KR20130086192A - Unmanned aerial vehicle system operated by smart eyeglass - Google Patents

Abstract

PURPOSE: An unmanned aerial vehicle control method using smart glasses and a control system thereof are provided to make an unmanned aerial vehicle operator wear the smart glasses in order to maximize availability and utilization of an unmanned aerial vehicle, thereby controlling the unmanned aerial vehicle while photographing images with a camera of the unmanned aerial vehicle. CONSTITUTION: An audio processing unit (170) converts a sound signal delivered by a control unit into an electrical signal. The audio processing unit outputs a converted electrical signal through a speaker (120) attached to smart glasses. A video processing unit (160) converts an image signal delivered by the control unit into a suitable signal for a display unit (110). The video processing unit outputs a converted image signal through the display unit. A direction detecting sensor (130) detects a moving direction of the smart glasses. [Reference numerals] (1) Microphone; (110) Display unit; (120) Speaker; (130) Direction detecting sensor; (140,5) Control unit; (160) Video processing unit; (170) Audio processing unit; (200) Still image camera; (6) Driving unit; (9) Video camera; (AA) Manual operation command; (BB) Automatic operation command; (CC) Still camera photographing command

Description

Unmanned Aerial Vehicle System operated by smart eyeglass}

Recently, smart glasses have been used to adjust and control vehicles and various electronic devices. As a representative example, Google introduced its smart glasses, Google glasses. The mediait June 6, 2013 report describes the Google Glasses, or Google Glass, well. Google Glass, which has been rumored for years, is an entirely new product. Apart from simply projecting information in the form of goggles, it is always connected to the network so that it can constantly communicate with augmented reality and SNS. The 8000 people who were selected as testers through the Glass Explorer program paid $ 1,500 to use an early version of Google Glass. The $ 1500 price is not the price of a commercial version and is expected to be significantly lower when released. The spec of the Google Glass test version is a bit less than the latest smartphones. It is equipped with a 5 million pixel camera module and can shoot 720p video. Of the 16GB of internal memory, 12GB can be used by the user and synced with Google Drive, Google's cloud service. A display smaller than a fingernail is said to look like a 25-inch high-definition screen about 2.5 meters away. The voice employs a stiffness oscillator so that you can hear the sound without connecting it directly to the eardrum. Supporting networks are Wi-Fi (IEEE 802.11b / g) and Bluetooth, and testers say the built-in battery can last three to five hours of continuous use when fully charged. To charge, use a micro USB cable. Here's what you can do with Google Glass: Video chat, you can still video chat, but has the disadvantage of giving up the freedom of both hands. But with Google Glass, you can share your everyday face-to-face contact on the go. In addition, you can share the scenery you see. To shoot video, until now, to shoot video, you had to hold the camera and keep your arms steady. But with Google Glass, you can easily record what you see without shaking. Navigation, the most impressive part of the Google Glass demo video was this navigation. Like the HUD (Head Up Display) used in cars, navigation is superimposed on the front of the real screen, even when you are walking, biking, or moving in a car. Voice messages, programs such as Samsung's S Voice, LG's Q Voice, and Apple's Siri can also send voice messages, but Google Glass can send messages more elegantly and formally. Augmented reality, this feature will be a key feature of Google Glass. If you go to the museum while wearing Google Glass, you can display additional descriptions in line with your artwork when listening to famous paintings, or listen to the audio commentary through the Docent app. If you ask to see nearby restaurants, you will be able to order restaurants online as soon as you see the restaurant location and trade name in front of you. Even if you see a foreign language you don't know, it can be automatically translated to tell you what it is, or you can switch your voice to your local language.

  Meanwhile, in the private sector, unmanned aerial vehicles are currently used in various countries around the world for shooting and surveillance of the ground. For example, in the case of China, according to the August 29, 2012 report of China, China launched an unmanned aerial vehicle and launched a large-scale maritime surveillance. An overseas version of the People's Daily of the Communist Party reported on Wednesday that it plans to deploy more than one to monitor the jurisdiction of the province. The Maritime Affairs Bureau requires precise marine monitoring and detection in the context of increasing maritime development, and explained that satellite or aviation remote sensing and local monitoring and detection, which are currently used as major marine monitoring means, are lacking in many aspects, such as precision and convenience. The Maritime Bureau's Director of Maritime Affairs Bureau said that unmanned aerial vehicles can be photographed while flying in orbit with a new remote monitoring tool, which will ensure real-time picture and video with excellent resolution. It will be a big help to resource protection. The measure, however, is intended to prepare for an increasingly fierce territorial dispute in the East and South China Seas. Chinese authorities have reported satisfactory results by conducting unmanned aerial vehicle remote sensing tests in the last six months.

Next, in military use, unmanned aerial vehicles are classified into ultra low altitude (less than 5,000 ft), low altitude (5,000 to 20,000 ft), medium to high (20,000 to 45,000 ft), and altitude (more than 45,000 ft) by flight altitude. As of the end of 2007, UAVs operated by the US military were 528 tactical and strategic class medium and large sized UAVs, and 3,437 small UAVs. Among them, the MQ-1 Predator, which is a representative UAV, is a General It is an unmanned aerial vehicle manufactured by Atomics with a reconnaissance of 8.1m and a wingspan of 14.8m.It has a 920-kilometer operating radius and can carry up to 200 kilograms of airborne cargo at more than 24 hours. Use optical (EO), infrared (IR) and Synthetic Aperture Radar (SAR) to perform reconnaissance and target acquisition missions.

 Accordingly, the present invention relates to the unmanned aerial vehicle that shoots, monitors, and attacks on the smart glasses and the ground or a specific area as described above, and more specifically, the unmanned aerial vehicle operator operates the air by wearing the smart glasses. It is about unmanned aerial vehicle control and control system using smart glasses that can transmit and receive in real time and simultaneously perform shooting and adjustment for unmanned aerial vehicle.

ZDNet Korea's June 8, 2013 report details the background of smart glasses such as Google glasses. According to the contents, the era of devices worn on the body by Google Glass will be opened. IT devices move quickly from a PC in the room to a smartphone in the hand and back to a product you can wear on your body. On June 7 (local time) CNET reported the history of the glasses-shaped smart device, the ancestor of Google Glass, with photos. The spectacle device, the ancestor of Google Glass, has been around for over 40 years. After Ivan Sutherland's eyeglasses, which was a researcher at the University of Utah in 1968, we can see the history of various glasses-type digital devices from Google Glass this year. First of all, in 1968, Ivan Sutherland, 45 years ago, developed the Damocles sword. Damonculus' knife opened the beginning of the history of spectacle devices. Damocles' sword is a display worn on the head. Ivan Sutherland is a researcher at the University of Utah. The instrument was developed with his student, Bob Sparrow. Next, Steve's Wearcom1 was developed by Steve Mann in 1980. Steve Mann is a professor of computer and electrical engineering at the University of Toronto and a senior member of the IEEE. He is an author of early augmented reality. In order to create a visual experience, WearComp 1 needed to attach various devices to every corner of the body. The antenna ran to capture radio signals. You can also watch videos through the device. Next, Steve Man Pineberg, a pioneer in augmented reality and eyeglass digital devices, and Steve Man Pineberg, professor of computer science at Columbia University, made augmented reality mobile devices using transparent displays for the first time in 1996. University of Toronto professor Steve Mann has spent more than 35 years developing digital glasses. Regarding Steve's `` WarComp 4 '', Ware Comp 4 was released in 1984 when Apple's Macintosh was released. Developed by Steve Mann, the WearComp 4 had to wear signal processing equipment like clothes. The display on the left eye shows a variety of images. Like the WearComp 1, it has an antenna for wirelessly transmitting voice and video. In 1984, when WarCompass 4 was released, William Gibson was the subject of augmented reality in science fiction neuromancers. In 1989, Reflection Technology's The Private Eye came out, and in 1989, The Private Eye was equipped with a vibrating mirror and a vertically arranged LED display. The Private Eye has a 1.25 inch, black and white screen. Next, in 1998, about augmented reality goggles Eyetap, Steve's interest in digital glasses began after he had learned to weld with his grandfather. He used video cameras, displays, and computers to keep a good eye on the front while welding. Subsequently, about Digital Eyeglasses, Steve Mann, the father of digital glasses, wore Eyetap, released in 1999. Eyetap, worn by Mann, could record visual images and overlay digital images. The eyes and camera could be used at the same time. Instead, he had to attach a small computer to his body. Next, for Micro Optical's Task 9, Micro Optical was founded in 1995 by Mark Spitzer. Micro Optical closed down in 2010, but the patented technology was acquired by Google. Mark Spitzer is currently on the board of directors of Google X Lab. Next, for Microvision's Nomad Digital Display in 2005, Microvision is a supplier of automotive head-up displays. For the next nonwoven V920 in 2005, the nonwoven developed the V920 video glasses in 2005. The company sold out video glasses for 15 years. For the next 2008 MyView Personal Media Viewer Crystal Edition, MyView's Personal Media Viewer is a device that allows you to receive and watch videos from outside. The device that supplies the video may be an iPod. The media viewer gave the effect of watching a big screen with a small screen. For the next nonwoven labs see-through prototype in 2009, the nonwovens developed the labs see-through in 2009, following the 2005 V920 video glasses. Next year, BizComm released my new digital glasses in 2010. MyView was founded in 1995 by Mark Spitzer, a founder of Micro Optical. In 2011, the nonwoven lab AR920 was developed. For the next 2013 prototype for Meta's developer, Meta's eyeglasses create the illusion that it's in 3D space. You can also interact with the virtual world using your hands. Metasystem has developed 3D stereoscopic glasses and motion control system that can be found in movies such as Iron Man and Avatar. Meta plans to release stylish glasses in 2014 (Reporter Song Ju-young).

Unmanned Aeriel Vehicles (UAVs) or Unmanned Aircraft Systems (UASs), on the other hand, are generally used by remote control on the ground without a pilot, or by a pre-programmed program or around the aircraft itself. A vehicle that recognizes, judges, and flies autonomously, or a flight system having some or all of these functions. In 1988, the Korea Aerospace Industries and Seoul National University jointly developed a snipe, with the National Defense Science Research Institute starting with the kite, a jet-propelled unmanned drone in the 1980s. Later, by completing the development of the falcons in operation by the Korean aerospace industry and the Army Corps, Korea became one of the ten nations in the world currently operating independent-developed drones.

In detail, the field of application of unmanned aerial vehicle is real-time reconnaissance (reconnaissance of area, line and point target), artillery fire guidance, combat damage assessment, sea and coast monitoring, mine detection, electronic warfare (deception, attack, defense). , Radar disturbance and destruction, unmanned aerial combat, unmanned bombing, coastal landing operations, and pioneering air routes. In the civil field, it is also used for border patrols, aerial photographs of terrain and facilities, forest fires and forest surveillance, coastal and ship surveillance, crime screening and tracking, control and prevention, weather data collection, disaster prevention, communication relay, environmental monitoring, and disaster relief. have. As such, the unmanned aerial vehicle can be used in various fields of civilian, military and civilian governments with the advantage that it can achieve its intended purpose without damage to life with minimal cost.

As described above, since the unmanned aerial vehicle is widely used for military or observation purposes, various devices are used together with the unmanned aerial vehicle for its operation. However, in such an unmanned aerial vehicle, smart glasses having various functions and advantages as described above have not yet been used for control and steering, which reduces the availability and utility of the unmanned aerial vehicle. Therefore, the present invention provides an unmanned aerial vehicle control and control system using a smart glasses to allow the unmanned aerial vehicle operator to wear smart glasses, and transmit and receive in real time with the unmanned aerial vehicle operating in the air to perform shooting and adjustment for the unmanned aerial vehicle at the same time. For the purpose, in particular, a device capable of receiving images captured by the unmanned aerial vehicle in real time and displaying them on a smart glasses screen and an unmanned aerial vehicle that can automatically adjust the movement and shooting direction of the unmanned aerial vehicle according to the direction of movement of the smart glasses. The company began to develop aircraft movement and camera control systems.

Related prior arts include a drone control system and a method thereof (Korean Patent No. 10-0999556), a method of collecting and transmitting unmanned information floating in the air, and a system thereof (Korean Patent Registration 10-1103846).

An object of the present invention is to use the unmanned aerial vehicle control and control system using the smart glasses to allow the unmanned aerial vehicle operator to wear the smart glasses to proceed with the shooting and adjustment at the same time for the unmanned aerial vehicle to maximize the availability and utility of the unmanned aerial vehicle A device capable of receiving images captured by an unmanned aerial vehicle in real time and displaying them on a smart glasses screen, and a moving camera and an unmanned aerial vehicle that can automatically adjust movement and shooting directions according to the change of direction of the smart glasses. It is intended to provide an adjustment system.

The present invention has been made to solve the above problems, an object of the present invention is to provide a display device that can be displayed in real time by receiving the image taken by the camera attached to the unmanned aerial vehicle to the drone operator wearing smart glasses. have. It is another object of the present invention to automatically control the moving direction of the unmanned aerial vehicle according to the switching direction of the smart glasses whenever the direction of the smart glasses is controlled by the drone operator wearing the smart glasses, unmanned to adjust the shooting direction It provides a camera control device of the aircraft. It is another object of the present invention to provide a display device capable of giving an effect such as boarding an aircraft to a ground man by showing the image taken by the drone in real time to the drone man wearing the smart glasses. .

Next, the method for controlling an unmanned aerial vehicle for photographing an aerial photograph using smart glasses according to the present invention for achieving the above object comprises the steps of: the unmanned aerial vehicle entering the air over the monitoring and photographing area and autopiloting; Generating a video camera photographing command by a controller mounted on the unmanned aerial vehicle to operate a video camera mounted on the unmanned aerial vehicle by a driver; The video obtained by the video camera is transmitted to the video receiver located on the ground by the video transmitter connected to the video camera and displayed on the smart glasses connected to the video receiver in real time, and is controlled by the controller inside the unmanned aerial vehicle connected to the video camera. Transmitted; A control unit reading an image transmitted by the video camera in real time to determine whether a display on the image is an object to be monitored and photographed; If it is determined by the controller that the display object matches the object to be monitored and photographed, a still image camera operation signal is generated by the controller of the unmanned aerial vehicle so that the driver operates the still image camera to photograph the aerial photograph of the object to be monitored and photographed. step; And a still image camera operation signal is generated by the control unit of the unmanned aerial vehicle, and the driving unit operates the still image camera to photograph the aerial photograph of the object to be monitored and photographed, and displays it on the smart glasses of the unmanned aerial vehicle operator on the ground. If it is determined by the controller that the target is not the object to be monitored and photographed, an operation signal is generated by the controller to drive the driver to operate the unmanned aerial vehicle again.

Operation commands for the unmanned aerial vehicle, such as take-off, landing and movement of the unmanned aerial vehicle, when the unmanned aerial vehicle operator manually takes off the unmanned aerial vehicle, then enters the surveillance and shooting area, and enters the shooting and monitoring area. After arriving, it is advisable for the unmanned aerial vehicle operator to provide automatic piloting orders for the area to be monitored and photographed. In addition, if the unmanned aerial vehicle automatically detects and monitors a shooting area while traveling, it is desirable to adjust the camera shooting direction by changing the direction of the smart glasses. In addition, in the unmanned aerial vehicle system, it is preferable to use a satellite communication network of a radio or GPS satellite and a communication satellite.

As described above, the present invention automatically adjusts the shooting direction of the camera mounted on the unmanned aerial vehicle according to the switching direction of the smart glasses whenever the direction of the smart glasses by the drone operator wearing the smart glasses and the camera By showing the video taken by the unmanned aerial vehicle operator wearing the smart glasses in real time, gives the ground operator the same effect as boarding the aircraft. Therefore, as in a real aircraft by wearing smart glasses having various functions and advantages, it is possible to increase the availability and usability of the unmanned aerial vehicle by controlling and adjusting the unmanned aerial vehicle. By real-time transmission and reception with the unmanned aerial vehicle in flight, the unmanned aerial vehicle can shoot and adjust simultaneously, and provide the control and control system for the unmanned aerial vehicle using smart glasses, especially photographed by the unmanned aerial vehicle Provides a device that can receive the image in real time and display on the screen of the smart glasses, and provides the control and control of the unmanned aerial vehicle and camera control system that can automatically adjust the movement and shooting direction according to the switching direction of the smart glasses It works.

1 is a schematic diagram of a transmission and reception system between an unmanned aerial vehicle operator and an unmanned aerial vehicle wearing smart glasses according to an embodiment of the present invention.
2 is a schematic diagram of an unmanned aerial vehicle control system for monitoring and aerial photographing according to an embodiment of the present invention.
3 is a flowchart illustrating a method for controlling an unmanned aerial vehicle for monitoring and photographing aerial photographs according to an embodiment of the present invention.

Hereinafter, an unmanned aerial vehicle system using smart glasses according to the present invention will be described in detail with reference to the accompanying drawings.

According to an aspect of the present invention, there is provided a display apparatus for wirelessly receiving and displaying an image photographed from an unmanned aerial vehicle, the display apparatus comprising: a display unit for displaying an image signal; A radio frequency transceiver configured to be mounted on the smart glasses and convert radio frequency signals transmitted from the unmanned aerial vehicle into baseband signals; A control unit mounted on the smart glasses and transmitting in real time from the unmanned aerial vehicle and outputting an image signal received through the radio frequency transceiver; An audio processor mounted on the smart glasses and converting a sound signal transmitted by the controller into an electrical signal and outputting the electrical signal to a speaker mounted on the smart glasses; A video processor mounted on the smart glasses and converting an image signal transmitted by the controller into a signal suitable for the display unit and outputting the signal to the display unit; And a direction detecting sensor mounted on the smart glasses to detect a moving direction of the smart glasses. The display unit is attached to the smart glasses to be located on the front or one side of the wearer wearing the smart glasses. The control unit outputs a video signal and a sound signal included in the composite video signal transmitted from the unmanned aerial vehicle to the video processor and the audio processor, respectively, and outputs a direction signal detected by the direction sensor through the radio frequency transmitter / receiver. Send to the unmanned aerial vehicle in real time. The radio frequency transmitting and receiving unit converts the direction signal transmitted from the control unit to a radio frequency signal and transmits it to the unmanned aerial vehicle.

Next, the present invention provides an unmanned aerial vehicle that transmits a video signal taken by photographing a surrounding image to an external device such as smart glasses, the microphone for receiving ambient sound; Still image and video camera for taking a picture of the surrounding; A driving unit for switching a shooting direction of the still image and video camera; The driving unit outputs a composite video signal including a sound signal input from the microphone and a video signal captured by the still image and video camera, and switches the direction of the still image and video camera according to a direction signal. A control unit for controlling; And converting the composite video signal transmitted from the controller into a radio frequency signal and transmitting the radio frequency signal to the external device in real time, converting the direction signal transmitted from the external device into a radio frequency signal to a baseband signal and transmitting the radio signal to the controller. It includes a frequency transceiver.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram of a transmission / reception system between an unmanned aerial vehicle operator and an unmanned aerial vehicle wearing smart glasses to which the present invention is applied, and a smart signal displaying in real time an image signal provided as a radio frequency signal worn by the operator 300 of the unmanned aerial vehicle; Glasses 100, and the unmanned aerial vehicle 200 that shoots the image of the ground through the mounted camera and transmits the captured image to the smart glasses 100 as a radio frequency signal. The smart glasses 100 are provided with a display function of the video signal and the output function of the sound signal to the smart glasses 100 on the smart glasses 100 in real time on the image taken in the air by the camera of the unmanned aerial vehicle 200 By displaying and also providing a sound signal such as sound generated in the vicinity of the unmanned aerial vehicle 200 through the smart glasses 100, so that the wearer of the smart glasses 100 to feel like aboard the plane on the ground. And, the wearer unmanned aerial vehicle operator 300 is wearing the smart glasses 100, in real time to send and receive over the unmanned aerial vehicle 200 in flight over the unmanned aerial vehicle 200 to proceed with the shooting and adjustment at the same time By acting as a control and control function for the unmanned aerial vehicle 200, the camera shooting direction of the unmanned aerial vehicle 200 automatically according to the movement direction of the smart glasses 100. It is adjustable. The unmanned aerial vehicle 200 captures an image of the ground from the air through a mounted camera, receives a sound generated from the surroundings through a mounted microphone, and then outputs a composite video signal including the captured video signal and the input sound signal. Converts to a radio frequency signal and transmits to the smart glasses (100).

Here, the unmanned aerial vehicle 200 transmits the composite video signal to the smart glasses 100 using the 2.4GHz Industrial Scientific Medical (ISM) frequency which can be used without a separate legal permission, but unilaterally combines it without using an address. The video signal is converted into a radio frequency signal and transmitted. When the smart glasses 100 detect the direction of movement whenever the direction is moved by the wearer, and converts the detected direction signal into a radio frequency signal and transmits the signal to the unmanned aerial vehicle 200 in real time, the unmanned aerial vehicle 200 is smart. The photographing direction of the mounted camera is changed to the direction in which the smart glasses 100 are moved according to the direction signal transmitted from the glasses 100.

Looking at the present invention applied to the smart glasses 100 and the unmanned aerial vehicle 200 performing such a function as follows. 2 is a schematic diagram of an unmanned aerial vehicle control system for monitoring and aerial photographing according to an embodiment of the present invention.

Referring to FIG. 2, the display apparatus of the present invention includes a display unit 110 for displaying an image signal, a speaker 120 for outputting a sound signal, and a direction for detecting the movement direction of the smart glasses 100. Outputs a video signal and a sound signal included in the direction sensor 130 and the composite video signal transmitted from the unmanned aerial vehicle 200 to the display 110 and the speaker 120, respectively, to the direction sensor 130 The controller 140 transmits the direction signal detected by the unmanned aerial vehicle 200, and converts the radio frequency signal transmitted from the unmanned aerial vehicle 200 into a baseband signal and transmits the signal to the controller 140. By converting the transmitted direction signal to a radio frequency signal to the radio frequency transceiver 150 for transmitting to the unmanned aerial vehicle 200, and converts the image signal transmitted by the control unit 140 into a signal suitable for the display unit 110 display And a video processor 160 for outputting to 110 and an audio processor 170 for converting the sound signal transmitted by the controller 140 into an electrical signal suitable for the speaker 120 and outputting the electrical signal to the speaker 120. .

The display device of the present invention having such a configuration is disposed on the smart glasses 100 and driven by a battery or a battery. The display unit 110 receives and displays an image signal provided in real time from the unmanned aerial vehicle 200 by the controller 140, so that the wearer of the smart glasses 100, which is the operator 300 of the unmanned aerial vehicle, actually boards the plane. To directly control and adjust the unmanned aerial vehicle. Accordingly, when the wearer who is the driver 300 of the drone wears the smart glasses 100, the display unit 110 is implemented to be located at the front or one side of the wearer's eye, and the display unit of the smart glasses 100 ( 110 may be implemented to be able to move in the vertical direction. That is, when the image signal provided from the unmanned aerial vehicle 200 is photographed by the camera of the unmanned aerial vehicle 200, the display unit 110 is positioned in front of the wearer's eye, and when the display unit 110 displays the smart glasses ( 100) to be located on one side. In addition, the display 110 may be implemented as a liquid crystal display (LCD).

The speaker 120 receives and outputs a sound signal generated in the vicinity of the unmanned aerial vehicle 200 in real time, so that the wearer of the smart glasses 100 which is the operator 300 of the unmanned aerial vehicle is photographed by the unmanned aerial vehicle 200. While watching the video signal, at the same time it can listen to the sound signal generated from the surroundings to give a higher sense of reality. The speaker 120 is attached to the smart glasses 100, it will be preferable to be implemented as a pair so that the wearer is located near both ears of the wearer when wearing the smart glasses 100.

The direction sensor 130 detects the direction of the moved head when the wearer who wears the smart glasses 100 on the head, which is the operator 300 of the drone, moves the head to the controller 140. The direction signal detected by the transmission is transmitted to the unmanned aerial vehicle 200 in real time. This is to allow the wearer of the smart glasses 100, which is the manipulator 300 of the drone, to move his head to move the photographing position of the camera mounted on the drone 200. Accordingly, the manipulator of the drone ( The wearer 300) can move his head to see the image in the direction he wants to see in real time.

When the composite video signal transmitted from the unmanned aerial vehicle 200 is received through the RF transmitter / receiver 150, the controller 140 outputs a video signal and a sound signal included in the received composite video signal to the video processor 160. Output to the audio processor 170. In this case, the video processor 160 converts an image signal transmitted by the controller 140 into a signal suitable for the display 110 and outputs the signal to the display 110, and the audio processor 170 controls the controller 140. The sound signal transmitted by converts into an electrical signal suitable for the speaker 120 and outputs to the speaker (120). In addition, the controller 140 transmits the direction signal detected by the direction sensor 130 to the unmanned aerial vehicle 150 through the radio frequency transceiver 150 in real time. The radio frequency transceiver 150 converts a radio frequency signal of the 2.4 GHz ISM band transmitted from the unmanned aerial vehicle 200 into a baseband signal and transmits the signal to the controller 140, and also transmits a direction signal transmitted from the controller 140. The 2.4GHz ISM band is converted into a radio frequency signal and transmitted to the unmanned aerial vehicle 200.

2, the unmanned aerial vehicle 200 of the present invention includes a microphone 210 for receiving ambient sounds, a still image camera 7 and a video camera (that is, a camera for capturing surrounding images). 9) and the composite video signal including the sound signal input from the microphone 210 and the video signal photographed by the still image camera 7 and the video camera 9 to the smart glasses 100, smart glasses ( The control unit 5 for controlling the movement of the shooting direction of the still image camera 7 and the video camera 9 in accordance with the direction signal transmitted from the 100, and baseband to the radio frequency signal transmitted from the smart glasses 100 And converting the signal into the control unit 5 and converting the composite video signal transmitted from the control unit 5 into a radio frequency signal and transmitting the radio frequency transmission and reception unit 240 and the control unit 5, Still video camera under control (7 And a driving unit 6 for moving the position of the video camera 9. The microphone 210 receives a sound generated in the vicinity of the unmanned aerial vehicle 200 and outputs an electric sound signal suitable for the controller 5 to the controller 5. The still image camera 7 and the video camera 9 capture an image of the unmanned aerial vehicle 200 in flight according to a shooting instruction of the controller 5, and deliver the image to the controller 5 in real time, and also by the driving unit 6. The shooting direction is shifted. Therefore, it is preferable that the controller 5 has a function of reading the image captured by the still image camera 7 and the video camera 9 and transmitted in real time. In addition, the control unit 5 is smart through the radio frequency transceiver 240, a composite video signal including a sound signal input from the microphone 210 and the video signal captured by the still image camera 7 and the video camera (9). Real-time transmission to the glasses 100, and also controls the movement of the shooting direction of the still image camera 7 and the video camera 9 in accordance with the direction signal transmitted from the smart glasses 100. The radio frequency transceiver 240 converts the radio frequency signal of the 2.4 GHz ISM band transmitted from the smart glasses 100 into a baseband signal and transmits the signal to the control unit 5, and also the complex video signal transmitted from the control unit 5. And converts the radio frequency signal of the 2.4GHz ISM band and transmits to the smart glasses (100). The driving unit 6 moves the photographing directions of the still image camera 7 and the video camera 9 in the direction indicated by the control unit 5.

The unmanned aerial vehicle 200 may be configured as an unmanned aerial vehicle system to perform operations such as shooting and monitoring according to a control and adjustment command of the operator 300 of the unmanned aerial vehicle. Therefore, with reference to Figures 1, 2 and 3 will be described in more detail below.

In the control and adjustment method of the unmanned aerial vehicle 200 for monitoring and photographing aerial photographs using the smart glasses 100 according to the present invention, the operator 300 manually takes off the unmanned aerial vehicle 200 and the unmanned aerial vehicle 200 ) Into the air of the monitoring and shooting area, and give the automatic control command (S10), the unmanned aerial vehicle 200 receives the GPS signal to calculate the current position of the aircraft and is input to the unmanned aerial vehicle 200 It calculates the longitude, latitude, and altitude of the surveillance and shooting area, automatically moves to the monitoring and shooting area, and then traverses the monitoring and shooting area according to a pre-programmed program. After the unmanned aerial vehicle 200 is taken off as described above, a video camera 9 photographing command is generated by the controller 5 mounted on the unmanned aerial vehicle 200, and the driving unit 6 is mounted on the unmanned aerial vehicle 200. The operated video camera 9 is operated (S20).

As described above, the image obtained by the operation of the video camera 9 is transmitted to the video receiver 2 located on the ground by the video transmitter 8 connected with the video camera 9, and connected to the video receiver 2. The display unit 110 of the glasses 100 is displayed in real time, and is transmitted in real time to the control unit 5 connected to the video camera 9 (S30). In this case, the controller 5 may check whether the various displays in the image acquired by the video camera 9 are compared with the monitoring and photographing targets, which are input values, in real time.

Therefore, when the image captured and monitored by the video camera 9 is displayed on the display unit 110 of the smart glasses 100 as described above, the control unit 5 at the same time by the video camera 9 By reading the image transmitted in real time, and compared with the value previously input by the operator 300 of the unmanned aerial vehicle, it is determined whether the object to be monitored and photographed to take a still-steel photograph (S40). At this time, the operator 300 of the unmanned aerial vehicle may change the input values of the monitoring and shooting target to be taken in real time with respect to the smart glasses 100 worn by the user connected to the Internet. In addition, when the input value of the monitoring and shooting target to be photographed in the smart glasses 100 is changed, it may be transmitted to the control unit 5 in real time.

  When it is determined by the controller 5 that the display object matches the object to be monitored and photographed, the control signal 5 of the unmanned aerial vehicle generates a still image camera 7 operation signal, and the driving unit 6 causes the still image camera ( Operate 7) to photograph the aerial photograph of the monitoring and shooting target (S50). At this time, when the still image camera 7 operation signal is generated by the control unit 5 of the unmanned aerial vehicle, and the driving unit 6 operates the still image camera 7 to photograph the aerial photograph of the object to be monitored and photographed. It can be displayed by transmitting in real time to the smart glasses 100 of the drone operator 300 of (S60). At this time, when the aerial photo of the monitoring and shooting target is transmitted and displayed in real time to the smart glasses 100, at the same time the smart glasses 100 is displayed whether or not to continue the automatic mode for the monitoring and shooting area, drone operator 300 ), Auto mode or not, and if it is negative, go back to the previous monitoring step (S20) to continue monitoring and shooting missions. Proceed to Preferably, in the checking step (S40), if it is determined by the control unit 5 that the display is not the object to be monitored and photographed (S40), the unmanned aerial vehicle 200 is monitored and photographed area according to a pre-input program Continue to traverse (S20).

Operation commands for the unmanned aerial vehicle, such as takeoff and landing of the unmanned aerial vehicle 200 and movement in the air, allow the unmanned aerial vehicle operator to manually take off the unmanned aerial vehicle, and then enter into the monitoring and photographing area. After arriving at the surveillance area, it is advisable that the unmanned aerial vehicle operator will be able to cycle through the surveillance and photographing area with an automatic control command. In addition, if the unmanned aerial vehicle automatically detects and monitors a shooting area while traveling, it is desirable to adjust the camera shooting direction by changing the direction of the smart glasses. In addition, in the unmanned aerial vehicle system, it is preferable to use a satellite communication network of a radio or GPS satellite and a communication satellite.

The present invention is not limited to the above-described specific preferred embodiments, and various modifications can be made by those skilled in the art without departing from the gist of the present invention as claimed in the claims. Of course, such changes will fall within the scope of the claims.

100: smart glasses
110:
120: speaker
130: direction sensor
140, 5: control unit
150, 240: radio frequency transceiver
160: video processing unit
170: audio processing unit
200: unmanned aerial vehicle
300: drone manipulator
1: microphone
2: video receiver
3: command transmitter
4: command receiver
6: drive unit
7: Still video camera
8: Video Transmitter
9: video camera

Claims (1)

  A display unit mounted on the smart glasses and configured to display an image signal; A radio frequency transceiver configured to be mounted on the smart glasses and convert radio frequency signals transmitted from the unmanned aerial vehicle into baseband signals; A control unit mounted on the smart glasses and transmitting in real time from the unmanned aerial vehicle and outputting an image signal received through the radio frequency transceiver; An audio processor mounted on the smart glasses and converting a sound signal transmitted by the controller into an electrical signal and outputting the electrical signal to a speaker mounted on the smart glasses; A video processor mounted on the smart glasses and converting an image signal transmitted by the controller into a signal suitable for the display unit and outputting the signal to the display unit; And a direction detecting sensor mounted on the smart glasses to detect a moving direction of the smart glasses, wherein the display unit is located at the front of the wearer wearing the smart glasses or attached to any one side of the smart glasses. The controller outputs a video signal and a sound signal included in the composite video signal transmitted from the unmanned aerial vehicle to the video processor and the audio processor, respectively, and outputs a direction signal detected by the direction sensor to the radio frequency transmitter / receiver. In the unmanned aerial vehicle display apparatus using a smart glasses characterized in that it is transmitted to the unmanned aerial vehicle in real time, and the radio frequency transceiver transmits the direction signal transmitted from the controller to a radio frequency signal to transmit to the unmanned aerial vehicle, The unmanned aerial vehicle monitors and Steps to enter the Chamber of local spirits and autopilot; Generating a video camera photographing command by a controller mounted on the unmanned aerial vehicle to operate a video camera mounted on the unmanned aerial vehicle by a driver; The video obtained by the video camera is transmitted to the video receiver located on the ground by the video transmitter connected to the video camera and displayed on the smart glasses connected to the video receiver in real time, and is controlled by the controller inside the unmanned aerial vehicle connected to the video camera. Transmitted; A control unit reading an image transmitted by the video camera in real time to determine whether a display on the image is an object to be monitored and photographed; If it is determined by the controller that the display object matches the object to be monitored and photographed, a still image camera operation signal is generated by the controller of the unmanned aerial vehicle so that the driver operates the still image camera to photograph the aerial photograph of the object to be monitored and photographed. step; And a still image camera operation signal is generated by the control unit of the unmanned aerial vehicle, and the driving unit operates the still image camera to photograph the aerial photograph of the object to be monitored and photographed, and displays it on the smart glasses of the unmanned aerial vehicle operator on the ground. If it is determined by the control unit that the target is not the object to be monitored and photographed, an operation signal is generated by the control unit to drive the unmanned aerial vehicle again; Unmanned aerial vehicle control and control system using a smart glasses, characterized in that it comprises a;

Images