CN105334864A

CN105334864A - Intelligent glasses and control method for controlling unmanned aerial vehicle

Info

Publication number: CN105334864A
Application number: CN201510822257.XA
Authority: CN
Inventors: 杨珊珊
Original assignee: Individual
Current assignee: Individual
Priority date: 2015-11-24
Filing date: 2015-11-24
Publication date: 2016-02-17
Anticipated expiration: 2035-11-24
Also published as: CN105334864B

Abstract

The invention discloses a pair of intelligent glasses and a control method for controlling an unmanned aerial vehicle, and belongs to the field of unmanned aerial vehicle application. The pair of intelligent glasses comprises a remote control command sender, a telemetry data receiver, an image display device, an eyeball motion monitoring device and a controller, wherein the eyeball motion monitoring device is arranged on the image display device and is used for transmitting aerial images of a shooting device carried on the unmanned aerial vehicle to the image display device for displaying; the controller is electrically connected with the eyeball motion monitoring device and the remote control command sender respectively, and is applicable to generating a control command and transmitting the control command to the unmanned aerial vehicle according to user eyeball motions detected by the eyeball motion monitoring device; and the shooting device is controlled according to the control command to perform corresponding actions. The invention provides a conception of adjusting the direction of the shooting device carried on the unmanned aerial vehicle by using the eyeball motions, and the natural motions of eyeballs during observation are fully utilized to automatically adjust the best field of view. Meanwhile, the eyeball motions are combined with the flight path control of the unmanned aerial vehicle.

Description

Intelligent glasses for controlling unmanned aerial vehicle and control method

Technical Field

The invention relates to the technical field of unmanned aerial vehicle application, in particular to intelligent glasses for controlling an unmanned aerial vehicle and a control method.

Background

With the mature development of the unmanned aerial vehicle, especially the multi-rotor unmanned aerial vehicle technology, the multi-rotor unmanned aerial vehicle is adopted for aerial photography, and an aerial photography image is transmitted back to a client side of a user through a real-time image transmission technology, so that the user can share a visual field with the unmanned aerial vehicle in real time, and the method becomes a promising requirement. In this case, the drone appears as a telescope to fly, and the user can view the distant scene through the screen.

For the convenience of unmanned aerial vehicle remote control, the display screen that corresponds the controller is given image real-time transfer to through the camera in unmanned aerial vehicle the place ahead at present mainly, and the operator looks a view or carries out corresponding control according to the pattern condition again, however, a defect that this kind of observation mode exists is: the image content can only be obtained from a third-party screen, and the feeling of being personally on the scene is difficult to be given.

Meanwhile, most of the existing unmanned aerial vehicles need to be matched with a ground computer for operation, so that the use field of the unmanned aerial vehicles is limited. A whole set of instruments such as ground data receiving equipment, data conversion equipment and video output equipment are needed for unmanned aerial vehicle aerial photography. Furthermore, the control of the orientation of the unmanned aerial vehicle in the air requires manual operation of a rocker or other equipment to change the orientation of the unmanned aerial vehicle. The inconvenience of operation and loaded down with trivial details to a great extent have restricted unmanned aerial vehicle's use.

Therefore, someone proposes to combine together wear-type intelligent glasses and unmanned aerial vehicle's picture transmission system, still goes to gather the image in real time through unmanned aerial vehicle, but the image that gathers comes directly sends for this wear-type intelligent glasses to direct projection lets the user can go to experience unmanned aerial vehicle's shooting field of vision with the mode of being personally on the scene in user's the field of vision.

In this way, the user can observe the object in a completely free moving mode without limitation of visual angle and space distance, and particularly in a top view mode, the user can generate a feeling of observing on the unmanned aerial vehicle and has no danger at all.

However, the problem among the prior art scheme is that the control to unmanned aerial vehicle and the shooting equipment on the unmanned aerial vehicle is separated with this wear-type intelligent glasses, and the user needs to use the control cabinet to operate unmanned aerial vehicle separately to because the field of vision is invaded by this wear-type intelligent glasses, at this moment be blind accuse to unmanned aerial vehicle's control, this kind of operation degree of difficulty has formed the popularization obstacle of above-mentioned scheme.

For example: the invention discloses an unmanned aerial vehicle capable of being monitored, shot and controlled through intelligent glasses, which is disclosed in Chinese patent application with the application number of 201410340859.7 and the invention name of 'an unmanned aerial vehicle capable of being monitored, shot and controlled through intelligent glasses'.

Another way is to give the unmanned aerial vehicle's control to the implementation of the third person, and the person wearing the intelligent glasses of wear is only attentive to experience. In this way, the wearer of the head-mounted intelligent glasses has no control capability for the content to be observed, and can only wait for the change of the observation range passively, so that the experience effect is greatly reduced.

Disclosure of Invention

The invention aims to provide intelligent glasses for controlling an unmanned aerial vehicle and a control method, which can enable a wearer of head-mounted intelligent glasses to autonomously select the observation visual field of the wearer without additional operation.

Another object of the present invention is to provide smart glasses and a control method for controlling an unmanned aerial vehicle, which can complete simple control of the unmanned aerial vehicle with minimal action cost on the basis of controlling the visual field.

In order to solve the technical problems, the technical scheme adopted by the invention is as follows:

the utility model provides an intelligent glasses for controlling unmanned aerial vehicle, unmanned aerial vehicle includes flying control panel and the shooting equipment, remote control instruction receiver, the telemetering data sender that are used for the aerial photograph, fly control panel with the remote control instruction receiver electricity is connected, shoot equipment with the telemetering data sender electricity is connected, intelligent glasses include remote control instruction sender, telemetering data receiver, image display equipment, eyeball action monitoring facilities, controller, eyeball action monitoring facilities set up in on the image display equipment, remote control instruction sender connects the remote control instruction receiver, the telemetering data receiver connects the telemetering data sender, the image display equipment with the telemetering data receiver electricity is connected, wherein,

transmitting the aerial image of the shooting device to the image display device for display through the telemetric data transmitter and the telemetric data receiver;

the controller is respectively electrically connected with the eyeball motion monitoring equipment and the remote control command transmitter and is suitable for generating and transmitting a control command to the unmanned aerial vehicle according to the eyeball motion of the user detected by the eyeball motion monitoring equipment;

and controlling the shooting equipment to perform corresponding actions according to the control instruction.

Further, the unmanned aerial vehicle further comprises a cradle head, the shooting device is carried on the cradle head, the controller comprises a cradle head controller, the cradle head controller is respectively electrically connected with the eyeball motion monitoring device and the remote control command transmitter, the controller is suitable for sending a cradle head control command to the unmanned aerial vehicle according to the eyeball motion of the user detected by the eyeball motion monitoring device, and the cradle head adjusts the shooting direction of the shooting device according to the cradle head control command.

Further, the controller further comprises a flight controller, the flight controller is respectively connected with the eyeball motion monitoring device and the remote control command transmitter, and the flight controller is suitable for transmitting a flight control command to the unmanned aerial vehicle according to the detected eyeball motion.

Further, the smart glasses further comprise a mode switching unit, wherein the mode switching unit is electrically connected with the flight controller and is adapted to generate a flight control command for switching the unmanned aerial vehicle between the first observation mode and the second observation mode.

Further, the mode switching unit includes a voice recognizer and/or a mode switching switch, wherein,

the voice recognizer is suitable for recognizing a preset voice instruction sent by a user and controlling the unmanned aerial vehicle to switch between the first observation mode and the second observation mode according to the preset voice instruction;

the mode switch is electrically connected with the eyeball motion monitoring equipment and is suitable for controlling the unmanned aerial vehicle to switch between the first observation mode and the second observation mode according to the preset eyeball motion, or

The mode switch is connected with the flight controller, and controls the unmanned aerial vehicle to switch between the first observation mode and the second observation mode according to the disconnection or connection state of the unmanned aerial vehicle.

Furthermore, the intelligent glasses further comprise an eyeball action analyzer which is respectively connected with the eyeball action monitoring equipment and the flight controller, and the eyeball action analyzer is suitable for analyzing the eyeball action in the second observation mode and controlling the flight of the unmanned aerial vehicle according to an analysis result.

According to another aspect of the present invention, there is provided a method for controlling a drone by smart glasses, including the steps of:

the intelligent glasses receive and display aerial images sent by the unmanned aerial vehicle;

monitoring eyeball movement of a user;

generating a control instruction according to the eyeball action and sending the control instruction to the unmanned aerial vehicle;

Further, the control command includes a pan-tilt control command and/or a flight control command.

Further, a mode switching step is included, so that the unmanned aerial vehicle switches between the first observation mode and the second observation mode.

Further, the method also comprises a flight control step, and specifically comprises the following steps:

analyzing the eyeball motion in the second observation mode;

and controlling the flight of the unmanned aerial vehicle according to the analysis result.

The invention discloses intelligent glasses for controlling an unmanned aerial vehicle and a control method thereof. Moreover, by means of an eyeball motion sensing technology, a user does not need to additionally control the holder on the unmanned aerial vehicle in other modes, and the experience process of the user is not interfered completely. Such control effect is good, and the authenticity of finding a view is high to whole equipment easily carries, and the people can realize the true observation effect on unmanned aerial vehicle on ground.

In addition, according to the intelligent glasses for controlling the unmanned aerial vehicle and the control method thereof, disclosed by the invention, the head-mounted intelligent glasses can select the observation visual field through an eyeball action sensing technology, and the control of the flight track of the unmanned aerial vehicle by utilizing the eyeball action can be realized by utilizing the psychological symbolic meaning analysis of the eyeball action.

The above description is only an overview of the technical solutions of the present invention, and in order to make the technical means of the present invention more clearly apparent, and to make the implementation of the content of the description possible for those skilled in the art, and to make the above and other objects, features and advantages of the present invention more obvious, the following description is given by way of example of the specific embodiments of the present invention.

Drawings

Various other advantages and benefits of the present invention will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. It is obvious that the drawings described below are only some embodiments of the invention, and that for a person skilled in the art, other drawings can be derived from them without inventive effort. Also, like parts are designated by like reference numerals throughout the drawings. In the drawings:

fig. 1 shows a schematic structural diagram of smart glasses for controlling a drone according to a first embodiment of the invention;

fig. 2 shows a schematic structural diagram of smart glasses for controlling a drone according to a second embodiment of the invention;

fig. 3 shows a flowchart of a method for controlling an unmanned aerial vehicle by using smart glasses according to a third embodiment of the invention;

fig. 4 shows a flowchart of a method for controlling the unmanned aerial vehicle by the smart glasses according to the fourth embodiment of the invention.

Detailed Description

Specific embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While specific embodiments of the invention are shown in the drawings, it should be understood that the invention may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

It should be noted that certain terms are used throughout the description and claims to refer to particular components. As one skilled in the art will appreciate, manufacturers may refer to a component by different names. This specification and claims do not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms "include" and "comprise" are used in an open-ended fashion, and thus should be interpreted to mean "include, but not limited to. The description which follows is a preferred embodiment of the invention, but is made for the purpose of illustrating the general principles of the invention and not for the purpose of limiting the scope of the invention. The scope of the present invention is defined by the appended claims.

For the purpose of facilitating an understanding of the embodiments of the present invention, the following description will be made in terms of several specific embodiments with reference to the accompanying drawings, and the drawings are not intended to limit the embodiments of the present invention.

An unmanned aerial vehicle is called an unmanned aerial vehicle (unmanned aerial vehicle) in short, and is called an unmanned aerial vehicle (uav) (unmanned aerial vehicle) in short, and is an unmanned aerial vehicle operated by using a radio remote control device and a self-contained program control device. From a technical point of view, the definition can be divided into: unmanned helicopters, unmanned fixed wing aircraft, unmanned multi-rotor aircraft, unmanned airships, unmanned paragliders, and the like. In recent years, with the improvement of sensor technology, the improvement of microprocessor technology, the improvement of power devices and the increase of battery endurance, the application of the unmanned aerial vehicle in military and civil fields is continuously and rapidly expanded, and the unmanned aerial vehicle market has wide prospects.

The preferred first-aid unmanned aerial vehicle in the embodiment of the invention is a multi-rotor unmanned aerial vehicle (or called multi-rotor unmanned aerial vehicle), and can be an unmanned aerial vehicle with four rotors, six rotors and rotors more than six. Preferably, the fuselage is made by carbon fiber material, satisfies under higher use strength and the prerequisite of rigidity, can alleviate the weight of fuselage by a wide margin to reduce many rotor unmanned vehicles's power demand and improve many rotor unmanned vehicles's mobility. Of course, in other embodiments of the invention, the fuselage may also be made of plastic or any other material used. The machine body is provided with a plurality of slurry arms which are symmetrically distributed relative to a symmetrical plane in the machine body, one end of each slurry arm, which is far away from the machine body, is provided with a paddle component, each paddle component comprises a motor and a paddle, the motor is installed on the slurry arm, the paddles are connected to an output shaft of the motor, and the rotation axis of each paddle is located on the same cylindrical surface.

The first-aid unmanned aerial vehicle adopted by the technical scheme of the invention mainly refers to a small and miniature multi-rotor unmanned aerial vehicle which has the advantages of small volume, low cost, good flight stability, low flight cost and the like. The aircraft used in the present invention is typically a four-axis multi-rotor aircraft.

Embodiment one, a smart glasses for controlling unmanned aerial vehicle.

Fig. 1 is a schematic structural diagram of smart glasses for controlling an unmanned aerial vehicle according to a first embodiment of the present invention, and the first embodiment of the present invention will be specifically described with reference to fig. 1.

As shown in fig. 1, an embodiment of the present invention provides a pair of smart glasses 101 for controlling a drone 107, where the drone 107 includes a flight control panel 110, a shooting device 111 for aerial photography, a remote control command receiver 108, and a telemetry data transmitter 109, the flight control panel 110 is electrically connected to the remote control command receiver 108, the shooting device 111 is electrically connected to the telemetry data transmitter 109, the pair of smart glasses 101 includes a remote control command transmitter 102, a telemetry data receiver 103, an image display device 106, an eye movement monitoring device 104, and a controller 105, the eye movement monitoring device 104 is disposed on the image display device 106, the remote control command transmitter 102 is connected to the remote control command receiver 108, the telemetry data receiver 103 is connected to the telemetry data transmitter 109, and the image display device 106 is electrically connected to the telemetry data receiver 103, wherein,

transmitting the aerial image of the shooting device 111 to the image display device 106 for display through the telemetric data transmitter 109 and the telemetric data receiver 103;

the controller 105 is electrically connected to the eye movement monitoring device 104 and the remote control command transmitter 102, and is adapted to generate and send a control command to the drone 107 according to the eye movement of the user detected by the eye movement monitoring device 104;

and controlling the shooting equipment 111 to perform corresponding actions according to the control instruction.

Specifically, the output end of the eyeball motion monitoring device is connected with the input end of the controller, the output end of the controller is connected with the remote control command transmitter, the output end of the remote control data receiver is connected with the input end of the image display device, the output end of the remote control command transmitter on the intelligent glasses is connected with the input end of the remote control command receiver on the unmanned aerial vehicle, the remote control command transmitter and the remote control command receiver are connected in a wireless communication mode, the output end of the remote control command receiver on the unmanned aerial vehicle is connected with the input end of the flight control panel, the output end of the flight control panel is connected with the input end of the shooting device, the output end of the shooting device is connected with the input end of the remote control data transmitter, and the output end of the remote control data transmitter on the unmanned aerial vehicle is connected with the input end of the remote control data, the telemetry data transmitter and the telemetry data receiver are connected through wireless communication. It should be noted that, in the present invention, the connection may be a wireless connection or a wired connection, and may also include a direct connection and/or an indirect connection, where the indirect connection means that another component may be disposed between two connected components.

Preferably, in an embodiment of the present invention, the eye movement monitoring device is an element for detecting an eye of a user of the drone and monitoring eye movement and eye gaze. The eye movement monitoring device is further configured to detect and capture eye gaze locations on the image display device and to measure the time of each eye gaze.

For eye gaze tracking, the eye movement monitoring device may employ many different types of technologies. For example, the eye movement monitoring device may take three steps to achieve eye gaze tracking:

in a first step, detecting an eyeball on the face of the user based on the haar-like features;

in a second step, tracking of the movement of the eyeball is performed using the lucas kanade algorithm;

in a third step, the eye gaze is detected using a gaussian process. Those skilled in the art will recognize that the techniques described above are not the only solution for eye gaze tracking, and that many other techniques may be used for eye gaze tracking. The camera is responsible for capturing and detecting the user's eye gaze point. The camera may be an element of the eye movement monitoring device.

Preferably, in an embodiment of the present invention, the controller further includes a storage, and the storage stores a table including eye movements and commands. In the table, each command is associated with a respective eye movement. For example, when the user's eye moves upwards, a translating eye movement upwards is detected using the eye movement monitoring device, and the detected eye movement is then compared with the eye movements in the table stored in the reservoir. If an eye movement matching the detected eye movement is found in the table, a command associated with the matched eye movement in the table is executed. If the command is 'the shooting equipment turns upwards', the flight control panel moves the lens direction of the shooting equipment on the holder upwards.

According to the embodiment of the invention, the movement of the holder is adjusted according to the movements of eyeballs in all directions, and the adjustment of the shooting direction of the shooting equipment carried on the holder is realized. For example, when the upward movement of the pupil of the eyeball is sensed, the shooting device is adjusted to move upward relative to the current position; when the pupil of the eyeball moves downwards, the shooting equipment is adjusted to move downwards relative to the current position. Other directions are similar principles. So, user's observation desire can be natural by the perception and satisfy, between the user is careless, just realized where the user wants to see, the camera just removes to where for user's observation experience obtains very big promotion.

In the above-described embodiments of the present invention, the eyeball motion can be detected even if the eyeball motion is deformed within a certain margin range compared with the reference eyeball motion thereof.

In an embodiment of the present invention, preferably, the unmanned aerial vehicle 107 further includes a pan-tilt, the shooting device 111 is mounted on the pan-tilt, the controller 105 includes a pan-tilt controller, the pan-tilt controller is electrically connected to the eyeball motion monitoring device 104 and the remote control command transmitter 102, and is adapted to send a pan-tilt control command to the unmanned aerial vehicle 107 according to the eyeball motion of the user detected by the eyeball motion monitoring device 104, and the pan-tilt adjusts the shooting direction of the shooting device 111 according to the pan-tilt control command.

Of course, the unmanned aerial vehicle in the embodiment of the present invention may not include the pan/tilt head, for example, the change of the shooting direction of the shooting device mounted on the unmanned aerial vehicle may also be implemented by the rotation motor.

Specifically, unmanned aerial vehicle includes unmanned aerial vehicle main part, the headstock of making a video recording, control support, the headstock of making a video recording passes through control support fixes the below of unmanned aerial vehicle main part front end, there is a pair of camera headstock the place ahead of making a video recording, control support includes main rotating electrical machines, side rotating electrical machines and support, main rotating electrical machines bottom is fixed the below of unmanned aerial vehicle main part front end, the tip of main rotating electrical machines's pivot has the support, the headstock both sides of making a video recording respectively with side rotating electrical machines's pivot links to each other, the terminal surface is fixed under the support in side rotating electrical machines bottom.

In an embodiment of the present invention, preferably, the image display device of the smart glasses may be a display screen, and may also adopt any structure that enables human eyes to feel an image, for example, a technology of projecting an image to an eyeball, which is not limited herein. In the following embodiments, a display screen is exemplified.

In an embodiment of the present invention, preferably, the smart glasses further include a smart glasses main body, support legs, a support leg connecting hinge, a button, a frame support for a display screen, a columnar image projector, an eye movement monitoring device, a frame connecting hinge, and an eye movement monitoring device fixing frame, the smart glasses main body has two frames, the support legs have a pair, one end of each support leg is connected to a side end of the smart glasses main body through the support leg connecting hinge, the frame of the smart glasses main body is provided with the remote control command transmitter and the remote measurement data receiver, respectively, corresponding to the remote control command receiver and the remote measurement data transmitter at the front end of the unmanned aerial vehicle main body, the eye movement monitoring device is fixed in the frame of the smart glasses main body through the eye movement monitoring device fixing frame, a lens of the eye movement monitoring device faces to an eyeball side, the picture frame support for the display screen is provided with 2 picture frames corresponding to the picture frames of the intelligent glasses main body, the display screen is arranged in the picture frames of the picture frame support for the display screen, the columnar image projector is fixed on the display screen, a lens of the columnar image projector leans against the display screen, the upper end of the picture frame support for the display screen is connected with the upper end of the intelligent glasses main body through the support connecting hinge, and the support legs are provided with buttons.

In the embodiment of the invention, preferably, the button on the support leg may be a camera button and/or a switch button, and the camera button (used for controlling the shooting device of the unmanned aerial vehicle to collect video data), the camera button (used for controlling the shooting device of the unmanned aerial vehicle to collect image data), and the switch button (used for controlling the work between the unmanned aerial vehicle and the smart glasses to be started and closed) may be set according to functions.

In the embodiment of the invention, preferably, a control touch screen is arranged below the end part of the support leg connected with the intelligent glasses main body, and the control touch screen below the support leg is used for controlling, so that an operator can conveniently hold the glasses for control, and the operation is very convenient.

In order to accurately position the eyeballs, the eyeball position and eyeball action monitoring devices are in a pair, and the eyeball position and eyeball action monitoring devices are symmetrically fixed on the upper and lower sections in a glasses frame of the intelligent glasses main body through eyeball action monitoring device fixing frames.

In an embodiment of the present invention, preferably, the smart glasses further include a memory for recording image or video information, for example, a RAM (random access memory), which is capable of recording image or video information sent by the controlled unmanned aerial vehicle, and the memory is electrically connected to the telemetry data receiver and the display screen, respectively. The intelligent glasses are head-mounted and can be worn on the head of a user, the wireless transmission module (such as the remote control command transmitter and the remote measuring data receiver) is in wireless communication with the unmanned aerial vehicle, images or videos collected by the unmanned aerial vehicle are transmitted to the memory, the images or videos are input into the display screen of the intelligent glasses through the memory to be displayed, and the user can see pictures transmitted by the unmanned aerial vehicle through the intelligent glasses so as to monitor the site environment or enjoy aerial landscapes during operation.

Preferably, in the embodiment of the present invention, the smart glasses include a telemetry data receiver, configured to receive image or video data transmitted by an unmanned aerial vehicle, where the image or video data is captured by a capturing device carried by the unmanned aerial vehicle; the number of the display screens is two, the display screens are respectively positioned at two lenses of the intelligent glasses and connected with the telemetering data receiver, and the display screens are used for displaying the image or video data received by the telemetering data receiver; the eyeball action monitoring equipment is used for sensing eyeball actions of a user of the intelligent glasses; the controller, with eyeball action monitoring facilities with unmanned aerial vehicle's flight control board links to each other for according to the eyeball action that eyeball action monitoring facilities sensed, control carry on the unmanned aerial vehicle shoot equipment and carry out corresponding action. For example, the eyeball motion monitoring device can sense that the eyeball moves leftwards, rightwards, upwards and downwards, and control a cloud deck of the shooting device carried on the unmanned aerial vehicle, so that the lens angle of view performs corresponding motions of moving leftwards, rightwards, upwards and downwards; or, the lens carrying the shooting device on the unmanned aerial vehicle can be directly controlled to perform zooming and retracting operations and the like through upward and downward movement of the eyeballs sensed by the eyeball motion monitoring device.

In the embodiment of the invention, the display screen is preferably a liquid crystal display screen. The intelligent glasses lens manufactured in the mode is thin, small in size and light in weight. The display screen may be a touch screen, so that in addition to the user input means (e.g. mode switching unit in the following) it may provide the user with the possibility to operate the drone on the display screen.

In the preferred embodiment of the present invention, a protective film is further disposed on the display screen. Specifically, the protective film is a glass protective film, mainly plays a role in protecting the display screen, and is bonded with the display screen through glue.

In an embodiment of the present invention, preferably, the smart glasses further include a video processor connected to the memory and the display screen, and configured to process the image or video data received by the telemetry data receiver and transmit the processed data to the display screen.

Preferably, in an embodiment of the present invention, the telemetry data receiver may receive, for example, picture data information captured by a camera mounted on the drone through a wireless receiver with a frequency of 5.8G, where the picture data information may be transmitted at a rate of 128kb/s and 540P pixels through a transmitter mounted on the drone (for example, the telemetry data transmitter described above); since the image or video data transmitted by wireless is processed by compression coding, a video decoding device can be arranged in the telemetering data receiver to restore the received image or video data to an adaptive mode shot by the shooting device through an image or video decoding technology, or the video decoding device can be arranged in the video processor.

Preferably, in an embodiment of the present invention, the telemetry data receiver may be configured to receive image or video data transmitted by the multi-rotor drone. Although the telemetering data receiver can receive image or video data transmitted by the fixed-wing unmanned aerial vehicle and the multi-rotor unmanned aerial vehicle, the fixed-wing unmanned aerial vehicle is characterized by high speed and incapability of hovering, so that the intelligent glasses in the embodiment of the invention are adopted to display shot images or videos, which may cause dizziness of users and damage to eyes of the users; the multi-rotor unmanned aerial vehicle, such as a four-rotor unmanned aerial vehicle and a six-rotor unmanned aerial vehicle, is characterized by being capable of hovering, so that the intelligent glasses in the embodiment of the invention are adopted to display a shot video, a user sees a picture shot by a lens hovering stably, and the user experience is more comfortable.

The imaging technology of the intelligent glasses has the following working principle: the intelligent glasses are a video receiving terminal combining optical, electrical and information technologies, which is developed along with the virtual reality technology in recent years. In the embodiment of the invention, the intelligent glasses different from other display terminals are used as the video display terminals, the intelligent glasses are small in size, light in weight and convenient to carry, and can display images or video images returned by shooting equipment (such as a card camera) carried by the quad-rotor unmanned aerial vehicle. Generally, the smart glasses may include a battery, a control circuit (which implements the function of the controller in the above), a display module (which implements the function of the display screen in the above), a wireless receiving module (which implements the function of the wireless receiver in the above), a mirror frame, and the like.

In addition, the working principle of the quad-rotor unmanned aerial vehicle is also described in the embodiment of the present invention to facilitate understanding of the implementation manner of acquiring the camera shooting image code in the embodiment:

four rotor unmanned aerial vehicle adopt four rotors as the direct power supply of flight, and four rotors symmetric distribution are in same high plane around the organism, about, four directions, and four rotors are in the same high plane, and the structure and the radius of four rotors are all the same, and wherein two rotors anticlockwise rotation, two other rotors clockwise rotation, the installation in the support end of four motor symmetries.

The quad-rotor unmanned aerial vehicle carries shooting equipment (such as a camera, a video camera and the like) to lift off, flight states and positions are controlled through a ground remote control device (such as the intelligent glasses or the wireless remote controller, the image data shot by the camera are stored in a video module in real time, are transmitted back to the intelligent glasses through a wireless technology after being processed by compression coding, are restored into an image or a video mode shot by the camera through a video decoding technology, and image data are displayed on a liquid crystal display screen on the intelligent glasses. Through image or video that present in the intelligence glasses can assist operating personnel to master quad-rotor unmanned aerial vehicle's flight state and shoot video angle at any time.

In an embodiment of the present invention, preferably, the unmanned aerial vehicle is further provided with a cradle head, a flight control panel, a GPS sensing module, an acceleration sensor, a gyroscope, a barometer, and a data transmission module (for example, the remote control command receiver and the telemetry data transmitter) for connecting with the smart glasses, the flight control panel is respectively connected with the cradle head, the GPS sensing module, the acceleration sensor, the gyroscope, the barometer, and the data transmission module, and two cameras are mounted on the cradle head. Specifically, the method comprises the following steps: the flight control panel controls the rotation of the holder, the GPS sensing module, the acceleration sensor, the gyroscope and the barometer are used for acquiring current position information and running state data of the unmanned aerial vehicle, and the data transmission module transmits video data by adopting a 4G technology, namely a TD-LTE-Advanced transmission technology, for example, and the transmission speed is high. The two cameras calculate the distance between the cameras and the focal point by using the focusing principle of focusing of the two cameras.

According to the embodiment of the invention, the image or video data shot by the light shooting equipment arranged on the unmanned aerial vehicle is transmitted to the intelligent glasses, and the first visual angle is adopted to carry out video recording on the unmanned aerial vehicle and the operation condition, so that ground remote control personnel can conveniently know the flight condition of the unmanned aerial vehicle in real time, a user has the experience of personally driving the unmanned aerial vehicle for observation, and the user experience is improved. Simultaneously, through above-mentioned structure, receive the video data that unmanned aerial vehicle transmitted through wireless receiver in intelligent glasses to show through the display screen, thereby only used a pair glasses just to realize among the correlation technique the ordinary or effect of consolidating the notebook computer that ground station system adopted, and, compare ordinary or consolidate the notebook computer, glasses are small, light in weight, and be convenient for hand-carry has solved the heavier problem of staff heavy burden among the correlation technique.

Preferably, in the embodiment of the present invention, the controller 105 further includes a flight controller, and the flight controller is respectively connected to the eye movement monitoring device and the remote control command transmitter 102, and is adapted to transmit a flight control command to the drone 107 according to the detected eye movement.

In an embodiment of the present invention, preferably, the smart glasses 101 further include a mode switching unit, where the mode switching unit is electrically connected to the flight controller, and is adapted to generate a flight control command for switching the unmanned aerial vehicle 107 between the first observation mode and the second observation mode.

Preferably, in an embodiment of the present invention, the mode switching unit includes a speech recognizer and/or a mode switch, wherein,

the voice recognizer is suitable for recognizing a preset voice instruction sent by a user, and controls the unmanned aerial vehicle 107 to switch between the first observation mode and the second observation mode according to the preset voice instruction;

the mode switch is electrically connected to the eye movement monitor 104, and is adapted to control the unmanned aerial vehicle 107 to switch between the first observation mode and the second observation mode according to a preset eye movement, or

The mode switch is connected to the flight controller, and controls the drone 107 to switch between the first observation mode and the second observation mode according to a disconnection or connection state thereof.

Preferably, in the embodiment of the present invention, the smart glasses 101 further include an eye movement analyzer, which is respectively connected to the eye movement monitoring device 104 and the flight controller, and is adapted to analyze the eye movement in the second observation mode and control the flight of the unmanned aerial vehicle 107 according to an analysis result.

In an embodiment of the present invention, a program for analyzing the image is preferably provided in the controller. In the program, different control commands are set for different eyeball actions, such as forward movement, backward movement, left rotation, right rotation, stop and the like, which respectively correspond to different pan-tilt control commands and/or flight control commands of the unmanned aerial vehicle.

Preferably, in an embodiment of the present invention, the communication components (remote control command transmitter, remote control command receiver, telemetry data transmitter, and telemetry data receiver) are configured to facilitate wired or wireless communication between the smart glasses, the drone, and other devices. Wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination thereof, may be accessed. In one exemplary embodiment, the communication component further includes Near Field Communication (NFC) communication to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data protocol (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies. For example, the smart glasses and other devices such as the user terminal, and the user terminal and other user terminals to be shared may communicate through NFC.

In the embodiment of the present invention, preferably, the shooting device for the unmanned aerial vehicle may include a fixed-focus motion camera such as hero3, a mini-single camera, a single lens reflex camera, and the like, the shooting device itself may support wireless control to realize remote control of the shooting device, and the camera used therein may also support WIFI control or infrared control to realize remote control of the camera, thereby performing shooting or video recording of the camera. The camera remote control may include various functions such as a shutter function, a camera zoom, a mode, and the like.

In embodiments of the present invention, the storage components (memory and storage) are configured to store various types of data to support operations on the system. These data include instructions for any application or method operating on the system. The storage component may be implemented by any type or combination of volatile or non-volatile storage devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The embodiment of the invention discloses intelligent glasses for controlling an unmanned aerial vehicle, and the head-mounted intelligent glasses naturally correspond to eyeballs of a user, so that the observation requirements and the selection of an observation range of the user can be best adapted by utilizing an eyeball action induction technology. Moreover, by means of an eyeball motion sensing technology, a user does not need to additionally control the holder on the unmanned aerial vehicle in other modes, and the experience process of the user is not interfered completely. Such control effect is good, and the authenticity of finding a view is high to whole equipment easily carries, and the people can realize the true observation effect on unmanned aerial vehicle on ground.

Embodiment two, a smart glasses for controlling unmanned aerial vehicle.

Fig. 2 is a schematic structural view of smart glasses for controlling an unmanned aerial vehicle according to a second embodiment of the present invention, which will be specifically described with reference to fig. 2.

As shown in fig. 2, an embodiment of the present invention provides a pair of smart glasses 201 for controlling a drone 107, where the drone 107 includes a flight control panel 110, a shooting device 111 for aerial photography, a remote control command receiver 108, and a telemetry data transmitter 109, the flight control panel 110 is electrically connected to the remote control command receiver 108, the shooting device 111 is electrically connected to the telemetry data transmitter 109, the pair of smart glasses 201 includes a remote control command transmitter 102, a telemetry data receiver 103, an image display device 106, an eye movement monitoring device 104, and a controller 202, the eye movement monitoring device 104 is disposed on the image display device 106, the remote control command transmitter 102 is connected to the remote control command receiver 108, the telemetry data receiver 103 is connected to the telemetry data transmitter 109, and the image display device 106 is electrically connected to the telemetry data receiver 103, wherein,

transmitting the aerial image of the shooting device 111 to the image display device 106 for display through the telemetry data transmitter 109 and the telemetry data receiver 103;

the controller 202 is electrically connected to the eye movement monitoring device 104 and the remote control command transmitter 102, and is adapted to generate and send a control command to the drone 107 according to the eye movement of the user detected by the eye movement monitoring device 104;

In an embodiment of the present invention, preferably, the unmanned aerial vehicle 107 further includes a pan-tilt, the shooting device 111 is mounted on the pan-tilt, the controller 202 includes a pan-tilt controller, the pan-tilt controller is electrically connected to the eyeball motion monitoring device 104 and the remote control command transmitter 102, and is adapted to send a pan-tilt control command to the unmanned aerial vehicle 107 according to the eyeball motion of the user detected by the eyeball motion monitoring device 104, and the pan-tilt adjusts the shooting direction of the shooting device 111 according to the pan-tilt control command.

In an embodiment of the present invention, preferably, the controller 202 further includes a flight controller, and the flight controller is connected to the eye movement monitoring device and the remote control command transmitter, respectively, and is adapted to transmit a flight control command to the drone 107 according to the detected eye movement.

In an embodiment of the present invention, preferably, the smart glasses 201 further include a mode switching unit 204, where the mode switching unit 204 is electrically connected to the flight controller, and is adapted to generate a flight control command for switching the unmanned aerial vehicle 107 between the first observation mode and the second observation mode.

Preferably, in an embodiment of the present invention, the mode switching unit 204 includes a speech recognizer and/or a mode switch, wherein,

the mode switch is electrically connected to the eye movement monitoring device 104, and is adapted to control the unmanned aerial vehicle 107 to switch between the first observation mode and the second observation mode according to a preset eye movement, or

Preferably, in this embodiment of the present invention, the preset voice instruction may include a similar voice instruction such as "start the first observation mode" and "start the second observation mode", and when the voice recognizer recognizes that the voice instruction issued by the user is "start the first observation mode", the unmanned aerial vehicle is controlled to switch to the first observation mode. Similarly, when the voice recognizer recognizes that the voice command sent by the user is 'start the second observation mode', the unmanned aerial vehicle is controlled to be switched to the second observation mode.

Preferably, in an embodiment of the present invention, the mode switch may include a key or a button on the smart glasses to input a character or a command, and further include a function of recognizing the character or the command input using the key or the button. The mode switch may be optional if the image display device on the smart glasses is a touch screen and the device is configured to allow the input of characters and commands on the image display device.

Preferably, in an embodiment of the present invention, the mode switch is electrically connected to the eye movement monitoring device 104, and is adapted to control the unmanned aerial vehicle 107 to switch between the first observation mode and the second observation mode according to a preset eye movement. The preset eye movement may comprise a blinking movement, for example, switching from the first observation mode to the second observation mode or from the second observation mode to the first observation mode when the eye movement monitoring device detects that the current user blinks three times in succession. Of course, the specific blinking times can be set according to the situation, and can even be intelligently adjusted according to different users. Preferably, a blink frequency can be set, the blink frequency and the blink work are combined, and even further, the blink action and the holder control instruction or the flight control instruction can be combined to respectively control the shooting equipment and the flight of the unmanned aerial vehicle.

Preferably, in the embodiment of the present invention, the smart glasses 201 further include an eye movement analyzer 203, which is respectively connected to the eye movement monitoring device 104 and the flight controller, and is adapted to analyze the eye movement in the second observation mode and control the flight of the unmanned aerial vehicle 107 according to an analysis result.

Preferably in an embodiment of the invention, the combination of the eye movements and the time period for completing the eye movements according to the invention generates different kinds of commands for operating the drone.

For example, an eye movement in which the eye gaze point moves from left to right. The "drone turns right" command is associated with a combination of this eye movement and a threshold time period T for completing this eye movement. If the eye movement is detected and the time period T for completing the eye movement is greater than or equal to a predetermined threshold time period T, a "drone turn right" command is executed, causing the drone to turn right. If the time T is shorter than T, the command is not executed, and the user only watches the content on the intelligent glasses image display equipment without adjusting the flight direction or the flight speed of the current unmanned aerial vehicle when the time T meets the condition that T is shorter than T, and flies according to a preset flight mode.

Different combinations of eye movement patterns and threshold time periods are stored in a reservoir. Further, the different commands are stored in the containers in a state in which the different commands are associated with respective combinations in the containers. These different combinations and the commands associated with them may be stored in a table format in a storage.

The eyeball motion actually reflects the observation interest point of the user, so the observation expectation of the user can be known by deeply analyzing the eyeball motion, and a typical observation expectation is as follows: when the user continuously observes a certain range, it often means that the user is interested in the location, and the user wants to know the specific location more clearly.

Therefore, the control mode of the unmanned aerial vehicle can be designed according to the interest points of the user. Namely, the observation mode of the unmanned aerial vehicle is divided into two modes, one mode is called as a first observation mode, the first observation mode is a static observation mode, the other mode is called as a second observation mode, and the second observation mode is a dynamic observation mode.

In the static observation mode, as described in the above embodiment of the present invention, the unmanned aerial vehicle stops at a certain specific position in the air, and the cradle head adjusts the orientation of the shooting device according to the cradle head control instruction obtained by the eyeball motion monitoring device, so that the shooting device meets the observation requirement of the user. When the eyeball motion monitoring equipment monitors the eyeball motion, the shooting direction of the shooting equipment can be automatically changed through the pan-tilt movement control, and therefore the landscape in the moving direction of the eyeball is moved to the center of the current observation range.

It should be noted that, since the user may need to perform a quick panoramic view of all the views in the current visual field, the eye movements may move around at a high speed, and in this case, the eye movement monitoring does not determine that the user is looking for an observation interest point everywhere, and the pan-tilt viewing range is adjusted quickly. Because, if such a fast and chaotic adjustment is implemented, it may cause a wide range of changes in the user's view and may cause the user to be dazzled. Therefore, only the continuous observation behavior that the eyeball moves slowly and has definite purpose and keeps for a certain time after moving can be recognized as the effective observation range change will by the system, and after the system judges the will, the pan-tilt control instruction for adjusting the observation range can be given.

In the dynamic observation mode, similarly, when the eyeball motion monitoring device monitors the eyeball motion, the shooting direction of the shooting device can be automatically changed through the pan-tilt movement control, so that the landscape in the moving direction of the eyeball is moved to the center of the current observation range.

Preferably, in the embodiment of the present invention, when the eye movement analyzer analyzes that the observation range of the current user is always kept unchanged (when a certain time threshold is exceeded, the pupil of the eye remains substantially unchanged, and the movement amplitude does not reach a degree of changing the field range preset in the system), the field range which is observed by the current user is a part which is interested by the user by default, so that the unmanned aerial vehicle can be controlled to fly towards the direction pointed by the current shooting device at a preset speed to approach the observed object in the direction; and when the eyeball action analyzer finds that the user continuously pays attention to a specific target for a long time, the specific target can be regarded as the willingness of detailed observation, and the flying action of the unmanned aerial vehicle moving and approaching is triggered, at this time, if the specific target is not in the current flying direction of the unmanned aerial vehicle, a flying control instruction for changing the flying direction of the unmanned aerial vehicle needs to be sent out.

The static observation mode and the dynamic observation mode can be freely switched by an instruction given by a user, and the instruction can be a trigger input type, a voice control type, an eyeball action type and the like.

Preferably, in an embodiment of the present invention, the controller can be implemented by a Central Processing Unit (CPU) and/or a coprocessor, a Field Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an application specific basic circuit (ASIC), and an embedded microprocessor (ARM), a microcontroller, a microprocessor, or other electronic components. Preferably, the controller includes a processing component, which further includes one or more processors, and memory resources, represented by memory, for storing instructions, such as application programs, executable by the processing component. The application program stored in the memory may include one or more modules that each correspond to a set of instructions.

The embodiment of the invention discloses intelligent glasses for controlling an unmanned aerial vehicle, which can select an observation visual field through an eyeball action sensing technology and also can utilize psychological symbolic meaning analysis on eyeball actions to realize the control of the flight track of the unmanned aerial vehicle by utilizing the eyeball actions.

For other contents in the embodiments of the present invention, reference is made to the contents in the embodiments of the present invention, and details are not described herein.

Embodiment three, a method for controlling an unmanned aerial vehicle by intelligent glasses.

Fig. 3 is a flowchart of a method for controlling an unmanned aerial vehicle by using smart glasses according to a third embodiment of the present invention, which will be specifically described with reference to fig. 3.

As shown in fig. 3, an embodiment of the present invention provides a method for controlling an unmanned aerial vehicle by using smart glasses, where the method includes the following steps:

step S301: the intelligent glasses receive and display aerial images sent by the unmanned aerial vehicle;

step S302: monitoring eyeball movement of a user;

step S303: generating a control instruction according to the eyeball action and sending the control instruction to the unmanned aerial vehicle;

step S304: and controlling the shooting equipment to perform corresponding actions according to the control instruction.

Preferably, in an embodiment of the present invention, the control command includes a pan-tilt control command and/or a flight control command.

Preferably, in the embodiment of the present invention, the control instruction includes a pan/tilt control instruction, and the pan/tilt on the unmanned aerial vehicle adjusts the shooting direction of the shooting device according to the pan/tilt control instruction.

Preferably, in the embodiment of the present invention, the control instruction further includes a flight control instruction, and the unmanned aerial vehicle controls a flight trajectory of the unmanned aerial vehicle according to the flight control instruction.

In an embodiment of the present invention, it is preferable that the method further includes a mode switching step, so that the drone switches between the first observation mode and the second observation mode.

In an embodiment of the present invention, preferably, the mode switching may be implemented by a speech recognizer and/or a mode switch, and when implemented by using the speech recognizer, the method includes the following steps:

recognizing a preset voice instruction sent by a user;

and controlling the unmanned aerial vehicle to switch between the first observation mode and the second observation mode according to the preset voice instruction.

Preferably, in the embodiment of the present invention, when the mode switch is used for implementation, the method includes the following steps:

judging whether a preset eyeball action is detected or not;

and if so, controlling the unmanned aerial vehicle to switch between the first observation mode and the second observation mode.

Preferably, in an embodiment of the present invention, the preset eye movement may include a blinking movement, for example, when the eye movement monitoring device detects that the current user blinks three times in succession, the eye movement monitoring device switches from the first observation mode to the second observation mode, or switches from the second observation mode to the first observation mode. Of course, the specific blinking times can be set according to the situation, and can even be intelligently adjusted according to different users. Preferably, a blink frequency can be set, the blink frequency and the blink work are combined, and even further, the blink action and the holder control instruction or the flight control instruction can be combined to respectively control the shooting equipment and the flight of the unmanned aerial vehicle.

Preferably, in the embodiment of the present invention, when the mode switch is implemented, the method further includes the following steps:

judging whether the mode selector switch is in a disconnected or connected state;

and respectively controlling the unmanned aerial vehicle to switch between the first observation mode and the second observation mode according to the disconnection state and the connection state.

The embodiment of the invention is preferable, and further comprises a flight control step, which specifically comprises:

analyzing the eyeball motion in the second observation mode;

The embodiment of the invention discloses a method for controlling an unmanned aerial vehicle by intelligent glasses, which is characterized in that head-mounted intelligent glasses naturally correspond to eyeballs of a user, so that the observation requirements and the selection of an observation range of the user can be best adapted by utilizing an eyeball action sensing technology. Moreover, by means of an eyeball motion sensing technology, a user does not need to additionally control the holder on the unmanned aerial vehicle in other modes, and the experience process of the user is not interfered completely. Such control effect is good, and the authenticity of finding a view is high to whole equipment easily carries, and the people can realize the true observation effect on unmanned aerial vehicle on ground.

The fourth embodiment provides a method for controlling an unmanned aerial vehicle by using intelligent glasses.

Fig. 4 is a flowchart of a method for controlling an unmanned aerial vehicle by using smart glasses according to a fourth embodiment of the present invention, which will be specifically described with reference to fig. 4.

As shown in fig. 4, an embodiment of the present invention provides a method for controlling an unmanned aerial vehicle by using smart glasses, including the following steps;

step S401: the intelligent glasses receive and display aerial images sent by the unmanned aerial vehicle;

step S402: monitoring eyeball movement of a user;

step S403: generating a control instruction according to the eyeball action and sending the control instruction to the unmanned aerial vehicle;

step S404: controlling the shooting equipment to perform corresponding actions according to the control instruction;

step S405: judging whether the unmanned aerial vehicle is in a second observation mode; if yes, entering the next step; otherwise, go back to step S402;

step S406: analyzing the eyeball motion;

step S407: and controlling the flight of the unmanned aerial vehicle according to the analysis result.

The embodiment of the invention discloses a method for controlling an unmanned aerial vehicle by intelligent glasses, which can select an observation visual field by head-mounted intelligent glasses through an eyeball action induction technology, and can also utilize psychological symbolic meaning analysis on eyeball actions to realize control on the flight track of the unmanned aerial vehicle by utilizing the eyeball actions.

The invention can bring the beneficial technical effects: the intelligent glasses for controlling the unmanned aerial vehicle and the control method thereof disclosed by the embodiment of the invention provide a concept of adjusting the holder of the shooting equipment carried on the unmanned aerial vehicle by utilizing eyeball motion, directly get through the relation between observation and visual field, and fully utilize the natural motion of the eyeballs during observation to automatically adjust the optimal visual field range without other intermediate control means. Meanwhile, the eyeball action and the flight track control of the unmanned aerial vehicle are combined according to the psychological symbol represented by the eyeball action, and the flight track control is further realized on the basis of visual field adjustment without any other control means.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. The utility model provides a smart glasses for controlling unmanned aerial vehicle, unmanned aerial vehicle includes flies the control panel and is used for the shooting equipment, remote control instruction receiver, the telemetering data transmitter of taking photo by plane, fly the control panel with the remote control instruction receiver electricity is connected, shoot equipment with the telemetering data transmitter electricity is connected, its characterized in that: the intelligent glasses comprise a remote control command transmitter, a telemetering data receiver, an image display device, an eyeball action monitoring device and a controller, wherein the eyeball action monitoring device is arranged on the image display device, the remote control command transmitter is connected with the remote control command receiver, the telemetering data receiver is connected with the telemetering data transmitter, the image display device is electrically connected with the telemetering data receiver, wherein,

2. The smart glasses for controlling a drone of claim 1, wherein: the unmanned aerial vehicle further comprises a cradle head, the shooting equipment is carried on the cradle head, the controller comprises a cradle head controller, the cradle head controller is respectively electrically connected with the eyeball motion monitoring equipment and the remote control command transmitter, the cradle head controller is suitable for sending a cradle head control command to the unmanned aerial vehicle according to the eyeball motion of the user detected by the eyeball motion monitoring equipment, and the cradle head adjusts the shooting direction of the shooting equipment according to the cradle head control command.

3. The smart glasses for controlling a drone of claim 1, wherein: the controller further comprises a flight controller, the flight controller is respectively connected with the eyeball motion monitoring equipment and the remote control command transmitter, and the flight controller is suitable for transmitting flight control commands to the unmanned aerial vehicle according to the detected eyeball motions.

4. The smart glasses for controlling a drone of claim 3, wherein: the intelligent glasses further comprise a mode switching unit, the mode switching unit is electrically connected with the flight controller and is suitable for generating a flight control instruction for switching the unmanned aerial vehicle between a first observation mode and a second observation mode.

5. The smart glasses for controlling a drone of claim 4, wherein: the mode switching unit comprises a speech recognizer and/or a mode switch, wherein,

6. The smart glasses for controlling a drone according to claim 3 or 4, characterized in that: the intelligent glasses further comprise an eyeball action analyzer which is respectively connected with the eyeball action monitoring equipment and the flight controller, and the eyeball action analyzer is suitable for analyzing the eyeball action in the second observation mode and controlling the flight of the unmanned aerial vehicle according to an analysis result.

7. A method for controlling an unmanned aerial vehicle by intelligent glasses comprises the following steps:

monitoring eyeball movement of a user;

8. The method of smart glasses controlling a drone according to claim 7, characterized in that: the control command comprises a holder control command and/or a flight control command.

9. The method of smart glasses controlling a drone according to claim 7, characterized in that: further comprising a mode switching step, such that the drone switches between a first observation mode and a second observation mode.

10. The method of smart glasses controlling a drone according to claim 8, characterized in that: the method also comprises a flight control step, and specifically comprises the following steps:

analyzing the eyeball motion in the second observation mode;