CN105425952A - Interactive method and apparatus for control interface of unmanned aerial vehicle - Google Patents

Interactive method and apparatus for control interface of unmanned aerial vehicle Download PDF

Info

Publication number
CN105425952A
CN105425952A CN201510741750.9A CN201510741750A CN105425952A CN 105425952 A CN105425952 A CN 105425952A CN 201510741750 A CN201510741750 A CN 201510741750A CN 105425952 A CN105425952 A CN 105425952A
Authority
CN
China
Prior art keywords
control
manipulation
aircraft
manipulation order
order
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510741750.9A
Other languages
Chinese (zh)
Inventor
李家伦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201510741750.9A priority Critical patent/CN105425952A/en
Publication of CN105425952A publication Critical patent/CN105425952A/en
Priority claimed from US15/957,749 external-priority patent/US10587790B2/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

The invention provides an interactive method for a control interface of an unmanned aerial vehicle. The method comprises the following steps: displaying an image transmission interface on a touch screen of a portable electronic device, wherein the image transmission interface is used for displaying an image photographed by the unmanned aerial vehicle; detecting a touch signal acting on the touch screen; if detecting the touch signal, obtaining a control gesture according to the touch signal; and generating a corresponding control command according to the control gesture, and sending the control command to the unmanned aerial vehicle. By adopting the method, the reaction speed is faster, and the method is easier to use. In addition, the invention further provides an interactive apparatus for the control interface of the unmanned aerial vehicle.

Description

Unmanned plane operation and control interface exchange method and device
Technical field
The present invention relates to unmanned plane and field of intelligent control technology, particularly relate to a kind of unmanned plane operation and control interface exchange method and device.
Background technology
Existing unmanned plane control mode comprises the Wi-Fi that uses matched remote controller to transmit to manipulate unmanned plane and use mobile phone to be launched by unmanned plane or Bluetooth signal manipulates unmanned plane.Use a teleswitch manipulation unmanned plane, as needed display unmanned plane shooting image in real time, then needs to add image transmitting transponder.Picture is converted to signal and is sent to transponder by unmanned plane, and mobile phone, panel computer etc. are by connecting the image of the Wi-Fi signal real-time reception unmanned plane shooting of transponder transmitting.But this control mode cost is high and volume is large.
Use mobile phone manipulation unmanned plane in mobile phone screen, normally use virtual rocking bar to carry out the control of unmanned plane.But this method needs on the virtual rocking bar of the notice of user in screen.And due to being separated of unmanned plane operation interface and image transmission interface, user needs constantly to adjust operation by virtual rocking bar to unmanned plane, and due to virtual rocking bar feedback more weak, if user needs to carry out accurate operation, need very high proficiency, be therefore not easy to user and use.
Summary of the invention
Based on this, be necessary for above-mentioned technical matters, provide a kind of reaction velocity faster, be easier to unmanned plane operation and control interface exchange method and the device of use.
A kind of unmanned plane operation and control interface exchange method, described method comprises:
At the touch screen display image transmission interface of portable electric appts, the picture that described image transmission interface photographs for showing unmanned plane;
Detect the touching signals acted on described touch-screen;
If described touching signals detected, then obtain manipulation gesture according to described touching signals;
Generate corresponding manipulation order according to described manipulation gesture, described manipulation order is sent to unmanned plane.
A kind of unmanned plane operation and control interface interactive device, described device comprises:
Display module, for the touch screen display image transmission interface at portable electric appts, the picture that described image transmission interface photographs for showing unmanned plane;
Signal detection module, for detecting the touching signals acted on described touch-screen;
Gesture acquisition module, if for described touching signals being detected, then obtains manipulation gesture according to described touching signals;
Control module, for generating corresponding manipulation order according to described manipulation gesture, is sent to unmanned plane by described manipulation order.
Above-mentioned unmanned plane operation and control interface exchange method and device, the picture photographed by image transmission interface display unmanned plane, detect the touching signals acted on touch-screen, the manipulation gesture according to producing on the touchscreen controls unmanned plane.Because operation and control interface and image transmission interface are on same interface, user is convenient to the picture seeing that unmanned plane photographs in real time while manipulation unmanned plane, and by just realizing manipulating unmanned plane to the touch-screen of portable electric appts carrying out touch control operation, reaction velocity is faster, is easier to use.
Accompanying drawing explanation
Fig. 1 is the applied environment figure of unmanned plane operation and control interface exchange method in an embodiment;
Fig. 2 is the cut-away view of portable electric appts in an embodiment;
Fig. 3 is the process flow diagram of unmanned plane operation and control interface exchange method in an embodiment;
Fig. 4 is the interface schematic diagram switching control model in an embodiment;
Fig. 5 is the schematic diagram manipulating aircraft in an embodiment;
Fig. 6 is the schematic diagram manipulating camera lens in an embodiment;
Fig. 7 is the structured flowchart of unmanned plane operation and control interface interactive device in an embodiment;
Fig. 8 is the structured flowchart of control module in an embodiment.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The unmanned plane operation and control interface exchange method that the embodiment of the present invention provides can be applicable in system as shown in Figure 1.Please refer to shown in Fig. 1, portable electric appts 102 sends manipulation order by network to unmanned plane 104, and the picture that unmanned plane 104 photographs by Internet Transmission to portable electric appts 102, the real-time picture that photographs of display unmanned plane 104 on portable electric appts 102.Concrete, image can be converted to signal and be sent to image transmitting transponder by unmanned plane 104, and portable electric appts 102 receives by the WiFi signal of connection image transmitting transponder the image that real-time unmanned plane photographs.More preferred, portable electric appts 102 and unmanned plane 104 arrange wireless communication module respectively, sets up communication port by wireless communication module.Such as, portable electric appts 102 and unmanned plane 104 set up 2.4G wireless communication.By this wireless communication, what portable electric appts 102 can be instant is sent to unmanned plane 104 by manipulation order, and unmanned plane 104 can be real-time is shown to portable electric appts 102 by the picture transmission photographed.Wherein, portable electric appts 102 can be but be not limited to the smart mobile phone, panel computer, Wearable electronic equipment etc. of various band touch-screen.
In one embodiment, as shown in Figure 2, additionally provide a kind of portable electric appts 102, this portable electric appts 102 comprises the processor, Graphics Processing Unit, storage medium, internal memory, network interface, display and the input equipment that are connected by system bus, store operating system and a kind of unmanned plane operation and control interface interactive device in storage medium, this unmanned plane operation and control interface interactive device is for performing a kind of unmanned plane operation and control interface exchange method.This processor, for improving calculating and control ability, supports the operation of whole portable electric appts.Graphics Processing Unit in portable electric appts is used for the drawing ability at least providing aobvious application operating interface, such as draw the interface element etc. in unmanned plane operation and control interface, internal memory is used for providing environment for the operation of the unmanned plane operation and control interface interactive device in storage medium, network interface is used for carrying out network service with unmanned plane, receive or send data, such as manipulation order is sent to unmanned plane, receives the image frame etc. that unmanned plane photographs.Touch-screen is used for the icon of various application and the display at interface, such as, show the various interface elements etc. in image transmission interface and unmanned plane operation and control interface.Touch-screen is also for detecting the touching signals acted on touch-screen, and obtain manipulation gesture etc. when touching signals being detected according to the touching signals formed at touch-screen, the manipulation gesture such as got is the slide etc. to certain direction.
As shown in Figure 3, in one embodiment, provide a kind of unmanned plane operation and control interface exchange method, the method is illustrated to be applied in the portable electric appts 102 shown in Fig. 1 and Fig. 2, comprising:
Step 302, at the touch screen display image transmission interface of portable electric appts, the picture that this image transmission interface photographs for showing unmanned plane.
In the present embodiment, the picture photographed that portable electric appts transmits by wireless communication module real-time reception unmanned plane, the image transmission interface that the application run by portable electric appts is provided shows the picture that unmanned plane photographs in real time.
Step 304, detects the touching signals acted on touch-screen.
Due to portable electric appts band touch-screen, the touching signals be applied to it can be detected by touch-screen.Such as, user uses finger or pointer to carry out on the touchscreen clicking or sliding, then touch-screen can detect touching signals.In the present embodiment, image transmission interface and operation and control interface are on same interface, that is, directly can carry out touch control operation on image transmission interface.
Step 306, if touching signals detected, then obtains manipulation gesture according to touching signals.
In the present embodiment, portable electric appts can detect the touching signals be applied to it by touch-screen, concrete, is the touching signals acted on image transmission interface.Such as, user only slides by single on image transmission interface, or user slides on image transmission interface by two finger.Can get manipulation gesture according to the touching signals acted on image transmission interface, these manipulation gestures include but not limited to that single contact moves gesture, double-contact moves gesture etc.Different manipulation order that different manipulation gestures is corresponding, therefore, can form manipulation gesture to realize the various manipulations to unmanned plane on image transmission interface.
Step 308, generates corresponding manipulation order according to manipulation gesture, manipulation order is sent to unmanned plane.
Concrete, different manipulation order that different manipulation gestures is corresponding, can generate corresponding manipulation order according to manipulation gesture.Such as, the image transmission interface that user uses finger to show on the touchscreen slides to the right, then generate the manipulation order of corresponding control aircraft to right translation.Further, manipulation order is sent to unmanned plane by wireless communication by portable electric appts, to realize manipulating unmanned plane.
In the present embodiment, the picture photographed by image transmission interface display unmanned plane, detect the touching signals acted on touch-screen, the manipulation gesture according to producing on the touchscreen controls unmanned plane.Because operation and control interface and image transmission interface are on same interface, user is convenient to the picture seeing that unmanned plane photographs in real time while manipulation unmanned plane, and by just realizing manipulating unmanned plane to the touch-screen of portable electric appts carrying out touch control operation, reaction velocity is faster, is easier to use.
In one embodiment, generate the step of corresponding manipulation order according to manipulation gesture, comprising: detect current control module; If present control mode is for controlling airplane-mode, then generate the manipulation order of corresponding control aircraft movement according to manipulation gesture; If present control mode is for controlling camera mode, then the manipulation order that the control camera lens generating correspondence according to manipulation gesture rotates.
Manipulating unmanned plane can according to the manipulation of user to change camera site and angle, aircraft and the camera lens of unmanned plane can be manipulated, comprise the direction of manipulation aircraft movement and the direction of camera lens rotation, therefore, the steer mode provided comprises control airplane-mode and controls camera mode.In the present embodiment, unmanned plane operation and control interface provides the control for switching present control mode, comprise and present control mode be switched to for present control mode being switched to the control and being used for controlling airplane-mode the interface control controlling camera mode, user by click corresponding control or act on corresponding control slide to trigger switching present control mode.
As shown in Figure 4, provide a kind of unmanned plane operation and control interface, comprise image transmission interface 402 in this unmanned plane operation and control interface, unmanned plane operation and control interface additionally provides for being switched to the control 404 of control airplane-mode and the control 406 for being switched to control camera mode.Trigger control 404, then present control mode is for controlling airplane-mode, and the manipulation gesture that image transmission interface 402 gets can be used for the movement controlling aircraft.Trigger control 406, then present control mode is for controlling camera mode, and the manipulation gesture that image transmission interface 402 gets can be used for the rotation controlling camera lens.
Again shown in composition graphs 4, the picture that unmanned plane operation and control interface is photographed by image transmission interface 402 real-time display unmanned plane, unmanned plane operation and control interface additionally provides some interface elements for realizing shooting and correlation function.Such as, unmanned plane operation and control interface also provides control 412 for taking pictures to the image frame of display in real time in image transmission interface 402, portable electric appts detects the clicking operation to control 412, image frame then in preservation present image transport interface 402 in specified folder, and shows the thumbnail 414 of the photo obtained of taking pictures in unmanned plane operation and control interface.Thumbnail 414 additionally provides the entrance browsing photo, clicks thumbnail 414 and directly can obtain from specified folder and show the current photo obtained of taking pictures.In addition, unmanned plane operation and control interface provides control 408 to be used for switching to exposal model, provides control 410 to be used for switching to image pickup mode.
Further, user can use finger on image transmission interface 402, to carry out touch control operation to produce manipulation gesture.Such as, shown in composition graphs 4, user uses finger to slide on image transmission interface 402 to the right, then generate the manipulation order controlling aircraft and move right.
In the present embodiment, by arranging two kinds of control models, both can manipulate the movement of aircraft, and can rotate camera lens again and manipulating, making unmanned plane photograph the picture of various angle, have more standby dirigibility.
Further, in one embodiment, generate the step of the manipulation order of corresponding control aircraft movement according to manipulation gesture, comprising: detect single-contact moving direction, generate the manipulation order of the control aircraft movement of respective direction according to described single-contact moving direction.
In the present embodiment, be when controlling airplane-mode at present control mode, user uses one to point or pointer produces single contact on image transmission interface.Concrete, single-contact moving direction comprises: move up, move down, be moved to the left and move right, then the direction of the manipulation order corresponding control aircraft movement generated is: aircraft rises, aircraft declines, aircraft is moved to the left and moves right with aircraft.That is: with reference to shown in figure 5, when single-contact moving direction being detected for moving up, then the manipulation order controlling aircraft and rise is generated; When single-contact moving direction being detected for moving down, then generate the manipulation order controlling aircraft and decline; When single-contact moving direction being detected for being moved to the left, then generate and control the manipulation order of aircraft to left; When single-contact moving direction being detected for moving right, then generate and control the manipulation order of aircraft to right translation.
It should be noted that what mention in the application is comparatively speaking up and down, refer to portable electric appts with most common way by the process of use the four direction up and down that produces.Shown in composition graphs 5, user uses portable electric appts to watch the image frame of image transmission interface 402 display in real time in a conventional manner, then can determine four direction up and down.Under control airplane-mode, when user uses single finger or pointer is slided to different directions, then generate and make aircraft towards the manipulation order of correspondence direction movement.
At control aircraft towards in the process of different directions movement, image transmission interface 402 shows the picture (for ease of the picture of the not shown actual photographed of manipulation principle is described in Fig. 5) that unmanned plane photographs in real time, manipulation with real-time show synchronous, and user just can realize the movement of aerospace plane by slip up and down on image transmission interface 402, reaction velocity is faster, uses also more convenient.
In one embodiment, generate the step of the manipulation order of corresponding control aircraft movement according to manipulation gesture, comprising: the moving direction detecting two contacts; When two contacts are moved towards the direction deviated from, generate the manipulation order that control extensions moves forward; When two contacts are moved towards the direction of industry dragon, generate the manipulation order controlling aircraft movement backward.
In the present embodiment, user can use two fingers to carry out touch control operation on image transmission interface 402.Shown in composition graphs 5, user uses two to point and form two contacts on image transmission interface 402, when these two contacts are moved towards the direction deviated from, then can control aircraft and move forward, otherwise control aircraft retrogressing.The present embodiment, by simple two finger slide, can control the movable of aircraft, and relative to the control mode of virtual rocking bar, its reaction velocity is faster, and user is easy to left-hand seat, fast more convenient to use.
In one embodiment, the step of the manipulation order that the control camera lens corresponding according to the generation of manipulation gesture rotates, comprising: detect single-contact moving direction, generates the manipulation order of the control camera lens rotation of respective direction according to the described moving direction when contact.
In the present embodiment, be when controlling camera mode in current air pattern, user uses one to point or pointer produces single contact on image transmission interface.Concrete, single-contact moving direction comprises: move up, move down, be moved to the left and move right, then the direction that the corresponding control camera lens of the manipulation order generated rotates is for upwards to rotate, rotate, turn left and to turn right.That is: when single-contact moving direction being detected for moving up, then the manipulation order controlling camera lens and upwards rotate is generated; When single-contact moving direction being detected for moving down, then generate the manipulation order controlling camera lens and rotate; When single-contact moving direction being detected for being moved to the left, then generate the manipulation order controlling lens left and rotate; When single-contact moving direction being detected for moving right, then generate the manipulation order controlling camera lens and turn right.
Because some camera lens is only supported to rotate up and down, therefore, in more preferred embodiment, under the pattern controlling camera lens, single-contact moving direction comprises: move up and move down, then the direction that the corresponding control camera lens of the manipulation order generated rotates is for upwards rotating and rotating.
In more preferred embodiment, under control camera mode, except can controlling camera lens and rotating up and down, also can carry out left and right translation to control aircraft.Concrete, generating the step of corresponding manipulation order according to manipulation gesture, also comprise: if present control mode is for controlling camera mode, then detecting single-contact moving direction; When single-contact moving direction is vertical movement, then the manipulation order that the control camera lens generating respective direction rotates up and down, when single-contact moving direction is for moving horizontally, then generates the manipulation order of the control aircraft translation of respective direction.
In the present embodiment, shown in composition graphs 6, if present control mode is for controlling camera mode, user uses single finger or pointer on image transmission interface 402, carry out touch control operation, and the touch-screen of portable electric appts detects single-contact moving direction.When single-contact moving direction being detected for moving up, then generate and control the manipulation order that camera lens upwards rotates (facing upward); When single-contact moving direction being detected for moving down, then generate and control the manipulation order that camera lens rotates (nutation); When single-contact moving direction being detected for being moved to the left, then generate and control the manipulation order of aircraft to left; When single-contact moving direction being detected for moving right, then generate and control the manipulation order of aircraft to right translation.
Under control camera mode, can also realize by horizontally slipping on image transmission interface 402 manipulating the translation of aircraft left and right, and slide up and down and can manipulate camera lens and rotate up and down, thus manipulation unmanned plane can be realized carry out 360 degree of shootings without dead angle.And move and camera lens rotation by just can realize manipulation aircraft in the enterprising line slip of image transmission interface 402, relative to the control mode of virtual rocking bar, reaction velocity is more accelerated, and user is fast more convenient to use.
In one embodiment, generate the step of corresponding manipulation order according to manipulation gesture, also comprise: the moving direction detecting two contacts; When two contacts are moved towards the direction deviated from, generate and control the manipulation order that camera lens elongates focal length; When two contacts are moved towards the direction closed up, generate and control the manipulation order that camera lens shortens focal length.
In the present embodiment, under control camera mode, user can use two fingers to carry out touch control operation on image transmission interface 402, shown in composition graphs 6, when two contacts are moved towards the direction deviated from, the camera lens controlling unmanned plane elongates focal length, and the shooting picture of display in real time in such image transmission interface 402 is amplified, and the visual field diminishes.When two contacts are moved towards the direction closed up, the camera lens controlling unmanned plane shortens focal length, and in such image transmission interface 402, the shooting picture of display in real time reduces, and the visual field becomes large.
The present embodiment is under control camera mode, by two finger slide, can control lens focus elongated and shorten, relative to the control mode of virtual rocking bar, its reaction velocity is faster, and user touches by simple the mitigation and amplification that slide just can control the shooting picture of display in real time in image transmission interface, fast more convenient to use.
As shown in Figure 7, in one embodiment, provide a kind of unmanned plane operation and control interface interactive device, this device comprises:
Display module 702, for the touch screen display image transmission interface at portable electric appts, the picture that described image transmission interface photographs for showing unmanned plane.
Signal detection module 704, for detecting the touching signals acted on touch-screen.
Gesture acquisition module 706, if for touching signals being detected, then obtains manipulation gesture according to touching signals.
Control module 708, for generating corresponding manipulation order according to manipulation gesture, is sent to unmanned plane by manipulation order.
In one embodiment, as shown in Figure 8, control module 708 comprises:
Mode detection module 718, for detecting present control mode.
First control module 728, if be aircraft control model for present control mode, then generates the manipulation order of corresponding control aircraft movement according to manipulation gesture.
Second control module 738, if for current control module for controlling camera mode, then the manipulation order that the control camera lens generating correspondence according to manipulation gesture rotates.
Further, in one embodiment, the first control module 728, for detecting single-contact moving direction, generates the manipulation order of the control aircraft movement of respective direction according to single-contact moving direction.
Further, moving direction when contact comprises: move up, move down, be moved to the left and move right, then the direction of the manipulation order corresponding control aircraft movement generated is: aircraft rises, aircraft declines, aircraft is moved to the left and moves right with aircraft.
In one embodiment, the first control module 728 is for detecting the moving direction of two contacts; When two contacts are moved towards the direction deviated from, generate the manipulation order controlling aircraft and move forward; When two contacts towards close up general orientation move time, generate the manipulation order controlling aircraft movement backward.
In one embodiment, the second control module 738, for detecting single-contact moving direction, generates the manipulation order of the control camera lens rotation of respective direction according to single-contact moving direction.
Further, single-contact moving direction comprises: move up and move down, then the direction that the corresponding control camera lens of the manipulation order generated rotates is: upwards rotate and rotate.
In one embodiment, the second control module 738 is for detecting the moving direction of two contacts; When two contacts are moved towards the direction deviated from, generate and control the manipulation order that camera lens elongates focal length; When two contacts are moved towards the direction closed up, generate and control the manipulation order that camera lens shortens focal length.
In one embodiment, if the second control module 738 also for present control mode for control camera mode, then detect single-contact moving direction; When the moving direction of contact is vertical movement, then the manipulation order that the control camera lens generating respective direction rotates up and down, when single-contact moving direction is for moving horizontally, then generates the manipulation order of the control aircraft translation of respective direction.
One of ordinary skill in the art will appreciate that all or part of flow process realized in above-described embodiment method, that the hardware that can carry out instruction relevant by computer program has come, described program can be stored in a computer read/write memory medium, this program, when performing, can comprise the flow process of the embodiment as above-mentioned each side method.Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-OnlyMemory, ROM) or random store-memory body (RandomAccessMemory, RAM) etc.
Each technical characteristic of the above embodiment can combine arbitrarily, for making description succinct, the all possible combination of each technical characteristic in above-described embodiment is not all described, but, as long as the combination of these technical characteristics does not exist contradiction, be all considered to be the scope that this instructions is recorded.
The above embodiment only have expressed several embodiment of the present invention, and it describes comparatively concrete and detailed, but can not therefore be construed as limiting the scope of the patent.It should be pointed out that for the person of ordinary skill of the art, without departing from the inventive concept of the premise, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with claims.

Claims (18)

1. a unmanned plane operation and control interface exchange method, described method comprises:
At the touch screen display image transmission interface of portable electric appts, the picture that described image transmission interface photographs for showing unmanned plane;
Detect the touching signals acted on described touch-screen;
If described touching signals detected, then obtain manipulation gesture according to described touching signals;
Generate corresponding manipulation order according to described manipulation gesture, described manipulation order is sent to unmanned plane.
2. method according to claim 1, is characterized in that, the described step generating corresponding manipulation order according to manipulation gesture, comprising:
Detect present control mode;
If present control mode for controlling airplane-mode, then generates the manipulation order of corresponding control aircraft movement according to described manipulation gesture;
If current control module is for controlling camera mode, then generate the manipulation order of corresponding control camera lens rotation according to described manipulation gesture.
3. method according to claim 2, is characterized in that, the described step generating the manipulation order of corresponding control aircraft movement according to manipulation gesture, comprising:
Detect single-contact moving direction, generate the manipulation order of the control aircraft movement of respective direction according to described single-contact moving direction.
4. method according to claim 3, it is characterized in that, described single-contact moving direction comprises: move up, move down, be moved to the left and move right, then the direction of described manipulation order corresponding control aircraft movement is: aircraft rises, aircraft declines, aircraft is moved to the left and moves right with aircraft.
5. method according to claim 2, is characterized in that, the described step generating the manipulation order of corresponding control aircraft movement according to manipulation gesture, comprising:
Detect the moving direction of two contacts;
When described two contacts are moved towards the direction deviated from, generate the manipulation order controlling aircraft and move forward;
When described two contacts are moved towards the direction closed up, generate the manipulation order controlling aircraft movement backward.
6. method according to claim 2, is characterized in that, the described step generating the manipulation order that corresponding control camera lens rotates according to manipulation gesture, comprising:
Detect single-contact moving direction, generate the manipulation order of the control camera lens rotation of respective direction according to described single-contact moving direction.
7. method according to claim 6, is characterized in that, described single-contact moving direction comprises: move up and move down, then the direction that the corresponding control camera lens of described manipulation order rotates is: upwards rotate and rotate.
8. method according to claim 2, is characterized in that, the described step generating the manipulation order that corresponding control camera lens rotates according to manipulation gesture, comprising:
Detect the moving direction of two contacts;
When described two contacts are moved towards the direction deviated from, generate and control the manipulation order that camera lens elongates focal length;
When described two contacts are moved towards the direction that the back of the body closes up, generate and control the manipulation order that camera lens shortens focal length.
9. method according to claim 2, is characterized in that, the described step generating corresponding manipulation order according to manipulation gesture, also comprises:
If present control mode for controlling camera mode, then detects single-contact moving direction;
When described single-contact moving direction is vertical movement, then the manipulation order that the control camera lens generating respective direction rotates up and down, when described single-contact moving direction is for moving horizontally, then generates the manipulation order of the control aircraft translation of respective direction.
10. a unmanned plane operation and control interface interactive device, is characterized in that, described device comprises:
Display module, for the touch screen display image transmission interface at portable electric appts, the picture that described image transmission interface photographs for showing unmanned plane;
Signal detection module, for detecting the touching signals acted on described touch-screen;
Gesture acquisition module, if for described touching signals being detected, then obtains manipulation gesture according to described touching signals;
Control module, for generating corresponding manipulation order according to described manipulation gesture, is sent to unmanned plane by described manipulation order.
11. devices according to claim 10, is characterized in that, described control module comprises:
Mode detection module, for detecting present control mode;
First control module, if for present control mode for controlling airplane-mode, then generate the manipulation order of corresponding control aircraft movement according to described manipulation gesture;
Second control module, if for current control module for controlling camera mode, then generates the manipulation order of corresponding control camera lens rotation according to described manipulation gesture.
12. devices according to claim 11, is characterized in that, described first control module, for detecting single-contact moving direction, generates the manipulation order of the control aircraft movement of respective direction according to described single-contact moving direction.
13. devices according to claim 12, it is characterized in that, described single-contact moving direction comprises: move up, move down, be moved to the left and move right, then the direction of described manipulation order corresponding control aircraft movement is: aircraft rises, aircraft declines, aircraft is moved to the left and moves right with aircraft.
14. devices according to claim 11, is characterized in that, described first control module is for detecting the moving direction of two contacts; When described two contacts are moved towards the direction deviated from, generate the manipulation order controlling aircraft and move forward; When described two contacts are moved towards the direction closed up, generate the manipulation order controlling aircraft movement backward.
15. devices according to claim 11, is characterized in that, described second control module, for detecting single-contact moving direction, generates the manipulation order of the control camera lens rotation of respective direction according to described single-contact moving direction.
16. devices according to claim 15, is characterized in that, described single-contact moving direction comprises: move up and move down, then the direction that the corresponding control camera lens of described manipulation order rotates is: upwards rotate and rotate.
17. devices according to claim 11, is characterized in that, described second control module is for detecting the moving direction of two contacts; When described two contacts are moved towards the direction deviated from, generate and control the manipulation order that camera lens elongates focal length; When described two contacts are moved towards the direction closed up, generate and control the manipulation order that camera lens shortens focal length.
18. devices according to claim 11, is characterized in that, if described second control module also for present control mode for control camera mode, then detect single-contact moving direction; When described single-contact moving direction is vertical movement, then the manipulation order that the control camera lens generating respective direction rotates up and down, when described single-contact moving direction is for moving horizontally, then generates the manipulation order of the control aircraft translation of respective direction.
CN201510741750.9A 2015-11-04 2015-11-04 Interactive method and apparatus for control interface of unmanned aerial vehicle Pending CN105425952A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510741750.9A CN105425952A (en) 2015-11-04 2015-11-04 Interactive method and apparatus for control interface of unmanned aerial vehicle

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN201510741750.9A CN105425952A (en) 2015-11-04 2015-11-04 Interactive method and apparatus for control interface of unmanned aerial vehicle
PCT/CN2016/082925 WO2017075973A1 (en) 2015-11-04 2016-05-20 Method for providing interactive drone control interface, portable electronic apparatus and storage medium
US15/957,749 US10587790B2 (en) 2015-11-04 2018-04-19 Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
US15/959,007 US10674062B2 (en) 2015-11-04 2018-04-20 Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
US15/959,032 US10623621B2 (en) 2015-11-04 2018-04-20 Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
US15/959,014 US10863073B2 (en) 2015-11-04 2018-04-20 Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle

Publications (1)

Publication Number Publication Date
CN105425952A true CN105425952A (en) 2016-03-23

Family

ID=55504209

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510741750.9A Pending CN105425952A (en) 2015-11-04 2015-11-04 Interactive method and apparatus for control interface of unmanned aerial vehicle

Country Status (2)

Country Link
CN (1) CN105425952A (en)
WO (1) WO2017075973A1 (en)

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105676866A (en) * 2016-04-20 2016-06-15 北京博瑞爱飞科技发展有限公司 Unmanned aerial vehicle flight control method and device
CN105867362A (en) * 2016-04-20 2016-08-17 北京博瑞爱飞科技发展有限公司 Terminal equipment and control system of unmanned aerial vehicle
CN106095265A (en) * 2016-05-31 2016-11-09 深圳市元征科技股份有限公司 A kind of unmanned plane device for shooting its focalization method and Intelligent worn device
CN106125924A (en) * 2016-06-22 2016-11-16 北京博瑞爱飞科技发展有限公司 Remote control thereof, Apparatus and system
CN106155309A (en) * 2016-06-27 2016-11-23 北京博瑞爱飞科技发展有限公司 Remote control thereof, Apparatus and system
CN106444830A (en) * 2016-09-23 2017-02-22 重庆零度智控智能科技有限公司 Braking method and device for flying device
CN106550193A (en) * 2016-12-09 2017-03-29 联想(北京)有限公司 A kind of method and device of taking photo by plane of image, electronic equipment
WO2017075973A1 (en) * 2015-11-04 2017-05-11 腾讯科技(深圳)有限公司 Method for providing interactive drone control interface, portable electronic apparatus and storage medium
CN106708412A (en) * 2017-01-17 2017-05-24 亿航智能设备(广州)有限公司 Method and device for controlling intelligent terminals
CN106817567A (en) * 2016-12-02 2017-06-09 无锡人人行拍网络科技有限公司 A kind of 1080P high-definition digitals image delivering system
US9703288B1 (en) 2016-04-22 2017-07-11 Zero Zero Robotics Inc. System and method for aerial system control
WO2017187220A1 (en) * 2016-04-24 2017-11-02 Hangzhou Zero Zero Technology Co., Ltd. System and method for aerial system control
WO2017201697A1 (en) * 2016-05-25 2017-11-30 SZ DJI Technology Co., Ltd. Techniques for image recognition-based aerial vehicle navigation
US9836053B2 (en) 2015-01-04 2017-12-05 Zero Zero Robotics Inc. System and method for automated aerial system operation
CN107861683A (en) * 2017-11-07 2018-03-30 苏州九号电子科技有限公司 Unmanned plane button-free operating method and device
WO2018077250A1 (en) * 2016-10-27 2018-05-03 中兴通讯股份有限公司 Method and apparatus for determining motion parameters
WO2018214462A1 (en) * 2017-05-23 2018-11-29 深圳市道通智能航空技术有限公司 Remote control for image processing, unmanned flight system, and image processing method for unmanned aerial vehicle
CN109032164A (en) * 2017-06-08 2018-12-18 徐海东 A kind of unmanned plane virtual remote control device
CN109062400A (en) * 2018-07-06 2018-12-21 深圳臻迪信息技术有限公司 The control method and device of image acquisition device
US10220954B2 (en) 2015-01-04 2019-03-05 Zero Zero Robotics Inc Aerial system thermal control system and method
US10358214B2 (en) 2015-01-04 2019-07-23 Hangzhou Zero Zro Technology Co., Ltd. Aerial vehicle and method of operation
US10435144B2 (en) 2016-04-24 2019-10-08 Hangzhou Zero Zero Technology Co., Ltd. Aerial system propulsion assembly and method of use
US10587790B2 (en) 2015-11-04 2020-03-10 Tencent Technology (Shenzhen) Company Limited Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
US10719080B2 (en) 2015-01-04 2020-07-21 Hangzhou Zero Zero Technology Co., Ltd. Aerial system and detachable housing
US10824167B2 (en) 2015-01-04 2020-11-03 Hangzhou Zero Zero Technology Co., Ltd. System and method for automated aerial system operation
US11027833B2 (en) 2019-08-28 2021-06-08 Hangzhou Zero Zero Technology Co., Ltd. Aerial system propulsion assembly and method of use

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103426282A (en) * 2013-07-31 2013-12-04 深圳市大疆创新科技有限公司 Remote control method and terminal
CN104598108A (en) * 2015-01-02 2015-05-06 北京时代沃林科技发展有限公司 Equipment and method for proportionally remote controlling vehicle and unmanned aerial vehicle by touching on intelligent terminal

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100302359A1 (en) * 2009-06-01 2010-12-02 Honeywell International Inc. Unmanned Aerial Vehicle Communication
CN102346479B (en) * 2010-08-04 2014-08-20 鸿富锦精密工业(深圳)有限公司 Hand-hold apparatus and method for controlling unmanned aerial vehicle by utilizing hand-hold apparatus
CN102591346A (en) * 2011-12-05 2012-07-18 大连理工大学 Small-size handheld ground monitoring system for unmanned aerial vehicle
CN105425952A (en) * 2015-11-04 2016-03-23 腾讯科技(深圳)有限公司 Interactive method and apparatus for control interface of unmanned aerial vehicle

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103426282A (en) * 2013-07-31 2013-12-04 深圳市大疆创新科技有限公司 Remote control method and terminal
CN104598108A (en) * 2015-01-02 2015-05-06 北京时代沃林科技发展有限公司 Equipment and method for proportionally remote controlling vehicle and unmanned aerial vehicle by touching on intelligent terminal

Cited By (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9836053B2 (en) 2015-01-04 2017-12-05 Zero Zero Robotics Inc. System and method for automated aerial system operation
US10220954B2 (en) 2015-01-04 2019-03-05 Zero Zero Robotics Inc Aerial system thermal control system and method
US10824149B2 (en) 2015-01-04 2020-11-03 Hangzhou Zero Zero Technology Co., Ltd. System and method for automated aerial system operation
US10528049B2 (en) 2015-01-04 2020-01-07 Hangzhou Zero Zero Technology Co., Ltd. System and method for automated aerial system operation
US10358214B2 (en) 2015-01-04 2019-07-23 Hangzhou Zero Zro Technology Co., Ltd. Aerial vehicle and method of operation
US10222800B2 (en) 2015-01-04 2019-03-05 Hangzhou Zero Zero Technology Co., Ltd System and method for automated aerial system operation
US10824167B2 (en) 2015-01-04 2020-11-03 Hangzhou Zero Zero Technology Co., Ltd. System and method for automated aerial system operation
US10719080B2 (en) 2015-01-04 2020-07-21 Hangzhou Zero Zero Technology Co., Ltd. Aerial system and detachable housing
US10674062B2 (en) 2015-11-04 2020-06-02 Tencent Technology (Shenzhen) Company Limited Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
WO2017075973A1 (en) * 2015-11-04 2017-05-11 腾讯科技(深圳)有限公司 Method for providing interactive drone control interface, portable electronic apparatus and storage medium
US10623621B2 (en) 2015-11-04 2020-04-14 Tencent Technology (Shenzhen) Company Limited Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
US10587790B2 (en) 2015-11-04 2020-03-10 Tencent Technology (Shenzhen) Company Limited Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
US10863073B2 (en) 2015-11-04 2020-12-08 Tencent Technology (Shenzhen) Company Limited Control method for photographing using unmanned aerial vehicle, photographing method using unmanned aerial vehicle, mobile terminal, and unmanned aerial vehicle
CN105676866A (en) * 2016-04-20 2016-06-15 北京博瑞爱飞科技发展有限公司 Unmanned aerial vehicle flight control method and device
CN105867362A (en) * 2016-04-20 2016-08-17 北京博瑞爱飞科技发展有限公司 Terminal equipment and control system of unmanned aerial vehicle
WO2017181511A1 (en) * 2016-04-20 2017-10-26 高鹏 Terminal device and control system for unmanned aerial vehicle
US9703288B1 (en) 2016-04-22 2017-07-11 Zero Zero Robotics Inc. System and method for aerial system control
US10435144B2 (en) 2016-04-24 2019-10-08 Hangzhou Zero Zero Technology Co., Ltd. Aerial system propulsion assembly and method of use
WO2017187220A1 (en) * 2016-04-24 2017-11-02 Hangzhou Zero Zero Technology Co., Ltd. System and method for aerial system control
WO2017201697A1 (en) * 2016-05-25 2017-11-30 SZ DJI Technology Co., Ltd. Techniques for image recognition-based aerial vehicle navigation
CN109416535A (en) * 2016-05-25 2019-03-01 深圳市大疆创新科技有限公司 Aircraft navigation technology based on image recognition
US10802479B2 (en) 2016-05-25 2020-10-13 SZ DJI Technology Co., Ltd. Techniques for image recognition-based aerial vehicle navigation
CN106095265A (en) * 2016-05-31 2016-11-09 深圳市元征科技股份有限公司 A kind of unmanned plane device for shooting its focalization method and Intelligent worn device
WO2017206435A1 (en) * 2016-05-31 2017-12-07 深圳市元征科技股份有限公司 Method for adjusting focal length of unmanned aerial vehicle photographing device and smart wearable device
CN106125924A (en) * 2016-06-22 2016-11-16 北京博瑞爱飞科技发展有限公司 Remote control thereof, Apparatus and system
CN106155309A (en) * 2016-06-27 2016-11-23 北京博瑞爱飞科技发展有限公司 Remote control thereof, Apparatus and system
CN106444830A (en) * 2016-09-23 2017-02-22 重庆零度智控智能科技有限公司 Braking method and device for flying device
WO2018077250A1 (en) * 2016-10-27 2018-05-03 中兴通讯股份有限公司 Method and apparatus for determining motion parameters
CN106817567A (en) * 2016-12-02 2017-06-09 无锡人人行拍网络科技有限公司 A kind of 1080P high-definition digitals image delivering system
CN106550193A (en) * 2016-12-09 2017-03-29 联想(北京)有限公司 A kind of method and device of taking photo by plane of image, electronic equipment
WO2018133593A1 (en) * 2017-01-17 2018-07-26 亿航智能设备(广州)有限公司 Control method and device for intelligent terminal
CN106708412B (en) * 2017-01-17 2020-06-12 亿航智能设备(广州)有限公司 Control method and device of intelligent terminal
CN106708412A (en) * 2017-01-17 2017-05-24 亿航智能设备(广州)有限公司 Method and device for controlling intelligent terminals
WO2018214462A1 (en) * 2017-05-23 2018-11-29 深圳市道通智能航空技术有限公司 Remote control for image processing, unmanned flight system, and image processing method for unmanned aerial vehicle
US10752354B2 (en) 2017-05-23 2020-08-25 Autel Robotics Co., Ltd. Remote control for implementing image processing, unmanned aircraft system and image processing method for unmanned aerial vehicle
CN109032164A (en) * 2017-06-08 2018-12-18 徐海东 A kind of unmanned plane virtual remote control device
CN107861683A (en) * 2017-11-07 2018-03-30 苏州九号电子科技有限公司 Unmanned plane button-free operating method and device
CN109062400A (en) * 2018-07-06 2018-12-21 深圳臻迪信息技术有限公司 The control method and device of image acquisition device
US11027833B2 (en) 2019-08-28 2021-06-08 Hangzhou Zero Zero Technology Co., Ltd. Aerial system propulsion assembly and method of use

Also Published As

Publication number Publication date
WO2017075973A1 (en) 2017-05-11

Similar Documents

Publication Publication Date Title
US10515610B2 (en) Floating window processing method and apparatus
US20190025909A1 (en) Human-body-gesture-based region and volume selection for hmd
US9563341B2 (en) Data sharing
KR101935181B1 (en) Flight control method and device, and electronic equipment
CN107077169B (en) Spatial interaction in augmented reality
US9906586B2 (en) Method and device for transmitting data, and method and device for receiving data
RU2668055C2 (en) Display method and apparatus for diversely displaying object according to scroll speed
US9261995B2 (en) Apparatus, method, and computer readable recording medium for selecting object by using multi-touch with related reference point
US20180217730A1 (en) Infinite bi-directional scrolling
CN106775313B (en) Split screen operation control method and mobile terminal
US9479693B2 (en) Method and mobile terminal apparatus for displaying specialized visual guides for photography
US9762851B1 (en) Shared experience with contextual augmentation
KR101935039B1 (en) Mobile terminal and method for controlling of the same
US9667870B2 (en) Method for controlling camera operation based on haptic function and terminal supporting the same
US9924018B2 (en) Multi display method, storage medium, and electronic device
KR102057629B1 (en) Mobile terminal and method for controlling of the same
KR102227087B1 (en) Wearable glass-type device and control method of the wearable glass-type device
US10038844B2 (en) User interface for wide angle photography
CN106210253B (en) Glasses type terminal and control method thereof
US9207902B2 (en) Method and apparatus for implementing multi-vision system by using multiple portable terminals
KR102010955B1 (en) Method for controlling preview of picture taken in camera and mobile terminal implementing the same
KR102121592B1 (en) Method and apparatus for protecting eyesight
US8988247B1 (en) Mobile terminal and method of controlling the same
US9851889B2 (en) Apparatus and method for rotating a displayed image by using multi-point touch inputs
US20190163344A1 (en) Information processing apparatus, information processing method, and recording medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160323