WO2017075973A1

WO2017075973A1 - Method for providing interactive drone control interface, portable electronic apparatus and storage medium

Info

Publication number: WO2017075973A1
Application number: PCT/CN2016/082925
Authority: WO
Inventors: 李家伦
Original assignee: 腾讯科技（深圳）有限公司
Priority date: 2015-11-04
Filing date: 2016-05-20
Publication date: 2017-05-11
Also published as: CN105425952A

Abstract

A method for providing an interactive drone control interface comprises: displaying an image transmission interface on a touchscreen of a portable electronic apparatus, wherein the image transmission interface is configured to display an image captured by a drone; detecting a touch signal associated with a touch on the touchscreen; if the touch signal is detected, acquiring a control gesture according to the touch signal; and generating a corresponding control command according to the control gesture, and transmitting the control command to the drone.

Description

UAV control interface interaction method, portable electronic device and storage medium

This application claims priority to Chinese Patent Application No. 2015107417509, entitled "UAV Operation Interface Interaction Method and Apparatus", filed on November 4, 2015, the entire contents of which are incorporated herein by reference. In the application.

[Technical Field]

The present invention relates to the field of UAVs and intelligent control technologies, and in particular, to a UAV control interface interaction method, a portable electronic device, and a storage medium.

【Background technique】

Existing drone control methods include using a remote control to transmit signals to control the drone and using the mobile phone to control the drone through Wi-Fi or Bluetooth signals transmitted by the drone. Use the remote control to control the drone. If you want to display the image of the drone in real time, you need to add an image transfer relay. The drone converts the picture into a signal and sends it to the relay. The mobile phone, tablet, etc. receive the image taken by the drone in real time through the Wi-Fi signal transmitted by the connection relay. But this type of control is costly and bulky.

Using a mobile phone to control a drone is usually done by using a virtual joystick on the phone screen for drone control. However, this method requires the user's attention on the virtual joystick in the screen. And because the drone operation interface is separated from the image transmission interface, the user needs to continuously adjust the drone through the virtual joystick, and since the virtual joystick has weak feedback, the user needs to perform the precise operation, which is very high. Proficiency and therefore not easy for users to use.

[Summary of the Invention]

The UAV control interface interaction method, portable electronic device and storage medium disclosed in the present application solve one or more problems involved in the background art.

A UAV control interface interaction method includes:

Displaying an image transmission interface on the touch screen of the portable electronic device, the image transmission interface for displaying a picture captured by the drone;

Detecting a touch signal applied to the touch screen;

If the touch signal is detected, acquiring a manipulation gesture according to the touch signal; and

Generating a corresponding manipulation command according to the manipulation gesture, and transmitting the manipulation command to the drone.

A portable electronic device includes a memory and a processor, the memory storing instructions that, when executed by the processor, cause the processor to perform the following steps:

Detecting a touch signal applied to the touch screen;

One or more computer non-volatile storage media storing computer readable instructions, when executed by one or more processors, cause the one or more processors to perform the steps of:

Detecting a touch signal applied to the touch screen;

Details of one or more embodiments of the invention are set forth in the accompanying drawings and description below. Other features, objects, and advantages of the invention will be apparent from the description and appended claims.

[Description of the Drawings]

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is an application environment diagram of an interaction method of a drone control interface in an embodiment;

2 is an internal structural diagram of a portable electronic device in an embodiment;

3 is a flow chart of an interaction method of a drone control interface in an embodiment;

4 is a schematic diagram of an interface of a switching control mode in an embodiment;

Figure 5 is a schematic view of a control aircraft in an embodiment;

Figure 6 is a schematic view of a steering lens in an embodiment;

Figure 7 is a block diagram showing the structure of a portable electronic device in an embodiment;

Figure 8 is a block diagram showing the structure of a control module in one embodiment.

【detailed description】

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The UAV control interface interaction method provided by an embodiment can be applied to the system shown in FIG. 1. Referring to FIG. 1, the portable electronic device 102 transmits a manipulation command to the drone 104 through the network, and the image captured by the drone 104 can be transmitted to the portable electronic device 102 through the network, and the portable electronic device 102 displays the real-time display on the portable electronic device 102. The picture taken by the man machine 104. Specifically, the drone 104 can convert the image into a signal transmission to the image transmission relay, and the portable electronic device 102 receives the image captured by the real-time drone through the WiFi signal connected to the image transmission relay. A wireless communication module can also be separately disposed on the portable electronic device 102 and the drone 104 to establish a communication channel through the wireless communication module. For example, portable electronic device 102 and drone 104 establish a 2.4G wireless communication channel. Through the wireless communication channel, the portable electronic device 102 can immediately transmit a manipulation command to the drone 104, and the drone 104 can transmit the captured image to the portable electronic device 102 for display in real time. The portable electronic device 102 can be, but is not limited to, various smart phones with touch screens, tablet computers, wearable electronic devices, and the like.

In one embodiment, as shown in FIG. 2, a portable electronic device 102 is also provided, the portable electronic device 102 including a processor, a graphics processing unit, a storage medium, a memory, a network interface, a display, and The input device stores an operating system in the storage medium, and can also store computer executable instructions. When the computer executable instructions are executed by the processor, a UAV control interface interaction method can be implemented. The processor is used to increase computing and control capabilities to support the operation of the entire portable electronic device. The graphics processing unit in the portable electronic device is configured to at least provide a rendering capability of the application operating interface, such as drawing interface elements in the drone control interface, and the memory is used to control the operation of the interface interaction device for the drone in the storage medium. Providing an environment, the network interface is used for network communication with the drone, receiving or transmitting data, for example, sending control commands to the drone, receiving image images captured by the drone, and the like. The touch screen is used for display of icons and interfaces of various applications, such as display image transmission interface and various interface elements in the drone control interface. The touch screen is further configured to detect a touch signal applied to the touch screen. When the touch signal is detected, the touch gesture is obtained according to the touch signal formed on the touch screen. For example, the acquired control gesture is a sliding operation in a certain direction.

As shown in FIG. 3, in one embodiment, a UAV control interface interaction method is provided. The method is applied to the portable electronic device 102 shown in FIG. 1 and FIG. 2, and includes:

Step 302: Display an image transmission interface on the touch screen of the portable electronic device, and the image transmission interface is used to display a picture captured by the drone.

In this embodiment, the portable electronic device can receive the captured image transmitted by the drone in real time through the wireless communication module, and display the image captured by the drone in real time through the image transmission interface provided by the application running by the portable electronic device.

Step 304: Detect a touch signal applied to the touch screen.

Since the portable electronic device has a touch screen, the touch signal acting on it can be detected through the touch screen. For example, if the user clicks or slides on the touch screen with a finger or a stylus, the touch screen can detect the touch signal. In this embodiment, the image transmission interface and the manipulation interface are on the same interface, that is, the touch operation can be directly performed on the image transmission interface.

Step 306, if a touch signal is detected, acquiring a manipulation gesture according to the touch signal.

In this embodiment, the portable electronic device can detect the touch signal applied thereto through the touch screen, specifically, the touch signal applied to the image transmission interface. For example, the user can slide on the image transmission interface by a single finger, or the user can slide on the image transmission interface by two fingers. Control gestures may be acquired according to touch signals acting on the image transmission interface, including but not limited to single-contact movement gestures, dual-contact movement gestures, and the like. Different manipulation gestures correspond to different manipulation commands, and therefore, manipulation gestures can be formed on the image transmission interface to implement various manipulations of the drone.

Step 308: Generate a corresponding manipulation command according to the manipulation gesture, and send the manipulation command to the drone.

Specifically, different manipulation gestures correspond to different manipulation commands, and corresponding manipulation commands can be generated according to the manipulation gestures. For example, if the user uses a finger to slide to the right on the image transmission interface displayed on the touch screen, a manipulation command corresponding to controlling the aircraft to pan to the right is generated. Further, the portable electronic device transmits a manipulation command to the drone through the wireless communication channel to implement manipulation of the drone.

In this embodiment, the image captured by the drone is displayed through the image transmission interface, the touch signal acting on the touch screen is detected, and the drone is controlled according to the manipulation gesture generated on the touch screen. Since the control interface and the image transmission interface are on the same interface, the user can view the image captured by the drone in real time while controlling the drone, and can realize the manipulation by performing touch operation on the touch screen of the portable electronic device. Man-machine, faster response and easier to use.

In one embodiment, the step of generating a corresponding manipulation command according to the manipulation gesture comprises: detecting a current control mode; if the current control mode is controlling the airplane mode, generating a corresponding manipulation command for controlling the movement of the aircraft according to the manipulation gesture; When the mode is to control the lens mode, a corresponding control command for controlling the rotation of the lens is generated according to the manipulation gesture.

To control the drone to change the shooting position and angle according to the user's manipulation, the drone's aircraft and lens can be controlled, including the direction in which the aircraft moves and the direction in which the lens rotates. Therefore, the provided control modes include controlling the aircraft. Mode and control lens mode. In this embodiment, the drone control interface provides controls for switching the current control mode, including a control for switching the current control mode to the control aircraft mode and an interface control for switching the current control mode to the control lens mode. The user can trigger the switching of the current control mode by clicking the corresponding control or a sliding operation on the corresponding control.

As shown in FIG. 4, a drone control interface is provided. The drone control interface includes an image transmission interface 402. The drone control interface further provides a control 404 for switching to the control aircraft mode and is used for Switch to control 406 that controls the lens mode. Trigger control 404, the current control mode is to control the airplane mode, and the manipulation gesture acquired on the image transmission interface 402 can be used to control the movement of the aircraft. When the control 406 is triggered, the current control mode is the control lens mode, and the manipulation gesture acquired on the image transmission interface 402 can be used to control the rotation of the lens.

Referring to FIG. 4, the drone control interface displays the image captured by the drone in real time through the image transmission interface 402. The drone control interface also provides some interface elements for implementing shooting and related functions. For example, the drone control interface further provides a control 412 for taking a picture of an image displayed in real time in the image transmission interface 402. When the portable electronic device detects a click operation on the control 412, the image image in the current image transmission interface 402 is saved. Go to the specified folder and display the thumbnail 414 of the photo taken in the drone control interface. The thumbnail 414 also provides an entry for browsing photos, and clicking on the thumbnail 414 allows the photo currently taken from the specified folder to be directly retrieved and displayed. In addition, the drone control interface provides a control 408 for switching to a photographing mode, and the control 410 is provided for switching to the camera mode.

Further, the user can perform a touch operation on the image transmission interface 402 using a finger to generate a manipulation gesture. For example, in conjunction with FIG. 4, the user uses a finger to slide to the right on the image transmission interface 402 to generate a manipulation command that controls the movement of the aircraft to the right.

In this embodiment, by setting two control modes, the movement of the aircraft can be controlled, and the rotation of the lens can be controlled, so that the drone can capture images of various angles, and has more flexibility.

Further, in an embodiment, the step of generating a corresponding manipulation command for controlling the movement of the aircraft according to the manipulation gesture comprises: detecting a moving direction of the single contact, and generating a corresponding direction of controlling the movement of the aircraft according to the moving direction of the single contact Control commands.

In this embodiment, in the case where the current control mode is to control the airplane mode, the user uses a finger or a stylus to generate a single contact on the image transmission interface. Specifically, the moving direction of the single contact includes: upward movement, downward movement, leftward movement, and rightward movement, and the generated manipulation command correspondingly controls the movement direction of the aircraft: the aircraft rises, the aircraft descends, the aircraft moves to the left, and The plane moves to the right. That is, referring to FIG. 5, when it is detected that the moving direction of the single contact is moving upward, a control command for controlling the rise of the aircraft is generated; when it is detected that the moving direction of the single contact is moving downward, the control aircraft is generated. a falling steering command; when it is detected that the moving direction of the single contact is moving to the left, a manipulation command for controlling the leftward translation of the aircraft is generated; when it is detected that the moving direction of the single contact is moving to the right, the control aircraft is generated A manipulation command that pans to the right.

It should be noted that the upper and lower left and right sides mentioned in the present application are relative, and refer to the four directions of up, down, left, and right generated by the portable electronic device during use. As shown in FIG. 5, when the user views the image screen displayed in real time by the image transmission interface 402 using the portable electronic device, the four directions of up, down, left, and right can be determined. In the control airplane mode, when the user slides in different directions using a single finger or stylus, a manipulation command is generated that causes the aircraft to move in the corresponding direction. It can be understood that when the portable electronic device is turned over, if the displayed manipulation interface is also flipped, the four directions of up, down, left, and right are regenerated.

In the process of controlling the movement of the aircraft in different directions, the image transmission interface 402 displays the picture captured by the drone in real time (the picture taken in FIG. 5 for convenience of explaining the operation principle does not show the actual picture), the control is synchronized with the real-time display, and the user The movement of the air plane can be realized by sliding up and down and left and right on the image transmission interface 402, which is similar to the movement of the aircraft in reality, so the reaction speed is faster and the use is more convenient and quick.

In one embodiment, the step of generating a corresponding manipulation command for controlling the movement of the aircraft according to the manipulation gesture comprises: detecting a moving direction of the two contacts; and generating a control extension to move forward when the two contacts move in a direction away from each other; The manipulation command; when the two contacts move in the direction of closing, a manipulation command is generated to control the backward movement of the aircraft.

In this embodiment, the user can perform a touch operation on the image transmission interface 402 using two fingers. As shown in FIG. 5, the user forms two contacts on the image transmission interface 402 using two fingers, and can control when the two contacts move in a direction away from each other (ie, the distance between the two contacts becomes far). The aircraft moves forward, and conversely, when the two contacts move in the direction of closing (ie, the distance between the two contacts becomes closer), the aircraft is controlled to retreat. In this embodiment, the simple two-finger sliding operation can control the forward and backward movement of the aircraft. Compared with the control mode of the virtual rocker, the reaction speed is faster, and the user is easy to use, and the use is more convenient and quick.

In one embodiment, the step of generating a corresponding manipulation command for controlling the rotation of the lens according to the manipulation gesture comprises: detecting a movement direction of the single contact, and generating a manipulation command for controlling the rotation of the lens according to the movement direction of the single contact.

In this embodiment, in the case that the current control mode is the control lens mode, the user generates a single contact on the image transmission interface using one finger or a stylus. Specifically, the moving direction of the single contact includes: an upward movement, a downward movement, a leftward movement, and a rightward movement, and the generated manipulation command correspondingly controls the rotation direction of the lens to be upward rotation, downward rotation, leftward rotation, and Turn to the right. That is, when it is detected that the moving direction of the single contact is moving upward, a manipulation command for controlling the upward rotation of the lens is generated; when it is detected that the moving direction of the single contact is moving downward, the control for controlling the downward rotation of the lens is generated. Command; when detecting that the moving direction of the single contact is moving to the left, generating a manipulation command for controlling the rotation of the lens to the left; when detecting that the moving direction of the single contact is moving to the right, generating a control lens to the right Rotating control commands.

Since some lenses only support up and down rotation, in a more preferred embodiment, in the mode of controlling the lens, the moving direction of the single contact includes: upward movement and downward movement, and the generated manipulation command correspondingly controls the rotation of the lens. The direction is to turn up and down.

In a more preferred embodiment, in the control lens mode, in addition to controlling the up and down rotation of the lens, the control aircraft can be panned left and right. Specifically, the step of generating a corresponding manipulation command according to the manipulation gesture further includes: if the current control mode is the control lens mode, detecting a moving direction of the single contact; when the moving direction of the single contact is a vertical movement, generating corresponding The direction control lens controls the up and down rotation of the lens. When the movement direction of the single contact is horizontal, the corresponding direction of the control command for controlling the panning of the aircraft is generated.

In this embodiment, as shown in FIG. 6, if the current control mode is the control lens mode, the user performs a touch operation on the image transmission interface 402 by using a single finger or a stylus, and the touch screen of the portable electronic device detects the movement of the single contact. direction. When it is detected that the moving direction of the single contact is moving upward, a manipulation command for controlling the upward rotation (upward) of the lens is generated; when it is detected that the moving direction of the single contact is moving downward, the control lens is rotated downward. a control command (downward); when it is detected that the moving direction of the single contact is moving to the left, a manipulation command for controlling the leftward translation of the aircraft is generated; when it is detected that the moving direction of the single contact is moving to the right, Generate a control command that controls the airplane to pan to the right.

In the control lens mode, the left and right panning of the aircraft can be realized by sliding left and right on the image transmission interface 402, and the up and down sliding can control the lens to rotate up and down, thereby enabling the drone to be operated 360 degrees without dead angle shooting. And by sliding on the image transmission interface 402, the movement of the aircraft and the rotation of the lens can be realized. Compared with the manipulation mode of the virtual joystick, the reaction speed is faster, and the user is more convenient and quick to use.

In one embodiment, the step of generating a corresponding manipulation command according to the manipulation gesture further comprises: detecting a moving direction of the two contacts; and generating a manipulation command for controlling the extended focal length of the lens when the two contacts move in a direction away from the deviation When the two contacts move in the direction of closing, a manipulation command is generated to control the lens to shorten the focal length.

In this embodiment, in the control lens mode, the user can perform touch operation on the image transmission interface 402 by using two fingers, and as shown in FIG. 6, when the two contacts move in the direction away from each other, the drone is controlled. The lens lengthens the focal length, so that the captured image displayed in real time in the image transmission interface 402 is enlarged, and the field of view becomes smaller. When the two contacts move in the closing direction, the lens of the drone is controlled to shorten the focal length, so that the shooting picture displayed in real time in the image transmission interface 402 is reduced, and the field of view becomes large.

In the control lens mode, the two-finger sliding operation can control the focal length of the lens to be longer and shorter, and the reaction speed is faster than the control mode of the virtual joystick, and the user can control by a simple touch sliding operation. The zooming in and out of the shooting screen displayed in real time in the image transmission interface is more convenient and quicker to use.

As shown in FIG. 7, in one embodiment, a portable electronic device is provided, the internal structure of which may correspond to the structure shown in FIG. 2, each of which may be partially or partially passed through software, Hardware or a combination thereof is implemented.

As shown in FIG. 7, in one embodiment, the portable electronic device includes:

The display module 702 is configured to display an image transmission interface on the touch screen of the portable electronic device, where the image transmission interface is used to display a picture captured by the drone.

The signal detecting module 704 is configured to detect a touch signal applied to the touch screen.

The gesture acquisition module 706 is configured to acquire a manipulation gesture according to the touch signal if the touch signal is detected.

The control module 708 is configured to generate a corresponding manipulation command according to the manipulation gesture, and send the manipulation command to the drone.

In one embodiment, as shown in FIG. 8, the control module 708 includes:

The mode detecting module 718 is configured to detect the current control mode.

The first control module 728 is configured to generate a corresponding control command for controlling the movement of the aircraft according to the manipulation gesture if the current control mode is the aircraft control mode.

The second control module 738 is configured to generate a corresponding control command for controlling the rotation of the lens according to the manipulation gesture, if the current control module is in the control lens mode.

Further, in an embodiment, the first control module 728 is configured to detect a moving direction of the single contact, and generate a control command for controlling the movement of the aircraft according to the moving direction of the single contact.

Further, when the moving direction of the contact includes: moving upward, moving downward, moving to the left, and moving to the right, the generated steering command correspondingly controls the direction in which the aircraft moves: the aircraft rises, the aircraft descends, the aircraft moves to the left, and The plane moves to the right.

In one embodiment, the first control module 728 is configured to detect a moving direction of the two contacts; when the two contacts move in a direction away from each other, generate a steering command that controls the forward movement of the aircraft; When the large direction moves, the control command to control the backward movement of the aircraft is generated.

In one embodiment, the second control module 738 is configured to detect a moving direction of the single contact, and generate a control command for controlling the rotation of the lens according to the moving direction of the single contact.

Further, the moving direction of the single contact includes: an upward movement and a downward movement, and the generated manipulation command correspondingly controls the rotation direction of the lens to be upward rotation and downward rotation.

In one embodiment, the second control module 738 is configured to detect a moving direction of the two contacts; when the two contacts move in a direction away from each other, generate a manipulation command for controlling the lens to extend the focal length; when the two contacts are facing When the direction of the close is moved, a manipulation command for controlling the lens to shorten the focal length is generated.

In an embodiment, the second control module 738 is further configured to detect a moving direction of the single contact if the current control mode is the control lens mode, and generate a control lens of the corresponding direction when the moving direction of the contact is vertical. The steering command that rotates up and down, when the moving direction of the single contact moves horizontally, generates a control command for controlling the panning of the aircraft in the corresponding direction.

One of ordinary skill in the art can understand that all or part of the process of implementing the foregoing embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, or a read-only storage memory (Read-Only) Memory, ROM) or Random Access Memory (RAM).

The technical features of the above-described embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be considered as the scope of this manual.

The above-described embodiments are merely illustrative of several embodiments of the present invention, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims

A UAV control interface interaction method includes:

Displaying an image transmission interface on the touch screen of the portable electronic device, the image transmission interface for displaying a picture captured by the drone;

Detecting a touch signal applied to the touch screen;

If the touch signal is detected, acquiring a manipulation gesture according to the touch signal; and

Generating a corresponding manipulation command according to the manipulation gesture, and transmitting the manipulation command to the drone.
The method according to claim 1, wherein the step of generating a corresponding manipulation command according to the manipulation gesture comprises:

Detecting the current control mode;

If the current control mode is the control aircraft mode, generating a corresponding control command for controlling the movement of the aircraft according to the manipulation gesture;

If the current control module is in the control lens mode, a corresponding control command for controlling the rotation of the lens is generated according to the manipulation gesture.
The method according to claim 2, wherein the step of generating a corresponding manipulation command for controlling the movement of the aircraft according to the manipulation gesture comprises:

The moving direction of the single contact is detected, and a control command for controlling the movement of the aircraft is generated according to the moving direction of the single contact.
The method according to claim 3, wherein the moving direction of the single contact comprises: an upward movement, a downward movement, a leftward movement, and a rightward movement, wherein the manipulation command correspondingly controls the movement direction of the aircraft to be : The plane rises, the plane descends, the plane moves to the left and the plane moves to the right.
The method according to claim 2, wherein the step of generating a corresponding manipulation command for controlling the movement of the aircraft according to the manipulation gesture comprises:

Detecting the moving direction of the two contacts;

Generating a control command to control the forward movement of the aircraft when the two contacts move in a direction away from;

When the two contacts move in the closed direction, a manipulation command is generated to control the backward movement of the aircraft.
The method according to claim 2, wherein the step of generating a corresponding manipulation command for controlling the rotation of the lens according to the manipulation gesture comprises:

The moving direction of the single contact is detected, and a control command for controlling the rotation of the lens is generated according to the moving direction of the single contact.
The method according to claim 6, wherein the moving direction of the single contact comprises: an upward movement and a downward movement, and the manipulation command correspondingly controls the rotation direction of the lens to be upward rotation and downward rotation.
The method according to claim 2, wherein the step of generating a corresponding manipulation command for controlling the rotation of the lens according to the manipulation gesture comprises:

Detecting the moving direction of the two contacts;

When the two contacts move in a direction away from each other, a manipulation command for controlling the lens to lengthen the focal length is generated;

When the two contacts move in the closing direction, a manipulation command is generated to control the lens to shorten the focal length.
The method according to claim 2, wherein the step of generating a corresponding manipulation command according to the manipulation gesture further comprises:

If the current control mode is the control lens mode, detecting the moving direction of the single contact;

When the moving direction of the single contact is vertical movement, a control command for controlling the up and down rotation of the lens in the corresponding direction is generated, and when the moving direction of the single contact is horizontally moving, the corresponding direction of the control plane is generated. Manipulate commands.
A portable electronic device includes a memory and a processor, the memory storing instructions that, when executed by the processor, cause the processor to perform the following steps:

Displaying an image transmission interface on the touch screen of the portable electronic device, the image transmission interface for displaying a picture captured by the drone;

Detecting a touch signal applied to the touch screen;

If the touch signal is detected, acquiring a manipulation gesture according to the touch signal; and

Generating a corresponding manipulation command according to the manipulation gesture, and transmitting the manipulation command to the drone.
The portable electronic device according to claim 10, wherein the processor performs the step of generating a corresponding manipulation command according to the manipulation gesture, comprising:

Detecting the current control mode;

If the current control mode is the control aircraft mode, generating a corresponding control command for controlling the movement of the aircraft according to the manipulation gesture;

If the current control module is in the control lens mode, a corresponding control command for controlling the rotation of the lens is generated according to the manipulation gesture.
The portable electronic device according to claim 11, wherein the processor performs a step of generating a corresponding manipulation command for controlling the movement of the aircraft according to the manipulation gesture, comprising:

The moving direction of the single contact is detected, and a control command for controlling the movement of the aircraft is generated according to the moving direction of the single contact.
The portable electronic device according to claim 12, wherein the moving direction of the single contact comprises: an upward movement, a downward movement, a leftward movement, and a rightward movement, and the manipulation command correspondingly controls the movement of the aircraft. The direction is: the aircraft rises, the aircraft descends, the aircraft moves to the left and the aircraft moves to the right.
The portable electronic device according to claim 11, wherein the processor performs a step of generating a corresponding manipulation command for controlling the movement of the aircraft according to the manipulation gesture, comprising:

Detecting the moving direction of the two contacts;

Generating a control command to control the forward movement of the aircraft when the two contacts move in a direction away from;

When the two contacts move in the closed direction, a manipulation command is generated to control the backward movement of the aircraft.
The portable electronic device according to claim 11, wherein the processor performs a step of generating a corresponding manipulation command for controlling lens rotation according to the manipulation gesture, comprising:

The moving direction of the single contact is detected, and a control command for controlling the rotation of the lens is generated according to the moving direction of the single contact.
The portable electronic device according to claim 15, wherein the moving direction of the single contact comprises: an upward movement and a downward movement, wherein the manipulation command correspondingly controls the direction in which the lens rotates: upward rotation and downward movement Turn.
The portable electronic device according to claim 11, wherein the processor performs a step of generating a corresponding manipulation command for controlling lens rotation according to the manipulation gesture, comprising:

Detecting the moving direction of the two contacts;

When the two contacts move in a direction away from each other, a manipulation command for controlling the lens to lengthen the focal length is generated;

When the two contacts move in the closing direction, a manipulation command is generated to control the lens to shorten the focal length.
The portable electronic device according to claim 11, wherein the step of the processor executing the corresponding manipulation command according to the manipulation gesture further comprises:

If the current control mode is the control lens mode, detecting the moving direction of the single contact;

When the moving direction of the single contact is vertical movement, a control command for controlling the up and down rotation of the lens in the corresponding direction is generated, and when the moving direction of the single contact is horizontally moving, the corresponding direction of the control plane is generated. Manipulate commands.
One or more computer non-volatile storage media storing computer readable instructions, when executed by one or more processors, cause the one or more processors to perform the steps of:

Displaying an image transmission interface on the touch screen of the portable electronic device, the image transmission interface for displaying a picture captured by the drone;

Detecting a touch signal applied to the touch screen;

If the touch signal is detected, acquiring a manipulation gesture according to the touch signal; and

Generating a corresponding manipulation command according to the manipulation gesture, and transmitting the manipulation command to the drone.