WO2020199126A1 - Control method for movable platform, control terminal, and computer readable storage medium - Google Patents

Abstract

A control method for a movable platform, a control terminal, and a computer readable storage medium. The method comprises: outputting target training task prompt information, the target training task prompt information being used for instructing a user to control the movable platform to perform a target training task, the movable platform being restricted to move within a target area, and the target area being determined by the movable platform according to target area information; detecting a target control operation inputted by the user, and determining control information of the movable platform according to the detected target control operation; and sending the control information to the movable platform, the control information being used for controlling the movable platform to perform the target training task within the target area. The embodiments of the present invention can not only instruct the user to control the movable platform by means of training tasks so as to reduce the difficulty of the user to get started, but also improve the safety of operating the movable platform by restricting the movement area of the movable platform.

Description

Control method of movable platform, control terminal and computer readable storage medium Technical field

The present invention relates to the field of control technology, in particular to a control method of a movable platform, a control terminal and a computer-readable storage medium.

Background technique

At present, the functions of mobile platforms such as unmanned aerial vehicles, unmanned ships, and mobile vehicles are constantly enriched, and they have been widely used in public services, agriculture, surveillance, and aerial photography. The user can use the control device that establishes a communication connection with the movable platform to control the movable platform to perform task operations, such as controlling the movement of the movable platform. But for users who are new to the mobile platform, they usually don’t know how to use the control terminal to control the mobile platform. They can only learn how to control the mobile platform through graphic textbooks, instruction manuals, and constant hands-on attempts. The content of textbooks and instruction manuals is difficult to understand, and there is a certain difference from the actual control, which makes it difficult to get started, and there is a high possibility of improper operation in the process of getting started. Improper operation can easily cause the mobile platform to malfunction or Damage, or even cause other safety issues.

Summary of the invention

The embodiment of the invention discloses a method for controlling a movable platform, a control terminal and a computer-readable storage medium, which can not only instruct the user to control the movable platform through a training task, thereby reducing the difficulty for the user to get started, but also restrict the movable platform. The mobile area of the platform can improve the safety of operating the mobile platform.

The first aspect of the embodiments of the present invention discloses a control method of a movable platform, which is applied to a control terminal, and the method includes:

Output target training task prompt information, where the target training task prompt information is used to instruct the user to control the movable platform to perform the target training task, the movable platform is restricted to move within the target area, and the target area is the Determined by the mobile platform based on the target area information;

Detecting the target control operation input by the user, and determining the control information of the movable platform according to the detected target control operation;

The control information is sent to the movable platform, wherein the control information is used to control the movable platform to perform the target training task in the target area.

The second aspect of the embodiments of the present invention discloses a control terminal, which includes a memory, a communication interface and a processor,

The memory is used to store program instructions;

The processor is configured to execute program instructions stored in the memory, and when the program instructions are executed, the processor is configured to:

Output target training task prompt information, where the target training task prompt information is used to instruct the user to control the movable platform to perform the target training task, the movable platform is restricted to move within the target area, and the target area is the Determined by the mobile platform based on the target area information;

Detecting the target control operation input by the user, and determining the control information of the movable platform according to the detected target control operation;

The control information is sent to the movable platform through the communication interface, where the control information is used to control the movable platform to perform the target training task in the target area.

A third aspect of the embodiments of the present invention discloses a computer-readable storage medium in which a computer program is stored, and when the computer program is executed by a processor, the steps of the method described in the first aspect are implemented .

In the embodiment of the present invention, the target training task prompt information is first output to instruct the user to control the movable platform to perform the target training task, and then the target control operation input by the user is detected, and the control information corresponding to the target control operation is sent to the movable platform , To control the movable platform to perform the target training task in the target area. In the above method, not only can the user be instructed to control the movable platform through the training task, thereby reducing the difficulty for the user to get started, but also by restricting the movement area of the movable platform. Improve the safety of operating mobile platforms.

Description of the drawings

In order to explain the technical solutions in the embodiments of the present invention more clearly, the following will briefly introduce the drawings needed in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative labor, other drawings can be obtained from these drawings.

FIG. 1 is a schematic diagram of the architecture of a mobile platform control system disclosed in an embodiment of the present invention;

2 is a schematic flowchart of a method for controlling a movable platform disclosed in an embodiment of the present invention;

3 is a schematic diagram of a control interface disclosed in the first embodiment of the present invention;

4 is a schematic diagram of a control interface disclosed in the second embodiment of the present invention;

5 is a schematic diagram of a control interface disclosed in the third embodiment of the present invention;

6 is a schematic flowchart of another method for controlling a movable platform disclosed in an embodiment of the present invention;

7 is a schematic diagram of a control interface disclosed in the fourth embodiment of the present invention;

FIG. 8 is a schematic flowchart of another method for controlling a movable platform disclosed in an embodiment of the present invention;

9 is a schematic diagram of a control interface disclosed in the fifth embodiment of the present invention;

Fig. 10 is a schematic structural diagram of a control terminal disclosed in an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention.

In the embodiment of the present invention, the movable platform may be a movable device such as an unmanned aerial vehicle (UAV), an unmanned vehicle (or a movable car), an unmanned ship, and a mobile robot. The mobile platform can be equipped with a positioning device and a camera. The positioning device can be at least one of a visual inertial odometer (VIO) and a GPS module; the camera can be a cloud mounted on the mobile platform. On the stage; the PTZ set on the movable platform can be rotatable or fixed. The control terminal is a smart device that can be used to control the mobile platform to perform task operations, such as a smart remote control, a smart phone and other mobile terminal devices; the control terminal can be equipped with a display device, which can be a display screen.

Please refer to FIG. 1, which is a schematic structural diagram of a movable platform control system provided by an embodiment of the present invention. As shown in FIG. 1, the movable platform control system includes a control terminal 100 and a movable platform 200, and a communication connection is established between the control terminal 100 and the movable platform 200. When the target training task is detected, the control terminal 100 outputs target training task prompt information, which is used to instruct the user to control the movable platform 200 to perform the target training task. Further, the control terminal 100 detects the target control operation input by the user, and determines the control information for controlling the movable platform 200 according to the detected target control operation; and then sends the control information to the movable platform 200. After the mobile platform 200 receives the control information sent by the control terminal 100, it controls the mobile platform 200 to perform the target training task according to the control information. Among them, the movable platform 200 is restricted to move in the target area, and is restricted to perform target training tasks in the target area. The target area is determined by the movable platform 200 according to the target area information. The target area information may be pre-stored in the movable platform 200, or may be sent to the movable platform 200 by the control terminal 100. Using the above method, not only can the user be instructed to control the movable platform through the training task, thereby reducing the difficulty of the user to get started, and helping the user to get started quickly, but also can improve the safety of operating the movable platform by limiting the movement area of the movable platform , To a certain extent, reduce the possibility of failure or damage to the movable platform due to improper operation. It should be noted that the movable platform 200 in FIG. 1 is illustrated by using a drone as an example, and the control terminal 100 is illustrated by using a smart phone as an example. The movable platform 200 includes but is not limited to drones, and the control terminal 100 includes but is not limited to smart phones.

Please refer to FIG. 2, which is a schematic flowchart of a method for controlling a movable platform according to the first embodiment of the present invention. The control method of the movable platform described in the embodiment of the present invention is applied to the control terminal in the control system of the movable platform as shown in FIG. 1. The control method of the movable platform may include:

S201. The control terminal outputs target training task prompt information, where the target training task prompt information is used to instruct the user to control the movable platform to perform the target training task, and the movable platform is restricted to move within the target area.

In the embodiment of the present invention, the target training task prompt information is used to instruct the user to control the mobile platform to perform the target training task, that is, any information used to prompt the user to control the mobile platform to complete which target training task. In an embodiment, the target training task may include one or more of the tasks of controlling the movable platform to move to the target position, controlling the movable platform to take pictures, video, flip, or adjust the shooting posture. The control terminal may use at least one of a text format, a video format, an animation format, and an audio format to output the target training task prompt information.

Among them, before outputting the target training task prompt information, the control terminal first establishes a communication connection with the movable platform. The control terminal may establish communication with the movable platform by connecting to the wireless signal transmitted by the movable platform. Wherein, the wireless signal may be generated based on wireless protocols such as Wireless Fidelity (Wi-Fi), Software Definition Radio (SDR), cellular communication or Bluetooth. In one embodiment, before establishing a communication connection with the mobile platform, the control terminal outputs a communication connection prompt information used to introduce to the user how to establish a communication connection with the mobile platform; the control terminal may adopt text, video, and animation forms And at least one of audio formats to output the communication connection prompt information. In another embodiment, after the output of the communication connection prompt information is completed, it is determined whether the control terminal has successfully established a communication connection with the movable platform at a preset time interval, and if not, the communication connection prompt information is output again.

In one embodiment, after the control terminal successfully establishes a communication connection with the movable platform, the control terminal outputs a training task selection interface, the training task selection interface includes at least one training task option; the control terminal acquires the user’s response to the at least one training task Option input selection instruction, and use the training task corresponding to the selection instruction as the target training task. In another embodiment, the at least one training task option is sorted according to the difficulty index of the corresponding training task, which may be in order from left to right, and the difficulty of the training task corresponding to the training task option ranked first The index is lower than the difficulty index of the training task corresponding to the training task option ranked next. The first training task option for which the corresponding difficulty index is not the lowest remains locked. When the control terminal determines that the user controls the movable platform to complete the training task corresponding to the second training task option, unlock the first training task option; The training task option is the training task option with the corresponding difficulty index ranked first in the first training task option. By adopting the above method, the training tasks are changed from easy to difficult, which not only brings a better training experience to the user, but also reduces the user's misoperation during the hands-on process to a certain extent and improves the safety during the training process.

In an embodiment, after determining the target training task selected by the user, before outputting the target training task prompt information, the control terminal outputs the introduction information of the target training task. The introduction information is used to explain and demonstrate the target training task. Among them, the introduction information can be used to explain what type of task the target training task is, the difficulty index of the target training task and the estimated training duration respectively, and can also be used to explain in text or voice what the user corresponding to the target training task needs to perform The input control operation can also be used to demonstrate the input control operation required to be performed by the user corresponding to the target training task through animation or video.

S202: The control terminal detects the target control operation input by the user, and determines the control information of the movable platform according to the detected target control operation.

In the embodiment of the present invention, the target control operation may be input by the user through the control button of the control terminal, the control joystick, or through the user gesture operation. The control button can be a physical control button or a virtual control button; the control joystick can be a physical control joystick or a virtual control joystick; the user gesture operation can be gesture operation, eye movement or head Sports operations, etc. After detecting the target control operation input by the user, the control terminal determines the control information used to control the movable platform to perform the target training task according to the detected target control operation.

In an embodiment, before detecting the target control operation input by the user, the control terminal outputs a control interface for the movable platform, and the control interface includes a control area. The control area is used for the user to input a target control operation to input control instructions for the movable platform; the control area may be one or more. The control terminal detects the target control operation input by the user through the control area, and determines the control information used to control the movable platform to perform the target training task according to the detected target control operation.

Please also refer to FIG. 3, which is a schematic diagram of a control interface provided by the first embodiment of the present invention. As shown in FIG. 3, the control interface includes a first control area 301, a second control area 302, a third control area 303, and a fourth control area 304. Wherein, the first control area 301 includes a first virtual control joystick, which can be used for the user to input forward movement instructions, backward movement instructions, left movement instructions, right movement instructions, and direction One or more of a left-forward movement instruction, a left-rear movement instruction, a right-forward movement instruction, and a right-rear movement instruction. For example, when the control terminal detects the user's touch operation on the control area 3011 of the first virtual control joystick, it is determined that the user inputs a forward movement instruction on the movable platform; when the control terminal detects that the user is on the first virtual control joystick During the touch operation of the control area 3012 in, it is determined that the user inputs a left shift instruction for the movable platform.

Wherein, the second control area 302 includes a second virtual control joystick, and the second virtual control joystick can be used for the user to input an upward movement instruction, a downward movement instruction, a left steering instruction (or a clockwise steering instruction) for the movable platform. ) And one or more of a right steering command (or a counterclockwise steering command). For example, when the control terminal detects the user's touch operation on the control area 3021 in the second virtual control joystick, it is determined that the user inputs an upward movement instruction for the movable platform; when the movable platform is a drone, the upward movement instruction It is an instruction to instruct the drone to fly upward. When the control terminal detects the user's touch operation on the control area 3022 in the second virtual control joystick, it is determined that the user inputs a left steering instruction (or a clockwise steering instruction) for the movable platform. It should be noted that the forward movement, backward movement, left movement, right movement, up movement and down movement mentioned above are relative to the three-dimensional space coordinate system, and the left and right movement can refer to the three-dimensional space coordinate system. The horizontal axis (X axis) in the movement, forward and backward movement can refer to the movement along the vertical axis (Y axis) in the three-dimensional space coordinate system, and the upward and downward movement can refer to the movement along the three-dimensional space coordinate system. The vertical axis (Z axis) moves.

Among them, the third control area 303 includes a virtual camera button 3031 and a virtual video button 3032. The virtual camera button 3031 can be used for the user to input a camera command for the mobile platform, and the virtual video button 3032 can be used for the user to target the mobile platform. The platform enters the video instruction. The fourth control area 303 is a gesture control area preset by the control terminal, which can be used for a user to input a control instruction for the movable platform through a gesture input operation, and the control instruction includes a flip control instruction. For example, when the control terminal detects that the user inputs an upward sliding gesture operation in the fourth control area, it is determined that the user inputs a forward flip control instruction for the movable platform.

In one embodiment, please also refer to FIG. 4, which is a schematic diagram of a control interface provided by the second embodiment of the present invention. Compared with the control interface shown in FIG. 3, the control interface shown in FIG. 4 further includes a fifth control area 305 and a movement status display area 306. As shown in FIG. 4, the fifth control area includes a movement start button 3051 and a movement stop button 3052. When the control terminal detects that the user clicks on the movement start button 3051, it is determined that the user inputs a movement start instruction for the movable platform, and the movement start instruction is used to control the movable platform to start moving. When the control terminal detects that the user clicks on the movement stop button 3052, it is determined that the user inputs a movement stop instruction for the movable platform, and the movement stop instruction is used to control the movable platform to stop moving. As shown in FIG. 4, the moving state display area 306 includes a moving speed display area 3061 and a moving distance display area 3062. The moving speed display area 3061 can be used to display the moving speed of the movable platform during the movement; the moving distance display area 3062 can be used to display the distance between the current position of the movable platform and the geometric center position of the target area; the moving distance display area 3062 can also be used to display the distance between the current position of the movable platform and the initial position of the movable platform.

S203. The control terminal sends the control information to the movable platform, where the control information is used to control the movable platform to perform the target training task in the target area.

In the embodiment of the present invention, the movable platform is restricted to perform target training tasks in the target area. Wherein, the target area is determined by the movable platform based on the target area information, and the target area information may be pre-stored in the movable platform, or may be sent to the movable platform by the control terminal.

For the case where the target area information is pre-stored in the movable platform, the control terminal sends the movement restriction information to the movable platform before sending the control information to the movable platform, or when sending the control information to the movable platform for the first time , The movement restriction information is used to restrict the movable platform from moving within the target area. Among them, after the mobile platform receives the movement restriction information sent by the control terminal, it activates the movement area restriction function, obtains its stored target area information, and determines the target area according to the obtained target area information. In the subsequent execution of the training task, the control movable platform can only execute the target training task in the target area.

For the case where the target area information is sent by the control terminal to the movable platform, the control terminal shall carry the target area information in the movement restriction before sending the control information to the movable platform, or when sending the control information to the movable platform for the first time. The information is sent to the movable platform, and the movement restriction information is used to restrict the movable platform from moving within the target area. Wherein, after receiving the movement restriction information sent by the control terminal, the movable platform activates the movement area restriction function, acquires the target area information included in the movement restriction information, and determines the target area according to the acquired target area information. In the subsequent execution of the training task, the control movable platform can only execute the target training task in the target area.

In an embodiment, when the movable platform is under the control of the movement area limitation function, during the process of performing the target training task under the control of the controlled terminal, if it is detected that the distance between the movable platform and the boundary of the target area is less than or equal to The distance threshold is controlled to reduce the moving speed of the movable platform; if the movable platform is detected to move to the boundary of the target area, the movable platform is controlled to remain stationary. With the above method, it can be ensured that the movable platform is restricted to perform the target training task in the target area.

In an embodiment, the target area information includes position information of the geometric center point of the target area, and a target value that can be used to determine the range of the target area. The target value may be a side length value of the geometric shape of the target area, At least one of the angle length value, the radius value, the diameter value, the length value from the geometric center point to the vertex, the area area, and the area circumference. The movable platform determines the target area based on the position information of the geometric center point and the target value. The geometric center point of the target area includes at least one of the initial position point of the movable platform, the current position point of the movable platform, and the position point of the control terminal.

In an embodiment, the target area may be a circular area, an elliptical area, or a rectangular area. When the target area is a circular area, the target area information includes the position information of the geometric center point of the circular area, and the radius value or diameter value of the circular area, the radius value is, for example, 1 m; the movable platform is based on the geometric center point The location information and the radius or diameter value determine the target area. When the target area is an elliptical area, the target area information includes the position information of the geometric center point of the elliptical area, as well as the length of the major semi-axis and the length of the minor semi-axis of the elliptical area. The movable platform is based on the geometric center point. The position information, the length of the major semi-axis and the length of the minor axis determine the target area. When the target area is a rectangular area, the target area information includes the position information of the geometric center point of the rectangular area, and the length value and width value of the rectangular area. The movable platform is based on the position information of the geometric center point, the length value and the width The value determines the target area.

In one embodiment, the control terminal displays the area icon corresponding to the target area, obtains the current position point of the movable platform in the target area, and displays the area icon in the area icon according to the current position point of the movable platform and the target area information The icon used to indicate the current position of the movable platform. Wherein, the geometric shape corresponding to the area icon can be any of a circle, an ellipse, and a rectangle. Please also refer to FIG. 5, which is a schematic diagram of a control interface provided by the third embodiment of the present invention. Compared with the control interface shown in FIG. 3, the control interface shown in FIG. 5 also includes an area icon 307 corresponding to the target area. As shown in FIG. 5, the geometric shape of the area icon 307 is a circle, and an icon 3071 for indicating the current position of the movable platform is displayed in the area icon 307. By adopting the above method, it is possible to provide users with position reference and route navigation in the process of controlling the movement of the movable platform. In one embodiment, a positioning device is configured on the movable platform, and the positioning device may be a visual inertial odometer, and the control terminal can obtain the position of the movable platform through the visual inertial odometer configured on the movable platform. Using the visual inertial odometer to locate the movable platform, the positioning error is small, and the accuracy of the positioning can be improved.

In an embodiment, after the control terminal outputs the target training task prompt information, it outputs the control operation prompt information. The control terminal may use at least one of a text format, a video format, an animation format, and an audio format to output the control operation prompt information. Wherein, the control operation prompt information is used to indicate to the user an input control operation for controlling the movable platform to perform the target training task. For example, assuming that the target training task includes controlling the movable platform to rotate 360 degrees, the control operation prompt information can be used to prompt the user to perform the operation of triggering the rotation control button, and can prompt the user where the rotation control button is located and trigger rotation The duration of the control button, etc.

In one embodiment, after the control terminal sends the control information corresponding to the target control operation input by the user to the mobile platform, it detects whether the mobile platform has completed the current target training task; if it is detected that the mobile platform has completed the current target training task; For the target training task, the prompt information for the next target training task is output on the interactive interface of the control terminal, or the prompt information for the mobile platform to complete the current target training task is output on the interactive interface, or on the interactive interface The introduction information of the next target training task is output on the top. In another embodiment, after the control terminal sends the control information corresponding to the target control operation input by the user to the movable platform, it detects whether the movable platform has completed the current training task in the target training task; if the movable platform is detected After the current training task in the target training task has been executed, the prompt information or introduction information of the next target training task in the target training task is output on the interactive interface of the control terminal.

In the embodiment of the present invention, the target training task prompt information is first output to instruct the user to control the movable platform to perform the target training task, and then the target control operation input by the user is detected, and the control information corresponding to the target control operation is sent to the movable platform , To control the movable platform to perform the target training task in the target area. In the above method, not only can the user be instructed to control the movable platform through the training task, thereby reducing the difficulty for the user to get started, but also by restricting the movement area of the movable platform. Improve the safety of operating mobile platforms.

Please refer to FIG. 6, which is a schematic flowchart of a method for controlling a movable platform according to a second embodiment of the present invention. The control method of the movable platform described in the embodiment of the present invention is applied to the control terminal in the control system of the movable platform as shown in FIG. 1. The control method of the movable platform may include:

S601. The control terminal outputs target training task prompt information, where the target training task prompt information is used to instruct the user to control the movable platform to perform a target training task. The target training task includes a task to move to a target location. The mobile platform is restricted to move within the target area.

In the embodiment of the present invention, the target area is determined by the movable platform according to the target area information. The location where the target location point is located is also within the target area, and there may be one or more target location points. The control terminal may determine a point separated by a first preset distance from the initial position point of the movable platform as the target position point; the target position point may also be randomly determined by the control terminal according to the target area information.

S602. The control terminal displays the area icon corresponding to the target area, and displays the first position point icon of the target position point in the area icon, and according to the current position point of the movable platform and the target Area information, displaying a second position point icon for indicating the current position point of the movable platform in the area icon.

In the embodiment of the present invention, the first location point icon of the target location point and the second location point icon of the current location point of the movable platform are displayed in the area icon, which can let the user know that the movable platform needs to be controlled to move to The end position of the terminal, and allows the user to understand and determine the approximate path that controls the movable platform to move from the current position to the target position.

In an embodiment, the control terminal displays a trajectory from the second location point icon to the first location point icon in the area icon, and the trajectory is used to indicate a target path for controlling the movable platform to move from the current location point to the target location point. The target path may be the shortest path for controlling the movable platform to move from the current location point to the target location point, and the target path may also be a path randomly planned by the control terminal according to the current location point and the target location point of the movable platform. Please also refer to FIG. 7, which is a schematic diagram of a control interface provided by the fourth embodiment of the present invention. Compared with the control interface described in FIG. 5, the control interface shown in FIG. 7 also displays the area icon 307 in the control interface. There are the icon of the target location point, and the trajectory from the icon of the current location point of the movable platform to the icon of the target location point. As shown in Fig. 7, the icon of the current position point of the movable platform is the second position point icon 3071 in the area icon 307, and the icon of the target position point is the first position point icon 3072 in the area icon 307. The trajectory of the point icon 3071 to the first position point icon 3072 is 3073, which is used to indicate the shortest path from the second position point icon 3071 to the first position point icon 3072, that is, to indicate the control of the movable platform from the current position point The shortest path to move to the target location point.

S603. The control terminal detects the movement control operation input by the user, and sends the control information corresponding to the movement control operation to the movable platform, wherein the control information corresponding to the movement control operation is used to control the mobile platform. The movable platform moves from the current position point to the target position point in the target area.

For example, please refer to FIG. 7 together. As shown in FIG. 7, the first position point icon 3072 corresponding to the target position point is located on the left side of the second position point icon 3071 corresponding to the current position point of the movable platform. Move the movable platform to the left to control the movable platform to move from the current position to the target position. If the control terminal detects the touch operation input by the user on the control area 3012 in the first control area 301, it is determined that the user has input the left shift control operation. Then the left shift control information corresponding to the left shift control operation is sent to the mobile platform. After receiving the left shift control information, the movable platform controls the movable platform to move to the left to move from the current position point to the target position point in the target area.

In one embodiment, before the control terminal detects the movement control operation input by the user, it outputs the movement control operation prompt information, and the control terminal can output the movement control in at least one of text form, video form, animation form, and audio form Operation prompt information. Wherein, the movement control operation prompt information is used to indicate to the user an input movement control operation for controlling the movable platform to move from the current position point to the target position point. For example, assuming that the target location point is on the right side of the current location point of the movable platform, the movement control operation prompt information can be used to prompt the user to perform the operation of triggering the right-shift button or the right-shift control area, and can prompt the user Move the button right or move the position of the control area right.

S604. When it is determined that the movable platform has moved to the target location point, the control terminal detects the shooting control operation input by the user, and sends control information corresponding to the shooting control operation to the movable platform. Wherein, the target training task also includes a photographing task or a video recording task, and the control information corresponding to the photographing control operation is used to control the movable platform to perform a photographing task or a video recording task at the target location point.

In the embodiment of the present invention, after the control terminal sends the control information corresponding to the shooting control operation to the mobile platform, it obtains the target image obtained by the mobile platform during the photographing task, or obtains the mobile platform during the recording task. Record the target video; and display the target image or play the target video in the interactive interface of the control terminal.

In one embodiment, before the control terminal detects the shooting control operation input by the user, it outputs the shooting control operation prompt information. The control terminal may output the shooting control in at least one of text form, video form, animation form, and audio form. Operation prompt information. Wherein, the shooting control operation prompt information is used to instruct the user to control the shooting control operation of the movable platform to take pictures or video. The shooting control operation prompt information can be used to prompt the user to perform the operation of triggering the camera button or the operation of triggering the video button, and can prompt the user where the camera button or the video button is located. The camera button can be triggered by pressing the physical camera button or by clicking the virtual camera button. The recording button can be triggered by pressing the physical recording button or clicking the virtual recording button.

In one embodiment, when the control information corresponding to the shooting control operation is used to control the movable platform to perform the video recording task at the target location, the control information corresponding to the shooting control operation is also used to control the movable platform to perform the video recording task. Adjust the shooting posture of the movable platform during the process. Specifically, when the control terminal detects that the user has performed a video triggering button operation, it is determined that the user has input a video control operation, and the control information corresponding to the video control operation is sent to the movable platform. The control information corresponding to the video control operation is used to control the movable platform to perform the video recording task at the target position, and to control the movable platform to adjust the shooting posture according to preset rules during the process of performing the video task. The preset rule refers to: controlling the movable platform to rotate a preset angle in a preset direction, or controlling the target axis of a pan/tilt equipped with a camera configured on the movable platform to rotate to a preset position. Wherein, the preset direction may be a clockwise direction or a counterclockwise direction, the target axis may be the yaw axis, pitch axis or roll axis of the pan/tilt head, and the joint angle of the preset position as the target axis is a predetermined angle. In an embodiment, the predetermined angle may be 30 degrees to 360 degrees, and the predetermined angle may be the joint angle of the target axis of 30 degrees to 120 degrees.

In another embodiment, the target training task further includes a shooting task and adjusting the shooting posture of the movable platform. The shooting task may be a photographing task or a video recording task. When it is determined that the movable platform moves to the target position point, the control terminal detects the shooting control operation and the rotation control operation input by the user, and sends the control information corresponding to the shooting control operation and the rotation control operation to the movable platform. Wherein, the control information corresponding to the shooting control operation is used to control the movable platform to perform the shooting task at the target location point, and the control information corresponding to the rotation control operation is used to control the movable platform to adjust the shooting posture during the execution of the shooting task. The control information corresponding to the rotation control operation is specifically used to control the movable platform to adjust the shooting posture according to a preset rule. The preset rule refers to: controlling the movable platform to rotate a preset angle in a preset direction, or controlling the target axis of a pan/tilt equipped with a camera configured on the movable platform to rotate to a preset position.

Refer to FIG. 8, which is a schematic flowchart of a method for controlling a movable platform according to a third embodiment of the present invention. The control method of the movable platform described in the embodiment of the present invention is applied to the control terminal in the control system of the movable platform as shown in FIG. 1. The control method of the movable platform may include:

S801. The control terminal outputs target training task prompt information, where the target training task prompt information is used to instruct the user to control the movable platform to perform the target training task, the target training task includes a flip task, and the movable platform is restricted to Move within the target area.

In the embodiment of the present invention, the target area is determined by the movable platform according to the target area information.

S802. The control terminal detects the flip control operation input by the user, and sends the control information corresponding to the flip control operation to the movable platform, wherein the control information corresponding to the flip control operation is used to control the The movable platform performs a turnover task in the target area.

For example, please also refer to FIG. 9, which is a schematic diagram of a control interface provided by the fifth embodiment of the present invention. Compared with the control interface shown in FIG. 5, the control interface shown in FIG. The control area includes a track area 3041, and the track area 3041 is used to indicate gesture operations input by the user. As shown in FIG. 9, the track area 3041 indicates that the gesture operation input by the user is sliding to the right. If the controlling terminal detects that the user's gesture operation input in the fourth control area 304 is sliding to the right, and the sliding distance to the right is greater than the second preset distance, it is determined that the user has input the right flip control operation; The right turning control information corresponding to the right turning control operation is sent to the movable platform. After the movable platform receives the right flip control information, it controls the movable platform to perform a right flip task in the target area.

In an embodiment, the control terminal outputs the prompt information of the flip control operation before detecting the flip control operation input by the user, and the control terminal may output the flip control in at least one of text, video, animation, and audio formats. Operation prompt information. Wherein, the flip control operation prompt information is used to instruct the user to control the movable platform to perform the input flip control operation of the flip task along the preset direction. The flip task can include any one of forward flip, backward flip, left flip, and right flip. For example, assuming that the target training task includes a forward flip task, the flip control operation prompt information can be used to prompt the user to enter an upward sliding gesture operation in the gesture control area, and the upward sliding gesture can be shown to the user in the gesture control area operating. The flip control operation prompt information can also be used to prompt the user to perform an operation that triggers the forward flip control button, and can prompt the user where the forward flip control button is located.

In one embodiment, before detecting the flip control operation input by the user, the control terminal controls the movable platform to enter the flip mode and displays the area icon corresponding to the target area, and the mobile platform icon corresponding to the movable platform is displayed in the area icon. The mobile platform icon may be located at the geometric center point of the area icon. Further, the target object icon is displayed in the area icon according to a preset display mode, and in the process of displaying the target object icon according to the preset display mode, the flip control operation input by the user is detected, and the control information corresponding to the flip control operation is detected Sent to the movable platform to control the movable platform to perform flipping tasks in the target area. Among them, displaying the target object icon in the area icon according to the preset display mode means: moving and displaying the target object icon in the area icon according to the preset moving direction, and the target object icon will pass through the display of the mobile platform icon during the moving display process position. The preset moving direction includes any one of bottom to top, top to bottom, left to right, or right to left. In the process of the mobile platform performing the flip task, the mobile platform icon is not displayed in the area icon; if the mobile platform icon is not displayed in the area icon, the target object icon is detected to move through the mobile platform before performing the flip task. The display position of the mobile platform icon in the area icon determines that the movable platform successfully avoids the target object, and it is determined that the movable platform completes the flip task.

It should be noted that the specific implementation of some steps in the embodiment shown in FIG. 8 and FIG. 6 can refer to the description in the embodiment shown in FIG. 2, and will not be repeated here.

Refer to FIG. 10, which is a schematic structural diagram of a control terminal provided by an embodiment of the present invention. The control terminal described in the embodiment of the present invention includes a processor 1001, a communication interface 1002, a user interface 1003, and a memory 1004. Among them, the processor 1001, the communication interface 1002, the user interface 1003, and the memory 1004 may be connected by a bus or other methods. The embodiment of the present invention takes the connection by a bus as an example.

The processor 1001 may be a central processing unit (CPU), or a core used to implement communication identification binding in a multi-core CPU. The processor 1001 may be a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a general array logic (generic array logic, GAL) or any combination thereof.

The communication interface 1002 may be used for the interaction of sending and receiving information or signaling, as well as the reception and transmission of signals. The communication interface 1002 may optionally include a standard wireless interface (such as Wi-Fi, mobile communication interface, etc.). The user interface 1003 is a medium for realizing interaction and information exchange between the user and the control terminal. The specific embodiment may include a display and a speaker for output, and keys, a joystick, a touch screen and a mark for input. Wind, etc.; it should be noted that the buttons and joysticks here can be either physical or virtual. The memory 1004 may mainly include a storage program area and a storage data area. The storage program area can store an operating system and a storage program required by at least one function (such as a text storage function, a location storage function, etc.); the storage data area can store Data (such as image data, text data) created according to the use of the device, etc., and may include application storage programs, etc. In addition, the memory 1004 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.

The memory 1004 is also used to store program instructions. The processor 1001 is configured to execute program instructions stored in the memory 1004. When the program instructions are executed, the processor 1001 is configured to: output target training task prompt information through the user interface 1003, where: The target training task prompt information is used to instruct the user to control the movable platform to perform the target training task, the movable platform is restricted to move within the target area, and the target area is determined by the movable platform according to the target area information Detect the target control operation input by the user, and determine the control information of the movable platform according to the detected target control operation; send the control information to the movable platform through the communication interface, wherein the The control information is used to control the movable platform to perform the target training task in the target area.

The methods executed by the processor in the embodiment of the present invention are all described from the perspective of the processor. It is understandable that the processor in the embodiment of the present invention needs the cooperation of other hardware structures to execute the foregoing method. The embodiments of the present invention do not make detailed descriptions and restrictions on the specific implementation process.

In an embodiment, the processor 1001 is further configured to send movement restriction information to the movable platform through the communication interface 1002, where the movement restriction information is used to restrict the movable platform from being Move within the target area.

In an embodiment, the movement restriction information includes the target area information. In an embodiment, the target area information includes position information of a geometric center point of the target area. In an embodiment, the geometric center point includes at least one of an initial position point of the movable platform, a current position point of the movable platform, and a position point of the control terminal. In an embodiment, the target area is a circular area, and the target area information includes a radius value or a diameter value of the circular area. In an embodiment, the target training task includes at least one of a task of moving to a target location point, a photographing task, a video recording task, adjusting the shooting posture of the movable platform, and a flipping task.

In an embodiment, the processor 1001 is further configured to: display the area icon corresponding to the target area through the user interface 1003; according to the current position of the movable platform and the target area information, pass The user interface 1003 displays an icon for indicating the current position of the movable platform in the area icon.

In an embodiment, the position of the movable platform is determined according to a visual inertial odometer configured on the movable platform.

In an embodiment, after the processor 1001 outputs the target training task prompt information through the user interface 1003, the processor 1001 is further configured to: output control operation prompt information through the user interface 1003, where the The control operation prompt information is used to indicate to the user an input control operation for controlling the movable platform to perform the target training task.

In an embodiment, the target training task includes a task of moving to a target location point. Before the processor 1001 detects the target control operation input by the user, the processor 1001 is further configured to: display through the user interface 1003 The area icon corresponding to the target area, the first position point icon of the target position point is displayed in the area icon; according to the current position point of the movable platform and the target area information, through the user The interface 1003 displays the second position point icon indicating the current position point of the movable platform in the area icon; wherein, when the processor 1001 detects the target control operation input by the user, it is specifically used to: detect the user The input movement control operation, wherein the control information corresponding to the movement control operation is used to control the movable platform to move from the current position point to the target position point in the target area.

In an embodiment, the processor 1001 is further configured to display a trajectory from the second position point icon to the first position point icon in the area icon through the user interface 1003, wherein The track is used to indicate a target path for the movable platform to move from the current position point to the target position point.

In an embodiment, the processor 1001 is further configured to: output movement control operation prompt information through the user interface 1003, wherein the movement control operation prompt information is used to indicate to the user to control the movable platform from all directions. The input movement control operation of moving the current position point to the target position point.

In an embodiment, the target training task further includes a photographing task or a video recording task, and the processor 1001 is further configured to: when it is determined that the movable platform has moved to the target position point, detect the photographing control input by the user Operation; wherein the control information corresponding to the shooting control operation is used to control the movable platform to perform a photographing task or a video recording task at the target location point.

In an embodiment, when the control information corresponding to the shooting control operation is used to control the movable platform to perform a video recording task at the target location, the control information corresponding to the shooting control operation is also used to control The movable platform adjusts the shooting posture of the movable platform during the execution of the video recording task.

In an embodiment, the target training task includes a flip task. When the processor 1001 detects a target control operation input by a user, it is specifically configured to: detect a flip control operation input by the user, wherein the flip control operation corresponds to The control information is used to control the movable platform to perform a flipping task in the target area.

In one embodiment, the processor 1001 is further configured to: output tipping control operation prompt information through the user interface 1003, wherein the tipping control operation prompt information is used to instruct the user to control the movable platform to execute the edge The input flip control operation of the flip task in the preset direction.

In an embodiment, before the processor 1001 outputs the target training task prompt information through the user interface 1003, the processor 1001 is further configured to: output the introduction information of the target training task through the user interface 1003, Wherein, the introduction information includes at least one of the type of the target training task, the difficulty index, the expected training duration, and the input control operation corresponding to the target training task.

In an embodiment, after the processor 1001 sends the control information to the movable platform through the communication interface, the processor 1001 is further configured to: detect whether the movable platform has finished executing the current Target training task; if yes, output prompt information for the next target training task on the interactive interface, or output prompt information on the interactive interface that the movable platform has completed the current target training task, or The introduction information of the next target training task is output on the interactive interface.

In an embodiment, the movable platform is a drone or a mobile robot.

In specific implementation, the processor 1001, the communication interface 1002, the user interface 1003, and the memory 1004 described in the embodiment of the present invention can execute the implementation described in the method for controlling a movable platform provided by the embodiment of the present invention. This will not be repeated here.

An embodiment of the present invention also provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the method for controlling the movable platform described in the foregoing method embodiment is implemented .

The embodiment of the present invention also provides a computer program product containing instructions, which when running on a computer, causes the computer to execute the control method of the movable platform described in the above method embodiment.

It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described sequence of actions. Because according to the present invention, certain steps can be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the involved actions and modules are not necessarily required by the present invention.

A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by a program instructing relevant hardware. The program can be stored in a computer-readable storage medium, and the storage medium can include: Flash disk, read-only memory (Read-Only Memory, ROM), random access device (Random Access Memory, RAM), magnetic disk or optical disk, etc.

The control method and control terminal of a movable platform provided by the embodiments of the present invention are described in detail above. Specific examples are used in this article to explain the principles and implementation of the present invention. The description of the above embodiments is only for Help understand the method of the present invention and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and the scope of application. In summary, the content of this specification It should not be understood as a limitation to the present invention.

Claims (41)

1. A control method of a movable platform, characterized in that it is applied to a control terminal, and the method includes:

   Output target training task prompt information, where the target training task prompt information is used to instruct the user to control the movable platform to perform the target training task, the movable platform is restricted to move within the target area, and the target area is the Determined by the mobile platform based on the target area information;

   Detecting the target control operation input by the user, and determining the control information of the movable platform according to the detected target control operation;

   The control information is sent to the movable platform, wherein the control information is used to control the movable platform to perform the target training task in the target area.
2. The method of claim 1, wherein the method further comprises:

   Sending movement restriction information to the movable platform, wherein the movement restriction information is used to restrict the movable platform from moving within the target area.
3. The method according to claim 2, wherein the movement restriction information includes the target area information.
4. The method according to any one of claims 1 to 3, wherein the target area information includes position information of a geometric center point of the target area.
5. The method according to claim 4, wherein the geometric center point includes at least one of an initial position point of the movable platform, a current position point of the movable platform, and a position point of the control terminal Kind.
6. The method according to any one of claims 1 to 5, wherein the target area is a circular area, and the target area information includes a radius value or a diameter value of the circular area.
7. The method according to any one of claims 1 to 6, wherein the target training task includes a task of moving to a target location, a task of taking pictures, a task of recording, adjusting the shooting posture of the movable platform and turning At least one of the tasks.
8. The method according to any one of claims 1 to 7, wherein the method further comprises:

   Displaying the area icon corresponding to the target area;

   According to the current position point of the movable platform and the target area information, an icon for indicating the current position point of the movable platform is displayed in the area icon.
9. The method according to claim 8, wherein the position of the movable platform is determined according to a visual inertial odometer configured on the movable platform.
10. The method according to any one of claims 1 to 9, characterized in that, after the output of the target training task prompt information, the method further comprises:

    Output control operation prompt information, wherein the control operation prompt information is used to indicate to the user an input control operation for controlling the movable platform to perform the target training task.
11. The method according to any one of claims 1 to 10, wherein the target training task includes a task of moving to a target location point, and before the detecting the target control operation input by the user, the method further comprises:

    Displaying the area icon corresponding to the target area;

    Displaying the first location point icon of the target location point in the area icon;

    According to the current location point of the movable platform and the target area information, displaying a second location point icon for indicating the current location point of the movable platform in the area icon;

    The detection of the target control operation input by the user includes:

    The movement control operation input by the user is detected, wherein the control information corresponding to the movement control operation is used to control the movable platform to move from the current position point to the target position point in the target area.
12. The method of claim 11, wherein the method further comprises:

    A trajectory from the second location point icon to the first location point icon is displayed in the area icon, wherein the trajectory is used to instruct the movable platform to move from the current location point to the target The target path of the location point.
13. The method according to claim 11 or 12, wherein the method further comprises:

    Output movement control operation prompt information, where the movement control operation prompt information is used to indicate to the user an input movement control operation for controlling the movable platform to move from the current position point to the target position point.
14. The method according to any one of claims 11 to 13, wherein the target training task further comprises a photographing task or a video recording task, and the method further comprises:

    When it is determined that the movable platform moves to the target position point, the user inputted shooting control operation is detected; wherein, the control information corresponding to the shooting control operation is used to control the movable platform at the target position point Perform photo task or video task.
15. The method according to claim 14, wherein when the control information corresponding to the shooting control operation is used to control the movable platform to perform a video recording task at the target location point, the shooting control operation corresponds to The control information is also used to control the movable platform to adjust the shooting posture of the movable platform during the process of performing the video recording task.
16. The method according to any one of claims 1 to 10, wherein the target training task includes a flip task, and the detecting a target control operation input by a user includes:

    Detecting a turning control operation input by a user, wherein the control information corresponding to the turning control operation is used to control the movable platform to perform a turning task in the target area.
17. The method of claim 16, wherein the method further comprises:

    Outputting the flip control operation prompt information, wherein the flip control operation prompt information is used to instruct the user to control the movable platform to perform the flip task input in the preset direction.
18. The method according to any one of claims 1 to 17, wherein before the output of the target training task prompt information, the method further comprises:

    Outputting introduction information of the target training task, wherein the introduction information includes at least one of the type of the target training task, the difficulty index, the estimated training duration, and the input control operation corresponding to the target training task.
19. The method according to any one of claims 1 to 18, wherein after the sending the control information to the movable platform, the method further comprises:

    Detecting whether the movable platform has completed the current target training task;

    If yes, output prompt information for the next target training task on the interactive interface, or output prompt information on the interactive interface that the mobile platform has completed the current target training task, or output on the interactive interface The above shows the introduction information of the next target training task.
20. The method according to any one of claims 1 to 19, wherein the movable platform is a drone or a mobile robot.
21. A control terminal, which is characterized by comprising: a memory, a communication interface and a processor,

    The memory is used to store program instructions;

    The communication interface is controlled by the processor for sending and receiving information;

    The processor is configured to execute program instructions stored in the memory, and when the program instructions are executed, the processor is configured to:

    Output target training task prompt information, where the target training task prompt information is used to instruct the user to control the movable platform to perform the target training task, the movable platform is restricted to move within the target area, and the target area is the Determined by the mobile platform based on the target area information;

    Detecting the target control operation input by the user, and determining the control information of the movable platform according to the detected target control operation;

    The control information is sent to the movable platform through the communication interface, where the control information is used to control the movable platform to perform the target training task in the target area.
22. The control terminal according to claim 21, wherein the processor is further configured to:

    Sending movement restriction information to the movable platform through the communication interface, where the movement restriction information is used to restrict the movable platform from moving within the target area.
23. The control terminal according to claim 22, wherein the movement restriction information includes the target area information.
24. The control terminal according to any one of claims 21 to 23, wherein the target area information includes position information of a geometric center point of the target area.
25. The control terminal according to claim 24, wherein the geometric center point comprises at least one of the initial position point of the movable platform, the current position point of the movable platform, and the position point of the control terminal One kind.
26. The control terminal according to any one of claims 21 to 25, wherein the target area is a circular area, and the target area information includes a radius value or a diameter value of the circular area.
27. The control terminal according to any one of claims 21 to 26, wherein the target training task includes a task of moving to a target location point, a photographing task, a video recording task, adjusting the shooting posture of the movable platform, and At least one of the flipped tasks.
28. The control terminal according to any one of claims 21 to 27, wherein the processor is further configured to:

    Displaying the area icon corresponding to the target area;

    According to the current position point of the movable platform and the target area information, an icon for indicating the current position point of the movable platform is displayed in the area icon.
29. The control terminal according to claim 28, wherein the position of the movable platform is determined according to a visual inertial odometer configured on the movable platform.
30. The control terminal according to any one of claims 21 to 29, wherein after the processor outputs the target training task prompt information, the processor is further configured to:

    Output control operation prompt information, wherein the control operation prompt information is used to indicate to the user an input control operation for controlling the movable platform to perform the target training task.
31. The control terminal according to any one of claims 21 to 30, wherein the target training task includes a task of moving to a target location point, and before the processor detects the target control operation input by the user, the processing The device is also used for:

    Displaying the area icon corresponding to the target area;

    Displaying the first location point icon of the target location point in the area icon;

    According to the current location point of the movable platform and the target area information, displaying a second location point icon for indicating the current location point of the movable platform in the area icon;

    When the processor detects the target control operation input by the user, it is specifically used for:

    The movement control operation input by the user is detected, wherein the control information corresponding to the movement control operation is used to control the movable platform to move from the current position point to the target position point in the target area.
32. The control terminal according to claim 31, wherein the processor is further configured to:

    A trajectory from the second location point icon to the first location point icon is displayed in the area icon, wherein the trajectory is used to instruct the movable platform to move from the current location point to the target The target path of the location point.
33. The control terminal according to claim 31 or 32, wherein the processor is further configured to: output movement control operation prompt information, wherein the movement control operation prompt information is used to instruct a user to control the movable An input movement control operation for the platform to move from the current position point to the target position point.
34. The control terminal according to any one of claims 31 to 33, wherein the target training task further includes a photographing task or a video recording task, and the processor is further configured to:

    When it is determined that the movable platform moves to the target position point, the user inputted shooting control operation is detected; wherein, the control information corresponding to the shooting control operation is used to control the movable platform at the target position point Perform photo task or video task.
35. The control terminal according to claim 34, wherein when the control information corresponding to the shooting control operation is used to control the movable platform to perform a video recording task at the target location, the shooting control operation The corresponding control information is also used to control the movable platform to adjust the shooting posture of the movable platform in the process of performing the video recording task.
36. The control terminal according to any one of claims 21 to 30, wherein the target training task includes a flip task, and when the processor detects the target control operation input by the user, it is specifically configured to:

    Detecting a turning control operation input by a user, wherein the control information corresponding to the turning control operation is used to control the movable platform to perform a turning task in the target area.
37. The control terminal according to claim 36, wherein the processor is further configured to:

    Outputting the flip control operation prompt information, wherein the flip control operation prompt information is used to instruct the user to control the movable platform to perform the flip task input in the preset direction.
38. The control terminal according to any one of claims 21 to 37, wherein before the processor outputs the target training task prompt information, the processor is further configured to:

    Outputting introduction information of the target training task, wherein the introduction information includes at least one of the type of the target training task, the difficulty index, the estimated training duration, and the input control operation corresponding to the target training task.
39. The control terminal according to any one of claims 21 to 38, wherein after the processor sends the control information to the movable platform through the communication interface, the processor is further configured to :

    Detecting whether the movable platform has completed the current target training task;

    If yes, output prompt information for the next target training task on the interactive interface, or output prompt information on the interactive interface that the mobile platform has completed the current target training task, or output on the interactive interface The introductory information of the next target training task described above is output.
40. The control terminal according to any one of claims 21 to 39, wherein the movable platform is a drone or a mobile robot.
41. A computer-readable storage medium having a computer program stored in the computer-readable storage medium, wherein the computer program implements the steps of the method according to any one of claims 1 to 20 when the computer program is executed by a processor .

Images