WO2020037524A1 - Control method for movable platform, movable platform and readable storage medium - Google Patents

Control method for movable platform, movable platform and readable storage medium Download PDF

Info

Publication number
WO2020037524A1
WO2020037524A1 PCT/CN2018/101630 CN2018101630W WO2020037524A1 WO 2020037524 A1 WO2020037524 A1 WO 2020037524A1 CN 2018101630 W CN2018101630 W CN 2018101630W WO 2020037524 A1 WO2020037524 A1 WO 2020037524A1
Authority
WO
WIPO (PCT)
Prior art keywords
movable platform
target object
distance
control information
degrees
Prior art date
Application number
PCT/CN2018/101630
Other languages
French (fr)
Chinese (zh)
Inventor
周游
杨振飞
黄金柱
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2018/101630 priority Critical patent/WO2020037524A1/en
Priority to CN201880039799.1A priority patent/CN110770668A/en
Publication of WO2020037524A1 publication Critical patent/WO2020037524A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions
    • G05D1/101Simultaneous control of position or course in three dimensions specially adapted for aircraft
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions

Definitions

  • the present invention relates to the field of control technology, and in particular, to a control method of a movable platform, a movable platform, and a readable storage medium.
  • Unmanned vehicles such as unmanned aerial vehicles (UAV, UAV for short) have been developed for use in a variety of fields, including consumer and industrial applications. For example, drones can be manipulated for entertainment, photography / camera, surveillance, delivery, or other applications, and drones have expanded every aspect of personal life.
  • UAV unmanned aerial vehicles
  • the invention provides a control method of a movable platform, a movable platform and a readable storage medium.
  • a control method of a movable platform includes:
  • the included angle between the platform directions along the line is 0 degrees to 90 degrees.
  • a movable platform including: a memory and a processor; the memory is used to store program code; the processor is used to call the program code, and when the program code is executed When the processor is used to perform the following operations:
  • the included angle between the platform directions along the line is 0 degrees to 90 degrees.
  • a computer-readable storage medium stores computer instructions, and when the computer instructions are executed, a control method of a movable platform is implemented.
  • the distance between the target object and the movable platform can be determined, the control information of the movable platform can be determined according to the distance, and the movable platform can be controlled to move according to the control information so that the movable platform is in contact with the target Before the object, the moving direction of the movable platform can be adjusted so that the included angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees.
  • the above method senses the surrounding environment through the movable platform, and determines the distance between the target object and the movable platform according to the surrounding environment. The direction of the drone's movement is controlled based on the distance, without user intervention, autonomously planning the travel route, which can safely fly and simplify User operation to improve user experience.
  • FIG. 1 is a schematic flowchart of a control method of a movable platform
  • FIG. 2 is a schematic flowchart of determining a distance between a target object and a movable platform
  • 3 is a schematic flowchart of determining a distance between a target object and a movable platform according to depth information
  • 4A-4J are schematic diagrams of control of a movable platform
  • Figure 5 is a block diagram of one embodiment of a mobile platform.
  • first, second, third, etc. may be used in the present invention to describe various information, these information should not be limited to these terms. These terms are used to distinguish the same type of information from each other.
  • first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information.
  • word "if” can be interpreted as “at ", or "at !, or "in response to a determination”.
  • An embodiment of the present invention provides a control method for a movable platform, and the method can be applied to a movable platform (such as a drone, an unmanned vehicle, etc., which is not limited).
  • a movable platform such as a drone, an unmanned vehicle, etc., which is not limited.
  • the embodiments of the present invention and the subsequent embodiments are described by using a movable platform as a drone as an example. It can be understood that other mobile platforms other than drones are also applicable to the descriptions in the embodiments of the present invention and subsequent embodiments.
  • FIG. 1 is a schematic flowchart of a control method of a movable platform. The method includes:
  • Step 101 Determine the distance between the target object and the movable platform.
  • the target object may be a first object used to control the movement of the movable platform (such as a user controlling the movement of the movable platform), and the target object may also be a second object used to hinder the movement of the movable platform (such as hindering the movement of the movable platform). Obstacles to platform movement), whether the target object is the first object or the second object, the distance between the target object and the movable platform can be determined. For details, see the subsequent embodiments.
  • Step 102 Determine control information of the movable platform according to the distance.
  • control information may be acceleration, speed, or a control force for generating acceleration (such as by controlling an output torque of a driving device used to drive a movable platform, such as an output torque of a motor).
  • the control information is acceleration, speed, or control force
  • the control information of the movable platform can be determined according to the distance. For details, see the subsequent embodiments.
  • Step 103 Control the movable platform for movement according to the control information, so that before the movable platform contacts the target object, the direction of movement of the movable platform can be adjusted to the direction along the line from the target object to the movable platform (such as the target object to The direction along the line of the center of the movable platform is not limited, and the included angle is 0 degrees to 90 degrees.
  • the movable platform may be controlled to move according to the control information, so that the movable platform moves in the direction of movement before the movable platform contacts the target object. It can be adjusted so that the included angle between the target object and the direction along the line of the movable platform is 0 degrees.
  • the target object is a second object used to hinder the movement of the movable platform
  • the movable platform can be controlled to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to The angle between the target object and the direction along the line of the movable platform is 90 degrees.
  • the above are just two examples of controlling the movement of the movable platform, which are not limited, and specific control methods can refer to the subsequent embodiments.
  • the surrounding environment is sensed by the movable platform, and the distance between the target object and the movable platform is determined according to the surrounding environment, and the control information of the movable platform is determined according to the distance.
  • the mobile platform performs movement without user intervention and autonomously plans the travel route. It can fly safely, simplify user operations, and improve user experience.
  • the distance between the target object and the movable platform can be determined as shown in FIG. 2.
  • Step 201 Obtain a depth map, where the depth map may include an object area corresponding to a target object.
  • the movable platform can include two vision sensors, such as a camera. These two cameras can form a basic vision system called Stereo Vision System.
  • Stereo Vision System can form a basic vision system called Stereo Vision System.
  • the movable platform can use two cameras to shoot two cameras at different angles at the same time. Image, and use the triangle relationship to calculate the distance relationship between the scene and the camera based on the difference between the two images, the position and angle relationship between the two cameras, and obtain a depth map (that is, Depth Map) based on the distance relationship.
  • the acquisition process of the depth map is not limited.
  • the depth map may include an object area (such as an object area or multiple object areas) corresponding to the target object, and in order to obtain the object area from the depth map, similar pixel points in the depth map may be used. Aggregate to obtain a connected region, and determine that the connected region is an object region corresponding to the target object. Aggregating similar pixels in the depth map may include, but is not limited to: flooding filling algorithm may be used to aggregate similar pixels in the depth map.
  • a floodfill algorithm ie, a flood fill algorithm
  • the floodfill algorithm comprehensively considers color information, distance information (that is, depth information), and whether each pixel is connected to each other. It can aggregate similar pixels together into a connected area, and there is no restriction on this process.
  • each connected region may be determined as a target object. If there are 3 connected regions, there are 3 target objects. For convenience of description, in the subsequent embodiments, one target object is used as an example for description.
  • Step 202 Determine the distance between the target object and the movable platform according to the depth information of the object area.
  • the depth information of the object area can be obtained, and the distance between the target object and the movable platform can be determined according to the depth information of the object area. For example, the following can be adopted: The process determines the distance between the target object and the movable platform.
  • Step 2021 Obtain depth information of pixels in the object area.
  • Step 2022 Obtain the depth confidence of the pixels in the object area.
  • a disparity map corresponding to the depth map may be obtained, and a disparity pixel point corresponding to a pixel point of the object area is selected from the disparity map; then, the object area is determined according to the disparity confidence level of the disparity pixel point.
  • Pixel depth confidence Determining the depth confidence of the pixels in the object region according to the disparity confidence of the parallax pixels may include, but is not limited to, the following methods: According to the disparity confidence of the parallax pixels, the depth information of the pixels in the object region And the focal length and binocular distance of the movable platform to determine the depth confidence of the pixels in the object area.
  • Step 2023 Determine the distance between the target object and the movable platform according to the depth information of the pixel and the depth confidence of the pixel.
  • the distance between the target object and the movable platform may be determined based on the filtering method according to the depth information of the pixel point and the depth confidence degree of the pixel point.
  • the filtering method may include, but is not limited to, a Kalman filtering method.
  • step 202 The implementation flow of step 202 is described in detail below with reference to the flowchart shown in FIG. 3.
  • Step 301 Obtain depth information of pixels in the object area.
  • the depth information of each pixel point of the object area (that is, the distance between the corresponding position of the pixel point and the movable platform) can be obtained.
  • the manner of the depth information of each pixel point is not repeated here.
  • Step 302 Obtain a disparity map corresponding to the depth map.
  • the parallax map is based on any one of the image pairs (that is, two images taken simultaneously by two vision sensors at different angles for the same scene), the size is the size of the reference image, and the element value is the parallax value Image, and the disparity map contains the distance information of the scene. Because the depth map also contains the distance information of the scene, after obtaining the depth map, you can use the depth map to obtain the disparity map. There is no restriction on the acquisition process, as long as the disparity map can be obtained.
  • Step 303 Select a parallax pixel point corresponding to a pixel point of the object area from the parallax map.
  • the corresponding pixel points of the object area in the depth map may be determined. These pixel points may be part of the pixel points in the depth map.
  • the pixel set A includes the object area. All pixels in the depth map.
  • the pixel set B includes each pixel in the pixel set A
  • the pixel point corresponding to the point in the disparity map, then each pixel point in the pixel point set B can be referred to as a disparity pixel point.
  • Step 304 Obtain the parallax confidence of the parallax pixels.
  • the parallax confidence of each parallax pixel can also be called the uncertainty of the parallax pixel.
  • the difference between the measured value and the true value of each parallax pixel can be regarded as a Gaussian distribution.
  • the parallax confidence of parallax pixels is bias.
  • the parallax confidence of the parallax pixels can be determined as follows: Among them, ⁇ id represents the parallax confidence of the parallax pixels, and S represents the total energy, such as the total energy given in the SGM (Semi Global Matching) algorithm. There is no restriction on this. Represents the theoretical minimum energy, such as the theoretical minimum energy given in the SGM algorithm, which is not limited.
  • the above method for determining the parallax confidence is only an example, and there is no limitation on this, as long as the parallax confidence of the parallax pixels can be obtained.
  • Step 305 Determine the depth confidence of the pixels of the object area (ie, the pixels in the depth map) according to the parallax confidence of the disparity pixels (ie, the pixels in the disparity map).
  • the depth confidence of the pixel points of the object region may be determined according to the parallax confidence of the parallax pixels, the depth information of the pixel points of the object region, and the focal distance and binocular distance of the movable platform.
  • the depth confidence of a pixel can be determined as follows: Among them, ⁇ id represents the parallax confidence of the parallax pixels, d represents the depth information of the pixels in the object area (that is, the distance between the corresponding position of the pixels and the movable platform), and f and b represent the visual sensors of the movable platform. Focal distance and binocular distance. It can be known from the above formula that when the depth information of the pixels in the object area is known, the parallax confidence of the parallax pixels is known, and the focal distance and binocular distance of the movable platform are known, the Depth confidence. Of course, the above method for determining the depth confidence is only an example, and there is no limitation on this, as long as the depth confidence can be obtained.
  • Step 306 Determine the distance between the target object and the movable platform according to the depth information of the pixel and the depth confidence of the pixel.
  • the distance between the target object and the movable platform may be determined based on the filtering method according to the depth information of the pixel point and the depth confidence degree of the pixel point.
  • the target object corresponds to multiple pixels, and each pixel corresponds to a depth information and a depth confidence.
  • each pixel corresponds to a depth information and a depth confidence.
  • multiple pixels of the target object correspond to multiple distance values. Therefore, Kalman Filtering can be used to achieve data fusion and obtain a distance between the target object and the movable platform. That is, based on the depth information and depth confidence of each pixel, Kalman The Mann filter method realizes data fusion.
  • the distance update value at the current time can be determined according to the depth information of each pixel and the depth confidence of the pixel point; the distance prediction value at the current time is obtained, and the value is updated according to the distance And distance prediction value to determine the distance between the target object and the movable platform at the current moment.
  • the above method is only an example of determining the distance between the target object and the movable platform, and there is no limitation on this, as long as the distance between the target object and the movable platform can be determined.
  • the control information when determining the control information of the movable platform according to the distance, the control information may be acceleration, speed, or a control force for generating acceleration (for example, by controlling a drive for driving the movable platform).
  • the output torque of the device is realized, such as the output torque of a motor), and the type of the control information is not limited.
  • the component of the acceleration in the first direction can be adjusted to be greater than the current acceleration of the movable platform in the second direction, and the first direction and the second direction
  • the direction is opposite, and the second direction is the direction along the line from the movable platform to the target object (for example, the target object may be a second object for blocking the movement of the movable platform).
  • the component of the speed in the first direction can be adjusted to be greater than the current speed of the movable platform in the second direction, and the first direction and the second direction
  • the direction is opposite, and the second direction is the direction along the line from the movable platform to the target object (for example, the target object is a second object for blocking the movement of the movable platform).
  • the control information is acceleration
  • the first direction is opposite to the second direction.
  • the second direction is the direction along the line from the movable platform to the second object.
  • acceleration in the opposite direction of the direction of the second object and the acceleration may be greater than the current acceleration in the direction of the movable platform to the second object, thereby achieving obstacle avoidance.
  • the control information is velocity
  • the component of the velocity in the first direction can be adjusted before the movable platform contacts the second object.
  • the first direction is opposite to the second direction, which is the direction along the line from the movable platform to the second object.
  • the speed may be greater than the current speed in the direction of the movable platform to the second object, thereby achieving obstacle avoidance.
  • the position of the movable platform is position A
  • the position of the target object is position B
  • the direction of movement of the movable platform is position A-position B
  • the second direction is the direction along the line from the movable platform to the target object, that is, the second The direction is position A-position B
  • the first direction is position B-position A.
  • the movable platform moves through the current acceleration 1 in the second direction.
  • the acceleration A in the first direction is determined according to the distance.
  • the acceleration A is small and may be smaller than the current acceleration 1. In this way, because the direction of the acceleration A is opposite to the direction of the current acceleration 1, the current acceleration 1 becomes smaller, but the direction of the current acceleration 1 is still the second direction.
  • the acceleration A in the first direction determined according to the distance becomes larger, until the component of the acceleration A in the first direction is greater than the current acceleration 1 in the second direction, which results in
  • the moving direction of the mobile platform is the first direction, and it is no longer the second direction.
  • the movable platform moves toward the first direction, so that the distance between the movable platform and the target object becomes longer.
  • the movable platform moves at the current speed 2 in the second direction.
  • the speed B in the first direction may be determined according to the distance.
  • the speed B is relatively small and may be less than the current speed 2.
  • the speed B in the first direction determined according to the distance becomes larger, until the component of the speed B in the first direction is greater than the current speed 2 in the second direction, which results in
  • the moving direction of the mobile platform is the first direction, and it is no longer the second direction.
  • the movable platform moves toward the first direction, so that the distance between the movable platform and the target object becomes longer.
  • the acceleration of the movable platform when determining the control information of the movable platform according to the distance, if the control information is acceleration, the acceleration of the movable platform may be determined according to a preset constant and distance, and the acceleration of the movable platform may be equal to the preset constant. There is a positive correlation and a negative correlation with this distance.
  • the movable platform can also be controlled to move according to the acceleration of the movable platform, so that before the movable platform contacts the target object, the direction of movement of the movable platform can be adjusted to the direction along the line from the target object to the movable platform (
  • the angle between the target object and the center of the movable platform along the line is 0 to 90 degrees.
  • the included angle may be, for example, 0 degrees, 10 degrees, 20 degrees, 30 degrees, 40 degrees, 50 degrees, 60 degrees, 70 degrees, 80 degrees, or 90 degrees.
  • the acceleration of the movable platform may also be determined according to a preset constant and distance.
  • the acceleration of the movable platform may be related to the preset Let the constant be positively correlated and negatively correlated with the distance. Then, the speed of the movable platform can also be determined based on the acceleration of the movable platform. Further, the movable platform can also be controlled to move according to the speed of the movable platform, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be along the line from the target object to the movable platform.
  • the included angle is between 0 and 90 degrees. For example, the included angle may be 0 degrees, 10 degrees, 20 degrees, 30 degrees, 40 degrees, 50 degrees, 60 degrees, 70 degrees, 80 degrees, or 90 degrees.
  • the preset constant may be determined according to the type of the target object. If the type of the target object is a preset first type (such as a first object, such as a user), the preset constant may be a first value; if the type of the target object is a preset second type (such as a second object, such as an obstacle) Object), the preset constant is a second value; wherein the first value may be greater than the second value, and both the first value and the second value may be configured according to experience.
  • a preset first type such as a first object, such as a user
  • the preset constant may be a first value
  • a preset second type such as a second object, such as an obstacle
  • the preset constant is a second value
  • the first value may be greater than the second value, and both the first value and the second value may be configured according to experience.
  • the acceleration of the movable platform is positively related to the preset constant (that is, the first value)
  • the first value is relatively large
  • a relatively large acceleration can be generated to avoid the contact of the movable platform.
  • the movable platform is located between the user and the obstacle
  • the first value is greater than the second value
  • the distance between the movable platform and the user and the distance between the movable platform and the obstacle are the same or similar
  • the acceleration between the movable platform and the user may be greater than the acceleration between the movable platform and the obstacle, thereby preventing the movable platform from contacting the user and protecting the user more effectively.
  • the type of the target object in addition to distinguishing the first object and the second object as types, in actual applications, other classification standards such as living objects and non-living objects can be used, so that When the type is a living object, the living object can be more effectively protected through different setting of the distance threshold, and the living object can be prevented from being injured due to the improper movement control of the movable platform.
  • a repulsive force field can be constructed (that is, a control force can be generated).
  • a repulsive force field can be constructed by the following formula:
  • F can represent the repulsive force field
  • m obstacls can represent the mass of the target object
  • r can represent the radius of the constructed repulsive force field
  • m drons can represent the mass of the movable platform.
  • the acceleration of the movable platform can be determined by using the above-mentioned repulsive force field.
  • the acceleration of the movable platform can be determined by the following formula: In the formula, a represents the acceleration of the movable platform, w represents a preset constant, and d represents the distance between the target object and the movable platform.
  • the acceleration of the movable platform has a positive correlation with the preset constant and a negative correlation with the distance.
  • the above formula is only an example, and there is no limitation on this.
  • the type of the target object is a preset first type (such as a first object, such as a user)
  • the preset constant w is a first value
  • the type of the target object is a preset second type (such as a second object, (Such as obstacles)
  • the preset constant w is a second value
  • the first value is greater than the second value.
  • the type of the target object in addition to distinguishing the first object and the second object as types, in actual applications, other classification standards such as living objects and non-living objects can be used, so that When the type is a living object, the living object can be more effectively protected through different setting of the distance threshold, and the living object can be prevented from being injured due to the improper movement control of the movable platform.
  • the movable platform after determining the acceleration of the movable platform, the movable platform may be controlled to move according to the acceleration of the movable platform; or, after determining the acceleration of the movable platform, the movable platform may be determined according to the acceleration of the movable platform.
  • the speed of the mobile platform is not limited in this determination method. Then, the mobile platform can be controlled to move according to the speed of the mobile platform.
  • step 102 when determining the control information of the movable platform according to the distance, when the distance is not greater than the distance threshold, the control information of the movable platform is determined according to the distance.
  • the repulsive force field can be generated only when the distance is not greater than the distance threshold, so as to determine the control information of the movable platform according to the distance, and use the control information to control the movable platform for movement. Therefore, it is not necessary to determine the control information of the movable platform according to the distance, and it is not necessary to use the control information to control the movement of the movable platform.
  • the control information of the movable platform is no longer determined according to the distance, and it is not necessary to use the control information to control the movable platform for movement.
  • the distance threshold may be determined according to the type of the target object. If the type of the target object is a preset third type (such as a first object, such as a user), the distance threshold may be a third value; if the type of the target object is a preset fourth type (such as a second object, such as an obstacle) ), The distance threshold may be a fourth value; wherein the third value may be greater than the fourth value, and the third value and the fourth value may be configured according to experience.
  • a preset third type such as a first object, such as a user
  • the distance threshold may be a third value
  • a preset fourth type such as a second object, such as an obstacle
  • the type of the target object in addition to distinguishing the first object and the second object as types, in actual applications, other classification standards such as living objects and non-living objects can be used, so that When the type is a living object, the living object can be more effectively protected through different setting of the distance threshold, and the living object can be prevented from being injured due to the improper movement control of the movable platform.
  • control information may include one or any combination of the following: control force in one or more directions, acceleration in one or more directions, and one or more directions speed.
  • control force in one or more directions In the above embodiment, the acceleration in one direction or the speed in one direction is taken as an example. The processing flow in other cases is similar, and is not described herein again.
  • the movable platform when controlling the movable platform for movement according to the control information, if the target object is the first object (such as a user) for controlling the movement of the movable platform, the movable platform may be controlled for movement according to the control information.
  • the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees, for example, the angle between the two The angle can be 0 degrees.
  • the included angle between the direction along the line of the first object to the movable platform and the current movement direction of the movable platform is greater than or equal to 0 degrees and less than or equal to 90 degrees.
  • the target object is the first object (such as a user), and the included angle between the direction of movement of the movable platform and the direction along the line (that is, the direction of the target object to the movable platform) is 0 degrees to 90 degrees, FIG. 4A takes an included angle of 0 degrees as an example. Moreover, it can be seen from FIG. 4A that the included angle between the first object and the movable platform along the line direction and the current movement direction of the movable platform is 0 degrees.
  • the movable platform uses the cruise speed (the cruise speed can be set in advance) to fly in direction 1.
  • the user does not control the movable platform. Because the distance between the movable platform and the user is greater than the threshold . Therefore, the repulsive force field can be ignored, and the movable platform continues to fly in direction 1.
  • the user needs to control the movable platform to accelerate to fly in direction 1, the user moves to the rear of the movable platform (such as the opposite direction of the flight direction) and moves toward the movable platform. At this time, the movable platform continues to fly in direction 1, but due to the user's movement, the distance between the movable platform and the user can become smaller and smaller.
  • the repulsive field Will play a role When the distance between the movable platform and the user is less than the threshold, the repulsive field Will play a role, at this time, it can produce the same acceleration as the current direction of movement of the movable platform, and the speed of the movable platform gradually increases to fly in direction 1, as the distance between the movable platform and the user becomes smaller and smaller, The repulsive force field continues to play a role. At this time, the acceleration further increases, and the speed of the movable platform further increases, and continues to fly in direction 1.
  • the movement direction of the first object can be the same as the movement direction of the movable platform.
  • the movable platform can be controlled to also move along the movement direction to achieve The control of the mobile platform achieves the effect of promoting the mobile platform.
  • the user does not need to use the control terminal to implement control of the movable platform, thereby simplifying the operation of the user and improving the user experience.
  • step 103 when controlling the movable platform for movement according to the control information, if the target object is a second object (such as an obstacle) for blocking the movement of the movable platform, then controlling the movable platform for movement according to the control information, Before the movable platform contacts the target object, the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees, for example, the angle between the two The angle can be 90 degrees.
  • the included angle between the second object to the movable platform and the current movement direction of the movable platform is greater than 90 degrees and less than or equal to 180 degrees.
  • the target object is a second object (such as an obstacle), and the current movement direction of the movable platform is toward the second object.
  • the angle between the adjusted direction of movement and the direction along the line is 0 degrees to 90 degrees.
  • the angle is 0 degrees as an example
  • the included angle is 90 degrees.
  • the included angle between the second object to the movable platform and the current movement direction of the movable platform is 180 degrees.
  • the movable platform can be moved in a direction away from the second object (such as an obstacle).
  • the movable platform moves in the reverse direction to realize the control of the movable platform, to achieve the effect of popping up the movable platform, to achieve detours to obstacles, and to simplify operations while flying safely.
  • the movable platform uses cruising speed to fly forward. Since the distance between the movable platform and the obstacle (that is, the second object) is larger than the threshold, the repulsive force field can be ignored and the movable platform continues to fly forward, see Figure 4D As shown. Then, as the movable platform flies forward, the distance between the movable platform and the obstacle is getting smaller and smaller. When the distance between the movable platform and the obstacle is less than the threshold, the repulsive force field will play a role.
  • an acceleration opposite to the current movement direction of the movable platform can be generated, and the speed of the movable platform is gradually reduced to fly forward, as shown in FIG. 4E. Then, as the movable platform continues to fly forward, the distance between the movable platform and the obstacle is getting smaller and smaller, and the repulsive force field continues to play a role. At this time, the acceleration further increases, and the movable platform moves toward the obstacle. After the speed in the direction is reduced to 0, the movable platform can accelerate backwards and return to the backward flight due to the generated reverse acceleration, as shown in FIG. 4F. Then, as the movable platform flies backward, the distance between the movable platform and the obstacle is getting larger and larger.
  • the acceleration gradually decreases.
  • the repulsive force field can be ignored, that is, the acceleration is 0. Therefore, the movable platform can resume the cruising speed, maintain the current flight direction, and fly backward, as shown in FIG. 4G.
  • control information such as control force or speed
  • a more stable repulsive force field can be obtained through distance detection, which makes route planning smoother without causing sudden changes in speed, and can automatically plan routes to avoid obstacles, greatly simplifying operations, and Improved safety performance.
  • Able to sense the surrounding environment detect obstacles in the direction of movement, and build a repulsive field to achieve the function of "visual spring". It can change the direction of travel before colliding with obstacles without intervention, and independently plan the travel route. It also simplifies operations while flying safely.
  • the above method is an autonomous flight mode. When safety is a priority, automatic navigation planning routes, obstacle avoidance and active flight are achieved, and smooth flight in a small space is completed.
  • step 103 when controlling the movable platform for movement according to the control information, if the target object includes a first object (such as a user) for controlling the movement of the movable platform and a second object (such as an obstacle for hindering the movement of the movable platform) Object), according to the control information, to control the movable platform for movement, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be along the line direction from the target object to the movable platform (such as the target object to the movable The angle between the center of the platform along the line) is 0 degrees to 90 degrees.
  • a first object such as a user
  • a second object such as an obstacle for hindering the movement of the movable platform
  • the movement direction of the movable platform can be adjusted to be along the line direction from the target object to the movable platform (such as the target object to the movable
  • the angle between the center of the platform along the line is 0 degrees to 90 degrees.
  • the included angle between the first object to the movable platform and the current movement direction of the movable platform is greater than or equal to 0 degrees and less than or equal to 90 degrees.
  • the included angle may be 0 degrees, 10 degrees, 20 degrees, 30 degrees, 40 degrees, 50 degrees, 60 degrees, 70 degrees, 80 degrees, or 90 degrees.
  • the included angle between the second object to the movable platform and the current movement direction of the movable platform is greater than 90 degrees and less than or equal to 180 degrees.
  • the included angle may be 91 degrees, 100 degrees, 110 degrees, 120 degrees, 130 degrees, 140 degrees, 150 degrees, 160 degrees, 170 degrees, or 180 degrees.
  • control information 1 can be obtained according to the distance between the movable platform and the first object, and then the movable platform is controlled to move according to the control information 1 so that the movable platform can be moved before contacting the first object.
  • the moving direction of the moving platform can be adjusted so that the included angle between the first object and the direction along the line of the movable platform is 0 degrees to 90 degrees. For details, see Embodiment 5.
  • control information 2 can be obtained according to the distance between the movable platform and the second object, and then the movable platform is controlled to move according to the control information 2 so that the movable platform can move the platform before contacting the second object.
  • the moving direction of can be adjusted so that the included angle between the second object and the direction along the line of the movable platform is 0 degrees to 90 degrees. For a specific determination method, see Embodiment 6.
  • the movement direction of the movable platform can be adjusted to be between the first object and the direction along the line of the movable platform.
  • the angle is 0 degrees to 90 degrees
  • the movement direction of the movable platform can be adjusted to an included angle between the second object and the direction along the line of the movable platform is 0 degrees to 90 degrees, which will not be described again.
  • the first object can make the moving direction of the movable platform to be direction 1
  • the second object can make the moving direction of the movable platform to be direction 2.
  • the final movement direction of the movable platform can be adjusted to direction 3.
  • the angle between the direction 3 and the direction along the line from the first object to the movable platform is 0 degrees to 90 degrees.
  • the included angle is between 0 degrees and 90 degrees.
  • the movable platform is controlled to move according to the control information, so that the movable platform can move the movable platform before contacting the target object.
  • the movement direction can be adjusted so that the included angle between the target object and the direction along the movable platform is 0 degrees to 90 degrees, which can include but is not limited to: the movable platform can be controlled to move according to the control information, so that the movable platform is suspended Between the first object and the second object, that is, hovering between them; or, the movable platform can be controlled to move according to the control information, so that the movable platform moves toward the second object and contacts the second object Before, you can hover in front of the second object; or you can control the movable platform to move according to the control information, so that the movable platform moves in other directions, such as bypassing the second object and moving in the opposite direction of the second object.
  • the effects shown in FIG. 4I to FIG. 4J can be achieved by using the foregoing method.
  • the distance between the first object and the movable platform is relatively short, which results in a large repulsive force field, while the distance between the second object and the movable platform is relatively large, which results in a small or no repulsive force field.
  • the mobile platform moves forward to achieve the effect of pushing to the movable platform, as shown in FIG. 4I.
  • the distance between the second object and the movable platform is getting closer and closer, so a larger repulsive force field is generated, and because the first object controls the movable platform to move forward, the distance between the first object and the movable platform can be maintained relative Fixed (the first object can also move farther and farther away from the movable platform without moving), and the repulsive force field is relatively problematic. In this way, due to the superposition of the two repulsive force fields, the movable platform can be promoted. Hover between the first object and the second object.
  • the movable platform can be caused to rebound to fly obliquely backward, as shown in FIG. 4J.
  • the movable platform when controlling the movable platform for movement according to the control information, if the target object is the first object (such as a user) for controlling the movement of the movable platform, the movable platform may be controlled for movement according to the control information.
  • the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform from 0 degrees to 90 degrees, which can include but is not limited to: according to the control information
  • the distance between the movable platform and the first object is controlled to be not greater than a distance threshold.
  • the movable platform moves in the first direction
  • the first object moves in the second direction (such as the opposite direction of the first direction)
  • the distance between the movable platform and the first object is getting farther and farther.
  • the movable platform no longer moves in the first direction, but moves in the second direction, that is, the direction of movement of the movable platform and the first object
  • the movement direction is the same, so that the distance between the movable platform and the first object is at a constant value, and then the effect that the first object retracts and the movable platform also retracts can be achieved.
  • control information when controlling the movable platform for movement according to the control information, if there are multiple target objects, the control information may further include control information corresponding to each target object, that is, there is multiple control information. Based on this, controlling the movable platform to perform motion according to the control information may include, but is not limited to: fusing control information corresponding to each target object, and controlling the movable platform to perform motion according to the fusion result.
  • the control information is acceleration
  • the accelerations corresponding to the respective target objects can be fused, such as vector superposition of the accelerations corresponding to the respective target objects to obtain a total acceleration, and the total acceleration is used as the final acceleration. Move the platform for movement.
  • the speeds corresponding to the respective target objects can be fused, such as vector superposition of the speeds corresponding to the respective target objects to obtain a total speed, with the total speed as the final speed, and controlling according to the total speed Moveable platform for movement.
  • the movable platform itself also has an acceleration. Therefore, when the acceleration corresponding to each target object is superimposed to obtain the total acceleration, the acceleration corresponding to each target object can also be vectored with the acceleration of the movable platform itself. Add up to get a total acceleration.
  • the movable platform itself also has a speed. Therefore, when the speed corresponding to each target object is superimposed on the vector to obtain the total speed, the speed corresponding to each target object can also be compared with the speed of the movable platform itself. The vectors are superimposed to get a total velocity.
  • an embodiment of the present invention further provides a movable platform including: a memory and a processor; referring to FIG. 5, it is a schematic structural diagram of the movable platform.
  • the memory is used to store program code; the processor is used to call the program code, and when the program code is executed, the processor is used to perform the following operations:
  • the included angle between the platform directions along the line is 0 degrees to 90 degrees.
  • the target object includes a first object for controlling the movement of the movable platform
  • the processor controls the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be equal to that of the target object.
  • the included angle between the movable platforms along the line direction is 0 degrees to 90 degrees, it is specifically used to: control the movable platform to move according to the control information, so that the movable platform is in contact with the target Before the object, the moving direction of the movable platform can be adjusted so that the included angle between the target object and the direction along the line of the movable platform is 0 degrees.
  • the target object includes a second object for blocking movement of the movable platform
  • the processor controls the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be equal to that of the target object.
  • the included angle between the movable platforms along the line direction is 0 degrees to 90 degrees, it is specifically used to: control the movable platform to move according to the control information, so that the movable platform is in contact with the target Before the object, the moving direction of the movable platform can be adjusted so that the included angle between the target object and the direction along the line of the movable platform is 90 degrees.
  • the target object includes a first object for controlling the movement of the movable platform and a second object for hindering the movement of the movable platform;
  • the processor controls the movable platform to move according to the control information, so that the movable platform is in Before touching the target object, the direction of movement of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees.
  • the control information controls the movable platform to move so that the movable platform is suspended between the first object and the second object.
  • an included angle between a direction along the line of the first object to the movable platform and a current movement direction of the movable platform is greater than or equal to 0 degrees and less than or equal to 90 degrees.
  • an included angle between a direction along the line of the second object to the movable platform and a current movement direction of the movable platform is greater than 90 degrees and less than or equal to 180 degrees.
  • control information includes acceleration; before the movable platform contacts the target object, a component of the acceleration in a first direction can be adjusted to be greater than a current acceleration of the movable platform in a second direction
  • the first direction is opposite to the second direction
  • the second direction is a direction along the line from the movable platform to the second object.
  • the processor when determining the control information of the movable platform according to the distance, is specifically configured to determine the acceleration of the movable platform according to a preset constant and the distance, and the acceleration of the movable platform and The preset constant has a positive correlation and a negative correlation with the distance;
  • the processor controls the movable platform to perform motion according to the control information
  • the processor is specifically configured to: control the movable platform to perform motion according to the acceleration of the movable platform.
  • control information includes a speed; before the movable platform contacts the target object, a component of the speed in a first direction can be adjusted to be greater than a current speed of the movable platform in a second direction
  • the first direction is opposite to the second direction
  • the second direction is a direction along the line from the movable platform to the second object.
  • the processor when determining the control information of the movable platform according to the distance, is specifically configured to determine the acceleration of the movable platform according to a preset constant and the distance, and the acceleration of the movable platform and The preset constant has a positive correlation and a negative correlation with the distance;
  • the processor controls the movable platform to perform motion according to the control information
  • the processor is specifically configured to: control the movable platform to perform motion according to the speed of the movable platform.
  • the processor determines the control information of the movable platform according to the distance
  • the processor is specifically configured to: when the distance is not greater than a distance threshold, determine the control information of the movable platform according to the distance.
  • the processor is further configured to: when the distance is greater than a distance threshold, maintain current movement information of the movable platform.
  • the target object includes a plurality of objects
  • the control information includes control information corresponding to each of the target objects
  • the processor is specifically configured to: when controlling the movable platform to perform motion according to the control information: Fusing control information corresponding to the target object;
  • the processor determines the distance between the target object and the movable platform
  • the processor is specifically configured to: obtain a depth map, where the depth map includes an object area corresponding to the target object; and according to the depth information of the object area Determining a distance between the target object and the movable platform.
  • the processor is further configured to: aggregate similar pixel points in the depth map to obtain a connected area; determine The connected region is an object region corresponding to the target object.
  • the processor when the processor aggregates similar pixels in the depth map, the processor is specifically configured to: use a flood filling algorithm to aggregate similar pixels in the depth map.
  • the processor determines the distance between the target object and the movable platform according to the depth information of the object area
  • the processor is specifically configured to: obtain depth information of pixels of the object area, and obtain the object A depth confidence level of a pixel point of the region; and determining a distance between the target object and the movable platform according to the depth information of the pixel point and the depth confidence level of the pixel point.
  • the processor when the processor obtains the depth confidence of the pixels of the object region, the processor is specifically configured to: obtain a disparity map corresponding to the depth map; and select the pixels of the object area from the disparity map A corresponding parallax pixel point; and a depth confidence level of a pixel point of the object region is determined according to the parallax confidence level of the parallax pixel point.
  • the processor determines the depth confidence level of the pixel point of the object area according to the parallax confidence level of the parallax pixel point
  • the processor is specifically configured to: according to the parallax confidence level of the parallax pixel point, the The depth information of the pixels and the focal distance and binocular distance of the movable platform determine the depth confidence of the pixels in the object area.
  • the processor when determining the distance between the target object and the movable platform according to the depth information of the pixel point and the depth confidence degree of the pixel point, is specifically configured to: according to the depth of the pixel point The information and the depth confidence level of the pixel point are used to determine the distance between the target object and the movable platform based on a filtering method.
  • a computer-readable storage medium stores computer instructions. When the computer instructions are executed, the control method of the movable platform is implemented.
  • the system, device, module, or unit described in the foregoing embodiments may be implemented by a computer chip or entity, or by a product having a certain function.
  • a typical implementation device is a computer, and the specific form of the computer may be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email sending and receiving device, and a game control Desk, tablet computer, wearable device, or a combination of any of these devices.
  • the embodiments of the present invention may be provided as a method, a system, or a computer program product. Therefore, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • these computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured article including the instruction device,
  • the instruction device implements the functions specified in a flowchart or a plurality of processes and / or a block or a block of the block diagram.
  • These computer program instructions can also be loaded into a computer or other programmable data processing device, so that a series of operating steps are performed on the computer or other programmable device to produce a computer-implemented process, and the instructions executed on the computer or other programmable device Provides steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

Landscapes

  • Engineering & Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

A control method for a movable platform, and a device and a computer-readable storage medium. The method comprises: determining the distance between a target object and a movable platform (101); determining control information of the movable platform according to the distance (102); and controlling the movement of the movable platform according to the control information, such that before the movable platform comes into contact with the target object, the movement direction of the movable platform can be adjusted to form an included angle of 0 degrees to 90 degrees with the line direction from the target object to the movable platform (103). A surrounding environment is sensed by means of the movable platform, the distance between a target object and the movable platform is determined according to the surrounding environment, and the movement direction of an unmanned aerial vehicle is controlled based on the distance, without user intervention, and a moving route is autonomously planned; therefore, safe flight can be realized, user operations can be simplified, and the usage experience of a user can be improved.

Description

可移动平台的控制方法、可移动平台及可读存储介质Control method of movable platform, movable platform and readable storage medium 技术领域Technical field
本发明涉及控制技术领域,尤其是涉及可移动平台的控制方法、可移动平台及可读存储介质。The present invention relates to the field of control technology, and in particular, to a control method of a movable platform, a movable platform, and a readable storage medium.
背景技术Background technique
诸如无人飞行器(UAV,简称无人机)等无人载具已经被开发用于各种领域,包括消费者应用和行业应用。例如,可以操纵无人机用于娱乐、摄影/摄像、监视、递送或其他应用,无人机已经拓展了个人生活的方方面面。Unmanned vehicles such as unmanned aerial vehicles (UAV, UAV for short) have been developed for use in a variety of fields, including consumer and industrial applications. For example, drones can be manipulated for entertainment, photography / camera, surveillance, delivery, or other applications, and drones have expanded every aspect of personal life.
随着无人机的使用变得愈加普遍,无人机的功能越来越多,但是,无人机的操作和控制也比较繁琐,如何安全操控无人机是一大难题。目前,已有一些智能功能来辅助用户,通过简单交互即可拍出航拍视频,但这些智能功能是针对中大型无人机的户外航拍,而对于小型、微型无人机的室内操作,并没有很好的解决方案,导致无人机的使用受到了限制。As the use of drones becomes more common, the functions of drones are more and more, but the operation and control of drones is also more complicated, and how to safely control drones is a major problem. At present, there are some intelligent functions to assist users, and aerial video can be taken through simple interaction. However, these intelligent functions are aimed at outdoor aerial photography of medium and large drones, and for indoor operation of small and micro drones, there is no Very good solution, resulting in limited use of drones.
发明内容Summary of the Invention
本发明提供可移动平台的控制方法、可移动平台及可读存储介质。The invention provides a control method of a movable platform, a movable platform and a readable storage medium.
本发明第一方面,提供一种可移动平台的控制方法,所述方法包括:According to a first aspect of the present invention, a control method of a movable platform is provided, and the method includes:
确定目标物体与所述可移动平台的距离;Determining a distance between a target object and the movable platform;
根据所述距离确定所述可移动平台的控制信息;Determining control information of the movable platform according to the distance;
根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度。Controlling the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be in line with the target object to the movable The included angle between the platform directions along the line is 0 degrees to 90 degrees.
本发明第二方面,提供一种可移动平台,包括:存储器和处理器;所述存储器,用于存储程序代码;所述处理器,用于调用所述程序代码,当所述 程序代码被执行时,所述处理器用于执行以下操作:According to a second aspect of the present invention, a movable platform is provided, including: a memory and a processor; the memory is used to store program code; the processor is used to call the program code, and when the program code is executed When the processor is used to perform the following operations:
确定目标物体与所述可移动平台的距离;Determining a distance between a target object and the movable platform;
根据所述距离确定所述可移动平台的控制信息;Determining control information of the movable platform according to the distance;
根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度。Controlling the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be in line with the target object to the movable The included angle between the platform directions along the line is 0 degrees to 90 degrees.
本发明第三方面,提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机指令,所述计算机指令被执行时实现可移动平台的控制方法。According to a third aspect of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium stores computer instructions, and when the computer instructions are executed, a control method of a movable platform is implemented.
基于上述技术方案,本发明实施例中,可以确定目标物体与可移动平台的距离,根据距离确定可移动平台的控制信息,根据控制信息控制可移动平台进行运动,以使可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与目标物体至可移动平台的沿线方向之间的夹角为0度至90度。显然,上述方式通过可移动平台感知周围环境,并根据周围环境确定目标物体与可移动平台的距离,基于距离控制无人机的运动方向,无需用户干预,自主规划行进路线,能够安全飞行,简化用户操作,提高用户的使用体验。Based on the above technical solution, in the embodiments of the present invention, the distance between the target object and the movable platform can be determined, the control information of the movable platform can be determined according to the distance, and the movable platform can be controlled to move according to the control information so that the movable platform is in contact with the target Before the object, the moving direction of the movable platform can be adjusted so that the included angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees. Obviously, the above method senses the surrounding environment through the movable platform, and determines the distance between the target object and the movable platform according to the surrounding environment. The direction of the drone's movement is controlled based on the distance, without user intervention, autonomously planning the travel route, which can safely fly and simplify User operation to improve user experience.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更加清楚地说明本发明实施例中的技术方案,下面将对本发明实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明中记载的一些实施例,对于本领域普通技术人员来讲,还可以根据本发明实施例的这些附图获得其它的附图。In order to explain the technical solutions in the embodiments of the present invention more clearly, the drawings used in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings in the following description are just some of the records in the present invention. For those of ordinary skill in the art, other drawings may be obtained based on the drawings of the embodiments of the present invention.
图1是可移动平台的控制方法的流程示意图;1 is a schematic flowchart of a control method of a movable platform;
图2是确定目标物体与可移动平台的距离的流程示意图;2 is a schematic flowchart of determining a distance between a target object and a movable platform;
图3是根据深度信息确定目标物体与可移动平台的距离的流程示意图;3 is a schematic flowchart of determining a distance between a target object and a movable platform according to depth information;
图4A-图4J是可移动平台的控制示意图;4A-4J are schematic diagrams of control of a movable platform;
图5是可移动平台的一个实施例框图。Figure 5 is a block diagram of one embodiment of a mobile platform.
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。另外,在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。In the following, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention. In addition, in the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.
本发明使用的术语仅仅是出于描述特定实施例的目的,而非限制本发明。本发明和权利要求书所使用的单数形式的“一种”、“所述”和“该”也旨在包括多数形式,除非上下文清楚地表示其它含义。应当理解,本文中使用的术语“和/或”是指包含一个或者多个相关联的列出项目的任何或所有可能组合。The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms "a," "the," and "the" as used in this invention and in the claims are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should be understood that the term "and / or" as used herein means any or all possible combinations that include one or more of the associated listed items.
尽管在本发明可能采用术语第一、第二、第三等来描述各种信息,但这些信息不应限于这些术语。这些术语用来将同一类型的信息彼此区分开。例如,在不脱离本发明范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。取决于语境,此外,所使用的词语“如果”可以被解释成为“在……时”,或者“当……时”,或者“响应于确定”。Although the terms first, second, third, etc. may be used in the present invention to describe various information, these information should not be limited to these terms. These terms are used to distinguish the same type of information from each other. For example, without departing from the scope of the present invention, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, in addition, the word "if" can be interpreted as "at ...", or "at ...", or "in response to a determination".
实施例1:Example 1:
本发明实施例中提出一种可移动平台的控制方法,该方法可以应用于可移动平台(如无人机、无人车等,对此不做限制)。本发明实施例以及后续实施例均以可移动平台为无人机为例进行说明。可以理解,无人机以外的其它可移动平台也同样适用于本发明实施例以及后续实施例中的说明内容。An embodiment of the present invention provides a control method for a movable platform, and the method can be applied to a movable platform (such as a drone, an unmanned vehicle, etc., which is not limited). The embodiments of the present invention and the subsequent embodiments are described by using a movable platform as a drone as an example. It can be understood that other mobile platforms other than drones are also applicable to the descriptions in the embodiments of the present invention and subsequent embodiments.
参见图1所示,为可移动平台的控制方法的流程示意图,该方法包括:Refer to FIG. 1, which is a schematic flowchart of a control method of a movable platform. The method includes:
步骤101,确定目标物体与可移动平台的距离。Step 101: Determine the distance between the target object and the movable platform.
具体的,目标物体可以是用于控制可移动平台运动的第一物体(如控制 可移动平台运动的用户),目标物体也可以是用于阻碍可移动平台运动的第二物体(如阻碍可移动平台运动的障碍物),无论目标物体是第一物体还是第二物体,均可以确定目标物体与可移动平台的距离,具体方式参见后续实施例。Specifically, the target object may be a first object used to control the movement of the movable platform (such as a user controlling the movement of the movable platform), and the target object may also be a second object used to hinder the movement of the movable platform (such as hindering the movement of the movable platform). Obstacles to platform movement), whether the target object is the first object or the second object, the distance between the target object and the movable platform can be determined. For details, see the subsequent embodiments.
步骤102,根据该距离确定可移动平台的控制信息。Step 102: Determine control information of the movable platform according to the distance.
具体的,控制信息可以是加速度,也可以是速度,还可以是用于产生加速度的控制力(如通过控制用于驱动可移动平台的驱动装置的输出扭矩实现,如电机的输出扭矩),无论控制信息是加速度、速度还是控制力,均可以根据该距离确定可移动平台的控制信息,具体方式参见后续实施例。Specifically, the control information may be acceleration, speed, or a control force for generating acceleration (such as by controlling an output torque of a driving device used to drive a movable platform, such as an output torque of a motor). Whether the control information is acceleration, speed, or control force, the control information of the movable platform can be determined according to the distance. For details, see the subsequent embodiments.
步骤103,根据该控制信息控制可移动平台进行运动,以使得可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与该目标物体至可移动平台的沿线方向(如目标物体至可移动平台的中心的沿线方向等,对此沿线方向不做限制)之间的夹角为0度至90度。Step 103: Control the movable platform for movement according to the control information, so that before the movable platform contacts the target object, the direction of movement of the movable platform can be adjusted to the direction along the line from the target object to the movable platform (such as the target object to The direction along the line of the center of the movable platform is not limited, and the included angle is 0 degrees to 90 degrees.
具体的,在目标物体是用于控制可移动平台运动的第一物体时,则可以根据该控制信息控制可移动平台进行运动,以使得可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与目标物体至可移动平台的沿线方向之间的夹角为0度。在目标物体是用于阻碍可移动平台运动的第二物体时,则可以根据该控制信息控制可移动平台进行运动,以使得可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与目标物体至可移动平台的沿线方向之间的夹角为90度。当然,上述只是控制可移动平台进行运动的两个示例,对此不做限制,且具体控制方式可以参见后续实施例。Specifically, when the target object is the first object for controlling the movement of the movable platform, the movable platform may be controlled to move according to the control information, so that the movable platform moves in the direction of movement before the movable platform contacts the target object. It can be adjusted so that the included angle between the target object and the direction along the line of the movable platform is 0 degrees. When the target object is a second object used to hinder the movement of the movable platform, the movable platform can be controlled to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to The angle between the target object and the direction along the line of the movable platform is 90 degrees. Of course, the above are just two examples of controlling the movement of the movable platform, which are not limited, and specific control methods can refer to the subsequent embodiments.
基于上述技术方案,本发明实施例中,通过可移动平台感知周围环境,并根据周围环境确定目标物体与可移动平台的距离,根据该距离确定可移动平台的控制信息,根据该控制信息控制可移动平台进行运动,无需用户干预,自主规划行进路线,能够安全飞行,简化用户操作,提高用户的使用体验。Based on the above technical solution, in the embodiment of the present invention, the surrounding environment is sensed by the movable platform, and the distance between the target object and the movable platform is determined according to the surrounding environment, and the control information of the movable platform is determined according to the distance. The mobile platform performs movement without user intervention and autonomously plans the travel route. It can fly safely, simplify user operations, and improve user experience.
实施例2:Example 2:
针对步骤101,确定目标物体与可移动平台的距离可以参见图2所示。For step 101, the distance between the target object and the movable platform can be determined as shown in FIG. 2.
步骤201,获取深度图,该深度图可以包括与目标物体对应的物体区域。Step 201: Obtain a depth map, where the depth map may include an object area corresponding to a target object.
具体的,可移动平台可以包括两个视觉传感器,如摄像头,这两个摄像头可以组成一个基础的视觉系统,称为Stereo Vision System,可移动平台可以通过两个摄像头,拍摄同一时刻不同角度的两张图像,并通过两张图像的差异、两个摄像头之间的位置、角度关系,利用三角关系计算出场景与摄像头的距离关系,并根据该距离关系获取深度图(即Depth Map),对此深度图的获取过程不做限制。Specifically, the movable platform can include two vision sensors, such as a camera. These two cameras can form a basic vision system called Stereo Vision System. The movable platform can use two cameras to shoot two cameras at different angles at the same time. Image, and use the triangle relationship to calculate the distance relationship between the scene and the camera based on the difference between the two images, the position and angle relationship between the two cameras, and obtain a depth map (that is, Depth Map) based on the distance relationship. The acquisition process of the depth map is not limited.
在一个例子中,该深度图可以包括与目标物体对应的物体区域(如一个物体区域或者多个物体区域),而为了从深度图中得到物体区域,则可以将深度图中的相似像素点进行聚合,得到连通区域,并确定该连通区域为与该目标物体对应的物体区域。其中,将深度图中的相似像素点进行聚合,可以包括但不限于:可以采用泛洪填充算法对深度图中的相似像素点进行聚合。In an example, the depth map may include an object area (such as an object area or multiple object areas) corresponding to the target object, and in order to obtain the object area from the depth map, similar pixel points in the depth map may be used. Aggregate to obtain a connected region, and determine that the connected region is an object region corresponding to the target object. Aggregating similar pixels in the depth map may include, but is not limited to: flooding filling algorithm may be used to aggregate similar pixels in the depth map.
具体的,在获取到深度图之后,可以使用floodfill算法(即泛洪填充算法),对深度图中的相似像素点进行聚合,且聚合后的像素点组成连通区域。floodfill算法综合考虑颜色信息、距离信息(即深度信息)、各像素点是否互相联通等,可以将相似像素点聚合在一起,成为连通区域,对此过程不做限制。然后,可以将每个连通区域确定为一个目标物体,如存在3个连通区域时,就存在3个目标物体,为了方便描述,后续实施例中,以一个目标物体为例进行说明。Specifically, after obtaining the depth map, a floodfill algorithm (ie, a flood fill algorithm) can be used to aggregate similar pixels in the depth map, and the aggregated pixels form a connected region. The floodfill algorithm comprehensively considers color information, distance information (that is, depth information), and whether each pixel is connected to each other. It can aggregate similar pixels together into a connected area, and there is no restriction on this process. Then, each connected region may be determined as a target object. If there are 3 connected regions, there are 3 target objects. For convenience of description, in the subsequent embodiments, one target object is used as an example for description.
步骤202,根据物体区域的深度信息确定目标物体与可移动平台的距离。Step 202: Determine the distance between the target object and the movable platform according to the depth information of the object area.
具体的,在从深度图中得到目标物体对应的物体区域后,就可以获取该物体区域的深度信息,并根据该物体区域的深度信息确定目标物体与可移动平台的距离,例如,可以采用如下流程确定目标物体与可移动平台的距离。Specifically, after obtaining the object area corresponding to the target object from the depth map, the depth information of the object area can be obtained, and the distance between the target object and the movable platform can be determined according to the depth information of the object area. For example, the following can be adopted: The process determines the distance between the target object and the movable platform.
步骤2021,获取该物体区域的像素点的深度信息。Step 2021: Obtain depth information of pixels in the object area.
步骤2022,获取该物体区域的像素点的深度置信度。Step 2022: Obtain the depth confidence of the pixels in the object area.
具体的,可以获取与该深度图对应的视差图,并从该视差图中选取与该物体区域的像素点对应的视差像素点;然后,根据该视差像素点的视差置信度确定该物体区域的像素点的深度置信度。其中,根据该视差像素点的视差置信度确定该物体区域的像素点的深度置信度,可以包括但不限于如下方式:根据该视差像素点的视差置信度、该物体区域的像素点的深度信息以及可移动平台的焦距、双目距离,确定该物体区域的像素点的深度置信度。Specifically, a disparity map corresponding to the depth map may be obtained, and a disparity pixel point corresponding to a pixel point of the object area is selected from the disparity map; then, the object area is determined according to the disparity confidence level of the disparity pixel point. Pixel depth confidence. Determining the depth confidence of the pixels in the object region according to the disparity confidence of the parallax pixels may include, but is not limited to, the following methods: According to the disparity confidence of the parallax pixels, the depth information of the pixels in the object region And the focal length and binocular distance of the movable platform to determine the depth confidence of the pixels in the object area.
步骤2023,根据像素点的深度信息和该像素点的深度置信度,确定该目标物体与可移动平台的距离。Step 2023: Determine the distance between the target object and the movable platform according to the depth information of the pixel and the depth confidence of the pixel.
具体的,可以根据该像素点的深度信息和该像素点的深度置信度,基于滤波法确定该目标物体与可移动平台的距离。Specifically, the distance between the target object and the movable platform may be determined based on the filtering method according to the depth information of the pixel point and the depth confidence degree of the pixel point.
其中,所述滤波法可以包括但不限于:卡尔曼滤波法。The filtering method may include, but is not limited to, a Kalman filtering method.
以下结合图3所示的流程图,对步骤202的实现流程进行详细说明。The implementation flow of step 202 is described in detail below with reference to the flowchart shown in FIG. 3.
步骤301,获取该物体区域的像素点的深度信息。Step 301: Obtain depth information of pixels in the object area.
具体的,在从深度图中得到物体区域后,可以获取该物体区域的每个像素点的深度信息(即像素点对应位置与可移动平台的距离),对于从深度图中获取该物体区域的每个像素点的深度信息的方式,在此不再赘述。Specifically, after obtaining the object area from the depth map, the depth information of each pixel point of the object area (that is, the distance between the corresponding position of the pixel point and the movable platform) can be obtained. The manner of the depth information of each pixel point is not repeated here.
步骤302,获取与该深度图对应的视差图。Step 302: Obtain a disparity map corresponding to the depth map.
具体的,视差图是以图像对(即两个视觉传感器针对同一场景在不同角度同时拍摄的两幅图像)中任一幅图像为基准,大小为该基准图像的大小,元素值为视差值的图像,且视差图包含了场景的距离信息。由于深度图中也包含场景的距离信息,因此,在得到深度图后,就可以利用深度图获取视差图,对此获取过程不做限制,只要能够得到视差图即可。Specifically, the parallax map is based on any one of the image pairs (that is, two images taken simultaneously by two vision sensors at different angles for the same scene), the size is the size of the reference image, and the element value is the parallax value Image, and the disparity map contains the distance information of the scene. Because the depth map also contains the distance information of the scene, after obtaining the depth map, you can use the depth map to obtain the disparity map. There is no restriction on the acquisition process, as long as the disparity map can be obtained.
步骤303,从该视差图中选取与物体区域的像素点对应的视差像素点。Step 303: Select a parallax pixel point corresponding to a pixel point of the object area from the parallax map.
具体的,在从深度图中得到物体区域后,可以确定该物体区域在深度图中对应的像素点,这些像素点可以是深度图中的部分像素点,例如,像素点集合A包括该物体区域在深度图中对应的所有像素点。然后,在得到深度图对应的视差图后,可以确定像素点集合A内的每个像素点在该视差图中对应 的像素点,例如,像素点集合B包括像素点集合A内的每个像素点在视差图中对应的像素点,那么可以将像素点集合B中的每个像素点称为视差像素点。Specifically, after obtaining the object area from the depth map, the corresponding pixel points of the object area in the depth map may be determined. These pixel points may be part of the pixel points in the depth map. For example, the pixel set A includes the object area. All pixels in the depth map. Then, after obtaining the disparity map corresponding to the depth map, it is possible to determine the corresponding pixel point of each pixel in the pixel set A in the disparity map, for example, the pixel set B includes each pixel in the pixel set A The pixel point corresponding to the point in the disparity map, then each pixel point in the pixel point set B can be referred to as a disparity pixel point.
步骤304,获取视差像素点的视差置信度。Step 304: Obtain the parallax confidence of the parallax pixels.
具体的,每个视差像素点的视差置信度,也可以称为该视差像素点的不确定度(uncertainty),可以将每个视差像素点的测量值与真实值之差看做高斯分布,则视差像素点的视差置信度就是偏差。例如,可以采用如下方式确定视差像素点的视差置信度:
Figure PCTCN2018101630-appb-000001
其中,σ id表示视差像素点的视差置信度,S表示总能量,如SGM(Semi Global Matching,半全局匹配)算法中给出的总能量,对此不做限制,
Figure PCTCN2018101630-appb-000002
表示理论最小能量,如SGM算法中给出的理论最小能量,对此不做限制。当然,上述确定视差置信度的方式,只是一个示例,对此不做限制,只要能够获取到视差像素点的视差置信度即可。
Specifically, the parallax confidence of each parallax pixel can also be called the uncertainty of the parallax pixel. The difference between the measured value and the true value of each parallax pixel can be regarded as a Gaussian distribution. The parallax confidence of parallax pixels is bias. For example, the parallax confidence of the parallax pixels can be determined as follows:
Figure PCTCN2018101630-appb-000001
Among them, σ id represents the parallax confidence of the parallax pixels, and S represents the total energy, such as the total energy given in the SGM (Semi Global Matching) algorithm. There is no restriction on this.
Figure PCTCN2018101630-appb-000002
Represents the theoretical minimum energy, such as the theoretical minimum energy given in the SGM algorithm, which is not limited. Of course, the above method for determining the parallax confidence is only an example, and there is no limitation on this, as long as the parallax confidence of the parallax pixels can be obtained.
步骤305,根据视差像素点(即视差图中的像素点)的视差置信度确定该物体区域的像素点(即深度图中的像素点)的深度置信度。Step 305: Determine the depth confidence of the pixels of the object area (ie, the pixels in the depth map) according to the parallax confidence of the disparity pixels (ie, the pixels in the disparity map).
具体的,可以根据该视差像素点的视差置信度、该物体区域的像素点的深度信息以及可移动平台的焦距、双目距离,确定该物体区域的像素点的深度置信度。Specifically, the depth confidence of the pixel points of the object region may be determined according to the parallax confidence of the parallax pixels, the depth information of the pixel points of the object region, and the focal distance and binocular distance of the movable platform.
例如,可以采用如下方式确定像素点的深度置信度:
Figure PCTCN2018101630-appb-000003
其中,σ id表示视差像素点的视差置信度,d表示物体区域的像素点的深度信息(即像素点对应位置与可移动平台的距离),f和b分别表示可移动平台中的视觉传感器的焦距和双目距离。通过上述公式可知,在物体区域的像素点的深度信息为已知、视差像素点的视差置信度为已知、可移动平台的焦距和双目距离为已知的情况下,可以确定像素点的深度置信度。当然,上述确定深度置信度的方式,只是一个示例,对此不做限制,只要能够获取到深度置信度即可。
For example, the depth confidence of a pixel can be determined as follows:
Figure PCTCN2018101630-appb-000003
Among them, σ id represents the parallax confidence of the parallax pixels, d represents the depth information of the pixels in the object area (that is, the distance between the corresponding position of the pixels and the movable platform), and f and b represent the visual sensors of the movable platform. Focal distance and binocular distance. It can be known from the above formula that when the depth information of the pixels in the object area is known, the parallax confidence of the parallax pixels is known, and the focal distance and binocular distance of the movable platform are known, the Depth confidence. Of course, the above method for determining the depth confidence is only an example, and there is no limitation on this, as long as the depth confidence can be obtained.
步骤306,根据像素点的深度信息和该像素点的深度置信度,确定该目标物体与可移动平台的距离。Step 306: Determine the distance between the target object and the movable platform according to the depth information of the pixel and the depth confidence of the pixel.
具体的,可以根据该像素点的深度信息和该像素点的深度置信度,基于滤波法确定该目标物体与可移动平台的距离。Specifically, the distance between the target object and the movable platform may be determined based on the filtering method according to the depth information of the pixel point and the depth confidence degree of the pixel point.
在一个例子中,针对目标物体来说,该目标物体对应多个像素点,每个像素点对应一个深度信息和一个深度置信度,这样,目标物体的多个像素点就对应多个距离值,因此,可以使用卡尔曼滤波法(Kalman Filtering)实现数据的融合,得到目标物体与可移动平台之间的一个距离,也就是说,可以基于每个像素点的深度信息和深度置信度,使用卡尔曼滤波法实现数据的融合。In one example, for a target object, the target object corresponds to multiple pixels, and each pixel corresponds to a depth information and a depth confidence. In this way, multiple pixels of the target object correspond to multiple distance values. Therefore, Kalman Filtering can be used to achieve data fusion and obtain a distance between the target object and the movable platform. That is, based on the depth information and depth confidence of each pixel, Kalman The Mann filter method realizes data fusion.
在使用卡尔曼滤波法实现数据融合时,可以根据每个像素点的深度信息和该像素点的深度置信度,确定当前时刻的距离更新值;获取当前时刻的距离预测值,并根据距离更新值和距离预测值,确定目标物体与可移动平台在当前时刻的距离。当然,上述方式只是确定目标物体与可移动平台的距的一个示例,对此不做限制,只要能够确定目标物体与可移动平台的距离即可。When using Kalman filtering to achieve data fusion, the distance update value at the current time can be determined according to the depth information of each pixel and the depth confidence of the pixel point; the distance prediction value at the current time is obtained, and the value is updated according to the distance And distance prediction value to determine the distance between the target object and the movable platform at the current moment. Of course, the above method is only an example of determining the distance between the target object and the movable platform, and there is no limitation on this, as long as the distance between the target object and the movable platform can be determined.
实施例3:Example 3:
针对步骤102,在根据距离确定可移动平台的控制信息时,该控制信息可以是加速度,也可以是速度,还可以是用于产生加速度的控制力(如通过控制用于驱动可移动平台的驱动装置的输出扭矩实现,如电机的输出扭矩),对此控制信息的类型不做限制。其中,若控制信息为加速度,则可移动平台在接触目标物体之前,该加速度在第一方向上的分量能够调整为大于可移动平台在第二方向上的当前加速度,且第一方向与第二方向相反,该第二方向为可移动平台至目标物体(如目标物体可以是用于阻碍可移动平台运动的第二物体)的沿线方向。此外,若控制信息为速度,则可移动平台在接触目标物体之前,该速度在第一方向上的分量能够调整为大于可移动平台在第二方向上的当前速度,且第一方向与第二方向相反,该第二方向为可移动平台至目标物体(如目标物体是用于阻碍可移动平台运动的第二物体)的沿线方向。For step 102, when determining the control information of the movable platform according to the distance, the control information may be acceleration, speed, or a control force for generating acceleration (for example, by controlling a drive for driving the movable platform). The output torque of the device is realized, such as the output torque of a motor), and the type of the control information is not limited. Wherein, if the control information is acceleration, before the movable platform contacts the target object, the component of the acceleration in the first direction can be adjusted to be greater than the current acceleration of the movable platform in the second direction, and the first direction and the second direction The direction is opposite, and the second direction is the direction along the line from the movable platform to the target object (for example, the target object may be a second object for blocking the movement of the movable platform). In addition, if the control information is speed, before the movable platform contacts the target object, the component of the speed in the first direction can be adjusted to be greater than the current speed of the movable platform in the second direction, and the first direction and the second direction The direction is opposite, and the second direction is the direction along the line from the movable platform to the target object (for example, the target object is a second object for blocking the movement of the movable platform).
综上所述,以目标物体是用于阻碍可移动平台运动的第二物体为例,若控制信息为加速度,则在可移动平台接触第二物体之前,由于该加速度在第 一方向上的分量能够调整为大于可移动平台在第二方向上的当前加速度,且第一方向与第二方向相反,第二方向为可移动平台至该第二物体的沿线方向,因此,可以在可移动平台至第二物体的方向的相反方向上具有加速度,且该加速度可以大于可移动平台至第二物体的方向的当前加速度,从而实现避障。In summary, taking the target object as a second object for blocking the movement of the movable platform as an example, if the control information is acceleration, before the movable platform contacts the second object, due to the component of the acceleration in the first direction It can be adjusted to be greater than the current acceleration of the movable platform in the second direction, and the first direction is opposite to the second direction. The second direction is the direction along the line from the movable platform to the second object. There is acceleration in the opposite direction of the direction of the second object, and the acceleration may be greater than the current acceleration in the direction of the movable platform to the second object, thereby achieving obstacle avoidance.
或者,以目标物体是用于阻碍可移动平台运动的第二物体为例,若控制信息为速度,则在可移动平台在接触第二物体之前,由于该速度在第一方向上的分量能够调整为大于可移动平台在第二方向上的当前速度,而且,第一方向与第二方向相反,该第二方向为可移动平台至第二物体的沿线方向,因此,可以在可移动平台至第二物体的方向的相反方向上具有速度,且该速度可以大于可移动平台至第二物体的方向的当前速度,从而实现避障。Or, taking the target object as a second object for hindering the movement of the movable platform as an example, if the control information is velocity, before the movable platform contacts the second object, the component of the velocity in the first direction can be adjusted before the movable platform contacts the second object. Is greater than the current speed of the movable platform in the second direction, and the first direction is opposite to the second direction, which is the direction along the line from the movable platform to the second object. There is a speed in the opposite direction of the direction of the two objects, and the speed may be greater than the current speed in the direction of the movable platform to the second object, thereby achieving obstacle avoidance.
例如,假设可移动平台的位置是位置A,目标物体的位置是位置B,可移动平台的运动方向是位置A-位置B,第二方向为可移动平台至目标物体的沿线方向,即第二方向为位置A-位置B,且第一方向为位置B-位置A。For example, suppose the position of the movable platform is position A, the position of the target object is position B, the direction of movement of the movable platform is position A-position B, and the second direction is the direction along the line from the movable platform to the target object, that is, the second The direction is position A-position B, and the first direction is position B-position A.
可移动平台通过第二方向上的当前加速度1运动,在可移动平台接触目标物体之前,根据距离确定第一方向的加速度A。在该距离比较远时,则加速度A比较小,可能小于当前加速度1。这样,由于加速度A的方向与当前加速度1的方向相反,导致当前加速度1变小,但当前加速度1的方向仍然为第二方向。随着可移动平台与目标物体的距离变近,根据距离确定的第一方向的加速度A变大,直到加速度A在第一方向上的分量大于第二方向上的当前加速度1,就会导致可移动平台的运动方向是第一方向,而不再是第二方向,可移动平台朝着第一方向运动,使得可移动平台与目标物体的距离变远。The movable platform moves through the current acceleration 1 in the second direction. Before the movable platform contacts the target object, the acceleration A in the first direction is determined according to the distance. When the distance is relatively long, the acceleration A is small and may be smaller than the current acceleration 1. In this way, because the direction of the acceleration A is opposite to the direction of the current acceleration 1, the current acceleration 1 becomes smaller, but the direction of the current acceleration 1 is still the second direction. As the distance between the movable platform and the target object becomes closer, the acceleration A in the first direction determined according to the distance becomes larger, until the component of the acceleration A in the first direction is greater than the current acceleration 1 in the second direction, which results in The moving direction of the mobile platform is the first direction, and it is no longer the second direction. The movable platform moves toward the first direction, so that the distance between the movable platform and the target object becomes longer.
又例如,可移动平台通过第二方向上的当前速度2运动,在可移动平台接触目标物体之前,可以根据距离确定第一方向的速度B。在该距离比较远时,则速度B比较小,可能小于当前速度2。这样,由于速度B的方向与当前速度2的方向相反,导致当前速度2变小,但当前速度2的方向仍然为第二方向。随着可移动平台与目标物体的距离变近,根据距离确定的第一方向的速度B变大,直到速度B在第一方向上的分量大于第二方向上的当前速度 2,就会导致可移动平台的运动方向是第一方向,而不再是第二方向,可移动平台朝着第一方向运动,使得可移动平台与目标物体的距离变远。As another example, the movable platform moves at the current speed 2 in the second direction. Before the movable platform contacts the target object, the speed B in the first direction may be determined according to the distance. When the distance is relatively long, the speed B is relatively small and may be less than the current speed 2. In this way, because the direction of the speed B is opposite to the direction of the current speed 2, the current speed 2 becomes smaller, but the direction of the current speed 2 is still the second direction. As the distance between the movable platform and the target object becomes closer, the speed B in the first direction determined according to the distance becomes larger, until the component of the speed B in the first direction is greater than the current speed 2 in the second direction, which results in The moving direction of the mobile platform is the first direction, and it is no longer the second direction. The movable platform moves toward the first direction, so that the distance between the movable platform and the target object becomes longer.
在一个例子中,在根据距离确定可移动平台的控制信息时,若控制信息是加速度,则可以根据预设常数和距离确定可移动平台的加速度,该可移动平台的加速度可以与该预设常数呈正相关、与该距离呈负相关。In one example, when determining the control information of the movable platform according to the distance, if the control information is acceleration, the acceleration of the movable platform may be determined according to a preset constant and distance, and the acceleration of the movable platform may be equal to the preset constant. There is a positive correlation and a negative correlation with this distance.
进一步的,还可以根据可移动平台的加速度控制可移动平台进行运动,以使得可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与该目标物体至可移动平台的沿线方向(如目标物体至可移动平台的中心的沿线方向等)之间的夹角为0度至90度。例如,该夹角可以为如0度、10度、20度、30度、40度、50度、60度、70度、80度或90度。Further, the movable platform can also be controlled to move according to the acceleration of the movable platform, so that before the movable platform contacts the target object, the direction of movement of the movable platform can be adjusted to the direction along the line from the target object to the movable platform ( For example, the angle between the target object and the center of the movable platform along the line is 0 to 90 degrees. For example, the included angle may be, for example, 0 degrees, 10 degrees, 20 degrees, 30 degrees, 40 degrees, 50 degrees, 60 degrees, 70 degrees, 80 degrees, or 90 degrees.
在另一个例子中,在根据距离确定可移动平台的控制信息时,若控制信息是速度,则还可以根据预设常数和距离确定可移动平台的加速度,该可移动平台的加速度可以与该预设常数呈正相关、与该距离呈负相关。然后,还可以根据可移动平台的该加速度确定可移动平台的速度。进一步的,还可以根据可移动平台的该速度控制可移动平台进行运动,以使得可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与该目标物体至可移动平台的沿线方向之间的夹角为0度至90度。例如,该夹角可以为0度、10度、20度、30度、40度、50度、60度、70度、80度或90度。In another example, when determining the control information of the movable platform according to the distance, if the control information is speed, the acceleration of the movable platform may also be determined according to a preset constant and distance. The acceleration of the movable platform may be related to the preset Let the constant be positively correlated and negatively correlated with the distance. Then, the speed of the movable platform can also be determined based on the acceleration of the movable platform. Further, the movable platform can also be controlled to move according to the speed of the movable platform, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be along the line from the target object to the movable platform. The included angle is between 0 and 90 degrees. For example, the included angle may be 0 degrees, 10 degrees, 20 degrees, 30 degrees, 40 degrees, 50 degrees, 60 degrees, 70 degrees, 80 degrees, or 90 degrees.
在上述实施例中,预设常数可以为依据目标物体的类型确定。若目标物体的类型为预设第一类型(如第一物体,如用户),则预设常数可以为第一数值;若目标物体的类型为预设第二类型(如第二物体,如障碍物),则预设常数为第二数值;其中,该第一数值可以大于第二数值,且第一数值和第二数值均可以根据经验配置。显然,当目标物体是用户时,由于可移动平台的加速度与预设常数(即第一数值)呈正相关,因此,若第一数值比较大,则可以产生比较大的加速度,避免可移动平台接触到用户,从而更有效地保护到用户。而且,当可移动平台位于用户与障碍物之间时,若第一数值大于第二数值,在可移动平台与用户之间的距离和可移动平台与障碍物之间的距离相 同或者类似时,则可移动平台与用户之间的加速度可以大于可移动平台与障碍物之间的加速度,从而也可以避免可移动平台接触到用户,更有效地保护到用户。In the above embodiment, the preset constant may be determined according to the type of the target object. If the type of the target object is a preset first type (such as a first object, such as a user), the preset constant may be a first value; if the type of the target object is a preset second type (such as a second object, such as an obstacle) Object), the preset constant is a second value; wherein the first value may be greater than the second value, and both the first value and the second value may be configured according to experience. Obviously, when the target object is the user, since the acceleration of the movable platform is positively related to the preset constant (that is, the first value), if the first value is relatively large, a relatively large acceleration can be generated to avoid the contact of the movable platform. To the user, thereby protecting the user more effectively. Moreover, when the movable platform is located between the user and the obstacle, if the first value is greater than the second value, the distance between the movable platform and the user and the distance between the movable platform and the obstacle are the same or similar, Then, the acceleration between the movable platform and the user may be greater than the acceleration between the movable platform and the obstacle, thereby preventing the movable platform from contacting the user and protecting the user more effectively.
可选的,关于目标物体的类型,除了以第一物体和第二物体作为类型区分之外,在实际应用中,还可以采用其它分类标准,如生命物体与非生命物体,从而能够在目标物体的类型为生命物体时,能够通过距离阈值的不同设定而更有效地保护到生命物体,避免由于可移动平台的移动控制不及时而伤害到生命物体。Optionally, regarding the type of the target object, in addition to distinguishing the first object and the second object as types, in actual applications, other classification standards such as living objects and non-living objects can be used, so that When the type is a living object, the living object can be more effectively protected through different setting of the distance threshold, and the living object can be prevented from being injured due to the improper movement control of the movable platform.
综上所述,在根据距离确定可移动平台的控制信息时,可以构建一个斥力场(即可以产生一个控制力),例如,可以通过如下公式来构建一个斥力场:
Figure PCTCN2018101630-appb-000004
在该公式中,F可以表示该斥力场,m obstacls可以表示目标物体的质量,r可以表示构建的斥力场的半径,m drons可以表示可移动平台的质量。其中,假设目标物体的质量m obstacls是一个较大的恒定值,G也是一个恒定值,则可以通过预设常数w来表示上述公式中的G·m obstacls
In summary, when determining the control information of the movable platform according to the distance, a repulsive force field can be constructed (that is, a control force can be generated). For example, a repulsive force field can be constructed by the following formula:
Figure PCTCN2018101630-appb-000004
In this formula, F can represent the repulsive force field, m obstacls can represent the mass of the target object, r can represent the radius of the constructed repulsive force field, and m drons can represent the mass of the movable platform. Among them, assuming that the mass m obstacls of the target object is a large constant value and G is also a constant value, G · m obstacls in the above formula can be expressed by a preset constant w.
进一步的,可以利用上述斥力场确定可移动平台的加速度,例如,可以通过如下公式确定可移动平台的加速度:
Figure PCTCN2018101630-appb-000005
在该公式中,a表示可移动平台的加速度,w表示预设常数,d表示目标物体与可移动平台的距离。
Further, the acceleration of the movable platform can be determined by using the above-mentioned repulsive force field. For example, the acceleration of the movable platform can be determined by the following formula:
Figure PCTCN2018101630-appb-000005
In the formula, a represents the acceleration of the movable platform, w represents a preset constant, and d represents the distance between the target object and the movable platform.
其中,可移动平台的加速度与预设常数呈正相关、与距离呈负相关。当然,上述公式只是示例,对此不做限制。而且,若目标物体的类型为预设第一类型(如第一物体,如用户),则预设常数w为第一数值,若目标物体的类型为预设第二类型(如第二物体,如障碍物),则预设常数w为第二数值,且第一数值大于第二数值。Among them, the acceleration of the movable platform has a positive correlation with the preset constant and a negative correlation with the distance. Of course, the above formula is only an example, and there is no limitation on this. Moreover, if the type of the target object is a preset first type (such as a first object, such as a user), the preset constant w is a first value, and if the type of the target object is a preset second type (such as a second object, (Such as obstacles), the preset constant w is a second value, and the first value is greater than the second value.
可选的,关于目标物体的类型,除了以第一物体和第二物体作为类型区分之外,在实际应用中,还可以采用其它分类标准,如生命物体与非生命物体,从而能够在目标物体的类型为生命物体时,能够通过距离阈值的不同设定而更有效地保护到生命物体,避免由于可移动平台的移动控制不及时而伤 害到生命物体。Optionally, regarding the type of the target object, in addition to distinguishing the first object and the second object as types, in actual applications, other classification standards such as living objects and non-living objects can be used, so that When the type is a living object, the living object can be more effectively protected through different setting of the distance threshold, and the living object can be prevented from being injured due to the improper movement control of the movable platform.
在一个例子中,在确定出可移动平台的加速度后,可以根据可移动平台的加速度控制可移动平台进行运动;或者,在确定出可移动平台的加速度后,可以根据可移动平台的加速度确定可移动平台的速度,对此确定方式不做限制,然后,可以根据可移动平台的速度控制可移动平台进行运动。In one example, after determining the acceleration of the movable platform, the movable platform may be controlled to move according to the acceleration of the movable platform; or, after determining the acceleration of the movable platform, the movable platform may be determined according to the acceleration of the movable platform. The speed of the mobile platform is not limited in this determination method. Then, the mobile platform can be controlled to move according to the speed of the mobile platform.
实施例4:Example 4:
针对步骤102,在根据距离确定可移动平台的控制信息时,当距离不大于距离阈值时,则根据该距离确定可移动平台的控制信息,具体确定方式参见实施例3,在此不再赘述。显然,可以当距离不大于距离阈值时,才产生斥力场,从而根据距离确定可移动平台的控制信息,利用控制信息控制可移动平台进行运动,而距离大于距离阈值时,可以不产生斥力场,也就不需要根据距离确定可移动平台的控制信息,不需要利用控制信息控制可移动平台运动。For step 102, when determining the control information of the movable platform according to the distance, when the distance is not greater than the distance threshold, the control information of the movable platform is determined according to the distance. For a specific determination method, refer to Embodiment 3, and details are not described herein again. Obviously, the repulsive force field can be generated only when the distance is not greater than the distance threshold, so as to determine the control information of the movable platform according to the distance, and use the control information to control the movable platform for movement. Therefore, it is not necessary to determine the control information of the movable platform according to the distance, and it is not necessary to use the control information to control the movement of the movable platform.
进一步的,在根据控制信息控制可移动平台进行运动之后,当距离大于距离阈值时,可以保持可移动平台的当前运动信息,也就是说,当距离大于距离阈值时,可以忽略斥力信息,不再产生斥力场,也就不再根据距离确定可移动平台的控制信息,不需要利用控制信息控制可移动平台进行运动。Further, after controlling the movable platform for movement according to the control information, when the distance is greater than the distance threshold, the current movement information of the movable platform can be maintained, that is, when the distance is greater than the distance threshold, the repulsive force information can be ignored and no longer When a repulsive force field is generated, the control information of the movable platform is no longer determined according to the distance, and it is not necessary to use the control information to control the movable platform for movement.
在上述实施例中,距离阈值可以为依据目标物体的类型确定。若目标物体的类型为预设第三类型(如第一物体,如用户),则距离阈值可以为第三数值;若目标物体的类型为预设第四类型(如第二物体,如障碍物),则距离阈值可以为第四数值;其中,第三数值可以大于第四数值,且第三数值和第四数值均可以根据经验配置。In the above embodiment, the distance threshold may be determined according to the type of the target object. If the type of the target object is a preset third type (such as a first object, such as a user), the distance threshold may be a third value; if the type of the target object is a preset fourth type (such as a second object, such as an obstacle) ), The distance threshold may be a fourth value; wherein the third value may be greater than the fourth value, and the third value and the fourth value may be configured according to experience.
可选的,关于目标物体的类型,除了以第一物体和第二物体作为类型区分之外,在实际应用中,还可以采用其它分类标准,如生命物体与非生命物体,从而能够在目标物体的类型为生命物体时,能够通过距离阈值的不同设定而更有效地保护到生命物体,避免由于可移动平台的移动控制不及时而伤害到生命物体。Optionally, regarding the type of the target object, in addition to distinguishing the first object and the second object as types, in actual applications, other classification standards such as living objects and non-living objects can be used, so that When the type is a living object, the living object can be more effectively protected through different setting of the distance threshold, and the living object can be prevented from being injured due to the improper movement control of the movable platform.
其中,在根据距离确定可移动平台的控制信息时,控制信息可以包括以 下之一或任意组合:一个或者多个方向上的控制力、一个或者多个方向上的加速度、一个或者多个方向上的速度。在上述实施例中,以一个方向上的加速度,或一个方向上的速度为例,其它情况的处理流程类似,在此不再赘述。When determining the control information of the movable platform according to the distance, the control information may include one or any combination of the following: control force in one or more directions, acceleration in one or more directions, and one or more directions speed. In the above embodiment, the acceleration in one direction or the speed in one direction is taken as an example. The processing flow in other cases is similar, and is not described herein again.
实施例5:Example 5:
针对步骤103,在根据控制信息控制可移动平台进行运动时,若目标物体是用于控制可移动平台运动的第一物体(如用户)时,则可以根据该控制信息控制可移动平台进行运动,以使得可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与目标物体至可移动平台的沿线方向之间的夹角为0度至90度,例如,二者之间的夹角可以为0度。For step 103, when controlling the movable platform for movement according to the control information, if the target object is the first object (such as a user) for controlling the movement of the movable platform, the movable platform may be controlled for movement according to the control information. Before the movable platform contacts the target object, the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees, for example, the angle between the two The angle can be 0 degrees.
其中,对于第一物体的位置关系,则第一物体至可移动平台的沿线方向与可移动平台的当前运动方向之间的夹角为大于等于0度并小于等于90度。For the positional relationship of the first object, the included angle between the direction along the line of the first object to the movable platform and the current movement direction of the movable platform is greater than or equal to 0 degrees and less than or equal to 90 degrees.
参见图4A所示,目标物体是第一物体(如用户),可移动平台的运动方向与沿线方向(即目标物体至可移动平台的沿线方向)之间的夹角为0度至90度,图4A以夹角为0度为例。而且,从图4A中可以看出,第一物体至可移动平台的沿线方向,与可移动平台的当前运动方向之间的夹角为0度。As shown in FIG. 4A, the target object is the first object (such as a user), and the included angle between the direction of movement of the movable platform and the direction along the line (that is, the direction of the target object to the movable platform) is 0 degrees to 90 degrees, FIG. 4A takes an included angle of 0 degrees as an example. Moreover, it can be seen from FIG. 4A that the included angle between the first object and the movable platform along the line direction and the current movement direction of the movable platform is 0 degrees.
在根据控制信息控制可移动平台进行运动时,采用上述方式可以达到如下效果。首先,在启动可移动平台后,可移动平台采用巡航速度(该巡航速度可以预先设置)向方向1飞行,用户并未对可移动平台进行控制,由于可移动平台与用户之间的距离大于阈值。因此,斥力场可以忽略,可移动平台继续向方向1飞行。When the movable platform is controlled to perform motion according to the control information, the following effects can be achieved by adopting the foregoing manner. First, after starting the movable platform, the movable platform uses the cruise speed (the cruise speed can be set in advance) to fly in direction 1. The user does not control the movable platform. Because the distance between the movable platform and the user is greater than the threshold . Therefore, the repulsive force field can be ignored, and the movable platform continues to fly in direction 1.
然后,若用户需要控制可移动平台加速向方向1飞行,则用户移动到可移动平台的后方(如飞行方向的反方向),并向可移动平台移动。此时,可移动平台继续向方向1飞行,但由于用户的移动,可移动平台与用户之间的距离可以越来越小,当可移动平台与用户之间的距离小于阈值时,则斥力场将起到作用,此时,可以产生与可移动平台的当前运动方向相同的加速度,可移动平台速度逐渐增加地向方向1飞行,随着可移动平台与用户之间的距离越来越小,斥力场持续起到作用,此时,加速度进一步增大,可移动平台的 速度也进一步增大,并继续向方向1飞行。此时,若用户不再向可移动平台移动,则随着可移动平台与用户之间的距离越来越大,当距离大于阈值时,就不再产生加速度,可移动平台采用当前的巡航速度继续向方向1飞行;或者,此时,若用户继续向可移动平台移动,当可移动平台与用户之间的距离不大于阈值时,会继续产生加速度,可移动平台加速向方向1飞行,一直到可移动平台与用户之间的距离大于阈值。Then, if the user needs to control the movable platform to accelerate to fly in direction 1, the user moves to the rear of the movable platform (such as the opposite direction of the flight direction) and moves toward the movable platform. At this time, the movable platform continues to fly in direction 1, but due to the user's movement, the distance between the movable platform and the user can become smaller and smaller. When the distance between the movable platform and the user is less than the threshold, the repulsive field Will play a role, at this time, it can produce the same acceleration as the current direction of movement of the movable platform, and the speed of the movable platform gradually increases to fly in direction 1, as the distance between the movable platform and the user becomes smaller and smaller, The repulsive force field continues to play a role. At this time, the acceleration further increases, and the speed of the movable platform further increases, and continues to fly in direction 1. At this time, if the user no longer moves to the movable platform, as the distance between the movable platform and the user becomes larger and larger, when the distance is greater than the threshold value, no acceleration will be generated, and the movable platform adopts the current cruising speed. Continue to fly in direction 1; or, at this time, if the user continues to move to the movable platform, when the distance between the movable platform and the user is not greater than the threshold, acceleration will continue to occur, and the movable platform accelerates to fly in direction 1 and has been The distance to the mobile platform and the user is greater than a threshold.
进一步的,第一物体的运动方向可以与可移动平台的运动方向相同,这样,当第一物体沿着该运动方向进行运动时,可以控制可移动平台也沿着该运动方向进行运动,实现可移动平台的控制,达到推动可移动平台的效果。Further, the movement direction of the first object can be the same as the movement direction of the movable platform. In this way, when the first object moves along the movement direction, the movable platform can be controlled to also move along the movement direction to achieve The control of the mobile platform achieves the effect of promoting the mobile platform.
显然,在上述方式中,用户不需要使用控制终端,就可以实现对可移动平台的控制,从而简化用户的操作,提高用户的使用体验。Obviously, in the above manner, the user does not need to use the control terminal to implement control of the movable platform, thereby simplifying the operation of the user and improving the user experience.
实施例6:Example 6:
针对步骤103,在根据控制信息控制可移动平台进行运动时,若目标物体是用于阻碍可移动平台运动的第二物体(如障碍物)时,则根据该控制信息控制可移动平台进行运动,以使得可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与目标物体至可移动平台的沿线方向之间的夹角为0度至90度,例如,二者之间的夹角可以为90度。For step 103, when controlling the movable platform for movement according to the control information, if the target object is a second object (such as an obstacle) for blocking the movement of the movable platform, then controlling the movable platform for movement according to the control information, Before the movable platform contacts the target object, the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees, for example, the angle between the two The angle can be 90 degrees.
其中,对于第二物体的位置关系,则第二物体至可移动平台的沿线方向与可移动平台的当前运动方向之间的夹角为大于90度并小于等于180度。For the positional relationship of the second object, the included angle between the second object to the movable platform and the current movement direction of the movable platform is greater than 90 degrees and less than or equal to 180 degrees.
参见图4B和图4C所示,目标物体是第二物体(如障碍物),可移动平台的当前运动方向是朝向第二物体,在根据控制信息控制可移动平台进行运动后,可移动平台的调整后的运动方向与沿线方向(即目标物体至可移动平台的沿线方向)之间的夹角为0度至90度,在图4B中以夹角为0度为例,在图4C中以夹角为90度为例。而且,从图4B和图4C可以看出,第二物体至可移动平台的沿线方向,与可移动平台的当前运动方向之间的夹角为180度。Referring to FIG. 4B and FIG. 4C, the target object is a second object (such as an obstacle), and the current movement direction of the movable platform is toward the second object. After controlling the movable platform for movement according to the control information, The angle between the adjusted direction of movement and the direction along the line (that is, the direction along the line from the target object to the movable platform) is 0 degrees to 90 degrees. In FIG. 4B, the angle is 0 degrees as an example, and in FIG. 4C, As an example, the included angle is 90 degrees. Furthermore, it can be seen from FIG. 4B and FIG. 4C that the included angle between the second object to the movable platform and the current movement direction of the movable platform is 180 degrees.
进一步的,由于可移动平台的调整后的运动方向与沿线方向之间的夹角为0度至90度,这样,可以使可移动平台沿着远离第二物体(如障碍物)的 方向进行运动,如可移动平台反向运动,实现可移动平台的控制,达到弹开可移动平台的效果,实现对障碍物的绕行,在安全飞行的同时简化了操作。Further, since the included angle between the adjusted movement direction of the movable platform and the direction along the line is 0 degrees to 90 degrees, in this way, the movable platform can be moved in a direction away from the second object (such as an obstacle). For example, the movable platform moves in the reverse direction to realize the control of the movable platform, to achieve the effect of popping up the movable platform, to achieve detours to obstacles, and to simplify operations while flying safely.
在根据控制信息控制可移动平台进行运动时,采用上述方式可以达到图4D-图4G所示的效果。首先,可移动平台采用巡航速度向前飞行,由于可移动平台与障碍物(即第二物体)之间的距离大于阈值,因此,斥力场可以忽略,可移动平台继续向前飞行,参见图4D所示。然后,随着可移动平台向前飞行,可移动平台与障碍物之间的距离越来越小,当可移动平台与障碍物之间的距离小于阈值时,则斥力场将起到作用,此时,可以产生与可移动平台的当前运动方向相反的加速度,可移动平台速度逐渐降低地向前飞行,参见图4E所示。然后,随着可移动平台继续向前飞行,可移动平台与障碍物之间的距离越来越小,斥力场持续起到作用,此时,加速度进一步增大,在可移动平台向障碍物的方向的速度降低到0后,由于产生的反向加速度的作用,可移动平台可以反向加速折返向后飞行,参见图4F所示。然后,随着可移动平台向后飞行,可移动平台与障碍物之间的距离越来越大,此时,加速度慢慢减小,当可移动平台与障碍物之间的距离大于阈值时,斥力场可以忽略,即加速度为0,因此,可移动平台可以恢复巡航速度,保持当前的飞行方向,向后飞行,参见图4G所示。其中,对控制力或速度等控制信息的控制可以参照上述对加速度的控制流程,在此不再赘述。When the movable platform is controlled to perform motion according to the control information, the effects shown in FIGS. 4D to 4G can be achieved by using the foregoing manner. First, the movable platform uses cruising speed to fly forward. Since the distance between the movable platform and the obstacle (that is, the second object) is larger than the threshold, the repulsive force field can be ignored and the movable platform continues to fly forward, see Figure 4D As shown. Then, as the movable platform flies forward, the distance between the movable platform and the obstacle is getting smaller and smaller. When the distance between the movable platform and the obstacle is less than the threshold, the repulsive force field will play a role. At this time, an acceleration opposite to the current movement direction of the movable platform can be generated, and the speed of the movable platform is gradually reduced to fly forward, as shown in FIG. 4E. Then, as the movable platform continues to fly forward, the distance between the movable platform and the obstacle is getting smaller and smaller, and the repulsive force field continues to play a role. At this time, the acceleration further increases, and the movable platform moves toward the obstacle. After the speed in the direction is reduced to 0, the movable platform can accelerate backwards and return to the backward flight due to the generated reverse acceleration, as shown in FIG. 4F. Then, as the movable platform flies backward, the distance between the movable platform and the obstacle is getting larger and larger. At this time, the acceleration gradually decreases. When the distance between the movable platform and the obstacle is greater than the threshold, The repulsive force field can be ignored, that is, the acceleration is 0. Therefore, the movable platform can resume the cruising speed, maintain the current flight direction, and fly backward, as shown in FIG. 4G. For control of control information such as control force or speed, reference may be made to the above-mentioned control process of acceleration, and details are not described herein again.
综上所述,本实施例中,可以通过距离检测得到更加稳定的斥力场,使得航线规划更加顺畅,不会引起速度突变,并可以自动规划航线,以躲避障碍物,大大简化了操作,并提升了安全性能。能够感知周围的环境,探测移动方向上的障碍物,并通过构建斥力场,从而实现“视觉弹簧”的功能,能够在碰撞障碍物前,改变行进方向,且无需干预,自主规划行进路线,在安全飞行的同时大大简化了操作。上述方式是一种自主飞行模式,在优先考虑安全的情况下,自动导航规划路线,实现障碍物避让以及主动飞行,完成狭小空间内的顺畅飞行。In summary, in this embodiment, a more stable repulsive force field can be obtained through distance detection, which makes route planning smoother without causing sudden changes in speed, and can automatically plan routes to avoid obstacles, greatly simplifying operations, and Improved safety performance. Able to sense the surrounding environment, detect obstacles in the direction of movement, and build a repulsive field to achieve the function of "visual spring". It can change the direction of travel before colliding with obstacles without intervention, and independently plan the travel route. It also simplifies operations while flying safely. The above method is an autonomous flight mode. When safety is a priority, automatic navigation planning routes, obstacle avoidance and active flight are achieved, and smooth flight in a small space is completed.
实施例7:Example 7:
针对步骤103,在根据控制信息控制可移动平台进行运动时,若目标物体包括用于控制可移动平台运动的第一物体(如用户)和用于阻碍可移动平台运动的第二物体(如障碍物),根据控制信息控制可移动平台进行运动,以使得可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与目标物体至可移动平台的沿线方向(如目标物体至可移动平台的中心的沿线方向)之间的夹角为0度至90度。For step 103, when controlling the movable platform for movement according to the control information, if the target object includes a first object (such as a user) for controlling the movement of the movable platform and a second object (such as an obstacle for hindering the movement of the movable platform) Object), according to the control information, to control the movable platform for movement, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be along the line direction from the target object to the movable platform (such as the target object to the movable The angle between the center of the platform along the line) is 0 degrees to 90 degrees.
其中,对于第一物体与可移动平台的位置关系,可以是第一物体至可移动平台的沿线方向与可移动平台的当前运动方向之间的夹角为大于等于0度并小于等于90度。例如,该夹角可以为0度、10度、20度、30度、40度、50度、60度、70度、80度或90度。For the positional relationship between the first object and the movable platform, the included angle between the first object to the movable platform and the current movement direction of the movable platform is greater than or equal to 0 degrees and less than or equal to 90 degrees. For example, the included angle may be 0 degrees, 10 degrees, 20 degrees, 30 degrees, 40 degrees, 50 degrees, 60 degrees, 70 degrees, 80 degrees, or 90 degrees.
其中,对于第二物体与可移动平台的位置关系,可以是第二物体至可移动平台的沿线方向与可移动平台的当前运动方向之间的夹角为大于90度并小于等于180度。例如,该夹角可以为91度、100度、110度、120度、130度、140度、150度、160度、170度或180度。For the positional relationship between the second object and the movable platform, the included angle between the second object to the movable platform and the current movement direction of the movable platform is greater than 90 degrees and less than or equal to 180 degrees. For example, the included angle may be 91 degrees, 100 degrees, 110 degrees, 120 degrees, 130 degrees, 140 degrees, 150 degrees, 160 degrees, 170 degrees, or 180 degrees.
在一个例子中,根据可移动平台与第一物体之间的距离,可以得到控制信息1,然后,根据控制信息1控制可移动平台进行运动,以使得可移动平台在接触第一物体之前,可移动平台的运动方向能够调整为与第一物体至可移动平台的沿线方向之间的夹角为0度至90度,具体确定方式参见实施例5。In one example, the control information 1 can be obtained according to the distance between the movable platform and the first object, and then the movable platform is controlled to move according to the control information 1 so that the movable platform can be moved before contacting the first object. The moving direction of the moving platform can be adjusted so that the included angle between the first object and the direction along the line of the movable platform is 0 degrees to 90 degrees. For details, see Embodiment 5.
进一步的,根据可移动平台与第二物体之间的距离,可以得到控制信息2,然后,根据控制信息2控制可移动平台进行运动,以使得可移动平台在接触第二物体之前,可移动平台的运动方向能够调整为与第二物体至可移动平台的沿线方向之间的夹角为0度至90度,具体确定方式参见实施例6。Further, the control information 2 can be obtained according to the distance between the movable platform and the second object, and then the movable platform is controlled to move according to the control information 2 so that the movable platform can move the platform before contacting the second object. The moving direction of can be adjusted so that the included angle between the second object and the direction along the line of the movable platform is 0 degrees to 90 degrees. For a specific determination method, see Embodiment 6.
综上所述,无论可移动平台、第一物体和第二物体三者是否共线,则可以使可移动平台的运动方向能够调整为与第一物体至可移动平台的沿线方向之间的夹角为0度至90度,并可以使可移动平台的运动方向能够调整为与第二物体至可移动平台的沿线方向之间的夹角为0度至90度,对此不再赘述。In summary, regardless of whether the movable platform, the first object, and the second object are collinear, the movement direction of the movable platform can be adjusted to be between the first object and the direction along the line of the movable platform. The angle is 0 degrees to 90 degrees, and the movement direction of the movable platform can be adjusted to an included angle between the second object and the direction along the line of the movable platform is 0 degrees to 90 degrees, which will not be described again.
例如,参见图4H所示,该第一物体能够使可移动平台的运动方向是方向 1,而该第二物体能够使可移动平台的运动方向是方向2,在叠加该方向1和该方向2后,可移动平台最终的运动方向可以调整为方向3。显然,从图4H可以看出,该方向3与第一物体至可移动平台的沿线方向之间的夹角为0度至90度,该方向3与第二物体至可移动平台的沿线方向之间的夹角为0度至90度。For example, referring to FIG. 4H, the first object can make the moving direction of the movable platform to be direction 1, and the second object can make the moving direction of the movable platform to be direction 2. When the direction 1 and the direction 2 are superimposed, Later, the final movement direction of the movable platform can be adjusted to direction 3. Obviously, it can be seen from FIG. 4H that the angle between the direction 3 and the direction along the line from the first object to the movable platform is 0 degrees to 90 degrees. The included angle is between 0 degrees and 90 degrees.
在一个例子中,当第一物体、第二物体、可移动平台三者共线时,根据控制信息控制可移动平台进行运动,以使得可移动平台在接触所述目标物体之前,可移动平台的运动方向能够调整为与目标物体至可移动平台的沿线方向之间的夹角为0度至90度,可以包括但不限于:可以根据控制信息控制可移动平台进行运动,以使得可移动平台暂停于第一物体与第二物体之间,即悬停于二者之间;或者,可以根据控制信息控制可移动平台进行运动,以使得可移动平台向第二物体运动,并在接触第二物体之前,可以悬停在第二物体面前;或者,可以根据控制信息控制可移动平台进行运动,以使得可移动平台向其它方向运动,如绕过第二物体并向第二物体的反方向运动。In one example, when the first object, the second object, and the movable platform are all in line, the movable platform is controlled to move according to the control information, so that the movable platform can move the movable platform before contacting the target object. The movement direction can be adjusted so that the included angle between the target object and the direction along the movable platform is 0 degrees to 90 degrees, which can include but is not limited to: the movable platform can be controlled to move according to the control information, so that the movable platform is suspended Between the first object and the second object, that is, hovering between them; or, the movable platform can be controlled to move according to the control information, so that the movable platform moves toward the second object and contacts the second object Before, you can hover in front of the second object; or you can control the movable platform to move according to the control information, so that the movable platform moves in other directions, such as bypassing the second object and moving in the opposite direction of the second object.
例如,当第一物体、第二物体、可移动平台三者共线时,在根据控制信息控制可移动平台进行运动时,采用上述方式可以达到图4I-图4J所示的效果。首先,第一物体与可移动平台的距离较近,产生较大的斥力场,而第二物体与可移动平台的距离较远,产生较小的斥力场或者没有斥力场,因此,可以控制可移动平台向前运动,从而达到推到可移动平台的效果,参见图4I所示。然后,第二物体与可移动平台的距离越来越近,因此产生较大的斥力场,而第一物体由于控制可移动平台向前方运动,则第一物体与可移动平台的距离可以保持相对固定(第一物体也可以在不运动的情况下,与可移动平台的距离越来越远),产生的斥力场也相对问题,这样,由于两个斥力场的叠加作用,可以促使可移动平台悬停于第一物体与第二物体之间。或者,当第一物体、第二物体、可移动平台三者不共线时,由于两个斥力场的叠加作用,可以促使可移动平台反弹向斜后方向飞行,参见图4J所示。For example, when the first object, the second object, and the movable platform are all in line, when the movable platform is controlled to perform motion according to the control information, the effects shown in FIG. 4I to FIG. 4J can be achieved by using the foregoing method. First, the distance between the first object and the movable platform is relatively short, which results in a large repulsive force field, while the distance between the second object and the movable platform is relatively large, which results in a small or no repulsive force field. The mobile platform moves forward to achieve the effect of pushing to the movable platform, as shown in FIG. 4I. Then, the distance between the second object and the movable platform is getting closer and closer, so a larger repulsive force field is generated, and because the first object controls the movable platform to move forward, the distance between the first object and the movable platform can be maintained relative Fixed (the first object can also move farther and farther away from the movable platform without moving), and the repulsive force field is relatively problematic. In this way, due to the superposition of the two repulsive force fields, the movable platform can be promoted. Hover between the first object and the second object. Alternatively, when the first object, the second object, and the movable platform are not in line, due to the superposition of the two repulsive force fields, the movable platform can be caused to rebound to fly obliquely backward, as shown in FIG. 4J.
实施例8:Example 8:
针对步骤103,在根据控制信息控制可移动平台进行运动时,若目标物体是用于控制可移动平台运动的第一物体(如用户)时,则可以根据该控制信息控制可移动平台进行运动,以使得可移动平台在接触目标物体之前,可移动平台的运动方向能够调整为与目标物体至可移动平台的沿线方向之间的夹角为0度至90度可以包括但不限于:根据控制信息控制可移动平台与第一物体的距离不大于距离阈值。也就是说,在可移动平台向第一方向运动时,若第一物体向第二方向(如第一方向的反方向)运动,则可移动平台与第一物体之间的距离越来越远,当可移动平台与第一物体之间的距离大于距离阈值后,则可移动平台不再向第一方向运动,而是向第二方向运动,即可移动平台的运动方向与第一物体的运动方向相同,从而使得可移动平台与第一物体的距离在一恒定值,继而可以达到第一物体后退,可移动平台也后退的效果。For step 103, when controlling the movable platform for movement according to the control information, if the target object is the first object (such as a user) for controlling the movement of the movable platform, the movable platform may be controlled for movement according to the control information. Before the movable platform contacts the target object, the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform from 0 degrees to 90 degrees, which can include but is not limited to: according to the control information The distance between the movable platform and the first object is controlled to be not greater than a distance threshold. That is, when the movable platform moves in the first direction, if the first object moves in the second direction (such as the opposite direction of the first direction), the distance between the movable platform and the first object is getting farther and farther. When the distance between the movable platform and the first object is greater than the distance threshold, the movable platform no longer moves in the first direction, but moves in the second direction, that is, the direction of movement of the movable platform and the first object The movement direction is the same, so that the distance between the movable platform and the first object is at a constant value, and then the effect that the first object retracts and the movable platform also retracts can be achieved.
实施例9:Example 9:
针对步骤103,在根据控制信息控制可移动平台进行运动时,若目标物体为多个,则上述控制信息还可以包括各个目标物体对应的控制信息,即存在多个控制信息。基于此,根据控制信息控制可移动平台进行运动,可以包括但不限于:将各个目标物体对应的控制信息进行融合,并根据融合结果控制可移动平台进行运动。例如,若控制信息是加速度,则可以将各个目标物体对应的加速度进行融合,如对各个目标物体对应的加速度进行矢量叠加,得到一个总加速度,将总加速度作为最终的加速度,根据总加速度控制可移动平台进行运动。又例如,若控制信息是速度,则可以将各个目标物体对应的速度进行融合,如对各个目标物体对应的速度进行矢量叠加,得到一个总速度,将总速度作为最终的速度,根据总速度控制可移动平台进行运动。Regarding step 103, when controlling the movable platform for movement according to the control information, if there are multiple target objects, the control information may further include control information corresponding to each target object, that is, there is multiple control information. Based on this, controlling the movable platform to perform motion according to the control information may include, but is not limited to: fusing control information corresponding to each target object, and controlling the movable platform to perform motion according to the fusion result. For example, if the control information is acceleration, the accelerations corresponding to the respective target objects can be fused, such as vector superposition of the accelerations corresponding to the respective target objects to obtain a total acceleration, and the total acceleration is used as the final acceleration. Move the platform for movement. For another example, if the control information is speed, the speeds corresponding to the respective target objects can be fused, such as vector superposition of the speeds corresponding to the respective target objects to obtain a total speed, with the total speed as the final speed, and controlling according to the total speed Moveable platform for movement.
在一个例子中,可移动平台本身也有一个加速度,因此,在对各个目标物体对应的加速度进行矢量叠加,得到总加速度时,还可以将各个目标物体对应的加速度与可移动平台本身的加速度进行矢量叠加,得到一个总加速度。In one example, the movable platform itself also has an acceleration. Therefore, when the acceleration corresponding to each target object is superimposed to obtain the total acceleration, the acceleration corresponding to each target object can also be vectored with the acceleration of the movable platform itself. Add up to get a total acceleration.
在另一个例子中,可移动平台本身也有一个速度,因此,在对各个目标物体对应的速度进行矢量叠加,得到总速度时,还可以将各个目标物体对应 的速度与可移动平台本身的速度进行矢量叠加,得到一个总速度。In another example, the movable platform itself also has a speed. Therefore, when the speed corresponding to each target object is superimposed on the vector to obtain the total speed, the speed corresponding to each target object can also be compared with the speed of the movable platform itself. The vectors are superimposed to get a total velocity.
实施例10:Example 10:
基于与上述方法同样的发明构思,本发明实施例中还提供一种可移动平台,包括:存储器和处理器;参见图5所示,为可移动平台的结构示意图。Based on the same inventive concept as the above method, an embodiment of the present invention further provides a movable platform including: a memory and a processor; referring to FIG. 5, it is a schematic structural diagram of the movable platform.
所述存储器,用于存储程序代码;所述处理器,用于调用所述程序代码,当所述程序代码被执行时,所述处理器用于执行以下操作:The memory is used to store program code; the processor is used to call the program code, and when the program code is executed, the processor is used to perform the following operations:
确定目标物体与所述可移动平台的距离;Determining a distance between a target object and the movable platform;
根据所述距离确定所述可移动平台的控制信息;Determining control information of the movable platform according to the distance;
根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度。Controlling the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be in line with the target object to the movable The included angle between the platform directions along the line is 0 degrees to 90 degrees.
优选的,所述目标物体包括用于控制所述可移动平台运动的第一物体;Preferably, the target object includes a first object for controlling the movement of the movable platform;
所述处理器根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度时具体用于:根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度。The processor controls the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be equal to that of the target object. When the included angle between the movable platforms along the line direction is 0 degrees to 90 degrees, it is specifically used to: control the movable platform to move according to the control information, so that the movable platform is in contact with the target Before the object, the moving direction of the movable platform can be adjusted so that the included angle between the target object and the direction along the line of the movable platform is 0 degrees.
优选的,所述目标物体包括用于阻碍所述可移动平台运动的第二物体;Preferably, the target object includes a second object for blocking movement of the movable platform;
所述处理器根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度时具体用于:根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为90度。The processor controls the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be equal to that of the target object. When the included angle between the movable platforms along the line direction is 0 degrees to 90 degrees, it is specifically used to: control the movable platform to move according to the control information, so that the movable platform is in contact with the target Before the object, the moving direction of the movable platform can be adjusted so that the included angle between the target object and the direction along the line of the movable platform is 90 degrees.
优选的,所述目标物体包括用于控制所述可移动平台运动的第一物体和 用于阻碍所述可移动平台运动的第二物体;Preferably, the target object includes a first object for controlling the movement of the movable platform and a second object for hindering the movement of the movable platform;
当所述第一物体、所述第二物体、所述可移动平台三者共线时,所述处理器根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度时具体用于:根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台暂停于所述第一物体与所述第二物体之间。When the first object, the second object, and the movable platform are all in line, the processor controls the movable platform to move according to the control information, so that the movable platform is in Before touching the target object, the direction of movement of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees. The control information controls the movable platform to move so that the movable platform is suspended between the first object and the second object.
优选的,所述第一物体至所述可移动平台的沿线方向与所述可移动平台的当前运动方向之间的夹角为大于等于0度并小于等于90度。Preferably, an included angle between a direction along the line of the first object to the movable platform and a current movement direction of the movable platform is greater than or equal to 0 degrees and less than or equal to 90 degrees.
优选的,所述第二物体至所述可移动平台的沿线方向与所述可移动平台的当前运动方向之间的夹角为大于90度并小于等于180度。Preferably, an included angle between a direction along the line of the second object to the movable platform and a current movement direction of the movable platform is greater than 90 degrees and less than or equal to 180 degrees.
优选的,所述控制信息包括加速度;所述可移动平台在接触所述目标物体之前,所述加速度在第一方向上的分量能够调整为大于所述可移动平台在第二方向上的当前加速度,所述第一方向与所述第二方向相反,所述第二方向为所述可移动平台至所述第二物体的沿线方向。Preferably, the control information includes acceleration; before the movable platform contacts the target object, a component of the acceleration in a first direction can be adjusted to be greater than a current acceleration of the movable platform in a second direction The first direction is opposite to the second direction, and the second direction is a direction along the line from the movable platform to the second object.
优选的,所述处理器根据所述距离确定所述可移动平台的控制信息时具体用于:根据预设常数和所述距离确定所述可移动平台的加速度,所述可移动平台的加速度与所述预设常数呈正相关、与所述距离呈负相关;Preferably, when determining the control information of the movable platform according to the distance, the processor is specifically configured to determine the acceleration of the movable platform according to a preset constant and the distance, and the acceleration of the movable platform and The preset constant has a positive correlation and a negative correlation with the distance;
所述处理器根据所述控制信息控制所述可移动平台进行运动时具体用于:根据所述可移动平台的加速度控制所述可移动平台进行运动。When the processor controls the movable platform to perform motion according to the control information, the processor is specifically configured to: control the movable platform to perform motion according to the acceleration of the movable platform.
优选的,所述控制信息包括速度;所述可移动平台在接触所述目标物体之前,所述速度在第一方向上的分量能够调整为大于所述可移动平台在第二方向上的当前速度,所述第一方向与所述第二方向相反,所述第二方向为所述可移动平台至所述第二物体的沿线方向。Preferably, the control information includes a speed; before the movable platform contacts the target object, a component of the speed in a first direction can be adjusted to be greater than a current speed of the movable platform in a second direction The first direction is opposite to the second direction, and the second direction is a direction along the line from the movable platform to the second object.
优选的,所述处理器据所述距离确定所述可移动平台的控制信息时具体用于:根据预设常数和所述距离确定所述可移动平台的加速度,所述可移动平台的加速度与所述预设常数呈正相关、与所述距离呈负相关;Preferably, when determining the control information of the movable platform according to the distance, the processor is specifically configured to determine the acceleration of the movable platform according to a preset constant and the distance, and the acceleration of the movable platform and The preset constant has a positive correlation and a negative correlation with the distance;
根据所述可移动平台的加速度确定所述可移动平台的速度;Determining the speed of the movable platform according to the acceleration of the movable platform;
所述处理器根据所述控制信息控制所述可移动平台进行运动时具体用于:根据所述可移动平台的速度控制所述可移动平台进行运动。When the processor controls the movable platform to perform motion according to the control information, the processor is specifically configured to: control the movable platform to perform motion according to the speed of the movable platform.
优选的,所述处理器根据所述距离确定所述可移动平台的控制信息时具体用于:当所述距离不大于距离阈值时,根据所述距离确定所述可移动平台的控制信息。Preferably, when the processor determines the control information of the movable platform according to the distance, the processor is specifically configured to: when the distance is not greater than a distance threshold, determine the control information of the movable platform according to the distance.
优选的,处理器根据所述控制信息控制所述可移动平台进行运动之后还用于:当所述距离大于距离阈值时,保持所述可移动平台的当前运动信息。Preferably, after the processor controls the movable platform to perform movement according to the control information, the processor is further configured to: when the distance is greater than a distance threshold, maintain current movement information of the movable platform.
优选的,所述目标物体包括多个,所述控制信息包括各个所述目标物体对应的控制信息;所述处理器根据所述控制信息控制所述可移动平台进行运动时具体用于:将各个所述目标物体对应的控制信息进行融合;Preferably, the target object includes a plurality of objects, and the control information includes control information corresponding to each of the target objects; the processor is specifically configured to: when controlling the movable platform to perform motion according to the control information: Fusing control information corresponding to the target object;
根据融合结果控制所述可移动平台进行运动。And controlling the movable platform for movement according to the fusion result.
优选的,所述处理器确定目标物体与所述可移动平台的距离时具体用于:获取深度图,所述深度图包括与所述目标物体对应的物体区域;根据所述物体区域的深度信息确定所述目标物体与所述可移动平台的距离。Preferably, when the processor determines the distance between the target object and the movable platform, the processor is specifically configured to: obtain a depth map, where the depth map includes an object area corresponding to the target object; and according to the depth information of the object area Determining a distance between the target object and the movable platform.
优选的,所述处理器在根据所述物体区域的深度信息确定所述目标物体与可移动平台的距离之前还用于:将所述深度图中的相似像素点进行聚合,得到连通区域;确定所述连通区域为与所述目标物体对应的物体区域。Preferably, before determining the distance between the target object and the movable platform according to the depth information of the object area, the processor is further configured to: aggregate similar pixel points in the depth map to obtain a connected area; determine The connected region is an object region corresponding to the target object.
优选的,所述处理器将所述深度图中的相似像素点进行聚合时具体用于:采用泛洪填充算法对所述深度图中的相似像素点进行聚合。Preferably, when the processor aggregates similar pixels in the depth map, the processor is specifically configured to: use a flood filling algorithm to aggregate similar pixels in the depth map.
优选的,所述处理器根据所述物体区域的深度信息确定所述目标物体与所述可移动平台的距离时具体用于:获取所述物体区域的像素点的深度信息,并获取所述物体区域的像素点的深度置信度;根据所述像素点的深度信息和所述像素点的深度置信度,确定所述目标物体与所述可移动平台的距离。Preferably, when the processor determines the distance between the target object and the movable platform according to the depth information of the object area, the processor is specifically configured to: obtain depth information of pixels of the object area, and obtain the object A depth confidence level of a pixel point of the region; and determining a distance between the target object and the movable platform according to the depth information of the pixel point and the depth confidence level of the pixel point.
优选的,所述处理器获取所述物体区域的像素点的深度置信度时具体用于:获取与所述深度图对应的视差图;从所述视差图中选取与所述物体区域的像素点对应的视差像素点;根据所述视差像素点的视差置信度确定所述物 体区域的像素点的深度置信度。Preferably, when the processor obtains the depth confidence of the pixels of the object region, the processor is specifically configured to: obtain a disparity map corresponding to the depth map; and select the pixels of the object area from the disparity map A corresponding parallax pixel point; and a depth confidence level of a pixel point of the object region is determined according to the parallax confidence level of the parallax pixel point.
优选的,所述处理器根据所述视差像素点的视差置信度确定所述物体区域的像素点的深度置信度时具体用于:根据所述视差像素点的视差置信度、所述物体区域的像素点的深度信息以及所述可移动平台的焦距、双目距离,确定所述物体区域的像素点的深度置信度。Preferably, when the processor determines the depth confidence level of the pixel point of the object area according to the parallax confidence level of the parallax pixel point, the processor is specifically configured to: according to the parallax confidence level of the parallax pixel point, the The depth information of the pixels and the focal distance and binocular distance of the movable platform determine the depth confidence of the pixels in the object area.
优选的,所述处理器根据所述像素点的深度信息和所述像素点的深度置信度,确定所述目标物体与所述可移动平台的距离时具体用于:根据所述像素点的深度信息和所述像素点的深度置信度,基于滤波法确定所述目标物体与所述可移动平台的距离。Preferably, when determining the distance between the target object and the movable platform according to the depth information of the pixel point and the depth confidence degree of the pixel point, the processor is specifically configured to: according to the depth of the pixel point The information and the depth confidence level of the pixel point are used to determine the distance between the target object and the movable platform based on a filtering method.
实施例11:Example 11:
本发明实施例中还提出一种计算机可读存储介质,所述计算机可读存储介质上存储有计算机指令,所述计算机指令被执行时,实现上述可移动平台的控制方法。In the embodiment of the present invention, a computer-readable storage medium is also provided. The computer-readable storage medium stores computer instructions. When the computer instructions are executed, the control method of the movable platform is implemented.
上述实施例阐明的系统、装置、模块或单元,可以由计算机芯片或实体实现,或者由具有某种功能的产品来实现。一种典型的实现设备为计算机,计算机的具体形式可以是个人计算机、膝上型计算机、蜂窝电话、相机电话、智能电话、个人数字助理、媒体播放器、导航设备、电子邮件收发设备、游戏控制台、平板计算机、可穿戴设备或者这些设备中的任意几种设备的组合。The system, device, module, or unit described in the foregoing embodiments may be implemented by a computer chip or entity, or by a product having a certain function. A typical implementation device is a computer, and the specific form of the computer may be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email sending and receiving device, and a game control Desk, tablet computer, wearable device, or a combination of any of these devices.
为了描述的方便,描述以上装置时以功能分为各种单元分别描述。当然,在实施本发明时可以把各单元的功能在同一个或多个软件和/或硬件中实现。For the convenience of description, when describing the above device, the functions are divided into various units and described separately. Of course, when implementing the present invention, the functions of the units may be implemented in the same or multiple software and / or hardware.
本领域内的技术人员应明白,本发明实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明实施例可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present invention may be provided as a method, a system, or a computer program product. Therefore, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产 品的流程图和/或方框图来描述的。应理解可以由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其它可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其它可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, and combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to produce a machine, so that instructions generated by the processor of the computer or other programmable data processing device may be used to Means for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.
而且,这些计算机程序指令也可以存储在能引导计算机或其它可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或者多个流程和/或方框图一个方框或者多个方框中指定的功能。Moreover, these computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured article including the instruction device, The instruction device implements the functions specified in a flowchart or a plurality of processes and / or a block or a block of the block diagram.
这些计算机程序指令也可装载到计算机或其它可编程数据处理设备,使得在计算机或者其它可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其它可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded into a computer or other programmable data processing device, so that a series of operating steps are performed on the computer or other programmable device to produce a computer-implemented process, and the instructions executed on the computer or other programmable device Provides steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.
以上所述仅为本发明实施例而已,并不用于限制本发明。对于本领域技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原理之内所作的任何修改、等同替换、改进,均应包含在本发明的权利要求范围之内。The above description is only an embodiment of the present invention, and is not intended to limit the present invention. It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall be included in the scope of the claims of the present invention.

Claims (59)

  1. 一种可移动平台的控制方法,其特征在于,所述方法包括:A control method of a movable platform, characterized in that the method includes:
    确定目标物体与所述可移动平台的距离;Determining a distance between a target object and the movable platform;
    根据所述距离确定所述可移动平台的控制信息;Determining control information of the movable platform according to the distance;
    根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度。Controlling the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be in line with the target object to the movable The included angle between the platform directions along the line is 0 degrees to 90 degrees.
  2. 根据权利要求1所述的方法,其特征在于,所述目标物体包括用于控制所述可移动平台运动的第一物体。The method according to claim 1, wherein the target object comprises a first object for controlling movement of the movable platform.
  3. 根据权利要求2所述的方法,其特征在于,所述根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度,包括:The method according to claim 2, characterized in that the mobile platform is controlled to move according to the control information, so that before the mobile platform contacts the target object, the mobile platform The direction of movement can be adjusted to an angle between the target object and the direction along the line of the movable platform from 0 degrees to 90 degrees, including:
    根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度。Controlling the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be in line with the target object to the movable The included angle between the platforms along the line is 0 degrees.
  4. 根据权利要求1所述的方法,其特征在于,所述目标物体包括用于阻碍所述可移动平台运动的第二物体。The method of claim 1, wherein the target object comprises a second object for hindering movement of the movable platform.
  5. 根据权利要求4所述的方法,其特征在于,所述根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度,包括:The method according to claim 4, characterized in that the mobile platform is controlled to move according to the control information, so that before the mobile platform contacts the target object, the mobile platform The direction of movement can be adjusted to an angle between the target object and the direction along the line of the movable platform from 0 degrees to 90 degrees, including:
    根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为90度。Controlling the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be in line with the target object to the movable The included angle between the platforms along the line is 90 degrees.
  6. 根据权利要求1所述的方法,其特征在于,所述目标物体包括用于控制所述可移动平台运动的第一物体和用于阻碍所述可移动平台运动的第二物 体。The method according to claim 1, wherein the target object comprises a first object for controlling movement of the movable platform and a second object for hindering movement of the movable platform.
  7. 根据权利要求6所述的方法,其特征在于,当所述第一物体、所述第二物体、所述可移动平台三者共线时,所述根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度,包括:The method according to claim 6, characterized in that when the first object, the second object, and the movable platform are in line, the controlling the movable platform according to the control information Perform movement so that before the movable platform contacts the target object, the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 Degrees to 90 degrees, including:
    根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台暂停于所述第一物体与所述第二物体之间。Controlling the movable platform to move according to the control information, so that the movable platform is paused between the first object and the second object.
  8. 根据权利要求2或3或6或7所述的方法,其特征在于,所述第一物体至所述可移动平台的沿线方向与所述可移动平台的当前运动方向之间的夹角为大于等于0度并小于等于90度。The method according to claim 2 or 3 or 6 or 7, characterized in that an included angle between a direction along the line of the first object to the movable platform and a current movement direction of the movable platform is greater than 0 degrees and 90 degrees or less.
  9. 根据权利要求4至7中任一项所述的方法,其特征在于,所述第二物体至所述可移动平台的沿线方向与所述可移动平台的当前运动方向之间的夹角为大于90度并小于等于180度。The method according to any one of claims 4 to 7, wherein an included angle between a direction along the line of the second object to the movable platform and a current movement direction of the movable platform is greater than 90 degrees and 180 degrees or less.
  10. 根据权利要求4至6中任一项所述的方法,其特征在于,所述控制信息包括加速度;The method according to any one of claims 4 to 6, wherein the control information includes acceleration;
    所述可移动平台在接触所述目标物体之前,所述加速度在第一方向上的分量能够调整为大于所述可移动平台在第二方向上的当前加速度,所述第一方向与所述第二方向相反,所述第二方向为所述可移动平台至所述第二物体的沿线方向。Before the movable platform contacts the target object, a component of the acceleration in a first direction can be adjusted to be greater than a current acceleration of the movable platform in a second direction, and the first direction and the first direction The two directions are opposite, and the second direction is a line direction from the movable platform to the second object.
  11. 根据权利要求10所述的方法,其特征在于,所述根据所述距离确定所述可移动平台的控制信息,包括:The method according to claim 10, wherein determining the control information of the movable platform according to the distance comprises:
    根据预设常数和所述距离确定所述可移动平台的加速度,所述可移动平台的加速度与所述预设常数呈正相关、与所述距离呈负相关;Determining the acceleration of the movable platform according to a preset constant and the distance, and the acceleration of the movable platform has a positive correlation with the preset constant and a negative correlation with the distance;
    所述根据所述控制信息控制所述可移动平台进行运动,包括:The controlling the movable platform to perform movement according to the control information includes:
    根据所述可移动平台的加速度控制所述可移动平台进行运动。The movable platform is controlled to move according to the acceleration of the movable platform.
  12. 根据权利要求4至6中任一项所述的方法,其特征在于,所述控制 信息包括速度;The method according to any one of claims 4 to 6, wherein the control information includes a speed;
    所述可移动平台在接触所述目标物体之前,所述速度在第一方向上的分量能够调整为大于所述可移动平台在第二方向上的当前速度,所述第一方向与所述第二方向相反,所述第二方向为所述可移动平台至所述第二物体的沿线方向。Before the movable platform contacts the target object, the velocity component in the first direction can be adjusted to be greater than the current velocity of the movable platform in the second direction, and the first direction and the first direction The two directions are opposite, and the second direction is a line direction from the movable platform to the second object.
  13. 根据权利要求12所述的方法,其特征在于,所述根据所述距离确定所述可移动平台的控制信息,包括:The method according to claim 12, wherein determining the control information of the movable platform according to the distance comprises:
    根据预设常数和所述距离确定所述可移动平台的加速度,所述可移动平台的加速度与所述预设常数呈正相关、与所述距离呈负相关;Determining the acceleration of the movable platform according to a preset constant and the distance, and the acceleration of the movable platform has a positive correlation with the preset constant and a negative correlation with the distance;
    根据所述可移动平台的加速度确定所述可移动平台的速度;Determining the speed of the movable platform according to the acceleration of the movable platform;
    所述根据所述控制信息控制所述可移动平台进行运动,包括:The controlling the movable platform to perform movement according to the control information includes:
    根据所述可移动平台的速度控制所述可移动平台进行运动。The movable platform is controlled to move according to the speed of the movable platform.
  14. 根据权利要求11或13所述的方法,其特征在于,所述预设常数为依据所述目标物体的类型确定。The method according to claim 11 or 13, wherein the preset constant is determined according to a type of the target object.
  15. 根据权利要求14所述的方法,其特征在于,若所述目标物体的类型为预设第一类型,则所述预设常数为第一数值;The method according to claim 14, wherein if the type of the target object is a preset first type, the preset constant is a first value;
    若所述目标物体的类型为预设第二类型,则所述预设常数为第二数值;If the type of the target object is a preset second type, the preset constant is a second value;
    其中,所述第一数值大于所述第二数值。The first value is greater than the second value.
  16. 根据权利要求1至7中任一项所述的方法,其特征在于,所述根据所述距离确定所述可移动平台的控制信息,包括:The method according to any one of claims 1 to 7, wherein the determining control information of the movable platform according to the distance comprises:
    当所述距离不大于距离阈值时,根据所述距离确定所述可移动平台的控制信息。When the distance is not greater than a distance threshold, control information of the movable platform is determined according to the distance.
  17. 根据权利要求16所述的方法,其特征在于,在所述根据所述控制信息控制所述可移动平台进行运动之后,所述方法还包括:The method according to claim 16, wherein after the controlling the movable platform for movement according to the control information, the method further comprises:
    当所述距离大于距离阈值时,保持所述可移动平台的当前运动信息。When the distance is greater than the distance threshold, current movement information of the movable platform is maintained.
  18. 根据权利要求17所述的方法,其特征在于,所述距离阈值为依据所述目标物体的类型确定。The method according to claim 17, wherein the distance threshold is determined according to a type of the target object.
  19. 根据权利要求18所述的方法,其特征在于,若所述目标物体的类型为预设第三类型,则所述距离阈值为第三数值;The method according to claim 18, wherein if the type of the target object is a preset third type, the distance threshold is a third value;
    若所述目标物体的类型为预设第四类型,则所述距离阈值为第四数值;If the type of the target object is a preset fourth type, the distance threshold is a fourth value;
    其中,所述第三数值大于所述第四数值。The third value is greater than the fourth value.
  20. 根据权利要求2或3或6或7所述的方法,其特征在于,所述根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度,包括:The method according to claim 2 or 3 or 6 or 7, characterized in that the mobile platform is controlled to move according to the control information, so that before the mobile platform contacts the target object, The moving direction of the movable platform can be adjusted so that the included angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees, including:
    根据所述控制信息控制所述可移动平台与所述第一物体的距离不大于距离阈值。Controlling the distance between the movable platform and the first object according to the control information to be not greater than a distance threshold.
  21. 根据权利要求1至7中任一项所述的方法,其特征在于,所述目标物体包括多个,所述控制信息包括各个所述目标物体对应的控制信息;The method according to any one of claims 1 to 7, wherein the target object includes a plurality of pieces, and the control information includes control information corresponding to each of the target objects;
    所述根据所述控制信息控制所述可移动平台进行运动,包括:The controlling the movable platform to perform movement according to the control information includes:
    将各个所述目标物体对应的控制信息进行融合;Fusing control information corresponding to each of the target objects;
    根据融合结果控制所述可移动平台进行运动。And controlling the movable platform for movement according to the fusion result.
  22. 根据权利要求1至7中任一项所述的方法,其特征在于,所述确定目标物体与所述可移动平台的距离,包括:The method according to any one of claims 1 to 7, wherein the determining a distance between a target object and the movable platform comprises:
    获取深度图,所述深度图包括与所述目标物体对应的物体区域;Acquiring a depth map, where the depth map includes an object region corresponding to the target object;
    根据所述物体区域的深度信息确定所述目标物体与所述可移动平台的距离。Determining a distance between the target object and the movable platform according to the depth information of the object region.
  23. 根据权利要求22所述的方法,其特征在于,在所述根据所述物体区域的深度信息确定所述目标物体与可移动平台的距离之前,所述方法还包括:The method according to claim 22, wherein before the determining the distance between the target object and the movable platform according to the depth information of the object region, the method further comprises:
    将所述深度图中的相似像素点进行聚合,得到连通区域;Aggregate similar pixels in the depth map to obtain a connected region;
    确定所述连通区域为与所述目标物体对应的物体区域。It is determined that the connected region is an object region corresponding to the target object.
  24. 根据权利要求23所述的方法,其特征在于,所述将所述深度图中的相似像素点进行聚合,包括:The method according to claim 23, wherein the aggregating similar pixels in the depth map comprises:
    采用泛洪填充算法对所述深度图中的相似像素点进行聚合。A flood filling algorithm is used to aggregate similar pixels in the depth map.
  25. 根据权利要求22所述的方法,其特征在于,所述根据所述物体区域的深度信息确定所述目标物体与所述可移动平台的距离,包括:The method according to claim 22, wherein determining the distance between the target object and the movable platform according to the depth information of the object region comprises:
    获取所述物体区域的像素点的深度信息,并获取所述物体区域的像素点的深度置信度;Acquiring depth information of pixels of the object region, and acquiring depth confidence of the pixels of the object region;
    根据所述像素点的深度信息和所述像素点的深度置信度,确定所述目标物体与所述可移动平台的距离。Determining the distance between the target object and the movable platform according to the depth information of the pixel point and the depth confidence degree of the pixel point.
  26. 根据权利要25所述的方法,其特征在于,所述获取所述物体区域的像素点的深度置信度,包括:The method according to claim 25, wherein the acquiring a depth confidence level of a pixel point of the object region comprises:
    获取与所述深度图对应的视差图;Obtaining a disparity map corresponding to the depth map;
    从所述视差图中选取与所述物体区域的像素点对应的视差像素点;Selecting a parallax pixel point corresponding to a pixel point of the object region from the parallax map;
    根据所述视差像素点的视差置信度确定所述物体区域的像素点的深度置信度。A depth confidence level of a pixel point of the object region is determined according to the parallax confidence level of the parallax pixel point.
  27. 根据权利要求26所述的方法,其特征在于,所述根据所述视差像素点的视差置信度确定所述物体区域的像素点的深度置信度,包括:The method according to claim 26, wherein determining the depth confidence level of the pixel point of the object area according to the parallax confidence level of the parallax pixel point comprises:
    根据所述视差像素点的视差置信度、所述物体区域的像素点的深度信息以及所述可移动平台的焦距、双目距离,确定所述物体区域的像素点的深度置信度。The depth confidence of the pixel points of the object area is determined according to the parallax confidence of the parallax pixels, the depth information of the pixel points of the object area, and the focal distance and binocular distance of the movable platform.
  28. 根据权利要求25所述的方法,其特征在于,所述根据所述像素点的深度信息和所述像素点的深度置信度,确定所述目标物体与所述可移动平台的距离,包括:The method according to claim 25, wherein determining the distance between the target object and the movable platform according to the depth information of the pixel point and the depth confidence degree of the pixel point comprises:
    根据所述像素点的深度信息和所述像素点的深度置信度,基于滤波法确定所述目标物体与所述可移动平台的距离。According to the depth information of the pixel point and the depth confidence degree of the pixel point, a distance between the target object and the movable platform is determined based on a filtering method.
  29. 根据权利要求28所述的方法,其特征在于,所述滤波法包括卡尔曼滤波法。The method according to claim 28, wherein the filtering method comprises a Kalman filtering method.
  30. 一种可移动平台,其特征在于,包括:存储器和处理器;所述存储器,用于存储程序代码;所述处理器,用于调用所述程序代码,当所述程序代码被执行时,所述处理器用于执行以下操作:A movable platform includes: a memory and a processor; the memory is used to store program code; the processor is used to call the program code, and when the program code is executed, all the The processor is used to perform the following operations:
    确定目标物体与所述可移动平台的距离;Determining a distance between a target object and the movable platform;
    根据所述距离确定所述可移动平台的控制信息;Determining control information of the movable platform according to the distance;
    根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度。Controlling the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be in line with the target object to the movable The included angle between the platform directions along the line is 0 degrees to 90 degrees.
  31. 根据权利要求30所述的可移动平台,其特征在于,所述目标物体包括用于控制所述可移动平台运动的第一物体。The movable platform according to claim 30, wherein the target object comprises a first object for controlling a movement of the movable platform.
  32. 根据权利要求31所述的可移动平台,其特征在于,所述处理器根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度时具体用于:The movable platform according to claim 31, wherein the processor controls the movable platform to move according to the control information, so that before the movable platform contacts the target object, the processor When the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees, it is specifically used for:
    根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度。Controlling the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be in line with the target object to the movable The included angle between the platforms along the line is 0 degrees.
  33. 根据权利要求30所述的可移动平台,其特征在于,所述目标物体包括用于阻碍所述可移动平台运动的第二物体。The movable platform according to claim 30, wherein the target object includes a second object for blocking movement of the movable platform.
  34. 根据权利要求33所述的可移动平台,其特征在于,所述处理器根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度时具体用于:The movable platform according to claim 33, wherein the processor controls the movable platform to move according to the control information, so that before the movable platform contacts the target object, the processor When the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees, it is specifically used for:
    根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为90度。Controlling the movable platform to move according to the control information, so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be in line with the target object to the movable The included angle between the platforms along the line is 90 degrees.
  35. 根据权利要求30所述的可移动平台,其特征在于,所述目标物体包括用于控制所述可移动平台运动的第一物体和用于阻碍所述可移动平台运动的第二物体。The movable platform according to claim 30, wherein the target object comprises a first object for controlling the movement of the movable platform and a second object for hindering the movement of the movable platform.
  36. 根据权利要求35所述的可移动平台,其特征在于,当所述第一物体、 所述第二物体、所述可移动平台三者共线时,所述处理器根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度时具体用于:The movable platform according to claim 35, wherein when the first object, the second object, and the movable platform are all in line, the processor controls the mobile station according to the control information. The movable platform moves so that before the movable platform contacts the target object, the movement direction of the movable platform can be adjusted to be between the target object and the direction along the line of the movable platform. When the included angle is 0 degrees to 90 degrees, it is specifically used for:
    根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台暂停于所述第一物体与所述第二物体之间。Controlling the movable platform to move according to the control information, so that the movable platform is paused between the first object and the second object.
  37. 根据权利要求31或32或35或36所述的可移动平台,其特征在于,所述第一物体至所述可移动平台的沿线方向与所述可移动平台的当前运动方向之间的夹角为大于等于0度并小于等于90度。The movable platform according to claim 31 or 32 or 35 or 36, wherein an angle between a direction along a line from the first object to the movable platform and a current movement direction of the movable platform 0 degrees or more and 90 degrees or less.
  38. 根据权利要求33至36中任一项所述的可移动平台,其特征在于,所述第二物体至所述可移动平台的沿线方向与所述可移动平台的当前运动方向之间的夹角为大于90度并小于等于180度。The movable platform according to any one of claims 33 to 36, wherein an angle between a direction along the line of the second object to the movable platform and a current movement direction of the movable platform It is greater than 90 degrees and less than or equal to 180 degrees.
  39. 根据权利要求33至35中任一项所述的可移动平台,其特征在于,所述控制信息包括加速度;The movable platform according to any one of claims 33 to 35, wherein the control information includes acceleration;
    所述可移动平台在接触所述目标物体之前,所述加速度在第一方向上的分量能够调整为大于所述可移动平台在第二方向上的当前加速度,所述第一方向与所述第二方向相反,所述第二方向为所述可移动平台至所述第二物体的沿线方向。Before the movable platform contacts the target object, a component of the acceleration in a first direction can be adjusted to be greater than a current acceleration of the movable platform in a second direction, and the first direction and the first direction The two directions are opposite, and the second direction is a line direction from the movable platform to the second object.
  40. 根据权利要求39所述的可移动平台,其特征在于,所述处理器根据所述距离确定所述可移动平台的控制信息时具体用于:The movable platform according to claim 39, wherein when the processor determines the control information of the movable platform according to the distance, the processor is specifically configured to:
    根据预设常数和所述距离确定所述可移动平台的加速度,所述可移动平台的加速度与所述预设常数呈正相关、与所述距离呈负相关;Determining the acceleration of the movable platform according to a preset constant and the distance, and the acceleration of the movable platform has a positive correlation with the preset constant and a negative correlation with the distance;
    所述处理器根据所述控制信息控制所述可移动平台进行运动时具体用于:When the processor controls the movable platform to perform movement according to the control information, the processor is specifically configured to:
    根据所述可移动平台的加速度控制所述可移动平台进行运动。The movable platform is controlled to move according to the acceleration of the movable platform.
  41. 根据权利要求33至35中任一项所述的可移动平台,其特征在于,所述控制信息包括速度;The movable platform according to any one of claims 33 to 35, wherein the control information includes a speed;
    所述可移动平台在接触所述目标物体之前,所述速度在第一方向上的分量能够调整为大于所述可移动平台在第二方向上的当前速度,所述第一方向与所述第二方向相反,所述第二方向为所述可移动平台至所述第二物体的沿线方向。Before the movable platform contacts the target object, the velocity component in the first direction can be adjusted to be greater than the current velocity of the movable platform in the second direction, and the first direction and the first direction The two directions are opposite, and the second direction is a line direction from the movable platform to the second object.
  42. 根据权利要求41所述的可移动平台,其特征在于,所述处理器据所述距离确定所述可移动平台的控制信息时具体用于:The movable platform according to claim 41, wherein when the processor determines the control information of the movable platform according to the distance, the processor is specifically configured to:
    根据预设常数和所述距离确定所述可移动平台的加速度,所述可移动平台的加速度与所述预设常数呈正相关、与所述距离呈负相关;Determining the acceleration of the movable platform according to a preset constant and the distance, and the acceleration of the movable platform has a positive correlation with the preset constant and a negative correlation with the distance;
    根据所述可移动平台的加速度确定所述可移动平台的速度;Determining the speed of the movable platform according to the acceleration of the movable platform;
    所述处理器根据所述控制信息控制所述可移动平台进行运动时具体用于:When the processor controls the movable platform to perform movement according to the control information, the processor is specifically configured to:
    根据所述可移动平台的速度控制所述可移动平台进行运动。The movable platform is controlled to move according to the speed of the movable platform.
  43. 根据权利要求40或42所述的可移动平台,其特征在于,所述预设常数为依据所述目标物体的类型确定。The movable platform according to claim 40 or 42, wherein the preset constant is determined according to a type of the target object.
  44. 根据权利要求43所述的可移动平台,其特征在于,若所述目标物体的类型为预设第一类型,则所述预设常数为第一数值;The movable platform according to claim 43, wherein if the type of the target object is a preset first type, the preset constant is a first value;
    若所述目标物体的类型为预设第二类型,则所述预设常数为第二数值;If the type of the target object is a preset second type, the preset constant is a second value;
    其中,所述第一数值大于所述第二数值。The first value is greater than the second value.
  45. 根据权利要求30至36中任一项所述的可移动平台,其特征在于,所述处理器根据所述距离确定所述可移动平台的控制信息时具体用于:The movable platform according to any one of claims 30 to 36, wherein the processor is specifically configured to: when determining the control information of the movable platform according to the distance:
    当所述距离不大于距离阈值时,根据所述距离确定所述可移动平台的控制信息。When the distance is not greater than a distance threshold, control information of the movable platform is determined according to the distance.
  46. 根据权利要求45所述的可移动平台,其特征在于,所述处理器根据所述控制信息控制所述可移动平台进行运动之后还用于:The movable platform according to claim 45, wherein after the processor controls the movable platform to perform movement according to the control information, the processor is further configured to:
    当所述距离大于距离阈值时,保持所述可移动平台的当前运动信息。When the distance is greater than the distance threshold, current movement information of the movable platform is maintained.
  47. 根据权利要求46所述的可移动平台,其特征在于,所述距离阈值为依据所述目标物体的类型确定。The movable platform according to claim 46, wherein the distance threshold is determined according to the type of the target object.
  48. 根据权利要求47所述的可移动平台,其特征在于,若所述目标物体的类型为预设第三类型,则所述距离阈值为第三数值;The movable platform according to claim 47, wherein if the type of the target object is a preset third type, the distance threshold is a third value;
    若所述目标物体的类型为预设第四类型,则所述距离阈值为第四数值;If the type of the target object is a preset fourth type, the distance threshold is a fourth value;
    其中,所述第三数值大于所述第四数值。The third value is greater than the fourth value.
  49. 根据权利要求31或32或35或36所述的方法,其特征在于,所述处理器根据所述控制信息控制所述可移动平台进行运动,以使得所述可移动平台在接触所述目标物体之前,所述可移动平台的运动方向能够调整为与所述目标物体至所述可移动平台的沿线方向之间的夹角为0度至90度时具体用于:The method according to claim 31 or 32 or 35 or 36, wherein the processor controls the movable platform to perform movement according to the control information, so that the movable platform is contacting the target object Previously, when the moving direction of the movable platform can be adjusted to an angle between the target object and the direction along the line of the movable platform is 0 degrees to 90 degrees, it is specifically used for:
    根据所述控制信息控制所述可移动平台与所述第一物体的距离不大于距离阈值。Controlling the distance between the movable platform and the first object according to the control information to be not greater than a distance threshold.
  50. 根据权利要求30至36中任一项所述的可移动平台,其特征在于,所述目标物体包括多个,所述控制信息包括各个所述目标物体对应的控制信息;The movable platform according to any one of claims 30 to 36, wherein the target object includes a plurality, and the control information includes control information corresponding to each of the target objects;
    所述处理器根据所述控制信息控制所述可移动平台进行运动时具体用于:When the processor controls the movable platform to perform movement according to the control information, the processor is specifically configured to:
    将各个所述目标物体对应的控制信息进行融合;Fusing control information corresponding to each of the target objects;
    根据融合结果控制所述可移动平台进行运动。And controlling the movable platform for movement according to the fusion result.
  51. 根据权利要求30至36中任一项所述的可移动平台,其特征在于,所述处理器确定目标物体与所述可移动平台的距离时具体用于:The movable platform according to any one of claims 30 to 36, wherein the processor is specifically configured to: when determining a distance between a target object and the movable platform:
    获取深度图,所述深度图包括与所述目标物体对应的物体区域;Acquiring a depth map, where the depth map includes an object region corresponding to the target object;
    根据所述物体区域的深度信息确定所述目标物体与所述可移动平台的距离。Determining a distance between the target object and the movable platform according to the depth information of the object region.
  52. 根据权利要求51所述的可移动平台,其特征在于,所述处理器在根据所述物体区域的深度信息确定所述目标物体与可移动平台的距离之前还用于:The movable platform according to claim 51, wherein before the processor determines the distance between the target object and the movable platform according to the depth information of the object region, the processor is further configured to:
    将所述深度图中的相似像素点进行聚合,得到连通区域;Aggregate similar pixels in the depth map to obtain a connected region;
    确定所述连通区域为与所述目标物体对应的物体区域。It is determined that the connected region is an object region corresponding to the target object.
  53. 根据权利要求52所述的可移动平台,其特征在于,所述处理器将所述深度图中的相似像素点进行聚合时具体用于:The movable platform according to claim 52, wherein when the processor aggregates similar pixels in the depth map, the processor is specifically configured to:
    采用泛洪填充算法对所述深度图中的相似像素点进行聚合。A flood filling algorithm is used to aggregate similar pixels in the depth map.
  54. 根据权利要求51所述的可移动平台,其特征在于,所述处理器根据所述物体区域的深度信息确定所述目标物体与所述可移动平台的距离时具体用于:The movable platform according to claim 51, wherein the processor is specifically configured to determine the distance between the target object and the movable platform according to the depth information of the object area:
    获取所述物体区域的像素点的深度信息,并获取所述物体区域的像素点的深度置信度;Acquiring depth information of pixels of the object region, and acquiring depth confidence of the pixels of the object region;
    根据所述像素点的深度信息和所述像素点的深度置信度,确定所述目标物体与所述可移动平台的距离。Determining the distance between the target object and the movable platform according to the depth information of the pixel point and the depth confidence degree of the pixel point.
  55. 根据权利要求54所述的可移动平台,其特征在于,所述处理器获取所述物体区域的像素点的深度置信度时具体用于:The movable platform according to claim 54, wherein the processor is specifically configured to: when obtaining the depth confidence of the pixels of the object region:
    获取与所述深度图对应的视差图;Obtaining a disparity map corresponding to the depth map;
    从所述视差图中选取与所述物体区域的像素点对应的视差像素点;Selecting a parallax pixel point corresponding to a pixel point of the object region from the parallax map;
    根据所述视差像素点的视差置信度确定所述物体区域的像素点的深度置信度。A depth confidence level of a pixel point of the object region is determined according to the parallax confidence level of the parallax pixel point.
  56. 根据权利要求55所述的可移动平台,其特征在于,所述处理器根据所述视差像素点的视差置信度确定所述物体区域的像素点的深度置信度时具体用于:The movable platform according to claim 55, wherein the processor is specifically configured to: when determining the depth confidence of the pixels of the object region according to the disparity confidence of the disparity pixels,
    根据所述视差像素点的视差置信度、所述物体区域的像素点的深度信息以及所述可移动平台的焦距、双目距离,确定所述物体区域的像素点的深度置信度。The depth confidence of the pixel points of the object area is determined according to the parallax confidence of the parallax pixels, the depth information of the pixel points of the object area, and the focal distance and binocular distance of the movable platform.
  57. 根据权利要求54所述的可移动平台,其特征在于,所述处理器根据所述像素点的深度信息和所述像素点的深度置信度,确定所述目标物体与所述可移动平台的距离时具体用于:The movable platform according to claim 54, wherein the processor determines the distance between the target object and the movable platform according to the depth information of the pixel point and the depth confidence degree of the pixel point. Specific when:
    根据所述像素点的深度信息和所述像素点的深度置信度,基于滤波法确 定所述目标物体与所述可移动平台的距离。A distance between the target object and the movable platform is determined based on a filtering method according to the depth information of the pixel point and the depth confidence degree of the pixel point.
  58. 根据权利要求57所述的可移动平台,其特征在于,所述滤波法包括卡尔曼滤波法。The movable platform according to claim 57, wherein the filtering method comprises a Kalman filtering method.
  59. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机指令,所述计算机指令被执行时,实现权利要求1-29所述的可移动平台的控制方法。A computer-readable storage medium, characterized in that computer instructions are stored on the computer-readable storage medium, and when the computer instructions are executed, the control method of the movable platform according to claims 1-29 is implemented.
PCT/CN2018/101630 2018-08-22 2018-08-22 Control method for movable platform, movable platform and readable storage medium WO2020037524A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/101630 WO2020037524A1 (en) 2018-08-22 2018-08-22 Control method for movable platform, movable platform and readable storage medium
CN201880039799.1A CN110770668A (en) 2018-08-22 2018-08-22 Control method of movable platform, movable platform and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/101630 WO2020037524A1 (en) 2018-08-22 2018-08-22 Control method for movable platform, movable platform and readable storage medium

Publications (1)

Publication Number Publication Date
WO2020037524A1 true WO2020037524A1 (en) 2020-02-27

Family

ID=69328587

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/101630 WO2020037524A1 (en) 2018-08-22 2018-08-22 Control method for movable platform, movable platform and readable storage medium

Country Status (2)

Country Link
CN (1) CN110770668A (en)
WO (1) WO2020037524A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112753210A (en) * 2020-04-26 2021-05-04 深圳市大疆创新科技有限公司 Movable platform, control method thereof and storage medium
WO2022188174A1 (en) * 2021-03-12 2022-09-15 深圳市大疆创新科技有限公司 Movable platform, control method of movable platform, and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106586011A (en) * 2016-12-12 2017-04-26 高域(北京)智能科技研究院有限公司 Aligning method of aerial shooting unmanned aerial vehicle and aerial shooting unmanned aerial vehicle thereof
US20170261604A1 (en) * 2016-03-11 2017-09-14 Raytheon Bbn Technologies Corp. Intercept drone tasked to location of lidar tracked drone
CN107223219A (en) * 2016-09-26 2017-09-29 深圳市大疆创新科技有限公司 Control method, control device and delivery system
CN108124472A (en) * 2017-12-26 2018-06-05 深圳市道通智能航空技术有限公司 A kind of method, apparatus and aircraft of barrier of dodging
CN108196451A (en) * 2017-12-29 2018-06-22 中国电子科技集团公司信息科学研究院 A kind of bionical shoal of fish avoid-obstacle behavior control method

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8660362B2 (en) * 2011-11-21 2014-02-25 Microsoft Corporation Combined depth filtering and super resolution
JP6009502B2 (en) * 2014-07-29 2016-10-19 株式会社ソニー・インタラクティブエンタテインメント Information processing apparatus and information processing method
WO2016154869A1 (en) * 2015-03-31 2016-10-06 SZ DJI Technology Co., Ltd. System and method for mobile platform operation
CN105761265A (en) * 2016-02-23 2016-07-13 英华达(上海)科技有限公司 Method for providing obstacle avoidance based on image depth information and unmanned aerial vehicle
US10635913B2 (en) * 2016-10-17 2020-04-28 Mediatek Inc. Path planning method and related navigation device
US10003787B1 (en) * 2016-12-21 2018-06-19 Canon Kabushiki Kaisha Method, system and apparatus for refining a depth map
CN107272681A (en) * 2017-06-16 2017-10-20 深圳市可飞科技有限公司 Adjust automatically mobile platform and the method and mobile platform of target object location relation
CN107272682A (en) * 2017-06-16 2017-10-20 深圳市可飞科技有限公司 Mobile platform evades the method, system and mobile platform of collision automatically

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170261604A1 (en) * 2016-03-11 2017-09-14 Raytheon Bbn Technologies Corp. Intercept drone tasked to location of lidar tracked drone
CN107223219A (en) * 2016-09-26 2017-09-29 深圳市大疆创新科技有限公司 Control method, control device and delivery system
CN106586011A (en) * 2016-12-12 2017-04-26 高域(北京)智能科技研究院有限公司 Aligning method of aerial shooting unmanned aerial vehicle and aerial shooting unmanned aerial vehicle thereof
CN108124472A (en) * 2017-12-26 2018-06-05 深圳市道通智能航空技术有限公司 A kind of method, apparatus and aircraft of barrier of dodging
CN108196451A (en) * 2017-12-29 2018-06-22 中国电子科技集团公司信息科学研究院 A kind of bionical shoal of fish avoid-obstacle behavior control method

Also Published As

Publication number Publication date
CN110770668A (en) 2020-02-07

Similar Documents

Publication Publication Date Title
US11644832B2 (en) User interaction paradigms for a flying digital assistant
Peng et al. Path planning and obstacle avoidance for vision guided quadrotor UAV navigation
Saha et al. A real-time monocular vision-based frontal obstacle detection and avoidance for low cost UAVs in GPS denied environment
CN108323190A (en) A kind of barrier-avoiding method, device and unmanned plane
CN113238583B (en) Intensive formation flying and anti-collision control method for fixed-wing unmanned aerial vehicles
WO2020037524A1 (en) Control method for movable platform, movable platform and readable storage medium
WO2021081960A1 (en) Route planning method, device and system, and storage medium
WO2021212462A1 (en) Movement control method, movement apparatus, and movement platform
WO2021078003A1 (en) Obstacle avoidance method and device for unmanned vehicle, and unmanned vehicle
WO2019227333A1 (en) Group photograph photographing method and apparatus
WO2022016534A1 (en) Flight control method of unmanned aerial vehicle and unmanned aerial vehicle
JP2018120570A (en) Autonomous type mobile robot, movement control method, and movement control program and system
JPWO2017221859A1 (en) Mobile body, mobile body control system, mobile body control method, interface device, and program
CN111444786A (en) Crowd evacuation method, device and system based on unmanned aerial vehicle group and storage medium
Mattamala et al. Learning camera performance models for active multi-camera visual teach and repeat
Yamamoto et al. Improvement of image processing for a collaborative security flight control system with multiple drones
Uchida et al. Image recognitions of collaborative drones' security controls for FPV systems
WO2021238743A1 (en) Flight control method and apparatus for unmanned aerial vehicle, and unmanned aerial vehicle
JP2021177582A (en) Control device, control method, and program
US20210011490A1 (en) Flight control method, device, and machine-readable storage medium
JP7422361B2 (en) Tracking devices and programs
Dinaux et al. FAITH: Fast iterative half-plane focus of expansion estimation using optic flow
CN115698890A (en) Incomplete mobile robot and continuous adjusting method and system thereof
Hattori et al. Generalized measuring-worm algorithm: High-accuracy mapping and movement via cooperating swarm robots
CN108319295B (en) Obstacle avoidance control method, equipment and computer readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18930584

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18930584

Country of ref document: EP

Kind code of ref document: A1