WO2022126477A1 - Control method and device for movable platform, and movable platform - Google Patents

Control method and device for movable platform, and movable platform Download PDF

Info

Publication number
WO2022126477A1
WO2022126477A1 PCT/CN2020/137173 CN2020137173W WO2022126477A1 WO 2022126477 A1 WO2022126477 A1 WO 2022126477A1 CN 2020137173 W CN2020137173 W CN 2020137173W WO 2022126477 A1 WO2022126477 A1 WO 2022126477A1
Authority
WO
WIPO (PCT)
Prior art keywords
movable platform
movement speed
movement
vision sensor
overlapping
Prior art date
Application number
PCT/CN2020/137173
Other languages
French (fr)
Chinese (zh)
Inventor
周游
赵子敬
杨振飞
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202080077986.6A priority Critical patent/CN114846295A/en
Priority to PCT/CN2020/137173 priority patent/WO2022126477A1/en
Publication of WO2022126477A1 publication Critical patent/WO2022126477A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/10Simultaneous control of position or course in three dimensions

Definitions

  • the present application relates to the field of automatic control, and in particular, to a control method for a movable platform, a control device for a movable platform, and a movable platform.
  • the movable platform can usually be equipped with a visual sensor for sensing the surrounding environment to prevent the movable platform from hitting obstacles.
  • the existing UAV systems are equipped with a multi-eye (multi-camera) visual perception module based on machine vision, which is used for the UAV to perceive the surrounding environment, thereby assisting the controller to fly safely.
  • a multi-eye (multi-camera) visual perception module based on machine vision, which is used for the UAV to perceive the surrounding environment, thereby assisting the controller to fly safely.
  • an embodiment of the present application provides a control method for a movable platform, the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping
  • the method includes:
  • the movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
  • embodiments of the present application provide a control method for a movable platform, where the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping
  • the method includes:
  • the movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
  • embodiments of the present application provide a control device for a movable platform, where the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping observations scope, the control device includes:
  • memory for storing processor-executable instructions
  • the processor is configured to:
  • the movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
  • an embodiment of the present application provides a control device for a movable platform, the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping Observation range, the control device includes:
  • memory for storing processor-executable instructions
  • the processor is configured to:
  • the parameter information includes a field of view angle corresponding to the overlapping observation ranges
  • the movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
  • an embodiment of the present application provides a movable platform, the movable platform includes a first vision sensor and a second vision sensor, and the first vision sensor and the second vision sensor have overlapping observation ranges,
  • the movable platform also includes:
  • memory for storing processor-executable instructions
  • the processor is configured to:
  • the movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
  • an embodiment of the present application provides a movable platform, the movable platform includes a first vision sensor and a second vision sensor, and the first vision sensor and the second vision sensor have overlapping observation ranges,
  • the movable platform also includes:
  • memory for storing processor-executable instructions
  • the processor is configured to:
  • the parameter information includes a field of view angle corresponding to the overlapping observation ranges
  • the movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
  • the embodiment of the present application controls the movable platform to move within the observation range, avoids the safety risk brought by the observation blind spot, and ensures that the movable platform is in a safe motion state.
  • FIG. 1 is a flowchart of a control method of a mobile platform according to an exemplary embodiment of the present application.
  • FIG. 2 is a schematic diagram of an overlapping observation range of a first visual sensor and a second visual sensor according to an exemplary embodiment of the present application.
  • FIG. 3 is a schematic diagram of an unmanned aerial vehicle according to an exemplary embodiment of the present application.
  • FIG. 4 is a top view showing an unmanned aerial vehicle flying in a horizontal direction according to an exemplary embodiment of the present application.
  • FIG. 5 is a schematic diagram illustrating a predicted motion trajectory obtained when an unmanned aerial vehicle flies in a horizontal direction according to an exemplary embodiment of the present application.
  • FIG. 6 is a flowchart of another method for controlling a movable platform according to an exemplary embodiment of the present application.
  • FIG. 7 is a schematic diagram of a control device of a movable platform according to an exemplary embodiment of the present application.
  • FIG. 8 is a schematic diagram of a movable platform according to an exemplary embodiment of the present application.
  • the embodiment of the present application provides a control method for a movable platform.
  • the movable platform can be controlled to move within the observation range according to the real-time observation range of the actual scene, so as to ensure that the movable platform is in a safe motion state.
  • the movable platform may be an unmanned aerial vehicle, an unmanned vehicle, an unmanned ship, a robot, etc.
  • the control method may be implemented by a processor or a processing chip carried in the movable platform, and the movable platform Automatically adjust the movement state; or, since the user can control the movement of the movable platform by manipulating the control terminal that is communicatively connected to the movable platform, if possible, the control terminal can also control the movement of the movable platform by communicating with the movable platform.
  • the information exchange between the mobile platform obtains the state information of the movable platform, and automatically adjusts the motion state of the movable platform; of course, the control terminal can also output the relevant parameters showing the real-time motion state of the movable platform, and the The picture captured by the camera or the visual sensor is returned, and the movement of the movable platform is controlled according to the instructions input by the user.
  • the control terminal may be a mobile terminal, such as a handheld remote control, a mobile phone, a tablet, a notebook computer, etc.; or a fixed terminal, such as a desktop computer, a server, and the like.
  • FIG. 1 is a flowchart of a control method of a movable platform according to an exemplary embodiment of the present application, wherein the movable platform includes the first control method.
  • a visual sensor and a second visual sensor, the first visual sensor and the second visual sensor have overlapping observation ranges, and the control method includes:
  • S102 Adjust the movement speed control amount of the movable platform according to the focal length information, so that the direction of the movement speed of the movable platform is within the field of view angle range corresponding to the overlapping observation range.
  • the overlapping observation range may be the observation range that the user perceives, for example, the movable platform may send the overlapping observation range of the first visual sensor and the second visual sensor to the control terminal held by the user for the user to view. Of course, it may also be an observation range that the user does not perceive.
  • the first visual sensor and the second visual sensor may be cameras, and for the scene observed within the overlapping observation range of the first visual sensor and the second visual sensor, the observation between the first visual sensor and the second visual sensor may be used.
  • Parallax is used to calculate the distance of the scene relative to the movable platform.
  • the first visual sensor and the second visual sensor can be used to take two photos at the same time and from different angles, and then use the position of the same scene in the two photos. Differences, as well as the position and angle relationship between the first visual sensor and the second visual sensor, use the triangular relationship to calculate the distance relationship between the scene and the first and second visual sensors, thereby obtaining the distance of the scene relative to the movable platform information.
  • the effective observation range of the movable platform is mainly the overlapping observation range of the first visual sensor and the second visual sensor.
  • the safety hazard caused by the observation blind spot can be effectively reduced.
  • FIG. 2 it is a schematic diagram of an overlapping observation range of a first visual sensor and a second visual sensor according to an exemplary embodiment of the present application.
  • “overlapping observation range” will be directly used below to represent the overlapping observation range of the first visual sensor and the second visual sensor. It can be understood that, unless otherwise specified, the overlapping observation range that appears below refers to the first visual sensor. Overlapping viewing range with the second vision sensor.
  • the speed control amount of the movable platform is adjusted according to the acquired field of view angle range, so that the direction of the movement speed of the movable platform is within the field of view angle range corresponding to the overlapping observation range.
  • the speed control amount of the movable platform can be the movement speed of the movable platform, which can be limited to the field of view angle corresponding to the overlapping observation range by directly adjusting the movement speed of the movable platform; the speed control amount of the movable platform is also It can be the limit amount of the movement speed of the movable platform, wherein the limit amount of the movement speed can be the maximum movement speed or the minimum movement speed, or the specified movement speed.
  • the movement speed limit of the movable platform can be preset based on the field of view angle range corresponding to the initial overlap range, and then the movement speed limit amount can be adjusted based on the real-time change of the field of view angle range.
  • the movement speed of the movable platform is adjusted by the limit amount, so as to limit the movement speed of the movable platform within the range of the field of view corresponding to the overlapping observation range.
  • the field angle range corresponding to the overlapping range can be obtained through the focal length information of the first visual sensor and the second visual sensor, where the focal length information can be the focal length of the first visual sensor and the second visual sensor, which can be obtained through the first visual sensor and the second visual sensor.
  • the focal length of the second visual sensor determines the field of view angle corresponding to the overlapping observation range. Specifically, the description is still made with reference to FIG. 2 .
  • the first visual sensor 201 and the second visual sensor 202 are represented by an inverted triangle shape in FIG. 2 . It can be seen from FIG. 2 that, whether for the first visual sensor 201 or the second visual sensor 202, the focal length f is inversely correlated with the field of view angle FoV, that is, the corresponding field of view angle FoV when the focal length f increases will decrease.
  • the angle of view corresponding to the focal length values of the first visual sensor 201 and the second visual sensor 202 can be pre-calibrated, so that when acquiring the focal length of the first visual sensor and the focal length value of the second visual sensor, the The focal length value of the sensor and the focal length value of the second visual sensor are used to determine the field of view angle of the first visual sensor and the field of view of the second visual sensor, and can further obtain the overlap of the first visual sensor and the second visual sensor.
  • the field of view range corresponding to the observation range.
  • the corresponding change of the field of view is also small, so it is not necessary to calibrate all the focal length values of the first vision sensor and the second vision sensor.
  • the field of view angle corresponding to the focal length value is calibrated, so that when zooming to an uncalibrated focal length, the field of view angle corresponding to the common focal length value close to it can be referred to. Thereby, the redundant calculation amount and the occupation of data storage during calibration can be reduced.
  • multiple focal length modes can also be configured, such as a telephoto mode, a medium focal length mode, a short focal length mode, etc., and the focal length values used in each focal length mode are correspondingly set as the calibrated common focal length values.
  • the focal length information of the first visual sensor and the second visual sensor may also be the focal length mode of the first visual sensor and the second visual sensor.
  • the focal length information of the first visual sensor and the second visual sensor can also be the angle of view of the first visual sensor and the second visual sensor.
  • the field angle range corresponding to the overlapping observation range is not only related to the focal length information of the first visual sensor and the second visual sensor, but also related to the baseline distance of the first visual sensor and the second visual sensor. It can be seen from FIG. 2 that when the length of the baseline distance b between the first visual sensor 201 and the second visual sensor 202 changes, the range of the field of view angle corresponding to the corresponding overlapping observation range also changes.
  • the baseline distances of the first visual sensor and the second visual sensor can also be obtained, and according to the baseline distance information and the aforementioned focal length information, the field angle range corresponding to the overlapping observation range can be determined, And adjust the movement speed control amount of the movable platform, so that the direction of the movement speed of the movable platform is within the range of the field angle corresponding to the overlapping observation range.
  • the movement speed control amount of the movable platform can also be adjusted according to the observation distance of the first visual sensor and the second visual sensor, so as to avoid accidents caused by faster speed when the observation distance is small.
  • the parameter information of the overlapping observation ranges of the first visual sensor and the second visual sensor may further include the observation distance, where the observation distance is related to the focal length information of the first visual sensor and the second visual sensor, and the first visual sensor and the second visual sensor.
  • the baseline distance between the two visual sensors is related. Specifically, the larger the focal length, the longer the observation distance; the longer the baseline distance, the longer the observation distance.
  • the observation distance can be determined by acquiring the focal length information and baseline distance information of the first visual sensor and the second visual sensor, and then the movement speed control amount of the movable platform can be adjusted. For example, when the observation distance is far, you can increase the limit of the movement speed, or allow the increase of the movement speed; when the observation distance is short, you can reduce the limit of the movement speed, or reduce the real-time movement speed.
  • the effective observation range of the movable platform is the field angle range corresponding to the overlapping observation range.
  • the movable platform can also be adjusted according to the observation requirements of the movable platform for the real-time scene in which it is located. The effective observation range of the platform, thereby reducing the observation blind spot of the movable platform.
  • the distance information of the object observed in the overlapping observation range may be determined according to the observation data of the first visual sensor and the observation data of the second visual sensor. For details on how to determine the distance information of the objects observed within the observation range, reference may be made to the foregoing description, and the description will not be repeated here. According to the determined distance information, the depth information of the current scene relative to the movable platform can be obtained, so as to determine the observation requirements of the movable platform for the real-time scene, and adjust the effective observation range of the movable platform according to this, That is, the overlapping observation range.
  • adjusting the overlapping observation range may be adjusting the focal length information of the first visual sensor and the second visual sensor according to the determined distance information. For example, when the determined distance is large, it can be determined that the current scene is far from the movable platform, that is, there is no risk of collision in the vicinity of the movable platform, so the first visual transmission can be adaptively increased.
  • the focal length of the second vision sensor so as to increase the observation distance of the movable platform, so that it can be observed more clearly in the distance; on the contrary, when the determined distance is small, it can be determined that the current scene is relatively close to the movable platform , that is, the adjacent area of the mobile platform is prone to collision, so the focal length of the first visual sensor and the second visual sensor can be adaptively reduced, thereby increasing the field of view of the first visual sensor and the second visual sensor, Further, the field of view angle corresponding to the overlapping observation range is increased, and the blind spot for observation of nearby objects is reduced.
  • adjusting the focal length of the first visual sensor and the second visual sensor may be adjusting the focal length of the first visual sensor and the focal length of the second visual sensor at the same time, or may choose one to adjust, or adjust the focal length of the first visual sensor.
  • the focal length and the focal length of the second vision sensor can be adjusted in different ranges.
  • the specific adjustment method can be configured according to the actual scene requirements.
  • Adjusting the overlapping observation range may also be adjusting the baseline distance information of the first vision sensor and the second vision sensor according to the determined distance information. Similar to the previous embodiment, when the determined distance is large, the baseline distance of the first visual sensor and the second visual sensor can be increased adaptively, thereby increasing the observation distance of the movable platform; When the determined distance is small, the baseline distance between the first visual sensor and the second visual sensor can be adaptively reduced, so that the observation dead zone between the first visual sensor and the second visual sensor can be reduced (refer to Fig. 2), to reduce the blind spot of observation for nearby objects.
  • the overlapping observation range can also be adjusted by simultaneously adjusting the focal length information of the first visual sensor and the second visual sensor, and the baseline distance information of the first visual sensor and the second visual sensor.
  • the focal length information of the first visual sensor and the second visual sensor can also be adjusted by simultaneously adjusting the focal length information of the first visual sensor and the second visual sensor, and the baseline distance information of the first visual sensor and the second visual sensor.
  • the determination as to whether the determined distance is larger may be that when the determined distance is greater than the preset first distance threshold, the determined distance is considered larger; or it may be determined between the first visual sensor and the second Vision sensor, when taking two photos at the same moment and from different angles, the position difference of the same scene in the two photos is small, for example, when it is less than the preset position difference threshold, it can be considered that the distance between the scene and the movable platform is relatively large. The distance results in a smaller parallax between the first vision sensor and the second vision sensor, so it can also be assumed that the determined distance is larger.
  • the determined distance is smaller than the second preset distance threshold (the second preset distance threshold is smaller than the first preset distance threshold), the determined distance is considered to be small. It can be understood that the determination method given above is only an example, and the technical personnel can choose the criterion for determining whether the distance belongs to a larger or smaller distance according to actual needs, which is not limited.
  • the mobile platform is taken as an example to introduce the drone. It can be understood that it is also applicable to other forms of mobile platforms.
  • the first thing that needs to be introduced is the installation of the first visual sensor and the second visual sensor on the drone. Since the drone usually flies in front of the fuselage, the first visual sensor and the second visual sensor on the drone can be side by side facing forward. Installed on the drone to sense the environmental conditions in front of the drone.
  • the drone shown in FIG. 3 includes a main camera 301 for capturing images, and a first visual sensor 302 and a second visual sensor 303 arranged side by side and facing forward for sensing environmental conditions.
  • the first direction in space may be in the horizontal direction, or it may be inclined downward at a certain angle, or inclined upward at a certain angle.
  • the movement speed limit of the drone in the first direction can be determined based on the observation distance of the overlapping observation range. Specifically, since the observation distance is actually determined by The focal length information of the first vision sensor, the second vision sensor, and the baseline distance information of the first vision sensor and the second vision sensor are determined, so the observation distance can be determined according to the focal length information and the baseline distance information, and then the UAV can be determined along the first The movement speed limit in one direction, and then based on the speed limit of the drone in the first direction, adjust the movement speed of the drone in the first direction, where if the drone moves in the first direction in real time If the speed is greater than the determined speed limit, it needs to be adjusted; if the real-time movement speed of the UAV in the first direction is not greater than the determined speed limit, it can be adjusted or not adjusted according to requirements.
  • the adjustment of the movement speed based on the movement speed limit may be to adjust the movement speed of the drone in the first direction to a specified value within the range of the determined speed limit, or to adjust the movement speed of the drone according to a preset reduction ratio.
  • the determined speed limit is reduced to determine a new movement speed.
  • the corresponding relationship between the observation distance and the movement speed limit can be obtained by engineering experiments, and can be pre-stored in the UAV or in the control terminal or server connected to the UAV, and called when needed.
  • the drone may change the motion trajectory by panning for shooting.
  • the motion speed of the drone may include the motion speed in the first direction, and the vertical For the movement speed in the first direction, the vertical direction of the first direction is recorded as the second direction, that is, the movement speed of the drone is actually composed of the movement speed in the first and second directions.
  • FIG. 4 is a top view of a drone flying in a horizontal direction.
  • the movement speed v1 in the vertical direction ie, the direction of the UAV's roll axis
  • the movement speed v2 in the horizontal upward direction ie, the direction of the UAV's pitch axis
  • the movement speed in the second direction, the movement speed v of the drone is composed of v1 and v2.
  • the movement speed limit in the vertical direction that is, the maximum value of v1
  • the actual movement speed v1 of the UAV can be adjusted based on this, and the horizontal field angle ⁇ corresponding to the overlapping observation range can be determined at the same time.
  • the movement speed limit in the direction that is, the maximum value of v2, specifically, can be passed through It is calculated so that the movement speed direction synthesized by the movement speed in the vertical direction and the movement speed limit in the horizontal direction is within the range of the field angle corresponding to the overlapping observation range, so that for the movement speed limit according to the horizontal direction
  • the direction of the movement speed v synthesized by the obtained movement speed v2 in the horizontal direction and the movement speed v1 in the vertical direction is within the range of the field angle corresponding to the overlapping observation range.
  • the second direction is not limited to the pitch axis direction of the UAV, it may be any direction under the premise of being perpendicular to the first direction, or may include multiple directions perpendicular to the first direction. It can be determined according to the actual movement direction of the drone. For example, if the drone wants to pan down while moving forward, the second direction can be the direction of the drone's pan axis; if the drone wants to pan down to the left while moving forward, the second direction can be the direction of the drone's pan axis. Can include pitch axis direction and pan axis direction. In any case, the principle thereof is the same as that of the above-mentioned embodiment, which will not be repeated here.
  • the UAV may change the motion trajectory by rotating, and specifically, the motion speed of the UAV may include the motion speed in the first direction, the angular speed on the yaw axis, and the angular speed on the pitch axis, That is, the movement speed of the UAV is actually composed of the movement speed in the first direction, the angular speed on the yaw axis and the angular speed on the pitch axis, so that the direction of the movement speed of the UAV is within the range of the field of view corresponding to the overlapping observation range.
  • the movement speed limit in the first direction it is also possible to further predict the direction of the movement speed of the UAV after a preset period of time, If the direction of the movement speed after the preset time exceeds the field of view range corresponding to the overlapping observation range, it can be determined that the instantaneous change of the movement speed of the current UAV is large, which is likely to occur after the UAV turns. Only the visual sensor perceives the information of the scene after the UAV turns, which can easily lead to accidents.
  • the angular velocity on the panning axis can be determined.
  • the limit amount, the angular velocity limit on the pitch axis, and the angular velocity on the pan axis and the angular velocity on the pitch axis are adjusted to the determined limit amount, so that the movement speed of the drone can be pointed at the Within the field of view corresponding to the overlapping observation range, it is ensured that the UAV can turn while sensing the scene to ensure the safety of the UAV.
  • the preset duration can be set according to requirements, for example, it can be set to 3s in some examples.
  • predicting the direction of the movement speed of the drone after the preset time period may be based on the adjusted movement speed of the drone in the first direction and the angular velocity on the heading axis and the pitch axis at the current moment.
  • the movement trajectory of the UAV within the duration is determined, and then the direction of the movement speed of the UAV after the preset duration is determined based on the preset obtained movement trajectory.
  • the drone may be diving or pitching in the forward direction.
  • the angular velocity on the yaw axis is 0.
  • the angular velocity on the yaw axis can be ignored, and only the movement speed in the first direction is considered.
  • the angular velocity on the pitch axis Predict with the angular velocity on the pitch axis; or maybe the drone is flying in the horizontal direction, at this time the angular velocity on the pitch axis is 0, the angular velocity on the pitch axis can be ignored, and only the movement in the first direction is considered
  • the velocity and angular velocity on the pan axis are predicted.
  • Figure 5 it is a schematic diagram of the predicted motion trajectory obtained when a UAV is flying in the horizontal direction. In the figure, since the end point of the predicted motion trajectory, the direction of the motion speed is corresponding to the overlapping observation range. Therefore, the angular velocity on the pan axis cannot be adjusted.
  • the angle between the direction of the movement speed of the UAV and the boundary of the field of view angle range corresponding to the overlapping observation range can also be limited to be no less than the preset first Angle margin, so that the safety of the UAV in flight can still be ensured under the condition of allowing the existence of system errors.
  • the first angle margin can be any preset angle, for example, it can be set to 5 degrees, and on this basis, the movement speed of the UAV in the second direction or the angular speed on the pan axis and the angular speed on the pitch axis are adjusted.
  • angular velocity according to the overlapping observation range, the left and right edges of the corresponding field of view are the field of view range after subtracting 5 degrees.
  • the field of view corresponding to the original overlapping observation range is 90 degrees
  • the field of view corresponding to the overlapping observation range becomes 80 degrees, and the direction of the movement speed of the UAV is adjusted to be within the field of view corresponding to the overlapping observation range at this time.
  • the specific process can be Referring to the introduction in the previous embodiment, details are not repeated here.
  • FIG. 6 is a flowchart of a control method for a movable platform according to an exemplary embodiment of the present application.
  • the movable platform includes a first A vision sensor and a second vision sensor, the first vision sensor and the second vision sensor have overlapping observation ranges, and the method includes:
  • S602 Adjust the movement speed control amount of the movable platform according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field of view angle range corresponding to the overlapping observation range .
  • the observation range of the movable platform is adjusted according to the scene information, so that it is more in line with the observation requirements of the movable platform for the current scene, the observation range is rationalized, and the observation blind area can be effectively reduced.
  • controlling the movement speed and direction of the movable platform within the observation range can ensure that the movable platform moves within the most reasonable observation range for the current scene, realize the accurate observation of the scene by the movable platform, minimize the observation blind area, and avoid Observe the safety hazards brought by blind spots.
  • An embodiment of the present application further provides a control device for a movable platform, the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping observation ranges.
  • FIG. 7 is a schematic diagram of a control device of a movable platform according to an exemplary embodiment of the present application, and the control device includes:
  • memory 702 for storing instructions executable by processor 701;
  • the processor 701 is configured to:
  • the movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
  • the processor 701 can also be configured to:
  • the parameter information includes a field of view angle corresponding to the overlapping observation ranges
  • the movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
  • the control device may also include other components necessary for normal operation according to its actual type.
  • the control device in the case where the control device is a processing chip or a mainboard integrated with the processing chip, it realizes the control function by being installed on the device, for example, installed on a movable platform or a control terminal.
  • the control device may also include a communication interface, It is used for data interaction with other devices on the device; in the case where the control device is an electronic device, the control device may also include, for example, an input/output interface, a communication interface, a bus, etc., and the input/output interface can be used to connect the input /Output module to realize information input and output.
  • the input/output/module can be configured in the electronic device as a component (not shown in the figure), or can be externally connected to the device to provide corresponding functions.
  • Input devices may include keyboards, mice, touch screens, microphones, various types of sensors, etc.
  • output devices may include displays, speakers, vibrators, indicator lights, and the like.
  • the communication interface is used to connect a communication module (not shown in the figure) to realize communication interaction between the electronic device and other devices.
  • the communication module may implement communication through wired means (eg, USB, network cable, etc.), or may implement communication through wireless means (eg, mobile network, WIFI, Bluetooth, etc.).
  • a bus includes a path that transfers information between various components of an electronic device, such as the processor, memory, input/output interfaces, and communication interfaces.
  • FIG. 8 is a schematic diagram of a movable platform shown in an exemplary embodiment of the present application.
  • the movable platform includes:
  • the first visual sensor 810 and the second visual sensor 820 have overlapping observation ranges
  • Fuselage 830 wherein fuselage 830 includes:
  • memory 832 for storing instructions executable by processor 831
  • the processor 831 is configured to:
  • the movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
  • the processor 831 can also be configured to:
  • the parameter information includes a field of view angle corresponding to the overlapping observation ranges
  • the movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
  • the embodiments of the present application further provide a computer storage medium, on which a computer program is stored, and when the computer program is executed, the method described in any of the foregoing embodiments is implemented.
  • a computer storage medium on which a computer program is stored, and when the computer program is executed, the method described in any of the foregoing embodiments is implemented.
  • the apparatus embodiments since they basically correspond to the method embodiments, reference may be made to the partial descriptions of the method embodiments for related parts.
  • the device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.
  • All the embodiments given in this application may be implemented in whole or in part by software, hardware, firmware or any combination thereof.
  • software When implemented in software, it can be implemented in whole or in part in the form of a computer program product.
  • a computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions according to the embodiments of the present application are generated in whole or in part.
  • the computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • Computer instructions may be stored in or transmitted over a computer-readable storage medium.
  • Computer instructions may be sent from one website site, computer, server, or data center to another website site, computer, by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wirelessly (eg, infrared, wireless, microwave, etc.) , server or data center for transmission.
  • a computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, a data center, or the like that includes an integration of one or more available media.
  • Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Multimedia (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Automation & Control Theory (AREA)
  • Studio Devices (AREA)

Abstract

A control method and control device for a movable platform, and a movable platform. The movable platform comprises a first visual sensor (201, 302, 810) and a second visual sensor (202, 303, 820), the first visual sensor (201, 302, 810) and the second visual sensor (202, 303, 820) having an overlapping observation range. Said method comprises: acquiring focal length information of the first visual sensor (201, 302, 810) and the second visual sensor (202, 303, 820) (S101); and adjusting the movement speed control amount of the movable platform according to the focal length information, so that the direction of the movement speed of the movable platform is within the field of view angle range corresponding to the overlapping observation range (S102). The security of a movable platform in a moving process is ensured.

Description

一种可移动平台的控制方法、装置及可移动平台Control method and device for movable platform and movable platform 技术领域technical field
本申请涉及自动控制领域,尤其涉及一种可移动平台的控制方法、可移动平台的控制装置以及可移动平台。The present application relates to the field of automatic control, and in particular, to a control method for a movable platform, a control device for a movable platform, and a movable platform.
背景技术Background technique
为了确保可移动平台使用过程中的安全避免受损,通常可以在可移动平台上配备用于感知周围环境的视觉传感器,避免可移动平台撞上障碍物。In order to ensure the safety of the movable platform and avoid damage during use, the movable platform can usually be equipped with a visual sensor for sensing the surrounding environment to prevent the movable platform from hitting obstacles.
例如现有的无人机系统为了安全飞行,都配有基于机器视觉的多目(多摄像头)视觉感知模块,用于无人机感知周围环境,从而辅助控制者安全飞行。For example, in order to fly safely, the existing UAV systems are equipped with a multi-eye (multi-camera) visual perception module based on machine vision, which is used for the UAV to perceive the surrounding environment, thereby assisting the controller to fly safely.
发明内容SUMMARY OF THE INVENTION
第一方面,本申请实施例提供一种可移动平台的控制方法,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,所述方法包括:In a first aspect, an embodiment of the present application provides a control method for a movable platform, the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping The scope of observation, the method includes:
获取所述第一视觉传感器和所述第二视觉传感器的焦距信息;acquiring focal length information of the first vision sensor and the second vision sensor;
根据所述焦距信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
第二方面,本申请实施例提供一种可移动平台的控制方法,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,所述方法包括:In a second aspect, embodiments of the present application provide a control method for a movable platform, where the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping The scope of observation, the method includes:
获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的 参数信息,所述参数信息包括所述重叠观测范围对应的视场角;Acquiring parameter information of overlapping observation ranges of the first vision sensor and the second vision sensor, where the parameter information includes a field of view angle corresponding to the overlapping observation ranges;
根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
第三方面,本申请实施例提供一种可移动平台的控制装置,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器具有重叠观测范围,所述控制装置包括:In a third aspect, embodiments of the present application provide a control device for a movable platform, where the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping observations scope, the control device includes:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
所述处理器被配置为:The processor is configured to:
获取所述第一视觉传感器和所述第二视觉传感器的焦距信息;acquiring focal length information of the first vision sensor and the second vision sensor;
根据所述焦距信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
第四方面,本申请实施例提供一种可移动平台的控制装置,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,所述控制装置包括:In a fourth aspect, an embodiment of the present application provides a control device for a movable platform, the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping Observation range, the control device includes:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
所述处理器被配置为:The processor is configured to:
获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的参数信息,所述参数信息包括所述重叠观测范围对应的视场角;acquiring parameter information of overlapping observation ranges of the first vision sensor and the second vision sensor, where the parameter information includes a field of view angle corresponding to the overlapping observation ranges;
根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范 围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
第五方面,本申请实施例提供一种可移动平台,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,所述可移动平台还包括:In a fifth aspect, an embodiment of the present application provides a movable platform, the movable platform includes a first vision sensor and a second vision sensor, and the first vision sensor and the second vision sensor have overlapping observation ranges, The movable platform also includes:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
所述处理器被配置为:The processor is configured to:
获取所述第一视觉传感器和所述第二视觉传感器的焦距信息;acquiring focal length information of the first vision sensor and the second vision sensor;
根据所述焦距信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
第六方面,本申请实施例提供一种可移动平台,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,所述可移动平台还包括:In a sixth aspect, an embodiment of the present application provides a movable platform, the movable platform includes a first vision sensor and a second vision sensor, and the first vision sensor and the second vision sensor have overlapping observation ranges, The movable platform also includes:
处理器;processor;
用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
所述处理器被配置为:The processor is configured to:
获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的参数信息,所述参数信息包括所述重叠观测范围对应的视场角;acquiring parameter information of overlapping observation ranges of the first vision sensor and the second vision sensor, where the parameter information includes a field of view angle corresponding to the overlapping observation ranges;
根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
本申请实施例根据对实际场景的实时观测范围,将可移动平台控制在观测范围内运动,避免观测盲区带来的安全风险,确保可移动平台处于 安全的运动状态。According to the real-time observation range of the actual scene, the embodiment of the present application controls the movable platform to move within the observation range, avoids the safety risk brought by the observation blind spot, and ensures that the movable platform is in a safe motion state.
附图说明Description of drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings that are used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative labor.
图1是本申请一示例性实施例示出的一种可移动平台的控制方法流程图。FIG. 1 is a flowchart of a control method of a mobile platform according to an exemplary embodiment of the present application.
图2是本申请一示例性实施例示出的一种第一视觉传感器与第二视觉传感器的重叠观测范围的示意图。FIG. 2 is a schematic diagram of an overlapping observation range of a first visual sensor and a second visual sensor according to an exemplary embodiment of the present application.
图3是本申请一示例性实施例示出的一种无人机的示意图。FIG. 3 is a schematic diagram of an unmanned aerial vehicle according to an exemplary embodiment of the present application.
图4是本申请一示例性实施例示出一种在水平方向上飞行的无人机的俯视图。FIG. 4 is a top view showing an unmanned aerial vehicle flying in a horizontal direction according to an exemplary embodiment of the present application.
图5是本申请一示例性实施例示出一种无人机在水平方向上飞行的情况下预测所得的运动轨迹的示意图。FIG. 5 is a schematic diagram illustrating a predicted motion trajectory obtained when an unmanned aerial vehicle flies in a horizontal direction according to an exemplary embodiment of the present application.
图6是本申请一示例性实施例示出的另一种可移动平台的控制方法流程图。FIG. 6 is a flowchart of another method for controlling a movable platform according to an exemplary embodiment of the present application.
图7是本申请一示例性实施例示出的一种可移动平台的控制装置示意图。FIG. 7 is a schematic diagram of a control device of a movable platform according to an exemplary embodiment of the present application.
图8是本申请一示例性实施例示出的一种可移动平台示意图。FIG. 8 is a schematic diagram of a movable platform according to an exemplary embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案 进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
本申请实施例提供一种可移动平台的控制方法,作为改进,可以根据对实际场景的实时观测范围,将可移动平台控制在观测范围内运动,以确保可移动平台处于安全的运动状态。The embodiment of the present application provides a control method for a movable platform. As an improvement, the movable platform can be controlled to move within the observation range according to the real-time observation range of the actual scene, so as to ensure that the movable platform is in a safe motion state.
本申请实施例中可移动平台可以是无人机、无人车、无人船、机器人等,所述的控制方法可以由可移动平台中搭载的处理器或处理芯片来实现,由可移动平台自动进行运动状态调整;或者,由于用户可以通过操纵与可移动平台通信连接的控制终端,来控制可移动平台的运动,因此在可能的情况下,也可以是由控制终端通过与可移动平台之间的信息交互获取可移动平台的状态信息,并自动对可移动平台的运动状态进行调整;当然,还可以由控制终端输出显示可移动平台的实时运动状态的相关参数,以及可移动平台搭载的相机或视觉传感器所拍摄回传的画面,同时根据用户输入的指令来控制可移动平台的运动。其中,控制终端可以是移动终端,例如手持遥控器、手机、平板、笔记本电脑等;也可以是固定终端,例如台式电脑、服务器等。In the embodiments of the present application, the movable platform may be an unmanned aerial vehicle, an unmanned vehicle, an unmanned ship, a robot, etc. The control method may be implemented by a processor or a processing chip carried in the movable platform, and the movable platform Automatically adjust the movement state; or, since the user can control the movement of the movable platform by manipulating the control terminal that is communicatively connected to the movable platform, if possible, the control terminal can also control the movement of the movable platform by communicating with the movable platform. The information exchange between the mobile platform obtains the state information of the movable platform, and automatically adjusts the motion state of the movable platform; of course, the control terminal can also output the relevant parameters showing the real-time motion state of the movable platform, and the The picture captured by the camera or the visual sensor is returned, and the movement of the movable platform is controlled according to the instructions input by the user. The control terminal may be a mobile terminal, such as a handheld remote control, a mobile phone, a tablet, a notebook computer, etc.; or a fixed terminal, such as a desktop computer, a server, and the like.
下面将展开介绍本申请实施例提供的可移动平台的控制方法,参照图1,图1是本申请一示例性实施例示出的一种可移动平台的控制方法流程图,其中可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器具有重叠观测范围,所述控制方法包括:The control method of the movable platform provided by the embodiment of the present application will be introduced below. Referring to FIG. 1, FIG. 1 is a flowchart of a control method of a movable platform according to an exemplary embodiment of the present application, wherein the movable platform includes the first control method. A visual sensor and a second visual sensor, the first visual sensor and the second visual sensor have overlapping observation ranges, and the control method includes:
S101,获取所述第一视觉传感器和所述第二视觉传感器的焦距信息;S101, acquiring focal length information of the first visual sensor and the second visual sensor;
S102,根据所述焦距信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场 角范围内。S102: Adjust the movement speed control amount of the movable platform according to the focal length information, so that the direction of the movement speed of the movable platform is within the field of view angle range corresponding to the overlapping observation range.
其中重叠观测范围可以是用户有感知的观测范围,例如可以是可移动平台将第一视觉传感器、第二视觉传感器的重叠观测范围发送到用户持有的控制终端供用户查看。当然,也可以是用户无感知的观测范围。The overlapping observation range may be the observation range that the user perceives, for example, the movable platform may send the overlapping observation range of the first visual sensor and the second visual sensor to the control terminal held by the user for the user to view. Of course, it may also be an observation range that the user does not perceive.
第一视觉传感器和第二视觉传感器可以是摄像头,对于第一视觉传感器和第二视觉传感器的重叠观测范围内所观测到的场景,可以通过第一视觉传感器与第二视觉传感之间的观测视差来推算场景相对于可移动平台的距离,具体的,可以是通过第一视觉传感器和第二视觉传感器,拍摄同一时刻,不同角度的两张照片,再通过两张照片中相同的场景的位置差异,以及第一视觉传感器和第二视觉传感器之间的位置、角度关系,利用三角关系,计算出场景与第一、第二视觉传感器的距离关系,由此得到场景相对于可移动平台的距离信息。因此实际上可移动平台的有效观测范围主要是第一视觉传感器与第二视觉传感器的重叠观测范围,为确保可移动平台运动过程中的安全,如果能够将可移动平台的运动方向控制在上述重叠观测范围对应的视场角范围内,则可以有效地减小观测盲区带来的安全隐患。如图2所示,为本申请一示例性实施例示出的一种第一视觉传感器与第二视觉传感器的重叠观测范围的示意图。为使表述简洁,下面将直接用“重叠观测范围”表示第一视觉传感器与第二视觉传感器的重叠观测范围,可以理解,除非特殊说明,否则下文所出现的重叠观测范围均指第一视觉传感器与第二视觉传感器的重叠观测范围。The first visual sensor and the second visual sensor may be cameras, and for the scene observed within the overlapping observation range of the first visual sensor and the second visual sensor, the observation between the first visual sensor and the second visual sensor may be used. Parallax is used to calculate the distance of the scene relative to the movable platform. Specifically, the first visual sensor and the second visual sensor can be used to take two photos at the same time and from different angles, and then use the position of the same scene in the two photos. Differences, as well as the position and angle relationship between the first visual sensor and the second visual sensor, use the triangular relationship to calculate the distance relationship between the scene and the first and second visual sensors, thereby obtaining the distance of the scene relative to the movable platform information. Therefore, in fact, the effective observation range of the movable platform is mainly the overlapping observation range of the first visual sensor and the second visual sensor. Within the range of the field of view corresponding to the observation range, the safety hazard caused by the observation blind spot can be effectively reduced. As shown in FIG. 2 , it is a schematic diagram of an overlapping observation range of a first visual sensor and a second visual sensor according to an exemplary embodiment of the present application. In order to make the expression concise, “overlapping observation range” will be directly used below to represent the overlapping observation range of the first visual sensor and the second visual sensor. It can be understood that, unless otherwise specified, the overlapping observation range that appears below refers to the first visual sensor. Overlapping viewing range with the second vision sensor.
为将可移动平台的运动方向控制在重叠观测范围对应的视场角范围内,首先获取重叠观测范围的参数信息,其中该参数信息可以包括重叠观测范围对应的视场角范围。根据所获取的视场角范围调整可移动平台的速度控制量,来使得可移动平台的运动速度的指向处于重叠观测范围对应的视场角范围内。其中可移动平台的速度控制量可以是可移动平台的运动速度,可以通过直接调整可移动平台的运动速度将其限制在重叠观测范围对 应的视场角范围内;可移动平台的速度控制量也可以是可移动平台的运动速度的限制量,其中运动速度的限制量可以是最大运动速度或者最小运动速度,或者是指定的运动速度。可以基于初始的重叠范围对应的视场角范围预先设定可移动平台运动速度的限制量,再基于实时的视场角范围变化对该运动速度限制量进行调整,根据调整后的该运动速度的限制量来调整可移动平台的运动速度,以将可移动平台的运动速度限制在重叠观测范围对应的视场角范围内。In order to control the moving direction of the movable platform within the field of view angle range corresponding to the overlapped observation range, first obtain parameter information of the overlapped observation range, where the parameter information may include the field of view angle range corresponding to the overlapped observation range. The speed control amount of the movable platform is adjusted according to the acquired field of view angle range, so that the direction of the movement speed of the movable platform is within the field of view angle range corresponding to the overlapping observation range. The speed control amount of the movable platform can be the movement speed of the movable platform, which can be limited to the field of view angle corresponding to the overlapping observation range by directly adjusting the movement speed of the movable platform; the speed control amount of the movable platform is also It can be the limit amount of the movement speed of the movable platform, wherein the limit amount of the movement speed can be the maximum movement speed or the minimum movement speed, or the specified movement speed. The movement speed limit of the movable platform can be preset based on the field of view angle range corresponding to the initial overlap range, and then the movement speed limit amount can be adjusted based on the real-time change of the field of view angle range. The movement speed of the movable platform is adjusted by the limit amount, so as to limit the movement speed of the movable platform within the range of the field of view corresponding to the overlapping observation range.
对于重叠范围对应的视场角范围,可以通过第一视觉传感器和第二视觉传感器的焦距信息获取,其中焦距信息可以是第一视觉传感器和第二视觉传感器的焦距,可以通过第一视觉传感器和第二视觉传感器的焦距确定重叠观测范围对应的视场角。具体的,依旧参照图2进行说明。The field angle range corresponding to the overlapping range can be obtained through the focal length information of the first visual sensor and the second visual sensor, where the focal length information can be the focal length of the first visual sensor and the second visual sensor, which can be obtained through the first visual sensor and the second visual sensor. The focal length of the second visual sensor determines the field of view angle corresponding to the overlapping observation range. Specifically, the description is still made with reference to FIG. 2 .
为更形象地说明第一视觉传感器201、第二视觉传感器202的焦距与视场角的关系,在图2中以倒三角形状来表示第一视觉传感器201、第二视觉传感器202。由图2可以看出,无论是对于第一视觉传感器201,还是第二视觉传感器202,其焦距f与视场角FoV成反相关的关系,即在焦距f增大时对应的视场角FoV将减小。In order to describe the relationship between the focal length and the field angle of the first visual sensor 201 and the second visual sensor 202 more vividly, the first visual sensor 201 and the second visual sensor 202 are represented by an inverted triangle shape in FIG. 2 . It can be seen from FIG. 2 that, whether for the first visual sensor 201 or the second visual sensor 202, the focal length f is inversely correlated with the field of view angle FoV, that is, the corresponding field of view angle FoV when the focal length f increases will decrease.
因此可以预先标定第一视觉传感器201、第二视觉传感器202的焦距值所对应的视场角,从而在获取第一视觉传感器的焦距,以及第二视觉传感器的焦距值时,可以根据第一视觉传感器的焦距值,以及第二视觉传感器的焦距值,来确定出第一视觉传感器的视场角和第二视觉传感器的视场角,并可以进一步得到第一视觉传感器和第二视觉传感器的重叠观测范围对应的视场角范围。Therefore, the angle of view corresponding to the focal length values of the first visual sensor 201 and the second visual sensor 202 can be pre-calibrated, so that when acquiring the focal length of the first visual sensor and the focal length value of the second visual sensor, the The focal length value of the sensor and the focal length value of the second visual sensor are used to determine the field of view angle of the first visual sensor and the field of view of the second visual sensor, and can further obtain the overlap of the first visual sensor and the second visual sensor. The field of view range corresponding to the observation range.
考虑到在实际应用的过程中,焦距变化较小时,对应的视场角变化也较小,因此可以不必对第一视觉传感器、第二视觉传感器的所有焦距值进行标定,可以只将常用的一些焦距值对应的视场角进行标定,从而在变焦至未标定的焦距时可以参照与其相近的常用焦距值对应的视场角。由此 可以减少标定时冗余的计算量以及数据存储的占用。Considering that in the process of practical application, when the change of focal length is small, the corresponding change of the field of view is also small, so it is not necessary to calibrate all the focal length values of the first vision sensor and the second vision sensor. The field of view angle corresponding to the focal length value is calibrated, so that when zooming to an uncalibrated focal length, the field of view angle corresponding to the common focal length value close to it can be referred to. Thereby, the redundant calculation amount and the occupation of data storage during calibration can be reduced.
进一步的,还可以配置多种焦距模式,例如长焦模式、中焦模式、短焦模式等,并将各焦距模式下采用的焦距值对应设定为已标定的常用焦距值。在此基础上,第一视觉传感器、第二视觉传感器的焦距信息还可以是第一视觉传感器、第二视觉传感器的焦距模式,通过获取第一视觉传感器、第二视觉传感器当前的焦距模式,同样可以确定重叠观测范围对应的视场角范围。Further, multiple focal length modes can also be configured, such as a telephoto mode, a medium focal length mode, a short focal length mode, etc., and the focal length values used in each focal length mode are correspondingly set as the calibrated common focal length values. On this basis, the focal length information of the first visual sensor and the second visual sensor may also be the focal length mode of the first visual sensor and the second visual sensor. By acquiring the current focal length mode of the first visual sensor and the second visual sensor, the same The field angle range corresponding to the overlapping observation range can be determined.
除此之外,由于焦距与视场角相关,因此第一视觉传感器、第二视觉传感器的焦距信息还可以是第一视觉传感器、第二视觉传感器的视场角,通过直接获取第一视觉传感器、第二视觉传感器的视场角来确定重叠观测范围对应的视场角范围,并调整可移动平台的运动速度控制量,使可移动平台的运动速度的指向处于重叠观测范围对应的视场角范围内。In addition, since the focal length is related to the angle of view, the focal length information of the first visual sensor and the second visual sensor can also be the angle of view of the first visual sensor and the second visual sensor. By directly obtaining the first visual sensor , the field of view angle of the second visual sensor to determine the field of view angle corresponding to the overlapping observation range, and adjust the movement speed control amount of the movable platform, so that the direction of the movement speed of the movable platform is in the field of view corresponding to the overlapping observation range. within the range.
另外,重叠观测范围对应的视场角范围除了与第一视觉传感器、第二视觉传感器的焦距信息有关,同时还与第一视觉传感器、第二视觉传感器的基线距离有关,可以继续参照图2,由图2可以看出,在第一视觉传感器201、第二视觉传感器202之间的基线距离b的长度变化时,相应的重叠观测范围对应的视场角的范围也发生变化。因此在一个实施例中,还可以获取第一视觉传感器、第二视觉传感器的基线距离,并根据该基线距离信息和前面所提到的焦距信息,来确定重叠观测范围对应的视场角范围,并调整可移动平台的运动速度控制量,使可移动平台的运动速度的指向处于重叠观测范围对应的视场角范围内。In addition, the field angle range corresponding to the overlapping observation range is not only related to the focal length information of the first visual sensor and the second visual sensor, but also related to the baseline distance of the first visual sensor and the second visual sensor. It can be seen from FIG. 2 that when the length of the baseline distance b between the first visual sensor 201 and the second visual sensor 202 changes, the range of the field of view angle corresponding to the corresponding overlapping observation range also changes. Therefore, in one embodiment, the baseline distances of the first visual sensor and the second visual sensor can also be obtained, and according to the baseline distance information and the aforementioned focal length information, the field angle range corresponding to the overlapping observation range can be determined, And adjust the movement speed control amount of the movable platform, so that the direction of the movement speed of the movable platform is within the range of the field angle corresponding to the overlapping observation range.
为进一步地确保可移动平台的安全,还可以根据第一视觉传感器、第二视觉传感器的观测距离来调整可移动平台的运动速度控制量,避免在观测距离较小时出现速度较快导致事故的发生。基于此,第一视觉传感器、第二视觉传感器的重叠观测范围的参数信息还可以包括观测距离,其中,观测距离与第一视觉传感器、第二视觉传感器的焦距信息,以及第一视觉 传感器、第二视觉传感器之间的基线距离相关,具体的,焦距越大,观测距离越远;基线距离越长,观测距离越远。因此可以通过获取第一视觉传感器、第二视觉传感器的焦距信息以及基线距离信息来确定观测距离,进而调整可移动平台的运动速度控制量。例如在观测距离较远时,可以调大运动速度的限制量,或者允许运动速度的增大;在观测距离较近时,调小运动速度的限制量,或者减小实时的运动速度。In order to further ensure the safety of the movable platform, the movement speed control amount of the movable platform can also be adjusted according to the observation distance of the first visual sensor and the second visual sensor, so as to avoid accidents caused by faster speed when the observation distance is small. . Based on this, the parameter information of the overlapping observation ranges of the first visual sensor and the second visual sensor may further include the observation distance, where the observation distance is related to the focal length information of the first visual sensor and the second visual sensor, and the first visual sensor and the second visual sensor. The baseline distance between the two visual sensors is related. Specifically, the larger the focal length, the longer the observation distance; the longer the baseline distance, the longer the observation distance. Therefore, the observation distance can be determined by acquiring the focal length information and baseline distance information of the first visual sensor and the second visual sensor, and then the movement speed control amount of the movable platform can be adjusted. For example, when the observation distance is far, you can increase the limit of the movement speed, or allow the increase of the movement speed; when the observation distance is short, you can reduce the limit of the movement speed, or reduce the real-time movement speed.
由前面实施例的分析可以知道,可移动平台的有效观测范围为重叠观测范围对应的视场角范围。为了减小观测盲区带来的安全隐患,除了将可移动平台的运动控制在重叠观测范围对应的视场角范围内,还可以根据可移动平台对所处的实时场景的观测需求来调整可移动平台的有效观测范围,从而减小可移动平台的观测盲区。It can be known from the analysis of the previous embodiment that the effective observation range of the movable platform is the field angle range corresponding to the overlapping observation range. In order to reduce the safety hazard caused by the observation blind spot, in addition to controlling the movement of the movable platform within the range of the field of view corresponding to the overlapping observation range, the movable platform can also be adjusted according to the observation requirements of the movable platform for the real-time scene in which it is located. The effective observation range of the platform, thereby reducing the observation blind spot of the movable platform.
在一个实施例中,可以根据第一视觉传感器的观测数据和第二视觉传感器的观测数据,来确定重叠观测范围内观测的对象的距离信息。其中对于具体如何确定观测范围内观测的对象的距离信息可以参照前文介绍,此处不再重复介绍。根据所确定出的距离信息,可以获取到当前场景相对于可移动平台的深度信息,从而确定可移动平台对所述的实时场景的观测需求,并依据此来调整可移动平台的有效观测范围,即重叠观测范围。In one embodiment, the distance information of the object observed in the overlapping observation range may be determined according to the observation data of the first visual sensor and the observation data of the second visual sensor. For details on how to determine the distance information of the objects observed within the observation range, reference may be made to the foregoing description, and the description will not be repeated here. According to the determined distance information, the depth information of the current scene relative to the movable platform can be obtained, so as to determine the observation requirements of the movable platform for the real-time scene, and adjust the effective observation range of the movable platform according to this, That is, the overlapping observation range.
其中调整重叠观测范围可以是,根据所确定出的距离信息调整第一视觉传感器和第二视觉传感器的焦距信息。例如,在所确定出的距离较大时,可以确定当前场景相对于可移动平台较远,即可移动平台的临近区域并不存在发生碰撞的风险,因此可以适应性地增大第一视觉传感、第二视觉传感器的焦距,从而增大可移动平台的观测距离,使其观测远处时可以更加清晰;反之在所确定出的距离较小时,可以确定当前场景相对于可移动平台较近,即可移动平台的临近区域容易发生碰撞,因此可以适应性地减小第一视觉传感、第二视觉传感器的焦距,从而增大第一视觉传感、第二视觉传感器的视场角,进而增大重叠观测范围对应的视场角,减小对于 近处物体的观测盲区。需要说明的是,调整第一视觉传感器、第二视觉传感器的焦距可以是同时调整第一视觉传感器的焦距和第二视觉传感器的焦距,也可以是择一进行调整,或者对第一视觉传感器的焦距和第二视觉传感器的焦距进行不同幅度的调整,具体如何调整,可以根据实际场景需求配置。Wherein, adjusting the overlapping observation range may be adjusting the focal length information of the first visual sensor and the second visual sensor according to the determined distance information. For example, when the determined distance is large, it can be determined that the current scene is far from the movable platform, that is, there is no risk of collision in the vicinity of the movable platform, so the first visual transmission can be adaptively increased. sense, the focal length of the second vision sensor, so as to increase the observation distance of the movable platform, so that it can be observed more clearly in the distance; on the contrary, when the determined distance is small, it can be determined that the current scene is relatively close to the movable platform , that is, the adjacent area of the mobile platform is prone to collision, so the focal length of the first visual sensor and the second visual sensor can be adaptively reduced, thereby increasing the field of view of the first visual sensor and the second visual sensor, Further, the field of view angle corresponding to the overlapping observation range is increased, and the blind spot for observation of nearby objects is reduced. It should be noted that adjusting the focal length of the first visual sensor and the second visual sensor may be adjusting the focal length of the first visual sensor and the focal length of the second visual sensor at the same time, or may choose one to adjust, or adjust the focal length of the first visual sensor. The focal length and the focal length of the second vision sensor can be adjusted in different ranges. The specific adjustment method can be configured according to the actual scene requirements.
调整重叠观测范围还可以是,根据所确定出的距离信息调整第一视觉传感器和第二视觉传感器的基线距离信息。与前面实施例类似的,在所确定出的距离较大时,可以适应性地增大第一视觉传感和第二视觉传感器的基线距离,从而增大可移动平台的观测距离;反之在所确定出的距离较小时,可以适应性地减小第一视觉传感和第二视觉传感器的基线距离,从而可以减小第一视觉传感器和第二视觉传感器之间的观测死区(可以参照图2中S区域),实现减小对于近处物体的观测盲区。Adjusting the overlapping observation range may also be adjusting the baseline distance information of the first vision sensor and the second vision sensor according to the determined distance information. Similar to the previous embodiment, when the determined distance is large, the baseline distance of the first visual sensor and the second visual sensor can be increased adaptively, thereby increasing the observation distance of the movable platform; When the determined distance is small, the baseline distance between the first visual sensor and the second visual sensor can be adaptively reduced, so that the observation dead zone between the first visual sensor and the second visual sensor can be reduced (refer to Fig. 2), to reduce the blind spot of observation for nearby objects.
除此之外,还可以通过同时调整第一视觉传感器、第二视觉传感器的焦距信息,以及第一视觉传感器和第二视觉传感器的基线距离信息,来调整重叠观测范围,具体可以参照前面实施例所述,在此不再赘述。In addition, the overlapping observation range can also be adjusted by simultaneously adjusting the focal length information of the first visual sensor and the second visual sensor, and the baseline distance information of the first visual sensor and the second visual sensor. For details, please refer to the previous embodiment. described, and will not be repeated here.
需要说明,对于所确定出的距离是否较大的判定可以是,在所确定出的距离大于预设第一距离阈值时认为所确定的距离较大;或者可以是在第一视觉传感器和第二视觉传感器,拍摄同一时刻,不同角度的两张照片时,两张照片中相同的场景的位置差异较小,例如小于预设位置差异阈值时,可以认为此时由于场景相对于可移动平台距离较远导致第一视觉传感器和第二视觉传感器的视差较小,因此也可以认定所确定的距离较大。同理在所确定出的距离小于第二预设距离阈值(第二预设距离阈值小于第一预设距离阈值)时认为所确定的距离较小。可以理解,以上所给出的判定方式仅为示例性的,技术人员可以根据实际需求自行选择判定距离是否属于较大或较小的标准,对此不做限定。It should be noted that the determination as to whether the determined distance is larger may be that when the determined distance is greater than the preset first distance threshold, the determined distance is considered larger; or it may be determined between the first visual sensor and the second Vision sensor, when taking two photos at the same moment and from different angles, the position difference of the same scene in the two photos is small, for example, when it is less than the preset position difference threshold, it can be considered that the distance between the scene and the movable platform is relatively large. The distance results in a smaller parallax between the first vision sensor and the second vision sensor, so it can also be assumed that the determined distance is larger. Similarly, when the determined distance is smaller than the second preset distance threshold (the second preset distance threshold is smaller than the first preset distance threshold), the determined distance is considered to be small. It can be understood that the determination method given above is only an example, and the technical personnel can choose the criterion for determining whether the distance belongs to a larger or smaller distance according to actual needs, which is not limited.
基于场景相对可移动平台的深度来调整第一视觉传感器、第二视觉 传感器的焦距信息,或者调整第一视觉传感器和第二视觉传感器的基线距离信息,实现调整重叠观测范围的参数信息,使得可移动平台的有效观测范围更加符合场景的需求,可以有效地减小可移动平台的观测盲区。Adjust the focal length information of the first vision sensor and the second vision sensor, or adjust the baseline distance information of the first vision sensor and the second vision sensor based on the depth of the scene relative to the movable platform, so as to adjust the parameter information of the overlapping observation range, so that the The effective observation range of the mobile platform is more in line with the needs of the scene, which can effectively reduce the observation blind spot of the mobile platform.
下面将进一步介绍在获取调整后的重叠观测范围的参数信息后,根据可移动平台不同的运动方式,具体如何调整可移动平台的运动速度控制量。为了方便说明,以可移动平台为无人机作为例子展开介绍,可以理解,对于其他形式的可移动平台同样适用。The following will further describe how to adjust the movement speed control amount of the movable platform according to different movement modes of the movable platform after obtaining the parameter information of the adjusted overlapping observation range. For the convenience of description, the mobile platform is taken as an example to introduce the drone. It can be understood that it is also applicable to other forms of mobile platforms.
首先需要介绍的是无人机上第一视觉传感器、第二视觉传感器的安装,由于无人机通常是朝机身前方飞行,因此无人机上第一视觉传感器、第二视觉传感器可以是并排朝前安装于无人机上,用于感知无人机前方的环境状况。例如如图3所示的无人机,其中包括了用于采集图像的主摄像头301,以及并排朝前设置的用于感知环境状况的第一视觉传感器302、第二视觉传感器303。The first thing that needs to be introduced is the installation of the first visual sensor and the second visual sensor on the drone. Since the drone usually flies in front of the fuselage, the first visual sensor and the second visual sensor on the drone can be side by side facing forward. Installed on the drone to sense the environmental conditions in front of the drone. For example, the drone shown in FIG. 3 includes a main camera 301 for capturing images, and a first visual sensor 302 and a second visual sensor 303 arranged side by side and facing forward for sensing environmental conditions.
为确保无人机朝前方飞行的安全,对于搭载第一视觉传感器、第二视觉传感器的无人机,首先需要根据重叠观测范围的参数信息调整无人机在前向方向上的运动速度控制量,其中该前向方向垂直于第一视觉传感器和第二视觉传感器的基线延伸方向,记该前向方向为第一方向。根据无人机飞行过程中俯仰角的不同,第一方向在空间中可能是在水平方向上,也可能是向下倾斜一定角度,或者是向上倾斜一定角度。In order to ensure the safety of the UAV flying forward, for the UAV equipped with the first visual sensor and the second visual sensor, it is first necessary to adjust the movement speed control amount of the UAV in the forward direction according to the parameter information of the overlapping observation range. , wherein the forward direction is perpendicular to the extension direction of the baselines of the first visual sensor and the second visual sensor, and the forward direction is denoted as the first direction. According to the different pitch angles during the flight of the drone, the first direction in space may be in the horizontal direction, or it may be inclined downward at a certain angle, or inclined upward at a certain angle.
对于无人机在第一方向上的运动速度控制量的调整,可以是基于重叠观测范围的观测距离确定无人机沿第一方向上的运动速度限制量,具体的,由于观测距离实际上由第一视觉传感器、第二视觉传感器的焦距信息,以及第一视觉传感器和第二视觉传感器的基线距离信息确定,因此可以根据焦距信息和基线距离信息来确定观测距离,进而确定无人机沿第一方向上的运动速度限制量,再基于无人机沿第一方向上的速度限制量,调整无人机沿第一方向上的运动速度,其中如果无人机实时沿第一方向上的运动 速度大于所确定的速度限制量,则需要对其进行调整;如果无人机实时沿第一方向上的运动速度不大于所确定的速度限制量,则可以根据需求选择调整或不调整。而基于运动速度限制量对运动速度的调整,可以是将无人机沿第一方向上的运动速度调整为所确定的速度限制量的范围内的指定值,或者是按照预设缩小比例对所确定的速度限制量进行缩小来确定出新的运动速度。当然,并不限于以上所述的方式,技术人员可以根据需求选择。For the adjustment of the movement speed control amount of the drone in the first direction, the movement speed limit of the drone in the first direction can be determined based on the observation distance of the overlapping observation range. Specifically, since the observation distance is actually determined by The focal length information of the first vision sensor, the second vision sensor, and the baseline distance information of the first vision sensor and the second vision sensor are determined, so the observation distance can be determined according to the focal length information and the baseline distance information, and then the UAV can be determined along the first The movement speed limit in one direction, and then based on the speed limit of the drone in the first direction, adjust the movement speed of the drone in the first direction, where if the drone moves in the first direction in real time If the speed is greater than the determined speed limit, it needs to be adjusted; if the real-time movement speed of the UAV in the first direction is not greater than the determined speed limit, it can be adjusted or not adjusted according to requirements. The adjustment of the movement speed based on the movement speed limit may be to adjust the movement speed of the drone in the first direction to a specified value within the range of the determined speed limit, or to adjust the movement speed of the drone according to a preset reduction ratio. The determined speed limit is reduced to determine a new movement speed. Of course, it is not limited to the above-mentioned methods, and the skilled person can choose according to requirements.
另外,观测距离与运动速度限制量之间的对应关系可以是由工程试验得出,可以预先存储于无人机或与无人机连接的控制终端或服务器中,在需要使用时进行调用。In addition, the corresponding relationship between the observation distance and the movement speed limit can be obtained by engineering experiments, and can be pre-stored in the UAV or in the control terminal or server connected to the UAV, and called when needed.
在一个实施例中,出于一些特殊的拍摄需求,无人机可以是通过平移的方式改变运动轨迹进行拍摄,此时无人机的运动速度可以包括第一方向上的运动速度,以及垂直于第一方向上的运动速度,将第一方向的垂直方向记为第二方向,即无人机的运动速度实际上由第一、第二方向上的运动速度合成。为使得无人机的运动速度方向在重叠观测范围对应的视场角范围内,在根据观测距离确定第一方向上的运动速度限制量并调整第一方向上的运动速度的基础上,还可以进一步地根据调整后的第一方向上的运动速度和重叠观测范围对应的视场角,来确定第二方向上的运动速度限制量,并基于第二方向上的运动速度限制量,调整无人机沿第二方向上的运动速度,使得沿第一、第二方向上的运动速度合成的运动速度方向在重叠观测范围对应的视场角范围内。In one embodiment, for some special shooting requirements, the drone may change the motion trajectory by panning for shooting. At this time, the motion speed of the drone may include the motion speed in the first direction, and the vertical For the movement speed in the first direction, the vertical direction of the first direction is recorded as the second direction, that is, the movement speed of the drone is actually composed of the movement speed in the first and second directions. In order to make the movement speed direction of the UAV within the range of the field of view corresponding to the overlapping observation range, on the basis of determining the movement speed limit in the first direction according to the observation distance and adjusting the movement speed in the first direction, you can also Further, according to the adjusted movement speed in the first direction and the field of view corresponding to the overlapping observation range, determine the movement speed limit in the second direction, and adjust the unmanned person based on the movement speed limit in the second direction. The moving speed of the camera along the second direction is determined, so that the combined moving speed direction of the moving speeds along the first and second directions is within the field of view angle range corresponding to the overlapping observation range.
具体的,举一个无人机在水平方向上飞行的例子进行说明。可以参照图4,图4是一个水平方向上飞行的无人机的俯视图。图4中以竖直方向上(即无人机横滚轴方向上)的运动速度v1代表第一方向上的运动速度,以水平向上(即无人机俯仰轴方向上)的运动速度v2代表第二方向上的运动速度,无人机的运动速度v由v1、v2合成。其中,可以基于观测距离确 定竖直方向上的运动速度限制量,即v1的最大值,并基于此来调整无人机实际的运动速度v1,同时基于重叠观测范围对应的视场角θ确定水平方向上的运动速度限制量,即v2的最大值,具体的,可以通过
Figure PCTCN2020137173-appb-000001
计算得到,以使得由竖直方向上的运动速度与水平方向上的运动速度限制量合成的运动速度方向在重叠观测范围对应的视场角范围内,从而对于根据水平方向上的运动速度限制量调整所得的水平方向上的运动速度v2,与竖直方向上的运动速度v1合成的运动速度v的方向在重叠观测范围对应的视场角范围内。
Specifically, an example of the drone flying in the horizontal direction is given for illustration. Referring to FIG. 4 , FIG. 4 is a top view of a drone flying in a horizontal direction. In Figure 4, the movement speed v1 in the vertical direction (ie, the direction of the UAV's roll axis) represents the movement speed in the first direction, and the movement speed v2 in the horizontal upward direction (ie, the direction of the UAV's pitch axis) represents the movement speed in the first direction. The movement speed in the second direction, the movement speed v of the drone is composed of v1 and v2. Among them, the movement speed limit in the vertical direction, that is, the maximum value of v1, can be determined based on the observation distance, and the actual movement speed v1 of the UAV can be adjusted based on this, and the horizontal field angle θ corresponding to the overlapping observation range can be determined at the same time. The movement speed limit in the direction, that is, the maximum value of v2, specifically, can be passed through
Figure PCTCN2020137173-appb-000001
It is calculated so that the movement speed direction synthesized by the movement speed in the vertical direction and the movement speed limit in the horizontal direction is within the range of the field angle corresponding to the overlapping observation range, so that for the movement speed limit according to the horizontal direction The direction of the movement speed v synthesized by the obtained movement speed v2 in the horizontal direction and the movement speed v1 in the vertical direction is within the range of the field angle corresponding to the overlapping observation range.
需要说明的是,第二方向并非限定为无人机的俯仰轴方向,其可以是在垂直于第一方向的前提下的任意方向,或者可能包括多个垂直于第一方向的方向组成,具体可以根据无人机实际的运动方向确定。例如在无人机在前进的同时想要向下平移的情况下,第二方向可以是无人机航向轴方向;在无人机前进的同时想要向左下方平移的情况下,第二方向可以包括俯仰轴方向和航向轴方向。而无论何种情况,其原理均是与上述实施例一致,在此不再进行重复介绍。It should be noted that the second direction is not limited to the pitch axis direction of the UAV, it may be any direction under the premise of being perpendicular to the first direction, or may include multiple directions perpendicular to the first direction. It can be determined according to the actual movement direction of the drone. For example, if the drone wants to pan down while moving forward, the second direction can be the direction of the drone's pan axis; if the drone wants to pan down to the left while moving forward, the second direction can be the direction of the drone's pan axis. Can include pitch axis direction and pan axis direction. In any case, the principle thereof is the same as that of the above-mentioned embodiment, which will not be repeated here.
在一个实施例中,无人机可以是通过旋转的方式改变运动轨迹,具体的,无人机的运动速度可以包括第一方向上的运动速度、航向轴上的角速度以及俯仰轴上的角速度,即无人机的运动速度实际上由第一方向上的运动速度、航向轴上的角速度以及俯仰轴上的角速度合成,为使得无人机的运动速度方向在重叠观测范围对应的视场角范围内,在根据观测距离确定第一方向上的运动速度限制量并调整第一方向上的运动速度的基础上,还可以进一步地对无人机在预设时长后的运动速度的指向进行预测,若预设时长后的运动速度的指向超出重合观测范围对应的视场角范围,则可以确定当前无人机的运动速度瞬时变化较大,容易出现在无人机转向后,第一、第二视觉传感器才感知到无人机转向后场景的信息,进而容易导致事故的发生。因此可以适当调整当前时刻无人机航向轴上的角速度,或者是 俯仰轴上的角速度,或者同时对航向轴上、俯仰轴上的角速度进行调整,具体的,可以是确定出航向轴上的角速度限制量、俯仰轴上的角速度限制量,并将航向轴上的角速度、俯仰轴上的角速度调整到所确定的限制量范围内,从而可以使得预设时长后无人机的运动速度的指向在重合观测范围对应的视场角范围内,确保无人机能够在感知场景的情况下进行转向,来保证无人机的安全。其中,预设时长可以根据需求设定,例如在一些例子中可以设置为3s。In one embodiment, the UAV may change the motion trajectory by rotating, and specifically, the motion speed of the UAV may include the motion speed in the first direction, the angular speed on the yaw axis, and the angular speed on the pitch axis, That is, the movement speed of the UAV is actually composed of the movement speed in the first direction, the angular speed on the yaw axis and the angular speed on the pitch axis, so that the direction of the movement speed of the UAV is within the range of the field of view corresponding to the overlapping observation range. On the basis of determining the movement speed limit in the first direction according to the observation distance and adjusting the movement speed in the first direction, it is also possible to further predict the direction of the movement speed of the UAV after a preset period of time, If the direction of the movement speed after the preset time exceeds the field of view range corresponding to the overlapping observation range, it can be determined that the instantaneous change of the movement speed of the current UAV is large, which is likely to occur after the UAV turns. Only the visual sensor perceives the information of the scene after the UAV turns, which can easily lead to accidents. Therefore, it is possible to appropriately adjust the angular velocity on the UAV's panning axis at the current moment, or the angular velocity on the pitching axis, or adjust the angular velocity on the panning axis and the pitching axis at the same time. Specifically, the angular velocity on the panning axis can be determined. The limit amount, the angular velocity limit on the pitch axis, and the angular velocity on the pan axis and the angular velocity on the pitch axis are adjusted to the determined limit amount, so that the movement speed of the drone can be pointed at the Within the field of view corresponding to the overlapping observation range, it is ensured that the UAV can turn while sensing the scene to ensure the safety of the UAV. The preset duration can be set according to requirements, for example, it can be set to 3s in some examples.
另外,对无人机在预设时长后的运动速度的指向进行预测,可以是基于调整后的无人机沿第一方向上的运动速度和当前时刻航向轴、俯仰轴上的角速度预测预设时长内无人机的运动轨迹,再基于预设所得运动轨迹确定预设时长后无人机的运动速度的指向。当然,在一些情况下,可能无人机进行的是向前方向的俯冲或仰冲,此时航向轴上角速度为0,可以忽略航向轴上的角速度,只考虑沿第一方向上的运动速度和俯仰轴上的角速度进行预测;或者可能无人机执行的是水平方向上的飞行,此时俯仰轴上的角速度为0,可以忽略俯仰轴上的角速度,只考虑沿第一方向上的运动速度和航向轴上的角速度进行预测。例如,图5所示,为一个无人机在水平方向上飞行的情况下预测所得的运动轨迹的示意图,图中由于所预测的运动轨迹的终点上,运动速度的方向在重合观测范围对应的视场角范围内,因此可以不对航向轴上的角速度进行调整。In addition, predicting the direction of the movement speed of the drone after the preset time period may be based on the adjusted movement speed of the drone in the first direction and the angular velocity on the heading axis and the pitch axis at the current moment. The movement trajectory of the UAV within the duration is determined, and then the direction of the movement speed of the UAV after the preset duration is determined based on the preset obtained movement trajectory. Of course, in some cases, the drone may be diving or pitching in the forward direction. At this time, the angular velocity on the yaw axis is 0. The angular velocity on the yaw axis can be ignored, and only the movement speed in the first direction is considered. Predict with the angular velocity on the pitch axis; or maybe the drone is flying in the horizontal direction, at this time the angular velocity on the pitch axis is 0, the angular velocity on the pitch axis can be ignored, and only the movement in the first direction is considered The velocity and angular velocity on the pan axis are predicted. For example, as shown in Figure 5, it is a schematic diagram of the predicted motion trajectory obtained when a UAV is flying in the horizontal direction. In the figure, since the end point of the predicted motion trajectory, the direction of the motion speed is corresponding to the overlapping observation range. Therefore, the angular velocity on the pan axis cannot be adjusted.
进一步的,考虑到对于无人机运动速度的计算和调整可能存在一定的误差,为避免由于误差导致无人机的运动速度方向过于贴近重叠观测范围对应的视场角范围的边界,甚至超出边界,提高事故的发生率,在一个实施例中,还可以将无人机的运动速度的指向与重合观测范围对应的视场角范围的边界所呈的夹角限制为不小于预设的第一角度裕量,从而在允许系统误差存在的情况下依旧能够确保无人机飞行中的安全。其中第一角度裕量可以是预设的任意角度,例如可以是设置为5度,在此基础上去调整 无人机的第二方向上的运动速度或者是航向轴上的角速度、俯仰轴上的角速度时,依照是重合观测范围变为,其原本对应的视场角左右边缘均减去5度之后的视场角范围,例如在其原本重合观测范围对应的视场角范围为90度的情况下,此时相当于重合观测范围的视场角范围变成80度,并将无人机的运动速度的指向调整为,处于此时重叠观测范围对应的视场角范围内,具体的过程可以参照前面实施例介绍,在此不再赘述。Further, considering that there may be a certain error in the calculation and adjustment of the UAV's movement speed, in order to avoid the error causing the movement speed of the UAV to be too close to the boundary of the field of view corresponding to the overlapping observation range, or even beyond the boundary , to improve the occurrence rate of accidents. In one embodiment, the angle between the direction of the movement speed of the UAV and the boundary of the field of view angle range corresponding to the overlapping observation range can also be limited to be no less than the preset first Angle margin, so that the safety of the UAV in flight can still be ensured under the condition of allowing the existence of system errors. The first angle margin can be any preset angle, for example, it can be set to 5 degrees, and on this basis, the movement speed of the UAV in the second direction or the angular speed on the pan axis and the angular speed on the pitch axis are adjusted. When angular velocity, according to the overlapping observation range, the left and right edges of the corresponding field of view are the field of view range after subtracting 5 degrees. For example, when the field of view corresponding to the original overlapping observation range is 90 degrees At this time, the field of view corresponding to the overlapping observation range becomes 80 degrees, and the direction of the movement speed of the UAV is adjusted to be within the field of view corresponding to the overlapping observation range at this time. The specific process can be Referring to the introduction in the previous embodiment, details are not repeated here.
可以理解,以上以无人机作为例子进行说明的相关实施例,其在可行的情况下也可以应用到其他的可移动平台中,例如无人车、无人船等,且以上所介绍的实施例,在不冲突的情况下,可以相互结合应用。It can be understood that the relevant embodiments described above by taking the UAV as an example can also be applied to other movable platforms, such as unmanned vehicles, unmanned ships, etc., when feasible, and the implementation of the above-mentioned implementation For example, they can be used in combination with each other without conflict.
本申请实施例还提供一种可移动平台的控制方法,参照图6,图6是本申请一示例性实施例示出的一种可移动平台的控制方法流程图,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,所述方法包括:An embodiment of the present application further provides a method for controlling a movable platform. Referring to FIG. 6 , FIG. 6 is a flowchart of a control method for a movable platform according to an exemplary embodiment of the present application. The movable platform includes a first A vision sensor and a second vision sensor, the first vision sensor and the second vision sensor have overlapping observation ranges, and the method includes:
S601,获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的参数信息,所述参数信息包括所述重叠观测范围对应的视场角;S601. Acquire parameter information of overlapping observation ranges of the first visual sensor and the second visual sensor, where the parameter information includes a field of view angle corresponding to the overlapping observation ranges;
S602,根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。S602: Adjust the movement speed control amount of the movable platform according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field of view angle range corresponding to the overlapping observation range .
其中,对于该控制方法的介绍可以参照上面实施例,在此不再赘述。For the introduction of the control method, reference may be made to the above embodiments, which will not be repeated here.
本申请以上实施例,根据场景信息来调整可移动平台的观测范围,使其更符合可移动平台对当前场景的观测需求,合理化观测范围并可以有效地减少观测盲区。同时将可移动平台的运动速度方向控制在观测范围内,可以确保可移动平台运动在针对当前场景最合理的观测范围内,实现了可移动平台对场景的准确观测以最小化观测盲区,以及避免观测盲区带来的安全隐患。In the above embodiments of the present application, the observation range of the movable platform is adjusted according to the scene information, so that it is more in line with the observation requirements of the movable platform for the current scene, the observation range is rationalized, and the observation blind area can be effectively reduced. At the same time, controlling the movement speed and direction of the movable platform within the observation range can ensure that the movable platform moves within the most reasonable observation range for the current scene, realize the accurate observation of the scene by the movable platform, minimize the observation blind area, and avoid Observe the safety hazards brought by blind spots.
本申请实施例还提供一种可移动平台的控制装置,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器具有重叠观测范围,参照图7,图7是本申请一示例性实施例示出的一种可移动平台的控制装置示意图,该控制装置包括:An embodiment of the present application further provides a control device for a movable platform, the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping observation ranges. FIG. 7 is a schematic diagram of a control device of a movable platform according to an exemplary embodiment of the present application, and the control device includes:
处理器701; processor 701;
用于存储处理器701可执行指令的存储器702; memory 702 for storing instructions executable by processor 701;
所述处理器701被配置为:The processor 701 is configured to:
获取所述第一视觉传感器和所述第二视觉传感器的焦距信息;acquiring focal length information of the first vision sensor and the second vision sensor;
根据所述焦距信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
所述处理器701还可以被配置为:The processor 701 can also be configured to:
获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的参数信息,所述参数信息包括所述重叠观测范围对应的视场角;acquiring parameter information of overlapping observation ranges of the first vision sensor and the second vision sensor, where the parameter information includes a field of view angle corresponding to the overlapping observation ranges;
根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
可以理解,在上述控制装置所示出的处理器、存储器的基础上,控制装置根据其实际的类型还可以包括实现正常运行所必需的其他组件。例如,在控制装置为处理芯片或集成有处理芯片的主板的情况下,其通过安装于设备上实现控制功能,例如安装于可移动平台或控制终端上,此时控制装置还可以包括通信接口,用于与设备上其他器件进行数据的交互;在控制装置为电子设备的情况下,此时控制装置还可以包括例如输入/输出接口、通信接口、总线等,输入/输出接口可以用于连接输入/输出模块,以实现信息输入及输出。输入输出/模块可以作为组件配置在电子设备中(图 中未示出),也可以外接于设备以提供相应功能。输入设备可以包括键盘、鼠标、触摸屏、麦克风、各类传感器等,输出设备可以包括显示器、扬声器、振动器、指示灯等。通信接口用于连接通信模块(图中未示出),以实现电子设备与其他设备的通信交互。其中通信模块可以通过有线方式(例如USB、网线等)实现通信,也可以通过无线方式(例如移动网络、WIFI、蓝牙等)实现通信。总线包括一通路,在电子设备的各个组件(例如处理器、存储器、输入/输出接口和通信接口)之间传输信息。It can be understood that, on the basis of the processor and memory shown in the above control device, the control device may also include other components necessary for normal operation according to its actual type. For example, in the case where the control device is a processing chip or a mainboard integrated with the processing chip, it realizes the control function by being installed on the device, for example, installed on a movable platform or a control terminal. At this time, the control device may also include a communication interface, It is used for data interaction with other devices on the device; in the case where the control device is an electronic device, the control device may also include, for example, an input/output interface, a communication interface, a bus, etc., and the input/output interface can be used to connect the input /Output module to realize information input and output. The input/output/module can be configured in the electronic device as a component (not shown in the figure), or can be externally connected to the device to provide corresponding functions. Input devices may include keyboards, mice, touch screens, microphones, various types of sensors, etc., and output devices may include displays, speakers, vibrators, indicator lights, and the like. The communication interface is used to connect a communication module (not shown in the figure) to realize communication interaction between the electronic device and other devices. The communication module may implement communication through wired means (eg, USB, network cable, etc.), or may implement communication through wireless means (eg, mobile network, WIFI, Bluetooth, etc.). A bus includes a path that transfers information between various components of an electronic device, such as the processor, memory, input/output interfaces, and communication interfaces.
本申请实施例还提供一种可移动平台,参照图8,图8是本申请一示例性实施例示出的一种可移动平台示意图,如图8所示,可移动平台包括:An embodiment of the present application further provides a movable platform. Referring to FIG. 8 , FIG. 8 is a schematic diagram of a movable platform shown in an exemplary embodiment of the present application. As shown in FIG. 8 , the movable platform includes:
第一视觉传感器810;a first visual sensor 810;
第二视觉传感器820;a second visual sensor 820;
所述第一视觉传感器810和所述第二视觉传感器820的具有重叠观测范围;The first visual sensor 810 and the second visual sensor 820 have overlapping observation ranges;
机身830;其中机身830包括: Fuselage 830; wherein fuselage 830 includes:
处理器831; processor 831;
用于存储处理器831可执行指令的存储器832; memory 832 for storing instructions executable by processor 831;
输入/输出接口833;input/output interface 833;
通信接口834; communication interface 834;
总线835; bus 835;
所述处理器831被配置为:The processor 831 is configured to:
获取所述第一视觉传感器和所述第二视觉传感器的焦距信息;acquiring focal length information of the first vision sensor and the second vision sensor;
根据所述焦距信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围 内。The movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
所述处理器831还可以被配置为:The processor 831 can also be configured to:
获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的参数信息,所述参数信息包括所述重叠观测范围对应的视场角;acquiring parameter information of overlapping observation ranges of the first vision sensor and the second vision sensor, where the parameter information includes a field of view angle corresponding to the overlapping observation ranges;
根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
本申请实施例还提供一种计算机存储介质,其上存储有计算机程序,所述计算机程序被执行时实现上述任意实施例所述的方法。对于装置实施例而言,由于其基本对应于方法实施例,所以相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。The embodiments of the present application further provide a computer storage medium, on which a computer program is stored, and when the computer program is executed, the method described in any of the foregoing embodiments is implemented. For the apparatus embodiments, since they basically correspond to the method embodiments, reference may be made to the partial descriptions of the method embodiments for related parts. The device embodiments described above are only illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed over multiple network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution in this embodiment. Those of ordinary skill in the art can understand and implement it without creative effort.
本申请所给出的所有实施例,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行计算机程序指令时,全部或部分地产生按照本申请实施例的流程或功能。计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。计算机指令可以存储在计算机可读存储介质中,或者通过计算机可读存储介质进行传输。计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、 计算机、服务器或数据中心进行传输。计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如,固态硬盘(solid state disk,SSD))等。All the embodiments given in this application may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions according to the embodiments of the present application are generated in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored in or transmitted over a computer-readable storage medium. Computer instructions may be sent from one website site, computer, server, or data center to another website site, computer, by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wirelessly (eg, infrared, wireless, microwave, etc.) , server or data center for transmission. A computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, a data center, or the like that includes an integration of one or more available media. Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, in this document, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any relationship between these entities or operations. any such actual relationship or sequence exists. The terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion such that a process, method, article or device comprising a list of elements includes not only those elements, but also other not expressly listed elements, or also include elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.
以上对本申请实施例所提供的方法和装置进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。The methods and devices provided by the embodiments of the present application have been introduced in detail above, and specific examples are used to illustrate the principles and implementations of the present application. At the same time, for those of ordinary skill in the art, according to the idea of the application, there will be changes in the specific implementation and application scope. In summary, the content of this specification should not be construed as a limitation to the application. .

Claims (72)

  1. 一种可移动平台的控制方法,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,其特征在于,所述方法包括:A control method of a movable platform, the movable platform includes a first vision sensor and a second vision sensor, and the first vision sensor and the second vision sensor have overlapping observation ranges, characterized in that the Methods include:
    获取所述第一视觉传感器和所述第二视觉传感器的焦距信息;acquiring focal length information of the first vision sensor and the second vision sensor;
    根据所述焦距信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
  2. 根据权利要求1所述的方法,其特征在于,在获取所述第一视觉传感器和所述第二视觉传感器的焦距信息之前,所述方法还包括:The method according to claim 1, wherein before acquiring the focal length information of the first vision sensor and the second vision sensor, the method further comprises:
    根据所述第一视觉传感器的观测数据和所述第二视觉传感器的观测数据,确定所述重叠观测范围内观测的对象的距离信息;According to the observation data of the first visual sensor and the observation data of the second visual sensor, determine the distance information of the object observed in the overlapping observation range;
    根据所述距离信息调整所述第一视觉传感器和/或所述第二视觉传感器焦距信息。The focal length information of the first vision sensor and/or the second vision sensor is adjusted according to the distance information.
  3. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    获取所述第一视觉传感器和所述第二视觉传感器的基线距离信息;acquiring baseline distance information of the first vision sensor and the second vision sensor;
    所述根据所述焦距信息调整所述可移动平台的运动速度控制量,包括:The adjusting the movement speed control amount of the movable platform according to the focal length information includes:
    根据所述基线距离信息和所述焦距信息调整所述可移动平台的运动速度控制量。The movement speed control amount of the movable platform is adjusted according to the baseline distance information and the focal length information.
  4. 根据权利要求3所述的方法,其特征在于,在获取所述第一视觉传感器和所述第二视觉传感器的基线距离信息之前,所述方法还包括:The method according to claim 3, wherein before acquiring the baseline distance information of the first vision sensor and the second vision sensor, the method further comprises:
    根据所述第一视觉传感器的观测数据和所述第二视觉传感器的观测数据,确定所述重叠观测范围内观测的对象的距离信息;According to the observation data of the first visual sensor and the observation data of the second visual sensor, determine the distance information of the object observed in the overlapping observation range;
    根据所述距离信息调整所述基线距离信息。The baseline distance information is adjusted according to the distance information.
  5. 根据权利要求1所述的方法,其特征在于,所述运动速度控制量包括:所述可移动平台的运动速度和/或运动速度的限制量。The method according to claim 1, wherein the movement speed control amount comprises: the movement speed and/or the limit amount of the movement speed of the movable platform.
  6. 根据权利要求3所述的方法,其特征在于,所述根据所述基线距离 信息和所述焦距信息调整所述可移动平台的运动速度控制量,包括:The method according to claim 3, wherein the adjusting the movement speed control amount of the movable platform according to the baseline distance information and the focal length information, comprising:
    根据所述基线距离信息和所述焦距信息调整所述可移动平台沿第一方向上的运动速度控制量,所述第一方向垂直于所述第一视觉传感器和所述第二视觉传感器的基线延伸方向。The movement speed control amount of the movable platform in a first direction is adjusted according to the baseline distance information and the focal length information, and the first direction is perpendicular to the baselines of the first vision sensor and the second vision sensor extension direction.
  7. 根据权利要求6所述的方法,其特征在于,所述根据所述基线距离信息和所述焦距信息调整所述可移动平台沿第一方向上的运动速度控制量,包括:The method according to claim 6, wherein the adjusting the movement speed control amount of the movable platform along the first direction according to the baseline distance information and the focal length information comprises:
    基于所述基线距离信息和所述焦距信息确定所述可移动平台沿所述第一方向上的运动速度限制量;determining a movement speed limit of the movable platform along the first direction based on the baseline distance information and the focal length information;
    基于所述可移动平台沿所述第一方向上的速度限制量,调整所述可移动平台沿所述第一方向上的运动速度。The speed of movement of the movable platform in the first direction is adjusted based on the speed limit of the movable platform in the first direction.
  8. 根据权利要求7所述的方法,其特征在于,所述可移动平台运动过程中通过平移改变运动轨迹;The method according to claim 7, wherein the movement trajectory of the movable platform is changed by translation during the movement of the movable platform;
    所述根据所述基线距离信息和所述焦距信息调整所述可移动平台的运动速度控制量还包括:The adjusting the movement speed control amount of the movable platform according to the baseline distance information and the focal length information further includes:
    基于调整所得所述可移动平台沿所述第一方向上的运动速度和所述重叠观测范围的视场角,确定所述可移动平台沿第二方向上的运动速度限制量;Determine the movement speed limit of the movable platform along the second direction based on the obtained movement speed of the movable platform along the first direction and the field angle of the overlapping observation range;
    基于所述可移动平台沿所述第二方向上的速度限制量,调整所述可移动平台沿所述第二方向上的运动速度;adjusting the speed of movement of the movable platform in the second direction based on a speed limit of the movable platform in the second direction;
    其中所述第二方向垂直于所述第一方向。wherein the second direction is perpendicular to the first direction.
  9. 根据权利要求7所述的方法,其特征在于,所述可移动平台运动过程中通过旋转改变运动轨迹,所述根据所述基线距离信息和所述焦距信息调整所述可移动平台的运动速度控制量还包括:The method according to claim 7, wherein, during the movement of the movable platform, a movement trajectory is changed by rotation, and the movement speed control of the movable platform is adjusted according to the baseline distance information and the focal length information. The amount also includes:
    对所述可移动平台在预设时长后的运动速度的指向进行预测;Predicting the direction of the movement speed of the movable platform after a preset period of time;
    若所述预设时长后的运动速度的指向超出所述重合观测范围对应的视场角范围,调整当前时刻可移动平台航向轴和/或俯仰轴上的角速度,以使 所述预设时长后的运动速度的指向在所述重合观测范围对应的视场角范围内。If the direction of the movement speed after the preset time exceeds the field of view angle range corresponding to the overlapping observation range, adjust the angular velocity on the pan axis and/or the pitch axis of the movable platform at the current moment, so that the preset time after the The direction of the movement speed is within the range of the field angle corresponding to the coincident observation range.
  10. 根据权利要求9所述的方法,其特征在于,所述对所述可移动平台在预设时长后的运动速度的指向进行预测,包括:The method according to claim 9, wherein the predicting the direction of the moving speed of the movable platform after a preset period of time comprises:
    基于调整后的所述可移动平台沿所述第一方向上的运动速度和当前时刻航向轴和/或俯仰轴上的角速度预测预设时长内可移动平台的运动轨迹;Predicting the movement trajectory of the movable platform within a preset period of time based on the adjusted movement speed of the movable platform in the first direction and the angular velocity on the pan axis and/or the pitch axis at the current moment;
    基于所述运动轨迹确定所述预设时长后可移动平台的运动速度的指向。The direction of the movement speed of the movable platform after the preset time period is determined based on the movement trajectory.
  11. 根据权利要求1所述的方法,其特征在于,所述可移动平台的运动速度的指向与所述重合观测范围对应的视场角范围的边界所呈的夹角不小于预设的第一角度裕量。The method according to claim 1, wherein the included angle formed by the moving speed of the movable platform pointing to the boundary of the field of view angle range corresponding to the coincident observation range is not less than a preset first angle Margin.
  12. 根据权利要求1所述的方法,其特征在于,所述可移动平台为无人机。The method of claim 1, wherein the movable platform is an unmanned aerial vehicle.
  13. 一种可移动平台的控制方法,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,其特征在于,所述方法包括:A control method of a movable platform, the movable platform includes a first vision sensor and a second vision sensor, and the first vision sensor and the second vision sensor have overlapping observation ranges, characterized in that the Methods include:
    获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的参数信息,所述参数信息包括所述重叠观测范围对应的视场角;acquiring parameter information of overlapping observation ranges of the first vision sensor and the second vision sensor, where the parameter information includes a field of view angle corresponding to the overlapping observation ranges;
    根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
  14. 根据权利要求13所述的方法,其特征在于,所述重叠观测范围的参数信息还包括观测距离。The method according to claim 13, wherein the parameter information of the overlapping observation range further comprises an observation distance.
  15. 根据权利要求14所述的方法,其特征在于,在获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的参数信息之前,所述方法还包括:The method according to claim 14, wherein before acquiring the parameter information of the overlapping observation range of the first vision sensor and the second vision sensor, the method further comprises:
    根据所述第一视觉传感器的观测数据和所述第二视觉传感器的观测数 据,确定所述重叠观测范围内观测的对象的距离信息;According to the observation data of the first visual sensor and the observation data of the second visual sensor, determine the distance information of the object observed in the overlapping observation range;
    根据所述距离信息调整所述重叠观测范围的所述参数信息。The parameter information of the overlapping observation range is adjusted according to the distance information.
  16. 根据权利要求15所述的方法,其特征在于,所述根据所述距离信息调整所述重叠观测范围的所述参数信息,包括:The method according to claim 15, wherein the adjusting the parameter information of the overlapping observation range according to the distance information comprises:
    根据所述距离信息调整所述第一视觉传感器和所述第二视觉传感器的焦距信息;和/或Adjust the focal length information of the first vision sensor and the second vision sensor according to the distance information; and/or
    根据所述距离信息调整所述第一视觉传感器和所述第二视觉传感器的基线距离信息。The baseline distance information of the first vision sensor and the second vision sensor is adjusted according to the distance information.
  17. 根据权利要求13所述的方法,其特征在于,所述运动速度控制量包括:所述可移动平台的运动速度和/或运动速度的限制量。The method according to claim 13, wherein the movement speed control amount comprises: the movement speed and/or the limit amount of the movement speed of the movable platform.
  18. 根据权利要求14所述的方法,其特征在于,根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,包括:The method according to claim 14, wherein adjusting the motion speed control amount of the movable platform according to the parameter information of the overlapping observation range comprises:
    根据所述重叠观测范围的所述参数信息调整所述可移动平台沿第一方向上的运动速度控制量,所述第一方向垂直于所述第一视觉传感器和所述第二视觉传感器的基线延伸方向。Adjust the movement speed control amount of the movable platform along a first direction according to the parameter information of the overlapping observation range, the first direction being perpendicular to the baselines of the first vision sensor and the second vision sensor extension direction.
  19. 根据权利要求18所述的方法,其特征在于,所述根据所述重叠观测范围的所述参数信息调整所述可移动平台沿第一方向上的运动速度控制量,包括:The method according to claim 18, wherein the adjusting the movement speed control amount of the movable platform along the first direction according to the parameter information of the overlapping observation range comprises:
    基于所述重叠观测范围的观测距离确定所述可移动平台沿所述第一方向上的运动速度限制量;determining a movement speed limit amount of the movable platform along the first direction based on the observation distance of the overlapping observation range;
    基于所述可移动平台沿所述第一方向上的运动速度限制量,调整所述可移动平台沿所述第一方向上的运动速度。The movement speed of the movable platform in the first direction is adjusted based on the limit amount of the movement speed of the movable platform in the first direction.
  20. 根据权利要求19所述的方法,其特征在于,所述可移动平台运动过程中通过平移改变运动轨迹;The method according to claim 19, wherein the movement trajectory is changed by translation during the movement of the movable platform;
    所述根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量还包括:The adjusting the motion speed control amount of the movable platform according to the parameter information of the overlapping observation range further includes:
    基于调整所得所述可移动平台沿所述第一方向上的运动速度和所述重 叠观测范围对应的视场角,确定所述可移动平台沿第二方向上的运动速度限制量;Determine the movement speed limit of the movable platform along the second direction based on the obtained moving speed of the movable platform along the first direction and the field angle corresponding to the overlapping observation range;
    基于所述可移动平台沿所述第二方向上的速度限制量,调整所述可移动平台沿所述第二方向上的运动速度;adjusting the speed of movement of the movable platform in the second direction based on a speed limit of the movable platform in the second direction;
    其中所述第二方向垂直于所述第一方向。wherein the second direction is perpendicular to the first direction.
  21. 根据权利要求19所述的方法,其特征在于,所述可移动平台运动过程中通过旋转改变运动轨迹,所述根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量还包括:The method according to claim 19, wherein, during the movement of the movable platform, a movement trajectory is changed by rotation, and the movement speed control of the movable platform is adjusted according to the parameter information of the overlapping observation range. The amount also includes:
    对所述可移动平台在预设时长后的运动速度的指向进行预测;Predicting the direction of the movement speed of the movable platform after a preset period of time;
    若所述预设时长后的运动速度的指向超出所述重合观测范围对应的视场角范围,调整当前时刻可移动平台航向轴和/或俯仰轴上的角速度,以使所述预设时长后的运动速度的指向在所述重合观测范围对应的视场角范围内。If the direction of the movement speed after the preset time exceeds the field of view angle range corresponding to the overlapping observation range, adjust the angular velocity on the pan axis and/or the pitch axis of the movable platform at the current moment, so that the preset time after the The direction of the movement speed is within the range of the field angle corresponding to the coincident observation range.
  22. 根据权利要求21所述的方法,其特征在于,所述对所述可移动平台在预设时长后的运动速度的指向进行预测,包括:The method according to claim 21, wherein the predicting the direction of the moving speed of the movable platform after a preset period of time comprises:
    基于调整后的所述可移动平台沿所述第一方向上的运动速度和当前时刻航向轴上的角速度、俯仰轴上的角速度预测预设时长内可移动平台的运动轨迹;Predict the movement trajectory of the movable platform within a preset time period based on the adjusted movement speed of the movable platform along the first direction and the angular velocity on the pan axis and the angular velocity on the pitch axis at the current moment;
    基于所述运动轨迹确定所述预设时长后可移动平台的运动速度的指向。The direction of the movement speed of the movable platform after the preset time period is determined based on the movement trajectory.
  23. 根据权利要求13所述的方法,其特征在于,所述可移动平台的运动速度的指向与所述重合观测范围对应的视场角范围的边界所呈的夹角不小于预设的第一角度裕量。The method according to claim 13, wherein the included angle formed by the moving speed of the movable platform to the boundary of the field of view angle range corresponding to the coincident observation range is not less than a preset first angle Margin.
  24. 根据权利要求13所述的方法,其特征在于,所述可移动平台为无人机。The method of claim 13, wherein the movable platform is an unmanned aerial vehicle.
  25. 一种可移动平台的控制装置,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器具有重 叠观测范围,其特征在于,所述控制装置包括:A control device for a movable platform, the movable platform includes a first visual sensor and a second visual sensor, the first visual sensor and the second visual sensor have overlapping observation ranges, characterized in that the control The device includes:
    处理器;processor;
    用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
    所述处理器被配置为:The processor is configured to:
    获取所述第一视觉传感器和所述第二视觉传感器的焦距信息;acquiring focal length information of the first vision sensor and the second vision sensor;
    根据所述焦距信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
  26. 根据权利要求25所述的控制装置,其特征在于,所述处理器还被配置为:The control device of claim 25, wherein the processor is further configured to:
    根据所述第一视觉传感器的观测数据和所述第二视觉传感器的观测数据,确定所述重叠观测范围内观测的对象的距离信息;According to the observation data of the first visual sensor and the observation data of the second visual sensor, determine the distance information of the object observed in the overlapping observation range;
    根据所述距离信息调整所述第一视觉传感器和/或所述第二视觉传感器焦距信息。The focal length information of the first vision sensor and/or the second vision sensor is adjusted according to the distance information.
  27. 根据权利要求25所述的控制装置,其特征在于,所述处理器还被配置为:The control device of claim 25, wherein the processor is further configured to:
    获取所述第一视觉传感器和所述第二视觉传感器的基线距离信息;acquiring baseline distance information of the first vision sensor and the second vision sensor;
    根据所述基线距离信息和所述焦距信息调整所述可移动平台的运动速度控制量。The movement speed control amount of the movable platform is adjusted according to the baseline distance information and the focal length information.
  28. 根据权利要求27所述的控制装置,其特征在于,所述处理器还被配置为:The control device of claim 27, wherein the processor is further configured to:
    根据所述第一视觉传感器的观测数据和所述第二视觉传感器的观测数据,确定所述重叠观测范围内观测的对象的距离信息;According to the observation data of the first visual sensor and the observation data of the second visual sensor, determine the distance information of the object observed in the overlapping observation range;
    根据所述距离信息调整所述基线距离信息。The baseline distance information is adjusted according to the distance information.
  29. 根据权利要求25所述的控制装置,其特征在于,所述运动速度控制量包括:所述可移动平台的运动速度和/或运动速度的限制量。The control device according to claim 25, wherein the movement speed control amount comprises: the movement speed and/or the limit amount of the movement speed of the movable platform.
  30. 根据权利要求27所述的控制装置,其特征在于,所述处理器具体 被配置为:The control device according to claim 27, wherein the processor is specifically configured to:
    根据所述基线距离信息和所述焦距信息调整所述可移动平台沿第一方向上的运动速度控制量,所述第一方向垂直于所述第一视觉传感器和所述第二视觉传感器的基线延伸方向。The movement speed control amount of the movable platform in a first direction is adjusted according to the baseline distance information and the focal length information, and the first direction is perpendicular to the baselines of the first vision sensor and the second vision sensor extension direction.
  31. 根据权利要求30所述的控制装置,其特征在于,所述处理器具体被配置为:The control device according to claim 30, wherein the processor is specifically configured to:
    基于所述基线距离信息和所述焦距信息确定所述可移动平台沿所述第一方向上的运动速度限制量;determining a movement speed limit of the movable platform along the first direction based on the baseline distance information and the focal length information;
    基于所述可移动平台沿所述第一方向上的速度限制量,调整所述可移动平台沿所述第一方向上的运动速度。The speed of movement of the movable platform in the first direction is adjusted based on the speed limit of the movable platform in the first direction.
  32. 根据权利要求31所述的控制装置,其特征在于,所述可移动平台运动过程中通过平移改变运动轨迹;The control device according to claim 31, wherein the movement trajectory of the movable platform is changed by translation during the movement of the movable platform;
    所述处理器具体被配置为:The processor is specifically configured to:
    基于调整所得所述可移动平台沿所述第一方向上的运动速度和所述重叠观测范围的视场角,确定所述可移动平台沿第二方向上的运动速度限制量;Determine the movement speed limit of the movable platform along the second direction based on the obtained movement speed of the movable platform along the first direction and the field angle of the overlapping observation range;
    基于所述可移动平台沿所述第二方向上的速度限制量,调整所述可移动平台沿所述第二方向上的运动速度;adjusting the speed of movement of the movable platform in the second direction based on a speed limit of the movable platform in the second direction;
    其中所述第二方向垂直于所述第一方向。wherein the second direction is perpendicular to the first direction.
  33. 根据权利要求31所述的控制装置,其特征在于,所述可移动平台运动过程中通过旋转改变运动轨迹,所述处理器具体被配置为:The control device according to claim 31, wherein, during the movement of the movable platform, the movement trajectory is changed by rotation, and the processor is specifically configured to:
    对所述可移动平台在预设时长后的运动速度的指向进行预测;Predicting the direction of the movement speed of the movable platform after a preset period of time;
    若所述预设时长后的运动速度的指向超出所述重合观测范围对应的视场角范围,调整当前时刻可移动平台航向轴和/或俯仰轴上的角速度,以使所述预设时长后的运动速度的指向在所述重合观测范围对应的视场角范围内。If the direction of the movement speed after the preset time exceeds the field of view angle range corresponding to the overlapping observation range, adjust the angular velocity on the pan axis and/or the pitch axis of the movable platform at the current moment, so that the preset time after the The direction of the movement speed is within the range of the field angle corresponding to the coincident observation range.
  34. 根据权利要求33所述的控制装置,其特征在于,所述处理器具体 被配置为:The control device according to claim 33, wherein the processor is specifically configured to:
    基于调整后的所述可移动平台沿所述第一方向上的运动速度和当前时刻航向轴和/或俯仰轴上的角速度预测预设时长内可移动平台的运动轨迹;Predicting the movement trajectory of the movable platform within a preset period of time based on the adjusted movement speed of the movable platform in the first direction and the angular velocity on the pan axis and/or the pitch axis at the current moment;
    基于所述运动轨迹确定所述预设时长后可移动平台的运动速度的指向。The direction of the movement speed of the movable platform after the preset time period is determined based on the movement trajectory.
  35. 根据权利要求25所述的控制装置,其特征在于,所述可移动平台的运动速度的指向与所述重合观测范围对应的视场角范围的边界所呈的夹角不小于预设的第一角度裕量。The control device according to claim 25, wherein the included angle formed by the moving speed of the movable platform pointing to the boundary of the field of view angle range corresponding to the overlapping observation range is not less than a preset first Angle allowance.
  36. 根据权利要求25所述的控制装置,其特征在于,所述可移动平台为无人机。The control device according to claim 25, wherein the movable platform is an unmanned aerial vehicle.
  37. 一种可移动平台的控制装置,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,其特征在于,所述控制装置包括:A control device for a movable platform, the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping observation ranges, characterized in that the Controls include:
    处理器;processor;
    用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
    所述处理器被配置为:The processor is configured to:
    获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的参数信息,所述参数信息包括所述重叠观测范围对应的视场角;acquiring parameter information of overlapping observation ranges of the first vision sensor and the second vision sensor, where the parameter information includes a field of view angle corresponding to the overlapping observation ranges;
    根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within the field angle range corresponding to the overlapping observation range.
  38. 根据权利要求13所述的控制装置,其特征在于,所述重叠观测范围的参数信息还包括观测距离。The control device according to claim 13, wherein the parameter information of the overlapping observation range further includes an observation distance.
  39. 根据权利要求38所述的控制装置,其特征在于,所述处理器还被配置为:The control device of claim 38, wherein the processor is further configured to:
    根据所述第一视觉传感器的观测数据和所述第二视觉传感器的观测数据,确定所述重叠观测范围内观测的对象的距离信息;According to the observation data of the first visual sensor and the observation data of the second visual sensor, determine the distance information of the object observed in the overlapping observation range;
    根据所述距离信息调整所述重叠观测范围的所述参数信息。The parameter information of the overlapping observation range is adjusted according to the distance information.
  40. 根据权利要求39所述的控制装置,其特征在于,所述处理器具体被配置为:The control device according to claim 39, wherein the processor is specifically configured to:
    根据所述距离信息调整所述第一视觉传感器和所述第二视觉传感器的焦距信息;和/或Adjust the focal length information of the first vision sensor and the second vision sensor according to the distance information; and/or
    根据所述距离信息调整所述第一视觉传感器和所述第二视觉传感器的基线距离信息。The baseline distance information of the first vision sensor and the second vision sensor is adjusted according to the distance information.
  41. 根据权利要求37所述的控制装置,其特征在于,所述运动速度控制量包括:所述可移动平台的运动速度和/或运动速度的限制量。The control device according to claim 37, wherein the movement speed control amount comprises: the movement speed and/or the limit amount of the movement speed of the movable platform.
  42. 根据权利要求38所述的控制装置,其特征在于,所述处理器具体被配置为:The control device according to claim 38, wherein the processor is specifically configured to:
    根据所述重叠观测范围的所述参数信息调整所述可移动平台沿第一方向上的运动速度控制量,所述第一方向垂直于所述第一视觉传感器和所述第二视觉传感器的基线延伸方向。Adjust the movement speed control amount of the movable platform along a first direction according to the parameter information of the overlapping observation range, the first direction being perpendicular to the baselines of the first vision sensor and the second vision sensor extension direction.
  43. 根据权利要求42所述的控制装置,其特征在于,所述处理器具体被配置为:The control device according to claim 42, wherein the processor is specifically configured to:
    基于所述重叠观测范围的观测距离确定所述可移动平台沿所述第一方向上的运动速度限制量;determining a movement speed limit amount of the movable platform along the first direction based on the observation distance of the overlapping observation range;
    基于所述可移动平台沿所述第一方向上的运动速度限制量,调整所述可移动平台沿所述第一方向上的运动速度。The movement speed of the movable platform in the first direction is adjusted based on the limit amount of the movement speed of the movable platform in the first direction.
  44. 根据权利要求43所述的控制装置,其特征在于,所述可移动平台运动过程中通过平移改变运动轨迹;The control device according to claim 43, wherein the movement trajectory of the movable platform is changed by translation during the movement of the movable platform;
    所述处理器具体被配置为:The processor is specifically configured to:
    基于调整所得所述可移动平台沿所述第一方向上的运动速度和所述重叠观测范围对应的视场角,确定所述可移动平台沿第二方向上的运动速度限制量;Determine the movement speed limit of the movable platform along the second direction based on the obtained movement speed of the movable platform along the first direction and the field angle corresponding to the overlapping observation range;
    基于所述可移动平台沿所述第二方向上的速度限制量,调整所述可移 动平台沿所述第二方向上的运动速度;adjusting the speed of movement of the movable platform in the second direction based on a speed limit of the movable platform in the second direction;
    其中所述第二方向垂直于所述第一方向。wherein the second direction is perpendicular to the first direction.
  45. 根据权利要求43所述的控制装置,其特征在于,所述可移动平台运动过程中通过旋转改变运动轨迹,所述处理器具体被配置为:The control device according to claim 43, wherein, during the movement of the movable platform, the movement trajectory is changed by rotation, and the processor is specifically configured to:
    对所述可移动平台在预设时长后的运动速度的指向进行预测;Predicting the direction of the movement speed of the movable platform after a preset period of time;
    若所述预设时长后的运动速度的指向超出所述重合观测范围对应的视场角范围,调整当前时刻可移动平台航向轴和/或俯仰轴上的角速度,以使所述预设时长后的运动速度的指向在所述重合观测范围对应的视场角范围内。If the direction of the movement speed after the preset time exceeds the field of view angle range corresponding to the overlapping observation range, adjust the angular velocity on the pan axis and/or the pitch axis of the movable platform at the current moment, so that the preset time after the The direction of the movement speed is within the range of the field angle corresponding to the coincident observation range.
  46. 根据权利要求45所述的控制装置,其特征在于,所述处理器具体被配置为:The control device according to claim 45, wherein the processor is specifically configured to:
    基于调整后的所述可移动平台沿所述第一方向上的运动速度和当前时刻航向轴上的角速度、俯仰轴上的角速度预测预设时长内可移动平台的运动轨迹;Predict the movement trajectory of the movable platform within a preset time period based on the adjusted movement speed of the movable platform along the first direction and the angular velocity on the pan axis and the angular velocity on the pitch axis at the current moment;
    基于所述运动轨迹确定所述预设时长后可移动平台的运动速度的指向。The direction of the movement speed of the movable platform after the preset time period is determined based on the movement trajectory.
  47. 根据权利要求37所述的控制装置,其特征在于,所述可移动平台的运动速度的指向与所述重合观测范围对应的视场角范围的边界所呈的夹角不小于预设的第一角度裕量。The control device according to claim 37, wherein the included angle between the moving speed of the movable platform and the boundary of the field of view angle range corresponding to the overlapping observation range is not less than a preset first Angle allowance.
  48. 根据权利要求37所述的控制装置,其特征在于,所述可移动平台为无人机。The control device of claim 37, wherein the movable platform is an unmanned aerial vehicle.
  49. 一种可移动平台,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,其特征在于,所述可移动平台还包括:A movable platform, the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping observation ranges, characterized in that the movable platform Also includes:
    处理器;processor;
    用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
    所述处理器被配置为:The processor is configured to:
    获取所述第一视觉传感器和所述第二视觉传感器的焦距信息;acquiring focal length information of the first vision sensor and the second vision sensor;
    根据所述焦距信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the focal length information, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
  50. 根据权利要求49所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 49, wherein the processor is further configured to:
    根据所述第一视觉传感器的观测数据和所述第二视觉传感器的观测数据,确定所述重叠观测范围内观测的对象的距离信息;According to the observation data of the first visual sensor and the observation data of the second visual sensor, determine the distance information of the object observed in the overlapping observation range;
    根据所述距离信息调整所述第一视觉传感器和/或所述第二视觉传感器焦距信息。The focal length information of the first vision sensor and/or the second vision sensor is adjusted according to the distance information.
  51. 根据权利要求49所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 49, wherein the processor is further configured to:
    获取所述第一视觉传感器和所述第二视觉传感器的基线距离信息;acquiring baseline distance information of the first vision sensor and the second vision sensor;
    根据所述基线距离信息和所述焦距信息调整所述可移动平台的运动速度控制量。The movement speed control amount of the movable platform is adjusted according to the baseline distance information and the focal length information.
  52. 根据权利要求51所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 51, wherein the processor is further configured to:
    根据所述第一视觉传感器的观测数据和所述第二视觉传感器的观测数据,确定所述重叠观测范围内观测的对象的距离信息;According to the observation data of the first visual sensor and the observation data of the second visual sensor, determine the distance information of the object observed in the overlapping observation range;
    根据所述距离信息调整所述基线距离信息。The baseline distance information is adjusted according to the distance information.
  53. 根据权利要求49所述的可移动平台,其特征在于,所述运动速度控制量包括:所述可移动平台的运动速度和/或运动速度的限制量。The movable platform according to claim 49, wherein the movement speed control amount comprises: the movement speed and/or the limit amount of the movement speed of the movable platform.
  54. 根据权利要求51所述的可移动平台,其特征在于,所述处理器具体被配置为:The movable platform of claim 51, wherein the processor is specifically configured to:
    根据所述基线距离信息和所述焦距信息调整所述可移动平台沿第一方向上的运动速度控制量,所述第一方向垂直于所述第一视觉传感器和所述第二视觉传感器的基线延伸方向。The movement speed control amount of the movable platform along a first direction is adjusted according to the baseline distance information and the focal length information, and the first direction is perpendicular to the baselines of the first vision sensor and the second vision sensor extension direction.
  55. 根据权利要求54所述的可移动平台,其特征在于,所述处理器具体被配置为:The movable platform of claim 54, wherein the processor is specifically configured to:
    基于所述基线距离信息和所述焦距信息确定所述可移动平台沿所述第一方向上的运动速度限制量;determining a movement speed limit of the movable platform along the first direction based on the baseline distance information and the focal length information;
    基于所述可移动平台沿所述第一方向上的速度限制量,调整所述可移动平台沿所述第一方向上的运动速度。The speed of movement of the movable platform in the first direction is adjusted based on the speed limit of the movable platform in the first direction.
  56. 根据权利要求55所述的可移动平台,其特征在于,所述可移动平台运动过程中通过平移改变运动轨迹;The movable platform according to claim 55, wherein the movement trajectory is changed by translation during the movement of the movable platform;
    所述处理器具体被配置为:The processor is specifically configured to:
    基于调整所得所述可移动平台沿所述第一方向上的运动速度和所述重叠观测范围的视场角,确定所述可移动平台沿第二方向上的运动速度限制量;Determine the movement speed limit of the movable platform along the second direction based on the obtained movement speed of the movable platform along the first direction and the field angle of the overlapping observation range;
    基于所述可移动平台沿所述第二方向上的速度限制量,调整所述可移动平台沿所述第二方向上的运动速度;adjusting the speed of movement of the movable platform in the second direction based on a speed limit of the movable platform in the second direction;
    其中所述第二方向垂直于所述第一方向。wherein the second direction is perpendicular to the first direction.
  57. 根据权利要求55所述的可移动平台,其特征在于,所述可移动平台运动过程中通过旋转改变运动轨迹,所述处理器具体被配置为:The movable platform according to claim 55, wherein, during the movement of the movable platform, the movement trajectory is changed by rotation, and the processor is specifically configured to:
    对所述可移动平台在预设时长后的运动速度的指向进行预测;Predicting the direction of the movement speed of the movable platform after a preset period of time;
    若所述预设时长后的运动速度的指向超出所述重合观测范围对应的视场角范围,调整当前时刻可移动平台航向轴和/或俯仰轴上的角速度,以使所述预设时长后的运动速度的指向在所述重合观测范围对应的视场角范围内。If the direction of the motion speed after the preset time exceeds the field of view angle range corresponding to the overlapping observation range, adjust the angular velocity on the pan axis and/or the pitch axis of the movable platform at the current moment so that the preset time The direction of the movement speed is within the range of the field angle corresponding to the coincident observation range.
  58. 根据权利要求57所述的可移动平台,其特征在于,所述处理器具体被配置为:The movable platform of claim 57, wherein the processor is specifically configured to:
    基于调整后的所述可移动平台沿所述第一方向上的运动速度和当前时刻航向轴和/或俯仰轴上的角速度预测预设时长内可移动平台的运动轨迹;Predicting the movement trajectory of the movable platform within a preset period of time based on the adjusted movement speed of the movable platform in the first direction and the angular velocity on the pan axis and/or the pitch axis at the current moment;
    基于所述运动轨迹确定所述预设时长后可移动平台的运动速度的指 向。The direction of the movement speed of the movable platform after the preset time period is determined based on the movement track.
  59. 根据权利要求49所述的可移动平台,其特征在于,所述可移动平台的运动速度的指向与所述重合观测范围对应的视场角范围的边界所呈的夹角不小于预设的第一角度裕量。The movable platform according to claim 49, wherein the moving speed of the movable platform points to the boundary of the field of view angle range corresponding to the overlapping observation range, and the included angle is not less than a preset first An angular margin.
  60. 根据权利要求49所述的可移动平台,其特征在于,所述可移动平台为无人机。The movable platform of claim 49, wherein the movable platform is an unmanned aerial vehicle.
  61. 一种可移动平台,所述可移动平台包括第一视觉传感器和第二视觉传感器,所述第一视觉传感器和所述第二视觉传感器的具有重叠观测范围,其特征在于,所述可移动平台还包括:A movable platform, the movable platform includes a first visual sensor and a second visual sensor, and the first visual sensor and the second visual sensor have overlapping observation ranges, characterized in that the movable platform Also includes:
    处理器;processor;
    用于存储处理器可执行指令的存储器;memory for storing processor-executable instructions;
    所述处理器被配置为:The processor is configured to:
    获取所述第一视觉传感器和所述第二视觉传感器的重叠观测范围的参数信息,所述参数信息包括所述重叠观测范围对应的视场角;acquiring parameter information of overlapping observation ranges of the first vision sensor and the second vision sensor, where the parameter information includes a field of view angle corresponding to the overlapping observation ranges;
    根据所述重叠观测范围的所述参数信息调整所述可移动平台的运动速度控制量,以使所述可移动平台的运动速度的指向处于所述重叠观测范围对应的视场角范围内。The movement speed control amount of the movable platform is adjusted according to the parameter information of the overlapping observation range, so that the direction of the movement speed of the movable platform is within a field angle range corresponding to the overlapping observation range.
  62. 根据权利要求61所述的可移动平台,其特征在于,所述重叠观测范围的参数信息还包括观测距离。The movable platform according to claim 61, wherein the parameter information of the overlapping observation range further comprises an observation distance.
  63. 根据权利要求62所述的可移动平台,其特征在于,所述处理器还被配置为:The movable platform of claim 62, wherein the processor is further configured to:
    根据所述第一视觉传感器的观测数据和所述第二视觉传感器的观测数据,确定所述重叠观测范围内观测的对象的距离信息;According to the observation data of the first visual sensor and the observation data of the second visual sensor, determine the distance information of the object observed in the overlapping observation range;
    根据所述距离信息调整所述重叠观测范围的所述参数信息。The parameter information of the overlapping observation range is adjusted according to the distance information.
  64. 根据权利要求63所述的可移动平台,其特征在于,所述处理器具体被配置为:The movable platform of claim 63, wherein the processor is specifically configured to:
    根据所述距离信息调整所述第一视觉传感器和所述第二视觉传感器的 焦距信息;和/或adjusting the focal length information of the first vision sensor and the second vision sensor according to the distance information; and/or
    根据所述距离信息调整所述第一视觉传感器和所述第二视觉传感器的基线距离信息。The baseline distance information of the first vision sensor and the second vision sensor is adjusted according to the distance information.
  65. 根据权利要求61所述的可移动平台,其特征在于,所述运动速度控制量包括:所述可移动平台的运动速度和/或运动速度的限制量。The movable platform according to claim 61, wherein the movement speed control amount comprises: the movement speed and/or the limit amount of the movement speed of the movable platform.
  66. 根据权利要求62所述的可移动平台,其特征在于,所述处理器具体被配置为:The movable platform of claim 62, wherein the processor is specifically configured to:
    根据所述重叠观测范围的所述参数信息调整所述可移动平台沿第一方向上的运动速度控制量,所述第一方向垂直于所述第一视觉传感器和所述第二视觉传感器的基线延伸方向。Adjust the movement speed control amount of the movable platform along a first direction according to the parameter information of the overlapping observation range, the first direction being perpendicular to the baselines of the first vision sensor and the second vision sensor extension direction.
  67. 根据权利要求66所述的可移动平台,其特征在于,所述处理器具体被配置为:The movable platform of claim 66, wherein the processor is specifically configured to:
    基于所述重叠观测范围的观测距离确定所述可移动平台沿所述第一方向上的运动速度限制量;determining a movement speed limit amount of the movable platform along the first direction based on the observation distance of the overlapping observation range;
    基于所述可移动平台沿所述第一方向上的运动速度限制量,调整所述可移动平台沿所述第一方向上的运动速度。The movement speed of the movable platform in the first direction is adjusted based on the limit amount of the movement speed of the movable platform in the first direction.
  68. 根据权利要求67所述的可移动平台,其特征在于,所述可移动平台运动过程中通过平移改变运动轨迹;The movable platform according to claim 67, wherein the movement trajectory of the movable platform is changed by translation during the movement of the movable platform;
    所述处理器具体被配置为:The processor is specifically configured to:
    基于调整所得所述可移动平台沿所述第一方向上的运动速度和所述重叠观测范围对应的视场角,确定所述可移动平台沿第二方向上的运动速度限制量;Determine the movement speed limit of the movable platform along the second direction based on the obtained movement speed of the movable platform along the first direction and the field angle corresponding to the overlapping observation range;
    基于所述可移动平台沿所述第二方向上的速度限制量,调整所述可移动平台沿所述第二方向上的运动速度;adjusting the speed of movement of the movable platform in the second direction based on a speed limit of the movable platform in the second direction;
    其中所述第二方向垂直于所述第一方向。wherein the second direction is perpendicular to the first direction.
  69. 根据权利要求67所述的可移动平台,其特征在于,所述可移动平台运动过程中通过旋转改变运动轨迹,所述处理器具体被配置为:The movable platform according to claim 67, wherein, during the movement of the movable platform, the movement trajectory is changed by rotation, and the processor is specifically configured to:
    对所述可移动平台在预设时长后的运动速度的指向进行预测;Predicting the direction of the movement speed of the movable platform after a preset period of time;
    若所述预设时长后的运动速度的指向超出所述重合观测范围对应的视场角范围,调整当前时刻可移动平台航向轴和/或俯仰轴上的角速度,以使所述预设时长后的运动速度的指向在所述重合观测范围对应的视场角范围内。If the direction of the motion speed after the preset time exceeds the field of view angle range corresponding to the overlapping observation range, adjust the angular velocity on the pan axis and/or the pitch axis of the movable platform at the current moment so that the preset time The direction of the movement speed is within the range of the field angle corresponding to the coincident observation range.
  70. 根据权利要求69所述的可移动平台,其特征在于,所述处理器具体被配置为:The movable platform of claim 69, wherein the processor is specifically configured to:
    基于调整后的所述可移动平台沿所述第一方向上的运动速度和当前时刻航向轴上的角速度、俯仰轴上的角速度预测预设时长内可移动平台的运动轨迹;Predicting the movement trajectory of the movable platform within a preset period of time based on the adjusted movement speed of the movable platform along the first direction and the angular velocity on the pan axis and the angular velocity on the pitch axis at the current moment;
    基于所述运动轨迹确定所述预设时长后可移动平台的运动速度的指向。The direction of the movement speed of the movable platform after the preset time period is determined based on the movement trajectory.
  71. 根据权利要求61所述的可移动平台,其特征在于,所述可移动平台的运动速度的指向与所述重合观测范围对应的视场角范围的边界所呈的夹角不小于预设的第一角度裕量。The movable platform according to claim 61, wherein the moving speed of the movable platform points to the boundary of the field of view angle range corresponding to the overlapping observation range, and the included angle is not less than a preset first An angular margin.
  72. 根据权利要求61所述的可移动平台,其特征在于,所述可移动平台为无人机。The movable platform of claim 61, wherein the movable platform is an unmanned aerial vehicle.
PCT/CN2020/137173 2020-12-17 2020-12-17 Control method and device for movable platform, and movable platform WO2022126477A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080077986.6A CN114846295A (en) 2020-12-17 2020-12-17 Control method and device for movable platform and movable platform
PCT/CN2020/137173 WO2022126477A1 (en) 2020-12-17 2020-12-17 Control method and device for movable platform, and movable platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/137173 WO2022126477A1 (en) 2020-12-17 2020-12-17 Control method and device for movable platform, and movable platform

Publications (1)

Publication Number Publication Date
WO2022126477A1 true WO2022126477A1 (en) 2022-06-23

Family

ID=82059957

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/137173 WO2022126477A1 (en) 2020-12-17 2020-12-17 Control method and device for movable platform, and movable platform

Country Status (2)

Country Link
CN (1) CN114846295A (en)
WO (1) WO2022126477A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117237438A (en) * 2023-09-18 2023-12-15 共享数据(福建)科技有限公司 Range matching method and terminal for three-dimensional model and unmanned aerial vehicle video data

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101408422A (en) * 2008-10-16 2009-04-15 浙江工业大学 Traffic accident on-site mapper based on binocular tridimensional all-directional vision
CN101969548A (en) * 2010-10-15 2011-02-09 中国人民解放军国防科学技术大学 Active video acquiring method and device based on binocular camera shooting
CN108052111A (en) * 2017-10-24 2018-05-18 南京奇蛙智能科技有限公司 A kind of unmanned plane Real-time Obstacle Avoidance Method based on binocular vision technology
US20200125101A1 (en) * 2016-08-12 2020-04-23 Skydio, Inc. Unmanned aerial image capture platform
CN111556309A (en) * 2020-04-03 2020-08-18 青岛联合创智科技有限公司 Control method of binocular tripod head with variable base line
CN111684458A (en) * 2019-05-31 2020-09-18 深圳市大疆创新科技有限公司 Target detection method, target detection device and unmanned aerial vehicle

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016154869A1 (en) * 2015-03-31 2016-10-06 SZ DJI Technology Co., Ltd. System and method for mobile platform operation
WO2018187916A1 (en) * 2017-04-10 2018-10-18 深圳市大疆创新科技有限公司 Cradle head servo control method and control device
CN108965651A (en) * 2017-05-19 2018-12-07 深圳市道通智能航空技术有限公司 A kind of drone height measurement method and unmanned plane
CN108319295B (en) * 2018-01-22 2021-05-28 深圳市大疆创新科技有限公司 Obstacle avoidance control method, equipment and computer readable storage medium
CN110007313A (en) * 2019-03-08 2019-07-12 中国科学院深圳先进技术研究院 Obstacle detection method and device based on unmanned plane

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101408422A (en) * 2008-10-16 2009-04-15 浙江工业大学 Traffic accident on-site mapper based on binocular tridimensional all-directional vision
CN101969548A (en) * 2010-10-15 2011-02-09 中国人民解放军国防科学技术大学 Active video acquiring method and device based on binocular camera shooting
US20200125101A1 (en) * 2016-08-12 2020-04-23 Skydio, Inc. Unmanned aerial image capture platform
CN108052111A (en) * 2017-10-24 2018-05-18 南京奇蛙智能科技有限公司 A kind of unmanned plane Real-time Obstacle Avoidance Method based on binocular vision technology
CN111684458A (en) * 2019-05-31 2020-09-18 深圳市大疆创新科技有限公司 Target detection method, target detection device and unmanned aerial vehicle
CN111556309A (en) * 2020-04-03 2020-08-18 青岛联合创智科技有限公司 Control method of binocular tripod head with variable base line

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117237438A (en) * 2023-09-18 2023-12-15 共享数据(福建)科技有限公司 Range matching method and terminal for three-dimensional model and unmanned aerial vehicle video data

Also Published As

Publication number Publication date
CN114846295A (en) 2022-08-02

Similar Documents

Publication Publication Date Title
WO2019113966A1 (en) Obstacle avoidance method and device, and unmanned aerial vehicle
WO2020107372A1 (en) Control method and apparatus for photographing device, and device and storage medium
CN108351650B (en) Flight control method and device for aircraft and aircraft
WO2017020150A1 (en) Image processing method, device and camera
WO2019127344A1 (en) Pan-tilt head reset control method and device, pan-tilt head, and unmanned aerial vehicle
WO2021016897A1 (en) Aerial survey method, photographing control method, aerial vehicle, terminal, system, and storage medium
US11064123B2 (en) Method and Apparatus for zooming relative to an object
WO2020019106A1 (en) Gimbal and unmanned aerial vehicle control method, gimbal, and unmanned aerial vehicle
WO2019127094A1 (en) Unmanned aerial vehicle and unmanned aerial vehicle control method and apparatus
WO2019095210A1 (en) Smart glasses, method for controlling gimbal by means of same, gimbal, control method and unmanned aerial vehicle
WO2017201698A1 (en) Method and apparatus for tracking target
JP2017062529A (en) Direction control method
US20210325886A1 (en) Photographing method and device
US20210349461A1 (en) Unmanned aerial vehicle, method for controlling unmanned aerial vehicle, control apparatus, and computer-readable storage medium
US20210276700A1 (en) Control method and device for unmanned aerial vehicle, and unmanned aerial vehicle
JP2015002522A (en) Surveillance camera and surveillance camera control method
CN112514366A (en) Image processing method, image processing apparatus, and image processing system
WO2020024182A1 (en) Parameter processing method and apparatus, camera device and aircraft
WO2019148348A1 (en) Tripod head control method and apparatus
JP6758828B2 (en) Imaging system and its control method
WO2022193081A1 (en) Method and apparatus for controlling unmanned aerial vehicle, and unmanned aerial vehicle
WO2022126477A1 (en) Control method and device for movable platform, and movable platform
WO2019205103A1 (en) Pan-tilt orientation correction method, pan-tilt orientation correction apparatus, pan-tilt, pan-tilt system, and unmanned aerial vehicle
WO2021217408A1 (en) Unmanned aerial vehicle system, and control method and device therefor
WO2020062024A1 (en) Distance measurement method and device based on unmanned aerial vehicle and unmanned aerial vehicle

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20965494

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20965494

Country of ref document: EP

Kind code of ref document: A1