WO2021134644A1 - Gimbal control method and gimbal - Google Patents

Gimbal control method and gimbal Download PDF

Info

Publication number
WO2021134644A1
WO2021134644A1 PCT/CN2019/130861 CN2019130861W WO2021134644A1 WO 2021134644 A1 WO2021134644 A1 WO 2021134644A1 CN 2019130861 W CN2019130861 W CN 2019130861W WO 2021134644 A1 WO2021134644 A1 WO 2021134644A1
Authority
WO
WIPO (PCT)
Prior art keywords
axis
pan
tilt
euler angle
target
Prior art date
Application number
PCT/CN2019/130861
Other languages
French (fr)
Chinese (zh)
Inventor
林荣华
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201980052066.6A priority Critical patent/CN112544065A/en
Priority to PCT/CN2019/130861 priority patent/WO2021134644A1/en
Publication of WO2021134644A1 publication Critical patent/WO2021134644A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D3/00Control of position or direction
    • G05D3/12Control of position or direction using feedback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices

Definitions

  • This application relates to the field of pan-tilt, and in particular to a method for controlling a pan-tilt and a pan-tilt.
  • This application provides a method for controlling a pan-tilt and a pan-tilt.
  • a method for controlling a pan/tilt the pan/tilt is mounted on a base, the pan/tilt is mounted with a photographing device, and the pan/tilt is configured to rotate around at least two axes ,
  • the method includes:
  • the attitude control amount sent by the control device of the pan/tilt head is received, the attitude control amount will be adjusted according to the Euler angle rotation sequence of the camera. Performing conversion to obtain the first target Euler angle component of the photographing device;
  • the posture of the at least two axes changes following the posture of the base.
  • a pan-tilt including:
  • a shaft assembly provided on the base, the shaft assembly is used to mount a photographing device, and the shaft assembly is configured to rotate about at least two shafts;
  • a controller the controller is electrically connected to the pan-tilt, and the controller is used for:
  • the attitude control amount sent by the control device of the pan/tilt head is received, the attitude control amount will be adjusted according to the Euler angle rotation sequence of the camera. Performing conversion to obtain the first target Euler angle component of the photographing device;
  • the posture of the at least two axes changes following the posture of the base.
  • the attitude control value sent by the control device is converted to obtain the first target Euler angle component of the camera , And then determine the target Euler angle of the camera according to the first target Euler angle component and the second target Euler angle component determined according to the real-time detection attitude of the base, and control the pan/tilt rotation according to the target Euler angle, and the user is controlling the cloud
  • the screen of the camera rotates around the world coordinate system, the direction of the screen rotation is more in line with the user's requirements, and the screen is more in line with the user's expectations.
  • Figure 1 is a perspective view of a pan-tilt in an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a method flow chart of a method for controlling a pan-tilt in an embodiment of the present application
  • Figure 3 is a perspective view of the handheld PTZ shown in Figure 1 when it is placed upright;
  • FIG. 4A is a schematic diagram of the photographing device in an embodiment of the present application when photographing in a horizontal orientation
  • 4B is a schematic diagram of the photographing device in an embodiment of the present application when photographing in a vertical orientation
  • FIG. 5 is a schematic flow chart of an implementation manner of controlling the rotation of the pan/tilt head according to the target Euler angle in an embodiment of the present application
  • Fig. 6 is a schematic diagram of a preset interpolation strategy in an embodiment of the present application.
  • FIG. 7 is a schematic flow chart of a method for controlling a pan-tilt in an embodiment of the present application.
  • Fig. 8 is a structural block diagram of a pan-tilt in an embodiment of the present application.
  • the existing gimbal can realize joystick control in the joint coordinate system in the FPV (First Person View) follow mode of the first-person main view.
  • the control device is a remote control
  • the amount of rod generated by the remote sensor may correspond to a joint Angle rotation
  • the pan/tilt controls a joint angle correspondingly, and other joint angles are not affected.
  • the picture taken by the camera rotates around the joint coordinate system, and the picture may not meet the user's expectations. Therefore, this kind of joystick control is realized on the joint coordinate system.
  • the method is not convenient for the operator to control the screen direction. Among them, in the joint coordinate system, each axis of the pan/tilt moves independently.
  • the attitude control amount sent by the control device is converted to obtain the first target Euler angle component of the camera, and then according to the first target Euler angle component.
  • the target Euler angle component and the second target Euler angle component determined according to the real-time detection attitude of the base determine the target Euler angle of the camera, and control the rotation of the pan/tilt according to the target Euler angle.
  • the camera is taken.
  • the screen of the device rotates around the world coordinate system, the rotation direction of the screen is more in line with the user's requirements, and the screen is more in line with the user's expectations.
  • the gimbal is a three-axis handheld gimbal
  • the handle of the handheld gimbal is tilted at this time
  • control in the corresponding attitude If the amount is only converted to a joint angle, at this time, the pitch motor can be driven to rotate, but the roll motor and yaw motor will not rotate. Because the camera rotates around the body coordinate system, the changes in the shooting screen will be more rigid and abrupt.
  • the pan/tilt in the embodiment of the present application is mounted on a base, the pan/tilt is mounted with a photographing device, and the pan/tilt is configured to rotate around at least two axes.
  • the camera when the base is tilted, the camera can rotate around the world coordinate system under the control of the pan/tilt.
  • the shooting device can be a camera, a SLR, a mirrorless single, a sports camera, a smart phone, and other shooting devices.
  • the pan/tilt is configured to rotate around at least two axes.
  • the pan/tilt head of this embodiment may be configured to rotate around two axes, or it may be configured to rotate around three axes or more than three axes.
  • the pan/tilt is configured to rotate about two axes, the two axes including a yaw axis and a pitch axis.
  • the pan/tilt is configured to rotate around three axes, the three axes including the yaw axis, the pitch axis, and the roll axis.
  • the pan/tilt in the embodiments of the present application may be a handheld pan/tilt or an airborne pan/tilt.
  • the airborne pan/tilt may be mounted on a movable platform, which may be an unmanned aerial vehicle, an unmanned vehicle, a mobile robot, etc. .
  • the pan/tilt is a handheld pan/tilt, and the pan/tilt is a three-axis pan/tilt.
  • the pan/tilt in this embodiment is configured to rotate around the yaw axis, pitch axis, and roll axis.
  • the handheld gimbal may include an outer frame 11, a middle frame 12, and an inner frame.
  • the outer frame 11 is configured to rotate about a yaw axis
  • the middle frame 12 is configured to rotate about a roll axis
  • the inner frame is configured to rotate about a pitch axis
  • the inner frame is used to mount the camera 2.
  • the outer frame 11 includes a yaw axis arm and is driven by a yaw axis motor
  • the middle frame 12 includes a roll axis arm and is driven by a roll axis motor
  • the inner frame includes a pitch axis arm and is driven by a pitch axis motor driven.
  • pan-tilt control method in the embodiment of the present application will be described below.
  • FIG. 2 is a schematic flow chart of a method for controlling a pan-tilt in an embodiment of the present application; please refer to FIG. 2, the method for controlling a pan-tilt according to an embodiment of the present application may include the following steps:
  • the yaw axis, roll axis, and pitch axis are all in follow mode.
  • the roll axis is in free mode, the roll axis is used for stabilization, and the pitch axis and/or yaw axis are in follow mode.
  • the free mode the base of the pan/tilt moves, but the corresponding arm of the pan/tilt does not rotate.
  • the follow mode the corresponding axis moves with the movement of the base of the pan/tilt.
  • the control device can be a mobile terminal such as a mobile phone, a tablet computer, or a fixed terminal, or a remote control or other device capable of controlling the rotating structure, and can also be integrated on the handle of the pan-tilt.
  • the control device is a remote control, and the amount of posture control is determined according to the amount of stick generated by the user operating the joystick of the remote control.
  • step S201 is to directly convert the attitude control amount to obtain the first target Euler angle component of the shooting device according to the Euler angle rotation sequence of the shooting device, but the attitude control amount is less than the first target Euler angle component.
  • the conversion between is not a simple correspondence.
  • the conversion in this embodiment may include the conversion of the Euler angular velocity of the pan/tilt rotation, or the conversion of the Euler angle of the pan/tilt rotation.
  • the conversion is the conversion of the Euler angular velocity of the pan/tilt rotation
  • the first target Euler angular component is the Euler angular velocity.
  • the conversion is the conversion of the Euler angle size of the pan/tilt rotation
  • the first target Euler angle component is the Euler angle size.
  • the Euler angle rotation sequence of the camera needs to be determined according to the shooting orientation of the camera.
  • the Euler angle of the camera corresponds to the rotation of the first axis, the second axis, and the third axis, where the first axis is parallel to the light of the camera.
  • the axis direction, the first axis, the second axis, and the third axis are orthogonal to each other.
  • the direction of the first axis, the direction of the second axis, and the direction of the third axis are determined according to the placement direction of the camera and the direction of the optical axis.
  • the camera is placed in a horizontal orientation and the optical axis of the camera is parallel to In the horizontal plane, the third axis is the vertical direction, and both the first axis and the second axis are parallel to the horizontal plane.
  • the first axis corresponds to the roll axis
  • the second axis corresponds to the pitch axis
  • the third axis corresponds to the yaw axis.
  • the first axis, the second axis, and the third axis are denoted by X, Y, and Z, respectively.
  • the camera is in the horizontal orientation shooting mode, and the rotation sequence of the Euler angle of the camera is: the third axis, the first axis, the second axis, or the second axis, the first axis, and the third axis.
  • the rotation sequence of the Euler angle of the camera is: the third axis, the first axis, the second axis, or the second axis, the first axis, and the third axis.
  • the configuration of the pan-tilt it is determined which of the above-mentioned Euler angle rotation sequence of the photographing device corresponding to the switched control instruction is.
  • the Euler angle rotation sequence of the camera is: the third axis, the first axis, and the second axis.
  • the Euler angle rotation sequence of the camera is: the second axis, the first axis, and the third axis.
  • the component of the attitude control quantity used to control the rotation of the gimbal around the yaw axis is obtained by conversion based on the third axis in the Euler angle rotation sequence, and the attitude control quantity is used for control
  • the component of the gimbal's rotation around the pitch axis is converted based on the second axis in the Euler angle rotation sequence, and the component used to control the gimbal's rotation around the roll axis in the attitude control quantity is the first component in the rotation sequence based on the Euler angle.
  • One-axis conversion is obtained.
  • the gimbal is in the ZXY configuration
  • the Euler angle rotation sequence of the camera is: Z, X, Y
  • the component used to control the rotation of the gimbal around the yaw axis in the attitude control is converted to obtain the camera's The Euler angular velocity or Euler angle of rotation around Z in the Euler angle rotation sequence
  • convert the component used to control the rotation of the gimbal around the pitch axis in the attitude control quantity to obtain the Euler angle rotation sequence of the camera around Y
  • the component used to control the rotation of the gimbal around the roll axis in the attitude control is converted to obtain the Euler angular velocity or the Euler angle rotating around X in the Euler angle rotation sequence of the camera.
  • the gimbal is in the YXZ configuration, and the Euler angle rotation sequence of the camera is: Y, X, Z.
  • the component used to control the rotation of the gimbal around the yaw axis in the attitude control is converted to obtain the Euler angle of the camera.
  • the Euler angular velocity or Euler angle of rotation around Z in the pull angle rotation sequence convert the component used to control the rotation of the gimbal around the pitch axis in the attitude control quantity to obtain the Euler angle rotation sequence of the camera to rotate around Y
  • the Euler angular velocity or Euler angle size of the angle convert the component used to control the rotation of the gimbal around the roll axis in the attitude control quantity to obtain the Euler angular velocity or Euler angle rotating around X in the Euler angle rotation sequence of the camera Angle size.
  • the camera is in the vertical orientation shooting mode, and the rotation sequence of the Euler angle of the camera is: second axis, first axis, second axis, or third axis, first axis, third axis .
  • the Euler angle rotation sequence of the camera corresponding to the switched control instruction is determined according to the configuration of the pan/tilt head, which one of the above Euler angle rotation sequences is, optionally, when the pan/tilt head is in the ZXY configuration , The Euler angle rotation sequence of the camera is: the third axis, the first axis, and the third axis.
  • the Euler angle rotation sequence of the camera is: the second axis, the first axis, and the second axis.
  • the attitude control quantity is used to control the pan/tilt to rotate around the yaw axis
  • the component and the component used to control the rotation of the gimbal around the pitch axis are obtained by conversion based on the second axis in the Euler angle rotation sequence.
  • the component used to control the rotation of the gimbal around the roll axis in the attitude control quantity is based on the Euler angle rotation.
  • the first axis in the rotation sequence of the pull angle is converted.
  • the Euler angle rotation sequence of the shooting device is: Y, X, Y, and the components used to control the rotation of the gimbal around the yaw axis in the attitude control value are converted to obtain the Euler angle rotation sequence of the shooting device
  • the Euler angular velocity or Euler angle size of the rotation around the first Y convert the component used to control the rotation of the gimbal around the pitch axis in the attitude control quantity to obtain the Euler angle rotation sequence of the camera to rotate around the second Y
  • the Euler angular velocity or Euler angle size of the angle convert the component used to control the rotation of the gimbal around the roll axis in the attitude control quantity to obtain the Euler angular velocity or Euler angle rotating around X in the Euler angle rotation sequence of the camera Angle size.
  • the Euler angle rotation sequence of the camera is: third axis, first axis, third axis, the component of the attitude control quantity used to control the rotation of the gimbal around the yaw axis, And the component used to control the rotation of the gimbal around the pitch axis is obtained by conversion based on the third axis in the Euler angle rotation sequence, and the component used to control the rotation of the gimbal around the roll axis in the attitude control quantity is based on the Euler angle
  • the first axis in the rotation sequence is transformed.
  • the Euler angle rotation sequence of the shooting device is: Z, X, Z, and the components used to control the rotation of the pan/tilt around the yaw axis in the attitude control value are converted to obtain the Euler angle rotation sequence of the shooting device
  • the Euler angular velocity or Euler angle of rotation around the first Z convert the component used to control the rotation of the gimbal around the pitch axis in the attitude control quantity to obtain the Euler angle rotation sequence of the camera to rotate around the second Z
  • the Euler angular velocity or Euler angle size of the angle convert the component used to control the rotation of the gimbal around the roll axis in the attitude control quantity to obtain the Euler angular velocity or Euler angle rotating around X in the Euler angle rotation sequence of the camera Angle size.
  • a three-axis gimbal and the gimbal is configured to rotate around the yaw axis, pitch axis, and roll axis as an example to illustrate the gimbal of the ZXY configuration and the gimbal of the YXZ configuration.
  • the ZXY configuration gimbal when the gimbal is placed upright and the joint angles of the outer frame, middle frame and inner frame are all 0 degrees, the outer frame rotates around the yaw axis, the middle frame rotates around the roll axis, and the inner frame Rotate around the pitch axis.
  • the handheld pan/tilt also includes a handle 3 and a screen 4 and buttons (not shown) provided on the front of the handle 3.
  • the screen 4 faces the user, and the lens of the shooting device is facing away from the user.
  • FIG. 3 it is a state diagram of the handheld PTZ placed upright.
  • the handheld PTZ shown in Figure 3 is a ZXY configuration PTZ.
  • horizontal orientation shooting may also be referred to as horizontal shooting
  • vertical orientation shooting may also be referred to as vertical shooting
  • the horizontal orientation of the shooting device means that the shooting device is installed horizontally on the pan/tilt support, so that it can take a horizontal picture relative to the horizontal plane.
  • the shooting device is a mobile phone as an example, please refer to Figure 4A, 10 is the horizontal plane, 20 is the long side of the screen, and 30 is the short side of the screen. Rotate the long side 20 of the screen to the horizontal direction (that is, the long side 20 of the screen is parallel to the horizontal plane 10) for shooting.
  • the device is photographed in a horizontal orientation.
  • the shooting device in the vertical orientation means that the shooting device is installed vertically on the pan/tilt support to take a vertical picture with respect to the horizontal plane.
  • the embodiment in which the above-mentioned shooting device is a mobile phone is used. Please refer to Fig. 4B.
  • the long side 20 is rotated to the vertical direction (that is, the long side 20 of the picture is perpendicular to the horizontal plane) for shooting, that is, the shooting device shoots in a vertical orientation.
  • the exemplary definitions of horizontal shooting and vertical shooting can also be completely opposite to the above description.
  • S202 Determine the target Euler angle of the camera according to the first target Euler angle component and the second target Euler angle component of the camera, and the second target Euler angle component is determined according to the real-time detection attitude of the base;
  • step S201 is omitted, and the target Euler angle in step S202 is determined according to the second target Euler angle component.
  • the attitude of the camera is controlled to follow the attitude of the base.
  • the priority of the control device to control the pan/tilt is higher than the priority of the attitude of the pan/tilt following the base, that is, when the attitude control amount sent by the control device is acquired.
  • the pan/tilt is not only controlled by the control device, but also follows the attitude of the base.
  • the process of determining the target Euler angle of the camera may include: according to the first target Euler angle component and the second target Euler angle component of the camera.
  • the sum of the target Euler angle components determines the target Euler angle of the camera.
  • target Euler angle (first target Euler angle component+second target Euler angle component).
  • the real-time detection attitude of the pedestal can be characterized by the real-time attitude quaternion of the pedestal, or the real-time attitude Euler angle of the pedestal.
  • the method for acquiring the real-time detection attitude of the base may include: acquiring the real-time attitude quaternion of the camera; and determining the real-time attitude quaternion of the base according to the real-time attitude quaternion of the camera.
  • the real-time attitude quaternion of is used to characterize the real-time detection attitude of the base.
  • the real-time posture quaternion of the camera can be obtained through the detection of an inertial measurement unit (IMU, Inertial Measurement Unit) provided on the camera.
  • IMU Inertial Measurement Unit
  • the IMU can also be set on the inner frame of the pan/tilt.
  • a handheld pan/tilt is taken as an example to illustrate how to determine the real-time attitude quaternion of the base according to the real-time attitude quaternion of the camera.
  • the base is the handle of the handheld pan/tilt.
  • the handheld pan/tilt in this embodiment also includes an accelerometer, which is used to detect the real-time posture quaternion qmesa of the camera.
  • the real-time attitude quaternion of the handle is determined according to the real-time attitude quaternion of the camera and the joint angle of the gimbal. Take a three-axis gimbal with a ZXY configuration as an example.
  • the joint angle of the gimbal includes the yaw joint angle.
  • each joint angle is the joint angle of the corresponding axis motor.
  • q_yaw, q_roll and q_pitch are obtained.
  • the conjugate or inverse of q_yaw, q_roll and q_pitch are q_yaw_inv, q_roll_inv and q_pitch_inv respectively.
  • the calculation formula of the real-time attitude quaternion qhandle of the handle is as follows:
  • joint represents the joint angle
  • q represents the quaternion
  • an inertial measurement unit is provided on the base, and the real-time detection attitude of the base is obtained through the detection of the inertial measurement unit on the base.
  • the realization process of determining the second target Euler angle component based on the real-time detection attitude of the base may include: the second target Euler angle component is based on the real-time detection attitude of the base and the relationship between the camera and the base. The preset attitude deviation between the two is determined.
  • the real-time attitude quaternion of the base is obtained by the above formula (1), and the preset attitude deviation is also characterized by quaternion, that is, the preset attitude quaternion deviation offset, and the second target Euler angle component corresponds to
  • the target posture quaternion component is determined according to the product of the real-time posture quaternion of the base and the offset, and then the second target Euler angle component is determined according to the target posture quaternion component corresponding to the second target Euler angle component.
  • the target attitude quaternion component corresponding to the second target Euler angle component real-time attitude quaternion of the base*offset.
  • the size of the preset attitude deviation can be set as required.
  • the preset attitude deviation is the attitude deviation between the camera and the base when the pan/tilt enters the FPV follow mode; of course, the preset attitude deviation can also be other settings. Set attitude deviation.
  • Fig. 5 is a schematic flow chart of an implementation method of controlling the rotation of the gimbal according to the target Euler angle in an embodiment of the present application; please refer to Fig. 5, the realization process of controlling the rotation of the gimbal according to the target Euler angle may include:
  • S501 Determine the quaternion of the target posture of the shooting device according to the target Euler angle
  • the camera is in the horizontal orientation shooting mode
  • the rotation sequence of the Euler angle of the camera is: Z, X, Y
  • the conversion formula of Euler angle to quaternion is as follows :
  • q is the converted quaternion
  • Inn_Y, Mid_X, and Out_Z are the Euler angles of the corresponding ZXY rotation sequence.
  • the target Euler angle can be converted into a target attitude quaternion.
  • S502 Determine the joint angle of the gimbal according to the quaternion of the target posture
  • the target joint angle of the pan/tilt head is determined based on the quaternion attitude deviation and the Jacobian inverse matrix.
  • the target joint angle includes the joint angle corresponding to the yaw motor, the joint angle corresponding to the roll motor, and the joint angle corresponding to the pitch motor.
  • the yaw motor It is used to control the gimbal to rotate around the yaw axis
  • the roll motor is used to control the gimbal to rotate around the roll axis
  • the pitch motor is used to control the gimbal to rotate around the pitch axis.
  • the current posture quaternion of the camera is different from the target posture quaternion, and the implementation process of S502 may include but is not limited to the following steps:
  • the preset interpolation strategy can be selected according to needs.
  • it is determined at least between the current pose quaternion and the target pose quaternion.
  • the realization process of an intermediate posture quaternion may include: determining at least one middle position between the current posture quaternion and the target posture quaternion according to the current posture quaternion, the target posture quaternion, and at least one time change parameter Posture quaternion.
  • at least one time change parameter corresponds to at least one intermediate posture quaternion one-to-one.
  • the time change parameter includes multiple, and the direction of the posture switching from the current posture quaternion to the target posture quaternion, and the time change parameters corresponding to the multiple intermediate posture quaternions show an increasing trend.
  • the quaternion smoothing interpolation algorithm slerp is used, such as The following calculation formula calculates the intermediate attitude quaternion q t :
  • t is a time parameter that varies from 0 to 1
  • is the angle difference between directions q 0 to q 1 , as shown in Figure 6.
  • t can also be a time parameter other than 0 to 1, which represents the time for the current attitude quaternion q 0 to change to the target attitude quaternion q 1 , and can be converted to 0 through normalized expressions. 1 time change parameter.
  • the magnitudes of the quaternion attitude deviations of the posture quaternions that are adjacent to each other are equal; alternatively, the magnitudes of the quaternion posture deviations of the posture quaternions that are adjacent to each other may not be equal.
  • the corresponding joint angle is determined according to the quaternion of each adjacent posture and the Euler angle rotation sequence of the camera; then according to the joint angle corresponding to each adjacent posture, from the quaternion of the current posture to the quaternion of the target posture To switch the direction of, control the rotation of the pan/tilt in turn to control the smooth rotation of the camera.
  • At least one intermediate pose quaternion is inserted between the current pose quaternion and the target pose quaternion.
  • the quaternion pose deviation corresponding to the adjacent pose is determined, and then
  • the quaternion posture deviation corresponding to the adjacent posture determine the joint angle corresponding to the adjacent posture, and then according to the joint angle corresponding to each adjacent posture, the direction of switching from the current posture to the target posture is controlled in turn to control the pan/tilt rotation to make the shooting
  • the device rotates smoothly.
  • the realization process of S503 may include: controlling the heading motor to rotate the joint angle corresponding to the heading motor, and control The roll motor rotates the joint angle corresponding to the roll motor, and controls the pitch motor to rotate the joint angle corresponding to the pitch motor.
  • the gimbal when the gimbal is in the normal follow mode, if you control the gimbal to center or take a selfie, the gimbal is in the joint coordinate system to achieve centering or self-timer control, and the gimbal cannot return to a horizontal neutral position as a shooting device. Starting point, it is not convenient for the gimbal operator to hold it with the handle tilted, level, and upside down, and thus cannot hold it in the posture that he likes, the most labor-saving, and the most conducive to shooting, so that it is easier to tilt the base slightly in an upright scene.
  • the pan/tilt when the pan/tilt is in the FPV follow mode, the pan/tilt can be controlled to switch to a preset target posture with one button, and the preset target posture may include the posture of the gimbal when returning to the center or the position of the gimbal.
  • the pitch joint angle is 0 degrees (self-timer).
  • the gimbal can be controlled by centering or self-timer in the world coordinate system. The gimbal can return to a horizontal middle position as the starting point of the shooting device, which is convenient for the operator to tilt, level, and hang upside down with the handle.
  • the method for controlling the pan/tilt may further include the following steps:
  • step S701 and step S702 it is realized that the pan/tilt is in the FPV follow mode, and the pan/tilt is controlled to switch to the preset target posture with one button, which is convenient for the operator of the pan/tilt to hold in the posture that he likes, is the most labor-saving, and is most conducive to shooting. .
  • the preset target posture can be set according to needs.
  • the preset target posture can include the posture of the pan/tilt when returning to the center, the pitch joint angle of the pan/tilt is 0 degrees (Selfie), and so on.
  • the preset target posture is the posture when the pan/tilt is returned to the center.
  • the specific plane in the coordinate system of the camera is parallel to the horizontal plane, and the direction of the optical axis of the camera is parallel. In a specific plane.
  • the lens of the photographing device faces forward (that is, the lens of the photographing device faces away from the user).
  • the optical axis direction of the shooting device is parallel to the horizontal plane, and the specific plane is also parallel to the horizontal plane.
  • the preset target posture is that the pitch joint angle of the gimbal is 0 degrees. At this time, the gimbal is in the Selfie mode. When the pitch joint angle of the gimbal is 0 degrees, the lens of the camera is facing the user and the lens It is easier to target users.
  • the gimbal as a handheld gimbal as an example, when the pitch joint angle of the gimbal is 0 degrees, if the handle is placed vertically, the specific plane in the coordinate system of the camera and the central axis of the handle (that is, the central axis in the length direction of the handle) Vertical; it should be understood that if the handle is placed obliquely, the specific plane in the coordinate system of the photographing device is perpendicular to the central axis of the handle.
  • the first trigger instruction can be generated in a variety of ways.
  • the pan/tilt includes a base and a control unit provided on the base, and the first trigger instruction is generated by the user triggering the control unit.
  • the control part may include keys, buttons, knobs or a combination of the above.
  • the control unit in this embodiment may include one or more.
  • the handheld pan/tilt may include a handle, and the control part may be provided on the handle.
  • the first trigger instruction is generated by the user operating the external device and sent by the external device.
  • the external device can communicate with the pan/tilt.
  • the external device may include a mobile terminal such as a mobile phone and a tablet computer, a fixed terminal, or a remote control or other control device of the pan/tilt.
  • control method of the pan/tilt may further include: when the pan/tilt is in the FPV follow mode, before acquiring the real-time attitude quaternion of the base, if a second trigger instruction indicating that the pan/tilt enters the FPV follow mode is acquired, then according to the first 2. Trigger the instruction to control the pan/tilt to enter the FPV follow mode. That is, before executing S201, it is necessary to trigger the pan-tilt to enter the FPV follow mode.
  • the second trigger instruction can be generated in a variety of ways.
  • the pan/tilt includes a base and a second control part provided on the base, and the second trigger instruction is generated by the user triggering the second control part.
  • the control part may include keys, buttons, knobs or a combination of the above.
  • the control unit in this embodiment may include one or more.
  • the handheld pan/tilt may include a handle, and the control part may be provided on the handle.
  • the second trigger instruction is generated by the user operating the external device and sent by the external device.
  • the external device can communicate with the pan/tilt.
  • the external device may include a mobile terminal such as a mobile phone and a tablet computer, a fixed terminal, or a remote control or other control device of the pan/tilt.
  • the embodiment of the present application also provides a pan/tilt head.
  • the pan/tilt head includes a base, a shaft assembly and a controller.
  • the shaft assembly is arranged on the base, and the shaft assembly is used to mount the imaging device.
  • the shaft assembly of this embodiment is configured to rotate around at least two axes.
  • the shaft assembly is configured to rotate around a yaw axis, a pitch axis, and a roll axis; optionally, the shaft assembly is configured to rotate around a yaw axis.
  • the axis and the pitch axis rotate.
  • the controller is electrically connected with the pan/tilt, and optionally, the controller is arranged on the base.
  • the controller is used for: when the pan/tilt is in the first-person main angle of view FPV follow mode, if it receives the attitude control amount sent by the control device of the pan/tilt, it will perform the attitude control amount according to the Euler angle rotation sequence of the camera.
  • the first target Euler angle component of the camera is obtained by conversion; the target Euler angle component of the camera is determined according to the first target Euler angle component and the second target Euler angle component of the camera, and the second target Euler angle component is It is determined according to the real-time detection attitude of the base; according to the target Euler angle, the pan/tilt is controlled to rotate; wherein, when the pan/tilt is in the FPV following mode, the attitude of at least two axes changes with the attitude of the base.
  • the controller in this embodiment may be a central processing unit (CPU).
  • the controller may further include a hardware chip.
  • the above-mentioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof.
  • the above-mentioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.
  • the base can be the handle of the handheld pan/tilt or be set on the handle of the handheld pan/tilt.
  • an embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the method for controlling the pan/tilt head of the above-mentioned embodiment are realized.
  • the computer-readable storage medium may be the internal storage unit of the pan/tilt head described in any of the foregoing embodiments, such as a hard disk or a memory.
  • the computer-readable storage medium may also be an external storage device of the pan-tilt, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash memory card (Flash Card), etc. equipped on the device .
  • the computer-readable storage medium may also include both an internal storage unit of the pan-tilt and an external storage device.
  • the computer-readable storage medium is used to store the computer program and other programs and data required by the pan/tilt, and can also be used to temporarily store data that has been output or will be output.
  • the program can be stored in a computer readable storage medium, and the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments.
  • the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

Abstract

A gimbal control method and a gimbal. The gimbal is mounted on a base, a photographic apparatus is mounted on the gimbal, and the gimbal is configured to rotate around at least two axes. The method comprises: when the gimbal is in a first person view (FPV) follow mode, if an attitude control amount sent by a gimbal control apparatus is received, converting the attitude control amount according to an Euler angle rotation sequence of the photographic apparatus to obtain a first target Euler angle component of the photographic apparatus; determining a target Euler angle of the photographic apparatus according to the first target Euler angle component and a second target Euler angle component of the photographic apparatus, wherein the second target Euler angle component is determined according to the real-time detection attitude of the base; and controlling the rotation of the gimbal according to the target Euler angle, wherein when the gimbal is in the FPV follow mode, the attitudes of at least two axes vary with the attitude of the base. According to the present application, when the rotation of the gimbal is controlled, a picture of the photographic apparatus rotates around a global coordinate system, and the picture better conforms to user expectation.

Description

云台的控制方法和云台PTZ control method and PTZ 技术领域Technical field
本申请涉及云台领域,尤其涉及一种云台的控制方法和云台。This application relates to the field of pan-tilt, and in particular to a method for controlling a pan-tilt and a pan-tilt.
背景技术Background technique
现有云台在第一人称主视角FPV(First Person View)跟随模式下,因功能设计定义不周或因技术限制,要么没有实现摇杆控制,要么在关节坐标系上实现摇杆控制,没法满足不同应用场景的需求、没法充分发挥各种控制装置的不同特性、不便于操作者实现画面方向的控制。Existing pan/tilt heads in the FPV (First Person View) follow mode, due to poorly defined function design or technical limitations, either did not achieve joystick control, or achieved joystick control in the joint coordinate system, which was impossible. To meet the needs of different application scenarios, it is impossible to give full play to the different characteristics of various control devices, and it is inconvenient for the operator to control the screen direction.
发明内容Summary of the invention
本申请提供一种云台的控制方法和云台。This application provides a method for controlling a pan-tilt and a pan-tilt.
根据本申请的第一方面,提供一种云台的控制方法,所述云台搭载在基座上,所述云台上搭载有拍摄装置,所述云台被配置为绕至少二个轴转动,所述方法包括:According to a first aspect of the present application, there is provided a method for controlling a pan/tilt, the pan/tilt is mounted on a base, the pan/tilt is mounted with a photographing device, and the pan/tilt is configured to rotate around at least two axes , The method includes:
在所述云台处于第一人称主视角FPV跟随模式下,若接收到所述云台的控制装置发送的姿态控制量,则根据所述拍摄装置的欧拉角旋转顺序,对所述姿态控制量进行转换得到所述拍摄装置的第一目标欧拉角分量;When the pan/tilt head is in the first-person main angle of view FPV follow mode, if the attitude control amount sent by the control device of the pan/tilt head is received, the attitude control amount will be adjusted according to the Euler angle rotation sequence of the camera. Performing conversion to obtain the first target Euler angle component of the photographing device;
根据所述第一目标欧拉角分量和所述拍摄装置的第二目标欧拉角分量,确定所述拍摄装置的目标欧拉角,所述第二目标欧拉角分量为根据所述基座的实时检测姿态确定;Determine the target Euler angle of the camera according to the first target Euler angle component and the second target Euler angle component of the camera, and the second target Euler angle component is based on the base Real-time detection of posture determination;
根据所述目标欧拉角,控制所述云台转动;Controlling the rotation of the pan/tilt according to the target Euler angle;
其中,当所述云台处于所述FPV跟随模式时,所述至少两个轴的姿态跟随所述基座的姿态变化而变化。Wherein, when the pan/tilt is in the FPV following mode, the posture of the at least two axes changes following the posture of the base.
根据本申请的第二方面,提供一种云台,所述云台包括:According to a second aspect of the present application, there is provided a pan-tilt, the pan-tilt including:
基座;Base
设置于所述基座上的轴组件,所述轴组件用于搭载拍摄装置,所述轴组件被配置为绕至少二个轴转动;和A shaft assembly provided on the base, the shaft assembly is used to mount a photographing device, and the shaft assembly is configured to rotate about at least two shafts; and
控制器,所述控制器与所述云台电连接,所述控制器用于:A controller, the controller is electrically connected to the pan-tilt, and the controller is used for:
在所述云台处于第一人称主视角FPV跟随模式下,若接收到所述云台的控制装置发送的姿态控制量,则根据所述拍摄装置的欧拉角旋转顺序,对所述姿态控制量进行转换得到所述拍摄装置的第一目标欧拉角分量;When the pan/tilt head is in the first-person main angle of view FPV follow mode, if the attitude control amount sent by the control device of the pan/tilt head is received, the attitude control amount will be adjusted according to the Euler angle rotation sequence of the camera. Performing conversion to obtain the first target Euler angle component of the photographing device;
根据所述第一目标欧拉角分量和所述拍摄装置的第二目标欧拉角分量,确定所述拍摄装置的目标欧拉角,所述第二目标欧拉角分量为根据所述基座的实时检测姿态确定;Determine the target Euler angle of the camera according to the first target Euler angle component and the second target Euler angle component of the camera, and the second target Euler angle component is based on the base Real-time detection of posture determination;
根据所述目标欧拉角,控制所述云台转动;Controlling the rotation of the pan/tilt according to the target Euler angle;
其中,当所述云台处于所述FPV跟随模式时,所述至少两个轴的姿态跟随所述基座的姿态变化而变化。Wherein, when the pan/tilt is in the FPV following mode, the posture of the at least two axes changes following the posture of the base.
根据本申请实施例提供的技术方案,在云台处于FPV跟随模式下,根据拍摄装置的欧拉角旋转顺序,对控制装置发送的姿态控制量进行转换得到拍摄装置的第一目标欧拉角分量,再根据第一目标欧拉角分量和根据基座的实时检测姿态确定的第二目标欧拉角分量确定拍摄装置的目标欧拉角,根据目标欧拉角控制云台转动,用户在控制云台转动时,拍摄装置的画面绕世界坐标系转动,画面转动方向更符合用户要求,画面更符合用户预期。According to the technical solution provided by the embodiments of this application, when the pan/tilt is in the FPV follow mode, according to the Euler angle rotation sequence of the camera, the attitude control value sent by the control device is converted to obtain the first target Euler angle component of the camera , And then determine the target Euler angle of the camera according to the first target Euler angle component and the second target Euler angle component determined according to the real-time detection attitude of the base, and control the pan/tilt rotation according to the target Euler angle, and the user is controlling the cloud When the stage rotates, the screen of the camera rotates around the world coordinate system, the direction of the screen rotation is more in line with the user's requirements, and the screen is more in line with the user's expectations.
附图说明Description of the drawings
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained from these drawings without creative labor.
图1是本发明一实施例中的云台的立体图;Figure 1 is a perspective view of a pan-tilt in an embodiment of the present invention;
图2是本申请一实施例中的云台的控制方法的方法流程示意图;2 is a schematic diagram of a method flow chart of a method for controlling a pan-tilt in an embodiment of the present application;
图3是图1所示的手持云台正立放置时的立体图;Figure 3 is a perspective view of the handheld PTZ shown in Figure 1 when it is placed upright;
图4A是本申请一实施例中的拍摄装置以水平取向拍摄时的示意图;4A is a schematic diagram of the photographing device in an embodiment of the present application when photographing in a horizontal orientation;
图4B是本申请一实施例中的拍摄装置以竖直取向拍摄时的示意图;4B is a schematic diagram of the photographing device in an embodiment of the present application when photographing in a vertical orientation;
图5是本申请一实施例中的根据目标欧拉角,控制云台转动的一种实现方式流程示意图;FIG. 5 is a schematic flow chart of an implementation manner of controlling the rotation of the pan/tilt head according to the target Euler angle in an embodiment of the present application;
图6是本申请一实施例中的预设插值策略的示意图;Fig. 6 is a schematic diagram of a preset interpolation strategy in an embodiment of the present application;
图7是本申请一实施例中的云台的控制方法的方法流程示意图;FIG. 7 is a schematic flow chart of a method for controlling a pan-tilt in an embodiment of the present application;
图8是本申请一实施例中的云台的结构框图。Fig. 8 is a structural block diagram of a pan-tilt in an embodiment of the present application.
具体实施方式Detailed ways
现有云台在第一人称主视角FPV(First Person View)跟随模式下,可以在关节坐标系上实现摇杆控制,如控制装置为遥控器时,遥感器打杆产生的杆量可能对应一个关节角转动,云台对应控制一个关节角,其他关节角不受影响,拍摄装置拍摄的 画面绕关节坐标系转动,画面可能不满足用户预期,因此,这种在关节坐标系上实现摇杆控制的方式不便于操作者实现画面方向的控制。其中,在关节坐标系下,云台各轴进行单独动作。The existing gimbal can realize joystick control in the joint coordinate system in the FPV (First Person View) follow mode of the first-person main view. For example, when the control device is a remote control, the amount of rod generated by the remote sensor may correspond to a joint Angle rotation, the pan/tilt controls a joint angle correspondingly, and other joint angles are not affected. The picture taken by the camera rotates around the joint coordinate system, and the picture may not meet the user's expectations. Therefore, this kind of joystick control is realized on the joint coordinate system. The method is not convenient for the operator to control the screen direction. Among them, in the joint coordinate system, each axis of the pan/tilt moves independently.
对于此,本申请在云台处于FPV跟随模式下,根据拍摄装置的欧拉角旋转顺序,对控制装置发送的姿态控制量进行转换得到拍摄装置的第一目标欧拉角分量,再根据第一目标欧拉角分量和根据基座的实时检测姿态确定的第二目标欧拉角分量确定拍摄装置的目标欧拉角,根据目标欧拉角控制云台转动,用户在控制云台转动时,拍摄装置的画面绕世界坐标系转动,画面转动方向更符合用户要求,画面更符合用户预期。例如,在云台为三轴的手持云台时,假设此时手持云台的手柄倾斜,若需要通过控制装置控制手持云台上的相应轴臂绕偏航轴转动,则在相应的姿态控制量若只转换为一个关节角时,此时,可以驱动俯仰电机转动,而横滚电机以及偏航电机不会转动,由于拍摄装置围绕机体坐标系转动,拍摄画面的变化将会比较生硬、突兀,而在相应的姿态控制量转换为相应的一个欧拉角时,此时,不仅可以驱动俯仰电机转动,横滚电机以及偏航电机也可能为转动,由于拍摄装置围绕世界坐标系转动,将会达到用户期望的偏航变化,拍摄画面的变化也将会比较平滑、衔接性强。For this, in this application, when the pan/tilt is in the FPV follow mode, according to the Euler angle rotation sequence of the camera, the attitude control amount sent by the control device is converted to obtain the first target Euler angle component of the camera, and then according to the first target Euler angle component. The target Euler angle component and the second target Euler angle component determined according to the real-time detection attitude of the base determine the target Euler angle of the camera, and control the rotation of the pan/tilt according to the target Euler angle. When the user controls the rotation of the pan/tilt, the camera is taken. The screen of the device rotates around the world coordinate system, the rotation direction of the screen is more in line with the user's requirements, and the screen is more in line with the user's expectations. For example, when the gimbal is a three-axis handheld gimbal, assuming that the handle of the handheld gimbal is tilted at this time, if it is necessary to control the corresponding axis arm on the handheld gimbal to rotate around the yaw axis through the control device, control in the corresponding attitude If the amount is only converted to a joint angle, at this time, the pitch motor can be driven to rotate, but the roll motor and yaw motor will not rotate. Because the camera rotates around the body coordinate system, the changes in the shooting screen will be more rigid and abrupt. , And when the corresponding attitude control value is converted to a corresponding Euler angle, not only can the pitch motor be driven to rotate, but the roll motor and the yaw motor may also rotate. As the camera rotates around the world coordinate system, the The yaw change expected by the user will be achieved, and the changes in the shooting picture will be smoother and more cohesive.
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.
需要说明的是,在不冲突的情况下,下述的实施例及实施方式中的特征可以相互组合。It should be noted that, in the case of no conflict, the following embodiments and features in the implementation can be combined with each other.
本申请实施例的云台搭载在基座上,云台上搭载有拍摄装置,云台被配置为绕至少二个轴转动。本申请实施例中,基座倾斜时,拍摄装置可以通过云台的控制绕世界坐标系旋转。该拍摄装置可以为摄像机、单反、微单、运动相机、智能手机等拍摄装置。The pan/tilt in the embodiment of the present application is mounted on a base, the pan/tilt is mounted with a photographing device, and the pan/tilt is configured to rotate around at least two axes. In the embodiment of the present application, when the base is tilted, the camera can rotate around the world coordinate system under the control of the pan/tilt. The shooting device can be a camera, a SLR, a mirrorless single, a sports camera, a smart phone, and other shooting devices.
其中,云台被配置为绕至少二个轴转动。本实施例的云台可以被配置为绕两个轴转动,也可以被配置为绕三个轴或三个以上的轴转动。例如,在一些实施例中,云台被配置为绕两个轴转动,两个轴包括偏航轴和俯仰轴。在另外一些实施例中,云台被配置为绕三个轴转动,三个轴包括偏航轴、俯仰轴和横滚轴。Wherein, the pan/tilt is configured to rotate around at least two axes. The pan/tilt head of this embodiment may be configured to rotate around two axes, or it may be configured to rotate around three axes or more than three axes. For example, in some embodiments, the pan/tilt is configured to rotate about two axes, the two axes including a yaw axis and a pitch axis. In other embodiments, the pan/tilt is configured to rotate around three axes, the three axes including the yaw axis, the pitch axis, and the roll axis.
本申请实施例的云台可以为手持云台,也可以为机载云台,机载云台可以搭载在可移动平台上,该可移动平台可以为无人机、无人车、移动机器人等。The pan/tilt in the embodiments of the present application may be a handheld pan/tilt or an airborne pan/tilt. The airborne pan/tilt may be mounted on a movable platform, which may be an unmanned aerial vehicle, an unmanned vehicle, a mobile robot, etc. .
示例性的,请参见图1,云台为手持云台,且云台为三轴云台,本实施例的云台被配置为绕偏航轴、俯仰轴和横滚轴转动。手持云台可包括外框架11、中框架12和内框架,外框架11被配置为绕偏航轴转动,中框架12被配置为绕横滚轴转动,内 框架被配置为绕俯仰轴转动,且内框架用于搭载拍摄装置2。其中,外框架11包括偏航轴轴臂,且由偏航轴电机驱动,中框架12包括横滚轴轴臂,且由横滚轴电机驱动,内框架包括俯仰轴轴臂,且由俯仰轴电机驱动。Exemplarily, please refer to Fig. 1. The pan/tilt is a handheld pan/tilt, and the pan/tilt is a three-axis pan/tilt. The pan/tilt in this embodiment is configured to rotate around the yaw axis, pitch axis, and roll axis. The handheld gimbal may include an outer frame 11, a middle frame 12, and an inner frame. The outer frame 11 is configured to rotate about a yaw axis, the middle frame 12 is configured to rotate about a roll axis, and the inner frame is configured to rotate about a pitch axis, And the inner frame is used to mount the camera 2. Wherein, the outer frame 11 includes a yaw axis arm and is driven by a yaw axis motor, the middle frame 12 includes a roll axis arm and is driven by a roll axis motor, and the inner frame includes a pitch axis arm and is driven by a pitch axis motor driven.
下面将阐述本申请实施例的云台的控制方法的具体实现过程。The specific implementation process of the pan-tilt control method in the embodiment of the present application will be described below.
图2是本申请一实施例中的云台的控制方法的方法流程示意图;请参见图2,本申请实施例的云台的控制方法可以包括如下步骤:FIG. 2 is a schematic flow chart of a method for controlling a pan-tilt in an embodiment of the present application; please refer to FIG. 2, the method for controlling a pan-tilt according to an embodiment of the present application may include the following steps:
S201:在云台处于第一人称主视角FPV跟随模式下,若接收到云台的控制装置发送的姿态控制量,则根据拍摄装置的欧拉角旋转顺序,对姿态控制量进行转换得到拍摄装置的第一目标欧拉角分量,其中,当云台处于FPV跟随模式时,至少两个轴的姿态跟随基座的姿态变化而变化;S201: When the pan/tilt is in the first-person main angle of view FPV follow mode, if the attitude control amount sent by the control device of the pan/tilt is received, the attitude control amount is converted according to the Euler angle rotation sequence of the camera to obtain the camera's The first target Euler angle component, where, when the gimbal is in the FPV follow mode, the attitude of at least two axes changes with the attitude of the base;
示例性的,以云台被配置为绕航向轴、横滚轴和俯仰轴转动为例,在拍摄装置处于FPV跟随模式下,航向轴、横滚轴和俯仰轴均为follow模式。另外,在拍摄装置处于普通跟随模式下时,横滚轴为自由free模式,横滚轴用于增稳,俯仰轴和/或偏航轴为follow模式。其中,在free模式下,云台的基座运动,云台的对应轴臂不转动。在follow模式下,对应轴跟随云台的基座运动而运动。Illustratively, taking the gimbal configured to rotate around the yaw axis, roll axis, and pitch axis as an example, when the camera is in the FPV follow mode, the yaw axis, roll axis, and pitch axis are all in follow mode. In addition, when the camera is in the normal follow mode, the roll axis is in free mode, the roll axis is used for stabilization, and the pitch axis and/or yaw axis are in follow mode. Among them, in the free mode, the base of the pan/tilt moves, but the corresponding arm of the pan/tilt does not rotate. In the follow mode, the corresponding axis moves with the movement of the base of the pan/tilt.
控制装置可以为手机、平板电脑等可移动终端,也可以为固定终端,还可以为遥控器或其他能够控制转动结构的装置,还可以集成在云台的手柄上。示例性的,控制装置为遥控器,姿态控制量根据用户操作遥控器的摇杆产生的杆量确定。The control device can be a mobile terminal such as a mobile phone, a tablet computer, or a fixed terminal, or a remote control or other device capable of controlling the rotating structure, and can also be integrated on the handle of the pan-tilt. Exemplarily, the control device is a remote control, and the amount of posture control is determined according to the amount of stick generated by the user operating the joystick of the remote control.
本申请实施例中,步骤S201是根据拍摄装置的欧拉角旋转顺序,对姿态控制量直接转换得到拍摄装置的第一目标欧拉角分量,但姿态控制量到第一目标欧拉角分量之间的转换并不是简单的对应关系。本实施例的转换可以包括云台转动的欧拉角速度的转换,或云台转动的欧拉角大小的转换。例如,在一些实施例中,转换为云台转动的欧拉角速度的转换,第一目标欧拉角分量即为欧拉角速度。在另外一些实施例中,转换为云台转动的欧拉角大小的转换,第一目标欧拉角分量即为欧拉角大小。In the embodiment of the present application, step S201 is to directly convert the attitude control amount to obtain the first target Euler angle component of the shooting device according to the Euler angle rotation sequence of the shooting device, but the attitude control amount is less than the first target Euler angle component. The conversion between is not a simple correspondence. The conversion in this embodiment may include the conversion of the Euler angular velocity of the pan/tilt rotation, or the conversion of the Euler angle of the pan/tilt rotation. For example, in some embodiments, the conversion is the conversion of the Euler angular velocity of the pan/tilt rotation, and the first target Euler angular component is the Euler angular velocity. In some other embodiments, the conversion is the conversion of the Euler angle size of the pan/tilt rotation, and the first target Euler angle component is the Euler angle size.
本申请实施例中,拍摄装置的欧拉角旋转顺序需要根据拍摄装置的拍摄取向确定。In the embodiment of the present application, the Euler angle rotation sequence of the camera needs to be determined according to the shooting orientation of the camera.
以云台被配置为绕三个轴转动为例,示例性的,拍摄装置的欧拉角对应第一轴、第二轴、第三轴的旋转,其中,第一轴平行于拍摄装置的光轴方向,第一轴、第二轴、第三轴分别正交。第一轴的方向、第二轴的方向和第三轴的方向是根据拍摄装置的放置方向和光轴方向确定的,示例性的,在拍摄装置以水平取向放置、且拍摄装置的光轴平行于水平面时,第三轴为竖直方向,第一轴、第二轴均平行于水平面。Taking the PTZ configured to rotate around three axes as an example, for example, the Euler angle of the camera corresponds to the rotation of the first axis, the second axis, and the third axis, where the first axis is parallel to the light of the camera. The axis direction, the first axis, the second axis, and the third axis are orthogonal to each other. The direction of the first axis, the direction of the second axis, and the direction of the third axis are determined according to the placement direction of the camera and the direction of the optical axis. Illustratively, the camera is placed in a horizontal orientation and the optical axis of the camera is parallel to In the horizontal plane, the third axis is the vertical direction, and both the first axis and the second axis are parallel to the horizontal plane.
本文中,第一轴对应横滚轴,第二轴对应俯仰轴,第三轴对应偏航轴,为方便描述,第一轴、第二轴、第三轴分别用X、Y、Z表示。In this article, the first axis corresponds to the roll axis, the second axis corresponds to the pitch axis, and the third axis corresponds to the yaw axis. For ease of description, the first axis, the second axis, and the third axis are denoted by X, Y, and Z, respectively.
在一些实施例中,拍摄装置处于水平取向拍摄模式,拍摄装置的欧拉角的旋转顺序为:第三轴、第一轴、第二轴,或第二轴、第一轴、第三轴。进一步地,根据云台的构型确定切换后的控制指令对应的拍摄装置的欧拉角旋转顺序是上述欧拉角旋转顺序中的哪一种。可选地,在云台为ZXY构型时,拍摄装置的欧拉角旋转顺序为:第三轴、第一轴、第二轴。可选地,在云台为YXZ构型时,拍摄装置的欧拉角旋转顺序为:第二轴、第一轴、第三轴。In some embodiments, the camera is in the horizontal orientation shooting mode, and the rotation sequence of the Euler angle of the camera is: the third axis, the first axis, the second axis, or the second axis, the first axis, and the third axis. Further, according to the configuration of the pan-tilt, it is determined which of the above-mentioned Euler angle rotation sequence of the photographing device corresponding to the switched control instruction is. Optionally, when the pan-tilt is in the ZXY configuration, the Euler angle rotation sequence of the camera is: the third axis, the first axis, and the second axis. Optionally, when the pan-tilt is in the YXZ configuration, the Euler angle rotation sequence of the camera is: the second axis, the first axis, and the third axis.
其中,当拍摄装置处于水平取向拍摄模式时,姿态控制量中用于控制云台绕航向轴转动的分量为基于欧拉角旋转顺序中的第三轴进行转换得到,姿态控制量中用于控制云台绕俯仰轴转动的分量为基于欧拉角旋转顺序中的第二轴进行转换得到,姿态控制量中用于控制云台绕横滚轴转动的分量为基于欧拉角旋转顺序中的第一轴进行转换得到。示例性的,云台为ZXY构型,拍摄装置的欧拉角旋转顺序为:Z、X、Y,对姿态控制量中用于控制云台绕航向轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕Z转动的欧拉角速度或欧拉角大小;对姿态控制量中用于控制云台绕俯仰轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕Y转动的欧拉角速度或欧拉角大小;对姿态控制量中用于控制云台绕横滚轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕X转动的欧拉角速度或欧拉角大小。又如,云台为YXZ构型,拍摄装置的欧拉角旋转顺序为:Y、X、Z,对姿态控制量中用于控制云台绕航向轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕Z转动的欧拉角速度或欧拉角大小;对姿态控制量中用于控制云台绕俯仰轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕Y转动的欧拉角速度或欧拉角大小;对姿态控制量中用于控制云台绕横滚轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕X转动的欧拉角速度或欧拉角大小。Among them, when the camera is in the horizontal orientation shooting mode, the component of the attitude control quantity used to control the rotation of the gimbal around the yaw axis is obtained by conversion based on the third axis in the Euler angle rotation sequence, and the attitude control quantity is used for control The component of the gimbal's rotation around the pitch axis is converted based on the second axis in the Euler angle rotation sequence, and the component used to control the gimbal's rotation around the roll axis in the attitude control quantity is the first component in the rotation sequence based on the Euler angle. One-axis conversion is obtained. Exemplarily, the gimbal is in the ZXY configuration, the Euler angle rotation sequence of the camera is: Z, X, Y, and the component used to control the rotation of the gimbal around the yaw axis in the attitude control is converted to obtain the camera's The Euler angular velocity or Euler angle of rotation around Z in the Euler angle rotation sequence; convert the component used to control the rotation of the gimbal around the pitch axis in the attitude control quantity to obtain the Euler angle rotation sequence of the camera around Y The Euler angular velocity or the size of the Euler angle of rotation; the component used to control the rotation of the gimbal around the roll axis in the attitude control is converted to obtain the Euler angular velocity or the Euler angle rotating around X in the Euler angle rotation sequence of the camera. The size of the pull angle. For another example, the gimbal is in the YXZ configuration, and the Euler angle rotation sequence of the camera is: Y, X, Z. The component used to control the rotation of the gimbal around the yaw axis in the attitude control is converted to obtain the Euler angle of the camera. The Euler angular velocity or Euler angle of rotation around Z in the pull angle rotation sequence; convert the component used to control the rotation of the gimbal around the pitch axis in the attitude control quantity to obtain the Euler angle rotation sequence of the camera to rotate around Y The Euler angular velocity or Euler angle size of the angle; convert the component used to control the rotation of the gimbal around the roll axis in the attitude control quantity to obtain the Euler angular velocity or Euler angle rotating around X in the Euler angle rotation sequence of the camera Angle size.
在一些实施例中,拍摄装置处于竖直取向拍摄模式,拍摄装置的欧拉角的旋转顺序为:第二轴、第一轴、第二轴,或第三轴、第一轴、第三轴。进一步地,根据云台的构型确定切换后的控制指令对应的拍摄装置的欧拉角旋转顺序是上述欧拉角旋转顺序中的哪一种,可选地,在云台为ZXY构型时,拍摄装置的欧拉角旋转顺序为:第三轴、第一轴、第三轴。可选地,在云台为YXZ构型时,拍摄装置的欧拉角旋转顺序为:第二轴、第一轴、第二轴。In some embodiments, the camera is in the vertical orientation shooting mode, and the rotation sequence of the Euler angle of the camera is: second axis, first axis, second axis, or third axis, first axis, third axis . Further, the Euler angle rotation sequence of the camera corresponding to the switched control instruction is determined according to the configuration of the pan/tilt head, which one of the above Euler angle rotation sequences is, optionally, when the pan/tilt head is in the ZXY configuration , The Euler angle rotation sequence of the camera is: the third axis, the first axis, and the third axis. Optionally, when the pan/tilt is in the YXZ configuration, the Euler angle rotation sequence of the camera is: the second axis, the first axis, and the second axis.
其中,当拍摄装置处于竖直取向拍摄模式时,若拍摄装置的欧拉角旋转顺序为:第二轴、第一轴、第二轴,则姿态控制量中用于控制云台绕航向轴转动的分量以及用于控制云台绕俯仰轴转动的分量,为基于欧拉角旋转顺序中的第二轴进行转换得到,姿态控制量中用于控制云台绕横滚轴转动的分量为基于欧拉角旋转顺序中的第一轴进行转换得到。本实施例中,拍摄装置的欧拉角旋转顺序为:Y、X、Y,对姿态控制量中用于控制云台绕航向轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕首个Y转动的欧拉角速度或欧拉角大小;对姿态控制量中用于控制云台绕俯仰轴转动 的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕第二个Y转动的欧拉角速度或欧拉角大小;对姿态控制量中用于控制云台绕横滚轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕X转动的欧拉角速度或欧拉角大小。Among them, when the camera is in the vertical orientation shooting mode, if the Euler angle rotation sequence of the camera is: second axis, first axis, second axis, then the attitude control quantity is used to control the pan/tilt to rotate around the yaw axis The component and the component used to control the rotation of the gimbal around the pitch axis are obtained by conversion based on the second axis in the Euler angle rotation sequence. The component used to control the rotation of the gimbal around the roll axis in the attitude control quantity is based on the Euler angle rotation. The first axis in the rotation sequence of the pull angle is converted. In this embodiment, the Euler angle rotation sequence of the shooting device is: Y, X, Y, and the components used to control the rotation of the gimbal around the yaw axis in the attitude control value are converted to obtain the Euler angle rotation sequence of the shooting device The Euler angular velocity or Euler angle size of the rotation around the first Y; convert the component used to control the rotation of the gimbal around the pitch axis in the attitude control quantity to obtain the Euler angle rotation sequence of the camera to rotate around the second Y The Euler angular velocity or Euler angle size of the angle; convert the component used to control the rotation of the gimbal around the roll axis in the attitude control quantity to obtain the Euler angular velocity or Euler angle rotating around X in the Euler angle rotation sequence of the camera Angle size.
当拍摄装置处于竖直取向拍摄模式时,若拍摄装置的欧拉角旋转顺序为:第三轴、第一轴、第三轴,姿态控制量中用于控制云台绕航向轴转动的分量,以及用于控制云台绕俯仰轴转动的分量,为基于欧拉角旋转顺序中的第三轴进行转换得到,姿态控制量中用于控制云台绕横滚轴转动的分量为基于欧拉角旋转顺序中的第一轴进行转换得到。本实施例中,拍摄装置的欧拉角旋转顺序为:Z、X、Z,对姿态控制量中用于控制云台绕航向轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕首个Z转动的欧拉角速度或欧拉角大小;对姿态控制量中用于控制云台绕俯仰轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕第二个Z转动的欧拉角速度或欧拉角大小;对姿态控制量中用于控制云台绕横滚轴转动的分量进行转换,得到拍摄装置的欧拉角旋转顺序中绕X转动的欧拉角速度或欧拉角大小。When the camera is in the vertical orientation shooting mode, if the Euler angle rotation sequence of the camera is: third axis, first axis, third axis, the component of the attitude control quantity used to control the rotation of the gimbal around the yaw axis, And the component used to control the rotation of the gimbal around the pitch axis is obtained by conversion based on the third axis in the Euler angle rotation sequence, and the component used to control the rotation of the gimbal around the roll axis in the attitude control quantity is based on the Euler angle The first axis in the rotation sequence is transformed. In this embodiment, the Euler angle rotation sequence of the shooting device is: Z, X, Z, and the components used to control the rotation of the pan/tilt around the yaw axis in the attitude control value are converted to obtain the Euler angle rotation sequence of the shooting device The Euler angular velocity or Euler angle of rotation around the first Z; convert the component used to control the rotation of the gimbal around the pitch axis in the attitude control quantity to obtain the Euler angle rotation sequence of the camera to rotate around the second Z The Euler angular velocity or Euler angle size of the angle; convert the component used to control the rotation of the gimbal around the roll axis in the attitude control quantity to obtain the Euler angular velocity or Euler angle rotating around X in the Euler angle rotation sequence of the camera Angle size.
以三轴云台、且云台被配置为绕偏航轴、俯仰轴和横滚轴转动为例来说明ZXY构型的云台和YXZ构型的云台。对于ZXY构型的云台,当云台正立放置、且外框架、中框架和内框架的关节角均为0度时,外框架绕偏航轴转动,中框架绕横滚轴,内框架绕俯仰轴转动。对于YXZ构型的云台,当云台正立放置、且外框架、中框架和内框架的关节角均为0度时,外框架绕俯仰轴转动,中框架绕横滚轴,内框架绕偏航轴转动。Take a three-axis gimbal and the gimbal is configured to rotate around the yaw axis, pitch axis, and roll axis as an example to illustrate the gimbal of the ZXY configuration and the gimbal of the YXZ configuration. For the ZXY configuration gimbal, when the gimbal is placed upright and the joint angles of the outer frame, middle frame and inner frame are all 0 degrees, the outer frame rotates around the yaw axis, the middle frame rotates around the roll axis, and the inner frame Rotate around the pitch axis. For a gimbal of YXZ configuration, when the gimbal is placed upright and the joint angles of the outer frame, middle frame and inner frame are all 0 degrees, the outer frame rotates around the pitch axis, the middle frame around the roll axis, and the inner frame around the The yaw axis rotates.
示例性的,沿用上述手持云台的实施例,请参见图3,手持云台还包括手柄3和设于手柄3正面的屏幕4和按键(未标出)等。手持云台正立放置时,屏幕4朝向用户,拍摄装置的镜头背对用户,如图3所示,为手持云台正立放置的状态图。图3所示的手持云台即为ZXY构型的云台。Exemplarily, following the embodiment of the above-mentioned handheld pan/tilt, please refer to FIG. 3. The handheld pan/tilt also includes a handle 3 and a screen 4 and buttons (not shown) provided on the front of the handle 3. When the handheld PTZ is placed upright, the screen 4 faces the user, and the lens of the shooting device is facing away from the user. As shown in FIG. 3, it is a state diagram of the handheld PTZ placed upright. The handheld PTZ shown in Figure 3 is a ZXY configuration PTZ.
需要说明的是,水平取向拍摄也可以称作横拍,竖直取向拍摄也可以称作竖拍。It should be noted that the horizontal orientation shooting may also be referred to as horizontal shooting, and the vertical orientation shooting may also be referred to as vertical shooting.
其中,拍摄装置以水平取向拍摄是指拍摄装置在云台支架上水平安装,以便于拍摄出相对于水平面水平的画面,对于给定画面长宽比的,以拍摄装置为手机为例,请参见图4A,10为水平面,20为画面的长边,30为画面的短边,将画面的长边20方向旋转到水平方向(即画面的长边20平行于水平面10)进行拍摄,即为拍摄装置以水平取向拍摄。拍摄装置以竖直取向拍摄是指拍摄装置在云台支架上竖直安装,以便于拍摄出相对于水平面竖直的画面,沿用上述拍摄装置为手机的实施例,请参见图4B,将画面的长边20方向旋转到竖直方向(即画面的长边20垂直于水平面)进行拍摄,即为拍摄装置以竖直取向拍摄。当然,横拍和竖拍的示例性定义也可以与上述说明完全相反。Among them, the horizontal orientation of the shooting device means that the shooting device is installed horizontally on the pan/tilt support, so that it can take a horizontal picture relative to the horizontal plane. For a given picture aspect ratio, the shooting device is a mobile phone as an example, please refer to Figure 4A, 10 is the horizontal plane, 20 is the long side of the screen, and 30 is the short side of the screen. Rotate the long side 20 of the screen to the horizontal direction (that is, the long side 20 of the screen is parallel to the horizontal plane 10) for shooting. The device is photographed in a horizontal orientation. The shooting device in the vertical orientation means that the shooting device is installed vertically on the pan/tilt support to take a vertical picture with respect to the horizontal plane. The embodiment in which the above-mentioned shooting device is a mobile phone is used. Please refer to Fig. 4B. The long side 20 is rotated to the vertical direction (that is, the long side 20 of the picture is perpendicular to the horizontal plane) for shooting, that is, the shooting device shoots in a vertical orientation. Of course, the exemplary definitions of horizontal shooting and vertical shooting can also be completely opposite to the above description.
S202:根据第一目标欧拉角分量和拍摄装置的第二目标欧拉角分量,确定拍摄 装置的目标欧拉角,第二目标欧拉角分量为根据基座的实时检测姿态确定;S202: Determine the target Euler angle of the camera according to the first target Euler angle component and the second target Euler angle component of the camera, and the second target Euler angle component is determined according to the real-time detection attitude of the base;
本实施例中,在云台处于FPV跟随模式下,云台既由控制装置控制,又跟随基座的姿态。应当理解地,在云台处于FPV跟随模式下,当控制装置未输入姿态控制量,且云台也不处于控制装置的控制下时,拍摄装置的姿态仅跟随基座的姿态变化而变化,也即,步骤S201省略,步骤S202中的目标欧拉角根据第二目标欧拉角分量确定。另外,在拍摄装置仅跟随基座的姿态时,若拍摄装置的当前姿态和云台的基座的实时检测姿态的偏差小于或等于预设偏差阈值,则无需控制拍摄装置的姿态;若拍摄装置的当前姿态和云台的基座的实时检测姿态的偏差大于预设偏差阈值,则控制拍摄装置的姿态以跟随基座的姿态。In this embodiment, when the pan/tilt is in the FPV follow mode, the pan/tilt is not only controlled by the control device, but also follows the posture of the base. It should be understood that when the pan/tilt is in the FPV follow mode, when the control device does not input the amount of attitude control and the pan/tilt is not under the control of the control device, the attitude of the camera only changes with the change of the base's attitude. That is, step S201 is omitted, and the target Euler angle in step S202 is determined according to the second target Euler angle component. In addition, when the camera only follows the posture of the base, if the deviation between the current posture of the camera and the real-time detection posture of the base of the pan/tilt is less than or equal to the preset deviation threshold, there is no need to control the posture of the camera; If the deviation between the current attitude of the camera and the real-time detected attitude of the base of the pan/tilt is greater than the preset deviation threshold, the attitude of the camera is controlled to follow the attitude of the base.
本实施例中,在云台处于FPV跟随模式下,控制装置控制云台的优先级高于云台跟随基座的姿态的优先级,也即,当获取到控制装置发送的姿态控制量时,云台既由控制装置控制,又跟随基座的姿态。In this embodiment, when the pan/tilt is in the FPV follow mode, the priority of the control device to control the pan/tilt is higher than the priority of the attitude of the pan/tilt following the base, that is, when the attitude control amount sent by the control device is acquired, The pan/tilt is not only controlled by the control device, but also follows the attitude of the base.
其中,根据第一目标欧拉角分量和拍摄装置的第二目标欧拉角分量,确定拍摄装置的目标欧拉角的实现过程可以包括:根据第一目标欧拉角分量和拍摄装置的第二目标欧拉角分量之和,确定拍摄装置的目标欧拉角。可选地,目标欧拉角=(第一目标欧拉角分量+第二目标欧拉角分量)。Wherein, according to the first target Euler angle component and the second target Euler angle component of the camera, the process of determining the target Euler angle of the camera may include: according to the first target Euler angle component and the second target Euler angle component of the camera. The sum of the target Euler angle components determines the target Euler angle of the camera. Optionally, target Euler angle=(first target Euler angle component+second target Euler angle component).
基座的实时检测姿态可以采用基座的实时姿态四元数来表征,也可以采用基座的实时姿态欧拉角来表征。The real-time detection attitude of the pedestal can be characterized by the real-time attitude quaternion of the pedestal, or the real-time attitude Euler angle of the pedestal.
在一些实施例中,基座的实时检测姿态的获取方式可以包括:获取拍摄装置的实时姿态四元数;根据拍摄装置的实时姿态四元数,确定基座的实时姿态四元数,基座的实时姿态四元数用于表征基座的实时检测姿态。其中,拍摄装置的实时姿态四元数可以通过拍摄装置上设置的惯性测量单元(IMU,Inertial measurement unit)检测获得。当然,IMU也可以设置于云台的内框架上。进一步地,以手持云台为例来说明如何根据拍摄装置的实时姿态四元数,确定基座的实时姿态四元数。基座为手持云台的手柄,本实施例的手持云台还包括加速度计,该加速度计用于检测拍摄装置的实时姿态四元数qmesa。手柄的实时姿态四元数是根据拍摄装置的实时姿态四元数和云台关节角确定的,以手持云台为ZXY构型的三轴云台为例,云台关节角包括偏航关节角joint_yaw、横滚关节角joint_roll和俯仰关节角joint_pitch,各关节角即为对应轴电机的关节角。根据轴角转换公式得到q_yaw、q_roll和q_pitch,q_yaw、q_roll和q_pitch的共轭或逆分别为q_yaw_inv、q_roll_inv和q_pitch_inv。手柄的实时姿态四元数qhandle的计算公式如下:In some embodiments, the method for acquiring the real-time detection attitude of the base may include: acquiring the real-time attitude quaternion of the camera; and determining the real-time attitude quaternion of the base according to the real-time attitude quaternion of the camera. The real-time attitude quaternion of is used to characterize the real-time detection attitude of the base. Among them, the real-time posture quaternion of the camera can be obtained through the detection of an inertial measurement unit (IMU, Inertial Measurement Unit) provided on the camera. Of course, the IMU can also be set on the inner frame of the pan/tilt. Furthermore, a handheld pan/tilt is taken as an example to illustrate how to determine the real-time attitude quaternion of the base according to the real-time attitude quaternion of the camera. The base is the handle of the handheld pan/tilt. The handheld pan/tilt in this embodiment also includes an accelerometer, which is used to detect the real-time posture quaternion qmesa of the camera. The real-time attitude quaternion of the handle is determined according to the real-time attitude quaternion of the camera and the joint angle of the gimbal. Take a three-axis gimbal with a ZXY configuration as an example. The joint angle of the gimbal includes the yaw joint angle. For joint_yaw, roll joint angle joint_roll and pitch joint angle joint_pitch, each joint angle is the joint angle of the corresponding axis motor. According to the shaft angle conversion formula, q_yaw, q_roll and q_pitch are obtained. The conjugate or inverse of q_yaw, q_roll and q_pitch are q_yaw_inv, q_roll_inv and q_pitch_inv respectively. The calculation formula of the real-time attitude quaternion qhandle of the handle is as follows:
qhandle=qmesa*q_pitch_inv*q_roll_inv*q_yaw_inv    (1);qhandle=qmesa*q_pitch_inv*q_roll_inv*q_yaw_inv (1);
其中,joint表示关节角,q表示四元数。Among them, joint represents the joint angle, and q represents the quaternion.
在另一些实施例中,在基座上设置惯性测量单元,通过基座上的惯性测量单元 检测获得基座的实时检测姿态。In other embodiments, an inertial measurement unit is provided on the base, and the real-time detection attitude of the base is obtained through the detection of the inertial measurement unit on the base.
在一些实施例中,第二目标欧拉角分量为根据基座的实时检测姿态确定的实现过程可以包括:第二目标欧拉角分量为根据基座的实时检测姿态以及拍摄装置与基座之间的预设姿态偏差确定。示例性的,通过上述公式(1)得到基座的实时姿态四元数,预设姿态偏差也采用四元数表征,即预设姿态四元数偏差offset,第二目标欧拉角分量对应的目标姿态四元数分量为根据基座的实时姿态四元数和offset的乘积确定,再根据第二目标欧拉角分量对应的目标姿态四元数分量确定第二目标欧拉角分量。可选地,第二目标欧拉角分量对应的目标姿态四元数分量=基座的实时姿态四元数*offset。In some embodiments, the realization process of determining the second target Euler angle component based on the real-time detection attitude of the base may include: the second target Euler angle component is based on the real-time detection attitude of the base and the relationship between the camera and the base. The preset attitude deviation between the two is determined. Exemplarily, the real-time attitude quaternion of the base is obtained by the above formula (1), and the preset attitude deviation is also characterized by quaternion, that is, the preset attitude quaternion deviation offset, and the second target Euler angle component corresponds to The target posture quaternion component is determined according to the product of the real-time posture quaternion of the base and the offset, and then the second target Euler angle component is determined according to the target posture quaternion component corresponding to the second target Euler angle component. Optionally, the target attitude quaternion component corresponding to the second target Euler angle component=real-time attitude quaternion of the base*offset.
预设姿态偏差的大小可以根据需要设置,可选地,预设姿态偏差为云台进入FPV跟随模式时,拍摄装置与基座之间的姿态偏差;当然,预设姿态偏差也可以为其他设定的姿态偏差。The size of the preset attitude deviation can be set as required. Optionally, the preset attitude deviation is the attitude deviation between the camera and the base when the pan/tilt enters the FPV follow mode; of course, the preset attitude deviation can also be other settings. Set attitude deviation.
S203:根据目标欧拉角,控制云台转动。S203: Control the gimbal to rotate according to the target Euler angle.
图5是本申请一实施例中的根据目标欧拉角,控制云台转动的一种实现方式流程示意图;请参见图5,根据目标欧拉角,控制云台转动的实现过程可以包括:Fig. 5 is a schematic flow chart of an implementation method of controlling the rotation of the gimbal according to the target Euler angle in an embodiment of the present application; please refer to Fig. 5, the realization process of controlling the rotation of the gimbal according to the target Euler angle may include:
S501:根据目标欧拉角,确定拍摄装置的目标姿态四元数;S501: Determine the quaternion of the target posture of the shooting device according to the target Euler angle;
示例性的,以ZXY构型的云台为例,拍摄装置处于水平取向拍摄模式,拍摄装置的欧拉角的旋转顺序为:Z、X、Y,欧拉角到四元数的转换公式如下:Exemplarily, taking the ZXY configuration of the PTZ as an example, the camera is in the horizontal orientation shooting mode, the rotation sequence of the Euler angle of the camera is: Z, X, Y, the conversion formula of Euler angle to quaternion is as follows :
Figure PCTCN2019130861-appb-000001
Figure PCTCN2019130861-appb-000001
其中,q为转换出来的四元数,Inn_Y、Mid_X、Out_Z分别为对应的ZXY旋转顺序的欧拉角大小。Among them, q is the converted quaternion, Inn_Y, Mid_X, and Out_Z are the Euler angles of the corresponding ZXY rotation sequence.
根据上述公式(2),即可将目标欧拉角转换成目标姿态四元数。According to the above formula (2), the target Euler angle can be converted into a target attitude quaternion.
S502:根据目标姿态四元数,确定云台的关节角;S502: Determine the joint angle of the gimbal according to the quaternion of the target posture;
该步骤中,根据目标姿态四元数和拍摄装置的当前姿态对应的姿态四元数,确定云台的目标关节角,具体地,根据目标姿态四元数和拍摄装置的当前姿态对应的姿态四元数,确定四元数姿态偏差;根据四元数姿态偏差,确定云台的目标关节角。其中,四元数姿态偏差为根据目标姿态四元数减去拍摄装置的当前姿态对应的姿态四元数获得的差值确定,可选地,四元数姿态偏差=(目标姿态四元数-拍摄装置的当前姿态对应的姿态四元数)。In this step, the target joint angle of the pan-tilt is determined according to the target posture quaternion and the posture quaternion corresponding to the current posture of the camera. Specifically, the target posture quaternion and the posture quaternion corresponding to the current posture of the camera are determined. Yuan, determine the quaternion attitude deviation; according to the quaternion attitude deviation, determine the target joint angle of the pan/tilt. Wherein, the quaternion attitude deviation is determined according to the difference obtained by subtracting the quaternion of the current attitude of the camera from the quaternion of the target attitude. Optionally, the quaternion attitude deviation=(target attitude quaternion- The posture quaternion corresponding to the current posture of the camera).
另外,在根据四元数姿态偏差,确定云台的目标关节角时,具体地,根据四元数姿态偏差以及雅克比逆矩阵,确定云台的目标关节角。以云台被配置为绕航向轴、横滚轴和俯仰轴转动为例,目标关节角包括航向电机对应的关节角、横滚电机对应的关节角以及俯仰电机对应的关节角,其中,航向电机用于控制云台绕航向轴转动,横滚电机用于控制云台绕横滚轴转动,俯仰电机用于控制云台绕俯仰轴转动。In addition, when determining the target joint angle of the pan/tilt head based on the quaternion attitude deviation, specifically, the target joint angle of the pan/tilt head is determined based on the quaternion attitude deviation and the Jacobian inverse matrix. Taking the gimbal configured to rotate around the yaw axis, roll axis, and pitch axis as an example, the target joint angle includes the joint angle corresponding to the yaw motor, the joint angle corresponding to the roll motor, and the joint angle corresponding to the pitch motor. Among them, the yaw motor It is used to control the gimbal to rotate around the yaw axis, the roll motor is used to control the gimbal to rotate around the roll axis, and the pitch motor is used to control the gimbal to rotate around the pitch axis.
可选地,拍摄装置的当前姿态四元数不同于目标姿态四元数,S502的实现过程可以包括但不限于如下步骤:Optionally, the current posture quaternion of the camera is different from the target posture quaternion, and the implementation process of S502 may include but is not limited to the following steps:
(1)、根据当前姿态四元数、目标姿态四元数和预设插值策略,确定位于当前姿态四元数和目标姿态四元数之间的至少一个中间姿态四元数;(1) Determine at least one intermediate posture quaternion between the current posture quaternion and the target posture quaternion according to the current posture quaternion, the target posture quaternion and the preset interpolation strategy;
预设插值策略可以根据需要选择,在一些实施例中,根据当前姿态四元数、目标姿态四元数和预设插值策略,确定位于当前姿态四元数和目标姿态四元数之间的至少一个中间姿态四元数的实现过程可以包括:根据当前姿态四元数、目标姿态四元数和至少一个时间变化参数,确定位于当前姿态四元数和目标姿态四元数之间的至少一个中间姿态四元数。其中,至少一个时间变化参数和至少一个中间姿态四元数一一对应。可选地,时间变化参数包括多个,由当前姿态四元数至目标姿态四元数的姿态切换方向,多个中间姿态四元数对应的时间变化参数呈递增趋势。The preset interpolation strategy can be selected according to needs. In some embodiments, according to the current pose quaternion, the target pose quaternion, and the preset interpolation strategy, it is determined at least between the current pose quaternion and the target pose quaternion. The realization process of an intermediate posture quaternion may include: determining at least one middle position between the current posture quaternion and the target posture quaternion according to the current posture quaternion, the target posture quaternion, and at least one time change parameter Posture quaternion. Among them, at least one time change parameter corresponds to at least one intermediate posture quaternion one-to-one. Optionally, the time change parameter includes multiple, and the direction of the posture switching from the current posture quaternion to the target posture quaternion, and the time change parameters corresponding to the multiple intermediate posture quaternions show an increasing trend.
假设当前姿态四元数表示为q 0,目标姿态四元数表示为q 1,在当前姿态四元数q 0和目标姿态四元数q 1之间,采用四元数平滑插值算法slerp,如以下计算公式计算中间姿态四元数q tAssuming that the current attitude quaternion is expressed as q 0 and the target attitude quaternion is expressed as q 1 , between the current attitude quaternion q 0 and the target attitude quaternion q 1 , the quaternion smoothing interpolation algorithm slerp is used, such as The following calculation formula calculates the intermediate attitude quaternion q t :
Figure PCTCN2019130861-appb-000002
Figure PCTCN2019130861-appb-000002
公式(3)中,t为0到1之间变化的时间参数,ω为方向q 0至q 1之间的角度差,如图6所示。可以理解,t也可以为0到1之外的时间参数,其表示当前姿态四元数q 0变化到目标姿态四元数q 1的时间,可以通过归一化的表达方式而转换为0到1之间的时间变化参数。 In formula (3), t is a time parameter that varies from 0 to 1, and ω is the angle difference between directions q 0 to q 1 , as shown in Figure 6. It can be understood that t can also be a time parameter other than 0 to 1, which represents the time for the current attitude quaternion q 0 to change to the target attitude quaternion q 1 , and can be converted to 0 through normalized expressions. 1 time change parameter.
可选地,位置相邻的姿态四元数的四元数姿态偏差大小相等;可选地,位置相邻的姿态四元数的四元数姿态偏差的大小也可以不相等。Optionally, the magnitudes of the quaternion attitude deviations of the posture quaternions that are adjacent to each other are equal; alternatively, the magnitudes of the quaternion posture deviations of the posture quaternions that are adjacent to each other may not be equal.
(2)、根据当前姿态四元数、至少一个中间姿态四元数以及目标姿态四元数,确定云台的目标关节角。(2) Determine the target joint angle of the pan/tilt head according to the current posture quaternion, at least one intermediate posture quaternion, and the target posture quaternion.
具体地,根据各相邻姿态四元数以及拍摄装置的欧拉角旋转顺序,确定对应的关节角;再根据各相邻姿态对应的关节角,由当前姿态四元数至目标姿态四元数的切换方向,依次控制云台转动,以控制拍摄装置平滑地转动。Specifically, the corresponding joint angle is determined according to the quaternion of each adjacent posture and the Euler angle rotation sequence of the camera; then according to the joint angle corresponding to each adjacent posture, from the quaternion of the current posture to the quaternion of the target posture To switch the direction of, control the rotation of the pan/tilt in turn to control the smooth rotation of the camera.
通过插值方式,在当前姿态四元数和目标姿态四元数之间插入至少一个中间姿 态四元数,根据相邻姿态对应的四元数,确定相邻姿态对应的四元数姿态偏差,再根据相邻姿态对应的四元数姿态偏差,确定相邻姿态对应的关节角,再根据各相邻姿态对应的关节角,由当前姿态至目标姿态的切换方向,依次控制云台转动,使得拍摄装置平滑地转动。By interpolation, at least one intermediate pose quaternion is inserted between the current pose quaternion and the target pose quaternion. According to the quaternion corresponding to the adjacent pose, the quaternion pose deviation corresponding to the adjacent pose is determined, and then According to the quaternion posture deviation corresponding to the adjacent posture, determine the joint angle corresponding to the adjacent posture, and then according to the joint angle corresponding to each adjacent posture, the direction of switching from the current posture to the target posture is controlled in turn to control the pan/tilt rotation to make the shooting The device rotates smoothly.
S503:根据云台的关节角,控制云台转动。S503: Control the rotation of the gimbal according to the joint angle of the gimbal.
其中,当目标关节角包括航向电机对应的关节角、横滚电机对应的关节角以及俯仰电机对应的关节角时,S503的实现过程可以包括:控制航向电机转动航向电机对应的关节角大小,控制横滚电机转动横滚电机对应的关节角大小,并控制俯仰电机转动俯仰电机对应的关节角大小。Wherein, when the target joint angle includes the joint angle corresponding to the heading motor, the joint angle corresponding to the roll motor, and the joint angle corresponding to the pitch motor, the realization process of S503 may include: controlling the heading motor to rotate the joint angle corresponding to the heading motor, and control The roll motor rotates the joint angle corresponding to the roll motor, and controls the pitch motor to rotate the joint angle corresponding to the pitch motor.
另外,在云台处于普通跟随模式下,若控制云台回中或自拍,云台是在关节坐标系是实现回中或自拍控制,云台不能回到一个水平的中位作为拍摄装置的拍摄起点,不便于云台操作者以手柄倾斜、水平、倒挂的姿态握持,进而无法以自身喜欢、最省力、最有利于拍摄的姿势握持,以便于在正立的场景稍微倾斜基座更好地发挥增稳性能、在手电筒(基座由正立切换为向前或向后翻转90度)拍摄的场景水平握持更舒适地、在低机位倒挂握持,甚至不能在FPV模式实现自拍。比如,在云台处于普通跟随模式下,若基座倾斜,云台回中后,拍摄装置拍摄的可能为地面,若通过摇杆控制拍摄装置的姿态,使得拍摄装置的特定平面平行于水平面,且拍摄装置的镜头朝向前方,会比较费力。In addition, when the gimbal is in the normal follow mode, if you control the gimbal to center or take a selfie, the gimbal is in the joint coordinate system to achieve centering or self-timer control, and the gimbal cannot return to a horizontal neutral position as a shooting device. Starting point, it is not convenient for the gimbal operator to hold it with the handle tilted, level, and upside down, and thus cannot hold it in the posture that he likes, the most labor-saving, and the most conducive to shooting, so that it is easier to tilt the base slightly in an upright scene. Good performance of stabilization, shooting scenes in the flashlight (the base is switched from upright to forward or backward by 90 degrees), horizontally holding more comfortably, holding upside down in a low camera position, not even in FPV mode Selfie. For example, when the gimbal is in the normal follow mode, if the base is tilted and the gimbal returns to the center, the camera may shoot the ground. If you control the posture of the camera by the joystick, the specific plane of the camera is parallel to the horizontal plane. And the lens of the camera is facing forward, which will be more laborious.
对于此,在一些实施例中,在云台处于FPV跟随模式下,可以一键式控制云台切换至预设目标姿态,该预设目标姿态可以包括云台回中时的姿态或云台的俯仰关节角为0度(自拍),云台在世界坐标系实现回中或自拍控制,云台能够回到一个水平的中位作为拍摄装置的拍摄起点,便于操作者以手柄倾斜、水平、倒挂的姿态握持,以便于在正立的场景稍微倾斜基座更好地发挥增稳性能、在手电筒(基座由正立切换为向前或向后翻转90度)拍摄的场景水平握持更舒适地、在低机位倒挂握持,有利于在FPV模式实现自拍。具体地,请参见图7,云台的控制方法还可以包括如下步骤:For this, in some embodiments, when the pan/tilt is in the FPV follow mode, the pan/tilt can be controlled to switch to a preset target posture with one button, and the preset target posture may include the posture of the gimbal when returning to the center or the position of the gimbal. The pitch joint angle is 0 degrees (self-timer). The gimbal can be controlled by centering or self-timer in the world coordinate system. The gimbal can return to a horizontal middle position as the starting point of the shooting device, which is convenient for the operator to tilt, level, and hang upside down with the handle. Hold it in an upright position, so as to slightly tilt the base in an upright scene to better exert the stabilization performance, and hold the scene more horizontally when shooting with a flashlight (the base is switched from upright to forward or backward by 90 degrees). Hold it upside down comfortably in a low camera position, which is conducive to self-timer in FPV mode. Specifically, referring to FIG. 7, the method for controlling the pan/tilt may further include the following steps:
S701:在云台处于FPV跟随模式下,获取到指示云台切换至预设目标姿态的第一触发指令;S701: when the pan/tilt is in the FPV follow mode, a first trigger instruction for instructing the pan/tilt to switch to a preset target posture is acquired;
S702:根据第一触发指令,控制云台切换至预设目标姿态。S702: According to the first trigger instruction, control the pan/tilt to switch to a preset target posture.
通过步骤S701和步骤S702,实现了云台处于FPV跟随模式下,一键式控制云台切换至预设目标姿态,便于云台操作者以自身喜欢、最省力、最有利于拍摄的姿势握持。Through step S701 and step S702, it is realized that the pan/tilt is in the FPV follow mode, and the pan/tilt is controlled to switch to the preset target posture with one button, which is convenient for the operator of the pan/tilt to hold in the posture that he likes, is the most labor-saving, and is most conducive to shooting. .
预设目标姿态可以根据需要设定,本实施例中,预设目标姿态可以包括云台回中时的姿态、云台的俯仰关节角为0度(自拍)等。The preset target posture can be set according to needs. In this embodiment, the preset target posture can include the posture of the pan/tilt when returning to the center, the pitch joint angle of the pan/tilt is 0 degrees (Selfie), and so on.
在一些实施例中,预设目标姿态为云台回中时的姿态,本实施例中,云台回中时,拍摄装置的坐标系中的特定平面平行于水平面,拍摄装置的光轴方向平行于特定平面。进一步地,云台回中时,拍摄装置的镜头朝向前方(即拍摄装置的镜头背对用户)。本实施例中,当拍摄装置正立放置时,拍摄装置的镜头背对用户,拍摄装置的光轴方向平行于水平面,特定平面也平行于水平面。In some embodiments, the preset target posture is the posture when the pan/tilt is returned to the center. In this embodiment, when the pan/tilt is returned to the center, the specific plane in the coordinate system of the camera is parallel to the horizontal plane, and the direction of the optical axis of the camera is parallel. In a specific plane. Further, when the pan/tilt is returned to the center, the lens of the photographing device faces forward (that is, the lens of the photographing device faces away from the user). In this embodiment, when the shooting device is placed upright, the lens of the shooting device faces away from the user, the optical axis direction of the shooting device is parallel to the horizontal plane, and the specific plane is also parallel to the horizontal plane.
在另一些实施例中,预设目标姿态为云台的俯仰关节角为0度,此时,云台处于自拍模式,云台的俯仰关节角为0度时,拍摄装置的镜头朝向用户且镜头比较容易对准用户。以云台为手持云台为例,云台的俯仰关节角为0度时,若手柄竖直放置,拍摄装置的坐标系中的特定平面与手柄的中轴线(即手柄长度方向的中轴线)垂直;应当理解的是,若手柄倾斜放置,拍摄装置的坐标系中的特定平面与手柄的中轴线垂直不成立。In other embodiments, the preset target posture is that the pitch joint angle of the gimbal is 0 degrees. At this time, the gimbal is in the Selfie mode. When the pitch joint angle of the gimbal is 0 degrees, the lens of the camera is facing the user and the lens It is easier to target users. Taking the gimbal as a handheld gimbal as an example, when the pitch joint angle of the gimbal is 0 degrees, if the handle is placed vertically, the specific plane in the coordinate system of the camera and the central axis of the handle (that is, the central axis in the length direction of the handle) Vertical; it should be understood that if the handle is placed obliquely, the specific plane in the coordinate system of the photographing device is perpendicular to the central axis of the handle.
第一触发指令的产生方式可以包括多种,例如,在其中一些实施例中,云台包括基座和设于基座上的控制部,第一触发指令由用户触发控制部产生。控制部可以包括按键、按钮、旋钮或上述组合。本实施例的控制部可以包括一个,也可以包括多个。当云台为手持云台时,手持云台可以包括手柄,控制部可以设于手柄上。在另一些实施例中,第一触发指令由用户操作外部设备产生,并由外部设备发送。该外部设备能够与云台进行通信,外部设备可以包括手机、平板电脑等可移动终端,也可以为固定终端,还可以为遥控器或其他云台的控制装置。The first trigger instruction can be generated in a variety of ways. For example, in some of the embodiments, the pan/tilt includes a base and a control unit provided on the base, and the first trigger instruction is generated by the user triggering the control unit. The control part may include keys, buttons, knobs or a combination of the above. The control unit in this embodiment may include one or more. When the pan/tilt is a handheld pan/tilt, the handheld pan/tilt may include a handle, and the control part may be provided on the handle. In some other embodiments, the first trigger instruction is generated by the user operating the external device and sent by the external device. The external device can communicate with the pan/tilt. The external device may include a mobile terminal such as a mobile phone and a tablet computer, a fixed terminal, or a remote control or other control device of the pan/tilt.
另外,云台的控制方法还可以包括:在云台处于FPV跟随模式下,获取基座的实时姿态四元数之前,若获取到指示云台进入FPV跟随模式的第二触发指令,则根据第二触发指令,控制云台进入FPV跟随模式。也即,在执行S201之前,需要触发云台进入FPV跟随模式。In addition, the control method of the pan/tilt may further include: when the pan/tilt is in the FPV follow mode, before acquiring the real-time attitude quaternion of the base, if a second trigger instruction indicating that the pan/tilt enters the FPV follow mode is acquired, then according to the first 2. Trigger the instruction to control the pan/tilt to enter the FPV follow mode. That is, before executing S201, it is necessary to trigger the pan-tilt to enter the FPV follow mode.
第二触发指令的产生方式可以包括多种,例如,在其中一些实施例中,云台包括基座和设于基座上的第二控制部,第二触发指令由用户触发第二控制部产生。控制部可以包括按键、按钮、旋钮或上述组合。本实施例的控制部可以包括一个,也可以包括多个。当云台为手持云台时,手持云台可以包括手柄,控制部可以设于手柄上。在另一些实施例中,第二触发指令由用户操作外部设备产生,并由外部设备发送。该外部设备能够与云台进行通信,外部设备可以包括手机、平板电脑等可移动终端,也可以为固定终端,还可以为遥控器或其他云台的控制装置。The second trigger instruction can be generated in a variety of ways. For example, in some of the embodiments, the pan/tilt includes a base and a second control part provided on the base, and the second trigger instruction is generated by the user triggering the second control part. . The control part may include keys, buttons, knobs or a combination of the above. The control unit in this embodiment may include one or more. When the pan/tilt is a handheld pan/tilt, the handheld pan/tilt may include a handle, and the control part may be provided on the handle. In other embodiments, the second trigger instruction is generated by the user operating the external device and sent by the external device. The external device can communicate with the pan/tilt. The external device may include a mobile terminal such as a mobile phone and a tablet computer, a fixed terminal, or a remote control or other control device of the pan/tilt.
对应于上述实施例的云台的控制方法,本申请实施例还提供一种云台,请结合图1和图8,该云台包括基座、轴组件和控制器。其中,轴组件设置于基座上,并且,轴组件用于搭载拍摄装置。本实施例的轴组件被配置为绕至少二个轴转动,可选地,轴组件被配置为绕偏航轴、俯仰轴和横滚轴转动;可选地,轴组件被配置为绕偏航轴和俯仰轴转动。控制器与云台电连接,可选地,控制器设于基座。Corresponding to the control method of the pan/tilt head in the foregoing embodiment, the embodiment of the present application also provides a pan/tilt head. With reference to FIGS. 1 and 8, the pan/tilt head includes a base, a shaft assembly and a controller. Wherein, the shaft assembly is arranged on the base, and the shaft assembly is used to mount the imaging device. The shaft assembly of this embodiment is configured to rotate around at least two axes. Optionally, the shaft assembly is configured to rotate around a yaw axis, a pitch axis, and a roll axis; optionally, the shaft assembly is configured to rotate around a yaw axis. The axis and the pitch axis rotate. The controller is electrically connected with the pan/tilt, and optionally, the controller is arranged on the base.
具体的,控制器用于:在云台处于第一人称主视角FPV跟随模式下,若接收到云台的控制装置发送的姿态控制量,则根据拍摄装置的欧拉角旋转顺序,对姿态控制量进行转换得到拍摄装置的第一目标欧拉角分量;根据第一目标欧拉角分量和拍摄装置的第二目标欧拉角分量,确定拍摄装置的目标欧拉角,第二目标欧拉角分量为根据基座的实时检测姿态确定;根据目标欧拉角,控制云台转动;其中,当云台处于FPV跟随模式时,至少两个轴的姿态跟随基座的姿态变化而变化。Specifically, the controller is used for: when the pan/tilt is in the first-person main angle of view FPV follow mode, if it receives the attitude control amount sent by the control device of the pan/tilt, it will perform the attitude control amount according to the Euler angle rotation sequence of the camera. The first target Euler angle component of the camera is obtained by conversion; the target Euler angle component of the camera is determined according to the first target Euler angle component and the second target Euler angle component of the camera, and the second target Euler angle component is It is determined according to the real-time detection attitude of the base; according to the target Euler angle, the pan/tilt is controlled to rotate; wherein, when the pan/tilt is in the FPV following mode, the attitude of at least two axes changes with the attitude of the base.
控制器的实现过程和工作原理可参见上述实施例的云台的控制方法的描述,此处不再赘述。For the implementation process and working principle of the controller, please refer to the description of the pan-tilt control method in the foregoing embodiment, which will not be repeated here.
本实施例的控制器可以是中央处理器(central processing unit,CPU)。控制器还可以进一步包括硬件芯片。上述硬件芯片可以是专用集成电路(application-specific integrated circuit,ASIC),可编程逻辑器件(programmable logic device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(complex programmable logic device,CPLD),现场可编程逻辑门阵列(field-programmable gate array,FPGA),通用阵列逻辑(generic array logic,GAL)或其任意组合。The controller in this embodiment may be a central processing unit (CPU). The controller may further include a hardware chip. The above-mentioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above-mentioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.
此外,当云台为手持云台时,基座可以为手持云台的手柄,或设于手持云台的手柄上。In addition, when the pan/tilt is a handheld pan/tilt, the base can be the handle of the handheld pan/tilt or be set on the handle of the handheld pan/tilt.
此外,本申请实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现上述实施例的云台的控制方法的步骤。In addition, an embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the method for controlling the pan/tilt head of the above-mentioned embodiment are realized.
所述计算机可读存储介质可以是前述任一实施例所述的云台的内部存储单元,例如硬盘或内存。所述计算机可读存储介质也可以是云台的外部存储设备,例如所述设备上配备的插接式硬盘、智能存储卡(Smart Media Card,SMC)、SD卡、闪存卡(Flash Card)等。进一步的,所述计算机可读存储介质还可以既包括云台的内部存储单元也包括外部存储设备。所述计算机可读存储介质用于存储所述计算机程序以及所述云台所需的其他程序和数据,还可以用于暂时地存储已经输出或者将要输出的数据。The computer-readable storage medium may be the internal storage unit of the pan/tilt head described in any of the foregoing embodiments, such as a hard disk or a memory. The computer-readable storage medium may also be an external storage device of the pan-tilt, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash memory card (Flash Card), etc. equipped on the device . Further, the computer-readable storage medium may also include both an internal storage unit of the pan-tilt and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the pan/tilt, and can also be used to temporarily store data that has been output or will be output.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(Random Access Memory,RAM)等。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium, and the program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.
以上所揭露的仅为本申请部分实施例而已,当然不能以此来限定本申请之权利范围,因此依本申请权利要求所作的等同变化,仍属本申请所涵盖的范围。The above-disclosed are only some of the embodiments of this application, which of course cannot be used to limit the scope of rights of this application. Therefore, equivalent changes made in accordance with the claims of this application still fall within the scope of this application.

Claims (46)

  1. 一种云台的控制方法,所述云台搭载在基座上,所述云台上搭载有拍摄装置,所述云台被配置为绕至少二个轴转动,其特征在于,所述方法包括:A method for controlling a pan/tilt, the pan/tilt is mounted on a base, a photographing device is mounted on the pan/tilt, and the pan/tilt is configured to rotate around at least two axes, characterized in that the method includes :
    在所述云台处于第一人称主视角FPV跟随模式下,若接收到所述云台的控制装置发送的姿态控制量,则根据所述拍摄装置的欧拉角旋转顺序,对所述姿态控制量进行转换得到所述拍摄装置的第一目标欧拉角分量;When the pan/tilt head is in the first-person main angle of view FPV follow mode, if the attitude control amount sent by the control device of the pan/tilt head is received, the attitude control amount will be adjusted according to the Euler angle rotation sequence of the camera. Performing conversion to obtain the first target Euler angle component of the photographing device;
    根据所述第一目标欧拉角分量和所述拍摄装置的第二目标欧拉角分量,确定所述拍摄装置的目标欧拉角,所述第二目标欧拉角分量为根据所述基座的实时检测姿态确定;Determine the target Euler angle of the camera according to the first target Euler angle component and the second target Euler angle component of the camera, and the second target Euler angle component is based on the base Real-time detection of posture determination;
    根据所述目标欧拉角,控制所述云台转动;Controlling the rotation of the pan/tilt according to the target Euler angle;
    其中,当所述云台处于所述FPV跟随模式时,所述至少两个轴的姿态跟随所述基座的姿态变化而变化。Wherein, when the pan/tilt is in the FPV following mode, the posture of the at least two axes changes following the posture of the base.
  2. 根据权利要求1所述的方法,其特征在于,所述转换包括所述云台转动的欧拉角速度的转换,或,所述云台转动的欧拉角大小的转换。The method according to claim 1, wherein the conversion includes conversion of the Euler angular velocity of the rotation of the pan/tilt, or conversion of the size of the Euler angle of the rotation of the pan/tilt.
  3. 根据权利要求1所述的方法,其特征在于,所述根据所述第一目标欧拉角分量和所述拍摄装置的第二目标欧拉角分量,确定所述拍摄装置的目标欧拉角,包括:The method according to claim 1, wherein the determining the target Euler angle of the photographing device according to the first target Euler angle component and the second target Euler angle component of the photographing device, include:
    根据所述第一目标欧拉角分量和所述拍摄装置的第二目标欧拉角分量之和,确定所述拍摄装置的目标欧拉角。The target Euler angle of the camera is determined according to the sum of the first target Euler angle component and the second target Euler angle component of the camera.
  4. 根据权利要求1所述的方法,其特征在于,所述根据所述目标欧拉角,控制所述云台转动,包括:The method according to claim 1, wherein the controlling the rotation of the pan/tilt head according to the target Euler angle comprises:
    根据所述目标欧拉角,确定所述拍摄装置的目标姿态四元数;Determining the quaternion of the target posture of the photographing device according to the target Euler angle;
    根据所述目标姿态四元数,确定所述云台的关节角;Determine the joint angle of the pan/tilt head according to the quaternion of the target posture;
    根据所述云台的关节角,控制所述云台转动。The rotation of the pan/tilt head is controlled according to the joint angle of the pan/tilt head.
  5. 根据权利要求4所述的方法,其特征在于,所述拍摄装置的当前姿态四元数不同于所述目标姿态四元数,所述根据所述目标姿态四元数,确定所述云台的关节角,包括:The method according to claim 4, wherein the quaternion of the current posture of the camera is different from the quaternion of the target posture, and the quaternion of the pan/tilt head is determined according to the quaternion of the target posture. Joint angle, including:
    根据所述当前姿态四元数、所述目标姿态四元数和预设插值策略,确定位于所述当前姿态四元数和所述目标姿态四元数之间的至少一个中间姿态四元数;Determine at least one intermediate posture quaternion between the current posture quaternion and the target posture quaternion according to the current posture quaternion, the target posture quaternion and a preset interpolation strategy;
    根据所述当前姿态四元数、至少一个所述中间姿态四元数以及所述目标姿态四元数,确定所述云台的目标关节角。Determine the target joint angle of the pan/tilt head according to the current posture quaternion, at least one of the intermediate posture quaternion, and the target posture quaternion.
  6. 根据权利要求5所述的方法,其特征在于,所述根据所述当前姿态四元数、所述目标姿态四元数和预设插值策略,确定位于所述当前姿态四元数和所述目标姿态四元数之间的至少一个中间姿态四元数,包括:The method according to claim 5, wherein the determining the current attitude quaternion and the target based on the current attitude quaternion, the target attitude quaternion, and a preset interpolation strategy At least one intermediate posture quaternion between posture quaternions, including:
    根据所述当前姿态四元数、所述目标姿态四元数和至少一个时间变化参数,确定位于所述当前姿态四元数和所述目标姿态四元数之间的至少一个中间姿态四元数;Determine at least one intermediate posture quaternion between the current posture quaternion and the target posture quaternion according to the current posture quaternion, the target posture quaternion and at least one time change parameter ;
    其中,至少一个所述时间变化参数和至少一个中间姿态四元数一一对应。Wherein, at least one of the time change parameters and at least one intermediate posture quaternion correspond one-to-one.
  7. 根据权利要求1所述的方法,其特征在于,所述基座的实时检测姿态的获取方式,包括:The method according to claim 1, wherein the method for acquiring the real-time detection posture of the base includes:
    获取所述拍摄装置的实时姿态四元数;Acquiring the real-time attitude quaternion of the camera;
    根据所述拍摄装置的实时姿态四元数,确定所述基座的实时姿态四元数,所述基座的实时姿态四元数用于表征所述基座的实时检测姿态。The real-time attitude quaternion of the base is determined according to the real-time attitude quaternion of the photographing device, and the real-time attitude quaternion of the base is used to characterize the real-time detection attitude of the base.
  8. 根据权利要求1所述的方法,其特征在于,所述第二目标欧拉角分量为根据所述基座的实时检测姿态确定,包括:The method according to claim 1, wherein the second target Euler angle component is determined according to the real-time detection attitude of the base, and comprises:
    第二目标欧拉角分量为根据所述基座的实时检测姿态以及所述拍摄装置与所述基座之间的预设姿态偏差确定。The second target Euler angle component is determined according to the real-time detection attitude of the base and the preset attitude deviation between the camera and the base.
  9. 根据权利要求8所述的方法,其特征在于,所述预设姿态偏差为所述云台进入所述FPV跟随模式时,所述拍摄装置与所述基座之间的姿态偏差。The method according to claim 8, wherein the preset attitude deviation is the attitude deviation between the camera and the base when the pan/tilt head enters the FPV follow mode.
  10. 根据权利要求1所述的方法,其特征在于,当所述拍摄装置处于水平取向拍摄模式时,所述拍摄装置的欧拉角的旋转顺序为:第三轴、第一轴、第二轴,或第二轴、第一轴、第三轴,所述第一轴平行于所述拍摄装置的光轴方向,所述第一轴、所述第二轴、所述第三轴分别正交;The method according to claim 1, wherein when the camera is in the horizontal orientation shooting mode, the rotation sequence of the Euler angle of the camera is: third axis, first axis, second axis, Or a second axis, a first axis, and a third axis, the first axis is parallel to the optical axis direction of the imaging device, and the first axis, the second axis, and the third axis are respectively orthogonal;
    其中,所述姿态控制量中用于控制所述云台绕航向轴转动的分量为基于所述欧拉角旋转顺序中的第三轴进行转换得到,用于控制所述云台绕俯仰轴转动的分量为基于所述欧拉角旋转顺序中的第二轴进行转换得到,用于控制所述云台绕横滚轴转动的分量为基于所述欧拉角旋转顺序中的第一轴进行转换得到。Wherein, the component of the attitude control quantity used to control the rotation of the gimbal around the yaw axis is obtained by conversion based on the third axis in the Euler angle rotation sequence, and is used to control the rotation of the gimbal around the pitch axis The component of is converted based on the second axis in the Euler angle rotation sequence, and the component used to control the rotation of the pan/tilt around the roll axis is converted based on the first axis in the Euler angle rotation sequence get.
  11. 根据权利要求10所述的方法,其特征在于,在所述拍摄装置以水平取向放置、且所述拍摄装置的光轴平行于水平面时,所述第三轴为竖直方向;The method according to claim 10, wherein when the photographing device is placed in a horizontal orientation and the optical axis of the photographing device is parallel to a horizontal plane, the third axis is a vertical direction;
    在所述云台为ZXY构型时,所述拍摄装置的欧拉角旋转顺序为:第三轴、第一轴、第二轴。When the pan-tilt is in the ZXY configuration, the Euler angle rotation sequence of the photographing device is: the third axis, the first axis, and the second axis.
  12. 根据权利要求10所述的方法,其特征在于,在所述拍摄装置以水平取向放置、且所述拍摄装置的光轴平行于水平面时,所述第三轴为竖直方向;The method according to claim 10, wherein when the photographing device is placed in a horizontal orientation and the optical axis of the photographing device is parallel to a horizontal plane, the third axis is a vertical direction;
    在所述云台为YXZ构型时,所述拍摄装置的欧拉角旋转顺序为:第二轴、第一轴、第三轴。When the pan-tilt is in the YXZ configuration, the Euler angle rotation sequence of the camera is: second axis, first axis, and third axis.
  13. 根据权利要求1所述的方法,其特征在于,当所述拍摄装置处于竖直取向拍摄模式时,所述拍摄装置的欧拉角的旋转顺序为:第二轴、第一轴、第二轴,或第三轴、第一轴、第三轴,所述第一轴平行于所述拍摄装置的光轴方向,所述第一轴、所述第二轴、所述第三轴分别正交;The method according to claim 1, wherein when the camera is in the vertical orientation shooting mode, the rotation sequence of the Euler angle of the camera is: second axis, first axis, second axis , Or the third axis, the first axis, the third axis, the first axis is parallel to the optical axis direction of the imaging device, and the first axis, the second axis, and the third axis are respectively orthogonal ;
    若所述拍摄装置的欧拉角旋转顺序为:第二轴、第一轴、第二轴,则所述姿态控制量中用于控制所述云台绕航向轴转动的分量以及用于控制所述云台绕俯仰轴转动的分量,为基于所述欧拉角旋转顺序中的第二轴进行转换得到,用于控制所述云台绕横滚轴转动的分量为基于所述欧拉角旋转顺序中的第一轴进行转换得到;If the Euler angle rotation sequence of the camera is: second axis, first axis, second axis, then the component of the attitude control quantity used to control the rotation of the pan/tilt around the yaw axis and used to control the The component of the pan/tilt rotation around the pitch axis is obtained by conversion based on the second axis in the Euler angle rotation sequence, and the component used to control the rotation of the pan/tilt around the roll axis is based on the Euler angle rotation The first axis in the sequence is converted;
    若所述拍摄装置的欧拉角旋转顺序为:第三轴、第一轴、第三轴,所述姿态控制 量中用于控制所述云台绕航向轴转动的分量,以及用于控制所述云台绕俯仰轴转动的分量,为基于所述欧拉角旋转顺序中的第三轴进行转换得到,用于控制所述云台绕横滚轴转动的分量为基于所述欧拉角旋转顺序中的第一轴进行转换得到。If the Euler angle rotation sequence of the photographing device is: the third axis, the first axis, and the third axis, the component of the attitude control quantity used to control the rotation of the pan/tilt around the yaw axis, and used to control the The component of the pan/tilt rotation around the pitch axis is obtained by conversion based on the third axis in the Euler angle rotation sequence, and the component used to control the rotation of the pan/tilt around the roll axis is based on the Euler angle rotation The first axis in the sequence is transformed.
  14. 根据权利要求13所述的方法,其特征在于,在所述拍摄装置以水平取向放置、且所述拍摄装置的光轴平行于水平面时,所述第三轴为竖直方向;The method according to claim 13, wherein when the photographing device is placed in a horizontal orientation and the optical axis of the photographing device is parallel to a horizontal plane, the third axis is a vertical direction;
    在所述云台为ZXY构型时,所述拍摄装置的欧拉角旋转顺序为:第三轴、第一轴、第三轴。When the pan-tilt is in the ZXY configuration, the Euler angle rotation sequence of the photographing device is: the third axis, the first axis, and the third axis.
  15. 根据权利要求13所述的方法,其特征在于,在所述拍摄装置以水平取向放置、且所述拍摄装置的光轴平行于水平面时,所述第三轴为竖直方向;The method according to claim 13, wherein when the photographing device is placed in a horizontal orientation and the optical axis of the photographing device is parallel to a horizontal plane, the third axis is a vertical direction;
    在所述云台为YXZ构型时,所述拍摄装置的欧拉角旋转顺序为:第二轴、第一轴、第二轴。When the PTZ is in the YXZ configuration, the Euler angle rotation sequence of the camera is: second axis, first axis, and second axis.
  16. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, wherein the method further comprises:
    在所述云台处于所述FPV跟随模式下,获取到指示所述云台切换至预设目标姿态的第一触发指令;When the pan/tilt is in the FPV follow mode, acquiring a first trigger instruction instructing the pan/tilt to switch to a preset target posture;
    根据所述第一触发指令,控制所述云台切换至所述预设目标姿态。According to the first trigger instruction, control the pan/tilt head to switch to the preset target posture.
  17. 根据权利要求16所述的方法,其特征在于,所述预设目标姿态包括云台回中时的姿态;The method according to claim 16, wherein the preset target posture includes the posture of the pan/tilt when returning to the center;
    其中,所述云台回中时,所述拍摄装置的坐标系中的特定平面平行于水平面,所述拍摄装置的光轴方向平行于所述特定平面。Wherein, when the pan/tilt is returned to the center, the specific plane in the coordinate system of the camera is parallel to the horizontal plane, and the direction of the optical axis of the camera is parallel to the specific plane.
  18. 根据权利要求16所述的方法,其特征在于,所述预设目标姿态包括所述云台的俯仰关节角为0度。The method according to claim 16, wherein the preset target attitude includes that the pitch joint angle of the pan/tilt is 0 degrees.
  19. 根据权利要求16所述的方法,其特征在于,所述云台包括:基座和设于所述基座上的第一控制部,所述第一触发指令由用户触发所述第一控制部产生;或者The method according to claim 16, wherein the pan/tilt head comprises: a base and a first control unit provided on the base, and the first trigger instruction is triggered by a user to trigger the first control unit Produce; or
    所述第一触发指令由用户操作外部设备产生,并由所述外部设备发送。The first trigger instruction is generated by a user operating an external device and sent by the external device.
  20. 根据权利要求1所述的方法,其特征在于,所述在所述云台处于第一人称主视角FPV跟随模式下,获取所述基座的实时姿态四元数之前,还包括:The method according to claim 1, characterized in that, before acquiring the real-time attitude quaternion of the base when the pan/tilt is in the first-person main-view FPV follow mode, the method further comprises:
    获取到指示所述云台进入所述FPV跟随模式的第二触发指令;Acquiring a second trigger instruction indicating that the pan/tilt enters the FPV follow mode;
    根据所述第二触发指令,控制所述云台进入所述FPV跟随模式。According to the second trigger instruction, control the pan/tilt to enter the FPV follow mode.
  21. 根据权利要求20所述的方法,其特征在于,所述云台包括:基座和设于所述基座上的第二控制部,所述第二触发指令由用户触发所述第二控制部产生;或者The method according to claim 20, wherein the pan/tilt head comprises: a base and a second control unit provided on the base, and the second trigger instruction is triggered by a user to trigger the second control unit Produce; or
    所述第二触发指令由用户操作外部设备产生,并由所述外部设备发送。The second trigger instruction is generated by a user operating an external device and sent by the external device.
  22. 根据权利要求1所述的方法,其特征在于,所述云台被配置为绕两个轴转动,两个所述轴包括偏航轴和俯仰轴。The method according to claim 1, wherein the pan/tilt is configured to rotate around two axes, the two axes including a yaw axis and a pitch axis.
  23. 根据权利要求1所述的方法,其特征在于,所述云台被配置为绕三个轴转动,三个所述轴包括偏航轴、俯仰轴和横滚轴。The method according to claim 1, wherein the pan-tilt is configured to rotate around three axes, and the three axes include a yaw axis, a pitch axis, and a roll axis.
  24. 一种云台,其特征在于,所述云台包括:A pan-tilt, characterized in that the pan-tilt includes:
    基座;Base
    设置于所述基座上的轴组件,所述轴组件用于搭载拍摄装置,所述轴组件被配置为绕至少二个轴转动;和A shaft assembly provided on the base, the shaft assembly is used to mount a photographing device, and the shaft assembly is configured to rotate about at least two shafts; and
    控制器,所述控制器与所述云台电连接,所述控制器用于:A controller, the controller is electrically connected to the pan-tilt, and the controller is used for:
    在所述云台处于第一人称主视角FPV跟随模式下,若接收到所述云台的控制装置发送的姿态控制量,则根据所述拍摄装置的欧拉角旋转顺序,对所述姿态控制量进行转换得到所述拍摄装置的第一目标欧拉角分量;When the pan/tilt head is in the first-person main angle of view FPV follow mode, if the attitude control amount sent by the control device of the pan/tilt head is received, the attitude control amount will be adjusted according to the Euler angle rotation sequence of the camera. Performing conversion to obtain the first target Euler angle component of the photographing device;
    根据所述第一目标欧拉角分量和所述拍摄装置的第二目标欧拉角分量,确定所述拍摄装置的目标欧拉角,所述第二目标欧拉角分量为根据所述基座的实时检测姿态确定;Determine the target Euler angle of the camera according to the first target Euler angle component and the second target Euler angle component of the camera, and the second target Euler angle component is based on the base Real-time detection of posture determination;
    根据所述目标欧拉角,控制所述云台转动;Controlling the rotation of the pan/tilt according to the target Euler angle;
    其中,当所述云台处于所述FPV跟随模式时,所述至少两个轴的姿态跟随所述基座的姿态变化而变化。Wherein, when the pan/tilt is in the FPV following mode, the posture of the at least two axes changes following the posture of the base.
  25. 根据权利要求24所述的云台,其特征在于,所述转换包括所述云台转动的欧拉角速度的转换,或,所述云台转动的欧拉角大小的转换。The pan/tilt head according to claim 24, wherein the conversion includes conversion of the Euler angular velocity of the rotation of the pan/tilt, or conversion of the size of the Euler angle of the rotation of the pan/tilt.
  26. 根据权利要求24所述的云台,其特征在于,所述控制器在根据所述第一目标欧拉角分量和所述拍摄装置的第二目标欧拉角分量,确定所述拍摄装置的目标欧拉角时,具体用于:The pan/tilt head according to claim 24, wherein the controller determines the target of the camera according to the first target Euler angle component and the second target Euler angle component of the camera. When Euler angle, it is specifically used for:
    根据所述第一目标欧拉角分量和所述拍摄装置的第二目标欧拉角分量之和,确定所述拍摄装置的目标欧拉角。The target Euler angle of the camera is determined according to the sum of the first target Euler angle component and the second target Euler angle component of the camera.
  27. 根据权利要求24所述的云台,其特征在于,所述控制器在根据所述目标欧拉角,控制所述云台转动时,具体用于:The pan/tilt head according to claim 24, wherein when the controller controls the rotation of the pan/tilt head according to the target Euler angle, it is specifically configured to:
    根据所述目标欧拉角,确定所述拍摄装置的目标姿态四元数;Determining the quaternion of the target posture of the photographing device according to the target Euler angle;
    根据所述目标姿态四元数,确定所述云台的关节角;Determine the joint angle of the pan/tilt head according to the quaternion of the target posture;
    根据所述云台的关节角,控制所述云台转动。The rotation of the pan/tilt head is controlled according to the joint angle of the pan/tilt head.
  28. 根据权利要求27所述的云台,其特征在于,所述拍摄装置的当前姿态四元数不同于所述目标姿态四元数,所述控制器在根据所述目标姿态四元数,确定所述云台的关节角时,具体用于:The pan/tilt head according to claim 27, wherein the current posture quaternion of the camera is different from the target posture quaternion, and the controller determines the quaternion according to the target posture quaternion. When describing the joint angle of the PTZ, it is specifically used for:
    根据所述当前姿态四元数、所述目标姿态四元数和预设插值策略,确定位于所述当前姿态四元数和所述目标姿态四元数之间的至少一个中间姿态四元数;Determine at least one intermediate posture quaternion between the current posture quaternion and the target posture quaternion according to the current posture quaternion, the target posture quaternion and a preset interpolation strategy;
    根据所述当前姿态四元数、至少一个所述中间姿态四元数以及所述目标姿态四元数,确定所述云台的目标关节角。Determine the target joint angle of the pan/tilt head according to the current posture quaternion, at least one of the intermediate posture quaternion, and the target posture quaternion.
  29. 根据权利要求28所述的云台,其特征在于,所述控制器在根据所述当前姿态四元数、所述目标姿态四元数和预设插值策略,确定位于所述当前姿态四元数和所述目标姿态四元数之间的至少一个中间姿态四元数时,具体用于:The pan/tilt head according to claim 28, wherein the controller determines the quaternion in the current posture according to the quaternion of the current posture, the quaternion of the target posture, and a preset interpolation strategy. When it is at least one intermediate posture quaternion between the target posture quaternion and the target posture quaternion, it is specifically used for:
    根据所述当前姿态四元数、所述目标姿态四元数和至少一个时间变化参数,确定 位于所述当前姿态四元数和所述目标姿态四元数之间的至少一个中间姿态四元数;Determine at least one intermediate posture quaternion between the current posture quaternion and the target posture quaternion according to the current posture quaternion, the target posture quaternion and at least one time change parameter ;
    其中,至少一个所述时间变化参数和至少一个中间姿态四元数一一对应。Wherein, at least one of the time change parameters and at least one intermediate posture quaternion correspond one-to-one.
  30. 根据权利要求24所述的云台,其特征在于,所述控制器在获取基座的实时检测姿态时,具体用于:The pan/tilt head according to claim 24, wherein the controller is specifically configured to:
    获取所述拍摄装置的实时姿态四元数;Acquiring the real-time attitude quaternion of the camera;
    根据所述拍摄装置的实时姿态四元数,确定所述基座的实时姿态四元数,所述基座的实时姿态四元数用于表征所述基座的实时检测姿态。The real-time attitude quaternion of the base is determined according to the real-time attitude quaternion of the photographing device, and the real-time attitude quaternion of the base is used to characterize the real-time detection attitude of the base.
  31. 根据权利要求24所述的云台,其特征在于,所述第二目标欧拉角分量为根据所述基座的实时检测姿态确定,包括:The pan/tilt head according to claim 24, wherein the second target Euler angle component is determined according to the real-time detection attitude of the base, and comprises:
    第二目标欧拉角分量为根据所述基座的实时检测姿态以及所述拍摄装置与所述基座之间的预设姿态偏差确定。The second target Euler angle component is determined according to the real-time detection attitude of the base and the preset attitude deviation between the camera and the base.
  32. 根据权利要求31所述的云台,其特征在于,所述预设姿态偏差为所述云台进入所述FPV跟随模式时,所述拍摄装置与所述基座之间的姿态偏差。The pan/tilt head according to claim 31, wherein the preset attitude deviation is the attitude deviation between the camera and the base when the pan/tilt head enters the FPV follow mode.
  33. 根据权利要求24所述的云台,其特征在于,当所述拍摄装置处于水平取向拍摄模式时,所述拍摄装置的欧拉角的旋转顺序为:第三轴、第一轴、第二轴,或第二轴、第一轴、第三轴,所述第一轴平行于所述拍摄装置的光轴方向,所述第一轴、所述第二轴、所述第三轴分别正交;The pan/tilt head according to claim 24, wherein when the camera is in the horizontal orientation shooting mode, the rotation sequence of the Euler angle of the camera is: third axis, first axis, second axis , Or the second axis, the first axis, the third axis, the first axis is parallel to the optical axis direction of the imaging device, and the first axis, the second axis, and the third axis are respectively orthogonal ;
    其中,所述姿态控制量中用于控制所述云台绕航向轴转动的分量为基于所述欧拉角旋转顺序中的第三轴进行转换得到,用于控制所述云台绕俯仰轴转动的分量为基于所述欧拉角旋转顺序中的第二轴进行转换得到,用于控制所述云台绕横滚轴转动的分量为基于所述欧拉角旋转顺序中的第一轴进行转换得到。Wherein, the component of the attitude control quantity used to control the rotation of the gimbal around the yaw axis is obtained by conversion based on the third axis in the Euler angle rotation sequence, and is used to control the rotation of the gimbal around the pitch axis The component of is converted based on the second axis in the Euler angle rotation sequence, and the component used to control the rotation of the pan/tilt around the roll axis is converted based on the first axis in the Euler angle rotation sequence get.
  34. 根据权利要求33所述的云台,其特征在于,在所述拍摄装置以水平取向放置、且所述拍摄装置的光轴平行于水平面时,所述第三轴为竖直方向;The pan/tilt head according to claim 33, wherein when the photographing device is placed in a horizontal orientation and the optical axis of the photographing device is parallel to a horizontal plane, the third axis is a vertical direction;
    在所述云台为ZXY构型时,所述拍摄装置的欧拉角旋转顺序为:第三轴、第一轴、第二轴。When the pan-tilt is in the ZXY configuration, the Euler angle rotation sequence of the photographing device is: the third axis, the first axis, and the second axis.
  35. 根据权利要求33所述的云台,其特征在于,在所述拍摄装置以水平取向放置、且所述拍摄装置的光轴平行于水平面时,所述第三轴为竖直方向;The pan/tilt head according to claim 33, wherein when the photographing device is placed in a horizontal orientation and the optical axis of the photographing device is parallel to a horizontal plane, the third axis is a vertical direction;
    在所述云台为YXZ构型时,所述拍摄装置的欧拉角旋转顺序为:第二轴、第一轴、第三轴。When the pan-tilt is in the YXZ configuration, the Euler angle rotation sequence of the camera is: second axis, first axis, and third axis.
  36. 根据权利要求24所述的云台,其特征在于,当所述拍摄装置处于竖直取向拍摄模式时,所述拍摄装置的欧拉角的旋转顺序为:第二轴、第一轴、第二轴,或第三轴、第一轴、第三轴,所述第一轴平行于所述拍摄装置的光轴方向,所述第一轴、所述第二轴、所述第三轴分别正交;The pan/tilt head according to claim 24, wherein when the camera is in the vertical orientation shooting mode, the rotation sequence of the Euler angle of the camera is: second axis, first axis, second axis Axis, or the third axis, the first axis, the third axis, the first axis is parallel to the optical axis direction of the imaging device, the first axis, the second axis, and the third axis are positive respectively cross;
    若所述拍摄装置的欧拉角旋转顺序为:第二轴、第一轴、第二轴,则所述姿态控制量中用于控制所述云台绕航向轴转动的分量以及用于控制所述云台绕俯仰轴转动的分量,为基于所述欧拉角旋转顺序中的第二轴进行转换得到,用于控制所述云台绕横 滚轴转动的分量为基于所述欧拉角旋转顺序中的第一轴进行转换得到;If the Euler angle rotation sequence of the photographing device is: second axis, first axis, second axis, then the component of the attitude control quantity used to control the rotation of the pan/tilt around the yaw axis and the The component of the pan/tilt rotation around the pitch axis is obtained by conversion based on the second axis in the Euler angle rotation sequence, and the component used to control the rotation of the pan/tilt around the roll axis is based on the Euler angle rotation The first axis in the sequence is converted;
    若所述拍摄装置的欧拉角旋转顺序为:第三轴、第一轴、第三轴,所述姿态控制量中用于控制所述云台绕航向轴转动的分量,以及用于控制所述云台绕俯仰轴转动的分量,为基于所述欧拉角旋转顺序中的第三轴进行转换得到,用于控制所述云台绕横滚轴转动的分量为基于所述欧拉角旋转顺序中的第一轴进行转换得到。If the Euler angle rotation sequence of the photographing device is: the third axis, the first axis, and the third axis, the component of the attitude control quantity used to control the rotation of the pan/tilt around the yaw axis, and used to control the The component of the pan/tilt rotation around the pitch axis is obtained by conversion based on the third axis in the Euler angle rotation sequence, and the component used to control the rotation of the pan/tilt head around the roll axis is based on the Euler angle rotation The first axis in the sequence is transformed.
  37. 根据权利要求36所述的云台,其特征在于,在所述拍摄装置以水平取向放置、且所述拍摄装置的光轴平行于水平面时,所述第三轴为竖直方向;The pan/tilt head according to claim 36, wherein when the photographing device is placed in a horizontal orientation and the optical axis of the photographing device is parallel to a horizontal plane, the third axis is a vertical direction;
    在所述云台为ZXY构型时,所述拍摄装置的欧拉角旋转顺序为:第三轴、第一轴、第三轴。When the pan-tilt is in the ZXY configuration, the Euler angle rotation sequence of the photographing device is: the third axis, the first axis, and the third axis.
  38. 根据权利要求36所述的云台,其特征在于,在所述拍摄装置以水平取向放置、且所述拍摄装置的光轴平行于水平面时,所述第三轴为竖直方向;The pan/tilt head according to claim 36, wherein when the photographing device is placed in a horizontal orientation and the optical axis of the photographing device is parallel to a horizontal plane, the third axis is a vertical direction;
    在所述云台为YXZ构型时,所述拍摄装置的欧拉角旋转顺序为:第二轴、第一轴、第二轴。When the PTZ is in the YXZ configuration, the Euler angle rotation sequence of the camera is: second axis, first axis, and second axis.
  39. 根据权利要求24所述的云台,其特征在于,所述控制器还用于:The pan-tilt according to claim 24, wherein the controller is further used for:
    在所述云台处于所述FPV跟随模式下,获取到指示所述云台切换至预设目标姿态的第一触发指令;When the pan/tilt is in the FPV follow mode, acquiring a first trigger instruction instructing the pan/tilt to switch to a preset target posture;
    根据所述第一触发指令,控制所述云台切换至所述预设目标姿态。According to the first trigger instruction, control the pan/tilt to switch to the preset target posture.
  40. 根据权利要求39所述的云台,其特征在于,所述预设目标姿态包括云台回中时的姿态;The pan/tilt head according to claim 39, wherein the preset target posture comprises the posture of the pan/tilt head when returning to the center;
    其中,所述云台回中时,所述拍摄装置的坐标系中的特定平面平行于水平面,所述拍摄装置的光轴方向平行于所述特定平面。Wherein, when the pan/tilt is returned to the center, the specific plane in the coordinate system of the camera is parallel to the horizontal plane, and the direction of the optical axis of the camera is parallel to the specific plane.
  41. 根据权利要求39所述的云台,其特征在于,所述预设目标姿态包括所述云台的俯仰关节角为0度。The pan/tilt head according to claim 39, wherein the preset target attitude includes that the pitch joint angle of the pan/tilt head is 0 degrees.
  42. 根据权利要求39所述的云台,其特征在于,所述云台包括:基座和设于所述基座上的第一控制部,所述第一触发指令由用户触发所述第一控制部产生;或者The pan/tilt head according to claim 39, wherein the pan/tilt head comprises: a base and a first control part provided on the base, and the first trigger instruction is triggered by the user to trigger the first control part. Partly produced; or
    所述第一触发指令由用户操作外部设备产生,并由所述外部设备发送。The first trigger instruction is generated by a user operating an external device and sent by the external device.
  43. 根据权利要求24所述的云台,其特征在于,所述控制器在所述云台处于第一人称主视角FPV跟随模式下,获取所述基座的实时姿态四元数之前,还用于:The pan/tilt head according to claim 24, wherein the controller is further configured to: before the pan/tilt head is in the first-person main-view FPV follow mode and obtain the real-time attitude quaternion of the base, the controller is further configured to:
    获取到指示所述云台进入所述FPV跟随模式的第二触发指令;Acquiring a second trigger instruction indicating that the pan/tilt enters the FPV follow mode;
    根据所述第二触发指令,控制所述云台进入所述FPV跟随模式。According to the second trigger instruction, control the pan/tilt to enter the FPV follow mode.
  44. 根据权利要求43所述的云台,其特征在于,所述云台包括:基座和设于所述基座上的第二控制部,所述第二触发指令由用户触发所述第二控制部产生;或者The pan/tilt head according to claim 43, wherein the pan/tilt head comprises: a base and a second control part provided on the base, and the second trigger instruction is triggered by the user to trigger the second control unit. Partly produced; or
    所述第二触发指令由用户操作外部设备产生,并由所述外部设备发送。The second trigger instruction is generated by a user operating an external device and sent by the external device.
  45. 根据权利要求24所述的云台,其特征在于,所述云台被配置为绕两个轴转动,两个所述轴包括偏航轴和俯仰轴。The pan/tilt head according to claim 24, wherein the pan/tilt head is configured to rotate around two axes, the two axes including a yaw axis and a pitch axis.
  46. 根据权利要求24所述的云台,其特征在于,所述云台被配置为绕三个轴转动, 三个所述轴包括偏航轴、俯仰轴和横滚轴。The pan/tilt head of claim 24, wherein the pan/tilt head is configured to rotate around three axes, and the three axes include a yaw axis, a pitch axis, and a roll axis.
PCT/CN2019/130861 2019-12-31 2019-12-31 Gimbal control method and gimbal WO2021134644A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980052066.6A CN112544065A (en) 2019-12-31 2019-12-31 Cloud deck control method and cloud deck
PCT/CN2019/130861 WO2021134644A1 (en) 2019-12-31 2019-12-31 Gimbal control method and gimbal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/130861 WO2021134644A1 (en) 2019-12-31 2019-12-31 Gimbal control method and gimbal

Publications (1)

Publication Number Publication Date
WO2021134644A1 true WO2021134644A1 (en) 2021-07-08

Family

ID=75013405

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/130861 WO2021134644A1 (en) 2019-12-31 2019-12-31 Gimbal control method and gimbal

Country Status (2)

Country Link
CN (1) CN112544065A (en)
WO (1) WO2021134644A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114967716A (en) * 2022-04-02 2022-08-30 中国人民解放军海军航空大学 Fixed-wing aircraft attitude control method based on quaternion spherical linear interpolation
CN116000925A (en) * 2022-12-27 2023-04-25 北京纳通医用机器人科技有限公司 Mechanical arm tracking method, device, equipment and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113329181B (en) * 2021-06-08 2022-06-14 厦门四信通信科技有限公司 Angle switching method, device, equipment and storage medium of camera

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007095950A1 (en) * 2006-02-21 2007-08-30 Stobbe Tech Holding A/S Remote controlled pan-tilt-angle device for supporting and exact positioning of optical equipment
CN106814754A (en) * 2017-03-28 2017-06-09 东莞松山湖国际机器人研究院有限公司 A kind of three axle heads, shooting robot and control method
CN108521814A (en) * 2017-09-12 2018-09-11 深圳市大疆灵眸科技有限公司 Control method, controller and the holder of holder
CN108762324A (en) * 2018-05-23 2018-11-06 深圳市道通智能航空技术有限公司 Horizontal stage electric machine angle and angular speed evaluation method, device, holder and aircraft
CN109292103A (en) * 2018-07-27 2019-02-01 北京臻迪科技股份有限公司 Holder method of adjustment, device, unmanned plane and holder adjust system
CN209351613U (en) * 2018-11-01 2019-09-06 深圳博士智能科技有限公司 A kind of concealed three axis holder of O-E Payload for UAV
CN110431507A (en) * 2018-05-31 2019-11-08 深圳市大疆创新科技有限公司 A kind of cloud platform control method and holder

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9567077B2 (en) * 2014-02-14 2017-02-14 Accenture Global Services Limited Unmanned vehicle (UV) control system
CN108259703B (en) * 2017-12-31 2021-06-01 深圳市越疆科技有限公司 Pan-tilt and pan-tilt tracking control method and device and pan-tilt
CN108234871A (en) * 2017-12-31 2018-06-29 深圳市秦墨科技有限公司 A kind of control method based on holder, device and electronic equipment
WO2019227347A1 (en) * 2018-05-30 2019-12-05 深圳市大疆创新科技有限公司 Gimbal control method, gimbal, photography device, and readable storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007095950A1 (en) * 2006-02-21 2007-08-30 Stobbe Tech Holding A/S Remote controlled pan-tilt-angle device for supporting and exact positioning of optical equipment
CN106814754A (en) * 2017-03-28 2017-06-09 东莞松山湖国际机器人研究院有限公司 A kind of three axle heads, shooting robot and control method
CN108521814A (en) * 2017-09-12 2018-09-11 深圳市大疆灵眸科技有限公司 Control method, controller and the holder of holder
CN108762324A (en) * 2018-05-23 2018-11-06 深圳市道通智能航空技术有限公司 Horizontal stage electric machine angle and angular speed evaluation method, device, holder and aircraft
CN110431507A (en) * 2018-05-31 2019-11-08 深圳市大疆创新科技有限公司 A kind of cloud platform control method and holder
CN109292103A (en) * 2018-07-27 2019-02-01 北京臻迪科技股份有限公司 Holder method of adjustment, device, unmanned plane and holder adjust system
CN209351613U (en) * 2018-11-01 2019-09-06 深圳博士智能科技有限公司 A kind of concealed three axis holder of O-E Payload for UAV

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114967716A (en) * 2022-04-02 2022-08-30 中国人民解放军海军航空大学 Fixed-wing aircraft attitude control method based on quaternion spherical linear interpolation
CN116000925A (en) * 2022-12-27 2023-04-25 北京纳通医用机器人科技有限公司 Mechanical arm tracking method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN112544065A (en) 2021-03-23

Similar Documents

Publication Publication Date Title
WO2021134644A1 (en) Gimbal control method and gimbal
WO2019227384A1 (en) Pan-tilt control method and pan-tilt
US11184548B2 (en) Imaging device, and method and apparatus for controlling the imaging device
US11265471B2 (en) Gimbal control method, device, gimbal, system, and storage medium
CN111279113B (en) Handheld holder control method and handheld holder
WO2020062281A1 (en) Cradle head control method, cradle head, movable platform and readable storage medium
WO2021026789A1 (en) Photographing method based on handheld gimbal, and handheld gimbal and storage medium
WO2022061537A1 (en) Control method, handheld gimbal, system, and computer-readable storage medium
US20220163166A1 (en) Handheld gimbal, gimbal control method and computer-readable storage medium
WO2018191971A1 (en) Cradle head control method and cradle head
WO2020107284A1 (en) Mode switching method and device for tripod head, movable platform, and storage medium
WO2020097893A1 (en) Hand-held gimbal controlling method and hand-held gimbal
WO2019227410A1 (en) Attitude conversion method, attitude display method, and pan-tilt system
WO2022061541A1 (en) Control method, handheld gimbal, system, and computer-readable storage medium
WO2022041013A1 (en) Control method, handheld gimbal, system, and computer readable storage medium
WO2021026760A1 (en) Cradle head system and control method therefor
WO2020237570A1 (en) Control method and device for gimbal, handheld gimbal and storage medium
WO2021146908A1 (en) Gimbal and control method therefor
CN112166280B (en) Handheld holder and control method thereof
CN112189333B (en) Following shooting, holder control method, shooting device, handheld holder and shooting system
WO2021134643A1 (en) Method for controlling cradle head and cradle head
WO2021243527A1 (en) Gimbal control method, handheld gimbal, and computer-readable storage medium
JP5797069B2 (en) Imaging apparatus, control method thereof, and control program
CN113227931A (en) Holder control method, device, equipment and computer readable storage medium
WO2022198607A1 (en) Handheld gimbal control method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19958700

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19958700

Country of ref document: EP

Kind code of ref document: A1