US20220043328A1 - Control method for gimbal, controller, and gimbal - Google Patents
Control method for gimbal, controller, and gimbal Download PDFInfo
- Publication number
- US20220043328A1 US20220043328A1 US17/509,973 US202117509973A US2022043328A1 US 20220043328 A1 US20220043328 A1 US 20220043328A1 US 202117509973 A US202117509973 A US 202117509973A US 2022043328 A1 US2022043328 A1 US 2022043328A1
- Authority
- US
- United States
- Prior art keywords
- gimbal
- base
- angular velocity
- attitude
- coefficient
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 230000004044 response Effects 0.000 claims abstract description 62
- 230000001133 acceleration Effects 0.000 claims description 85
- 230000008859 change Effects 0.000 claims description 13
- 238000005259 measurement Methods 0.000 claims description 9
- 238000003384 imaging method Methods 0.000 claims 22
- 238000004891 communication Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 6
- 230000007246 mechanism Effects 0.000 description 6
- 230000007423 decrease Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000004043 responsiveness Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/56—Accessories
- G03B17/561—Support related camera accessories
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64C—AEROPLANES; HELICOPTERS
- B64C39/00—Aircraft not otherwise provided for
- B64C39/02—Aircraft not otherwise provided for characterised by special use
- B64C39/024—Aircraft not otherwise provided for characterised by special use of the remote controlled vehicle type, i.e. RPV
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/08—Arrangements of cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U20/00—Constructional aspects of UAVs
- B64U20/80—Arrangement of on-board electronics, e.g. avionics systems or wiring
- B64U20/87—Mounting of imaging devices, e.g. mounting of gimbals
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D3/00—Control of position or direction
- G05D3/12—Control of position or direction using feedback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
-
- H04N5/23299—
-
- B64C2201/127—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
Definitions
- the present disclosure relates to the field of control technology and, more particularly, to a control method for a gimbal, a controller, and the gimbal.
- the speed of the gimbal to smoothly follow the target is determined by its speed configuration. The faster the configured speed is, the faster the speed for following the target is. If the speed for following the target is configured to be fast, the gimbal may respond quickly to closely follow the target with captured moving moments. However, such captured pictures are often very stiff. If the speed for following the target is configured to be slow, the captured pictures may be softer and smoother. In this case, the camera may not handle a sudden acceleration, which may result in loss of the target for capturing.
- the gimbal can provide a slow speed for following the target when a slow following is needed to allow a smooth picture to be captured. It is also desirable that the gimbal can provide a high speed for following the target when the target is fast moving to allow the gimbal to closely follow the target.
- One aspect of present disclosure provides a control method for a gimbal.
- the control method includes determining an acceleration of a base of the gimbal and controlling a movement response speed of the gimbal according to the acceleration of the base to allow an attitude adjustment of a camera of the gimbal.
- the controller includes a memory, storing program code; and a process, coupled with the memory.
- the processor is configured to determine an acceleration of a base of a gimbal; and control a movement response speed of the gimbal, according to the acceleration of the base, to allow an attitude adjustment of a camera of the gimbal.
- the gimbal includes a base, a controller, and a rotation structure.
- the controller is configured to determine an acceleration of the base.
- the controller is further configured to, according to the acceleration of the base, control a movement response speed of the gimbal, by controlling a movement of the rotation structure, to allow an attitude adjustment of a camera on the gimbal.
- FIG. 1 illustrates a structural schematic of a gimbal according to various disclosed embodiments of the present disclosure
- FIG. 2 illustrates a schematic flow chart of a control method for a gimbal according to various disclosed embodiments of the present disclosure
- FIG. 3 illustrates a schematic flow chart of a control method for a gimbal according to various disclosed embodiments of the present disclosure
- FIG. 4 illustrates a schematic block diagram of a controller according to various disclosed embodiments of the present disclosure
- FIG. 5 illustrates a schematic block diagram of a controller according to various disclosed embodiments of the present disclosure.
- FIG. 6 illustrates a schematic block diagram of an unmanned aerial vehicle according to various disclosed embodiments of the present disclosure.
- a component when a component is “fixedly connected” or “connected” to another component, or a component is “fixed” to another component, the component may be directly on another component or may be a centered component.
- a gimbal may be a supporting device for mounting and fixing a camera.
- the gimbal in the embodiments of the present disclosure may be a handheld gimbal, and may also be disposed on a movable object, such as an unmanned aerial vehicle, a car and the like.
- the gimbal may include at least one rotation structure, and the rotation structure may include a motor (e.g., a brushless motor or a brushed motor) and an arm.
- a motor e.g., a brushless motor or a brushed motor
- the rotation structure may include a pitch axis mechanism, a roll axis mechanism, and a yaw axis mechanism.
- a plurality of rotation structures may be connected in series.
- the pitch axis mechanism may include a pitch axis motor 18 and a pitch axis arm 15
- the roll axis mechanism may include a roll axis motor 13 and a roll axis arm 14
- the yaw axis mechanism may include a yaw axis motor 19 and a yaw axis arm 12 .
- the gimbal shown in FIG. 1 may further include a base 11 .
- the base When the gimbal is a handheld gimbal, the base may move with the movement of a user's hand.
- the base When the gimbal is connected to the movable object, the base may be rigidly connected to the movable object and move with the movement of the movable object.
- the gimbal shown in FIG. 1 may further include an inertial measurement unit (IMU) 16 .
- the IMU 16 may not move relative to the camera and may be used to measure an attitude of the camera.
- the IMU 16 may be rigidly fixed to a camera fixing structure.
- an IMU (not shown) may also be disposed on the base of the gimbal shown in FIG. 1 .
- the IMU may not move relative to the base.
- the IMU may be rigidly fixed to the base.
- the user may rotate the gimbal, that is, rotate the base of the gimbal; and a controller may be used to control the rotation structure, thereby matching a target attitude of the camera with an attitude of the base.
- a handheld stick or a handheld ring may be connected to the base, the user may control the movement of the gimbal through the handheld stick or the handheld ring.
- the moving object may move to drive the movement of the gimbal, that is, the movement of the base of the gimbal; and the controller may be used to control the rotation structure, thereby matching the target attitude with the attitude of the base.
- FIG. 2 illustrates a schematic flow chart of a control method 200 for the gimbal according to various disclosed embodiments of the present disclosure.
- the control method 200 of the gimbal may include at least a portion of the following contents.
- the controller may determine an acceleration of the gimbal base.
- the controller may determine an angular velocity of the base using a second IMU, where the second IMU may not move relative to the base, and a change of the angular velocity may be used to determine the acceleration of the gimbal base.
- the controller may directly obtain the angular velocity of the base using the second IMU, where the second IMU may be rigidly fixed on the base.
- the IMU when the gimbal is the handheld gimbal, in addition to disposing of the IMU on the base, the IMU may also be disposed on the handheld stick or ring of the gimbal.
- acceleration, the angular velocity or the attitude mentioned in the embodiments of the present disclosure may be measured by other devices than the IMU, such as a gyroscope and the like.
- the controller may control a movement response speed of the gimbal, thereby facilitating the attitude adjustment of the camera on the gimbal.
- the controller may control the movement of the gimbal motor based on the acceleration of the base, thereby implementing the control of the movement response speed of the gimbal.
- the controller may control the movement response speed of the gimbal, based on the acceleration of the gimbal base, to adjust the attitude of the camera on the gimbal, thereby combining the acceleration of the base to intelligently control the movement response speed of the gimbal, which may avoid the captured images to be stiff when a configured velocity is too high, and also avoid the problem of not closely following the target when the configured velocity is too low.
- the photographer may decrease a gimbal following velocity by rotating the base to improve the smoothness of the gimbal following capturing.
- the photographer may increase the following velocity by rotating the base; therefore, the gimbal may automatically recognize the photographer's intention and automatically enter the fast following status, thereby avoiding the problem that the gimbal frequently fails to follow the scenarios.
- the controller may control the movement response speed of the gimbal according to the acceleration of the base and the angular velocity of the camera.
- the controller may determine the acceleration of the base according to the IMU having no movement relative to the base, and determine the angular velocity of the camera according to the IMU having no movement relative to the camera, thus the movement response speed of the gimbal may be controlled according to the angular velocity of the base and the angular velocity of the camera.
- the movement response speed of the gimbal may be controlled according to not only the acceleration of the base, but also the angular velocity of the camera, thereby more rationally controlling the movement response speed of the gimbal.
- the controller may control the movement response speed of the gimbal according to the acceleration of the base, and a relationship between the angular velocity of the camera and the angular velocity of the base.
- the movement response speed of the gimbal may be adjusted.
- an angular velocity omega_base of the base is outputted by the IMU having no movement relative to the base
- an angular velocity omega_camera of the camera is outputted by the IMU having no movement relative to the gimbal.
- the angular velocity omega_base of the base increases suddenly (i.e., the acceleration exceeds a certain value) and is greatly larger than the angular velocity omega_camera of the camera (i.e., the difference between the angular velocity of the base and the angular velocity of the camera exceeds a certain value)
- the movement response speed of the gimbal may be increased, thereby implementing the quick switching from a slow following to a fast flowing.
- the controller may control the movement response speed of the gimbal according to the angular velocity of the base and a change rate of the angular velocity of the camera.
- the movement response speed of the gimbal may not be adjusted.
- the angular velocity omega_base of the base is outputted by the IMU having no movement relative to the base
- the angular velocity omega_camera of the camera is outputted by the IMU having no movement relative to the gimbal. If the angular velocity omega_base of the base decreases suddenly, and the angular velocity omega_camera of the camera does not change, the movement response speed of the gimbal may not be adjusted to prevent the camera from suddenly changing the following velocity.
- the movement response speed of the gimbal may not be adjusted.
- the movement response speed of the gimbal may not be adjusted.
- the movement response speed of the gimbal may also be directly adjusted in combination with the angular velocity of the camera in the embodiments of the present disclosure.
- the movement response speed of the gimbal may not be adjusted.
- the combination of the acceleration of the base and the angular velocity of the camera is used to determine whether the movement response speed of the gimbal is adjusted, but in the embodiments of the present disclosure, the combination of the acceleration of the base and the angular velocity of the camera may also be used to determine a specific quantity for adjusting the movement response speed of the gimbal.
- the controller may determine an attitude quantity for adjusting the camera and may control the movement response speed of the gimbal according to the attitude quantity for adjusting the camera and the acceleration of the base.
- the controller when the controller controls the movement response speed of the gimbal, it may be not only based on the acceleration of the base, and also based on the attitude quantity for adjusting the camera.
- the attitude quantity for adjusting the camera may indicate a total adjustment quantity for the camera attitude. After adjusting the adjustment quantity, the camera may follow the target object to be captured.
- the attitude quantity for adjusting the camera may be inputted by the user.
- the attitude quantity for adjusting the camera may be inputted into an input system connected to the controller.
- the attitude quantity for adjusting the camera may be obtained based on the attitude of the base, and an actual attitude of the camera, thereby implementing that the camera attitude follows the base attitude.
- the attitude quantity for adjusting the camera may be obtained by subtracting the actual attitude of the camera from an actual attitude of the base.
- the attitude quantity for adjusting the camera may be obtained by subtracting both the actual attitude of the camera and a dead zone from the actual attitude of the base.
- a dead zone problem may exist during the gimbal following process.
- a size of the dead zone may determine how far the gimbal does not follow from a center point of the camera. Therefore, an actual attitude quantity for adjusting the camera may be obtained by subtracting an attitude of the dead zone and also the dead zone from the actual attitude of the base.
- the actual attitude of the camera may be obtained by the IMU having no movement relative to the camera.
- the controller may perform integral correction based on the gyroscope and accelerometer on the IMU to obtain an IMU attitude. Since the camera is rigidly fixed on the camera fixing structure of the gimbal, the IMU attitude may be equal to the camera attitude.
- the actual attitude of the base may be obtained from the actual attitude of the camera and data of motor axles of the gimbal.
- the data of the motor axles of the gimbal may reflect a difference between the attitude of the camera and the attitude of the base. Therefore, the actual attitude of the base may be obtained based on the actual attitude of the camera and the data of the motor axles (i.e., data of the pitch axis, the yaw axis, and the roll axis) of the gimbal.
- the actual attitude of the base may be obtained from the IMU having no movement relative to the base.
- the actual attitude of the camera may be obtained from the IMU having no movement relative to the camera.
- the actual attitude of the base may be obtained from the IMU having no movement relative to the base, and the actual attitude of the camera may be obtained from the actual attitude of the base and the data of the motor axles.
- the controller may determine an adjustment degree for adjusting a preset velocity coefficient of the gimbal using a preset acceleration coefficient of the gimbal according to the acceleration of the base; the controller may adjust the preset velocity coefficient according to the preset acceleration coefficient and the adjustment degree; and the controller may adjust the movement response speed of the gimbal using an adjusted velocity coefficient and the attitude quantity for adjusting the camera.
- the velocity coefficient may determine the quick responsiveness of the gimbal for driving the camera to follow the target and may characterize velocity.
- the velocity coefficient may not be the velocity conventionally known.
- a value obtained by multiplying a square of the velocity coefficient with a square of the attitude quantity for adjusting the camera may be an attitude quantity for adjusting the camera in a next control time slice.
- the movement control of the gimbal by the controller may be controlled in units of time slices.
- Computing the movement quantity of the gimbal at each time slice may be equivalent to determining the movement response speed of the gimbal.
- the attitude quantity for adjusting the camera may be computed in real time (may be implemented by obtaining the actual attitude of the base and the actual attitude of the camera in real time), and/or the angular velocity of the base and the angular velocity of the camera may be computed in real time, where the real time may refer to that the computation may be executed one time for each time slice, and such values may be different for different time slices.
- the acceleration coefficient may indicate a maximum velocity coefficient that the gimbal may reach when accelerating the camera to follow the target.
- the acceleration coefficient may characterize acceleration but may not be the acceleration conventionally known.
- the acceleration coefficient and the attitude quantity for adjusting the camera may be added to a preset or previous velocity coefficient to obtain the adjusted velocity coefficient.
- the user may preset the velocity coefficient and/or the acceleration coefficient.
- the controller may adjust the acceleration coefficient and/or the velocity coefficient preset by the user in real time.
- the controller may determine the adjustment degree of the acceleration coefficient to the velocity coefficient using the acceleration of the base and may adjust the velocity coefficient based on a product of the acceleration coefficient and the adjustment degree.
- the product of the acceleration coefficient and the adjustment degree may be multiplied by the attitude quantity for adjusting the camera, and the obtained product value may be added to the preset velocity coefficient to obtain the adjusted velocity coefficient.
- the adjustment degree of the acceleration coefficient to the velocity coefficient may be further obtained based on the angular velocity of the camera.
- the controller may determine the adjustment degree according to the acceleration of the base, and the relationship between the angular velocity of the camera and the angular velocity of the base.
- the value of the adjustment degree may be determined to be 1.
- the angular velocity omega_base of the base is outputted by the IMU having no movement relative to the base, and an angular velocity omega_camera of the camera is outputted by the IMU having no movement relative to the gimbal.
- the angular velocity omega_base of the base increases suddenly (i.e., the acceleration exceeds a certain value) and is greatly larger than the angular velocity omega_camera of the camera (i.e., the difference between the angular velocity of the base and the angular velocity of the camera exceeds a certain value)
- the adjustment degree speed_dynamic_coef may be configured to be 1, thereby increasing the movement response speed of the gimbal.
- the adjustment degree may be determined according to the angular velocity of the base and the change rate of the angular velocity of the camera.
- the adjustment may be determined to be 0, that is, the velocity coefficient may not be adjusted.
- the angular velocity omega_base of the base is outputted by the IMU having no movement relative to the base
- the angular velocity omega_camera of the camera is outputted by the IMU having no movement relative to the gimbal.
- the adjustment degree speed_dynamic_coef may be configured to be 0, that is, the movement response speed of the gimbal may not be adjusted to prevent the camera from suddenly changing the following velocity.
- the values of the adjustment degree may be other values in addition to 0 and 1. For example, it may a value between 0 and 1, a value greater than 1, and a value less than 0, which may be determined in different scenarios.
- the target attitude of the camera may be obtained according to the attitude of the base and/or a control column value of a remote control; an integrator may integrate the angular velocity outputted by the gyroscope in the IMU to obtain a measurement attitude of the gimbal; the control response speed of the gimbal may be obtained by combining the target attitude of the camera, the measurement attitude of the gimbal, the acceleration of the base and the like; taking into account of control deviation, a control current may be outputted to a three-axis motor; currently, the three-axis motor may generate torque based on the control current, thereby moving the gimbal.
- a main control board may provide the target attitude of the camera, and the controller (e.g., a closed-loop controller) may perform feedback control according to the target attitude of the camera and the actual attitude of the camera, which may reduce the deviation between the actual attitude and the target attitude to make the actual attitude of the camera equal to the target attitude of the camera.
- the smooth movement of the gimbal may be controlled, and the smoothness of the gimbal may be a mode that allows the target attitude of the camera to smoothly follow the attitude of the base.
- FIG. 4 illustrates a schematic block diagram of a controller 400 according to various disclosed embodiments of the present disclosure.
- the controller may include a determination unit 410 and a control unit 420 .
- the determination unit 410 may be configured to determine the acceleration of the gimbal base; and the control unit 420 may be configured to control the movement response speed of the gimbal according to the acceleration of the base, thereby facilitating the attitude adjustment of the camera of the gimbal.
- control unit 420 may further be configured to control the movement response speed of the gimbal according to the acceleration of the base and the angular velocity of the camera.
- control unit 420 may further be configured to control the movement response speed of the gimbal according to the velocity of the base and the relationship between the angular velocity of the camera and the angular velocity of the base.
- control unit 420 may further be configured to adjust the movement response speed of the gimbal when the acceleration of the base is greater than or equal to the first value, and the difference between the angular velocity of the base and the angular velocity of the camera is greater than or equal to the second value.
- control unit 420 may further be configured to control the movement response speed of the gimbal according to the angular velocity of the base and the change rate of the angular velocity of the camera.
- control unit 420 may further be configured to not adjust the movement response speed of the gimbal when the acceleration of the base is less than or equal to the third value, and the change rate of the angular velocity of the camera is less than or equal to the fourth value.
- the determination unit 410 may further be configured to determine the angular velocity of the camera according to the first inertial measurement unit (IMU), where the first IMU may not move relative to the camera.
- IMU inertial measurement unit
- the determination unit 410 may further be configured to determine the acceleration of the base using the second IMU.
- the determination unit 410 may further be configured to determine the attitude quantity for adjusting the camera.
- the determination unit 410 may further be configured to control the movement response speed of the gimbal according to the attitude quantity for adjusting the camera and the acceleration of the base.
- control unit 420 may further be configured to determine the adjustment degree for adjusting the preset velocity coefficient of the gimbal using the preset acceleration coefficient of the gimbal according to the acceleration of the base or according to the acceleration of the base and the angular velocity of the camera, and may further be configured to adjust the preset velocity coefficient according to the preset acceleration coefficient and the adjustment degree; and may further be configured to adjust the movement response speed of the gimbal using the adjusted velocity coefficient and the attitude quantity for adjusting the camera.
- control unit 420 may further be configured to multiply the product of the acceleration coefficient and the adjustment degree with the attitude quantity for adjusting the camera to obtain the fifth value, and the fifth value may be added to the preset velocity coefficient to obtain the adjusted velocity coefficient.
- control unit 420 may further be configured to adjust the movement response speed of the gimbal according to the value obtained by multiplying the square of the adjusted velocity coefficient by the square of the attitude quantity for adjusting the camera.
- the determination unit 410 may further be configured to determine the actual attitude of the camera and the actual attitude of the base and may further be configured to determine the attitude quantity for adjusting the camera according to the actual attitude of the camera and the actual attitude of the base.
- the determination unit 410 may further be configured to determine the attitude quantity for adjusting the camera by subtracting both the actual attitude of the camera and the dead zone from the actual attitude of the base.
- the determination unit 410 may further be configured to determine the attitude of the first IMU as the actual attitude of the camera, where the first IMU may not move relative to the camera.
- the determination unit 410 may further be configured to obtain the actual attitude of the base according to the actual attitude of the first IMU and the data of motor axles of the gimbal, where the first IMU may not move relative to the camera.
- the determination unit 410 may further be configured to obtain the acceleration coefficient preset and the velocity coefficient both preset by the user.
- the gimbal may be a handhold gimbal.
- controller 400 may implement corresponding operations implemented by the controller in the above-mentioned embodiments, which may not be described in detail for brevity herein.
- FIG. 5 illustrates a schematic block diagram of a controller 500 according to various disclosed embodiments of the present disclosure.
- the controller 500 may include a processor 510 and a memory 520 .
- the memory 520 may be configured to store program code
- the processor 510 may be configured to execute the program code stored in the memory 520 .
- the controller 500 may further include a transceiver 530 , and the processor 510 may control external communication of the transceiver 530 .
- the processor 510 may be configured to call the program code stored in the memory 520 to implement corresponding operations of the controller in the method embodiments, which not be described in detail for brevity herein.
- the embodiments of the present disclosure provide the gimbal.
- the gimbal may include the base, the controller, and the rotation structure. Based on the acceleration of the base, the controller may control the movement of the rotation structure and the movement response speed of the gimbal, thereby facilitating the attitude adjustment of the camera on the gimbal.
- the gimbal may include at least two IMUs.
- the at least two IMUs may include one IMU, having no movement relative to the base, which is configured to measure the angular velocity, the acceleration and/or attitude of the base, and may also include another IMU, having no movement relative to the camera, which is configured to measure the angular velocity, the acceleration and/or attitude of the camera.
- the gimbal may include the input system, configured to input the acceleration coefficient and the velocity coefficient preset by the user.
- control method of the controller may refer to the description of the above-mentioned embodiments, and the gimbal structure may refer to FIG. 1 , which not be described in detail for brevity herein.
- the gimbal may be a handheld gimbal and may also be configured at the unmanned aerial vehicle.
- the unmanned aerial vehicle which is configured according to the embodiments of the present disclosure may be described in detail hereinafter.
- FIG. 6 illustrates a schematic block diagram of an unmanned aerial vehicle 600 according to various disclosed embodiments of the present disclosure.
- the unmanned aerial vehicle 600 may include a gimbal 610 and a camera 620 . Only a portion of the unmanned aerial vehicle 600 may be shown in FIG. 11 for description, and the unmanned aerial vehicle 600 may also include other portions.
- the camera 620 may be connected to the unmanned aerial vehicle through the gimbal 610 .
- the unmanned aerial vehicle 600 may further include a power system 630 , a sensing system 640 , a communication system 650 , and an image processing device 660 .
- the power system 630 may include an electronic governor, one or more propellers, one or more motors corresponding to one or more propellers.
- the motors and propellers may be disposed on corresponding arms.
- the electronic governor may be configured to receive drive signals generated by the flight controller and provide drive current to the motors according to the drive signals, thereby controlling the rotation speed and/or steering of the motors.
- the motors may be configured to drive the propellers to rotate, thereby providing power to the flight of the unmanned aerial vehicle, where the power may enable the unmanned aerial vehicle to implement the movement of one or more degrees of freedom.
- the unmanned aerial vehicle may rotate around one or more rotating axes.
- the rotating axes may include the roll axis, the yaw axis, and the pitch axis.
- the motor may be a direct current motor or an alternating current motor.
- the motor may be a brushless motor or a brushed motor.
- the sensing system 640 may be configured to measure the attitude information of the unmanned aerial vehicle, that is, the spatial position information and status information of the unmanned aerial vehicle.
- the attitude information may include three-dimensional positions, three-dimensional angles, three-dimensional velocities, three-dimensional accelerations, three-dimensional angular velocities, and the like.
- the sensing system may include at least one of gyroscope, an electronic compass, an inertial measurement unit (IMU), a vision sensor, a global positioning system (GPS), a barometer, and the like.
- the flight controller may be configured to control the flight of the unmanned aerial vehicle. For example, the flight of the unmanned aerial vehicle may be controlled by the attitude information measured by the sensing system. It should be understood that the flight controller may control the unmanned aerial vehicle according to pre-programmed program instructions, and also control the unmanned aerial vehicle by responding one or more control instructions from a control device.
- the communication system 650 may communicate with a terminal device 680 having a communication system 670 through wireless signals 690 .
- the communication system 650 and the communication system 670 may include a plurality of transmitters, receivers, and/or transceivers for wireless communication.
- the wireless communication may be a one-way communication, for example, only the unmanned aerial vehicle 600 may transmit data to the terminal device 680 .
- the wireless communication may be a two-way communication, and data may be transmitted from the unmanned aerial vehicle 600 to the terminal device 680 and may also be transmitted from the terminal device 680 to the unmanned aerial vehicle 600 .
- the terminal device 600 may provide control data to one or more unmanned aerial vehicles 600 , gimbals 610 and cameras 620 , and may also receive information transmitted by the unmanned aerial vehicles 600 , gimbals 610 and cameras 620 .
- the control data provided by the terminal device 600 may be configured to control states of one or more unmanned aerial vehicles 600 , gimbals 610 and cameras 620 .
- a communication module may be included in the gimbal 610 and the camera 620 for communicating with the terminal device 680 .
- the gimbal 610 included in the unmanned aerial vehicle and shown in FIG. 6 may refer to the description of the above-mentioned embodiments of the present disclosure, which not be described in detail for brevity herein.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Aviation & Aerospace Engineering (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Mechanical Engineering (AREA)
- Remote Sensing (AREA)
- Automation & Control Theory (AREA)
- Studio Devices (AREA)
- Accessories Of Cameras (AREA)
Abstract
Description
- This application is a continuation of U.S. application Ser. No. 16/727,630, filed on Dec. 26, 2019, which is a continuation of International Application No. PCT/CN2017/101398, filed on Sep. 12, 2017, the entire content of both of which are incorporated herein by reference.
- A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever.
- The present disclosure relates to the field of control technology and, more particularly, to a control method for a gimbal, a controller, and the gimbal.
- When a camera is mounted on a gimbal for photographing, it is necessary to capture a target moving at a slow speed at one time, and to suddenly accelerate to capture a target moving at a fast speed at the other time.
- The speed of the gimbal to smoothly follow the target is determined by its speed configuration. The faster the configured speed is, the faster the speed for following the target is. If the speed for following the target is configured to be fast, the gimbal may respond quickly to closely follow the target with captured moving moments. However, such captured pictures are often very stiff. If the speed for following the target is configured to be slow, the captured pictures may be softer and smoother. In this case, the camera may not handle a sudden acceleration, which may result in loss of the target for capturing.
- Therefore, it is desirable that the gimbal can provide a slow speed for following the target when a slow following is needed to allow a smooth picture to be captured. It is also desirable that the gimbal can provide a high speed for following the target when the target is fast moving to allow the gimbal to closely follow the target.
- One aspect of present disclosure provides a control method for a gimbal. The control method includes determining an acceleration of a base of the gimbal and controlling a movement response speed of the gimbal according to the acceleration of the base to allow an attitude adjustment of a camera of the gimbal.
- Another aspect of present disclosure provides a controller. The controller includes a memory, storing program code; and a process, coupled with the memory. When the program code being executed, the processor is configured to determine an acceleration of a base of a gimbal; and control a movement response speed of the gimbal, according to the acceleration of the base, to allow an attitude adjustment of a camera of the gimbal.
- Another aspect of present disclosure provides a gimbal. The gimbal includes a base, a controller, and a rotation structure. The controller is configured to determine an acceleration of the base. The controller is further configured to, according to the acceleration of the base, control a movement response speed of the gimbal, by controlling a movement of the rotation structure, to allow an attitude adjustment of a camera on the gimbal.
- In order to more clearly illustrate technical solutions in embodiments of the present disclosure, drawings required for describing the embodiments are briefly illustrated hereinafter. Obviously, the following drawings are merely examples for illustrative purposes according to various disclosed embodiments of the present disclosure and are not intended to limit the scope of the present disclosure. Those skilled in the art may obtain other drawings according to the drawings of the present disclosure without any creative efforts.
-
FIG. 1 illustrates a structural schematic of a gimbal according to various disclosed embodiments of the present disclosure; -
FIG. 2 illustrates a schematic flow chart of a control method for a gimbal according to various disclosed embodiments of the present disclosure; -
FIG. 3 illustrates a schematic flow chart of a control method for a gimbal according to various disclosed embodiments of the present disclosure; -
FIG. 4 illustrates a schematic block diagram of a controller according to various disclosed embodiments of the present disclosure; -
FIG. 5 illustrates a schematic block diagram of a controller according to various disclosed embodiments of the present disclosure; and -
FIG. 6 illustrates a schematic block diagram of an unmanned aerial vehicle according to various disclosed embodiments of the present disclosure. - The technical solutions in the embodiments of the present disclosure are described in the following with reference to the accompanying drawings in the embodiments of the present disclosure. It is obvious that the described embodiments are merely a portion of the embodiments of the present disclosure, but not all embodiments. All other embodiments, based on the embodiments of the present disclosure, obtained by those skilled in the art without creative efforts are within the scope of the present disclosure.
- It should be noted that, in the embodiments of the present disclosure, when a component is “fixedly connected” or “connected” to another component, or a component is “fixed” to another component, the component may be directly on another component or may be a centered component.
- Unless otherwise defined, all technical and scientific terms used in the present disclosure may have the same meaning commonly understood by those skilled in the art. The terminology used in the present disclosure may be merely for the purpose of describing specific embodiments and may not be intended to limit the scope of the present disclosure. The term “and/or” as used in the present disclosure includes any and all combinations of one or more of the associated listed items.
- A gimbal may be a supporting device for mounting and fixing a camera. The gimbal in the embodiments of the present disclosure may be a handheld gimbal, and may also be disposed on a movable object, such as an unmanned aerial vehicle, a car and the like.
- In the embodiments of the present disclosure, the gimbal may include at least one rotation structure, and the rotation structure may include a motor (e.g., a brushless motor or a brushed motor) and an arm.
- For example, in the gimbal shown in
FIG. 1 , the rotation structure may include a pitch axis mechanism, a roll axis mechanism, and a yaw axis mechanism. A plurality of rotation structures may be connected in series. - As shown in
FIG. 1 , the pitch axis mechanism may include apitch axis motor 18 and apitch axis arm 15, the roll axis mechanism may include aroll axis motor 13 and aroll axis arm 14, and the yaw axis mechanism may include ayaw axis motor 19 and ayaw axis arm 12. - Optionally, the gimbal shown in
FIG. 1 may further include abase 11. When the gimbal is a handheld gimbal, the base may move with the movement of a user's hand. When the gimbal is connected to the movable object, the base may be rigidly connected to the movable object and move with the movement of the movable object. - Optionally, the gimbal shown in
FIG. 1 may further include an inertial measurement unit (IMU) 16. The IMU 16 may not move relative to the camera and may be used to measure an attitude of the camera. For example, the IMU 16 may be rigidly fixed to a camera fixing structure. - Optionally, an IMU (not shown) may also be disposed on the base of the gimbal shown in
FIG. 1 . The IMU may not move relative to the base. For example, the IMU may be rigidly fixed to the base. - When the
camera 17 is mounted on the gimbal for capturing, it is necessary to capture a target moving at a slow speed at one time, and to suddenly accelerate to capture a target moving at a fast speed at the other time. - When the gimbal is the handheld gimbal for capturing a moving target, the user may rotate the gimbal, that is, rotate the base of the gimbal; and a controller may be used to control the rotation structure, thereby matching a target attitude of the camera with an attitude of the base.
- When the gimbal is the handheld gimbal, a handheld stick or a handheld ring may be connected to the base, the user may control the movement of the gimbal through the handheld stick or the handheld ring.
- Similarly, when the gimbal is disposed on the movable object for capturing the target, the moving object may move to drive the movement of the gimbal, that is, the movement of the base of the gimbal; and the controller may be used to control the rotation structure, thereby matching the target attitude with the attitude of the base.
- The following describes how to implement solutions of the control of the gimbal movement based on the base movement.
- It should be understood that the following embodiments may also be applied to scenarios other than the above-mentioned scenarios (i.e., the user or the moving target may move to drive the movement of the base, and the controller may control the movement of the gimbal, thereby matching the gimbal attitude with the base attitude), and as long as the control of the gimbal movement is based on the base movement, such scenarios may be within the protection scope of the present disclosure.
-
FIG. 2 illustrates a schematic flow chart of acontrol method 200 for the gimbal according to various disclosed embodiments of the present disclosure. Thecontrol method 200 of the gimbal may include at least a portion of the following contents. - At 210, the controller may determine an acceleration of the gimbal base.
- Optionally, the controller may determine an angular velocity of the base using a second IMU, where the second IMU may not move relative to the base, and a change of the angular velocity may be used to determine the acceleration of the gimbal base.
- Optionally, the controller may directly obtain the angular velocity of the base using the second IMU, where the second IMU may be rigidly fixed on the base.
- Optionally, when the gimbal is the handheld gimbal, in addition to disposing of the IMU on the base, the IMU may also be disposed on the handheld stick or ring of the gimbal.
- It should be understood that the acceleration, the angular velocity or the attitude mentioned in the embodiments of the present disclosure may be measured by other devices than the IMU, such as a gyroscope and the like.
- At 220, according to the acceleration of the base, the controller may control a movement response speed of the gimbal, thereby facilitating the attitude adjustment of the camera on the gimbal.
- For example, after obtaining the acceleration of the base, the controller may control the movement of the gimbal motor based on the acceleration of the base, thereby implementing the control of the movement response speed of the gimbal.
- Therefore, in the embodiments of the present disclosure, the controller may control the movement response speed of the gimbal, based on the acceleration of the gimbal base, to adjust the attitude of the camera on the gimbal, thereby combining the acceleration of the base to intelligently control the movement response speed of the gimbal, which may avoid the captured images to be stiff when a configured velocity is too high, and also avoid the problem of not closely following the target when the configured velocity is too low.
- For example, if a photographer thinks that the gimbal follows too fast, the photographer may decrease a gimbal following velocity by rotating the base to improve the smoothness of the gimbal following capturing. Or if the photographer cannot handle a sudden acceleration scenario after deceasing the following velocity, the photographer may increase the following velocity by rotating the base; therefore, the gimbal may automatically recognize the photographer's intention and automatically enter the fast following status, thereby avoiding the problem that the gimbal frequently fails to follow the scenarios.
- Optionally, the controller may control the movement response speed of the gimbal according to the acceleration of the base and the angular velocity of the camera.
- For example, the controller may determine the acceleration of the base according to the IMU having no movement relative to the base, and determine the angular velocity of the camera according to the IMU having no movement relative to the camera, thus the movement response speed of the gimbal may be controlled according to the angular velocity of the base and the angular velocity of the camera.
- Therefore, in the embodiments of the present disclosure, the movement response speed of the gimbal may be controlled according to not only the acceleration of the base, but also the angular velocity of the camera, thereby more rationally controlling the movement response speed of the gimbal.
- Optionally, the controller may control the movement response speed of the gimbal according to the acceleration of the base, and a relationship between the angular velocity of the camera and the angular velocity of the base.
- For example, when the acceleration of the base is greater than or equal to a first value, and a difference between the angular velocity of the base and the angular velocity of the camera is greater than or equal to a second value, the movement response speed of the gimbal may be adjusted.
- For example, an angular velocity omega_base of the base is outputted by the IMU having no movement relative to the base, and an angular velocity omega_camera of the camera is outputted by the IMU having no movement relative to the gimbal. If the angular velocity omega_base of the base increases suddenly (i.e., the acceleration exceeds a certain value) and is greatly larger than the angular velocity omega_camera of the camera (i.e., the difference between the angular velocity of the base and the angular velocity of the camera exceeds a certain value), it may indicate that the movable object or the user quickly rotates the gimbal base, and the angular velocity of the camera is greatly less than the angular velocity of the base. In order to prevent the camera from losing the target following, the movement response speed of the gimbal may be increased, thereby implementing the quick switching from a slow following to a fast flowing.
- Optionally, the controller may control the movement response speed of the gimbal according to the angular velocity of the base and a change rate of the angular velocity of the camera.
- For example, when the acceleration of the base is less than or equal to a third value, and the change rate of the angular velocity of the camera is less than or equal to a fourth value, the movement response speed of the gimbal may not be adjusted.
- For example, the angular velocity omega_base of the base is outputted by the IMU having no movement relative to the base, and the angular velocity omega_camera of the camera is outputted by the IMU having no movement relative to the gimbal. If the angular velocity omega_base of the base decreases suddenly, and the angular velocity omega_camera of the camera does not change, the movement response speed of the gimbal may not be adjusted to prevent the camera from suddenly changing the following velocity.
- It should be understood that the above-mentioned described manners for controlling the movement response speed of the gimbal according to the acceleration of the base and the angular velocity of the camera may be merely some optional implementation manners and may not limit the scope of the present disclosure.
- For example, when the acceleration of the base is negative and the acceleration is greater or equal to a certain value, the movement response speed of the gimbal may not be adjusted.
- For example, when the acceleration of the base is negative and the acceleration is greater or equal to a certain value, and the rate change of the angular velocity of the camera is less than or equal to a certain value, the movement response speed of the gimbal may not be adjusted.
- It should also be understood that although the above-mentioned description is based on the change rate of the angular velocity of the camera or the relationship between the angular velocity of the camera and the angular velocity of the base, the movement response speed of the gimbal may also be directly adjusted in combination with the angular velocity of the camera in the embodiments of the present disclosure.
- For example, when the acceleration of the base is less than or equal to a certain value, and the angular velocity of the camera is less than or equal to a certain value and is greater than or equal to another certain value, the movement response speed of the gimbal may not be adjusted.
- It also should be understood that the combination of the acceleration of the base and the angular velocity of the camera is used to determine whether the movement response speed of the gimbal is adjusted, but in the embodiments of the present disclosure, the combination of the acceleration of the base and the angular velocity of the camera may also be used to determine a specific quantity for adjusting the movement response speed of the gimbal.
- Optionally, in the embodiments of the present disclosure, the controller may determine an attitude quantity for adjusting the camera and may control the movement response speed of the gimbal according to the attitude quantity for adjusting the camera and the acceleration of the base.
- For example, when the controller controls the movement response speed of the gimbal, it may be not only based on the acceleration of the base, and also based on the attitude quantity for adjusting the camera.
- Optionally, the attitude quantity for adjusting the camera may indicate a total adjustment quantity for the camera attitude. After adjusting the adjustment quantity, the camera may follow the target object to be captured.
- The attitude quantity for adjusting the camera may be inputted by the user. For example, the attitude quantity for adjusting the camera may be inputted into an input system connected to the controller.
- Or, the attitude quantity for adjusting the camera may be obtained based on the attitude of the base, and an actual attitude of the camera, thereby implementing that the camera attitude follows the base attitude.
- For example, the attitude quantity for adjusting the camera may be obtained by subtracting the actual attitude of the camera from an actual attitude of the base.
- For example, the attitude quantity for adjusting the camera may be obtained by subtracting both the actual attitude of the camera and a dead zone from the actual attitude of the base.
- For example, a dead zone problem may exist during the gimbal following process. A size of the dead zone may determine how far the gimbal does not follow from a center point of the camera. Therefore, an actual attitude quantity for adjusting the camera may be obtained by subtracting an attitude of the dead zone and also the dead zone from the actual attitude of the base.
- Optionally, the actual attitude of the camera may be obtained by the IMU having no movement relative to the camera.
- For example, the controller may perform integral correction based on the gyroscope and accelerometer on the IMU to obtain an IMU attitude. Since the camera is rigidly fixed on the camera fixing structure of the gimbal, the IMU attitude may be equal to the camera attitude.
- Optionally, the actual attitude of the base may be obtained from the actual attitude of the camera and data of motor axles of the gimbal.
- Optionally, the data of the motor axles of the gimbal may reflect a difference between the attitude of the camera and the attitude of the base. Therefore, the actual attitude of the base may be obtained based on the actual attitude of the camera and the data of the motor axles (i.e., data of the pitch axis, the yaw axis, and the roll axis) of the gimbal.
- Obviously, the actual attitude of the base may be obtained from the IMU having no movement relative to the base. At such case, the actual attitude of the camera may be obtained from the IMU having no movement relative to the camera.
- Or, the actual attitude of the base may be obtained from the IMU having no movement relative to the base, and the actual attitude of the camera may be obtained from the actual attitude of the base and the data of the motor axles.
- Optionally, in the embodiments of the present disclosure, the controller may determine an adjustment degree for adjusting a preset velocity coefficient of the gimbal using a preset acceleration coefficient of the gimbal according to the acceleration of the base; the controller may adjust the preset velocity coefficient according to the preset acceleration coefficient and the adjustment degree; and the controller may adjust the movement response speed of the gimbal using an adjusted velocity coefficient and the attitude quantity for adjusting the camera.
- Optionally, in the embodiments of the present disclosure, the velocity coefficient may determine the quick responsiveness of the gimbal for driving the camera to follow the target and may characterize velocity. However, the velocity coefficient may not be the velocity conventionally known.
- For example, a value obtained by multiplying a square of the velocity coefficient with a square of the attitude quantity for adjusting the camera may be an attitude quantity for adjusting the camera in a next control time slice.
- It should be understood that, in the embodiments of the present disclosure, the movement control of the gimbal by the controller may be controlled in units of time slices. Computing the movement quantity of the gimbal at each time slice may be equivalent to determining the movement response speed of the gimbal.
- Optionally, in each time slice, the attitude quantity for adjusting the camera may be computed in real time (may be implemented by obtaining the actual attitude of the base and the actual attitude of the camera in real time), and/or the angular velocity of the base and the angular velocity of the camera may be computed in real time, where the real time may refer to that the computation may be executed one time for each time slice, and such values may be different for different time slices.
- Optionally, in the embodiments of the present disclosure, the acceleration coefficient may indicate a maximum velocity coefficient that the gimbal may reach when accelerating the camera to follow the target. The acceleration coefficient may characterize acceleration but may not be the acceleration conventionally known.
- For example, the acceleration coefficient and the attitude quantity for adjusting the camera may be added to a preset or previous velocity coefficient to obtain the adjusted velocity coefficient.
- Optionally, in the embodiments of the present disclosure, the user may preset the velocity coefficient and/or the acceleration coefficient. During the moving process, the controller may adjust the acceleration coefficient and/or the velocity coefficient preset by the user in real time.
- For example, the controller may determine the adjustment degree of the acceleration coefficient to the velocity coefficient using the acceleration of the base and may adjust the velocity coefficient based on a product of the acceleration coefficient and the adjustment degree.
- For example, the product of the acceleration coefficient and the adjustment degree may be multiplied by the attitude quantity for adjusting the camera, and the obtained product value may be added to the preset velocity coefficient to obtain the adjusted velocity coefficient.
- Optionally, in addition to the acceleration based on the gimbal base, the adjustment degree of the acceleration coefficient to the velocity coefficient may be further obtained based on the angular velocity of the camera.
- In one embodiment, the controller may determine the adjustment degree according to the acceleration of the base, and the relationship between the angular velocity of the camera and the angular velocity of the base.
- For example, when the acceleration of the base is greater than or equal to the first value, and the difference between the angular velocity of the base and the angular velocity of the camera is greater than or equal to the second value, the value of the adjustment degree may be determined to be 1.
- For example, the angular velocity omega_base of the base is outputted by the IMU having no movement relative to the base, and an angular velocity omega_camera of the camera is outputted by the IMU having no movement relative to the gimbal. If the angular velocity omega_base of the base increases suddenly (i.e., the acceleration exceeds a certain value) and is greatly larger than the angular velocity omega_camera of the camera (i.e., the difference between the angular velocity of the base and the angular velocity of the camera exceeds a certain value), it may indicate that the movable object or the user quickly rotates the gimbal base, and the angular velocity of the camera is greatly less than the angular velocity of the base. In order to prevent the camera from losing the target following, the adjustment degree speed_dynamic_coef may be configured to be 1, thereby increasing the movement response speed of the gimbal.
- Optionally, the adjustment degree may be determined according to the angular velocity of the base and the change rate of the angular velocity of the camera.
- For example, when the acceleration of the base is less than or equal to the third value, and the change rate of the angular velocity of the camera is less than or equal to the fourth value, the adjustment may be determined to be 0, that is, the velocity coefficient may not be adjusted.
- For example, the angular velocity omega_base of the base is outputted by the IMU having no movement relative to the base, and the angular velocity omega_camera of the camera is outputted by the IMU having no movement relative to the gimbal. If the angular velocity omega_base of the base decreases suddenly, and the angular velocity omega_camera of the camera does not change, the adjustment degree speed_dynamic_coef may be configured to be 0, that is, the movement response speed of the gimbal may not be adjusted to prevent the camera from suddenly changing the following velocity.
- It should be understood that, in the embodiments of the present disclosure, the values of the adjustment degree may be other values in addition to 0 and 1. For example, it may a value between 0 and 1, a value greater than 1, and a value less than 0, which may be determined in different scenarios.
- In order to understand the present disclosure more clearly, the embodiments of the present disclosure may be described with reference to the gimbal control method shown in
FIG. 3 hereinafter. - As shown in
FIG. 3 , the target attitude of the camera may be obtained according to the attitude of the base and/or a control column value of a remote control; an integrator may integrate the angular velocity outputted by the gyroscope in the IMU to obtain a measurement attitude of the gimbal; the control response speed of the gimbal may be obtained by combining the target attitude of the camera, the measurement attitude of the gimbal, the acceleration of the base and the like; taking into account of control deviation, a control current may be outputted to a three-axis motor; currently, the three-axis motor may generate torque based on the control current, thereby moving the gimbal. - A main control board may provide the target attitude of the camera, and the controller (e.g., a closed-loop controller) may perform feedback control according to the target attitude of the camera and the actual attitude of the camera, which may reduce the deviation between the actual attitude and the target attitude to make the actual attitude of the camera equal to the target attitude of the camera. The smooth movement of the gimbal may be controlled, and the smoothness of the gimbal may be a mode that allows the target attitude of the camera to smoothly follow the attitude of the base.
-
FIG. 4 illustrates a schematic block diagram of acontroller 400 according to various disclosed embodiments of the present disclosure. - As shown in
FIG. 4 , the controller may include adetermination unit 410 and acontrol unit 420. - The
determination unit 410 may be configured to determine the acceleration of the gimbal base; and thecontrol unit 420 may be configured to control the movement response speed of the gimbal according to the acceleration of the base, thereby facilitating the attitude adjustment of the camera of the gimbal. - Optionally, the
control unit 420 may further be configured to control the movement response speed of the gimbal according to the acceleration of the base and the angular velocity of the camera. - Optionally, the
control unit 420 may further be configured to control the movement response speed of the gimbal according to the velocity of the base and the relationship between the angular velocity of the camera and the angular velocity of the base. - Optionally, the
control unit 420 may further be configured to adjust the movement response speed of the gimbal when the acceleration of the base is greater than or equal to the first value, and the difference between the angular velocity of the base and the angular velocity of the camera is greater than or equal to the second value. - Optionally, the
control unit 420 may further be configured to control the movement response speed of the gimbal according to the angular velocity of the base and the change rate of the angular velocity of the camera. - Optionally, the
control unit 420 may further be configured to not adjust the movement response speed of the gimbal when the acceleration of the base is less than or equal to the third value, and the change rate of the angular velocity of the camera is less than or equal to the fourth value. - Optionally, the
determination unit 410 may further be configured to determine the angular velocity of the camera according to the first inertial measurement unit (IMU), where the first IMU may not move relative to the camera. - Optionally, the
determination unit 410 may further be configured to determine the acceleration of the base using the second IMU. - Optionally, the
determination unit 410 may further be configured to determine the attitude quantity for adjusting the camera. Thedetermination unit 410 may further be configured to control the movement response speed of the gimbal according to the attitude quantity for adjusting the camera and the acceleration of the base. - Optionally, the
control unit 420 may further be configured to determine the adjustment degree for adjusting the preset velocity coefficient of the gimbal using the preset acceleration coefficient of the gimbal according to the acceleration of the base or according to the acceleration of the base and the angular velocity of the camera, and may further be configured to adjust the preset velocity coefficient according to the preset acceleration coefficient and the adjustment degree; and may further be configured to adjust the movement response speed of the gimbal using the adjusted velocity coefficient and the attitude quantity for adjusting the camera. - Optionally, the
control unit 420 may further be configured to multiply the product of the acceleration coefficient and the adjustment degree with the attitude quantity for adjusting the camera to obtain the fifth value, and the fifth value may be added to the preset velocity coefficient to obtain the adjusted velocity coefficient. - Optionally, the
control unit 420 may further be configured to adjust the movement response speed of the gimbal according to the value obtained by multiplying the square of the adjusted velocity coefficient by the square of the attitude quantity for adjusting the camera. - Optionally, the
determination unit 410 may further be configured to determine the actual attitude of the camera and the actual attitude of the base and may further be configured to determine the attitude quantity for adjusting the camera according to the actual attitude of the camera and the actual attitude of the base. - Optionally, the
determination unit 410 may further be configured to determine the attitude quantity for adjusting the camera by subtracting both the actual attitude of the camera and the dead zone from the actual attitude of the base. - Optionally, the
determination unit 410 may further be configured to determine the attitude of the first IMU as the actual attitude of the camera, where the first IMU may not move relative to the camera. - Optionally, the
determination unit 410 may further be configured to obtain the actual attitude of the base according to the actual attitude of the first IMU and the data of motor axles of the gimbal, where the first IMU may not move relative to the camera. - Optionally, the
determination unit 410 may further be configured to obtain the acceleration coefficient preset and the velocity coefficient both preset by the user. - Optionally, the gimbal may be a handhold gimbal.
- It should be understood that the
controller 400 may implement corresponding operations implemented by the controller in the above-mentioned embodiments, which may not be described in detail for brevity herein. -
FIG. 5 illustrates a schematic block diagram of acontroller 500 according to various disclosed embodiments of the present disclosure. - As shown in
FIG. 5 , thecontroller 500 may include aprocessor 510 and amemory 520. Thememory 520 may be configured to store program code, and theprocessor 510 may be configured to execute the program code stored in thememory 520. - Optionally, as shown in
FIG. 5 , thecontroller 500 may further include atransceiver 530, and theprocessor 510 may control external communication of thetransceiver 530. - Optionally, the
processor 510 may be configured to call the program code stored in thememory 520 to implement corresponding operations of the controller in the method embodiments, which not be described in detail for brevity herein. - The embodiments of the present disclosure provide the gimbal. The gimbal may include the base, the controller, and the rotation structure. Based on the acceleration of the base, the controller may control the movement of the rotation structure and the movement response speed of the gimbal, thereby facilitating the attitude adjustment of the camera on the gimbal.
- Furthermore, the gimbal may include at least two IMUs. The at least two IMUs may include one IMU, having no movement relative to the base, which is configured to measure the angular velocity, the acceleration and/or attitude of the base, and may also include another IMU, having no movement relative to the camera, which is configured to measure the angular velocity, the acceleration and/or attitude of the camera.
- Furthermore, the gimbal may include the input system, configured to input the acceleration coefficient and the velocity coefficient preset by the user.
- The control method of the controller may refer to the description of the above-mentioned embodiments, and the gimbal structure may refer to
FIG. 1 , which not be described in detail for brevity herein. - Optionally, in the embodiments of the present disclosure, the gimbal may be a handheld gimbal and may also be configured at the unmanned aerial vehicle. The unmanned aerial vehicle which is configured according to the embodiments of the present disclosure may be described in detail hereinafter.
-
FIG. 6 illustrates a schematic block diagram of an unmannedaerial vehicle 600 according to various disclosed embodiments of the present disclosure. As shown inFIG. 6 , the unmannedaerial vehicle 600 may include agimbal 610 and acamera 620. Only a portion of the unmannedaerial vehicle 600 may be shown inFIG. 11 for description, and the unmannedaerial vehicle 600 may also include other portions. Thecamera 620 may be connected to the unmanned aerial vehicle through thegimbal 610. The unmannedaerial vehicle 600 may further include apower system 630, asensing system 640, acommunication system 650, and animage processing device 660. - The
power system 630 may include an electronic governor, one or more propellers, one or more motors corresponding to one or more propellers. The motors and propellers may be disposed on corresponding arms. The electronic governor may be configured to receive drive signals generated by the flight controller and provide drive current to the motors according to the drive signals, thereby controlling the rotation speed and/or steering of the motors. The motors may be configured to drive the propellers to rotate, thereby providing power to the flight of the unmanned aerial vehicle, where the power may enable the unmanned aerial vehicle to implement the movement of one or more degrees of freedom. In some embodiments, the unmanned aerial vehicle may rotate around one or more rotating axes. For example, the rotating axes may include the roll axis, the yaw axis, and the pitch axis. It should be understood that the motor may be a direct current motor or an alternating current motor. In addition, the motor may be a brushless motor or a brushed motor. - The
sensing system 640 may be configured to measure the attitude information of the unmanned aerial vehicle, that is, the spatial position information and status information of the unmanned aerial vehicle. The attitude information may include three-dimensional positions, three-dimensional angles, three-dimensional velocities, three-dimensional accelerations, three-dimensional angular velocities, and the like. The sensing system may include at least one of gyroscope, an electronic compass, an inertial measurement unit (IMU), a vision sensor, a global positioning system (GPS), a barometer, and the like. The flight controller may be configured to control the flight of the unmanned aerial vehicle. For example, the flight of the unmanned aerial vehicle may be controlled by the attitude information measured by the sensing system. It should be understood that the flight controller may control the unmanned aerial vehicle according to pre-programmed program instructions, and also control the unmanned aerial vehicle by responding one or more control instructions from a control device. - The
communication system 650 may communicate with aterminal device 680 having acommunication system 670 through wireless signals 690. Thecommunication system 650 and thecommunication system 670 may include a plurality of transmitters, receivers, and/or transceivers for wireless communication. The wireless communication may be a one-way communication, for example, only the unmannedaerial vehicle 600 may transmit data to theterminal device 680. Or the wireless communication may be a two-way communication, and data may be transmitted from the unmannedaerial vehicle 600 to theterminal device 680 and may also be transmitted from theterminal device 680 to the unmannedaerial vehicle 600. - Optionally, the
terminal device 600 may provide control data to one or more unmannedaerial vehicles 600,gimbals 610 andcameras 620, and may also receive information transmitted by the unmannedaerial vehicles 600,gimbals 610 andcameras 620. The control data provided by theterminal device 600 may be configured to control states of one or more unmannedaerial vehicles 600,gimbals 610 andcameras 620. Optionally, a communication module may be included in thegimbal 610 and thecamera 620 for communicating with theterminal device 680. - It can be understood that the
gimbal 610 included in the unmanned aerial vehicle and shown inFIG. 6 may refer to the description of the above-mentioned embodiments of the present disclosure, which not be described in detail for brevity herein. - It should be noted that the above-mentioned description may merely the embodiments of the present disclosure and may not intended to limit the scope of the present disclosure. Those skilled in the art should understand that various modifications may be made in the present disclosure, or equivalent replacements of some or all of the technical features may be made in the present disclosure. However, the modifications and equivalent replacements made within the spirit and principle of the present disclosure should be included in the scope of the various claims of the present disclosure. The scope of the present disclosure is defined by the scope of the appended claims and their equivalents.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/509,973 US20220043328A1 (en) | 2017-09-12 | 2021-10-25 | Control method for gimbal, controller, and gimbal |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2017/101398 WO2019051640A1 (en) | 2017-09-12 | 2017-09-12 | Control method for pan-tilt, controller, and pan-tilt |
US16/727,630 US11156905B2 (en) | 2017-09-12 | 2019-12-26 | Control method for gimbal, controller, and gimbal |
US17/509,973 US20220043328A1 (en) | 2017-09-12 | 2021-10-25 | Control method for gimbal, controller, and gimbal |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/727,630 Continuation US11156905B2 (en) | 2017-09-12 | 2019-12-26 | Control method for gimbal, controller, and gimbal |
Publications (1)
Publication Number | Publication Date |
---|---|
US20220043328A1 true US20220043328A1 (en) | 2022-02-10 |
Family
ID=63434392
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/727,630 Active US11156905B2 (en) | 2017-09-12 | 2019-12-26 | Control method for gimbal, controller, and gimbal |
US17/509,973 Abandoned US20220043328A1 (en) | 2017-09-12 | 2021-10-25 | Control method for gimbal, controller, and gimbal |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/727,630 Active US11156905B2 (en) | 2017-09-12 | 2019-12-26 | Control method for gimbal, controller, and gimbal |
Country Status (3)
Country | Link |
---|---|
US (2) | US11156905B2 (en) |
CN (2) | CN108521814B (en) |
WO (1) | WO2019051640A1 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018191988A1 (en) * | 2017-04-21 | 2018-10-25 | Sz Dji Osmo Technology Co., Ltd. | Methods and apparatuses for stabilizing a payload |
WO2019205152A1 (en) * | 2018-04-28 | 2019-10-31 | 深圳市大疆创新科技有限公司 | Cradle head control method and cradle head |
CN111279113B (en) * | 2019-01-04 | 2022-01-25 | 深圳市大疆创新科技有限公司 | Handheld holder control method and handheld holder |
WO2020220169A1 (en) * | 2019-04-28 | 2020-11-05 | 深圳市大疆创新科技有限公司 | Gimbal control method and device, mobile platform, and storage medium |
CN112544065A (en) * | 2019-12-31 | 2021-03-23 | 深圳市大疆创新科技有限公司 | Cloud deck control method and cloud deck |
CN111142580B (en) * | 2020-01-10 | 2020-12-29 | 上海摩象网络科技有限公司 | Holder, holder control method, control device and computer storage medium |
CN111750224B (en) * | 2020-07-01 | 2022-02-01 | 北京飞影科技有限公司 | Self-stabilization shooting platform and camera system |
CN113939788A (en) * | 2020-10-20 | 2022-01-14 | 深圳市大疆创新科技有限公司 | Cloud deck control method and cloud deck |
AT525840B1 (en) * | 2022-01-25 | 2023-10-15 | Ninjawerk Gmbh | Holding device for flexible mounting on a rod |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH01225900A (en) * | 1988-03-03 | 1989-09-08 | Mitsubishi Electric Corp | Tracking control device |
JPH1169339A (en) * | 1997-08-11 | 1999-03-09 | Sony Corp | Image transmission device |
JP3890585B2 (en) * | 1999-06-15 | 2007-03-07 | 横河電機株式会社 | Pan tilt camera device |
US7936984B2 (en) * | 2008-04-10 | 2011-05-03 | Camera Motion Research, Llc | Stabilizer device for optical equipment |
JP6151263B2 (en) * | 2011-11-02 | 2017-06-21 | ワーグナー, スティーヴン ディー.Wagner, Steven D. | Actively stabilized payload support apparatus and method |
CN202499280U (en) * | 2011-12-29 | 2012-10-24 | 湖北易瓦特科技有限公司 | Unmanned device self stabilization holder |
CN102707734A (en) * | 2012-06-19 | 2012-10-03 | 上海大学 | Self-stabilizing cloud deck based on inertia attitude sensor |
CN102913766A (en) * | 2012-10-24 | 2013-02-06 | 天津大学 | Directional lighting wrist lamp and control method thereof |
US20140267778A1 (en) * | 2013-03-15 | 2014-09-18 | Freefly Systems, Inc. | Apparatuses and methods for controlling a gimbal and other displacement systems |
CN104149985B (en) * | 2014-04-03 | 2016-02-17 | 浙江智天科技有限公司 | A kind of based on parallel institution from steady holder for aerial photographing |
CN105223967B (en) * | 2014-06-30 | 2017-11-28 | 深圳市大疆灵眸科技有限公司 | A kind of camera shooting control method, device and tripod head equipment |
JP6245149B2 (en) * | 2014-11-25 | 2017-12-13 | 株式会社Jvcケンウッド | Gimbal device and control method of gimbal device |
CN104390112B (en) * | 2014-11-26 | 2016-05-25 | 南京理工大学 | A kind of The Cloud Terrace of measuring self anglec of rotation |
US9937765B2 (en) * | 2015-04-28 | 2018-04-10 | Ram Sivaraman | Method of adapting an automobile suspension in real-time |
CN106292726A (en) * | 2015-05-13 | 2017-01-04 | 青岛东旭机器人视觉系统科技有限公司 | Rail high speed dollying The Cloud Terrace |
CN104991571B (en) * | 2015-05-29 | 2018-03-09 | 中央电视台 | Holder stability augmentation device and method |
CN105824235A (en) * | 2016-05-20 | 2016-08-03 | 江苏华辉云控科技有限公司 | Adaptive holder speed optimization method and adaptive holder speed optimization system |
CN105955328B (en) * | 2016-05-27 | 2018-09-18 | 北京奇虎科技有限公司 | The method for control speed and device of cradle head camera |
CN109922259A (en) * | 2016-05-31 | 2019-06-21 | 深圳市大疆灵眸科技有限公司 | Cloud platform control method, device and holder |
CN206130457U (en) * | 2016-06-29 | 2017-04-26 | 广东工业大学 | Three degree of freedom cloud platforms of full synchronizing based on remote control of FPV glasses |
CN106227240B (en) * | 2016-07-28 | 2019-06-18 | 纳恩博(北京)科技有限公司 | A kind of cloud platform control method and device |
CN106292741A (en) * | 2016-09-27 | 2017-01-04 | 成都普诺思博科技有限公司 | A kind of mobile machine user tripod head system based on brushless electric machine |
CN106681369B (en) * | 2016-12-01 | 2019-10-08 | 广州亿航智能技术有限公司 | A kind of holder attitude control method and system |
WO2018107337A1 (en) * | 2016-12-12 | 2018-06-21 | 深圳市大疆创新科技有限公司 | Pan-tilt, operation method and control method thereof, and mobile device using same |
CN206413090U (en) * | 2016-12-29 | 2017-08-15 | 昊翔电能运动科技(昆山)有限公司 | Hand-held head with three spindle balance assembling structures |
CN106959110B (en) * | 2017-04-06 | 2020-08-11 | 亿航智能设备(广州)有限公司 | Cloud deck attitude detection method and device |
-
2017
- 2017-09-12 CN CN201780004569.7A patent/CN108521814B/en not_active Expired - Fee Related
- 2017-09-12 CN CN202111162468.7A patent/CN113985928A/en not_active Withdrawn
- 2017-09-12 WO PCT/CN2017/101398 patent/WO2019051640A1/en active Application Filing
-
2019
- 2019-12-26 US US16/727,630 patent/US11156905B2/en active Active
-
2021
- 2021-10-25 US US17/509,973 patent/US20220043328A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
US20200133101A1 (en) | 2020-04-30 |
WO2019051640A1 (en) | 2019-03-21 |
CN108521814A (en) | 2018-09-11 |
US11156905B2 (en) | 2021-10-26 |
CN113985928A (en) | 2022-01-28 |
CN108521814B (en) | 2021-10-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11156905B2 (en) | Control method for gimbal, controller, and gimbal | |
US10447912B2 (en) | Systems, methods, and devices for setting camera parameters | |
US20220137643A1 (en) | Aircraft control method and aircraft | |
US20200213518A1 (en) | Method for controlling gimbal, gimbal controller, and gimbal | |
EP3734395A1 (en) | Method for switching operating mode of gimbal, and controller and image stability augmentation device | |
WO2019223270A1 (en) | Method and apparatus for estimating angle and angular velocity of electric motor of gimbal, and gimbal and aerial vehicle | |
CN108780316B (en) | Method and system for movement control of a flying device | |
US20200319642A1 (en) | Gimbal control method and device, gimbal, and unmanned aerial vehicle | |
US20180157253A1 (en) | Multi-rotor uav flight control method and system | |
US11958604B2 (en) | Unmanned aerial vehicle and method for controlling gimbal thereof | |
US20220155800A1 (en) | Method and apparatus for yaw fusion and aircraft | |
US20220238029A1 (en) | Unmanned aerial vehicle return method and apparatus and unmanned aerial vehicle | |
US20200256506A1 (en) | Method for controlling gimbal, gimbal, control system, and movable device | |
WO2018191963A1 (en) | Remote control, camera mount, and camera mount control method, device, and system | |
WO2013158050A1 (en) | Stabilization control system for flying or stationary platforms | |
WO2021217371A1 (en) | Control method and apparatus for movable platform | |
WO2020042159A1 (en) | Rotation control method and apparatus for gimbal, control device, and mobile platform | |
US20210276700A1 (en) | Control method and device for unmanned aerial vehicle, and unmanned aerial vehicle | |
WO2021168821A1 (en) | Mobile platform control method and device | |
CN110291013B (en) | Control method of cradle head, cradle head and unmanned aerial vehicle | |
WO2020168519A1 (en) | Camera parameter adjusting method, camera device, and movable platform | |
KR20190143172A (en) | Pan-tilt-gimbal integrated system and control method thereof | |
WO2022102303A1 (en) | Information processing method, information processing device, and information processing system | |
US20200309523A1 (en) | Gimbal control method, movable object, storage device, gimbal control system and gimbal | |
CN116820151A (en) | IMU-free posture adjustment method and system applied to unmanned aerial vehicle holder |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SZ DJI TECHNOLOGY CO., LTD., CHINA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SU, TIE;PAN, PAUL;REEL/FRAME:057903/0893 Effective date: 20191220 |
|
AS | Assignment |
Owner name: SZ DJI OSMO TECHNOLOGY CO., LTD., CHINA Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME AND ADDRESS PREVIOUSLY RECORDED AT REEL: 057903 FRAME: 0893. ASSIGNOR(S) HEREBY CONFIRMS THE ASSINGMENT;ASSIGNORS:SU, TIE;PAN, PAUL;REEL/FRAME:058862/0481 Effective date: 20191220 |
|
STCB | Information on status: application discontinuation |
Free format text: EXPRESSLY ABANDONED -- DURING EXAMINATION |