WO2021103865A1 - Dispositif de commande, système de photographie, objet mobile, procédé de commande et programme - Google Patents

Dispositif de commande, système de photographie, objet mobile, procédé de commande et programme Download PDF

Info

Publication number
WO2021103865A1
WO2021103865A1 PCT/CN2020/122780 CN2020122780W WO2021103865A1 WO 2021103865 A1 WO2021103865 A1 WO 2021103865A1 CN 2020122780 W CN2020122780 W CN 2020122780W WO 2021103865 A1 WO2021103865 A1 WO 2021103865A1
Authority
WO
WIPO (PCT)
Prior art keywords
axis
imaging device
lens
movement
image sensor
Prior art date
Application number
PCT/CN2020/122780
Other languages
English (en)
Chinese (zh)
Inventor
本庄谦一
安田知长
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202080004405.6A priority Critical patent/CN112567729A/zh
Publication of WO2021103865A1 publication Critical patent/WO2021103865A1/fr
Priority to US17/562,887 priority patent/US20220191396A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/56—Accessories
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B5/00—Adjustment of optical system relative to image or object surface other than for focusing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment

Definitions

  • the present disclosure relates to a control device, a camera system, a mobile body, a control method, and a program.
  • Patent Document 1 Japanese Patent No. 6331180 describes that based on the rotation speed of the motor or the current value input to the motor, the shake correction of the imaging device is controlled.
  • the motor is used to rotate the rotor of the flying body equipped with the imaging device. .
  • the present disclosure provides a method for testing the performance of the radio frequency identification system The device and method to save space and reduce the volume of test equipment.
  • the control device involved in one aspect of the present disclosure may be a control device that controls a camera system, the camera system including: a driving mechanism moves an optical system or an image sensor in a direction intersecting the optical axis of the optical system to perform shake correction
  • the camera device and a support mechanism that rotatably supports the camera device.
  • the control device may include a circuit configured to acquire a drive signal for a drive mechanism for performing shake correction based on a vibration signal showing vibration of the imaging device.
  • the circuit can be configured to control the support mechanism based on the vibration signal and the drive signal.
  • the circuit may be configured to control the support mechanism based on the vibration signal and the drive signal to maintain the posture of the imaging device in a predetermined posture.
  • the support mechanism can support the imaging device so that it can rotate around a first axis intersecting the optical axis.
  • the circuit may be configured to determine the first movement of the optical system or the image sensor in the direction of the first axis based on the drive signal; based on the first movement, the support mechanism controls the rotation of the imaging device centered on the first axis.
  • the supporting mechanism may further support the imaging device so that it can rotate around a second axis that intersects the optical axis and the first axis.
  • the circuit may be configured to determine the second movement of the optical system or the image sensor in the direction of the second axis based on the driving signal; based on the second movement, the support mechanism controls the rotation of the imaging device centered on the second axis.
  • the supporting mechanism may further support the imaging device so that it can rotate around the third axis along the optical axis.
  • the circuit may be configured to control the rotation of the imaging device centered on the third axis through the support mechanism based on the first movement and the second movement.
  • the circuit may be configured to control the rotation of the imaging device centered on at least one of the first axis, the second axis, and the third axis through the support mechanism based on the first movement and the second movement, so that the first axis and the second axis At least one of the second axis and the third axis generates an opposing force against the reaction force of the first axis, the second axis, and the third axis of the support mechanism, wherein the reaction force is generated by the movement of the optical system or the image sensor.
  • the circuit may be configured to control the driving mechanism based on the driving signal.
  • the camera system involved in one aspect of the present disclosure may be a camera system including the following: the above-mentioned control device; the camera device including an optical system, an image sensor, and a driving mechanism; and a support mechanism.
  • the mobile body according to one aspect of the present disclosure may be a mobile body that includes the above-mentioned camera system and moves.
  • the control method involved in one aspect of the present disclosure may be a control method for controlling a camera system, the camera system including: moving an optical system or an image sensor in a direction intersecting the optical axis of the optical system through a driving mechanism to perform shake correction The camera device; and a support mechanism that rotatably supports the camera device.
  • the control method may include acquiring a drive signal for a drive mechanism for performing shake correction based on a vibration signal showing vibration of the imaging device.
  • the control method may include: controlling the support mechanism based on the vibration signal and the driving signal.
  • the program according to one aspect of the present disclosure may be a program for causing a computer to function as the above-mentioned control device.
  • FIG. 1 is a diagram showing an example of the appearance of an imaging system.
  • Fig. 2 is a diagram showing an example of functional blocks of the camera system.
  • Fig. 3 is a diagram for explaining the reaction force applied to the pitch axis of the universal joint.
  • Fig. 4 is a diagram for explaining the reaction force applied to the yaw axis of the universal joint.
  • Fig. 5A is a diagram for explaining the reaction force applied to the roller shaft of the universal joint.
  • Fig. 5B is a diagram for explaining the reaction force applied to the roller shaft of the universal joint.
  • FIG. 6 is a diagram for explaining the thrust of the image stabilization lens in the Y direction, the reaction force of the gimbal in the pitch direction that opposes the thrust, and the force to be applied in the pitch direction of the gimbal.
  • FIG. 7 is used to explain the thrust of the image stabilization lens in the Y direction and the X direction, the reaction force in the roll direction of the universal joint against the thrust, and the force that should be applied to the roll direction of the universal joint Figure.
  • FIG. 8 is a flowchart showing an example of the control procedure of the gimbal when image stabilization is performed.
  • Fig. 9 is a diagram showing an example of the appearance of an unmanned aircraft and a remote control device.
  • Fig. 10 is a diagram showing an example of a hardware configuration.
  • the blocks may represent (1) a stage of a process of performing an operation or (2) a "part" of a device that performs an operation.
  • Specific stages and “parts” can be implemented by programmable circuits and/or processors.
  • Dedicated circuits may include digital and/or analog hardware circuits. May include integrated circuits (ICs) and/or discrete circuits.
  • Programmable circuits may include reconfigurable hardware circuits.
  • Reconfigurable hardware circuits can include logical AND, logical OR, logical exclusive OR, logical NAND, logical NOR, and other logical operations, flip-flops, registers, field programmable gate arrays (FPGA), programmable logic arrays (PLA) ) And other memory components.
  • the computer-readable medium may include any tangible device that can store instructions to be executed by a suitable device.
  • the computer-readable medium on which instructions are stored includes a product that includes instructions that can be executed to create means for performing operations specified by the flowchart or block diagram.
  • electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like may be included.
  • the computer readable medium may include floppy disk (registered trademark), floppy disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory) ), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), compact disc read-only memory (CD-ROM), digital versatile disc (DVD), Blu-ray (RTM) disc, memory stick, Integrated circuit cards, etc.
  • floppy disk registered trademark
  • floppy disk hard disk
  • ROM read only memory
  • EPROM or flash memory erasable programmable read only memory
  • EEPROM electrically erasable programmable read-only memory
  • SRAM compact disc read-only memory
  • DVD digital versatile disc
  • RTM Blu-ray
  • the computer-readable instructions may include any one of source code or object code described in any combination of one or more programming languages.
  • the source code or object code includes a traditional procedural programming language.
  • Traditional programming languages can be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, status setting data, or Smalltalk, JAVA (registered trademark), C++, etc.
  • the computer-readable instructions may be provided locally or via a wide area network (WAN) such as a local area network (LAN) or the Internet to a processor or programmable circuit of a general-purpose computer, a special-purpose computer, or other programmable data processing device.
  • WAN wide area network
  • LAN local area network
  • the processor or programmable circuit can execute computer-readable instructions to create means for performing the operations specified in the flowchart or block diagram.
  • Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and so on.
  • FIG. 1 is a diagram showing an example of the appearance of an imaging system 1000 according to this embodiment.
  • the imaging system 1000 includes a universal joint 50, an imaging device 100, a supporting member 410, a pair of hand-held parts 400, a hand-held part 420, and a display device 450.
  • the imaging device 100 is an imaging camera that captures a subject included in a desired imaging range.
  • the universal joint 50 rotatably supports the imaging device 100.
  • the universal joint 50 is supported in such a way that the posture of the imaging device 100 can be adjusted.
  • the universal joint 50 is an example of a supporting mechanism.
  • the universal joint 50 uses an actuator to support the imaging device 100 so that it can rotate around the pitch axis.
  • the universal joint 50 uses an actuator to further support the camera device 100 so that it can rotate around the roll axis and the yaw axis, respectively.
  • the gimbal 50 can change the posture of the camera device 100 by rotating the camera device 100 around at least one of the yaw axis, the pitch axis, and the roll axis.
  • the supporting member 410 supports the universal joint 50 detachably.
  • the support member 410 has a T-shape, and includes a rod-shaped member 412 extending in the pitch axis direction and a rod-shaped member 414 extending from the central part of the rod-shaped member 412 in the yaw axis direction.
  • the pair of hand-held parts 400 are rotatably mounted on the supporting member 410.
  • the pair of grip parts 400 sandwich the universal joint 50 and are attached to both ends of the rod-shaped member 412.
  • the pair of hand-held parts 400 are rotatably mounted on the supporting member 410.
  • the pair of hand-held parts 400 can be detachably provided on the supporting member 410.
  • the universal joint 50 is detachably installed at one end of the rod-shaped member 414.
  • the handle 420 extends in the direction of the rolling axis and is provided at the other end of the rod-shaped member 414.
  • the rod-shaped member 414 is further provided with a display device 450.
  • the display device 450 may be a touch screen display.
  • the display device 450 is attached to the rod-shaped member 414 on the side opposite to the side where the lens unit 200 of the imaging device 100 is provided.
  • the display device 450 may be attached to the rod-shaped member 414 on the back side opposite to the front side where the lens unit 200 of the imaging device 100 is installed.
  • the display device 450 can be detachably installed on the supporting member 410.
  • the imaging system 1000 can be used in a state where the display device 450 is detached from the supporting member 410.
  • the display device 450 may be disposed on the supporting member 410 in a manner that the angle of the display surface can be adjusted.
  • the display device 450 may be provided on the support member 410 so as to be rotatable about the pitch axis.
  • the support member 410 and the display device 450 are an example of mounting members mounted on the support member 410.
  • the display device 450 in this embodiment is mounted on the supporting member 410 independently of the imaging device 100.
  • the display device 450 may be provided as a part of the imaging device 100.
  • the display device 450 may be supported by the supporting member 410 through the imaging device 100.
  • the display device 450 may be integrally provided in the imaging device 100.
  • the display device 450 may be provided in the imaging device 100 such that the angle of the display surface can be adjusted with respect to the imaging device 100.
  • FIG. 2 is a diagram showing an example of functional blocks of the imaging system 1000.
  • the imaging system 1000 includes a universal joint 50, an imaging device 100, a main control unit 600, a memory 610, a handheld unit 400, and a display device 450.
  • the display device 450 displays an image captured by the imaging device 100.
  • the display device 450 can display a setting screen for setting various operating conditions of the gimbal 50 and the imaging device 100.
  • the display device 450 may be a touch display, and the user can instruct the movement of the universal joint 50 and the imaging device 100 through the display device 450.
  • the main control unit 600 controls the entire imaging system 1000.
  • the main control unit 600 may be constituted by a microprocessor such as a CPU or an MPU, a microcontroller such as an MCU, or the like.
  • the memory 610 stores programs and the like necessary for the main control unit 600 to control the gimbal 50, the imaging device 100, and the handheld unit 400.
  • the memory 610 may be a computer-readable recording medium, and may also include at least one of flash memory such as SRAM, DRAM, EPROM, EEPROM, and USB memory.
  • the memory 610 may be provided on the supporting member 410.
  • the storage 610 may be configured to be detachable from the supporting member 410.
  • the universal joint 50 includes a universal joint control section 510, a yaw axis driver 512, a pitch axis driver 522, a roll axis driver 532, a yaw axis drive section 514, a pitch axis drive section 524, a roll axis drive section 534, and a yaw axis.
  • the rotation mechanism 516, the pitch axis rotation mechanism 526, and the roll axis rotation mechanism 536 are examples of the rotation mechanism 536.
  • the yaw axis rotation mechanism 516 rotates the imaging device 100 around the yaw axis.
  • the pitch axis rotation mechanism 526 rotates the imaging device 100 around the pitch axis.
  • the roll axis rotation mechanism 536 rotates the imaging device 100 about the roll axis.
  • the universal joint control unit 510 outputs driving signals indicating respective driving amounts to the yaw axis driver 512, the pitch axis driver 522, and the roll axis driver 532 based on the driving signal of the universal joint 50 from the main control unit 600.
  • the yaw axis driver 512, the pitch axis driver 522, and the roll axis driver 532 drive the yaw axis drive unit 514, the pitch axis drive unit 524, and the roll axis drive unit 534 in accordance with the drive signal indicating the drive amount.
  • the yaw axis rotation mechanism 516, the pitch axis rotation mechanism 526, and the roll axis rotation mechanism 536 are driven by the yaw axis drive unit 514, the pitch axis drive unit 524, and the roll axis drive unit 534 to rotate and change the posture of the imaging device 100.
  • the imaging device 100 includes an imaging unit 102 and a lens unit 200.
  • the imaging unit 102 includes an image sensor 120, an imaging control unit 110, and a memory 130.
  • the image sensor 120 may be composed of CCD or CMOS.
  • the image sensor 120 outputs image data of the optical image formed by the zoom lens 211 and the focus lens 210 to the imaging control unit 110.
  • the imaging control unit 110 may be constituted by a microprocessor such as a CPU or an MPU, a microcontroller such as an MCU, or the like.
  • the memory 130 may be a computer-readable recording medium, and may also include at least one of flash memory such as SRAM, DRAM, EPROM, EEPROM, and USB memory.
  • the memory 130 stores programs and the like necessary for the imaging control unit 110 to control the image sensor 120 and the like.
  • the storage 130 may be provided inside the housing of the imaging apparatus 100.
  • the storage 130 may be configured to be detachable from the housing of the imaging device 100.
  • the lens unit 200 includes a focus lens 210, a zoom lens 211, a lens drive unit 212, a lens drive unit 213, and a lens control unit 220.
  • the focus lens 210 and the zoom lens 211 may include at least one lens. At least a part or all of the focus lens 210 and the zoom lens 211 are configured to be movable along the optical axis.
  • the lens unit 200 may be an interchangeable lens provided to be detachable from the imaging unit 102.
  • the lens driving unit 212 moves at least a part or all of the focus lens 210 along the optical axis via mechanical components such as a cam ring and a guide shaft.
  • the lens driving unit 213 moves at least a part or all of the zoom lens 211 along the optical axis via mechanical components such as a cam ring and a guide shaft.
  • the lens control section 220 drives at least one of the lens drive section 212 and the lens drive section 213 in accordance with a lens control instruction from the imaging section 102, and makes at least one of the focus lens 210 and the zoom lens 211 along the optical axis direction via mechanism components Move to perform at least one of a zooming action and a focusing action.
  • the lens control commands are, for example, zoom control commands and focus control commands.
  • the lens unit 200 further includes a position sensor 214 and a position sensor 215.
  • the position sensor 214 detects the position of the focus lens 210.
  • the position sensor 214 can detect the current focus position.
  • the position sensor 215 detects the position of the zoom lens 211.
  • the position sensor 215 can detect the current zoom position of the zoom lens 211.
  • the lens section 200 includes an optical image stabilization mechanism (OIS). More specifically, the lens unit 200 includes an image stabilization lens 231, a lens driving unit 233, and a position sensor 235.
  • the imaging unit 102 includes a vibration sensor 250.
  • the vibration sensor 250 outputs a vibration signal indicating the vibration of the imaging device 100.
  • the vibration sensor 250 may be a gyro sensor that detects vibration of the imaging device 100.
  • the vibration sensor 250 may be an acceleration sensor that detects vibration of the imaging device 100.
  • the gyro sensor detects, for example, angular jitter and rotational jitter.
  • the acceleration sensor detects, for example, displacement jitter in the X direction and the Y direction.
  • the gyroscope sensor can also convert angle and rotation into X-direction components and Y-direction components.
  • the acceleration sensor can also convert displacement jitter in the X and Y directions into angular jitter and rotational jitter.
  • the vibration sensor 250 may be a combination of an acceleration sensor and a gyroscope sensor.
  • the lens driving section 233 moves the lens 231 in a direction perpendicular to the optical axis to perform image stabilization.
  • the lens driving part 233 may include a motor that drives the lens 231 in the X direction and a motor that drives the lens 231 in the Y direction.
  • the motor may be a stepper motor.
  • the motor may be a voice coil motor.
  • the imaging control unit 110 generates a drive signal for the lens drive unit 233 for performing image stabilization based on the vibration signal from the vibration sensor 250.
  • the lens driving part 233 may move the lens 231 in a direction perpendicular to the optical axis based on the driving signal.
  • the lens driving part 233 may move the lens 231 in the X direction and the Y direction perpendicular to the optical axis based on the driving signal.
  • the lens driving unit 233 may move the lens 231 in a direction perpendicular to the optical axis in a direction that reduces the influence of the vibration of the imaging device 100 based on the vibration signal from the vibration sensor 250.
  • the driving signal may display the amount of movement that causes the lens 231 to move in the X direction and the Y direction.
  • the drive signal can display the drive amount of the motor that moves the lens 231 in the X direction and the drive amount of the motor that moves the lens 231 in the Y direction.
  • the drive signal can display the current value input to each motor.
  • the position sensor 235 detects the position of the lens 231.
  • the position sensor 235 can detect the position of the lens 231 in a direction perpendicular to the optical axis.
  • the position sensor 235 can detect the position of the lens 231 in the X direction and the Y direction perpendicular to the optical axis.
  • the lens section 200 is an example of an image stabilization device.
  • the lens control unit 220 obtains a vibration signal indicating vibration from the vibration sensor 250, and based on the vibration signal, the lens driving unit 233 vibrates the lens 231 in at least one of the X direction and the Y direction intersecting the optical axis, thereby performing image stabilization .
  • the image sensor 120 captures an image formed by the zoom lens 211, the focus lens 210, and the lens 231.
  • the imaging unit 102 further includes a body image stabilization mechanism (BIS). More specifically, the imaging section 102 further includes an image sensor driving section 150 and a position sensor 152.
  • the image sensor driving part 150 moves the image sensor 120 in a direction intersecting the optical axis.
  • the image sensor driving section 150 moves the image sensor 120 in a direction perpendicular to the optical axis.
  • the image sensor driving part 150 moves the image sensor 120 in at least one of the X direction and the Y direction perpendicular to the optical axis.
  • the image sensor driving part 150 may include a motor that drives the image sensor 120 in the X direction and a motor that drives the image sensor 120 in the Y direction.
  • the third motor and the fourth motor may be stepper motors or voice coil motors.
  • the position sensor 152 detects the position of the image sensor 120.
  • the position sensor 152 can detect the position of the image sensor 120 in a direction perpendicular to the optical axis.
  • the imaging control unit 110 obtains a vibration signal indicating the vibration of the imaging device 100 from the vibration sensor 250, and based on the vibration signal, the image sensor driving unit 150 vibrates the image sensor 120 in a direction intersecting the optical axis, thereby stabilizing the image.
  • the imaging control unit 110 generates a drive signal for the image sensor drive unit 150 for performing image stabilization based on the vibration signal from the vibration sensor 250.
  • the image sensor driving part 150 may move the image sensor 120 in a direction perpendicular to the optical axis based on the driving signal.
  • the image sensor driving part 150 may move the image sensor 120 in the X direction and the Y direction perpendicular to the optical axis based on the driving signal.
  • the image sensor driving unit 150 may move the image sensor 120 in a direction perpendicular to the optical axis in a direction that reduces the influence of the vibration of the imaging device 100 based on the vibration signal from the vibration sensor 250.
  • the driving signal may display the amount of movement that causes the image sensor 120 to move in the X direction and the Y direction.
  • the driving signal may display the driving amount of the motor for moving the image sensor 120 in the X direction and the driving amount of the motor for moving the image sensor 120 in the Y direction.
  • the drive signal can display the current value input to each motor.
  • the imaging device 100 may have at least one of OIS and BIS.
  • the image sensor driving part 150 or the lens driving part 233 is an example of a driving mechanism.
  • the gimbal 50 controls the posture of the imaging device 100.
  • the universal joint 50 controls the yaw axis rotation mechanism 516, the pitch axis rotation mechanism 526, and the roll axis rotation mechanism 536 through the yaw axis drive unit 514, the pitch axis drive unit 524, and the roll axis drive unit 534, for example, so that the imaging device 100
  • the posture is maintained in a predetermined posture, however, the gimbal 50 sometimes cannot completely cancel the vibration of the imaging device 100.
  • the universal joint 50 can cancel the low-frequency vibration of the imaging device 100.
  • the universal joint 50 cannot cancel the high-frequency vibration of the imaging device 100.
  • high-frequency vibration may also occur in the imaging device 100.
  • the imaging device 100 can offset the vibration that cannot be offset by the universal joint 50 through image stabilization based on OIS or BIS.
  • the image stabilization lens 231 or the image sensor 120 moves, and the reaction force of the thrust generated thereby is applied to the universal joint 50 supporting the imaging device 100. Due to this reaction force, the universal joint 50 may not be able to properly control the posture of the imaging device 100 in some cases. In other words, since the imaging device 100 performs image stabilization, the gimbal 50 may not be able to properly control the posture of the imaging device 100, and the image captured by the imaging device 100 may be blurred.
  • a thrust 701 is generated due to the movement of the lens 231 in the Y direction, and a reaction force 702 against the thrust is applied to the pitch axis 801 of the universal joint 50.
  • a thrust 703 is generated, and a reaction force 704 against the thrust is applied to the yaw axis 802 of the universal joint 50.
  • the universal joint 50 may not be able to properly control the posture of the imaging device 100 in some cases. Due to such a reaction force, the universal joint 50 may not be able to maintain the posture of the imaging device 100 in a predetermined posture.
  • the main control unit 600 controls the universal joint 50 to rotate each axial direction in the opposite direction to the reaction force.
  • the main control section 600 acquires a drive signal for the lens drive section 233 or the image sensor drive section 150 for performing shake correction based on the vibration signal that displays the vibration of the imaging device 100.
  • the driving signal may display the driving amount of the motor for moving the lens 231 or the image sensor 120 in the X direction and the driving amount of the motor for moving the lens 231 in the Y direction.
  • the main control unit 600 further acquires a vibration signal indicating the vibration of the imaging device 100 from the vibration sensor 250.
  • the main control unit 600 controls the universal joint 50 based on the vibration signal and the drive signal.
  • the main control unit 600 may control the universal joint 50 through the universal joint control unit 510 based on the vibration signal and the drive signal so that the posture of the imaging device 100 is maintained at a predetermined posture.
  • the main control part 600 may determine the first movement of the lens 231 or the image sensor 120 in the X direction based on the driving signal.
  • the first movement may be information displaying the thrust [N (Newton)] generated by the movement of the lens 231 or the image sensor 120 in the X direction.
  • the first movement may display the amount of movement of the lens 231 or the image sensor 120 in the X direction.
  • the first movement may display the driving amount (torque) of the motor that moves the lens 231 or the image sensor 120 in the X direction, or the current value input to the motor.
  • the first movement may display the acceleration of the lens 231 or the image sensor 120 in the X direction.
  • the main control part 600 may determine the second movement of the lens 231 or the image sensor 120 in the Y direction based on the driving signal.
  • the second movement may be information displaying the thrust [N (Newton)] generated by the movement of the lens 231 or the image sensor 120 in the Y direction.
  • the second movement may display the amount of movement of the lens 231 or the image sensor 120 in the Y direction.
  • the second movement may display the driving amount of the motor that moves the lens 231 or the image sensor 120 in the Y direction, or the current value input to the motor.
  • the second movement may display the acceleration of the lens 231 or the image sensor 120 in the Y direction.
  • the main control unit 600 can control the rotation of the imaging device 100 centered on the pitch axis through the universal joint control unit 510 and the universal joint 50.
  • the main control part 600 may control the torque applied to the pitch axis through the universal joint control part 510 and the universal joint 50 based on the first movement.
  • the main control unit 600 may control the rotation of the imaging device 100 centered on the yaw axis through the universal joint control unit 510 and the universal joint 50.
  • the main control unit 600 may control the torque applied to the yaw axis through the universal joint control unit 510 and the universal joint 50 based on the second movement.
  • the main control unit 600 can control the rotation of the imaging device 100 centered on the roll axis through the universal joint control unit 510 and the universal joint 50. Based on the first movement and the second movement, the control part 600 may control the torque applied to the roller shaft through the universal joint control part 510 and the universal joint 50.
  • the main control unit 600 can control the rotation of the imaging device 100 centered on at least one of the pitch axis, the yaw axis, and the roll axis through the universal joint 50 so that the At least one of the shaft and the roll axis generates an opposing force against the reaction force of the pitch axis, the yaw axis, and the roll axis of the cardan shaft 50, and the reaction force is generated by the movement of the lens 231 or the image sensor 120.
  • the main control section 600 is an example of a circuit.
  • the main control unit 600 derives the thrust force 701 of the lens 231 in the Y direction as shown in FIG. 6 based on the drive signal of the lens drive unit 233 for performing image stabilization based on the vibration signal of the imaging device 100.
  • the main control unit 600 derives a reaction force 702 applied to the pitch axis of the gimbal 50 against the thrust force 701 of the lens 231 in the Y direction.
  • the main control unit 600 derives the driving amount of the imaging device 100 centered on the pitch axis of the universal joint 50 so that a force 710 in a direction in which the reaction force 702 applied to the pitch axis of the universal joint 50 is offset is applied to the universal joint 50 The pitch axis.
  • the main control unit 600 can derive the torque applied to the pitch axis of the universal joint 50 so that a force 710 in the direction in which the reaction force 702 applied to the pitch axis of the universal joint 50 is offset is applied to the pitch axis of the universal joint 50. Similarly, the main control unit 600 derives the drive amount of the imaging device 100 centered on the yaw axis of the gimbal 50, so that the reaction force 704 applied to the yaw axis of the gimbal 50 is applied to the gimbal in a counteracting direction. Section 50 yaw axis.
  • the main control unit 600 derives the torque applied to the yaw axis of the universal joint 50 so that a force in the direction in which the reaction force 704 applied to the yaw axis of the universal joint 50 is offset is applied to the yaw axis of the universal joint 50.
  • the main control unit 600 derives the reaction force 705 applied to the roller shaft of the universal joint 50 based on the thrust 701 of the lens 231 in the Y direction and the thrust 703 of the lens in the X direction.
  • the main control unit 600 derives the drive amount of the imaging device 100 centered on the roll axis of the universal joint 50, so that a force in the direction of offsetting the reaction force 705 applied to the roll axis of the universal joint 50 is applied to the roll of the universal joint 50.
  • Shaft The main control unit 600 derives the torque applied to the rolling shaft of the universal joint 50 so that a force in the direction in which the reaction force 705 applied to the rolling shaft of the universal joint 50 is offset is applied to the rolling shaft of the universal joint 50.
  • the universal joint control unit 510 controls the yaw axis rotation mechanism 516, the pitch axis rotation mechanism 526, and the roll axis rotation mechanism 536 based on the derived drive amount for each axis.
  • FIG. 8 is a flowchart showing an example of the control procedure of the universal joint 50 when image stabilization is performed.
  • the main control section 600 acquires a vibration signal showing the vibration of the imaging device 100 detected by the vibration sensor 250 and a drive signal of the lens 231 based on the vibration signal of the imaging device 100 for performing image stabilization from the imaging control section 110 (S100). Based on the vibration signal, the main control unit 600 derives and controls the driving amount of each of the yaw direction, pitch direction, and roll direction of the universal joint 50 (S102). Based on the vibration signal, the main control unit 600 derives the respective driving amounts of the yaw direction, pitch direction, and roll direction of the gimbal 50 for maintaining the posture of the imaging device 100 in a predetermined posture.
  • the main control section 600 determines the movement of the lens 231 in the X direction and the Y direction based on the drive signal (S104).
  • the main control unit 600 may determine the thrust of the lens 231 in the X direction and the Y direction as the movement of the lens 231 in the X direction and the Y direction based on the driving signal.
  • the main control unit 600 may determine the drive amounts of the respective motors that move the lens 231 in the X direction and the Y direction based on the drive signal, as the movement of the lens 231 in the X direction and the Y direction.
  • the main control unit 600 derives the driving amount of the gimbal 50 in the yaw direction based on the movement of the lens 231 in the X direction.
  • the main control unit 600 derives the driving amount of the gimbal 50 in the pitch direction based on the movement of the lens 231 in the Y direction.
  • the main control unit 600 derives the driving amount of the gimbal 50 in the rolling direction based on the movement of the lens 231 in the X direction and the Y direction (S106).
  • the main control unit 600 derives the yaw direction, pitch direction, and roll direction of the universal joint 50 based on the driving amount of the vibration signal and the yaw direction, pitch direction, and roll direction of the drive signal.
  • the total driving amount in each direction of the yaw direction, pitch direction, and roll direction of the joint 50 (S108).
  • the main control unit 600 controls the gimbal 50 based on the total driving amount in each of the yaw direction, pitch direction, and roll direction of the gimbal 50 (S110).
  • the main control unit 600 controls the gimbal 50 so that the posture of the imaging device 100 becomes a desired posture based on the feedback control based on the vibration signal and the feedforward control based on the drive signal.
  • the aforementioned imaging device 100 may be mounted on a mobile body.
  • the camera device 100 can be mounted on an unmanned aerial vehicle (UAV) as shown in FIG. 9.
  • UAV 10 may include a UAV main body 20, a universal joint 50, a plurality of camera devices 60, and the camera device 100.
  • the gimbal 50 and the camera device 100 are an example of a camera system.
  • UAV10 is an example of a moving body propelled by a propulsion unit.
  • the concept of moving objects refers to flying objects such as airplanes moving in the air, vehicles moving on the ground, ships moving on water, etc., in addition to UAVs.
  • the UAV main body 20 includes a plurality of rotors. Multiple rotors are an example of a propulsion section.
  • the UAV main body 20 makes the UAV 10 fly by controlling the rotation of a plurality of rotors.
  • the UAV main body 20 uses, for example, four rotors to make the UAV 10 fly.
  • the number of rotors is not limited to four.
  • UAV10 can also be a fixed-wing aircraft without rotors.
  • the imaging device 100 is an imaging camera for imaging a subject included in a desired imaging range.
  • the universal joint 50 rotatably supports the imaging device 100.
  • the universal joint 50 is an example of a supporting mechanism.
  • the gimbal 50 uses an actuator to rotatably support the imaging device 100 with a pitch axis.
  • the universal joint 50 supports the camera device 100 so that it can also be rotated around the roll axis and the yaw axis using an actuator.
  • the gimbal 50 can change the posture of the camera device 100 by rotating the camera device 100 around at least one of the yaw axis, the pitch axis, and the roll axis.
  • the plurality of imaging devices 60 are sensing cameras that photograph the surroundings of the UAV 10 in order to control the flight of the UAV 10.
  • the two camera devices 60 can be installed on the nose of the UAV 10, that is, on the front side.
  • the other two camera devices 60 may be provided on the bottom surface of the UAV 10.
  • the two imaging devices 60 on the front side may be paired to function as a so-called stereo camera.
  • the two imaging devices 60 on the bottom side may also be paired to function as a stereo camera.
  • the three-dimensional spatial data around the UAV 10 can be generated based on the images taken by the plurality of camera devices 60.
  • the number of imaging devices 60 included in the UAV 10 is not limited to four.
  • the UAV 10 may include at least one imaging device 60.
  • the UAV 10 may include at least one camera 60 on the nose, tail, side, bottom, and top surfaces of the UAV 10, respectively.
  • the viewing angle that can be set in the imaging device 60 may be larger than the viewing angle that can be set in the imaging device 100.
  • the imaging device 60 may have a single focus lens or a fisheye lens.
  • the remote operation device 300 communicates with the UAV 10 to remotely operate the UAV 10.
  • the remote operation device 300 can wirelessly communicate with the UAV 10.
  • the remote operation device 300 transmits instruction information indicating various instructions related to the movement of the UAV 10 such as ascending, descending, accelerating, decelerating, forwarding, retreating, and rotating to the UAV 10.
  • the instruction information includes, for example, instruction information for raising the height of the UAV 10.
  • the instruction information can show the height at which the UAV10 should be located.
  • the UAV 10 moves to be at the height indicated by the instruction information received from the remote operation device 300.
  • the instruction information may include an ascending instruction to raise the UAV10. UAV10 rises while receiving the rise command. When the height of UAV10 has reached the upper limit height, even if the ascending instruction is accepted, the ascent of UAV10 can be restricted.
  • FIG. 10 shows an example of a computer 1200 that can embody aspects of the present disclosure in whole or in part.
  • the program installed on the computer 1200 can make the computer 1200 function as an operation associated with the device according to the embodiment of the present disclosure or one or more "parts" of the device. Alternatively, the program can cause the computer 1200 to perform the operation or the one or more "parts".
  • This program enables the computer 1200 to execute the process or stages of the process involved in the embodiment of the present disclosure.
  • Such a program may be executed by the CPU 1212, so that the computer 1200 executes specified operations associated with some or all of the blocks in the flowcharts and block diagrams described in this specification.
  • the computer 1200 of this embodiment includes a CPU 1212 and a RAM 1214, which are connected to each other through a host controller 1210.
  • the computer 1200 further includes a communication interface 1222, an input/output unit, which is connected to the host controller 1210 through the input/output controller 1220.
  • the computer 1200 also includes a ROM 1230.
  • the CPU 1212 operates in accordance with programs stored in the ROM 1230 and RAM 1214 to control each unit.
  • the communication interface 1222 communicates with other electronic devices through the network.
  • the hard disk drive can store programs and data used by the CPU 1212 in the computer 1200.
  • the ROM 1230 stores therein a boot program executed by the computer 1200 during operation, and/or a program dependent on the hardware of the computer 1200.
  • the program is provided via a computer-readable recording medium such as CR-ROM, USB memory, or IC card, or a network.
  • the program is installed in RAM 1214 or ROM 1230 which is also an example of a computer-readable recording medium, and is executed by CPU 1212.
  • the information processing described in these programs is read by the computer 1200 and causes cooperation between the programs and the various types of hardware resources described above.
  • the apparatus or method can be constituted by realizing the operation or processing of information according to the use of the computer 1200.
  • the CPU 1212 can execute a communication program loaded in the RAM 1214, and based on the processing described in the communication program, instruct the communication interface 1222 to perform communication processing.
  • the communication interface 1222 under the control of the CPU 1212, reads the transmission data stored in the transmission buffer provided in a recording medium such as RAM 1214 or USB memory, and sends the read transmission data to the network or receives the data from the network. The received data is written into the receiving buffer provided in the recording medium, etc.
  • the CPU 1212 can make the RAM 1214 read all or necessary parts of files or databases stored in an external recording medium such as a USB memory, and perform various types of processing on the data on the RAM 1214. Then, the CPU 1212 can write the processed data back to the external recording medium.
  • an external recording medium such as a USB memory
  • the CPU 1212 can perform various types of operations, information processing, conditional judgment, conditional transfer, unconditional transfer, and information retrieval/retrieval/information specified by the instruction sequence of the program described in various places in this disclosure. Replace various types of processing, and write the results back to RAM 1214.
  • the CPU 1212 can search for information in files, databases, and the like in the recording medium. For example, when multiple entries including the attribute value of the first attribute respectively associated with the attribute value of the second attribute are stored in the recording medium, the CPU 1212 may retrieve the attribute value of the specified first attribute from the multiple entries. The item that matches the condition is read, and the attribute value of the second attribute stored in the item is read, so as to obtain the attribute value of the second attribute that is associated with the first attribute that meets the predetermined condition.
  • the programs or software modules described above may be stored on the computer 1200 or on a computer-readable storage medium near the computer 1200.
  • a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium so that the program can be provided to the computer 1200 via the network.

Abstract

L'invention concerne un dispositif de photographie, lequel est soutenu par un mécanisme de support et vibre en raison de l'exécution d'une correction de gigue, et la vibration du dispositif de photographie affecte parfois la commande d'orientation effectuée par le mécanisme de support sur le dispositif de photographie. Un dispositif de commande est fourni afin de commander un système de photographie. Le système de photographie comprend un dispositif de photographie qui effectue une correction de gigue par un mécanisme d'entraînement par le déplacement d'un système optique ou un capteur d'image dans une direction croisant l'axe optique du système optique, et un mécanisme de support qui soutient le dispositif de photographie de manière rotative. Le dispositif de commande peut comprendre un circuit configuré : pour obtenir, sur la base d'un signal de vibration montrant la vibration du dispositif de photographie, un signal d'entraînement destiné au mécanisme d'entraînement utilisé pour effectuer la correction de gigue, et pour commander le mécanisme de support sur la base du signal de vibration et du signal d'entraînement.
PCT/CN2020/122780 2019-11-25 2020-10-22 Dispositif de commande, système de photographie, objet mobile, procédé de commande et programme WO2021103865A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080004405.6A CN112567729A (zh) 2019-11-25 2020-10-22 控制装置、摄像系统、移动体、控制方法以及程序
US17/562,887 US20220191396A1 (en) 2019-11-25 2021-12-27 Control apparatus, photographing system, movable object, control method, and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019-212081 2019-11-25
JP2019212081A JP6852243B1 (ja) 2019-11-25 2019-11-25 制御装置、撮像システム、移動体、制御方法、及びプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/562,887 Continuation US20220191396A1 (en) 2019-11-25 2021-12-27 Control apparatus, photographing system, movable object, control method, and program

Publications (1)

Publication Number Publication Date
WO2021103865A1 true WO2021103865A1 (fr) 2021-06-03

Family

ID=75154775

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/122780 WO2021103865A1 (fr) 2019-11-25 2020-10-22 Dispositif de commande, système de photographie, objet mobile, procédé de commande et programme

Country Status (2)

Country Link
JP (1) JP6852243B1 (fr)
WO (1) WO2021103865A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07274056A (ja) * 1994-03-25 1995-10-20 Sony Corp カメラの手振れ補正装置
US20060127073A1 (en) * 2004-12-09 2006-06-15 Konica Minolta Photo Imaging, Inc. Camera shake compensation mechanism and optical apparatus using the camera shake compensation mechanism
CN105282434A (zh) * 2014-07-16 2016-01-27 佳能株式会社 图像抖动校正装置及其控制方法和摄像设备
CN105376475A (zh) * 2014-08-19 2016-03-02 佳能株式会社 图像稳定装置及图像稳定装置的控制方法
US20170176767A1 (en) * 2015-12-21 2017-06-22 Nidec Sankyo Corporation Tilt adjusting method for movable body

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6673366B2 (ja) * 2016-11-18 2020-03-25 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドＳｚ Ｄｊｉ Ｔｅｃｈｎｏｌｏｇｙ Ｃｏ．，Ｌｔｄ 制御装置、撮像システム、移動体、制御方法、およびプログラム
JP7071099B2 (ja) * 2017-11-22 2022-05-18 キヤノン株式会社 撮像装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07274056A (ja) * 1994-03-25 1995-10-20 Sony Corp カメラの手振れ補正装置
US20060127073A1 (en) * 2004-12-09 2006-06-15 Konica Minolta Photo Imaging, Inc. Camera shake compensation mechanism and optical apparatus using the camera shake compensation mechanism
CN105282434A (zh) * 2014-07-16 2016-01-27 佳能株式会社 图像抖动校正装置及其控制方法和摄像设备
CN105376475A (zh) * 2014-08-19 2016-03-02 佳能株式会社 图像稳定装置及图像稳定装置的控制方法
US20170176767A1 (en) * 2015-12-21 2017-06-22 Nidec Sankyo Corporation Tilt adjusting method for movable body

Also Published As

Publication number Publication date
JP2021085895A (ja) 2021-06-03
JP6852243B1 (ja) 2021-03-31

Similar Documents

Publication Publication Date Title
JP6496955B1 (ja) 制御装置、システム、制御方法、及びプログラム
CN111356954B (zh) 控制装置、移动体、控制方法以及程序
US20220191396A1 (en) Control apparatus, photographing system, movable object, control method, and program
JP2019216343A (ja) 決定装置、移動体、決定方法、及びプログラム
CN110809746A (zh) 控制装置、摄像装置、移动体、控制方法以及程序
CN112219146B (zh) 控制装置、摄像装置、控制方法以及程序
CN110337609B (zh) 控制装置、镜头装置、摄像装置、飞行体以及控制方法
WO2021103865A1 (fr) Dispositif de commande, système de photographie, objet mobile, procédé de commande et programme
WO2021013096A1 (fr) Dispositif de commande, système de photographie, objet mobile, procédé de commande et programme
JP6838231B2 (ja) 制御装置、無人航空機、制御方法、及びプログラム
WO2019174343A1 (fr) Dispositif de détection de corps actif, dispositif de commande, corps mobile, procédé et procédure de détection de corps actif
JP6972458B1 (ja) 制御装置、撮像システム、移動体、制御方法、及びプログラム
CN111357271B (zh) 控制装置、移动体、控制方法
JP7048019B2 (ja) 制御装置、飛行体、制御方法、及びプログラム
CN111602385B (zh) 确定装置、移动体、确定方法以及计算机可读记录介质
JP6565071B2 (ja) 制御装置、撮像装置、飛行体、制御方法、及びプログラム
WO2020083342A1 (fr) Dispositif de commande, dispositif de photographie, corps mobile, procédé de commande et programme
JP6878738B1 (ja) 制御装置、撮像システム、移動体、制御方法、及びプログラム
CN111213369B (zh) 控制装置、方法、摄像装置、移动体以及计算机可读存储介质
JP6743337B1 (ja) 制御装置、撮像装置、撮像システム、制御方法、及びプログラム
JP7003357B2 (ja) 制御装置、撮像装置、移動体、制御方法、及びプログラム
JP6459012B1 (ja) 制御装置、撮像装置、飛行体、制御方法、及びプログラム
JP2021028722A (ja) 制御装置、無人航空機、制御方法、及びプログラム
JP2021189368A (ja) 制御装置、撮像システム、制御方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20893024

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20893024

Country of ref document: EP

Kind code of ref document: A1