WO2020181494A1 - Parameter synchronization method, image capture apparatus, and movable platform - Google Patents

Parameter synchronization method, image capture apparatus, and movable platform Download PDF

Info

Publication number
WO2020181494A1
WO2020181494A1 PCT/CN2019/077859 CN2019077859W WO2020181494A1 WO 2020181494 A1 WO2020181494 A1 WO 2020181494A1 CN 2019077859 W CN2019077859 W CN 2019077859W WO 2020181494 A1 WO2020181494 A1 WO 2020181494A1
Authority
WO
WIPO (PCT)
Prior art keywords
exposure parameter
image frame
photographing device
frame number
image
Prior art date
Application number
PCT/CN2019/077859
Other languages
French (fr)
Chinese (zh)
Inventor
俞利富
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201980005567.9A priority Critical patent/CN111345033A/en
Priority to PCT/CN2019/077859 priority patent/WO2020181494A1/en
Publication of WO2020181494A1 publication Critical patent/WO2020181494A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/04Synchronising

Definitions

  • the embodiment of the present invention relates to the field of electronic technology, and in particular to a parameter synchronization method, a photographing device and a movable platform.
  • Exposure parameters include, for example, electronic shutter values, analog gain values, digital gain values, and aperture values.
  • Exposure parameters include, for example, electronic shutter values, analog gain values, digital gain values, and aperture values.
  • the exposure parameters need to be sent to the image sensor, lens, and image signal processor (Image Signal Processor). Processor, ISP), and Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) chip at least one device.
  • ISP Image Signal Processor
  • FPGA Field-Programmable Gate Array
  • the embodiment of the present invention provides a parameter synchronization method, a photographing device and a movable platform, which are used to solve the exposure problem of the image obtained by shooting and improve the image quality.
  • an embodiment of the present invention provides a parameter synchronization method applied to a photographing device, and the method includes:
  • the type of exposure parameter is sent to the N elements of the plurality of elements that require the exposure parameter, so that the N elements use the at least one at the same image frame number.
  • An exposure parameter where N is an integer greater than or equal to 2.
  • an embodiment of the present invention provides a photographing device, including: a body and a plurality of components other than the body, the body including a processor;
  • the processor is configured to send a frame synchronization instruction to the multiple elements, so that the multiple elements set the image frame numbers corresponding to the moments when the frame synchronization instructions are received to the same initial frame number, and when the frame is received
  • start counting the image frame number from the same initial frame number obtain at least one exposure parameter required for shooting; determine the transmission time of each exposure parameter according to the effective delay time of each exposure parameter;
  • the exposure parameter is sent to the N elements of the plurality of elements that require the exposure parameter, so that the N elements use the at least one exposure at the same image frame number Parameter, the N is an integer greater than or equal to 2.
  • an embodiment of the present invention provides a movable platform that includes a body of the movable platform and the shooting device according to the embodiment of the present invention in the first aspect, and the shooting device is mounted on the machine of the movable platform. Body.
  • an embodiment of the present invention provides a chip, including: a memory and a processor;
  • the memory is used to store program instructions; the processor is used to call the program instructions in the memory to execute the parameter synchronization method according to the embodiment of the present invention in the first aspect.
  • an embodiment of the present invention provides a readable storage medium on which a computer program is stored; when the computer program is executed, it realizes the parameters described in the embodiment of the present invention in the first aspect Synchronization method.
  • an embodiment of the present invention provides a computer program, when the computer program is executed by a computer, it is used to implement the parameter synchronization method described in the embodiment of the present invention in the first aspect.
  • the frame synchronization instruction is sent to multiple elements in the photographing device, so that the multiple elements will receive the frame synchronization instruction.
  • the corresponding image frame number is set to the same initial frame number and the image frame number is counted from the same initial frame number when the frame synchronization signal is received; at least one exposure parameter required for shooting is acquired, and each exposure parameter takes effect Delay time, determine the transmission time of each exposure parameter, and when the transmission time of each exposure parameter arrives, send the exposure parameter to the N elements of the plurality of elements that require the exposure parameter, so that all The N elements use the at least one exposure parameter in the same image frame number. Therefore, the exposure parameters generated at the same time will take effect in the same image frame in the N elements, thereby avoiding the exposure problem of the captured images and improving the quality of the captured images.
  • Fig. 1 is a schematic architecture diagram of an unmanned aerial system according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a handheld pan/tilt head provided by an embodiment of the present invention
  • FIG. 3 is a flowchart of a parameter synchronization method provided by an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of components in a photographing device provided by an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of synchronization of exposure parameters provided by an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of synchronization of exposure parameters provided by another embodiment of the present invention.
  • FIG. 7 is a schematic diagram of parameter synchronization when switching between a preview mode and a photographing mode according to an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a photographing device provided by an embodiment of the present invention.
  • Figure 9 is a schematic structural diagram of a movable platform provided by an embodiment of the present invention.
  • a component when a component is said to be “fixed to” another component, it can be directly on the other component or a central component may also exist. When a component is considered to be “connected” to another component, it can be directly connected to another component or there may be a centered component at the same time.
  • the embodiment of the present invention provides a parameter synchronization method, a camera, and a movable platform, and the movable platform may include the camera.
  • the movable platform can be, for example, a drone, an unmanned ship, an unmanned car, a robot, a handheld electronic device, and the like.
  • Hand-held electronic devices are, for example, terminal devices such as handheld PTZ, mobile phones, tablet computers, notebook phones, and wearable devices.
  • the drone may be, for example, a rotorcraft, for example, a multi-rotor aircraft propelled by a plurality of propulsion devices through the air, and the embodiments of the present invention are not limited thereto.
  • Fig. 1 is a schematic architecture diagram of an unmanned aerial system according to an embodiment of the present invention.
  • a rotary wing drone is taken as an example for description.
  • the unmanned flying system 100 may include a drone 110, a display device 130, and a control terminal 140.
  • the UAV 110 may include a power system 150, a flight control system 160, a frame, and a pan/tilt 120 carried on the frame.
  • the drone 110 can wirelessly communicate with the control terminal 140 and the display device 130.
  • the frame may include a fuselage and a tripod (also called a landing gear).
  • the fuselage may include a center frame and one or more arms connected to the center frame, and the one or more arms extend radially from the center frame.
  • the tripod is connected with the fuselage, and is used for supporting the UAV 110 when landing.
  • the power system 150 may include one or more electronic speed regulators (referred to as ESCs) 151, one or more propellers 153, and one or more motors 152 corresponding to the one or more propellers 153, wherein the motors 152 are connected to Between the electronic governor 151 and the propeller 153, the motor 152 and the propeller 153 are arranged on the arm of the UAV 110; the electronic governor 151 is used to receive the driving signal generated by the flight control system 160 and provide driving according to the driving signal Current is supplied to the motor 152 to control the speed of the motor 152.
  • the motor 152 is used to drive the propeller to rotate, thereby providing power for the flight of the drone 110, and the power enables the drone 110 to realize one or more degrees of freedom of movement.
  • the drone 110 may rotate about one or more rotation axes.
  • the aforementioned rotation axis may include a roll axis (Roll), a yaw axis (Yaw), and a pitch axis (pitch).
  • the motor 152 may be a DC motor or an AC motor.
  • the motor 152 may be a brushless motor or a brushed motor.
  • the flight control system 160 may include a flight controller 161 and a sensing system 162.
  • the sensing system 162 is used to measure the attitude information of the drone, that is, the position information and state information of the drone 110 in space, such as three-dimensional position, three-dimensional angle, three-dimensional velocity, three-dimensional acceleration, and three-dimensional angular velocity.
  • the sensing system 162 may include, for example, at least one of sensors such as a gyroscope, an ultrasonic sensor, an electronic compass, an inertial measurement unit (IMU), a vision sensor, a global navigation satellite system, and a barometer.
  • the global navigation satellite system may be a global positioning system (Global Positioning System, GPS).
  • the flight controller 161 is used to control the flight of the drone 110, for example, it can control the flight of the drone 110 according to the attitude information measured by the sensor system 162. It should be understood that the flight controller 161 can control the drone 110 according to pre-programmed program instructions, and can also control the drone 110 by responding to one or more control instructions from the control terminal 140.
  • the pan/tilt head 120 may include a motor 122.
  • the pan/tilt is used to carry the camera 123.
  • the flight controller 161 can control the movement of the pan-tilt 120 through the motor 122.
  • the pan/tilt head 120 may further include a controller for controlling the movement of the pan/tilt head 120 by controlling the motor 122.
  • the pan-tilt 120 may be independent of the drone 110 or a part of the drone 110.
  • the motor 122 may be a DC motor or an AC motor.
  • the motor 122 may be a brushless motor or a brushed motor.
  • the pan-tilt may be located on the top of the drone or on the bottom of the drone.
  • the photographing device 123 may be, for example, a device for capturing images, such as a camera or a video camera, and the photographing device 123 may communicate with the flight controller and take pictures under the control of the flight controller.
  • the imaging device 123 of this embodiment at least includes a photosensitive element, and the photosensitive element is, for example, a Complementary Metal Oxide Semiconductor (CMOS) sensor or a Charge-coupled Device (CCD) sensor. It can be understood that the camera 123 can also be directly fixed to the drone 110, so the pan/tilt 120 can be omitted.
  • CMOS Complementary Metal Oxide Semiconductor
  • CCD Charge-coupled Device
  • the display device 130 is located at the ground end of the unmanned aerial system 100, can communicate with the drone 110 in a wireless manner, and can be used to display the attitude information of the drone 110.
  • the image taken by the photographing device may also be displayed on the display device 130.
  • the display device 130 may be an independent device or integrated in the control terminal 140.
  • the control terminal 140 is located on the ground end of the unmanned aerial system 100, and can communicate with the drone 110 in a wireless manner for remote control of the drone 110.
  • FIG. 2 is a schematic structural diagram of a handheld pan/tilt provided by an embodiment of the present invention.
  • the handheld pan/tilt may be, for example, a single-axis handheld pan/tilt, a dual-axis handheld pan/tilt, or a three-axis handheld pan/tilt.
  • Fig. 2 takes a three-axis handheld pan/tilt as an example for illustrative description.
  • the handheld pan/tilt may include a handle mechanism 10 and a pan/tilt mechanism 20.
  • the handle mechanism 10 is connected to the pan-tilt mechanism 20.
  • the pan-tilt mechanism 20 can be used to carry the photographing device 9.
  • the photographing device 9 in this embodiment may be, for example, a camera, a video camera, a mobile phone, and the like.
  • the handle mechanism 10 can be provided with a control button 11, and the pan-tilt mechanism 20 is used to control the handheld pan-tilt. It should be noted that this embodiment does not limit the number and implementation of the control buttons 11.
  • the control button 11 may be a switch button, a mode switch button, or the like.
  • the handle mechanism 10 may be equipped with a battery for powering various components of the handheld pan/tilt.
  • the pan-tilt mechanism 20 may include a pitch axis (Pitch axis) mechanism 21, a translation axis (Yaw axis) mechanism 22, and a roll axis (Roll axis) mechanism 23.
  • the pitch axis mechanism 21 includes a pitch axis rotation axis and a pitch axis drive motor;
  • the translation axis mechanism 22 includes a translation axis rotation axis and a translation axis drive motor;
  • the roll axis mechanism 23 includes a roll axis rotation axis and a roll axis drive motor.
  • the handheld pan/tilt may include a clamping mechanism 6 for fixing the camera 9.
  • the embodiment of the present invention does not limit the shape and position of the clamping mechanism 6.
  • an inertial measurement element can be provided in the clamping mechanism 6.
  • the inertial measurement element may be a gyroscope, accelerometer, etc.
  • FIG. 2 shows that the camera 9 can be separated from the handheld pan/tilt as an example. In other embodiments, the camera 9 may be a part of the handheld pan/tilt.
  • FIG. 3 is a flowchart of a parameter synchronization method provided by an embodiment of the present invention. As shown in FIG. 3, the method of this embodiment can be applied to a photographing device, such as the photographing device 123 in FIG.
  • the photographing device 9 in 2 this embodiment is not limited to this; the method of this embodiment may include:
  • this embodiment since the photographing device includes M elements, and M is an integer greater than or equal to 2, this embodiment takes 5 elements in the photographing device as an example, which are: body, image sensor, lens, memory chip, ISP, as shown in Figure 4. Among them, the solution of this embodiment can be executed by the body of the camera, for example.
  • the body can send a frame synchronization instruction to a plurality of elements in the camera, and the plurality of elements are elements belonging to the M elements.
  • the multiple components respectively set the image frame corresponding to the moment of receiving the frame synchronization instruction to the same initial frame number according to the frame synchronization instruction, for example, the same initial frame number is 0, so that the subsequent counted images of these multiple components Frame number synchronization. Then, the multiple components will receive the frame synchronization signal, and then the image frame numbers will be counted from the same initial frame number, so that the synchronization of the image frame numbers between the body and the multiple components can be ensured.
  • the aforementioned multiple elements include at least two of the following: image sensor, ISP, memory chip, and lens.
  • the frame synchronization signal is sent by an image sensor.
  • the exposure parameters include at least one of the following: electronic shutter value, analog gain value, digital gain value, aperture value, mechanical shutter value, etc.
  • electronic shutter value analog gain value
  • digital gain value digital gain value
  • aperture value aperture value
  • mechanical shutter value etc.
  • the embodiment is not limited to this.
  • the body of the shooting device can generate at least one exposure parameter required for shooting.
  • the body of the shooting device can generate at least one exposure parameter required for shooting according to its working mode.
  • the working mode is, for example, video recording. Mode, camera mode, preview mode, etc. or,
  • the body of the camera can acquire at least one exposure parameter set by the user.
  • the user can perform an exposure parameter setting operation on the camera, and the exposure parameter setting operation is used to set the at least one exposure parameter described above.
  • the user performs the exposure parameter setting operation on the control terminal of the drone.
  • the user performs the exposure parameter setting operation on the touch screen of the control terminal, and the control terminal detects the exposure
  • the parameter setting operation is to send an exposure parameter setting instruction to the camera of the drone, and the exposure parameter setting instruction includes at least one exposure parameter described above.
  • the body of the photographing device receives the exposure parameter setting instruction, so as to obtain at least one exposure parameter.
  • S303 Determine the sending time of each exposure parameter according to the effective delay time of each exposure parameter.
  • the acquired at least one exposure parameter needs to be sent to at least one of the multiple components, and the effective delay time of each exposure parameter in the component may be different. Therefore, the body sets each exposure parameter The sending time to the required components may also be different. Therefore, the body determines the sending time of each exposure parameter according to the effective delay time of each exposure parameter.
  • the body when it is determined that the sending time of each exposure parameter arrives, the body sends the exposure parameter to N elements of the plurality of elements that require the exposure parameter, where N is an integer greater than or equal to 2.
  • the N elements may be at least two of the image sensor, lens, memory chip, and ISP.
  • the received exposure parameter is used according to the effective delay time of the exposure parameter. Since the transmission time of each exposure parameter is determined according to the effective delay time, so After each component receives the exposure parameter, it will use the exposure parameter generated in the same time S302 at the same image frame number according to the effective delay time, so as to ensure that the exposure parameters generated at the same time take effect on the same image frame.
  • a frame synchronization instruction is sent to multiple elements in the photographing device, so that the multiple elements set the image frame numbers corresponding to the moments when the frame synchronization instructions are received to the same initial frame number and
  • the image frame number is counted from the same initial frame number, at least one exposure parameter required for shooting is obtained, and the transmission time of each exposure parameter is determined according to the effective delay time of each exposure parameter
  • the exposure parameter is sent to the N elements of the multiple elements that require the exposure parameter, so that the N elements use the at least one exposure parameter in the same image frame number.
  • Kind of exposure parameters are therefore, the exposure parameters generated at the same time will take effect in the same image frame in the N elements, thereby avoiding the exposure problem of the captured image and improving the quality of the captured image.
  • a possible implementation manner of the foregoing S303 may include S3031 and S3032:
  • S3031 according to the effective delay time of each exposure parameter, determine the maximum effective delay time among the effective delay time of various exposure parameters.
  • the maximum effective delay time of the effective delay time of the various exposure parameters is determined.
  • the duration in this embodiment may be represented by the number of image frames, for example.
  • the effective delay time of the first exposure parameter is 2 image frames
  • the effective delay time of the second exposure parameter is 1 image frame
  • the effective delay time of the third exposure parameter is 0 image frames
  • the maximum effective delay duration among these effective delay durations is 2 image frames.
  • the transmission time of each exposure parameter is determined according to the above-determined maximum effective delay time and the effective delay time of each exposure parameter, so as to ensure that each element can be in the same image frame number when receiving the exposure parameter. use.
  • the time difference between the transmission time of each type of exposure parameter and the generation time of the type of exposure parameter is equal to the maximum effective delay time and the effective delay of the type of exposure parameter.
  • the difference in duration is equal to the maximum effective delay time and the effective delay of the type of exposure parameter.
  • time is represented by image frames, and three exposure parameters are used.
  • the first type of exposure parameter has an effective delay time of 2 image frames
  • the second type of exposure parameter has an effective delay time of 1 image frame.
  • Frame the effective delay time of the third exposure parameter is 0 image frames
  • the maximum effective delay time is 2 image frames as an example.
  • the transmission time of the first exposure parameter is determined to be the nth image frame; according to the maximum effective delay time is If the effective delay time of 2 image frames and the second type of exposure parameter is 1 image frame, the transmission time of the first type of exposure parameter is determined to be the n+1 image frame; according to the maximum effective delay time, it is 2 images If the effective delay time of frame and the third exposure parameter is 0 frame image frame, it is determined that the transmission time of the third exposure parameter is the n+2th frame image frame.
  • the time for the component to use the first exposure parameter is the n+2th frame Image frame. Since the component receives the second exposure parameter in the n+1th image frame, and the effective delay time of the second exposure parameter is 1 image frame, the time for the component to use the second exposure parameter is the n+th 2 image frames. Since the component receives the third exposure parameter in the n+2 image frame, and the effective delay time of the third exposure parameter is 0 frame image frame, the time for the component to use the third exposure parameter is n+ 2 image frames. It can be seen that the exposure parameters generated at the same time, even if the effective delay time is different, can be used in the same image frame number in each component, which ensures the synchronization of the exposure parameters.
  • the at least one exposure parameter in S302 may include: an electronic shutter value, an analog gain value, and a digital gain value.
  • the N elements include: an image sensor and an ISP.
  • the exposure parameters required by the image sensor include: an electronic shutter value and an analog gain value; the exposure parameters required by the ISP include: a digital gain value.
  • the body can generate the electronic shutter value, the analog gain value and the digital gain value required by the ISP for the image sensor.
  • the body and the image sensor are connected through a two-wire serial (Inter-Integrated Circuit, I2C) bus. /Serial Peripheral Interface (SPI) bus communication connection.
  • I2C Inter-Integrated Circuit
  • SPI Serial Peripheral Interface
  • the body determines the transmission time of the electronic shutter value, the transmission time of the analog gain value, and the transmission of the digital gain value according to the effective delay time of the electronic shutter value, the effective delay time of the analog gain value, and the effective delay time of the digital gain value.
  • the specific implementation process can refer to the description of the foregoing embodiments, and details are not described herein again.
  • the transmission time of the electronic shutter value generated in the nth image frame determined by the fuselage is the nth image frame
  • the transmission time of the analog gain value generated in the nth image frame is the nth
  • the transmission time of the +1 image frame and the digital gain value generated in the nth image frame is the n+2th image frame.
  • the transmission time of the electronic shutter value generated in the n+1th image frame determined by the body is the n+1th image frame
  • the transmission time of the analog gain value generated in the n+1th image frame is the n+2th
  • the transmission time of the frame image frame and the digital gain value generated in the n+1th image frame is the n+3th image frame.
  • the transmission time of the electronic shutter value generated in the n+2th image frame determined by the body is the n+2th image frame
  • the transmission time of the analog gain value generated in the n+2th image frame is the n+3th image frame.
  • the transmission time of the frame image frame and the digital gain value generated in the n+2th image frame is the n+4th image frame.
  • the transmission time of the electronic shutter value generated in the n+3th image frame determined by the body is the n+3th image frame
  • the transmission time of the analog gain value generated in the n+3th image frame is the n+4th
  • the transmission time of the frame image frame and the digital gain value generated in the n+3th image frame is the n+5th image frame.
  • the transmission time of the electronic shutter value generated in the n+4th image frame determined by the body is the n+4th image frame
  • the transmission time of the analog gain value generated in the n+4th image frame is the n+5th
  • the transmission time of the frame image frame and the digital gain value generated in the n+4th image frame is the n+6th image frame.
  • the image sensor receives the electronic shutter value generated in the nth image frame in the nth image frame, and receives the analog gain value generated in the nth image frame in the n+1th image frame. ;
  • the electronic shutter value generated when the n+1th image frame is received;
  • the simulation generated when the n+1th image frame is received Gain value;
  • the n+3th image frame is received, the electronic shutter value generated when the n+3th image frame is received, and when the n+3th image frame is received, it is generated when the n+2th image frame is received
  • the analog gain value of the image frame; the electronic shutter value generated when the image frame of the n+4 frame is received in the image frame of the n+4 frame, and the image frame of the n+3 frame is received in the image frame of the n+4 frame The analog gain value generated at the time; the electronic shutter value generated at the n+5th image frame is received
  • the ISP receives the digital gain value generated in the nth image frame in the n+2th image frame; received the digital gain value generated in the n+1th image frame in the n+3th image frame ; Receive the digital gain value generated in the n+2 image frame in the n+4th image frame; receive the digital gain value generated in the n+3th image frame in the n+5th image frame Gain value; the digital gain value generated when the n+4th image frame is received in the n+6th image frame.
  • the image sensor uses the electronic shutter value and the analog gain value generated in the nth image frame in the n+2th image frame, and the ISP uses the nth image frame in the n+2th image frame.
  • the digital gain value is the exposure parameter of the nth frame corresponding to the brightness of the obtained n+2th image frame.
  • the image sensor uses the electronic shutter value and analog gain value generated in the n+1 image frame in the n+3 image frame, and the ISP uses the n+1 image frame in the n+3 image frame. Therefore, the brightness of the obtained image frame of the n+3th frame corresponds to the exposure parameter of the n+1th frame.
  • the image sensor uses the electronic shutter value and analog gain value generated in the n+2 image frame in the n+4th image frame, and the ISP uses the n+2th image frame in the n+4th image frame. Therefore, the brightness of the n+4th image frame obtained corresponds to the exposure parameter of the n+2th frame.
  • the image sensor uses the electronic shutter value and analog gain value generated in the n+3 image frame in the n+5th image frame, and the ISP uses the n+3th image frame in the n+5th image frame. Therefore, the brightness of the n+5th image frame obtained corresponds to the exposure parameter of the n+3th frame.
  • the image sensor uses the electronic shutter value and analog gain value generated in the n+4 image frame in the n+6 image frame, and the ISP uses the n+4 image frame in the n+6 image frame. Therefore, the brightness of the n+6th image frame obtained corresponds to the exposure parameter of the n+4th frame.
  • the N elements when the working mode of the photographing device is the video recording mode, the N elements further include: a storage chip; the exposure parameters required by the storage chip include: a digital gain value.
  • the memory chip may include an FPGA chip.
  • the fuselage and the memory chip are connected for communication via an I2C bus/SPI bus, for example.
  • the body sends the digital gain value generated in the nth image frame in the n+2th image frame, and sends the digital gain value generated in the n+1th image frame in the n+3th image frame Digital gain value, send the digital gain value generated in the n+2 image frame in the n+4th image frame, and send the digital gain value generated in the n+3th image frame in the n+5th image frame, In the n+6th image frame, the digital gain value generated in the n+4th image frame is sent.
  • the memory chip receives and uses the digital gain value generated in the nth image frame in the n+2th image frame; receives and uses the n+1th frame in the n+3th image frame The digital gain value generated in the image frame; the digital gain value generated in the n+2 image frame is received and used in the n+4th image frame; the digital gain value generated in the n+5th image frame is received and used in the n+5th image frame The digital gain value generated in the n+3th image frame; the digital gain value generated in the n+4th image frame is received and used in the n+6th image frame.
  • the body of the camera determines the aperture value of the lens; sends an aperture setting instruction to the lens,
  • the aperture setting instruction includes the aperture value and a preset time, and the aperture setting instruction is used for the lens to start using the aperture value at the preset time; the preset time is when the camera is taking a picture A point in time during the mode.
  • the lens of the shooting device when the shooting device is in the shooting mode, the lens of the shooting device needs to use the aperture value. Therefore, the body of the shooting device is in the process of switching the shooting device from the preview mode to the shooting mode.
  • the aperture value of the lens is determined, and then an aperture setting instruction is sent to the lens.
  • the aperture setting instruction includes the aperture value and a preset time, wherein the body and the lens are connected via I2C bus/SPI bus communication, for example.
  • the lens receives the aperture setting instruction, and according to the aperture setting instruction, starts to use the aperture value at the preset time.
  • the preset time may be, for example, the time for shooting the first image frame when the shooting device is in the shooting mode.
  • the memory chip before the body sends an aperture setting instruction to the lens, the memory chip also stops its internal processing logic.
  • the camera will switch from the camera mode to the preview mode after the camera is finished taking pictures.
  • the aperture value used by the lens in the preview mode of the camera is different from the aperture value used in the camera mode. Therefore, the lens is When the photographing device is in the photographing mode, the aperture value is restored to the aperture value in the preview mode.
  • the memory chip restores its internal processing logic.
  • the image sensor of the camera may also need to use a mechanical shutter value.
  • the body of the camera not only determines the aperture value of the lens, but also determines the mechanical shutter value of the image sensor; then sends a mechanical shutter value setting instruction to the image sensor,
  • the mechanical shutter value setting instruction includes the mechanical shutter value and a preset time, and the mechanical shutter value setting instruction is used to instruct the image sensor to start using the mechanical shutter value at the preset time.
  • the image sensor receives the mechanical shutter value setting instruction during the switching process of the camera from the preview mode to the photographing mode, and starts using the mechanical shutter value at the preset time according to the mechanical shutter value setting instruction.
  • the time when the image sensor starts to use the mechanical shutter value and the lens starts to use the aperture value is the same, thereby realizing the time synchronization between the mechanical shutter value and the aperture value between the components.
  • the preset time may be, for example, the time for shooting the first image frame when the shooting device is in the shooting mode.
  • the aforementioned frame synchronization indication includes an operation mode switching indication.
  • a possible implementation of the above S301 is: when the photographing device switches between working modes, The component sends a working mode switching instruction, so that the multiple components set the image frame numbers corresponding to the moment when the working mode switching instruction is received to the same initial frame number.
  • the camera body When the camera is switched between video mode and preview mode, or between video mode and camera mode, or between preview mode and camera mode, the camera body sends work mode switching instructions to multiple components .
  • these multiple components respectively set the corresponding image frame numbers at the time when the operating mode switching instruction is received to the same initial frame number, and these multiple components will all receive the frame synchronization signal, and the frames are received in these multiple components.
  • the image frame numbers are counted from the same initial frame number mentioned above, so that the image frame numbers counted in these multiple elements are synchronized.
  • the image frame number is synchronized, the synchronization of the exposure parameters is more accurate.
  • the above-mentioned multiple components include a lens and a memory chip.
  • the body needs to synchronize the image frame with the lens and the memory chip. Therefore, during the process of switching between the operating modes of the camera body, the operating mode switching instructions are sent to the lens and the memory chip respectively, and both the lens and the memory chip will receive the operating mode switching instructions, and then the lens and memory chip will The image frames that have received the operation mode switching instruction are set to the same initial frame number, for example, the respective stored image frame numbers are set, for example, the image frame number is set to 0.
  • the image sensor is not only communicatively connected with the body, but also communicatively connected with the memory chip and the lens.
  • the vd pin of the image sensor can be connected with the body, lens and memory chip, and the image sensor will be connected simultaneously through the vd pin.
  • Send frame synchronization signals (for example: vd signal or vsync signal) to the body, memory chip and lens respectively.
  • the body, memory chip, and lens will receive the frame synchronization signal, and then count the image frame numbers starting from the image frame number being 0, so that the image frame number synchronization between the body, lens and memory chip can be ensured.
  • the recording command when a recording device receives a recording command, the recording command is used to control the recording device to enter the recording mode and send a recording start instruction to the storage chip, and the recording start instruction is used to instruct the storage chip
  • the image frame is stored in the first memory outside the storage chip; the image frame number of the first image frame to be encoded is determined, and the image frame number is sent to the storage chip, so that the storage chip according to the Image frame number, starting from the image frame number, the corresponding image frames stored in the first memory are sequentially stored in the second memory outside the memory chip.
  • the user When the user needs to record, perform the recording operation on the camera. For example, take the camera with the drone as an example, the user can perform the recording operation on the drone's control terminal, and the control terminal will shoot the drone
  • the device sends a recording command.
  • the body of the camera will receive the video command, and the body will send a video start instruction to the memory chip.
  • the video start instruction is used to instruct the memory chip to store the image frame in the first memory.
  • the first memory and the memory chip Communication connection, and the first memory is a memory independent of the memory chip, and the first memory is, for example, a Double Data Rate (DDR) memory.
  • DDR Double Data Rate
  • the storage chip stores the image frames in the storage chip in the first memory.
  • the body determines the image frame number of the first image frame to be encoded, and the frame number can be an absolute image frame number or a relative image frame number.
  • the body then sends the image frame number to the storage chip, and after receiving the image frame number, the storage chip stores the image frame corresponding to the image frame number from the first memory to the second memory in.
  • the second memory is a memory different from the first memory, and the second memory is in communication connection with the storage chip.
  • the first memory is, for example, a solid state drive (SSD). Therefore, this embodiment can ensure that the image frames stored in the second memory are aligned with the image frame numbers of the encoded image frames.
  • the body and the memory chip may communicate through a general purpose input output (GPIO) interface or a universal asynchronous receiver/transmitter (UART) interface.
  • GPIO general purpose input output
  • UART universal asynchronous receiver/transmitter
  • the above-mentioned image frame number may be sent by the body to the storage chip through the at least one GPIO interface.
  • the at least one GPIO interface is, for example, 4 GPIO interfaces.
  • the frame number may be a relative image frame number, for example.
  • the above-mentioned recording start instruction may be sent by the body to the storage chip via the I2C bus.
  • the aforementioned image frame number may be sent by the fuselage to the storage chip through the UART interface, and the image frame number may be, for example, an absolute image frame number.
  • the above-mentioned recording start instruction may be sent by the body to the storage chip through SPI. Since this embodiment uses SPI to transmit the recording start instruction, the communication bandwidth can not be greatly increased.
  • the image frame number is transmitted through the GPIO interface or the UART interface, which can avoid that when the image frame number is transmitted through the I2C bus, because the amount of data transmitted on the I2C bus is very large, the transmission of the frame number will be greatly delayed. , The delay may be too large, causing the cache of the memory chip to burst, and the corresponding image frame is lost.
  • the solution executed by the body of the above-mentioned camera may be executed by a processor in the body of the camera.
  • the embodiment of the present invention also provides a computer storage medium, the computer storage medium stores program instructions, and the program execution may include part or all of the steps of the parameter synchronization method in FIG. 3 and its corresponding embodiments.
  • FIG. 8 is a schematic structural diagram of a photographing device provided by an embodiment of the present invention.
  • the photographing device 800 of this embodiment may include: a body 801 and multiple components other than the body. 801 can be communicatively connected with these multiple components; wherein, FIG. 8 shows multiple components including: an image sensor 802, an ISP 803, a storage chip 804, and a lens 805 as an example, but this embodiment is not limited to this.
  • the body 801 includes a processor 8011.
  • the processor 8011 is configured to send a frame synchronization instruction to the multiple elements, so that the multiple elements set the image frame number corresponding to the moment when the frame synchronization instruction is received to the same initial frame number, and the When the multiple elements receive the frame synchronization signal, start counting the image frame numbers from the same initial frame number; obtain at least one exposure parameter required for shooting; determine each exposure according to the effective delay time of each exposure parameter The transmission time of the parameter; when the transmission time of each exposure parameter arrives, the exposure parameter is sent to the N elements of the plurality of elements that require the exposure parameter, so that the N elements are in the same image frame Use the at least one exposure parameter, and the N is an integer greater than or equal to 2.
  • the processor 8011 determines the sending time of each exposure parameter according to the effective delay time of each exposure parameter, it is specifically configured to:
  • the effective delay time of each exposure parameter determine the maximum effective delay time among the effective delay time of various exposure parameters
  • the sending time of each exposure parameter is determined according to the maximum effective delay time and the effective delay time of each exposure parameter.
  • the time difference between the transmission time of each type of exposure parameter and the generation time of that type of exposure parameter is equal to the difference between the maximum effective delay time and the effective delay time of this type of exposure parameter Difference.
  • the plurality of components includes at least two of the following: image sensor, ISP, memory chip, lens.
  • the at least one exposure parameter includes: an electronic shutter value, an analog gain value, and a digital gain value.
  • the N elements when the working mode of the photographing device is a preview mode, a video recording mode, or a photographing mode, the N elements include: an image sensor 802 and an ISP 803;
  • the exposure parameters required by the image sensor 802 include: electronic shutter value and analog gain value;
  • the exposure parameters required by the ISP 803 include: digital gain value.
  • the N elements when the working mode of the photographing device is the video recording mode, the N elements further include: a storage chip 804;
  • the exposure parameters required by the memory chip 804 include digital gain values.
  • the memory chip 804 includes an FPGA chip.
  • the processor 8011 is further configured to:
  • the aperture setting instruction includes the aperture value and a preset time
  • the aperture setting instruction is used for the lens 805 to start using the aperture value at the preset time
  • the lens 805 is configured to start using the aperture value at the preset time
  • the preset time is a point in time when the photographing device 800 is in the photographing mode.
  • the processor 8011 is further configured to:
  • the mechanical shutter value setting instruction includes the mechanical shutter value and a preset time, and the mechanical shutter value setting instruction is used to instruct the image sensor 802 in the preset time. Set the time to start using the mechanical shutter value;
  • the image sensor 802 is configured to start using the mechanical shutter value at the preset time.
  • the frame synchronization instruction includes a work mode switching instruction; when the processor 8011 sends a frame synchronization instruction to multiple elements in the camera, it is specifically configured to:
  • the camera 800 When the camera 800 switches between the operating modes, it sends an operating mode switching instruction to the multiple components.
  • the frame synchronization signal is sent by the image sensor 802.
  • the processor 8011 is further configured to: when a recording command is received, the recording command is used to control the shooting device 800 to enter the recording mode, and send a recording start instruction to the storage chip 804, The recording start instruction is used to instruct the storage chip 804 to store the image frame in the first memory 806 outside the storage chip;
  • the storage chip 804 is configured to store image frames in the first memory 806 outside the storage chip 804, and according to the image frame number, store the image frames in the first memory 806 starting from the image frame number The corresponding image frames are sequentially stored in the second memory 807 outside the storage chip 804.
  • the photographing device 800 includes the first memory 806 and the second memory 807 described above. In other embodiments, at least one of the first memory 806 and the second memory 807 is a memory external to the camera 800.
  • the first memory 806 is a DDR memory
  • the second memory 807 is an SSD.
  • the body 801 and the storage chip 804 are communicatively connected through at least one GPIO interface or a UART interface.
  • the processor 8011 sends the image frame number to the storage chip 804, specifically Used for:
  • the image frame number is sent to the storage chip 804 through at least one GPIO interface or UART interface.
  • the body 801 and the storage chip 804 are connected through SPI communication;
  • the processor 8011 sends a video recording start instruction to the storage chip 804, it is specifically configured to send the video recording start instruction to the storage chip 804 via SPI.
  • the image frame number is an absolute image frame number or a relative image frame number.
  • the photographing device in this embodiment can be used to implement the technical solutions in the foregoing method embodiments of the present invention, and its implementation principles and technical effects are similar, and will not be repeated here.
  • FIG. 9 is a schematic structural diagram of a movable platform provided by an embodiment of the present invention.
  • the movable platform 900 of this embodiment may include: a body 901 of the movable platform 900 and a photographing device 902.
  • the device 902 is mounted on the body 901 of the movable platform.
  • the movable platform 900 further includes a pan/tilt (not shown in the figure), the pan/tilt is connected to the body 901, and the camera 902 is mounted on the pan/tilt.
  • the movable platform 900 is a handheld PTZ.
  • the movable platform of this embodiment can be used to implement the technical solutions in the foregoing method embodiments of the present invention, and its implementation principles and technical effects are similar, and will not be repeated here.
  • a person of ordinary skill in the art can understand that all or part of the steps in the above method embodiments can be implemented by a program instructing relevant hardware.
  • the foregoing program can be stored in a computer readable storage medium. When the program is executed, it is executed. Including the steps of the foregoing method embodiment; and the foregoing storage medium includes: read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks or optical disks, etc., which can store program codes Medium.

Abstract

A parameter synchronization method, an image capture apparatus, and a movable platform. The method comprises: sending a frame synchronization instruction to multiple elements within the image capture apparatus, so that the multiple elements configure image frame numbers corresponding to the moment at which the frame synchronization instruction is received to be the same initial frame number, and count image frame numbers starting from the same initial frame number when a frame synchronization signal is received (S301); obtaining at least one exposure parameter required for image capture (S302); determining the sending time of each exposure parameter according to the effective delay duration of each exposure parameter (S303); and when the sending time of each exposure parameter is reached, sending the exposure parameter to N elements that require the exposure parameter among the multiple elements, so that the N elements use the at least one exposure parameter at the same image frame number (S304). Exposure parameters generated at the same time may take effect on the same image frame in the N elements, thereby avoiding the problem of image exposure and improving image quality.

Description

参数同步方法、拍摄装置和可移动平台Parameter synchronization method, photographing device and movable platform 技术领域Technical field
本发明实施例涉及电子技术领域,尤其涉及一种参数同步方法、拍摄装置和可移动平台。The embodiment of the present invention relates to the field of electronic technology, and in particular to a parameter synchronization method, a photographing device and a movable platform.
背景技术Background technique
随着拍摄装置的普及,拍摄装置的应用场景越来越广,例如:拍摄装置可以应用于无人机或智能手机等中。用户对拍摄装置采集的图像质量的要求也越来越高,其中,曝光参数是决定图像质量的关键因素,曝光参数例如包括:电子快门值、模拟增益值、数字增益值、光圈值等。在拍摄过程中,需要多个元件之间的共同协作来完成图像采集,因此,在拍摄装置的机身产生曝光参数之后,需要将曝光参数发送给图像传感器、镜头、图像信号处理器(Image Signal Processor,ISP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)芯片中的至少一个设备。但是不同的参数具有不同的生效时延,这会造成同一时间产生的曝光参数,会在不同时间生效,从而造成拍摄获得的图像存在曝光问题,影响图像质量。With the popularity of shooting devices, the application scenarios of shooting devices are becoming wider and wider. For example, shooting devices can be used in drones or smart phones. Users have higher and higher requirements for the image quality captured by the camera. Among them, exposure parameters are a key factor in determining image quality. Exposure parameters include, for example, electronic shutter values, analog gain values, digital gain values, and aperture values. During the shooting process, the collaboration between multiple components is required to complete image acquisition. Therefore, after the exposure parameters are generated by the camera body, the exposure parameters need to be sent to the image sensor, lens, and image signal processor (Image Signal Processor). Processor, ISP), and Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) chip at least one device. However, different parameters have different effective time delays, which will cause the exposure parameters generated at the same time to take effect at different times, thereby causing exposure problems in the captured images and affecting image quality.
发明内容Summary of the invention
本发明实施例提供一种参数同步方法、拍摄装置和可移动平台,用于解决拍摄获得的图像存在曝光问题,提高图像质量。The embodiment of the present invention provides a parameter synchronization method, a photographing device and a movable platform, which are used to solve the exposure problem of the image obtained by shooting and improve the image quality.
第一方面,本发明实施例提供一种参数同步方法,应用于拍摄装置中,所述方法包括:In the first aspect, an embodiment of the present invention provides a parameter synchronization method applied to a photographing device, and the method includes:
向所述拍摄装置内的多个元件发送帧同步指示,以使所述多个元件将接收到所述帧同步指示的时刻对应的图像帧号置为同一初始帧号并且在接收到帧同步信号时从所述同一初始帧号开始计数图像帧号;Send a frame synchronization instruction to multiple elements in the imaging device, so that the multiple elements set the image frame numbers corresponding to the moment when the frame synchronization instructions are received to the same initial frame number, and when the frame synchronization signal is received When counting the image frame numbers from the same initial frame number;
获取拍摄所需的至少一种曝光参数;Acquiring at least one exposure parameter required for shooting;
根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间;Determine the sending time of each exposure parameter according to the effective delay time of each exposure parameter;
在每种曝光参数的发送时间到达时,将该种曝光参数发送给所述多个元 件中所需该曝光参数的N个元件,以使所述N个元件在同一图像帧号使用所述至少一种曝光参数,所述N为大于等于2的整数。When the sending time of each type of exposure parameter arrives, the type of exposure parameter is sent to the N elements of the plurality of elements that require the exposure parameter, so that the N elements use the at least one at the same image frame number. An exposure parameter, where N is an integer greater than or equal to 2.
第二方面,本发明实施例提供一种拍摄装置,包括:机身以及除所述机身之外的多个元件,所述机身包括处理器;In a second aspect, an embodiment of the present invention provides a photographing device, including: a body and a plurality of components other than the body, the body including a processor;
所述处理器,用于向所述多个元件发送帧同步指示,以使所述多个元件将接收到所述帧同步指示时刻对应的图像帧号置为同一初始帧号并在接收到帧同步信号时从所述同一初始帧号开始计数图像帧号;获取拍摄所需的至少一种曝光参数;根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间;在每种曝光参数的发送时间到达时,将该种曝光参数发送给所述多个元件中所需该曝光参数的N个元件,以使所述N个元件在同一图像帧号使用所述至少一种曝光参数,所述N为大于等于2的整数。The processor is configured to send a frame synchronization instruction to the multiple elements, so that the multiple elements set the image frame numbers corresponding to the moments when the frame synchronization instructions are received to the same initial frame number, and when the frame is received When synchronizing the signal, start counting the image frame number from the same initial frame number; obtain at least one exposure parameter required for shooting; determine the transmission time of each exposure parameter according to the effective delay time of each exposure parameter; When the transmission time of the exposure parameter arrives, the exposure parameter is sent to the N elements of the plurality of elements that require the exposure parameter, so that the N elements use the at least one exposure at the same image frame number Parameter, the N is an integer greater than or equal to 2.
第三方面,本发明实施例提供一种可移动平台,包括可移动平台的机身和如第一方面本发明实施例所述的拍摄装置,所述拍摄装置搭载于所述可移动平台的机身上。In a third aspect, an embodiment of the present invention provides a movable platform that includes a body of the movable platform and the shooting device according to the embodiment of the present invention in the first aspect, and the shooting device is mounted on the machine of the movable platform. Body.
第四方面,本发明实施例提供一种芯片,包括:存储器和处理器;In a fourth aspect, an embodiment of the present invention provides a chip, including: a memory and a processor;
所述存储器,用于存储程序指令;所述处理器用于调用存储器中的程序指令执行如第一方面本发明实施例所述的参数同步方法。The memory is used to store program instructions; the processor is used to call the program instructions in the memory to execute the parameter synchronization method according to the embodiment of the present invention in the first aspect.
第五方面,本发明实施例提供一种可读存储介质,所述可读存储介质上存储有计算机程序;所述计算机程序在被执行时,实现如第一方面本发明实施例所述的参数同步方法。In a fifth aspect, an embodiment of the present invention provides a readable storage medium on which a computer program is stored; when the computer program is executed, it realizes the parameters described in the embodiment of the present invention in the first aspect Synchronization method.
第六方面,本发明实施例提供一种计算机程序,当所述计算机程序被计算机执行时,用于实现第一方面本发明实施例所述的参数同步方法。In a sixth aspect, an embodiment of the present invention provides a computer program, when the computer program is executed by a computer, it is used to implement the parameter synchronization method described in the embodiment of the present invention in the first aspect.
本发明实施例提供的参数同步方法、拍摄装置和可移动平台,通过向所述拍摄装置内的多个元件发送帧同步指示,以使所述多个元件将接收到所述帧同步指示的时刻对应的图像帧号置为同一初始帧号与在接收到帧同步信号时从所述同一初始帧号开始计数图像帧号;获取拍摄所需的至少一种曝光参数,根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间,在每种曝光参数的发送时间到达时,将该种曝光参数发送给所述多个元件中所需该曝光参数的N个元件,以使所述N个元件在同一图像帧号使用所述至少一种曝光参数。因此,同一时间产生的曝光参数,会在N个元件中的同一图 像帧生效,从而避免了拍摄获得的图像存在的曝光问题,提高了拍摄的图像质量。According to the parameter synchronization method, the photographing device, and the movable platform provided by the embodiments of the present invention, the frame synchronization instruction is sent to multiple elements in the photographing device, so that the multiple elements will receive the frame synchronization instruction. The corresponding image frame number is set to the same initial frame number and the image frame number is counted from the same initial frame number when the frame synchronization signal is received; at least one exposure parameter required for shooting is acquired, and each exposure parameter takes effect Delay time, determine the transmission time of each exposure parameter, and when the transmission time of each exposure parameter arrives, send the exposure parameter to the N elements of the plurality of elements that require the exposure parameter, so that all The N elements use the at least one exposure parameter in the same image frame number. Therefore, the exposure parameters generated at the same time will take effect in the same image frame in the N elements, thereby avoiding the exposure problem of the captured images and improving the quality of the captured images.
附图说明Description of the drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings used in the description of the embodiments or the prior art. Obviously, the drawings in the following description These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
图1是根据本发明的实施例的无人飞行系统的示意性架构图;Fig. 1 is a schematic architecture diagram of an unmanned aerial system according to an embodiment of the present invention;
图2为本发明一实施例提供的手持云台的示意性架构图;2 is a schematic structural diagram of a handheld pan/tilt head provided by an embodiment of the present invention;
图3为本发明一实施例提供的参数同步方法的流程图;FIG. 3 is a flowchart of a parameter synchronization method provided by an embodiment of the present invention;
图4为本发明一实施例提供的拍摄装置中的元件的一种示意图;4 is a schematic diagram of components in a photographing device provided by an embodiment of the present invention;
图5为本发明一实施例提供的曝光参数的一种同步示意图;5 is a schematic diagram of synchronization of exposure parameters provided by an embodiment of the present invention;
图6为本发明另一实施例提供的曝光参数的一种同步示意图;6 is a schematic diagram of synchronization of exposure parameters provided by another embodiment of the present invention;
图7为本发明一实施例提供的预览模式与拍照模式切换时的参数同步示意图;FIG. 7 is a schematic diagram of parameter synchronization when switching between a preview mode and a photographing mode according to an embodiment of the present invention;
图8为本发明一实施例提供的拍摄装置的结构示意图;FIG. 8 is a schematic structural diagram of a photographing device provided by an embodiment of the present invention;
图9为本发明一实施例提供的可移动平台的结构示意图。Figure 9 is a schematic structural diagram of a movable platform provided by an embodiment of the present invention.
具体实施方式detailed description
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
需要说明的是,当组件被称为“固定于”另一个组件,它可以直接在另一个组件上或者也可以存在居中的组件。当一个组件被认为是“连接”另一个组件,它可以是直接连接到另一个组件或者可能同时存在居中组件。It should be noted that when a component is said to be "fixed to" another component, it can be directly on the other component or a central component may also exist. When a component is considered to be "connected" to another component, it can be directly connected to another component or there may be a centered component at the same time.
除非另有定义,本文所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。本文中在本发明的说明书中所使用的术 语只是为了描述具体的实施例的目的,不是旨在于限制本发明。本文所使用的术语“及/或”包括一个或多个相关的所列项目的任意的和所有的组合。Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of the present invention. The terms used in the description of the present invention herein are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The term "and/or" as used herein includes any and all combinations of one or more related listed items.
下面结合附图,对本发明的一些实施方式作详细说明。在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。Hereinafter, some embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.
本发明的实施例提供了参数同步方法、拍摄装置和可移动平台,该可移动平台可以包括该拍摄装置。该可移动平台例如可以是无人机、无人船、无人汽车、机器人、手持电子设备等。手持电子设备例如是手持云台、手机、平板电脑、笔记本电话、可穿戴设备等终端设备。其中无人机例如可以是旋翼飞行器(rotorcraft),例如,由多个推动装置通过空气推动的多旋翼飞行器,本发明的实施例并不限于此。The embodiment of the present invention provides a parameter synchronization method, a camera, and a movable platform, and the movable platform may include the camera. The movable platform can be, for example, a drone, an unmanned ship, an unmanned car, a robot, a handheld electronic device, and the like. Hand-held electronic devices are, for example, terminal devices such as handheld PTZ, mobile phones, tablet computers, notebook phones, and wearable devices. The drone may be, for example, a rotorcraft, for example, a multi-rotor aircraft propelled by a plurality of propulsion devices through the air, and the embodiments of the present invention are not limited thereto.
图1是根据本发明的实施例的无人飞行系统的示意性架构图。本实施例以旋翼无人机为例进行说明。Fig. 1 is a schematic architecture diagram of an unmanned aerial system according to an embodiment of the present invention. In this embodiment, a rotary wing drone is taken as an example for description.
无人飞行系统100可以包括无人机110、显示设备130和控制终端140。其中,无人机110可以包括动力系统150、飞行控制系统160、机架和承载在机架上的云台120。无人机110可以与控制终端140和显示设备130进行无线通信。The unmanned flying system 100 may include a drone 110, a display device 130, and a control terminal 140. Among them, the UAV 110 may include a power system 150, a flight control system 160, a frame, and a pan/tilt 120 carried on the frame. The drone 110 can wirelessly communicate with the control terminal 140 and the display device 130.
机架可以包括机身和脚架(也称为起落架)。机身可以包括中心架以及与中心架连接的一个或多个机臂,一个或多个机臂呈辐射状从中心架延伸出。脚架与机身连接,用于在无人机110着陆时起支撑作用。The frame may include a fuselage and a tripod (also called a landing gear). The fuselage may include a center frame and one or more arms connected to the center frame, and the one or more arms extend radially from the center frame. The tripod is connected with the fuselage, and is used for supporting the UAV 110 when landing.
动力系统150可以包括一个或多个电子调速器(简称为电调)151、一个或多个螺旋桨153以及与一个或多个螺旋桨153相对应的一个或多个电机152,其中电机152连接在电子调速器151与螺旋桨153之间,电机152和螺旋桨153设置在无人机110的机臂上;电子调速器151用于接收飞行控制系统160产生的驱动信号,并根据驱动信号提供驱动电流给电机152,以控制电机152的转速。电机152用于驱动螺旋桨旋转,从而为无人机110的飞行提供动力,该动力使得无人机110能够实现一个或多个自由度的运动。在某些实施例中,无人机110可以围绕一个或多个旋转轴旋转。例如,上述旋转轴可以包括横滚轴(Roll)、偏航轴(Yaw)和俯仰轴(pitch)。应理解,电机152可以是直流电机,也可以交流电机。另外,电机152可以是无刷电机,也可以是有刷电机。The power system 150 may include one or more electronic speed regulators (referred to as ESCs) 151, one or more propellers 153, and one or more motors 152 corresponding to the one or more propellers 153, wherein the motors 152 are connected to Between the electronic governor 151 and the propeller 153, the motor 152 and the propeller 153 are arranged on the arm of the UAV 110; the electronic governor 151 is used to receive the driving signal generated by the flight control system 160 and provide driving according to the driving signal Current is supplied to the motor 152 to control the speed of the motor 152. The motor 152 is used to drive the propeller to rotate, thereby providing power for the flight of the drone 110, and the power enables the drone 110 to realize one or more degrees of freedom of movement. In some embodiments, the drone 110 may rotate about one or more rotation axes. For example, the aforementioned rotation axis may include a roll axis (Roll), a yaw axis (Yaw), and a pitch axis (pitch). It should be understood that the motor 152 may be a DC motor or an AC motor. In addition, the motor 152 may be a brushless motor or a brushed motor.
飞行控制系统160可以包括飞行控制器161和传感系统162。传感系统162用于测量无人机的姿态信息,即无人机110在空间的位置信息和状态信息,例如,三维位置、三维角度、三维速度、三维加速度和三维角速度等。传感系统162例如可以包括陀螺仪、超声传感器、电子罗盘、惯性测量单元(Inertial Measurement Unit,IMU)、视觉传感器、全球导航卫星系统和气压计等传感器中的至少一种。例如,全球导航卫星系统可以是全球定位系统(Global Positioning System,GPS)。飞行控制器161用于控制无人机110的飞行,例如,可以根据传感系统162测量的姿态信息控制无人机110的飞行。应理解,飞行控制器161可以按照预先编好的程序指令对无人机110进行控制,也可以通过响应来自控制终端140的一个或多个控制指令对无人机110进行控制。The flight control system 160 may include a flight controller 161 and a sensing system 162. The sensing system 162 is used to measure the attitude information of the drone, that is, the position information and state information of the drone 110 in space, such as three-dimensional position, three-dimensional angle, three-dimensional velocity, three-dimensional acceleration, and three-dimensional angular velocity. The sensing system 162 may include, for example, at least one of sensors such as a gyroscope, an ultrasonic sensor, an electronic compass, an inertial measurement unit (IMU), a vision sensor, a global navigation satellite system, and a barometer. For example, the global navigation satellite system may be a global positioning system (Global Positioning System, GPS). The flight controller 161 is used to control the flight of the drone 110, for example, it can control the flight of the drone 110 according to the attitude information measured by the sensor system 162. It should be understood that the flight controller 161 can control the drone 110 according to pre-programmed program instructions, and can also control the drone 110 by responding to one or more control instructions from the control terminal 140.
云台120可以包括电机122。云台用于携带拍摄装置123。飞行控制器161可以通过电机122控制云台120的运动。可选地,作为另一实施例,云台120还可以包括控制器,用于通过控制电机122来控制云台120的运动。应理解,云台120可以独立于无人机110,也可以为无人机110的一部分。应理解,电机122可以是直流电机,也可以是交流电机。另外,电机122可以是无刷电机,也可以是有刷电机。还应理解,云台可以位于无人机的顶部,也可以位于无人机的底部。The pan/tilt head 120 may include a motor 122. The pan/tilt is used to carry the camera 123. The flight controller 161 can control the movement of the pan-tilt 120 through the motor 122. Optionally, as another embodiment, the pan/tilt head 120 may further include a controller for controlling the movement of the pan/tilt head 120 by controlling the motor 122. It should be understood that the pan-tilt 120 may be independent of the drone 110 or a part of the drone 110. It should be understood that the motor 122 may be a DC motor or an AC motor. In addition, the motor 122 may be a brushless motor or a brushed motor. It should also be understood that the pan-tilt may be located on the top of the drone or on the bottom of the drone.
拍摄装置123例如可以是照相机或摄像机等用于捕获图像的设备,拍摄装置123可以与飞行控制器通信,并在飞行控制器的控制下进行拍摄。本实施例的拍摄装置123至少包括感光元件,该感光元件例如为互补金属氧化物半导体(Complementary Metal Oxide Semiconductor,CMOS)传感器或电荷耦合元件(Charge-coupled Device,CCD)传感器。可以理解,拍摄装置123也可直接固定于无人机110上,从而云台120可以省略。The photographing device 123 may be, for example, a device for capturing images, such as a camera or a video camera, and the photographing device 123 may communicate with the flight controller and take pictures under the control of the flight controller. The imaging device 123 of this embodiment at least includes a photosensitive element, and the photosensitive element is, for example, a Complementary Metal Oxide Semiconductor (CMOS) sensor or a Charge-coupled Device (CCD) sensor. It can be understood that the camera 123 can also be directly fixed to the drone 110, so the pan/tilt 120 can be omitted.
显示设备130位于无人飞行系统100的地面端,可以通过无线方式与无人机110进行通信,并且可以用于显示无人机110的姿态信息。另外,还可以在显示设备130上显示拍摄装置拍摄的图像。应理解,显示设备130可以是独立的设备,也可以集成在控制终端140中。The display device 130 is located at the ground end of the unmanned aerial system 100, can communicate with the drone 110 in a wireless manner, and can be used to display the attitude information of the drone 110. In addition, the image taken by the photographing device may also be displayed on the display device 130. It should be understood that the display device 130 may be an independent device or integrated in the control terminal 140.
控制终端140位于无人飞行系统100的地面端,可以通过无线方式与无人机110进行通信,用于对无人机110进行远程操纵。The control terminal 140 is located on the ground end of the unmanned aerial system 100, and can communicate with the drone 110 in a wireless manner for remote control of the drone 110.
应理解,上述对于无人飞行系统各组成部分的命名仅是出于标识的目的,并不应理解为对本发明的实施例的限制。It should be understood that the aforementioned naming of the components of the unmanned aerial system is only for identification purposes and should not be understood as a limitation to the embodiments of the present invention.
图2为本发明一实施例提供的手持云台的示意性架构图,手持云台例如可以是单轴手持云台、双轴手持云台、三轴手持云台等。其中,图2以三轴手持云台为例进行示例性说明。手持云台可以包括手柄机构10和云台机构20。手柄机构10与云台机构20连接。FIG. 2 is a schematic structural diagram of a handheld pan/tilt provided by an embodiment of the present invention. The handheld pan/tilt may be, for example, a single-axis handheld pan/tilt, a dual-axis handheld pan/tilt, or a three-axis handheld pan/tilt. Among them, Fig. 2 takes a three-axis handheld pan/tilt as an example for illustrative description. The handheld pan/tilt may include a handle mechanism 10 and a pan/tilt mechanism 20. The handle mechanism 10 is connected to the pan-tilt mechanism 20.
其中,云台机构20可以用于承载拍摄装置9,本实施例中的拍摄装置9例如可以是照相机、摄像机、手机等。Wherein, the pan-tilt mechanism 20 can be used to carry the photographing device 9. The photographing device 9 in this embodiment may be, for example, a camera, a video camera, a mobile phone, and the like.
其中,手柄机构10上可以设置控制按键11,云台机构20用于对手持云台进行控制。需要说明的是,本实施例对于控制按键11的数量和实现方式不做限定。例如,控制按键11例如可以为开关按键、模式切换按键等。手柄机构10内部可以安装有为手持云台的各个部件供电的电池。Among them, the handle mechanism 10 can be provided with a control button 11, and the pan-tilt mechanism 20 is used to control the handheld pan-tilt. It should be noted that this embodiment does not limit the number and implementation of the control buttons 11. For example, the control button 11 may be a switch button, a mode switch button, or the like. The handle mechanism 10 may be equipped with a battery for powering various components of the handheld pan/tilt.
其中,云台机构20可以包括俯仰轴(Pitch轴)机构21、平移轴(Yaw轴)机构22和横滚轴(Roll轴)机构23。俯仰轴机构21包括俯仰轴转轴和俯仰轴驱动电机;平移轴机构22包括平移轴转轴和平移轴驱动电机;横滚轴机构23包括横滚轴转轴和横滚轴驱动电机。The pan-tilt mechanism 20 may include a pitch axis (Pitch axis) mechanism 21, a translation axis (Yaw axis) mechanism 22, and a roll axis (Roll axis) mechanism 23. The pitch axis mechanism 21 includes a pitch axis rotation axis and a pitch axis drive motor; the translation axis mechanism 22 includes a translation axis rotation axis and a translation axis drive motor; the roll axis mechanism 23 includes a roll axis rotation axis and a roll axis drive motor.
可选的,手持云台可以包括夹持机构6,用于固定拍摄装置9。本发明实施例对于夹持机构6的形状和位置不做限定。可选的,夹持机构6中可以设置惯性测量元件。可选的,惯性测量元件可以为陀螺仪、加速度计等。其中,图2中以拍摄装置9可以从手持云台中分离为例示出,在另一些实施例中,拍摄装置9可以为集成在手持云台中的一部分。Optionally, the handheld pan/tilt may include a clamping mechanism 6 for fixing the camera 9. The embodiment of the present invention does not limit the shape and position of the clamping mechanism 6. Optionally, an inertial measurement element can be provided in the clamping mechanism 6. Optionally, the inertial measurement element may be a gyroscope, accelerometer, etc. Wherein, FIG. 2 shows that the camera 9 can be separated from the handheld pan/tilt as an example. In other embodiments, the camera 9 may be a part of the handheld pan/tilt.
图3为本发明一实施例提供的参数同步方法的流程图,如图3所示,本实施例的方法可以应用于拍摄装置中,该拍摄装置例如为图1中的拍摄装置123,或图2中的拍摄装置9,本实施例不限于此;本实施例的方法可以包括:FIG. 3 is a flowchart of a parameter synchronization method provided by an embodiment of the present invention. As shown in FIG. 3, the method of this embodiment can be applied to a photographing device, such as the photographing device 123 in FIG. The photographing device 9 in 2, this embodiment is not limited to this; the method of this embodiment may include:
S301、向所述拍摄装置内的多个元件发送帧同步指示,以使所述多个元件将接收到所述帧同步指示的时刻对应的图像帧号置为同一初始帧号并且在接收到帧同步信号时从所述同一初始帧号开始计数图像帧号。S301. Send a frame synchronization instruction to multiple elements in the photographing device, so that the multiple elements set the image frame numbers corresponding to the moments when the frame synchronization instructions are received to the same initial frame number, and when the frame is received When synchronizing the signal, the image frame number is counted from the same initial frame number.
本实施例中,由于拍摄装置中包括M个元件,M为大于等于2的整数,本实施例以拍摄装置内的5个元件为例,分别为:机身、图像传感器、镜头、存储芯片、ISP,如图4所示。其中,本实施例的方案例如可以由拍摄装置的 机身来执行。In this embodiment, since the photographing device includes M elements, and M is an integer greater than or equal to 2, this embodiment takes 5 elements in the photographing device as an example, which are: body, image sensor, lens, memory chip, ISP, as shown in Figure 4. Among them, the solution of this embodiment can be executed by the body of the camera, for example.
机身可以向该拍摄装置内的多个元件发送帧同步指示,该多个元件为属于所述M个元件中的元件。相应地,这多个元件根据帧同步指示分别将接收到该帧同步指示的时刻对应的图像帧置为同一初始帧号,例如该同一初始帧号为0,使得这多个元件后续计数的图像帧号同步。然后,这多个元件会接收到帧同步信号,再从图像帧号为同一初始帧号开始对图像帧号进行计数,从而可以保证机身与该多个元件之间的图像帧号同步。The body can send a frame synchronization instruction to a plurality of elements in the camera, and the plurality of elements are elements belonging to the M elements. Correspondingly, the multiple components respectively set the image frame corresponding to the moment of receiving the frame synchronization instruction to the same initial frame number according to the frame synchronization instruction, for example, the same initial frame number is 0, so that the subsequent counted images of these multiple components Frame number synchronization. Then, the multiple components will receive the frame synchronization signal, and then the image frame numbers will be counted from the same initial frame number, so that the synchronization of the image frame numbers between the body and the multiple components can be ensured.
可选地,上述多个元件包括以下至少两种:图像传感器、ISP、存储芯片、镜头。Optionally, the aforementioned multiple elements include at least two of the following: image sensor, ISP, memory chip, and lens.
可选地,所述帧同步信号是图像传感器发送的。Optionally, the frame synchronization signal is sent by an image sensor.
S302、获取拍摄所需的至少一种曝光参数。S302. Acquire at least one exposure parameter required for shooting.
本实施例中,曝光参数包括以下至少一种:电子快门值、模拟增益值、数字增益值、光圈值、机械快门值等,本实施例并不限于此。In this embodiment, the exposure parameters include at least one of the following: electronic shutter value, analog gain value, digital gain value, aperture value, mechanical shutter value, etc. The embodiment is not limited to this.
其中,拍摄装置的机身可以生成拍摄所需的至少一种曝光参数,例如拍摄装置的机身可以根据其的工作模式,生成拍摄所需的至少一种曝光参数,该工作模式例如为:录像模式、拍照模式、预览模式等。或者,The body of the shooting device can generate at least one exposure parameter required for shooting. For example, the body of the shooting device can generate at least one exposure parameter required for shooting according to its working mode. The working mode is, for example, video recording. Mode, camera mode, preview mode, etc. or,
拍摄装置的机身可以获取用户设置的至少一种曝光参数,例如:用户可以通过对拍摄装置执行曝光参数设置操作,该曝光参数设置操作用于设置上述至少一种曝光参数。例如:以拍摄装置为无人机的拍摄装置为例,用户对无人机的控制终端执行曝光参数设置操作,例如用户对控制终端的触控屏执行该曝光参数设置操作,控制终端检测到曝光参数设置操作,向无人机的拍摄装置发送曝光参数设置指令,该曝光参数设置指令包括上述至少一种曝光参数。相应地,拍摄装置的机身会接收到该曝光参数设置指令,从而获得上述至少一种曝光参数。The body of the camera can acquire at least one exposure parameter set by the user. For example, the user can perform an exposure parameter setting operation on the camera, and the exposure parameter setting operation is used to set the at least one exposure parameter described above. For example: Taking the camera with the drone as an example, the user performs the exposure parameter setting operation on the control terminal of the drone. For example, the user performs the exposure parameter setting operation on the touch screen of the control terminal, and the control terminal detects the exposure The parameter setting operation is to send an exposure parameter setting instruction to the camera of the drone, and the exposure parameter setting instruction includes at least one exposure parameter described above. Correspondingly, the body of the photographing device receives the exposure parameter setting instruction, so as to obtain at least one exposure parameter.
S303、根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间。S303: Determine the sending time of each exposure parameter according to the effective delay time of each exposure parameter.
本实施例中,获取的至少一种曝光参数需要发送给该多个元件中的至少一个元件,而且每种曝光参数在元件中的生效延时时长可能不同,因此,机身将每种曝光参数发送给所需的元件的发送时间也可能不同。所以机身根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间。In this embodiment, the acquired at least one exposure parameter needs to be sent to at least one of the multiple components, and the effective delay time of each exposure parameter in the component may be different. Therefore, the body sets each exposure parameter The sending time to the required components may also be different. Therefore, the body determines the sending time of each exposure parameter according to the effective delay time of each exposure parameter.
S304、在每种曝光参数的发送时间到达时,将该种曝光参数发送给所述多个元件中所需该曝光参数的N个元件,以使所述N个元件在同一图像帧号使用所述至少一种曝光参数。S304. When the sending time of each type of exposure parameter arrives, send the type of exposure parameter to the N elements of the plurality of elements that require the exposure parameter, so that the N elements use all the elements in the same image frame number. Said at least one exposure parameter.
本实施例中,在确定每种曝光参数的发送时间到达时,机身将该种曝光参数发送给该多个元件中所需该曝光参数的N个元件,所述N为大于等于2的整数,该N个元件例如可以是图像传感器、镜头、存储芯片、ISP中的至少两个。N个元件中的每个元件在接收到曝光参数之后,根据曝光参数的生效延时时长,使用接收到的曝光参数,由于每种曝光参数的发送时间是根据生效延时时长来决定的,所以每个元件在接收到曝光参数后,根据生效延时时长会在同一图像帧号使用同一时间S302中产生的曝光参数,这样可以保证同一时间产生的曝光参数在同一图像帧上生效。In this embodiment, when it is determined that the sending time of each exposure parameter arrives, the body sends the exposure parameter to N elements of the plurality of elements that require the exposure parameter, where N is an integer greater than or equal to 2. For example, the N elements may be at least two of the image sensor, lens, memory chip, and ISP. After each element of the N elements receives the exposure parameter, the received exposure parameter is used according to the effective delay time of the exposure parameter. Since the transmission time of each exposure parameter is determined according to the effective delay time, so After each component receives the exposure parameter, it will use the exposure parameter generated in the same time S302 at the same image frame number according to the effective delay time, so as to ensure that the exposure parameters generated at the same time take effect on the same image frame.
需要说明的是,N个元件中的每个元件所需的曝光参数可能不同。It should be noted that the exposure parameters required by each of the N elements may be different.
本实施例中,通过向所述拍摄装置内的多个元件发送帧同步指示,以使所述多个元件将接收到所述帧同步指示的时刻对应的图像帧号置为同一初始帧号与在接收到帧同步信号时从所述同一初始帧号开始计数图像帧号,获取拍摄所需的至少一种曝光参数,根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间,在每种曝光参数的发送时间到达时,将该种曝光参数发送给多个元件中所需该曝光参数的N个元件,以使所述N个元件在同一图像帧号使用所述至少一种曝光参数。因此,同一时间产生的曝光参数,会在N个元件中的同一图像帧生效,从而避免了拍摄获得的图像存在的曝光问题,提高了拍摄的图像质量。In this embodiment, a frame synchronization instruction is sent to multiple elements in the photographing device, so that the multiple elements set the image frame numbers corresponding to the moments when the frame synchronization instructions are received to the same initial frame number and When the frame synchronization signal is received, the image frame number is counted from the same initial frame number, at least one exposure parameter required for shooting is obtained, and the transmission time of each exposure parameter is determined according to the effective delay time of each exposure parameter When the transmission time of each exposure parameter arrives, the exposure parameter is sent to the N elements of the multiple elements that require the exposure parameter, so that the N elements use the at least one exposure parameter in the same image frame number. Kind of exposure parameters. Therefore, the exposure parameters generated at the same time will take effect in the same image frame in the N elements, thereby avoiding the exposure problem of the captured image and improving the quality of the captured image.
在一些实施例中,上述S303的一种可能的实现方式可以包括S3031和S3032:In some embodiments, a possible implementation manner of the foregoing S303 may include S3031 and S3032:
S3031、根据每种曝光参数的生效延时时长,确定各种曝光参数的生效延时时长中的最大生效延时时长。S3031, according to the effective delay time of each exposure parameter, determine the maximum effective delay time among the effective delay time of various exposure parameters.
本实施例中,根据产生的至少一种曝光参数中每种曝光参数的生效延时时长,确定这些各种曝光参数的生效延时时长中的最大生效延时时长。本实施例中的时长例如可以由图像帧的帧数来表示。In this embodiment, according to the effective delay time of each exposure parameter in the generated at least one exposure parameter, the maximum effective delay time of the effective delay time of the various exposure parameters is determined. The duration in this embodiment may be represented by the number of image frames, for example.
若曝光参数为三种,第一种曝光参数的生效延时时长为2帧图像帧,第二种曝光参数的生效延时时长为1帧图像帧,第三种曝光参数的生效延时时 长为0帧图像帧,则这些生效延时时长中的最大生效延时时长为2帧图像帧。If there are three exposure parameters, the effective delay time of the first exposure parameter is 2 image frames, the effective delay time of the second exposure parameter is 1 image frame, and the effective delay time of the third exposure parameter is 0 image frames, the maximum effective delay duration among these effective delay durations is 2 image frames.
S3032、根据所述最大生效延时时长以及每种曝光参数的生效延时时长,确定每种曝光参数的发送时间。S3032, according to the maximum effective delay time and the effective delay time of each exposure parameter, determine the sending time of each exposure parameter.
本实施例中,根据上述确定的最大生效延时时长以及每种曝光参数的生效延时时长,确定每种曝光参数的发送时间,以确保各元件在接收到曝光参数时能在同一图像帧号使用。In this embodiment, the transmission time of each exposure parameter is determined according to the above-determined maximum effective delay time and the effective delay time of each exposure parameter, so as to ensure that each element can be in the same image frame number when receiving the exposure parameter. use.
在一种可能的实现方式中,所述每种曝光参数的发送时间与该种曝光参数的产生时间之间的时间差值,等于,所述最大生效延时时长与该种曝光参数的生效延时时长的差值。In a possible implementation, the time difference between the transmission time of each type of exposure parameter and the generation time of the type of exposure parameter is equal to the maximum effective delay time and the effective delay of the type of exposure parameter. The difference in duration.
本实施例中以时间由图像帧来表示,并以曝光参数为三种,第一种曝光参数的生效延时时长为2帧图像帧,第二种曝光参数的生效延时时长为1帧图像帧,第三种曝光参数的生效延时时长为0帧图像帧,最大生效延时时长为2帧图像帧为例子进行说明,若这三种曝光参数的产生时间为第n帧图像,根据最大生效延时时长为2帧图像帧以及第一种曝光参数的生效延时时长为2帧图像帧,则确定第一种曝光参数的发送时间为第n帧图像帧;根据最大生效延时时长为2帧图像帧以及第二种曝光参数的生效延时时长为1帧图像帧,则确定第一种曝光参数的发送时间为第n+1帧图像帧;根据最大生效延时时长为2帧图像帧以及第三种曝光参数的生效延时时长为0帧图像帧,则确定第三种曝光参数的发送时间为第n+2帧图像帧。由于元件在第n帧图像帧接收到该第一种曝光参数,并且第一种曝光参数的生效延时时长为2帧图像帧,所以元件使用第一种曝光参数的时间为第n+2帧图像帧。由于元件在第n+1帧图像帧接收到该第二种曝光参数,并且第二种曝光参数的生效延时时长为1帧图像帧,所以元件使用第二种曝光参数的时间为第n+2帧图像帧。由于元件在第n+2帧图像帧接收到该第三种曝光参数,并且第三种曝光参数的生效延时时长为0帧图像帧,所以元件使用第三种曝光参数的时间为第n+2帧图像帧。由此可知,同一时间产生的曝光参数,即使生效延时时间不同,但在各元件中可以在同一图像帧号使用,保证了曝光参数的同步。In this embodiment, time is represented by image frames, and three exposure parameters are used. The first type of exposure parameter has an effective delay time of 2 image frames, and the second type of exposure parameter has an effective delay time of 1 image frame. Frame, the effective delay time of the third exposure parameter is 0 image frames, and the maximum effective delay time is 2 image frames as an example. If the generation time of these three exposure parameters is the nth image, according to the maximum The effective delay time is 2 image frames and the effective delay time of the first exposure parameter is 2 image frames, then the transmission time of the first exposure parameter is determined to be the nth image frame; according to the maximum effective delay time is If the effective delay time of 2 image frames and the second type of exposure parameter is 1 image frame, the transmission time of the first type of exposure parameter is determined to be the n+1 image frame; according to the maximum effective delay time, it is 2 images If the effective delay time of frame and the third exposure parameter is 0 frame image frame, it is determined that the transmission time of the third exposure parameter is the n+2th frame image frame. Since the component receives the first exposure parameter in the nth image frame, and the effective delay time of the first exposure parameter is 2 image frames, the time for the component to use the first exposure parameter is the n+2th frame Image frame. Since the component receives the second exposure parameter in the n+1th image frame, and the effective delay time of the second exposure parameter is 1 image frame, the time for the component to use the second exposure parameter is the n+th 2 image frames. Since the component receives the third exposure parameter in the n+2 image frame, and the effective delay time of the third exposure parameter is 0 frame image frame, the time for the component to use the third exposure parameter is n+ 2 image frames. It can be seen that the exposure parameters generated at the same time, even if the effective delay time is different, can be used in the same image frame number in each component, which ensures the synchronization of the exposure parameters.
在一些实施例中,上述S302中的至少一种曝光参数可以包括:电子快门值、模拟增益值、数字增益值。In some embodiments, the at least one exposure parameter in S302 may include: an electronic shutter value, an analog gain value, and a digital gain value.
在一些实施例中,当所述拍摄装置的工作模式为预览模式(例如liveview 模式)或录像模式或拍照模式(例如still模式)时,所述N个元件包括:图像传感器和ISP。其中,所述图像传感器所需的曝光参数包括:电子快门值、模拟增益值;所述ISP所需的曝光参数包括:数字增益值。In some embodiments, when the working mode of the photographing device is preview mode (for example, liveview mode) or video mode or photographing mode (for example, still mode), the N elements include: an image sensor and an ISP. Wherein, the exposure parameters required by the image sensor include: an electronic shutter value and an analog gain value; the exposure parameters required by the ISP include: a digital gain value.
本实施例中,基于图4所示进行说明,以机身生成曝光参数为例。机身可以生成图像传感器所需的电子快门值、模拟增益值以及ISP所需的数字增益值,其中,机身与图像传感器之间例如通过两线式串行(Inter-Integrated Circuit,I2C)总线/串行外设接口(Serial Peripheral Interface,SPI)总线通信连接。假设电子快门值的生效延时时长为2帧图像帧,模拟增益值的生效延时时长为1帧图像帧,数字增益值的生效延时时长为0帧图像帧(即没有延时)。机身根据电子快门值的生效延时时长、模拟增益值的生效延时时长、数字增益值的生效延时时长,确定电子快门值的发送时间、模拟增益值的发送时间、数字增益值的发送时间,具体实现过程可以参见上述各实施例的描述,此处不再赘述。In this embodiment, the description is made based on what is shown in FIG. 4, taking the body to generate exposure parameters as an example. The body can generate the electronic shutter value, the analog gain value and the digital gain value required by the ISP for the image sensor. For example, the body and the image sensor are connected through a two-wire serial (Inter-Integrated Circuit, I2C) bus. /Serial Peripheral Interface (SPI) bus communication connection. Assuming that the effective delay time of the electronic shutter value is 2 image frames, the effective delay time of the analog gain value is 1 image frame, and the effective delay time of the digital gain value is 0 image frames (that is, there is no delay). The body determines the transmission time of the electronic shutter value, the transmission time of the analog gain value, and the transmission of the digital gain value according to the effective delay time of the electronic shutter value, the effective delay time of the analog gain value, and the effective delay time of the digital gain value. For time, the specific implementation process can refer to the description of the foregoing embodiments, and details are not described herein again.
例如:参见图5所示,机身确定的在第n帧图像帧生成的电子快门值的发送时间为第n帧图像帧、在第n帧图像帧生成的模拟增益值的发送时间为第n+1帧图像帧、在第n帧图像帧生成的数字增益值的发送时间为第n+2帧图像帧。机身确定的在第n+1帧图像帧生成的电子快门值的发送时间为第n+1帧图像帧、在第n+1帧图像帧生成的模拟增益值的发送时间为第n+2帧图像帧、在第n+1帧图像帧生成的数字增益值的发送时间为第n+3帧图像帧。机身确定的在第n+2帧图像帧生成的电子快门值的发送时间为第n+2帧图像帧、在第n+2帧图像帧生成的模拟增益值的发送时间为第n+3帧图像帧、在第n+2帧图像帧生成的数字增益值的发送时间为第n+4帧图像帧。机身确定的在第n+3帧图像帧生成的电子快门值的发送时间为第n+3帧图像帧、在第n+3帧图像帧生成的模拟增益值的发送时间为第n+4帧图像帧、在第n+3帧图像帧生成的数字增益值的发送时间为第n+5帧图像帧。机身确定的在第n+4帧图像帧生成的电子快门值的发送时间为第n+4帧图像帧、在第n+4帧图像帧生成的模拟增益值的发送时间为第n+5帧图像帧、在第n+4帧图像帧生成的数字增益值的发送时间为第n+6帧图像帧。For example: referring to Figure 5, the transmission time of the electronic shutter value generated in the nth image frame determined by the fuselage is the nth image frame, and the transmission time of the analog gain value generated in the nth image frame is the nth The transmission time of the +1 image frame and the digital gain value generated in the nth image frame is the n+2th image frame. The transmission time of the electronic shutter value generated in the n+1th image frame determined by the body is the n+1th image frame, and the transmission time of the analog gain value generated in the n+1th image frame is the n+2th The transmission time of the frame image frame and the digital gain value generated in the n+1th image frame is the n+3th image frame. The transmission time of the electronic shutter value generated in the n+2th image frame determined by the body is the n+2th image frame, and the transmission time of the analog gain value generated in the n+2th image frame is the n+3th image frame. The transmission time of the frame image frame and the digital gain value generated in the n+2th image frame is the n+4th image frame. The transmission time of the electronic shutter value generated in the n+3th image frame determined by the body is the n+3th image frame, and the transmission time of the analog gain value generated in the n+3th image frame is the n+4th The transmission time of the frame image frame and the digital gain value generated in the n+3th image frame is the n+5th image frame. The transmission time of the electronic shutter value generated in the n+4th image frame determined by the body is the n+4th image frame, and the transmission time of the analog gain value generated in the n+4th image frame is the n+5th The transmission time of the frame image frame and the digital gain value generated in the n+4th image frame is the n+6th image frame.
相应地,图像传感器在第n帧图像帧时接收到在第n帧图像帧时生成的电子快门值、在第n+1帧图像帧时接收到在第n帧图像帧时生成的模拟增益 值;在第n+1帧图像帧时接收到在第n+1帧图像帧时生成的电子快门值、在第n+2帧图像帧时接收到在第n+1帧图像帧时生成的模拟增益值;在第n+3帧图像帧时接收到在第n+3帧图像帧时生成的电子快门值、在第n+3帧图像帧时接收到在第n+2帧图像帧时生成的模拟增益值;在第n+4帧图像帧时接收到在第n+4帧图像帧时生成的电子快门值、在第n+4帧图像帧时接收到在第n+3帧图像帧时生成的模拟增益值;在第n+5帧图像帧时接收到在第n+5帧图像帧时生成的电子快门值、在第n+5帧图像帧时接收到在第n+4帧图像帧时生成的模拟增益值;在第n+6帧图像帧时接收到在第n+6帧图像帧时生成的电子快门值、在第n+6帧图像帧时接收到在第n+6帧图像帧时生成的模拟增益值。Correspondingly, the image sensor receives the electronic shutter value generated in the nth image frame in the nth image frame, and receives the analog gain value generated in the nth image frame in the n+1th image frame. ; When the n+1th image frame is received, the electronic shutter value generated when the n+1th image frame is received; when the n+2th image frame is received, the simulation generated when the n+1th image frame is received Gain value; when the n+3th image frame is received, the electronic shutter value generated when the n+3th image frame is received, and when the n+3th image frame is received, it is generated when the n+2th image frame is received The analog gain value of the image frame; the electronic shutter value generated when the image frame of the n+4 frame is received in the image frame of the n+4 frame, and the image frame of the n+3 frame is received in the image frame of the n+4 frame The analog gain value generated at the time; the electronic shutter value generated at the n+5th image frame is received at the n+5th image frame, and the n+4th frame is received at the n+5th image frame The analog gain value generated in the image frame; the electronic shutter value generated in the n+6 image frame is received in the n+6 image frame, and the electronic shutter value generated in the n+6 image frame is received in the n+6 image frame. The analog gain value generated in 6 image frames.
ISP在第n+2帧图像帧时接收到在第n帧图像帧时生成的数字增益值;在第n+3帧图像帧时接收到在第n+1帧图像帧时生成的数字增益值;在第n+4帧图像帧时接收到在第n+2帧图像帧时生成的数字增益值;在第n+5帧图像帧时接收到在第n+3帧图像帧时生成的数字增益值;在第n+6帧图像帧时接收到在第n+4帧图像帧时生成的数字增益值。The ISP receives the digital gain value generated in the nth image frame in the n+2th image frame; received the digital gain value generated in the n+1th image frame in the n+3th image frame ; Receive the digital gain value generated in the n+2 image frame in the n+4th image frame; receive the digital gain value generated in the n+3th image frame in the n+5th image frame Gain value; the digital gain value generated when the n+4th image frame is received in the n+6th image frame.
所以图像传感器在第n+2帧图像帧时使用在第n帧图像帧时生成的电子快门值和模拟增益值,ISP在第n+2帧图像帧时使用在第n帧图像帧时生成的数字增益值,因此,获得的第n+2帧图像帧的亮度对应的第n帧的曝光参数。图像传感器在第n+3帧图像帧时使用在第n+1帧图像帧时生成的电子快门值和模拟增益值,ISP在第n+3帧图像帧时使用在第n+1帧图像帧时生成的数字增益值,因此,获得的第n+3帧图像帧的亮度对应的第n+1帧的曝光参数。图像传感器在第n+4帧图像帧时使用在第n+2帧图像帧时生成的电子快门值和模拟增益值,ISP在第n+4帧图像帧时使用在第n+2帧图像帧时生成的数字增益值,因此,获得的第n+4帧图像帧的亮度对应的第n+2帧的曝光参数。图像传感器在第n+5帧图像帧时使用在第n+3帧图像帧时生成的电子快门值和模拟增益值,ISP在第n+5帧图像帧时使用在第n+3帧图像帧时生成的数字增益值,因此,获得的第n+5帧图像帧的亮度对应的第n+3帧的曝光参数。图像传感器在第n+6帧图像帧时使用在第n+4帧图像帧时生成的电子快门值和模拟增益值,ISP在第n+6帧图像帧时使用在第n+4帧图像帧时生成的数字增益值,因此,获得的第n+6帧图像帧的亮度对应的第n+4帧 的曝光参数。Therefore, the image sensor uses the electronic shutter value and the analog gain value generated in the nth image frame in the n+2th image frame, and the ISP uses the nth image frame in the n+2th image frame. The digital gain value is the exposure parameter of the nth frame corresponding to the brightness of the obtained n+2th image frame. The image sensor uses the electronic shutter value and analog gain value generated in the n+1 image frame in the n+3 image frame, and the ISP uses the n+1 image frame in the n+3 image frame. Therefore, the brightness of the obtained image frame of the n+3th frame corresponds to the exposure parameter of the n+1th frame. The image sensor uses the electronic shutter value and analog gain value generated in the n+2 image frame in the n+4th image frame, and the ISP uses the n+2th image frame in the n+4th image frame. Therefore, the brightness of the n+4th image frame obtained corresponds to the exposure parameter of the n+2th frame. The image sensor uses the electronic shutter value and analog gain value generated in the n+3 image frame in the n+5th image frame, and the ISP uses the n+3th image frame in the n+5th image frame. Therefore, the brightness of the n+5th image frame obtained corresponds to the exposure parameter of the n+3th frame. The image sensor uses the electronic shutter value and analog gain value generated in the n+4 image frame in the n+6 image frame, and the ISP uses the n+4 image frame in the n+6 image frame. Therefore, the brightness of the n+6th image frame obtained corresponds to the exposure parameter of the n+4th frame.
在一些实施例中,当所述拍摄装置的工作模式为录像模式时,所述N个元件还包括:存储芯片;所述存储芯片所需的曝光参数包括:数字增益值。可选地,该存储芯片可以包括FPGA芯片。其中,机身与存储芯片之间例如通过I2C总线/SPI总线通信连接。In some embodiments, when the working mode of the photographing device is the video recording mode, the N elements further include: a storage chip; the exposure parameters required by the storage chip include: a digital gain value. Optionally, the memory chip may include an FPGA chip. Wherein, the fuselage and the memory chip are connected for communication via an I2C bus/SPI bus, for example.
例如:参见图6所示,机身在第n+2帧图像帧发送在第n帧图像帧生成的数字增益值,在第n+3帧图像帧发送在第n+1帧图像帧生成的数字增益值,在第n+4帧图像帧发送在第n+2帧图像帧生成的数字增益值,在第n+5帧图像帧发送在第n+3帧图像帧生成的数字增益值,在第n+6帧图像帧发送在第n+4帧图像帧生成的数字增益值。For example: see Figure 6, the body sends the digital gain value generated in the nth image frame in the n+2th image frame, and sends the digital gain value generated in the n+1th image frame in the n+3th image frame Digital gain value, send the digital gain value generated in the n+2 image frame in the n+4th image frame, and send the digital gain value generated in the n+3th image frame in the n+5th image frame, In the n+6th image frame, the digital gain value generated in the n+4th image frame is sent.
相应地,存储芯片在第n+2帧图像帧时接收到并使用在第n帧图像帧时生成的数字增益值;在第n+3帧图像帧时接收到并使用在第n+1帧图像帧时生成的数字增益值;在第n+4帧图像帧时接收到并使用在第n+2帧图像帧时生成的数字增益值;在第n+5帧图像帧时接收到并使用在第n+3帧图像帧时生成的数字增益值;在第n+6帧图像帧时接收到并使用在第n+4帧图像帧时生成的数字增益值。Correspondingly, the memory chip receives and uses the digital gain value generated in the nth image frame in the n+2th image frame; receives and uses the n+1th frame in the n+3th image frame The digital gain value generated in the image frame; the digital gain value generated in the n+2 image frame is received and used in the n+4th image frame; the digital gain value generated in the n+5th image frame is received and used in the n+5th image frame The digital gain value generated in the n+3th image frame; the digital gain value generated in the n+4th image frame is received and used in the n+6th image frame.
在一些实施例中,若拍摄装置由预览模式(例如liveview模式)向拍照模式(例如still模式)切换时,则拍摄装置的机身还确定镜头的光圈值;向所述镜头发送光圈设置指令,所述光圈设置指令包括所述光圈值以及预设时间,所述光圈设置指令用于所述镜头在所述预设时间开始使用所述光圈值;所述预设时间为所述拍摄装置处于拍照模式时的一时间点。In some embodiments, if the camera is switched from preview mode (such as liveview mode) to photographing mode (such as still mode), the body of the camera also determines the aperture value of the lens; sends an aperture setting instruction to the lens, The aperture setting instruction includes the aperture value and a preset time, and the aperture setting instruction is used for the lens to start using the aperture value at the preset time; the preset time is when the camera is taking a picture A point in time during the mode.
本实施例中,可参照图7所示,当拍摄装置处于拍照模式时,拍摄装置的镜头需要使用光圈值,因此,拍摄装置的机身在拍摄装置由预览模式向拍照模式切换的过程中,确定镜头的光圈值,然后向镜头发送光圈设置指令,该光圈设置指令包括光圈值以及预设时间,其中,机身与镜头之间例如通过I2C总线/SPI总线通信连接。相应地,镜头接收该光圈设置指令,并根据光圈设置指令,在该预设时间开始使用该光圈值。该预设时间例如可以是拍摄装置处于拍照模式时拍摄第1帧图像帧的时间。可选地,在机身向镜头发送光圈设置指令之前,存储芯片还停止其内部的处理逻辑。In this embodiment, referring to FIG. 7, when the shooting device is in the shooting mode, the lens of the shooting device needs to use the aperture value. Therefore, the body of the shooting device is in the process of switching the shooting device from the preview mode to the shooting mode. The aperture value of the lens is determined, and then an aperture setting instruction is sent to the lens. The aperture setting instruction includes the aperture value and a preset time, wherein the body and the lens are connected via I2C bus/SPI bus communication, for example. Correspondingly, the lens receives the aperture setting instruction, and according to the aperture setting instruction, starts to use the aperture value at the preset time. The preset time may be, for example, the time for shooting the first image frame when the shooting device is in the shooting mode. Optionally, before the body sends an aperture setting instruction to the lens, the memory chip also stops its internal processing logic.
可选地,在拍摄装置在拍照结束后,会由拍照模式向预览模式切换,在 拍摄装置在预览模式下镜头使用的光圈值与在拍照模式下使用的光圈值不同,因此,镜头在所述拍照装置处于拍照模式结束时由所述光圈值恢复为处于预览模式下的光圈值。可选地,在镜头的光圈值恢复为预览模式下的光圈值之后,在由拍照模式切换为预览模式的过程中,存储芯片恢复其内部的处理逻辑。Optionally, the camera will switch from the camera mode to the preview mode after the camera is finished taking pictures. The aperture value used by the lens in the preview mode of the camera is different from the aperture value used in the camera mode. Therefore, the lens is When the photographing device is in the photographing mode, the aperture value is restored to the aperture value in the preview mode. Optionally, after the aperture value of the lens is restored to the aperture value in the preview mode, in the process of switching from the photographing mode to the preview mode, the memory chip restores its internal processing logic.
可选地,当拍摄装置处于拍照模式时,拍摄装置的图像传感器还可能需要使用机械快门值。在所述拍摄装置由预览模式向拍照模式切换时,拍摄装置的机身不仅确定镜头的光圈值,还确定图像传感器的机械快门值;然后向所述图像传感器发送机械快门值设置指令,所述机械快门值设置指令包括所述机械快门值以及预设时间,所述机械快门值设置指令用于指示所述图像传感器在所述预设时间开始使用所述机械快门值。相应地,图像传感器在拍摄装置由预览模式向拍照模式切换的过程中,接收机械快门值设置指令,并根据机械快门值设置指令,在该预设时间开始使用该机械快门值。其中,图像传感器开始使用机械快门值与镜头开始使用光圈值的时间相同,从而实现了机械快门值与光圈值在元件间的时间同步。该预设时间例如可以是拍摄装置处于拍照模式时拍摄第1帧图像帧的时间。Optionally, when the camera is in the camera mode, the image sensor of the camera may also need to use a mechanical shutter value. When the camera is switched from the preview mode to the camera mode, the body of the camera not only determines the aperture value of the lens, but also determines the mechanical shutter value of the image sensor; then sends a mechanical shutter value setting instruction to the image sensor, The mechanical shutter value setting instruction includes the mechanical shutter value and a preset time, and the mechanical shutter value setting instruction is used to instruct the image sensor to start using the mechanical shutter value at the preset time. Correspondingly, the image sensor receives the mechanical shutter value setting instruction during the switching process of the camera from the preview mode to the photographing mode, and starts using the mechanical shutter value at the preset time according to the mechanical shutter value setting instruction. Among them, the time when the image sensor starts to use the mechanical shutter value and the lens starts to use the aperture value is the same, thereby realizing the time synchronization between the mechanical shutter value and the aperture value between the components. The preset time may be, for example, the time for shooting the first image frame when the shooting device is in the shooting mode.
在一些实施例中,上述的帧同步指示包括工作模式切换指示,相应地,上述S301的一种可能的实现方式为:当所述拍摄装置在各工作模式之间切换时,向所述多个元件发送工作模式切换指示,以使所述多个元件将接收到所述工作模式切换指示的时刻对应的图像帧号置为同一初始帧号。In some embodiments, the aforementioned frame synchronization indication includes an operation mode switching indication. Correspondingly, a possible implementation of the above S301 is: when the photographing device switches between working modes, The component sends a working mode switching instruction, so that the multiple components set the image frame numbers corresponding to the moment when the working mode switching instruction is received to the same initial frame number.
当拍摄装置在录像模式与预览模式之间切换,或者,录像模式与拍照模式之间切换,或者,预览模式与拍照模式之间切换时,拍摄装置的机身向多个元件发送工作模式切换指示。相应地,这多个元件分别将接收到工作模式切换指示的时刻对应的图像帧号置为同一初始帧号,并且这多个元件均会接收到帧同步信号,在这多个元件接收到帧同步信号时从上述同一初始帧号开始计数图像帧号,使得这多个元件中计数的图像帧号同步。在图像帧号同步时,使得曝光参数的同步更加准确。When the camera is switched between video mode and preview mode, or between video mode and camera mode, or between preview mode and camera mode, the camera body sends work mode switching instructions to multiple components . Correspondingly, these multiple components respectively set the corresponding image frame numbers at the time when the operating mode switching instruction is received to the same initial frame number, and these multiple components will all receive the frame synchronization signal, and the frames are received in these multiple components. When synchronizing the signal, the image frame numbers are counted from the same initial frame number mentioned above, so that the image frame numbers counted in these multiple elements are synchronized. When the image frame number is synchronized, the synchronization of the exposure parameters is more accurate.
例如:上述多个元件包括镜头和存储芯片,在拍摄装置在各工作模式之间切换时,机身需要和镜头以及存储芯片进行图像帧同步。因此,拍摄装置的机身在各工作模式之间切换的过程中,分别向镜头和存储芯片发送工作模 式切换指示,镜头和存储芯片均会接收到该工作模式切换指示,然后镜头和存储芯片将接收到工作模式切换指示的图像帧置为同一初始帧号,例如置位各自存储的图像帧号,例如将图像帧号置为0。本实施例中,图像传感器不仅与机身通信连接,还与存储芯片和镜头通信连接,例如:图像传感器的vd引脚可以与机身、镜头和存储芯片连接,图像传感器会通过vd引脚同时分别向机身、存储芯片和镜头发送帧同步信号(例如:vd信号或vsync信号)。机身、存储芯片和镜头会接收到该帧同步信号,再从图像帧号为0开始对图像帧号进行计数,从而可以保证机身、镜头和存储芯片之间的图像帧号同步。For example, the above-mentioned multiple components include a lens and a memory chip. When the camera is switched between working modes, the body needs to synchronize the image frame with the lens and the memory chip. Therefore, during the process of switching between the operating modes of the camera body, the operating mode switching instructions are sent to the lens and the memory chip respectively, and both the lens and the memory chip will receive the operating mode switching instructions, and then the lens and memory chip will The image frames that have received the operation mode switching instruction are set to the same initial frame number, for example, the respective stored image frame numbers are set, for example, the image frame number is set to 0. In this embodiment, the image sensor is not only communicatively connected with the body, but also communicatively connected with the memory chip and the lens. For example, the vd pin of the image sensor can be connected with the body, lens and memory chip, and the image sensor will be connected simultaneously through the vd pin. Send frame synchronization signals (for example: vd signal or vsync signal) to the body, memory chip and lens respectively. The body, memory chip, and lens will receive the frame synchronization signal, and then count the image frame numbers starting from the image frame number being 0, so that the image frame number synchronization between the body, lens and memory chip can be ensured.
在一些实施例中,当拍摄装置接收到录像命令时,所述录像命令用于控制所述拍摄装置进入录像模式,向存储芯片发送录像开始指令,所述录像开始指令用于指示所述存储芯片将图像帧存储至存储芯片外部的第一存储器中;确定编码的第一个图像帧的图像帧号,并将所述图像帧号发送给所述存储芯片,以使所述存储芯片根据所述图像帧号,从所述图像帧号开始将所述第一存储器中存储的对应的图像帧依次存储至所述存储芯片外部的第二存储器中。In some embodiments, when a recording device receives a recording command, the recording command is used to control the recording device to enter the recording mode and send a recording start instruction to the storage chip, and the recording start instruction is used to instruct the storage chip The image frame is stored in the first memory outside the storage chip; the image frame number of the first image frame to be encoded is determined, and the image frame number is sent to the storage chip, so that the storage chip according to the Image frame number, starting from the image frame number, the corresponding image frames stored in the first memory are sequentially stored in the second memory outside the memory chip.
当用户需要录像时,对拍摄装置执行录像操作,例如:以拍摄装置为无人机的拍摄装置为例,用户可以对无人机的控制终端执行录像操作,控制终端会向无人机的拍摄装置发送录像命令。拍摄装置的机身会接收到录像命令,机身会向存储芯片发送录像开始指令,该录像开始指令用于指示存储芯片将图像帧存储至第一存储器中,其中,该第一存储器与存储芯片通信连接,并且该第一存储器为独立于存储芯片之外的存储器,该第一存储器例如为双倍速率(Double Data Rate,DDR)存储器。相应地,存储芯片接收到录像开始指令之后,将存储芯片中的图像帧存储至第一存储器中。然后机身确定编码的第一个图像帧的图像帧号,所述帧号可以为绝对图像帧号,或者,也可以是相对图像帧号。机身再将所述图像帧号发送给所述存储芯片,存储芯片接收到该图像帧号后,从所述第一存储器中将从所述图像帧号对应的图像帧开始存储至第二存储器中。其中,第二存储器为不同于第一存储器的存储器,第二存储器与存储芯片通信连接,该第一存储器例如为固态硬盘(Solid State Drive,SSD)。因此,本实施例可以保证第二存储器中存储的图像帧与编码的图像帧的图像帧号对齐。When the user needs to record, perform the recording operation on the camera. For example, take the camera with the drone as an example, the user can perform the recording operation on the drone's control terminal, and the control terminal will shoot the drone The device sends a recording command. The body of the camera will receive the video command, and the body will send a video start instruction to the memory chip. The video start instruction is used to instruct the memory chip to store the image frame in the first memory. The first memory and the memory chip Communication connection, and the first memory is a memory independent of the memory chip, and the first memory is, for example, a Double Data Rate (DDR) memory. Correspondingly, after receiving the video recording start instruction, the storage chip stores the image frames in the storage chip in the first memory. The body then determines the image frame number of the first image frame to be encoded, and the frame number can be an absolute image frame number or a relative image frame number. The body then sends the image frame number to the storage chip, and after receiving the image frame number, the storage chip stores the image frame corresponding to the image frame number from the first memory to the second memory in. The second memory is a memory different from the first memory, and the second memory is in communication connection with the storage chip. The first memory is, for example, a solid state drive (SSD). Therefore, this embodiment can ensure that the image frames stored in the second memory are aligned with the image frame numbers of the encoded image frames.
在一些实施例中,机身与存储芯片可以通过通用输入输出(General  Purpose Input Output,GPIO)接口或通用异步收发传输器(Universal Asynchronous Receiver/Transmitter,UART)接口来进行通信。当机身与存储芯片可以通过至少一个GPIO接口进行通信时,上述的图像帧号可以是机身通过该至少一个GPIO接口发送给存储芯片,该至少一个GPIO接口例如是4个GPIO接口,该图像帧号例如可以是相对图像帧号。上述的录像开始指令可以是机身通过I2C总线发送给存储芯片。In some embodiments, the body and the memory chip may communicate through a general purpose input output (GPIO) interface or a universal asynchronous receiver/transmitter (UART) interface. When the body and the storage chip can communicate through at least one GPIO interface, the above-mentioned image frame number may be sent by the body to the storage chip through the at least one GPIO interface. The at least one GPIO interface is, for example, 4 GPIO interfaces. The frame number may be a relative image frame number, for example. The above-mentioned recording start instruction may be sent by the body to the storage chip via the I2C bus.
当机身与存储芯片通过UART接口进行通信时,上述的图像帧号可以是机身通过该UART接口发送给存储芯片,该图像帧号例如可以是绝对图像帧号。上述的录像开始指令可以是机身通过SPI发送给存储芯片,由于本实施例通过使用SPI来传输录像开始指令,而不是可以大幅提升通信带宽。When the fuselage communicates with the storage chip through a UART interface, the aforementioned image frame number may be sent by the fuselage to the storage chip through the UART interface, and the image frame number may be, for example, an absolute image frame number. The above-mentioned recording start instruction may be sent by the body to the storage chip through SPI. Since this embodiment uses SPI to transmit the recording start instruction, the communication bandwidth can not be greatly increased.
本实施例是通过GPIO接口或UART接口来传输图像帧号,可以避免若图像帧号通过I2C总线传输时,由于I2C总线上传输的数据量非常多,会造成帧号的传输出现很大的延迟,该延迟有可能过大,导致存储芯片的缓存被撑爆,对应的图像帧丢失的现象。In this embodiment, the image frame number is transmitted through the GPIO interface or the UART interface, which can avoid that when the image frame number is transmitted through the I2C bus, because the amount of data transmitted on the I2C bus is very large, the transmission of the frame number will be greatly delayed. , The delay may be too large, causing the cache of the memory chip to burst, and the corresponding image frame is lost.
在一些实施例中,上述拍摄装置的机身执行的方案可以是由拍摄装置的机身内的处理器来执行。In some embodiments, the solution executed by the body of the above-mentioned camera may be executed by a processor in the body of the camera.
本发明实施例中还提供了一种计算机存储介质,该计算机存储介质中存储有程序指令,所述程序执行时可包括如图3及其对应实施例中的参数同步方法的部分或全部步骤。The embodiment of the present invention also provides a computer storage medium, the computer storage medium stores program instructions, and the program execution may include part or all of the steps of the parameter synchronization method in FIG. 3 and its corresponding embodiments.
图8为本发明一实施例提供的拍摄装置的结构示意图,如图8所示,本实施例的拍摄装置800可以包括:机身801以及除所述机身之外的多个元件,机身801与这多个元件可以通信连接;其中,图8以多个元件包括:图像传感器802、ISP 803、存储芯片804和镜头805为例示出,但本实施例并不限于此。其中,所述机身801包括处理器8011。FIG. 8 is a schematic structural diagram of a photographing device provided by an embodiment of the present invention. As shown in FIG. 8, the photographing device 800 of this embodiment may include: a body 801 and multiple components other than the body. 801 can be communicatively connected with these multiple components; wherein, FIG. 8 shows multiple components including: an image sensor 802, an ISP 803, a storage chip 804, and a lens 805 as an example, but this embodiment is not limited to this. Wherein, the body 801 includes a processor 8011.
所述处理器8011,用于向所述多个元件发送帧同步指示,以使所述多个元件将接收到所述帧同步指示时刻对应的图像帧号置为同一初始帧号,并与所述多个元件在接收到帧同步信号时从所述同一初始帧号开始计数图像帧号;获取拍摄所需的至少一种曝光参数;根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间;在每种曝光参数的发送时间到达时,将该种曝光参数发送给所述多个元件中所需该曝光参数的N个元件,以使所述N个元件在同 一图像帧号使用所述至少一种曝光参数,所述N为大于等于2的整数。The processor 8011 is configured to send a frame synchronization instruction to the multiple elements, so that the multiple elements set the image frame number corresponding to the moment when the frame synchronization instruction is received to the same initial frame number, and the When the multiple elements receive the frame synchronization signal, start counting the image frame numbers from the same initial frame number; obtain at least one exposure parameter required for shooting; determine each exposure according to the effective delay time of each exposure parameter The transmission time of the parameter; when the transmission time of each exposure parameter arrives, the exposure parameter is sent to the N elements of the plurality of elements that require the exposure parameter, so that the N elements are in the same image frame Use the at least one exposure parameter, and the N is an integer greater than or equal to 2.
在一些实施例中,所述处理器8011在根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间时,具体用于:In some embodiments, when the processor 8011 determines the sending time of each exposure parameter according to the effective delay time of each exposure parameter, it is specifically configured to:
根据每种曝光参数的生效延时时长,确定各种曝光参数的生效延时时长中的最大生效延时时长;According to the effective delay time of each exposure parameter, determine the maximum effective delay time among the effective delay time of various exposure parameters;
根据所述最大生效延时时长以及每种曝光参数的生效延时时长,确定每种曝光参数的发送时间。The sending time of each exposure parameter is determined according to the maximum effective delay time and the effective delay time of each exposure parameter.
在一些实施例中,所述每种曝光参数的发送时间与该种曝光参数的产生时间之间的时间差值,等于,所述最大生效延时时长与该种曝光参数的生效延时时长的差值。In some embodiments, the time difference between the transmission time of each type of exposure parameter and the generation time of that type of exposure parameter is equal to the difference between the maximum effective delay time and the effective delay time of this type of exposure parameter Difference.
在一些实施例中,所述多个元件包括以下至少两个:图像传感器、ISP、存储芯片、镜头。In some embodiments, the plurality of components includes at least two of the following: image sensor, ISP, memory chip, lens.
在一些实施例中,所述至少一种曝光参数包括:电子快门值、模拟增益值、数字增益值。In some embodiments, the at least one exposure parameter includes: an electronic shutter value, an analog gain value, and a digital gain value.
在一些实施例中,当所述拍摄装置的工作模式为预览模式或录像模式或拍照模式时,所述N个元件包括:图像传感器802和ISP 803;In some embodiments, when the working mode of the photographing device is a preview mode, a video recording mode, or a photographing mode, the N elements include: an image sensor 802 and an ISP 803;
其中,所述图像传感器802所需的曝光参数包括:电子快门值、模拟增益值;Wherein, the exposure parameters required by the image sensor 802 include: electronic shutter value and analog gain value;
所述ISP 803所需的曝光参数包括:数字增益值。The exposure parameters required by the ISP 803 include: digital gain value.
在一些实施例中,当所述拍摄装置的工作模式为录像模式时,所述N个元件还包括:存储芯片804;In some embodiments, when the working mode of the photographing device is the video recording mode, the N elements further include: a storage chip 804;
所述存储芯片804所需的曝光参数包括:数字增益值。The exposure parameters required by the memory chip 804 include digital gain values.
在一些实施例中,所述存储芯片804包括FPGA芯片。In some embodiments, the memory chip 804 includes an FPGA chip.
在一些实施例中,所述处理器8011,还用于:In some embodiments, the processor 8011 is further configured to:
在所述拍摄装置800由预览模式向拍照模式切换时,确定镜头805的光圈值;Determining the aperture value of the lens 805 when the photographing device 800 is switched from the preview mode to the photographing mode;
向所述镜头805发送光圈设置指令,所述光圈设置指令包括所述光圈值以及预设时间,所述光圈设置指令用于所述镜头805在所述预设时间开始使用所述光圈值;Sending an aperture setting instruction to the lens 805, where the aperture setting instruction includes the aperture value and a preset time, and the aperture setting instruction is used for the lens 805 to start using the aperture value at the preset time;
所述镜头805,用于在所述预设时间开始使用所述光圈值;The lens 805 is configured to start using the aperture value at the preset time;
所述预设时间为所述拍摄装置800处于拍照模式时的一时间点。The preset time is a point in time when the photographing device 800 is in the photographing mode.
在一些实施例中,所述处理器8011,还用于:In some embodiments, the processor 8011 is further configured to:
在所述拍摄装置800由预览模式向拍照模式切换时,确定图像传感器802的机械快门值;Determining the mechanical shutter value of the image sensor 802 when the photographing device 800 switches from the preview mode to the photographing mode;
向所述图像传感器802发送机械快门值设置指令,所述机械快门值设置指令包括所述机械快门值以及预设时间,所述机械快门值设置指令用于指示所述图像传感器802在所述预设时间开始使用所述机械快门值;Send a mechanical shutter value setting instruction to the image sensor 802. The mechanical shutter value setting instruction includes the mechanical shutter value and a preset time, and the mechanical shutter value setting instruction is used to instruct the image sensor 802 in the preset time. Set the time to start using the mechanical shutter value;
所述图像传感器802,用于在所述预设时间开始使用所述机械快门值。The image sensor 802 is configured to start using the mechanical shutter value at the preset time.
在一些实施例中,所述帧同步指示包括工作模式切换指示;所述处理器8011在向所述拍摄装置内的多个元件发送帧同步指示时,具体用于:In some embodiments, the frame synchronization instruction includes a work mode switching instruction; when the processor 8011 sends a frame synchronization instruction to multiple elements in the camera, it is specifically configured to:
当所述拍摄装置800在各工作模式之间切换时,向所述多个元件发送工作模式切换指示。When the camera 800 switches between the operating modes, it sends an operating mode switching instruction to the multiple components.
在一些实施例中,所述帧同步信号是图像传感器802发送的。In some embodiments, the frame synchronization signal is sent by the image sensor 802.
在一些实施例中,所述处理器8011,还用于:当接收到录像命令时,所述录像命令用于控制所述拍摄装置800进入录像模式,向存储芯片804发送录像开始指令,所述录像开始指令用于指示所述存储芯片804将图像帧存储至所述存储芯片外部的第一存储器806中;In some embodiments, the processor 8011 is further configured to: when a recording command is received, the recording command is used to control the shooting device 800 to enter the recording mode, and send a recording start instruction to the storage chip 804, The recording start instruction is used to instruct the storage chip 804 to store the image frame in the first memory 806 outside the storage chip;
确定编码的第一个图像帧的图像帧号,并将所述图像帧号发送给所述存储芯片804;Determine the image frame number of the first image frame to be encoded, and send the image frame number to the storage chip 804;
所述存储芯片804,用于将图像帧存储至所述存储芯片804外部的第一存储器806中,以及根据所述图像帧号,从所述图像帧号开始将所述第一存储器806中存储的对应的图像帧依次存储至所述存储芯片804外部的第二存储器807中。The storage chip 804 is configured to store image frames in the first memory 806 outside the storage chip 804, and according to the image frame number, store the image frames in the first memory 806 starting from the image frame number The corresponding image frames are sequentially stored in the second memory 807 outside the storage chip 804.
在一些实施例中,拍摄装置800中包括上述的第一存储器806和第二存储器807。在另一些实施例中,第一存储器806和第二存储器807中的至少一个为拍摄装置800外部的存储器。In some embodiments, the photographing device 800 includes the first memory 806 and the second memory 807 described above. In other embodiments, at least one of the first memory 806 and the second memory 807 is a memory external to the camera 800.
在一些实施例中,所述第一存储器806为DDR存储器,所述第二存储器807为SSD。In some embodiments, the first memory 806 is a DDR memory, and the second memory 807 is an SSD.
在一些实施例中,所述机身801与所述存储芯片804通过至少一个GPIO接口或UART接口通信连接,所述处理器8011在将所述图像帧号发送给所 述存储芯片804时,具体用于:In some embodiments, the body 801 and the storage chip 804 are communicatively connected through at least one GPIO interface or a UART interface. When the processor 8011 sends the image frame number to the storage chip 804, specifically Used for:
通过至少一个GPIO接口或UART接口,将所述图像帧号发送给所述存储芯片804。The image frame number is sent to the storage chip 804 through at least one GPIO interface or UART interface.
在一些实施例中,所述机身801与所述存储芯片804通过SPI通信连接;In some embodiments, the body 801 and the storage chip 804 are connected through SPI communication;
所述处理器8011在向存储芯片804发送录像开始指令时,具体用于:通过SPI向所述存储芯片804发送所述录像开始指令。When the processor 8011 sends a video recording start instruction to the storage chip 804, it is specifically configured to send the video recording start instruction to the storage chip 804 via SPI.
在一些实施例中,所述图像帧号为绝对图像帧号或相对图像帧号。In some embodiments, the image frame number is an absolute image frame number or a relative image frame number.
本实施例的拍摄装置,可以用于执行本发明上述各方法实施例中的技术方案,其实现原理和技术效果类似,此处不再赘述。The photographing device in this embodiment can be used to implement the technical solutions in the foregoing method embodiments of the present invention, and its implementation principles and technical effects are similar, and will not be repeated here.
图9为本发明一实施例提供的可移动平台的结构示意图,如图9所示,本实施例的可移动平台900可以包括:可移动平台900的机身901以及拍摄装置902,所述拍摄装置902搭载于所述可移动平台的机身901上。FIG. 9 is a schematic structural diagram of a movable platform provided by an embodiment of the present invention. As shown in FIG. 9, the movable platform 900 of this embodiment may include: a body 901 of the movable platform 900 and a photographing device 902. The device 902 is mounted on the body 901 of the movable platform.
在一些实施例中,可移动平台900还包括云台(图中未示出),云台与机身901连接,拍摄装置902搭载在该云台上。或者,可移动平台900为手持云台。In some embodiments, the movable platform 900 further includes a pan/tilt (not shown in the figure), the pan/tilt is connected to the body 901, and the camera 902 is mounted on the pan/tilt. Alternatively, the movable platform 900 is a handheld PTZ.
本实施例的可移动平台,可以用于执行本发明上述各方法实施例中的技术方案,其实现原理和技术效果类似,此处不再赘述。The movable platform of this embodiment can be used to implement the technical solutions in the foregoing method embodiments of the present invention, and its implementation principles and technical effects are similar, and will not be repeated here.
本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:只读内存(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。A person of ordinary skill in the art can understand that all or part of the steps in the above method embodiments can be implemented by a program instructing relevant hardware. The foregoing program can be stored in a computer readable storage medium. When the program is executed, it is executed. Including the steps of the foregoing method embodiment; and the foregoing storage medium includes: read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks or optical disks, etc., which can store program codes Medium.
最后应说明的是:以上各实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: It is still possible to modify the technical solutions described in the foregoing embodiments, or equivalently replace some or all of the technical features; these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present invention range.

Claims (38)

  1. 一种参数同步方法,其特征在于,应用于拍摄装置中,所述方法包括:A parameter synchronization method, which is characterized in that it is applied to a camera, and the method includes:
    向所述拍摄装置内的多个元件发送帧同步指示,以使所述多个元件将接收到所述帧同步指示时刻对应的图像帧号置为同一初始帧号并在接收到帧同步信号时从所述同一初始帧号开始计数图像帧号;Send a frame synchronization instruction to multiple elements in the photographing device, so that the multiple elements set the image frame number corresponding to the moment when the frame synchronization instruction is received to the same initial frame number, and when the frame synchronization signal is received Counting image frame numbers starting from the same initial frame number;
    获取拍摄所需的至少一种曝光参数;Acquiring at least one exposure parameter required for shooting;
    根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间;Determine the sending time of each exposure parameter according to the effective delay time of each exposure parameter;
    在每种曝光参数的发送时间到达时,将该种曝光参数发送给所述多个元件中所需该曝光参数的N个元件,以使所述N个元件在同一图像帧号使用所述至少一种曝光参数,所述N为大于等于2的整数。When the sending time of each type of exposure parameter arrives, the type of exposure parameter is sent to the N elements of the plurality of elements that require the exposure parameter, so that the N elements use the at least one at the same image frame number. An exposure parameter, where N is an integer greater than or equal to 2.
  2. 根据权利要求1所述的方法,其特征在于,所述根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间,包括:The method according to claim 1, wherein the determining the transmission time of each exposure parameter according to the effective delay time of each exposure parameter comprises:
    根据每种曝光参数的生效延时时长,确定各种曝光参数的生效延时时长中的最大生效延时时长;According to the effective delay time of each exposure parameter, determine the maximum effective delay time among the effective delay time of various exposure parameters;
    根据所述最大生效延时时长以及每种曝光参数的生效延时时长,确定每种曝光参数的发送时间。The sending time of each exposure parameter is determined according to the maximum effective delay time and the effective delay time of each exposure parameter.
  3. 根据权利要求2所述的方法,其特征在于,所述每种曝光参数的发送时间与该种曝光参数的产生时间之间的时间差值,等于,所述最大生效延时时长与该种曝光参数的生效延时时长的差值。The method according to claim 2, wherein the time difference between the transmission time of each type of exposure parameter and the generation time of the type of exposure parameter is equal to the maximum effective delay time and the type of exposure The difference between the effective delay time of the parameter.
  4. 根据权利要求1-3任一项所述的方法,其特征在于,所述获取拍摄所需的至少一种曝光参数,包括:The method according to any one of claims 1 to 3, wherein the obtaining at least one exposure parameter required for shooting comprises:
    生成拍摄所需的至少一种曝光参数;或者,Generate at least one exposure parameter required for shooting; or,
    获取用户设置的拍摄所需的至少一种曝光参数。At least one exposure parameter required for shooting set by the user is acquired.
  5. 根据权利要求1-4任一项所述的方法,其特征在于,所述多个元件包括以下至少两个:图像传感器、图像信号处理器ISP、存储芯片、镜头。The method according to any one of claims 1 to 4, wherein the multiple elements include at least two of the following: an image sensor, an image signal processor ISP, a memory chip, and a lens.
  6. 根据权利要求1-5任一项所述的方法,其特征在于,所述至少一种曝光参数包括:电子快门值、模拟增益值、数字增益值。The method according to any one of claims 1-5, wherein the at least one exposure parameter includes: an electronic shutter value, an analog gain value, and a digital gain value.
  7. 根据权利要求6所述的方法,其特征在于,当所述拍摄装置的工作模式为预览模式或录像模式或拍照模式时,所述N个元件包括:图像传感器和ISP;The method according to claim 6, wherein when the working mode of the photographing device is a preview mode, a video recording mode, or a photographing mode, the N elements include: an image sensor and an ISP;
    其中,所述图像传感器所需的曝光参数包括:电子快门值、模拟增益值;Wherein, the exposure parameters required by the image sensor include: electronic shutter value and analog gain value;
    所述ISP所需的曝光参数包括:数字增益值。The exposure parameters required by the ISP include: a digital gain value.
  8. 根据权利要求7所述的方法,其特征在于,当所述拍摄装置的工作模式为录像模式时,所述N个元件还包括:存储芯片;8. The method according to claim 7, wherein when the working mode of the photographing device is a video mode, the N elements further comprise: a memory chip;
    所述存储芯片所需的曝光参数包括:数字增益值。The exposure parameters required by the memory chip include: a digital gain value.
  9. 根据权利要求8所述的方法,其特征在于,所述存储芯片包括现场可编程门阵列FPGA芯片。The method according to claim 8, wherein the memory chip comprises a field programmable gate array (FPGA) chip.
  10. 根据权利要求1-9任一项所述的方法,其特征在于,还包括:The method according to any one of claims 1-9, further comprising:
    在所述拍摄装置由预览模式向拍照模式切换时,确定镜头的光圈值;Determining the aperture value of the lens when the photographing device is switched from the preview mode to the photographing mode;
    向所述镜头发送光圈设置指令,所述光圈设置指令包括所述光圈值以及预设时间,所述光圈设置指令用于所述镜头在所述预设时间开始使用所述光圈值;Sending an aperture setting instruction to the lens, where the aperture setting instruction includes the aperture value and a preset time, and the aperture setting instruction is for the lens to start using the aperture value at the preset time;
    所述预设时间为所述拍摄装置处于拍照模式时的一时间点。The preset time is a point in time when the photographing device is in a photographing mode.
  11. 根据权利要求10所述的方法,其特征在于,还包括:The method according to claim 10, further comprising:
    在所述拍摄装置由预览模式向拍照模式切换时,确定图像传感器的机械快门值;Determining the mechanical shutter value of the image sensor when the photographing device is switched from the preview mode to the photographing mode;
    向所述图像传感器发送机械快门值设置指令,所述机械快门值设置指令包括所述机械快门值以及预设时间,所述机械快门值设置指令用于指示所述镜头在所述预设时间开始使用所述机械快门值。Send a mechanical shutter value setting instruction to the image sensor, the mechanical shutter value setting instruction includes the mechanical shutter value and a preset time, the mechanical shutter value setting instruction is used to instruct the lens to start at the preset time Use the mechanical shutter value.
  12. 根据权利要求1-11任一项所述的方法,其特征在于,所述帧同步指示包括工作模式切换指示;所述向所述拍摄装置内的多个元件发送帧同步指示,包括:The method according to any one of claims 1-11, wherein the frame synchronization instruction comprises an operation mode switching instruction; and the sending a frame synchronization instruction to multiple elements in the photographing device comprises:
    当所述拍摄装置在各工作模式之间切换时,向所述多个元件发送工作模式切换指示。When the imaging device switches between the operating modes, it sends an operating mode switching instruction to the multiple components.
  13. 根据权利要求1-12任一项所述的方法,其特征在于,所述帧同步信号是图像传感器发送的。The method according to any one of claims 1-12, wherein the frame synchronization signal is sent by an image sensor.
  14. 根据权利要求1-13任一项所述的方法,其特征在于,还包括:The method according to any one of claims 1-13, further comprising:
    当接收到录像命令时,所述录像命令用于控制所述拍摄装置进入录像模式,向存储芯片发送录像开始指令,所述录像开始指令用于指示所述存储芯片将图像帧存储至所述存储芯片外部的第一存储器中;When a video recording command is received, the video recording command is used to control the shooting device to enter the video recording mode and send a video start instruction to the storage chip, and the video start instruction is used to instruct the storage chip to store image frames in the storage In the first memory outside the chip;
    确定编码的第一个图像帧的图像帧号,并将所述图像帧号发送给所述存储芯片,以使所述存储芯片根据所述图像帧号,从所述图像帧号开始将所述第一存储器中存储的对应的图像帧依次存储至所述存储芯片外部的第二存储器中。Determine the image frame number of the first encoded image frame, and send the image frame number to the storage chip, so that the storage chip starts with the image frame number according to the image frame number The corresponding image frames stored in the first memory are sequentially stored in the second memory outside the memory chip.
  15. 根据权利要求14所述的方法,其特征在于,所述第一存储器为双倍速率DDR存储器,所述第二存储器为固态硬盘SSD。The method according to claim 14, wherein the first memory is a double-rate DDR memory, and the second memory is a solid state drive (SSD).
  16. 根据权利要求14或15所述的方法,其特征在于,所述将所述图像帧号发送给所述存储芯片,包括:The method according to claim 14 or 15, wherein the sending the image frame number to the storage chip comprises:
    通过至少一个通用输入输出GPIO接口或通用异步收发传输器UART接口,将所述图像帧号发送给所述存储芯片。The image frame number is sent to the memory chip through at least one universal input/output GPIO interface or a universal asynchronous receiver transmitter UART interface.
  17. 根据权利要求14-16任一项所述的方法,其特征在于,所述向存储芯片发送录像开始指令,包括:The method according to any one of claims 14-16, wherein the sending a video recording start instruction to a storage chip comprises:
    通过串行外设接口SPI向所述存储芯片发送所述录像开始指令。The recording start instruction is sent to the storage chip through the serial peripheral interface SPI.
  18. 根据权利要求1-17任一项所述的方法,其特征在于,所述图像帧号为绝对图像帧号或相对图像帧号。The method according to any one of claims 1-17, wherein the image frame number is an absolute image frame number or a relative image frame number.
  19. 一种拍摄装置,其特征在于,包括:机身以及除所述机身之外的多个元件,所述机身包括处理器;A photographing device, characterized by comprising: a body and a plurality of elements other than the body, the body including a processor;
    所述处理器,用于向所述多个元件发送帧同步指示,以使所述多个元件将接收到所述帧同步指示时刻对应的图像帧号置为同一初始帧号并在接收到帧同步信号时从所述同一初始帧号开始计数图像帧号;获取拍摄所需的至少一种曝光参数;根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间;在每种曝光参数的发送时间到达时,将该种曝光参数发送给所述多个元件中所需该曝光参数的N个元件,以使所述N个元件在同一图像帧号时间使用所述至少一种曝光参数,所述N为大于等于2的整数。The processor is configured to send a frame synchronization instruction to the multiple elements, so that the multiple elements set the image frame numbers corresponding to the moments when the frame synchronization instructions are received to the same initial frame number, and when the frame is received When synchronizing the signal, start counting the image frame number from the same initial frame number; obtain at least one exposure parameter required for shooting; determine the transmission time of each exposure parameter according to the effective delay time of each exposure parameter; When the transmission time of the exposure parameter arrives, the exposure parameter is sent to the N elements of the plurality of elements that require the exposure parameter, so that the N elements use the at least one at the same image frame number time Exposure parameter, the N is an integer greater than or equal to 2.
  20. 根据权利要求19所述的拍摄装置,其特征在于,所述处理器在根据每种曝光参数的生效延时时长,确定每种曝光参数的发送时间时,具体用于:The photographing device according to claim 19, wherein the processor is specifically configured to: when determining the transmission time of each exposure parameter according to the effective delay time of each exposure parameter:
    根据每种曝光参数的生效延时时长,确定各种曝光参数的生效延时时长中的最大生效延时时长;According to the effective delay time of each exposure parameter, determine the maximum effective delay time among the effective delay time of various exposure parameters;
    根据所述最大生效延时时长以及每种曝光参数的生效延时时长,确定每种曝光参数的发送时间。The sending time of each exposure parameter is determined according to the maximum effective delay time and the effective delay time of each exposure parameter.
  21. 根据权利要求20所述的拍摄装置,其特征在于,所述每种曝光参数的发送时间与该种曝光参数的产生时间之间的时间差值,等于,所述最大生效延时时长与该种曝光参数的生效延时时长的差值。The photographing device according to claim 20, wherein the time difference between the transmission time of each type of exposure parameter and the generation time of the type of exposure parameter is equal to the difference between the maximum effective delay time and the type of exposure parameter. The difference between the effective delay time of the exposure parameter.
  22. 根据权利要求19-21任一项所述的拍摄装置,其特征在于,所述处理器在获取拍摄所需的至少一种曝光参数时,具体用于:生成拍摄所需的至少一种曝光参数;或者,获取用户设置的拍摄所需的至少一种曝光参数。The photographing device according to any one of claims 19-21, wherein when the processor obtains at least one exposure parameter required for photographing, it is specifically configured to: generate at least one exposure parameter required for photographing Or, obtain at least one exposure parameter set by the user and required for shooting.
  23. 根据权利要求19-22任一项所述的拍摄装置,其特征在于,所述多个元件包括以下至少两个:图像传感器、图像信号处理器ISP、存储芯片、镜头。The photographing device according to any one of claims 19-22, wherein the multiple elements include at least two of the following: an image sensor, an image signal processor ISP, a memory chip, and a lens.
  24. 根据权利要求19-23任一项所述的拍摄装置,其特征在于,所述至少一种曝光参数包括:电子快门值、模拟增益值、数字增益值。The photographing device according to any one of claims 19-23, wherein the at least one exposure parameter comprises: an electronic shutter value, an analog gain value, and a digital gain value.
  25. 根据权利要求24所述的拍摄装置,其特征在于,当所述拍摄装置的工作模式为预览模式或录像模式或拍照模式时,所述N个元件包括:图像传感器和图像信号处理器ISP;The photographing device according to claim 24, wherein when the working mode of the photographing device is a preview mode, a video recording mode, or a photographing mode, the N elements include: an image sensor and an image signal processor ISP;
    其中,所述图像传感器所需的曝光参数包括:电子快门值、模拟增益值;Wherein, the exposure parameters required by the image sensor include: electronic shutter value and analog gain value;
    所述ISP所需的曝光参数包括:数字增益值。The exposure parameters required by the ISP include: a digital gain value.
  26. 根据权利要求25所述的拍摄装置,其特征在于,当所述拍摄装置的工作模式为录像模式时,所述N个元件还包括:存储芯片;The photographing device according to claim 25, wherein when the working mode of the photographing device is a video recording mode, the N elements further comprise: a memory chip;
    所述存储芯片所需的曝光参数包括:数字增益值。The exposure parameters required by the memory chip include: a digital gain value.
  27. 根据权利要求26所述的拍摄装置,其特征在于,所述存储芯片包括现场可编程门阵列FPGA芯片。The photographing device according to claim 26, wherein the memory chip comprises a field programmable gate array (FPGA) chip.
  28. 根据权利要求20-26任一项所述的拍摄装置,其特征在于,The photographing device according to any one of claims 20-26, wherein:
    所述处理器,还用于:The processor is also used for:
    在所述拍摄装置由预览模式向拍照模式切换时,确定镜头的光圈值;Determining the aperture value of the lens when the photographing device is switched from the preview mode to the photographing mode;
    向所述镜头发送光圈设置指令,所述光圈设置指令包括所述光圈值以及预设时间,所述光圈设置指令用于所述镜头在所述预设时间开始使用所述光圈值;Sending an aperture setting instruction to the lens, where the aperture setting instruction includes the aperture value and a preset time, and the aperture setting instruction is for the lens to start using the aperture value at the preset time;
    所述镜头,用于在所述预设时间开始使用所述光圈值The lens is used to start using the aperture value at the preset time
    所述预设时间为所述拍摄装置处于拍照模式时的一时间点。The preset time is a point in time when the photographing device is in a photographing mode.
  29. 根据权利要求28所述的拍摄装置,其特征在于,所述处理器,还用 于:The photographing device according to claim 28, wherein the processor is further used for:
    在所述拍摄装置由预览模式向拍照模式切换时,确定图像传感器的机械快门值;Determining the mechanical shutter value of the image sensor when the photographing device is switched from the preview mode to the photographing mode;
    向所述图像传感器发送机械快门值设置指令,所述机械快门值设置指令包括所述机械快门值以及预设时间,所述机械快门值设置指令用于指示所述图像传感器在所述预设时间开始使用所述机械快门值;Send a mechanical shutter value setting instruction to the image sensor, where the mechanical shutter value setting instruction includes the mechanical shutter value and a preset time, and the mechanical shutter value setting instruction is used to instruct the image sensor to set at the preset time Start to use the mechanical shutter value;
    所述图像传感器,用于在所述预设时间开始使用所述机械快门值。The image sensor is configured to start using the mechanical shutter value at the preset time.
  30. 根据权利要求19-29任一项所述的拍摄装置,其特征在于,所述帧同步指示包括工作模式切换指示;所述处理器在向所述拍摄装置内的多个元件发送帧同步指示时,具体用于:The photographing device according to any one of claims 19-29, wherein the frame synchronization instruction comprises a work mode switching instruction; when the processor sends a frame synchronization instruction to multiple elements in the photographing device , Specifically used for:
    当所述拍摄装置在各工作模式之间切换时,向所述多个元件发送工作模式切换指示。When the imaging device switches between the operating modes, it sends an operating mode switching instruction to the multiple components.
  31. 根据权利要求19-30任一项所述的拍摄装置,其特征在于,所述帧同步信号是图像传感器发送的。The photographing device according to any one of claims 19-30, wherein the frame synchronization signal is sent by an image sensor.
  32. 根据权利要求19-31任一项所述的拍摄装置,其特征在于,所述处理器,还用于:当接收到录像命令时,所述录像命令用于控制所述拍摄装置进入录像模式,向存储芯片发送录像开始指令,所述录像开始指令用于指示所述存储芯片将图像帧存储至所述存储芯片外部的第一存储器中;确定编码的第一个图像帧的图像帧号,并将所述图像帧号发送给所述存储芯片;The photographing device according to any one of claims 19-31, wherein the processor is further configured to: when a recording command is received, the recording command is used to control the photographing device to enter a recording mode, Send a recording start instruction to the storage chip, the recording start instruction is used to instruct the storage chip to store the image frame in the first memory outside the storage chip; determine the image frame number of the first image frame to be encoded, and Sending the image frame number to the storage chip;
    所述存储芯片,用于将图像帧存储至所述存储芯片外部的第一存储器中,以及根据所述图像帧号,从所述图像帧号开始将所述第一存储器中存储的对应的图像帧依次存储至所述存储芯片外部的第二存储器中。The memory chip is configured to store image frames in a first memory outside the memory chip, and according to the image frame number, start from the image frame number and store the corresponding images stored in the first memory The frames are sequentially stored in the second memory outside the memory chip.
  33. 根据权利要求32所述的拍摄装置,其特征在于,所述第一存储器为双倍速率DDR存储器,所述第二存储器为固态硬盘SSD。The photographing device according to claim 32, wherein the first memory is a double-rate DDR memory, and the second memory is a solid state drive (SSD).
  34. 根据权利要求32或33所述的拍摄装置,其特征在于,所述机身与所述存储芯片通过至少一个通用输入输出GPIO接口或通用异步收发传输器UART接口通信连接,所述处理器在将所述图像帧号发送给所述存储芯片时,具体用于:The photographing device according to claim 32 or 33, wherein the body and the memory chip are communicatively connected through at least one universal input/output GPIO interface or a universal asynchronous receiver transmitter UART interface, and the processor is connecting When the image frame number is sent to the storage chip, it is specifically used for:
    通过至少一个GPIO接口或UART接口,将所述图像帧号发送给所述存储芯片。The image frame number is sent to the storage chip through at least one GPIO interface or UART interface.
  35. 根据权利要求32-34任一项所述的拍摄装置,其特征在于,所述机身与所述存储芯片通过串行外设接口SPI通信连接;The photographing device according to any one of claims 32-34, wherein the body and the memory chip are communicatively connected through a serial peripheral interface SPI;
    所述处理器在向存储芯片发送录像开始指令时,具体用于:通过SPI向所述存储芯片发送所述录像开始指令。When the processor sends a video recording start instruction to the storage chip, it is specifically configured to: send the video recording start instruction to the storage chip via SPI.
  36. 根据权利要求19-35任一项所述的拍摄装置,其特征在于,所述图像帧号为绝对图像帧号或相对图像帧号。The photographing device according to any one of claims 19-35, wherein the image frame number is an absolute image frame number or a relative image frame number.
  37. 一种可移动平台,其特征在于,包括可移动平台的机身和如权利要求19-36任一项所述的拍摄装置,所述拍摄装置搭载于所述可移动平台的机身上。A movable platform, characterized by comprising a body of the movable platform and the photographing device according to any one of claims 19-36, the photographing device being mounted on the body of the movable platform.
  38. 一种可读存储介质,其特征在于,所述可读存储介质上存储有计算机程序;所述计算机程序在被执行时,实现如权利要求1-18任一项所述的参数同步方法。A readable storage medium, wherein a computer program is stored on the readable storage medium; when the computer program is executed, the parameter synchronization method according to any one of claims 1-18 is realized.
PCT/CN2019/077859 2019-03-12 2019-03-12 Parameter synchronization method, image capture apparatus, and movable platform WO2020181494A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980005567.9A CN111345033A (en) 2019-03-12 2019-03-12 Parameter synchronization method, shooting device and movable platform
PCT/CN2019/077859 WO2020181494A1 (en) 2019-03-12 2019-03-12 Parameter synchronization method, image capture apparatus, and movable platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/077859 WO2020181494A1 (en) 2019-03-12 2019-03-12 Parameter synchronization method, image capture apparatus, and movable platform

Publications (1)

Publication Number Publication Date
WO2020181494A1 true WO2020181494A1 (en) 2020-09-17

Family

ID=71187739

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/077859 WO2020181494A1 (en) 2019-03-12 2019-03-12 Parameter synchronization method, image capture apparatus, and movable platform

Country Status (2)

Country Link
CN (1) CN111345033A (en)
WO (1) WO2020181494A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115988317A (en) * 2022-12-12 2023-04-18 Oppo广东移动通信有限公司 Image processing method, image processing device, image processing chip, communication device, and storage medium

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112532890B (en) * 2020-11-02 2022-06-07 浙江大华技术股份有限公司 Exposure control method, image pickup apparatus, and computer-readable storage medium
WO2022120827A1 (en) * 2020-12-11 2022-06-16 深圳市大疆创新科技有限公司 Exposure adjustment method, photographing device, movable platform, and storage medium
CN113676673B (en) * 2021-08-10 2023-06-16 广州极飞科技股份有限公司 Image acquisition method, image acquisition system and unmanned equipment
CN114363478B (en) * 2022-01-04 2023-11-10 平头哥(上海)半导体技术有限公司 Signal processing unit, method, acceleration unit, electronic device, and system-on-chip
CN115278052A (en) * 2022-06-22 2022-11-01 展讯通信(上海)有限公司 Image processing method and device, electronic equipment and computer readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030133018A1 (en) * 2002-01-16 2003-07-17 Ted Ziemkowski System for near-simultaneous capture of multiple camera images
CN102427509A (en) * 2011-09-16 2012-04-25 杭州海康威视数字技术股份有限公司 Device and method for controlling synchronization camera with light supplementing lamp
CN104412585A (en) * 2013-07-05 2015-03-11 联发科技股份有限公司 Synchronization controller for multi-sensor camera device and related synchronization method
CN108419017A (en) * 2018-04-28 2018-08-17 Oppo广东移动通信有限公司 Control method, apparatus, electronic equipment and the computer readable storage medium of shooting

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100370354C (en) * 2003-11-28 2008-02-20 北京中星微电子有限公司 Automatic focusing control circuit for eliminating exposure flicker under lighting lamp
US7437063B2 (en) * 2006-04-07 2008-10-14 Lab Partners Associates, Inc. Wireless camera flash synchronizer system and method
CN1968230A (en) * 2006-06-27 2007-05-23 华为技术有限公司 Signal processing apparatus and synchronization method
CA2752169A1 (en) * 2009-02-12 2010-08-19 Lab Partners Associates, Inc. Early photographic synchronization system and method
US8768158B2 (en) * 2010-02-01 2014-07-01 Canon Kabushiki Kaisha Image pickup apparatus, flash apparatus, and camera system
KR101953614B1 (en) * 2012-10-12 2019-05-22 삼성전자주식회사 Apparatus and method for processing a image of camera device and terminal equipment having a camera
TWI477123B (en) * 2013-01-15 2015-03-11 Univ Nat Chiao Tung Multifunctional control device for illumination
KR102124598B1 (en) * 2013-09-30 2020-06-19 삼성전자주식회사 Image acquisition method and apparatus
US10721420B2 (en) * 2015-06-02 2020-07-21 Intel Corporation Method and system of adaptable exposure control and light projection for cameras
CN107277385B (en) * 2017-06-12 2020-04-17 深圳市瑞立视多媒体科技有限公司 Multi-camera system synchronous exposure control method and device and terminal equipment
CN108781259B (en) * 2017-07-31 2021-04-16 深圳市大疆创新科技有限公司 Image shooting control method, control device and control system
CN109089013A (en) * 2018-09-21 2018-12-25 中兴新通讯有限公司 A kind of multiple light courcess detection image acquisition methods and Machine Vision Inspecting System

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030133018A1 (en) * 2002-01-16 2003-07-17 Ted Ziemkowski System for near-simultaneous capture of multiple camera images
CN102427509A (en) * 2011-09-16 2012-04-25 杭州海康威视数字技术股份有限公司 Device and method for controlling synchronization camera with light supplementing lamp
CN104412585A (en) * 2013-07-05 2015-03-11 联发科技股份有限公司 Synchronization controller for multi-sensor camera device and related synchronization method
CN108419017A (en) * 2018-04-28 2018-08-17 Oppo广东移动通信有限公司 Control method, apparatus, electronic equipment and the computer readable storage medium of shooting

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115988317A (en) * 2022-12-12 2023-04-18 Oppo广东移动通信有限公司 Image processing method, image processing device, image processing chip, communication device, and storage medium

Also Published As

Publication number Publication date
CN111345033A (en) 2020-06-26

Similar Documents

Publication Publication Date Title
WO2020181494A1 (en) Parameter synchronization method, image capture apparatus, and movable platform
WO2021078270A1 (en) Detachable/replaceable gimbal camera, aerial vehicle, system, and gimbal detachment/replacement method
US20190291864A1 (en) Transformable apparatus
CN107079102B (en) Focusing method, photographic device and unmanned plane
WO2018064831A1 (en) Tripod head, unmanned aerial vehicle and control method therefor
JP6785412B2 (en) Unmanned aerial vehicle system
WO2018035764A1 (en) Method for taking wide-angle pictures, device, cradle heads, unmanned aerial vehicle and robot
US20190199909A1 (en) Positioning apparatus for photographic and video imaging and recording and system utilizing the same
CN108780321B (en) Method, device, system, and computer-readable storage medium for device pose adjustment
CN108924520B (en) Transmission control method, device, controller, shooting equipment and aircraft
WO2019061295A1 (en) Video processing method and device, unmanned aerial vehicle and system
WO2019227289A1 (en) Time-lapse photography control method and device
WO2020172800A1 (en) Patrol control method for movable platform, and movable platform
WO2018163571A1 (en) Information-processing device, information-processing method, and information-processing program
WO2020006650A1 (en) Image camera, handheld cradle head and movable platform
WO2018191971A1 (en) Cradle head control method and cradle head
WO2021168821A1 (en) Mobile platform control method and device
JP6910785B2 (en) Mobile imager and its control method, as well as imager and its control method, unmanned aerial vehicle, program, storage medium
WO2021217371A1 (en) Control method and apparatus for movable platform
JP2017112438A (en) Imaging system and control method therefor, communication device, mobile imaging device, program
WO2020168519A1 (en) Camera parameter adjusting method, camera device, and movable platform
CN112585936B (en) Control method, photographing apparatus, lens, movable platform, and computer readable medium
WO2019134124A1 (en) Control method, unmanned aerial vehicle, remote control device, and nonvolatile storage medium
WO2022061934A1 (en) Image processing method and device, system, platform, and computer readable storage medium
WO2022109860A1 (en) Target object tracking method and gimbal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19919307

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19919307

Country of ref document: EP

Kind code of ref document: A1