WO2022016340A1 - 确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质 - Google Patents

确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质 Download PDF

Info

Publication number
WO2022016340A1
WO2022016340A1 PCT/CN2020/103120 CN2020103120W WO2022016340A1 WO 2022016340 A1 WO2022016340 A1 WO 2022016340A1 CN 2020103120 W CN2020103120 W CN 2020103120W WO 2022016340 A1 WO2022016340 A1 WO 2022016340A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera device
moment
movable platform
main camera
surrounding environment
Prior art date
Application number
PCT/CN2020/103120
Other languages
English (en)
French (fr)
Inventor
马宁
陈颖
胡涛
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202080005980.8A priority Critical patent/CN113016175A/zh
Priority to PCT/CN2020/103120 priority patent/WO2022016340A1/zh
Publication of WO2022016340A1 publication Critical patent/WO2022016340A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00—Diagnosis, testing or measuring for television systems or their details
    • H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/71—Circuitry for evaluating the brightness variation

Definitions

  • the present application relates to the technical field of photographic exposure, and in particular, to a method, system, movable platform and storage medium for determining exposure parameters of a main camera device.
  • the camera device When the camera device performs automatic exposure (AE, Automatic Exposure) according to the traditional exposure control strategy, the image is acquired under the current exposure parameters and the brightness is analyzed.
  • AE Automatic Exposure
  • the shutter time, aperture value, and ISO value can be reduced.
  • underexposure you can increase the shutter time, increase the aperture value, and increase the ISO value.
  • the automatic exposure of the traditional exposure control strategy includes the process of measuring, adjusting the exposure parameters, taking effect of the exposure parameters, and then continuing to measure and continue to adjust. The convergence of the AE parameters takes a period of time.
  • the flying drone competition is an emerging racing sport in recent years.
  • the first-person perspective (FPV, First Person View) camera device mounted on the flying drone follows the flying of the flying drone at high speed, and the attitude changes drastically.
  • the image transmission module of the traversing aircraft transmits the FPV video obtained by the FPV camera back to the pilot's glasses, and the pilot watches the FPV video of the traversing aircraft through the glasses and controls the traversing aircraft through the remote control.
  • the traditional automatic exposure system has a lag, response and control delay, which is easy to cause overexposure or underexposure , so that the pilot can't see the FPV screen clearly for a short time, which is easy to cause the bombing problem.
  • the present application provides a method, system, movable platform and storage medium for determining exposure parameters of a main camera device.
  • the application provides a method for determining exposure parameters of a main camera device, the main camera device is mounted on a movable platform, and the movable platform is also equipped with an auxiliary light metering device, and the method includes:
  • an exposure parameter of the main camera device at the second moment is determined.
  • the present application also provides a system for determining exposure parameters of a main camera device, the system is suitable for a movable platform, and the system includes: a main camera device, an auxiliary light metering device, a memory and a processor;
  • the memory is used to store computer programs
  • the processor is configured to execute the computer program and implement the following steps when executing the computer program:
  • an exposure parameter of the main camera device at the second moment is determined.
  • the present application also provides a movable platform, the movable platform includes the system for determining the exposure parameters of the main camera device as described above.
  • the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor enables the processor to realize the above-mentioned determination of the main A method of camera exposure parameters.
  • the embodiments of the present application provide a method, a system, a movable platform and a storage medium for determining exposure parameters of a main camera device.
  • An auxiliary light metering device is used to establish a local brightness map of the surrounding environment of the movable platform; motion information at one moment; predicting the position of the movable platform at a second moment based on the motion information; determining the position of the main camera at the second moment based on the local brightness map and the position at the second moment Exposure parameters at the second moment.
  • the position of the movable platform at the second moment is predicted based on the motion information of the movable platform at the first moment, so that the position corresponding to the position of the movable platform at the second moment can be predicted. brightness information, and then determine the exposure parameters of the main camera at the second moment. In this way, the exposure parameters of the main camera at the second moment can be automatically and quickly determined in advance, so that the main camera can respond and control more quickly. And better avoid overexposure or underexposure.
  • FIG. 1 is a schematic flowchart of an embodiment of a method for determining exposure parameters of a main camera device of the present application
  • FIG. 2 is a schematic flowchart of another embodiment of a method for determining exposure parameters of a main camera device of the present application
  • FIG. 3 is a schematic flowchart of another embodiment of a method for determining exposure parameters of a main camera device of the present application
  • FIG. 4 is a schematic flowchart of another embodiment of a method for determining exposure parameters of a main camera device of the present application
  • FIG. 5 is a schematic flowchart of another embodiment of a method for determining exposure parameters of a main camera device of the present application
  • FIG. 6 is a schematic flowchart of another embodiment of a method for determining exposure parameters of a main camera device of the present application
  • FIG. 7 is a schematic structural diagram of an embodiment of a system for determining exposure parameters of a main camera device of the present application.
  • the automatic exposure (AE, Automatic Exposure) of the camera is actually a process of adjusting the aperture, shutter and ISO values (ie exposure parameters) according to the brightness information of the surrounding environment measured by the camera.
  • the APEX exposure equation is as follows:
  • a V is the aperture value (aperture value)
  • T V is a time value (time value)
  • S V is a speed value (rate value)
  • B V is the luminance value (luminance value)
  • N is a constant.
  • APEX SYSTEM It can be seen from the above formula that, for the camera device, the parameters that control its exposure include aperture, shutter, and ISO.
  • the adjustment of aperture, shutter, and ISO is inseparable from the measurement of brightness.
  • the camera device performs automatic exposure, it analyzes the brightness of the image obtained under the current exposure parameters.
  • the shutter time and aperture can be reduced. value, reduce the ISO value, and when there is underexposure, it is adjusted by increasing the shutter time, increasing the aperture value, and increasing the ISO value; so the traditional automatic exposure will measure, adjust the exposure parameters, the exposure parameters will take effect, and then Continuing the process of measurement and adjustment, the convergence of AE parameters requires a process.
  • the first-person view (FPV, First Person View) camera device mounted on the flying drone follows the high-speed flight of the flying drone, and the attitude changes drastically.
  • the traditional automatic exposure system has a lag, response and control delay, which is easy to cause overexposure or underexposure, so that the pilot cannot see the FPV picture in a short time, which is easy to cause the problem of bombing.
  • the applicable application scenario of the embodiment of the present application may be the AE exposure strategy of the FPV camera device in the UAV product; especially the AE exposure strategy of the FPV camera device in the application scenario of high flight speed and fast attitude change such as the traversing aircraft.
  • Climbing machine competition is an emerging racing sport in recent years. Compared with ordinary aerial photography machines, the most obvious difference is that its maximum speed and acceleration are much larger than ordinary aerial photography machines. The acceleration time from standstill to 100km/h is less than 2s.
  • the way that the pilot of the T-travel plane controls the plane is: the image transmission module on the plane-travel plane transmits the fpv video obtained by the camera device on the plane-travel plane to the glasses, and the pilot watches the fpv video of the plane-traverse plane through the glasses, and then passes the fpv video of the plane-travel plane through the glasses.
  • a visual camera can be used on the flying machine, and the visual camera is used to assist in light metering. Combined with the current moving parameters of the flying machine, the corresponding ambient light brightness (or the corresponding ambient light brightness of the next frame of exposure of the FPV camera device after the moving flying machine is calculated) is calculated in advance.
  • the exposure of the next N frames is limited by the computing power, the smaller the N, the better), so as to calculate and configure the exposure parameters of the next frame in advance, so that the FPV camera can respond and control more quickly, and better avoid excessive exposure. overexposed or underexposed.
  • an auxiliary light metering device is used to establish a local brightness map of the surrounding environment of the movable platform; obtain the motion information of the movable platform at the first moment; based on the motion information, predict the movable platform at the second moment the position of ; determining the exposure parameter of the main camera device at the second moment based on the local brightness map and the position at the second moment. Since the local brightness map of the surrounding environment of the movable platform is established through the auxiliary light metering device, the position of the movable platform at the second moment is predicted based on the motion information of the movable platform at the first moment, so that the position corresponding to the position of the movable platform at the second moment can be predicted.
  • the exposure parameters of the main camera at the second moment can be automatically and quickly determined in advance, so that the main camera can respond and control more quickly. And better avoid overexposure or underexposure.
  • FIG. 1 is a schematic flowchart of an embodiment of a method for determining exposure parameters of a main camera device in the present application.
  • the main camera device is mounted on a movable platform, and the movable platform is also equipped with an auxiliary light metering device.
  • the movable platform may refer to various platforms that can move automatically or under controlled conditions, such as: drones, vehicles, unmanned vehicles, ground robots, unmanned ships, and so on.
  • the method includes: step S101, step S102, step S103 and step S104.
  • Step S101 Establish a local brightness map of the surrounding environment of the movable platform through the auxiliary light metering device.
  • the auxiliary light metering device may be a device capable of realizing automatic light metering in a changing environment.
  • the auxiliary photometric device may be an independent device dedicated to photometry, or may be a device including a photometric system, for example, the camera device itself includes a photometric system.
  • the local brightness map may be a map with location information and brightness information corresponding to the location information, and the corresponding brightness information can be found through the location information. Based on the number and location of auxiliary light metering devices, the local brightness map can be a brightness map within a certain distance range of 360° around the movable platform, or a brightness map within a certain angle range around the movable platform, such as forward or Forward plus sideways etc.
  • a local brightness map of the surrounding environment of the movable platform is established by the auxiliary light metering device.
  • the local brightness of the surrounding environment of the movable platform is determined according to the local brightness of the surrounding environment of the movable platform. map, you can obtain the brightness information corresponding to the location information.
  • Step S102 Obtain motion information of the movable platform at the first moment.
  • the position of the movable platform is changing and moving.
  • the motion information of the movable platform includes, but is not limited to, at least one of velocity information, acceleration information, angular velocity information, and angular acceleration information. If the movable platform includes an unmanned aerial vehicle, the motion information of the movable platform further includes at least one of attitude information and stick amount information of the joystick of the remote control.
  • the first moment is the moment before the subsequent position of the movable platform is predicted.
  • control system on the movable platform to realize real-time control of the movable platform.
  • the control system is provided with a measuring instrument that measures its own motion information to collect the motion information of the movable platform in real time, such as: radar , inertial measurement units, gyroscopes, accelerometers, and more. Therefore, the motion information of the movable platform at the first moment can be obtained by the measurement of these measuring instruments.
  • Step S103 Predict the position of the movable platform at the second moment based on the motion information of the movable platform at the first moment.
  • Step S104 Determine the exposure parameter of the main camera device at the second moment based on the local brightness map and the position at the second moment.
  • the brightness information corresponding to the position at the second moment can be determined, and the main camera device can be determined according to the brightness information corresponding to the position at the second moment exposure parameters at the second time instant.
  • the image corresponding to the exposure parameters of the main camera at the first moment is called the current frame image
  • the image corresponding to the exposure parameters of the main camera at the second moment may be the image of the current frame.
  • the next frame of images may also be the next N frames of images of the current frame of images, where N is greater than or equal to 2.
  • N is greater than or equal to 2.
  • the smaller N is, the better, and N is constrained by computing power.
  • an auxiliary light metering device is used to establish a local brightness map of the surrounding environment of the movable platform; obtain the motion information of the movable platform at the first moment; based on the motion information, predict the movable platform at the second moment the position of ; determining the exposure parameter of the main camera device at the second moment based on the local brightness map and the position at the second moment. Since the local brightness map of the surrounding environment of the movable platform is established through the auxiliary light metering device, the position of the movable platform at the second moment is predicted based on the motion information of the movable platform at the first moment, so that the position corresponding to the position of the movable platform at the second moment can be predicted.
  • the exposure parameters of the main camera at the second moment can be automatically and quickly determined in advance, so that the main camera can respond and control more quickly. And better avoid overexposure or underexposure.
  • the auxiliary light metering device is used in step S101, Establishing a local brightness map of the surrounding environment of the movable platform may include: establishing a local brightness map of the surrounding environment centered on the movable platform through the auxiliary light metering device.
  • the auxiliary light metering device includes a visual camera device.
  • a low-cost visual camera device is often used for obstacle avoidance on the movable platform.
  • the visual camera device is also used as an auxiliary light metering device, which can further save costs.
  • the field of view of the visual camera device is larger than the field of view of the main camera device, and the shooting range of the main camera device is within the shooting range of the visual camera device, which can be predicted to be more accurate.
  • the brightness information corresponding to the position of the movable platform at the second moment can be obtained, so that a more accurate exposure parameter of the main camera device at the second moment can be predicted.
  • establishing a local brightness map of the surrounding environment centered on the movable platform by using the auxiliary light metering device may further include: establishing, through the visual camera device, establishing a local brightness map centered on the movable platform A local brightness map of the surrounding environment in the center, the local brightness map including the position information of a plurality of photographed objects in the surrounding environment with the movable platform as the center and the environmental brightness information of each photographed object.
  • step S101 establishing a local brightness map of the surrounding environment centered on the movable platform by using the visual camera device may further include: sub-step S101A1 and sub-step S101A2 .
  • Sub-step S101A1 Obtain depth information of a plurality of photographed objects in a surrounding environment centered on the movable platform by the visual camera device, and further obtain position information of a plurality of the photographed objects.
  • Sub-step S101A2 Measure and obtain ambient brightness information of each of the photographed objects through the auxiliary light metering device.
  • the visual camera device can be used for distance measurement, and the depth information of multiple photographed objects in the surrounding environment is also the distance and distance information of the multiple photographed objects in the surrounding environment from the visual camera device; according to the movable platform as the center of the surrounding area
  • the depth information of multiple photographed objects in the environment, combined with the current position of the movable platform, can obtain the position information of multiple photographed objects; through the auxiliary light metering device (which can be a separate auxiliary light metering device) , or a camera device including a photometric system) can measure and obtain the ambient brightness information of each of the photographed objects. In this way, a local brightness map of the surrounding environment centered on the movable platform can be obtained simply and quickly.
  • obtaining depth information of a plurality of photographed objects in the surrounding environment centered on the movable platform by the visual camera device in sub-step S101A1 may further include: sub-step S101A11 and sub-step S101A12.
  • Sub-step S101A11 Generate a partial panoramic image or a panoramic image centered on the movable platform by the visual camera device.
  • the processing speed can only generate a partial panoramic image in a certain range around the movable platform.
  • Sub-step S101A12 Divide the partial panoramic image or the panoramic image into a plurality of grid images, and calculate and obtain a plurality of grid images corresponding to the plurality of grid images in the surrounding environment centered on the movable platform. Describe the depth information of the subject.
  • the partial panoramic image or the panoramic image is divided into a plurality of grid images, so that each grid image can be easily calculated to obtain each grid image corresponding to each grid image in the surrounding environment centered on the movable platform.
  • the depth information of each of the photographed objects can be obtained, and then the position information of each of the photographed objects corresponding to each grid image can be obtained, so that the brightness information of each of the photographed objects can be obtained according to the local brightness map.
  • the size of the grid image is not limited. The smaller the grid image, the greater the number of grid images, the higher the computing power requirements, the more time required for calculation; the larger the grid image, the less the number of grid images, the lower the computing power requirements, The calculation takes less time; the size of the grid image can be determined according to the specific practical application requirements.
  • the range of the local brightness map is related to the range of the surrounding environment of the main camera device. If the range of the surrounding environment of the main camera device is not predetermined, then in step S101, the visual camera device is used to Establishing a local brightness map of the surrounding environment centered on the movable platform may further include: sub-step S101B1 and sub-step S101B2.
  • Sub-step S101B1 Determine a predetermined range of the surrounding environment of the main camera device.
  • Sub-step S101B2 Using the visual camera device, establish a local brightness map with the movable platform as the center and a predetermined range of the surrounding environment of the main camera device.
  • the determining of the predetermined range of the surrounding environment of the main camera device in sub-step S101B1 may include: determining the predetermined range of the surrounding environment of the main camera device according to the field of view of the main camera device .
  • the angle of view of the main camera device can determine the shooting range, so according to the angle of view of the main camera device, a predetermined range of the surrounding environment of the main camera device is determined.
  • determining the predetermined range of the surrounding environment of the main camera device according to the field of view of the main camera device may further include: according to the field of view of the main camera device and the movable platform The mobility index value is determined to determine the predetermined range of the surrounding environment of the main camera device.
  • the mobility index value of the movable platform can be the index value of the ability of the movable platform to change the movement speed, flight altitude (such as drone) and movement direction within a certain period of time, which can be divided into speed and mobility index accordingly. value, high maneuverability indicator value (e.g. drone), and directional maneuverability indicator value.
  • high maneuverability indicator value e.g. drone
  • directional maneuverability indicator value e.g. the shorter the time it takes for the movable platform to change a certain speed, altitude or direction.
  • the higher the mobility index value of the movable platform the better the mobility of the movable platform.
  • the predetermined range of the surrounding environment of the main camera device needs to be larger.
  • the frequency of establishing a local brightness map of the surrounding environment of the movable platform may include: passing the auxiliary light at a predetermined frequency.
  • a photometric device for establishing a local brightness map of the surrounding environment of the movable platform may include: passing the auxiliary light at a predetermined frequency.
  • the predetermined frequency may be determined according to the performance index values of the main camera device and the auxiliary light metering device, and the computing capability of the movable platform. the predetermined frequency.
  • the predetermined frequency can be determined according to the specific hardware configuration and actual application requirements.
  • step S104 The details of step S104 will be described in detail below.
  • the traditional original exposure control strategy may also be considered to fuse the two strategies, so as to avoid the AE control problem caused by inaccurate calculation; the two strategies
  • the magnitude of the effect on the final AE can be dynamically adjusted.
  • determining the exposure parameter of the main camera device at the second moment based on the local brightness map and the position at the second moment may include: based on the local brightness map , the position at the second moment and the original exposure control strategy of the main camera device to determine the exposure parameters of the main camera device at the second moment.
  • the exposure parameters of the main camera device at the second moment may be determined mainly based on the ambient brightness corresponding to the predicted position at the second moment. Referring to FIG. 5 , in step S104, the exposure parameters of the main camera device at the second moment are determined based on the local brightness map, the position at the second moment, and the original exposure control strategy of the main camera device, It may include: sub-step S104A1, sub-step S104A2 and sub-step S104A3.
  • Sub-step S104A1 Based on the local brightness map and the position at the second moment, determine the ambient brightness corresponding to the position at the second moment.
  • Sub-step S104A2 If the change of the ambient brightness corresponding to the position at the second moment is less than a brightness threshold, determine the exposure parameters of the main camera device at the second moment based on the original exposure control strategy.
  • Sub-step S104A3 If the change of the ambient brightness corresponding to the position at the second moment is greater than the brightness threshold, determine the brightness of the main camera at the second moment based on the ambient brightness corresponding to the position at the second moment. exposure parameters.
  • the brightness threshold can be determined according to specific application requirements. If the change of the ambient brightness corresponding to the position at the second moment is less than the brightness threshold, it can be shown that the brightness of the surrounding environment of the main camera device does not change much, and the original exposure control strategy can be used to determine the main camera. Exposure parameters of the device at the second time instant. If the change of the ambient brightness corresponding to the position at the second moment is greater than the brightness threshold, it can be shown that the brightness of the surrounding environment of the main camera device has a large variation, and the ambient brightness corresponding to the position at the second moment can be used as the main Determine the exposure parameters of the main camera device at the second moment.
  • the exposure parameter of the main camera device at the second moment may be determined mainly based on the ambient brightness corresponding to the position at the second moment.
  • the exposure parameters of the main camera device at the second moment are determined based on the local brightness map, the position at the second moment, and the original exposure control strategy of the main camera device, It may include: sub-step S104B1, sub-step S104B2 and sub-step S104B3.
  • Sub-step S104B1 Based on the local brightness map and the position at the second moment, determine the ambient brightness corresponding to the position at the second moment.
  • Sub-step S104B2 If the movable platform does not perform a large maneuvering movement, then determine the exposure parameters of the main camera device at the second moment based on the original exposure control strategy, and the large maneuvering movement refers to a unit of A motorized movement in which the range of movement state changes in time exceeds the maximum threshold.
  • Sub-step S104B3 If the movable platform performs a large maneuvering movement, the exposure parameter of the main camera device at the second moment is determined based on the ambient brightness corresponding to the position at the second moment.
  • the maximum threshold may be the threshold at which the change (or amount of change) of the movement state per unit time will reach the threshold of large maneuvering movement.
  • the large maneuvering movement refers to a maneuvering movement in which the range of the movement state change per unit time exceeds the maximum threshold, and no large maneuvering movement is performed because the range of the movement state change per unit time does not exceed the maximum threshold. If the movable platform does not perform large maneuvering movements, it may indicate that the brightness of the surrounding environment of the main camera device does not change much. Exposure parameters at the moment. If the movable platform performs a large maneuvering movement, it may indicate that the brightness of the surrounding environment of the main camera device changes greatly. Exposure parameters at the second moment.
  • step S104 determining the exposure parameters of the main camera device at the second moment based on the local brightness map, the position at the second moment, and the original exposure control strategy of the main camera device, may further include: : sub-step S104C1, sub-step S104C2 and sub-step S104C3.
  • Sub-step S104C1 Based on the local brightness map and the position at the second moment, determine the ambient brightness corresponding to the position at the second moment.
  • Sub-step S104C2 If the movable platform does not perform a large maneuvering movement or if the change of the ambient brightness corresponding to the position at the second moment is less than a brightness threshold, then determine the main camera device based on the original exposure control strategy. exposure parameters at the second time instant.
  • Sub-step S104C3 If the movable platform performs a large maneuvering movement and the change of the ambient brightness corresponding to the position at the second moment is greater than the brightness threshold, the ambient brightness corresponding to the position at the second moment is determined as the main Exposure parameters of the main camera device at the second moment.
  • step S101 before establishing a local brightness map of the surrounding environment of the movable platform through the auxiliary light metering device, further It may include: calibrating the main camera device and the auxiliary light metering device respectively, so that the measurement of the brightness of the light by the main camera device and the auxiliary light metering device is unified. In this way, the measurement of light luminance by the main camera device and the auxiliary light metering device can be unified, thereby providing support for more accurate determination of the exposure parameters of the main camera device at the second moment.
  • the method may further include: capturing subsequent frame images through exposure parameters of the main camera device at the second moment.
  • FIG. 7 is a schematic structural diagram of an embodiment of a system for determining exposure parameters of a main camera device of the present application.
  • the system is suitable for a movable platform; it should be noted that the system can perform the above-mentioned method of determining the exposure parameters of the main camera device.
  • the steps in the method and the related contents please refer to the related contents of the above-mentioned method for determining the exposure parameters of the main camera device, which will not be repeated here.
  • the system 100 includes: a main camera 10 , an auxiliary light metering device 20 , a memory 1 and a processor 2 .
  • the main camera 10 , the auxiliary light metering device 20 , the memory 1 and the processor 2 are respectively connected through a bus.
  • the processor 2 may be a microcontroller unit, a central processing unit or a digital signal processor, and so on.
  • the memory 1 may be a Flash chip, a read-only memory, a magnetic disk, an optical disk, a U disk, a mobile hard disk, and the like.
  • the memory 1 is used to store a computer program; the processor 2 is used to execute the computer program and implement the following steps when executing the computer program:
  • a local brightness map of the surrounding environment of the movable platform is established; the motion information of the movable platform at the first moment is obtained; based on the motion information, the movable platform is predicted at the second moment the position of ; determining the exposure parameter of the main camera device at the second moment based on the local brightness map and the position at the second moment.
  • the processor executes the computer program, the following steps are implemented: establishing a local brightness map of the surrounding environment centered on the movable platform through the auxiliary light metering device.
  • the auxiliary light metering device includes a visual camera device.
  • the processor executes the computer program, the following steps are implemented: using the visual camera device to establish a local brightness map of the surrounding environment centered on the movable platform, where the local brightness map includes all The position information of a plurality of photographed objects in the surrounding environment centered on the movable platform and the ambient brightness information of each photographed object.
  • the processor when executing the computer program, implements the following steps: obtaining depth information of a plurality of photographed objects in the surrounding environment centered on the movable platform by the visual camera device, and then obtaining a plurality of The position information of the photographed object; the ambient brightness information of each of the photographed objects is measured and obtained by the auxiliary light metering device.
  • the processor when executing the computer program, implements the following steps: generating a partial panoramic image or panoramic image centered on the movable platform by the visual camera device; converting the partial panoramic image or panoramic image Dividing into a plurality of grid images, and calculating and obtaining depth information of a plurality of the photographed objects corresponding to the plurality of grid images in the surrounding environment centered on the movable platform.
  • the processor when executing the computer program, implements the following steps: determining a predetermined range of the surrounding environment of the main camera device; A local luminance map of a predetermined range of the surrounding environment of the main camera.
  • the processor executes the computer program, the following steps are implemented: determining a predetermined range of the surrounding environment of the main camera device according to the field of view of the main camera device.
  • the processor executes the computer program, the following steps are implemented: according to the field of view of the main camera device and the mobility index value of the movable platform, determine the surrounding environment of the main camera device. predetermined range.
  • the field of view of the visual camera device is larger than the field of view of the main camera device.
  • the processor executes the computer program, the following steps are implemented: establishing a local brightness map of the surrounding environment of the movable platform through the auxiliary light metering device at a predetermined frequency.
  • the processor when executing the computer program, implements the following steps: determining the predetermined frequency according to the performance index values of the main camera device and the auxiliary light metering device and the computing capability of the movable platform.
  • the motion information includes at least one of velocity information, acceleration information, angular velocity information, and angular acceleration information.
  • the movable platform includes an unmanned aerial vehicle
  • the motion information further includes at least one of attitude information and stick amount information of the joystick of the remote controller.
  • the processor when executing the computer program, implements the following steps: determining the main camera device based on the local brightness map, the position at the second moment and the original exposure control strategy of the main camera device exposure parameters at the second time instant.
  • the processor when executing the computer program, implements the following steps: determining, based on the local brightness map and the position at the second moment, the ambient brightness corresponding to the position at the second moment; The change of the ambient brightness corresponding to the position at the second moment is less than the brightness threshold, then the exposure parameter of the main camera device at the second moment is determined based on the original exposure control strategy; if the position corresponding to the second moment is If the change of the ambient brightness is greater than the brightness threshold, the exposure parameter of the main camera device at the second moment is determined mainly based on the ambient brightness corresponding to the position at the second moment.
  • the processor when executing the computer program, implements the following steps: based on the local brightness map and the position at the second moment, determine the ambient brightness corresponding to the position at the second moment; The mobile platform does not perform large maneuvering movements, then the original exposure control strategy is used to determine the exposure parameters of the main camera device at the second moment.
  • the processor executes the computer program, the following steps are implemented: calibrating the main camera device and the auxiliary light metering device respectively, so that the main camera device and the auxiliary light metering device can measure the brightness of the light. measurement uniformity.
  • the present application also provides a movable platform, which includes the system for determining exposure parameters of a main camera device as described in any one of the above.
  • a movable platform which includes the system for determining exposure parameters of a main camera device as described in any one of the above.
  • the present application also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor enables the processor to realize the determination of the main camera device according to any one of the above method for exposure parameters.
  • the related content please refer to the related content of the above-mentioned method for determining the exposure parameter of the main camera device, which will not be repeated here.
  • the computer-readable storage medium may be an internal storage unit of the above-mentioned system, such as a hard disk or a memory.
  • the computer-readable storage medium may also be an external storage device, such as an equipped plug-in hard disk, smart memory card, secure digital card, flash memory card, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Studio Devices (AREA)

Abstract

一种确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质，该方法包括：通过辅助测光装置，建立可移动平台周围环境的局部亮度地图（S101）；获取可移动平台第一时刻的运动信息（S102）；基于所述运动信息，预测可移动平台在第二时刻的位置（S103）；基于所述局部亮度地图和所述第二时刻的位置，确定主摄像装置在所述第二时刻的曝光参数（S104）。

Description

确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质 技术领域
本申请涉及拍摄曝光技术领域，尤其涉及一种确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质。
背景技术
摄像装置按照传统曝光控制策略进行自动曝光(AE，Automatic Exposure)时，在当前曝光参数下获取图像并进行亮度分析，当出现过曝时可以减少快门时间、减少光圈值、减少ISO值，当出现欠曝时可以增加快门时间、增加光圈值、增加ISO值。即传统曝光控制策略的自动曝光包括测量、调整曝光参数、曝光参数生效、然后继续测量、继续调整的过程，AE参数的收敛需要一段时间。
随着无人机技术的发展，无人机搭载摄像装置进行航拍开始被越来越多的人所使用。而与传统的航拍无人机不同，穿越机比赛则是近年新兴的竞速运动，搭载于穿越机的第一人称视角(FPV，First Person View)摄像装置跟随穿越机高速飞行，姿态剧烈变化。穿越机的图传模块将FPV摄像装置获取的FPV视频回传到飞手的眼镜上，飞手通过眼镜观看穿越机的FPV视频并通过遥控器操纵穿越机。当FPV摄像装置高速飞行、姿态剧烈变化、而场景亮度突变时(暗处到亮处或者亮处到暗处)，传统自动曝光系统具有滞后性，响应和控制延迟，容易造成过曝或者欠曝，使飞手短时间看不清楚FPV画面，容易引起炸机问题。
发明内容
基于此，本申请提供了一种确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质。
第一方面，本申请提供了一种确定主摄像装置曝光参数的方法，所述主摄 像装置搭载于可移动平台，所述可移动平台还搭载有辅助测光装置，所述方法包括：
通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图；
获取所述可移动平台第一时刻的运动信息；
基于所述运动信息，预测所述可移动平台在第二时刻的位置；
基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数。
第二方面，本申请还提供了一种确定主摄像装置曝光参数的系统，所述系统适用于可移动平台，所述系统包括：主摄像装置、辅助测光装置、存储器和处理器；
所述存储器用于存储计算机程序；
所述处理器用于执行所述计算机程序并在执行所述计算机程序时，实现如下步骤：
通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图；
获取所述可移动平台第一时刻的运动信息；
基于所述运动信息，预测所述可移动平台在第二时刻的位置；
基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数。
第三方面，本申请还提供了一种可移动平台，所述可移动平台包括如上所述的确定主摄像装置曝光参数的系统。
第四方面，本申请还提供了一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，所述计算机程序被处理器执行时使所述处理器实现如上所述的确定主摄像装置曝光参数的方法。
本申请实施例提供了一种确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质，通过辅助测光装置，建立可移动平台周围环境的局部亮度地图；获取所述可移动平台第一时刻的运动信息；基于所述运动信息，预测所述可移动平台在第二时刻的位置；基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数。由于通过辅助测光装置建立可移动平台周围环境的局部亮度地图，基于可移动平台第一时刻的运动信 息预测其在第二时刻的位置，从而可以预测可移动平台在第二时刻的位置对应的亮度信息，进而确定主摄像装置在第二时刻的曝光参数，通过这种方式，能够提前自动快速确定主摄像装置在第二时刻的曝光参数，进而使得主摄像装置能够更快速地响应和控制，并且更好地避免过曝或者欠曝。
应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本申请。
附图说明
为了更清楚地说明本申请实施例技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本申请确定主摄像装置曝光参数的方法一实施例的流程示意图；
图2是本申请确定主摄像装置曝光参数的方法另一实施例的流程示意图；
图3是本申请确定主摄像装置曝光参数的方法又一实施例的流程示意图；
图4是本申请确定主摄像装置曝光参数的方法又一实施例的流程示意图；
图5是本申请确定主摄像装置曝光参数的方法又一实施例的流程示意图；
图6是本申请确定主摄像装置曝光参数的方法又一实施例的流程示意图；
图7是本申请确定主摄像装置曝光参数的系统一实施例的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
附图中所示的流程图仅是示例说明，不是必须包括所有的内容和操作/步骤，也不是必须按所描述的顺序执行。例如，有的操作/步骤还可以分解、组合或部分合并，因此实际执行的顺序有可能根据实际情况改变。
在详细说明本申请的一些实施方式之前，先介绍一下曝光参数相关的内 容。
摄像装置自动曝光(AE，Automatic Exposure)实际上是根据摄像装置测量的周围环境的亮度信息来调节光圈、快门和感光度ISO值(即曝光参数)的过程，APEX曝光方程如下：
Figure PCTCN2020103120-appb-000001
E V＝A V+T V＝B V+S V  (1-2)
A V＝log 2(A 2)  (1-3)
Figure PCTCN2020103120-appb-000002
S V＝log 2(NS X)  (1-5)
Figure PCTCN2020103120-appb-000003
其中，A V为aperture value(光圈值)，T V为time value(时间值)，S V为speed value(速率值)，B V为luminance value(亮度值)，N为一个常量。以上公式称为APEX SYSTEM。上述公式可见，对摄像装置来说，控制其曝光的参数有光圈、快门、ISO三者。
对光圈、快门、ISO的调整离不开光亮度的测量，一般摄像装置在进行自动曝光时，通过对当前曝光参数下获取到的图像进行亮度分析，当出现过曝时可以减少快门时间，减少光圈值，减少ISO值，而当出现欠曝的时候，则通过增加快门时间，增加光圈值，增加ISO值得的方式进行调整；所以传统的自动曝光会有测量、调整曝光参数、曝光参数生效，然后继续测量、继续调整的过 程，AE参数的收敛需要一个过程。
与传统的航拍无人机不同，搭载于穿越机的第一人称视角(FPV，First Person View)摄像装置跟随穿越机高速飞行，姿态剧烈变化，当场景亮度突变时(暗处到亮处或者亮处到暗处)，传统自动曝光系统具有滞后性，响应和控制延迟，容易造成过曝或者欠曝，使飞手短时间看不清楚FPV画面，容易引起炸机问题。
本申请实施例适用的应用场景可以是无人机产品中FPV摄像装置的AE曝光策略；尤其是穿越机这种飞行速度高、姿态变化快的应用场景下FPV摄像装置的AE曝光策略。
穿越机比赛是近年新兴的竞速运动，穿越机和普通的航拍机比，最明显的不同就是其最大速度和加速度比普通的航拍机大很多，顶级的穿越机可以达到200-300km/h，从静止开始到100km/h的加速时间不到2s。另外，穿越机的飞手操纵穿越机的方式是：穿越机上的图传模块将穿越机上摄像装置获取的fpv视频回传到眼镜上，飞手通过眼镜来观看穿越机的fpv视频，进而通过fpv视频操纵穿越机；飞手需要在穿越机极高的速度下驾驭穿越机，完成大机动、穿越标志物等动作，对FPV视频的延迟和FPV的视频素质要求较高。本申请实施例可以在穿越机上使用视觉相机，通过视觉相机来辅助进行测光，结合当前穿越机运动参数，提前计算出穿越机运动后FPV摄像装置下一帧曝光时对应的环境光亮度(或者下N帧曝光，受计算能力约束，N越小越好)，从而提前对下一帧的曝光参数进行计算和配置，进而使得FPV摄像装置能够更快速地响应和控制，并且更好地避免过曝或者欠曝。
本申请实施例通过辅助测光装置，建立可移动平台周围环境的局部亮度地图；获取所述可移动平台第一时刻的运动信息；基于所述运动信息，预测所述可移动平台在第二时刻的位置；基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数。由于通过辅助测光装置建立可移动平台周围环境的局部亮度地图，基于可移动平台第一时刻的运动信息预测其在第二时刻的位置，从而可以预测可移动平台在第二时刻的位置对应的亮度信息，进而确定主摄像装置在第二时刻的曝光参数，通过这种方式，能够提前自动快速确定主摄像装置在第二时刻的曝光参数，进而使得主摄像装置 能够更快速地响应和控制，并且更好地避免过曝或者欠曝。
下面结合附图，对本申请的一些实施方式作详细说明。在不冲突的情况下，下述的实施例及实施例中的特征可以相互组合。
参见图1，图1是本申请确定主摄像装置曝光参数的方法一实施例的流程示意图，所述主摄像装置搭载于可移动平台，所述可移动平台还搭载有辅助测光装置，本实施例中可移动平台可以是指可以自动移动或者在受控条件下移动的各种平台，例如：无人机、车辆、无人车辆、地面机器人、无人船等等。所述方法包括：步骤S101、步骤S102、步骤S103以及步骤S104。
步骤S101：通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图。
在本实施例中，辅助测光装置可以是能够在变化环境下实现自动测光的装置。辅助测光装置可以是独立的专门用于测光的装置，也可以是包括测光系统的装置，例如摄像装置本身包括测光系统。
局部亮度地图可以是具有位置信息以及该位置信息对应的亮度信息的地图，通过位置信息可以找到对应的亮度信息。基于辅助测光装置数量及位置的不同，局部亮度地图可以是可移动平台周围360°的一定距离范围内的亮度地图，也可以是可移动平台周围某一角度范围的亮度地图，例如前向或前向加侧向等。
由于所述主摄像装置搭载于可移动平台上，主摄像装置随着可移动平台运动而运动，主摄像装置周围环境与可移动平台周围环境基本相同。本实施例中，通过所述辅助测光装置建立所述可移动平台周围环境的局部亮度地图，当知道可移动平台周围环境的某个位置信息时，根据所述可移动平台周围环境的局部亮度地图，即可获知该位置信息对应的亮度信息。
步骤S102：获取所述可移动平台第一时刻的运动信息。
可移动平台的位置是变化的、运动的。可移动平台的运动信息包括但不限于速度信息、加速度信息、角速度信息、角加速度信息中的至少一种。如果可移动平台包括无人飞行器，所述可移动平台的运动信息还包括姿态信息、遥控器摇杆的杆量信息中的至少一种。第一时刻是预测可移动平台后续位置之前的时刻。
可移动平台上通常具有控制系统，以实现对可移动平台的实时控制，要实现这一系统功能，控制系统提供有测量自身运动信息的测量仪器以实时采集可移动平台的运动信息，例如：雷达、惯性测量单元、陀螺仪、加速度计，等等。因此，利用这些测量仪器的测量，可以获取到所述可移动平台第一时刻的运动信息。
步骤S103：基于所述可移动平台第一时刻的运动信息，预测所述可移动平台在第二时刻的位置。
步骤S104：基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数。
基于所述局部亮度地图和所述第二时刻的位置，即可确定所述第二时刻的位置对应的亮度信息，根据所述第二时刻的位置对应的亮度信息即可确定所述主摄像装置在所述第二时刻的曝光参数。
需要说明的是，如果将所述主摄像装置在第一时刻的曝光参数对应的图像称为当前帧图像，那么所述主摄像装置在第二时刻的曝光参数对应的图像可以是当前帧图像的下一帧图像，也可以是当前帧图像的下N帧图像，N大于等于2。当然N越小越好，N受计算能力的约束。
本申请实施例通过辅助测光装置，建立可移动平台周围环境的局部亮度地图；获取所述可移动平台第一时刻的运动信息；基于所述运动信息，预测所述可移动平台在第二时刻的位置；基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数。由于通过辅助测光装置建立可移动平台周围环境的局部亮度地图，基于可移动平台第一时刻的运动信息预测其在第二时刻的位置，从而可以预测可移动平台在第二时刻的位置对应的亮度信息，进而确定主摄像装置在第二时刻的曝光参数，通过这种方式，能够提前自动快速确定主摄像装置在第二时刻的曝光参数，进而使得主摄像装置能够更快速地响应和控制，并且更好地避免过曝或者欠曝。
由于主摄像装置的视场角是以主摄像装置为中心对称的，为了更加准确预测主摄像装置的周围环境的亮度信息，在一实施例中，步骤S101所述通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图，可以包括：通过所述辅助测光装置，建立以所述可移动平台为中心的周围环境的局部亮度 地图。
在一实施例中，所述辅助测光装置包括视觉摄像装置。在可移动平台上常常采用成本较低的视觉摄像装置进行避障，本实施例也利用视觉摄像装置作为辅助测光装置，能够进一步节约成本。
其中，所述视觉摄像装置的视场角大于所述主摄像装置的视场角，所述主摄像装置的拍摄范围在所述视觉摄像装置的拍摄范围之内，这能够预测得到更加准确的所述可移动平台在第二时刻的位置对应的亮度信息，进而能够预测得到更加准确的所述主摄像装置在所述第二时刻的曝光参数。
其中，步骤S101所述通过所述辅助测光装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，还可以包括：通过所述视觉摄像装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，所述局部亮度地图包括以所述可移动平台为中心的周围环境的多个被拍摄对象的位置信息和每个被拍摄对象的环境亮度信息。
进一步，参见图2，步骤S101所述通过所述视觉摄像装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，还可以包括：子步骤S101A1和子步骤S101A2。
子步骤S101A1：通过所述视觉摄像装置得到以所述可移动平台为中心的周围环境中多个被拍摄对象的深度信息，进而得到多个所述被拍摄对象的位置信息。
子步骤S101A2：通过所述辅助测光装置测量并得到每个所述被拍摄对象的环境亮度信息。
视觉摄像装置可以被用来测距，周围环境中多个被拍摄对象的深度信息也就是周围环境中多个被拍摄对象距离视觉摄像装置的远近距离信息；根据所述可移动平台为中心的周围环境中多个被拍摄对象的深度信息，再结合可移动平台的当前位置，即可得到多个所述被拍摄对象的位置信息；通过所述辅助测光装置(可以是单独的辅助测光装置，也可以是包括测光系统的摄像装置)能够测量并得到每个所述被拍摄对象的环境亮度信息。通过这种方式，能够简单快速得到以所述可移动平台为中心的周围环境的局部亮度地图。
其中，参见图3，子步骤S101A1所述通过所述视觉摄像装置得到以所述 可移动平台为中心的周围环境中多个被拍摄对象的深度信息，还可以包括：子步骤S101A11和子步骤S101A12。
子步骤S101A11：通过所述视觉摄像装置生成以所述可移动平台为中心的部分全景图像或全景图像。
若所述视觉摄像装置的视场角无法覆盖以所述可移动平台为中心的全部方向，则生成以所述可移动平台为中心的周围环境的部分全景图像；或者，为了加强处理能力，加快处理速度，即使具有全景图像生成的能力，也可以只生成以所述可移动平台为中心的附近一定范围的部分全景图像。
子步骤S101A12：将所述部分全景图像或全景图像划分为多个网格图像，并计算得到以所述可移动平台为中心的周围环境中分别与多个所述网格图像对应的多个所述被拍摄对象的深度信息。
将所述部分全景图像或全景图像划分为多个网格图像，方便针对每个网格图像计算得到以所述可移动平台为中心的周围环境中分别与每个所述网格图像对应的每个所述被拍摄对象的深度信息，进而能够得到每个网格图像对应的每个所述被拍摄对象的位置信息，从而根据局部亮度地图可以得到每个所述被拍摄对象的亮度信息。
需要说明的是，网格图像的大小不做限定。网格图像越小，网格图像的数量越多，对计算能力要求越高，计算所需要的时间越多；网格图像越大，网格图像的数量越少，对计算能力要求越低，计算所需要的时间越少；网格图像的大小可以根据具体的实际应用要求来确定。
参见图4，局部亮度地图的范围与所述主摄像装置的周围环境的范围相关，如果所述主摄像装置的周围环境的范围没有预先确定，则步骤S101中所述通过所述视觉摄像装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，还可以包括：子步骤S101B1和子步骤S101B2。
子步骤S101B1：确定所述主摄像装置的周围环境的预定范围。
子步骤S101B2：通过所述视觉摄像装置，建立以所述可移动平台为中心、所述主摄像装置的周围环境的预定范围的局部亮度地图。
在一实施例中，子步骤S101B1所述确定所述主摄像装置的周围环境的预定范围，可以包括：根据所述主摄像装置的视场角，确定所述主摄像装置的周 围环境的预定范围。
所述主摄像装置的视场角可以确定拍摄范围，因此根据所述主摄像装置的视场角，确定所述主摄像装置的周围环境的预定范围。
进一步，如果可移动平台运动速度改变、运动姿态等等改变过快，这会导致所述主摄像装置的拍摄范围变化很快，因此为了尽可能准确预测所述主摄像装置在下一时刻的曝光参数，子步骤S101B1所述根据所述主摄像装置的视场角，确定所述主摄像装置的周围环境的预定范围，还可以包括：根据所述主摄像装置的视场角和所述可移动平台的机动性指标值，确定所述主摄像装置的周围环境的预定范围。
所述可移动平台的机动性指标值可以是可移动平台在一定时间内改变运动速度、飞行髙度(例如无人机)和运动方向的能力的指标值，相应地可以分为速度机动性指标值、高度机动性指标值(例如无人机)和方向机动性指标值。显然可移动平台改变一定速度、高度或方向所需的时间越短，可移动平台的机动性就越好。一般来说，所述可移动平台的机动性指标值越高，说明所述可移动平台的机动性越好，此时所述主摄像装置的周围环境的预定范围需要更大。
由于可移动平台的位置是不断变化的，其周围环境的亮度信息也是不断变化的，为了准确预测所述可移动平台在第二时刻的位置对应的亮度信息，需要所述可移动平台以一定的频率建立所述可移动平台周围环境的局部亮度地图，即步骤S101所述通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图，可以包括：以预定频率通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图。
在一实施例中，如果预定频率没有预先确定，所述预定频率确定的方式可以是：根据所述主摄像装置和所述辅助测光装置的性能指标值、所述可移动平台的计算能力确定所述预定频率。
通常来说，预定频率越高越好，但是预定频率越高，对所述主摄像装置和所述辅助测光装置的性能指标要求也越高，对可移动平台的计算能力要求也越高。预定频率可以根据具体的硬件配置情况和实际应用需求来确定。
下面详细说明步骤S104的细节内容。
确定所述主摄像装置在所述第二时刻的曝光参数时，也可以同时考虑使用 传统的原曝光控制策略进行两个策略的融合，从而避免由于计算不准确造成的AE控制问题；两种策略对最终AE影响的大小可以动态调整。
在一实施例中，步骤S104所述基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数，可以包括：基于所述局部亮度地图、所述第二时刻的位置和所述主摄像装置的原曝光控制策略，确定所述主摄像装置在所述第二时刻的曝光参数。
其中，相比第一时刻的位置对应的环境亮度，当预测的第二时刻的位置对应的环境亮度的变化大于一定门限的时候，说明所述主摄像装置的周围环境的亮度变化很大，此时可以以预测的第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。参见图5，步骤S104所述基于所述局部亮度地图、所述第二时刻的位置和所述主摄像装置的原曝光控制策略，确定所述主摄像装置在所述第二时刻的曝光参数，可以包括：子步骤S104A1、子步骤S104A2以及子步骤S104A3。
子步骤S104A1：基于所述局部亮度地图、所述第二时刻的位置，确定所述第二时刻的位置对应的环境亮度。
子步骤S104A2：若所述第二时刻的位置对应的环境亮度的变化小于亮度门限，则以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数。
子步骤S104A3：若所述第二时刻的位置对应的环境亮度的变化大于亮度门限，则以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
亮度门限可以根据具体的应用要求来确定。若所述第二时刻的位置对应的环境亮度的变化小于亮度门限，可以说明所述主摄像装置的周围环境的亮度变化不大，可以采用以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数。若所述第二时刻的位置对应的环境亮度的变化大于亮度门限，可以说明所述主摄像装置的周围环境的亮度变化较大，可以采用以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
其中，当可移动平台进行大机动移动的时候，所述主摄像装置的周围环境 变化很快，相比第一时刻的位置对应的环境亮度，预测的第二时刻的位置对应的环境亮度很可能变化也很快，此时可以以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。参见图6，步骤S104所述基于所述局部亮度地图、所述第二时刻的位置和所述主摄像装置的原曝光控制策略，确定所述主摄像装置在所述第二时刻的曝光参数，可以包括：子步骤S104B1、子步骤S104B2以及子步骤S104B3。
子步骤S104B1：基于所述局部亮度地图、所述第二时刻的位置，确定所述第二时刻的位置对应的环境亮度。
子步骤S104B2：若所述可移动平台没有进行大机动移动，则以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数，所述大机动移动是指单位时间内移动状态改变的范围超过最大门限的机动移动。
子步骤S104B3：若所述可移动平台进行大机动移动，则以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
最大门限可以是单位时间内移动状态的改变(或变化量)将要达到大机动移动的门限。所述大机动移动是指单位时间内移动状态改变的范围超过最大门限的机动移动，没有进行大机动移动可以是单位时间内移动状态改变的范围没有超过最大门限。若所述可移动平台没有进行大机动移动，可能说明所述主摄像装置的周围环境的亮度变化不大，可以采用以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数。若所述可移动平台进行大机动移动，可能说明所述主摄像装置的周围环境的亮度变化较大，可以采用以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
当然，还可以将预测的第二时刻的位置对应的环境亮度的变化与可移动平台进行大机动移动与否结合起来一起考虑，能够更加准确确定所述主摄像装置在所述第二时刻的曝光参数。即步骤S104所述基于所述局部亮度地图、所述第二时刻的位置和所述主摄像装置的原曝光控制策略，确定所述主摄像装置在所述第二时刻的曝光参数，还可以包括：子步骤S104C1、子步骤S104C2以及子步骤S104C3。
子步骤S104C1：基于所述局部亮度地图、所述第二时刻的位置，确定所 述第二时刻的位置对应的环境亮度。
子步骤S104C2：若所述可移动平台没有进行大机动移动或者若所述第二时刻的位置对应的环境亮度的变化小于亮度门限，则以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数。
子步骤S104C3：若所述可移动平台进行大机动移动且所述第二时刻的位置对应的环境亮度的变化大于亮度门限，则以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
在一实施例中，如果预先没有校准所述主摄像装置和所述辅助测光装置，步骤S101所述通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图之前，还可以包括：分别校准所述主摄像装置和所述辅助测光装置，以使所述主摄像装置和所述辅助测光装置对光亮度的测量统一。通过这种方式，能够使所述主摄像装置和所述辅助测光装置对光亮度的测量统一，从而为更加准确确定所述主摄像装置在所述第二时刻的曝光参数提供支持。
在一实施例中，所述方法还可以包括：通过所述主摄像装置在所述第二时刻的曝光参数捕获后续帧图像。
参见图7，图7是本申请确定主摄像装置曝光参数的系统一实施例的结构示意图，所述系统适用于可移动平台；需要说明的是，该系统能够执行上述确定主摄像装置曝光参数的方法中的步骤，相关内容的详细说明，请参见上述确定主摄像装置曝光参数的方法的相关内容，在此不再赘叙。
所述系统100包括：主摄像装置10、辅助测光装置20、存储器1和处理器2，主摄像装置10、辅助测光装置20、存储器1分别和处理器2通过总线连接。
其中，处理器2可以是微控制单元、中央处理单元或数字信号处理器，等等。
其中，存储器1可以是Flash芯片、只读存储器、磁盘、光盘、U盘或者移动硬盘等等。
所述存储器1用于存储计算机程序；所述处理器2用于执行所述计算机程序并在执行所述计算机程序时，实现如下步骤：
通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图； 获取所述可移动平台第一时刻的运动信息；基于所述运动信息，预测所述可移动平台在第二时刻的位置；基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：通过所述辅助测光装置，建立以所述可移动平台为中心的周围环境的局部亮度地图。
其中，所述辅助测光装置包括视觉摄像装置。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：通过所述视觉摄像装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，所述局部亮度地图包括以所述可移动平台为中心的周围环境的多个被拍摄对象的位置信息和每个被拍摄对象的环境亮度信息。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：通过所述视觉摄像装置得到以所述可移动平台为中心的周围环境中多个被拍摄对象的深度信息，进而得到多个所述被拍摄对象的位置信息；通过所述辅助测光装置测量并得到每个所述被拍摄对象的环境亮度信息。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：通过所述视觉摄像装置生成以所述可移动平台为中心的部分全景图像或全景图像；将所述部分全景图像或全景图像划分为多个网格图像，并计算得到以所述可移动平台为中心的周围环境中分别与多个所述网格图像对应的多个所述被拍摄对象的深度信息。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：确定所述主摄像装置的周围环境的预定范围；通过所述视觉摄像装置，建立以所述可移动平台为中心、所述主摄像装置的周围环境的预定范围的局部亮度地图。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：根据所述主摄像装置的视场角，确定所述主摄像装置的周围环境的预定范围。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：根据所述主摄像装置的视场角和所述可移动平台的机动性指标值，确定所述主摄像装置的周围环境的预定范围。
其中，所述视觉摄像装置的视场角大于所述主摄像装置的视场角。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：以预定频率 通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：根据所述主摄像装置和所述辅助测光装置的性能指标值、所述可移动平台的计算能力确定所述预定频率。
其中，所述运动信息包括速度信息、加速度信息、角速度信息、角加速度信息中的至少一种。
其中，所述可移动平台包括无人飞行器，所述运动信息还包括姿态信息、遥控器摇杆的杆量信息中的至少一种。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：基于所述局部亮度地图、所述第二时刻的位置和所述主摄像装置的原曝光控制策略，确定所述主摄像装置在所述第二时刻的曝光参数。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：基于所述局部亮度地图、所述第二时刻的位置，确定所述第二时刻的位置对应的环境亮度；若所述第二时刻的位置对应的环境亮度的变化小于亮度门限，则以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数；若所述第二时刻的位置对应的环境亮度的变化大于亮度门限，则以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：基于所述局部亮度地图、所述第二时刻的位置，确定所述第二时刻的位置对应的环境亮度；若所述可移动平台没有进行大机动移动，则以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数，所述大机动移动是指单位时间内移动状态改变的范围超过最大门限的机动移动；若所述可移动平台进行大机动移动，则以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：分别校准所述主摄像装置和所述辅助测光装置，以使所述主摄像装置和所述辅助测光装置对光亮度的测量统一。
其中，所述处理器在执行所述计算机程序时，实现如下步骤：通过所述主摄像装置在所述第二时刻的曝光参数捕获后续帧图像。
本申请还提供一种可移动平台，所述可移动平台包括如上任一项所述的确定主摄像装置曝光参数的系统。相关内容的详细说明，请参见上述确定主摄像装置曝光参数的系统的相关内容，在此不再赘叙。
本申请还提供一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，所述计算机程序被处理器执行时使所述处理器实现如上任一项所述的确定主摄像装置曝光参数的方法。相关内容的详细说明，请参见上述确定主摄像装置曝光参数的方法的相关内容，在此不再赘叙。
其中，该计算机可读存储介质可以是上述系统的内部存储单元，例如硬盘或内存。该计算机可读存储介质也可以是外部存储设备，例如配备的插接式硬盘、智能存储卡、安全数字卡、闪存卡，等等。
应当理解，在本申请说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。
还应当理解，在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合，并且包括这些组合。
以上所述，仅为本申请的具体实施例，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到各种等效的修改或替换，这些修改或替换都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以权利要求的保护范围为准。

Claims (40)

  1. 一种确定主摄像装置曝光参数的方法，所述主摄像装置搭载于可移动平台，其特征在于，所述可移动平台还搭载有辅助测光装置，所述方法包括：
    通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图；
    获取所述可移动平台第一时刻的运动信息；
    基于所述运动信息，预测所述可移动平台在第二时刻的位置；
    基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数。
  2. 根据权利要求1所述的方法，其特征在于，所述通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图，包括：
    通过所述辅助测光装置，建立以所述可移动平台为中心的周围环境的局部亮度地图。
  3. 根据权利要求2所述的方法，其特征在于，所述辅助测光装置包括视觉摄像装置。
  4. 根据权利要求3所述的方法，其特征在于，所述通过所述辅助测光装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，包括：
    通过所述视觉摄像装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，所述局部亮度地图包括以所述可移动平台为中心的周围环境的多个被拍摄对象的位置信息和每个被拍摄对象的环境亮度信息。
  5. 根据权利要求4所述的方法，其特征在于，所述通过所述视觉摄像装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，包括：
    通过所述视觉摄像装置得到以所述可移动平台为中心的周围环境中多个被拍摄对象的深度信息，进而得到多个所述被拍摄对象的位置信息；
    通过所述辅助测光装置测量并得到每个所述被拍摄对象的环境亮度信息。
  6. 根据权利要求5所述的方法，其特征在于，所述通过所述视觉摄像装置得到以所述可移动平台为中心的周围环境中多个被拍摄对象的深度信息，包括：
    通过所述视觉摄像装置生成以所述可移动平台为中心的部分全景图像或 全景图像；
    将所述部分全景图像或全景图像划分为多个网格图像，并计算得到以所述可移动平台为中心的周围环境中分别与多个所述网格图像对应的多个所述被拍摄对象的深度信息。
  7. 根据权利要求4所述的方法，其特征在于，所述通过所述视觉摄像装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，包括：
    确定所述主摄像装置的周围环境的预定范围；
    通过所述视觉摄像装置，建立以所述可移动平台为中心、所述主摄像装置的周围环境的预定范围的局部亮度地图。
  8. 根据权利要求7所述的方法，其特征在于，所述确定所述主摄像装置的周围环境的预定范围，包括：
    根据所述主摄像装置的视场角，确定所述主摄像装置的周围环境的预定范围。
  9. 根据权利要求8所述的方法，其特征在于，所述根据所述主摄像装置的视场角，确定所述主摄像装置的周围环境的预定范围，包括：
    根据所述主摄像装置的视场角和所述可移动平台的机动性指标值，确定所述主摄像装置的周围环境的预定范围。
  10. 根据权利要求3所述的方法，其特征在于，所述视觉摄像装置的视场角大于所述主摄像装置的视场角。
  11. 根据权利要求1所述的方法，其特征在于，所述通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图，包括：
    以预定频率通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图。
  12. 根据权利要求11所述的方法，其特征在于，所述方法还包括：
    根据所述主摄像装置和所述辅助测光装置的性能指标值、所述可移动平台的计算能力确定所述预定频率。
  13. 根据权利要求1所述的方法，其特征在于，所述运动信息包括速度信息、加速度信息、角速度信息、角加速度信息中的至少一种。
  14. 根据权利要求13所述的方法，其特征在于，所述可移动平台包括无 人飞行器，所述运动信息还包括姿态信息、遥控器摇杆的杆量信息中的至少一种。
  15. 根据权利要求1所述的方法，其特征在于，所述基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数，包括：
    基于所述局部亮度地图、所述第二时刻的位置和所述主摄像装置的原曝光控制策略，确定所述主摄像装置在所述第二时刻的曝光参数。
  16. 根据权利要求15所述的方法，其特征在于，所述基于所述局部亮度地图、所述第二时刻的位置和所述主摄像装置的原曝光控制策略，确定所述主摄像装置在所述第二时刻的曝光参数，包括：
    基于所述局部亮度地图、所述第二时刻的位置，确定所述第二时刻的位置对应的环境亮度；
    若所述第二时刻的位置对应的环境亮度的变化小于亮度门限，则以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数；
    若所述第二时刻的位置对应的环境亮度的变化大于亮度门限，则以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
  17. 根据权利要求15所述的方法，其特征在于，所述基于所述局部亮度地图、所述第二时刻的位置和所述主摄像装置的原曝光控制策略，确定所述主摄像装置在所述第二时刻的曝光参数，包括：
    基于所述局部亮度地图、所述第二时刻的位置，确定所述第二时刻的位置对应的环境亮度；
    若所述可移动平台没有进行大机动移动，则以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数，所述大机动移动是指单位时间内移动状态改变的范围超过最大门限的机动移动；
    若所述可移动平台进行大机动移动，则以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
  18. 根据权利要求1所述的方法，其特征在于，所述通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图之前，还包括：
    分别校准所述主摄像装置和所述辅助测光装置，以使所述主摄像装置和所述辅助测光装置对光亮度的测量统一。
  19. 根据权利要求1所述的方法，其特征在于，所述方法还包括：
    通过所述主摄像装置在所述第二时刻的曝光参数捕获后续帧图像。
  20. 一种确定主摄像装置曝光参数的系统，其特征在于，所述系统适用于可移动平台，所述系统包括：主摄像装置、辅助测光装置、存储器和处理器；
    所述存储器用于存储计算机程序；
    所述处理器用于执行所述计算机程序并在执行所述计算机程序时，实现如下步骤：
    通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图；
    获取所述可移动平台第一时刻的运动信息；
    基于所述运动信息，预测所述可移动平台在第二时刻的位置；
    基于所述局部亮度地图和所述第二时刻的位置，确定所述主摄像装置在所述第二时刻的曝光参数。
  21. 根据权利要求20所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    通过所述辅助测光装置，建立以所述可移动平台为中心的周围环境的局部亮度地图。
  22. 根据权利要求21所述的系统，其特征在于，所述辅助测光装置包括视觉摄像装置。
  23. 根据权利要求22所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    通过所述视觉摄像装置，建立以所述可移动平台为中心的周围环境的局部亮度地图，所述局部亮度地图包括以所述可移动平台为中心的周围环境的多个被拍摄对象的位置信息和每个被拍摄对象的环境亮度信息。
  24. 根据权利要求23所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    通过所述视觉摄像装置得到以所述可移动平台为中心的周围环境中多个被拍摄对象的深度信息，进而得到多个所述被拍摄对象的位置信息；
    通过所述辅助测光装置测量并得到每个所述被拍摄对象的环境亮度信息。
  25. 根据权利要求24所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    通过所述视觉摄像装置生成以所述可移动平台为中心的部分全景图像或全景图像；
    将所述部分全景图像或全景图像划分为多个网格图像，并计算得到以所述可移动平台为中心的周围环境中分别与多个所述网格图像对应的多个所述被拍摄对象的深度信息。
  26. 根据权利要求23所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    确定所述主摄像装置的周围环境的预定范围；
    通过所述视觉摄像装置，建立以所述可移动平台为中心、所述主摄像装置的周围环境的预定范围的局部亮度地图。
  27. 根据权利要求26所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    根据所述主摄像装置的视场角，确定所述主摄像装置的周围环境的预定范围。
  28. 根据权利要求27所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    根据所述主摄像装置的视场角和所述可移动平台的机动性指标值，确定所述主摄像装置的周围环境的预定范围。
  29. 根据权利要求22所述的系统，其特征在于，所述视觉摄像装置的视场角大于所述主摄像装置的视场角。
  30. 根据权利要求20所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    以预定频率通过所述辅助测光装置，建立所述可移动平台周围环境的局部亮度地图。
  31. 根据权利要求30所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    根据所述主摄像装置和所述辅助测光装置的性能指标值、所述可移动平台的计算能力确定所述预定频率。
  32. 根据权利要求20所述的系统，其特征在于，所述运动信息包括速度信息、加速度信息、角速度信息、角加速度信息中的至少一种。
  33. 根据权利要求32所述的系统，其特征在于，所述可移动平台包括无人飞行器，所述运动信息还包括姿态信息、遥控器摇杆的杆量信息中的至少一种。
  34. 根据权利要求20所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    基于所述局部亮度地图、所述第二时刻的位置和所述主摄像装置的原曝光控制策略，确定所述主摄像装置在所述第二时刻的曝光参数。
  35. 根据权利要求34所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    基于所述局部亮度地图、所述第二时刻的位置，确定所述第二时刻的位置对应的环境亮度；
    若所述第二时刻的位置对应的环境亮度的变化小于亮度门限，则以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数；
    若所述第二时刻的位置对应的环境亮度的变化大于亮度门限，则以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
  36. 根据权利要求34所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    基于所述局部亮度地图、所述第二时刻的位置，确定所述第二时刻的位置对应的环境亮度；
    若所述可移动平台没有进行大机动移动，则以所述原曝光控制策略为主确定所述主摄像装置在所述第二时刻的曝光参数，所述大机动移动是指单位时间内移动状态改变的范围超过最大门限的机动移动；
    若所述可移动平台进行大机动移动，则以所述第二时刻的位置对应的环境亮度为主确定所述主摄像装置在所述第二时刻的曝光参数。
  37. 根据权利要求20所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    分别校准所述主摄像装置和所述辅助测光装置，以使所述主摄像装置和所述辅助测光装置对光亮度的测量统一。
  38. 根据权利要求20所述的系统，其特征在于，所述处理器在执行所述计算机程序时，实现如下步骤：
    通过所述主摄像装置在所述第二时刻的曝光参数捕获后续帧图像。
  39. 一种可移动平台，其特征在于，所述可移动平台包括如权利要求20-38任一项所述的确定主摄像装置曝光参数的系统。
  40. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质存储有计算机程序，所述计算机程序被处理器执行时使所述处理器实现如权利要求1-19任一项所述的确定主摄像装置曝光参数的方法。
PCT/CN2020/103120 2020-07-20 2020-07-20 确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质 WO2022016340A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080005980.8A CN113016175A (zh) 2020-07-20 2020-07-20 确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质
PCT/CN2020/103120 WO2022016340A1 (zh) 2020-07-20 2020-07-20 确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/103120 WO2022016340A1 (zh) 2020-07-20 2020-07-20 确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质

Publications (1)

Publication Number Publication Date
WO2022016340A1 true WO2022016340A1 (zh) 2022-01-27

Family

ID=76384111

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/103120 WO2022016340A1 (zh) 2020-07-20 2020-07-20 确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质

Country Status (2)

Country Link
CN (1) CN113016175A (zh)
WO (1) WO2022016340A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113572973B (zh) * 2021-09-28 2021-12-17 武汉市聚芯微电子有限责任公司 一种曝光控制方法、装置、设备以及计算机存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104853109A (zh) * 2015-04-30 2015-08-19 广东欧珀移动通信有限公司 一种自动调节闪光的方法及拍摄终端
CN107797549A (zh) * 2016-09-01 2018-03-13 三星电子株式会社 用于控制自主车辆的视觉传感器的方法和设备
CN108141543A (zh) * 2016-08-17 2018-06-08 谷歌有限责任公司 基于预测环境因素的相机设置调整和采用这种相机设置调整的跟踪系统
CN109167929A (zh) * 2018-09-30 2019-01-08 深圳市商汤科技有限公司 车载相机参数的调节方法、装置与电子设备
CN109547669A (zh) * 2017-09-21 2019-03-29 比亚迪股份有限公司 图像传感器及其曝光控制方法、装置
WO2019116784A1 (ja) * 2017-12-12 2019-06-20 ソニー株式会社 情報処理装置、移動体、制御システム、情報処理方法及びプログラム
KR20200044182A (ko) * 2018-10-05 2020-04-29 삼성전자주식회사 자율 주행 장치의 객체 인식 방법 및 자율 주행 장치

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104853109A (zh) * 2015-04-30 2015-08-19 广东欧珀移动通信有限公司 一种自动调节闪光的方法及拍摄终端
CN108141543A (zh) * 2016-08-17 2018-06-08 谷歌有限责任公司 基于预测环境因素的相机设置调整和采用这种相机设置调整的跟踪系统
CN107797549A (zh) * 2016-09-01 2018-03-13 三星电子株式会社 用于控制自主车辆的视觉传感器的方法和设备
CN109547669A (zh) * 2017-09-21 2019-03-29 比亚迪股份有限公司 图像传感器及其曝光控制方法、装置
WO2019116784A1 (ja) * 2017-12-12 2019-06-20 ソニー株式会社 情報処理装置、移動体、制御システム、情報処理方法及びプログラム
CN109167929A (zh) * 2018-09-30 2019-01-08 深圳市商汤科技有限公司 车载相机参数的调节方法、装置与电子设备
KR20200044182A (ko) * 2018-10-05 2020-04-29 삼성전자주식회사 자율 주행 장치의 객체 인식 방법 및 자율 주행 장치

Also Published As

Publication number Publication date
CN113016175A (zh) 2021-06-22

Similar Documents

Publication Publication Date Title
US11797009B2 (en) Unmanned aerial image capture platform
US20210133996A1 (en) Techniques for motion-based automatic image capture
WO2018214078A1 (zh) 拍摄控制方法及装置
CN105242685B (zh) 一种伴飞无人机航拍系统及方法
WO2018098704A1 (zh) 控制方法、设备、系统、无人机和可移动平台
WO2017020150A1 (zh) 一种图像处理方法、装置及摄像机
US20180275659A1 (en) Route generation apparatus, route control system and route generation method
WO2019041276A1 (zh) 一种图像处理方法、无人机及系统
JP2017085550A (ja) 自動露光制御のために空の画像の区分を用いる前方視カメラ付きドローン
CN112154649A (zh) 航测方法、拍摄控制方法、飞行器、终端、系统及存储介质
WO2020233682A1 (zh) 一种自主环绕拍摄方法、装置以及无人机
WO2021212445A1 (zh) 拍摄方法、可移动平台、控制设备和存储介质
WO2020019106A1 (zh) 云台和无人机控制方法、云台及无人机
WO2022160294A1 (zh) 曝光控制方法、装置及计算机可读存储介质
WO2020237478A1 (zh) 一种飞行规划方法及相关设备
WO2022016340A1 (zh) 确定主摄像装置曝光参数的方法、系统、可移动平台及存储介质
JP2021096865A (ja) 情報処理装置、飛行制御指示方法、プログラム、及び記録媒体
US10412372B2 (en) Dynamic baseline depth imaging using multiple drones
WO2022193081A1 (zh) 无人机的控制方法、装置及无人机
WO2020019175A1 (zh) 图像处理方法和设备、摄像装置以及无人机
US20230341079A1 (en) Control method based on image capturing apparatus, control method and apparatus for gimbal
WO2020168519A1 (zh) 拍摄参数的调整方法、拍摄设备以及可移动平台
US20210092306A1 (en) Movable body, image generation method, program, and recording medium
US20220141371A1 (en) Control apparatuses, photographing apparatuses, movable objects, control methods, and programs
WO2022061934A1 (zh) 图像处理方法、装置、系统、平台及计算机可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20946279

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20946279

Country of ref document: EP

Kind code of ref document: A1