WO2021196208A1 - 图像处理方法、变焦相机、相机负载装置、无人机 - Google Patents

图像处理方法、变焦相机、相机负载装置、无人机 Download PDF

Info

Publication number
WO2021196208A1
WO2021196208A1 PCT/CN2020/083310 CN2020083310W WO2021196208A1 WO 2021196208 A1 WO2021196208 A1 WO 2021196208A1 CN 2020083310 W CN2020083310 W CN 2020083310W WO 2021196208 A1 WO2021196208 A1 WO 2021196208A1
Authority
WO
WIPO (PCT)
Prior art keywords
wide
brightness
camera
target area
angle camera
Prior art date
Application number
PCT/CN2020/083310
Other languages
English (en)
French (fr)
Inventor
钱亮
王浩伟
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2020/083310 priority Critical patent/WO2021196208A1/zh
Publication of WO2021196208A1 publication Critical patent/WO2021196208A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components

Definitions

  • This application relates to the field of image processing technology, and in particular to an image processing method, a zoom camera, a camera load device, a drone, and a computer-readable storage medium.
  • the camera's minimum aperture value that is, the maximum aperture
  • the clear aperture of the lens will also increase with the focal length.
  • the clear aperture of the lens is limited by the maximum aperture. After the maximum aperture is reached, if the focal length continues to increase, the minimum aperture value of the camera cannot be maintained.
  • the minimum aperture value changes drastically with the focal length during the zooming process, which leads to sudden changes in the brightness of the images captured during the zooming process, which greatly reduces the user experience.
  • the embodiments of the present application provide an image processing method, a zoom camera, a camera loading device, and a drone, which are intended to solve the technical problem that the brightness of the image captured by the camera may suddenly change during the zooming process.
  • the first aspect of the embodiments of the present application provides an image processing method, including:
  • the aperture value is adjusted according to the corresponding relationship between the pre-configured focal length and the minimum aperture value to eliminate sudden changes in image brightness
  • the minimum aperture value changes gently with the change of the focal length.
  • a second aspect of the embodiments of the present application provides an image processing method, the method including:
  • the ideal exposure parameter is determined according to the brightness difference between the brightness of the target area in the image captured by the wide-angle camera and the overall brightness of the image captured by the wide-angle camera.
  • a third aspect of the embodiments of the present application provides a zoom camera, including: a zoom lens, a processor, and a memory;
  • the memory is used to store the correspondence relationship between the focal length and the minimum aperture value, and in the correspondence relationship, the minimum aperture value changes gently with the change of the focal length;
  • the processor is configured to adjust the aperture value according to the corresponding relationship stored in the memory during the zooming process of the zoom lens, so as to eliminate sudden changes in image brightness.
  • the fourth aspect of the embodiments of the present application provides a combined camera, including: a wide-angle camera and a zoom camera;
  • the wide-angle camera is used to obtain the overall brightness of the captured image; obtain the target area selected by the user in the captured image;
  • the zoom camera is used to pre-adjust the current exposure parameters according to ideal exposure parameters when zooming and shooting the target area; wherein, the ideal exposure parameters are based on the target area in the wide-angle camera.
  • the brightness difference between the brightness in the captured image and the overall brightness of the image captured by the wide-angle camera is determined.
  • the fifth aspect of the embodiments of the present application provides an unmanned aerial vehicle equipped with a zoom camera.
  • the zoom camera is pre-configured with a correspondence relationship between a focal length and a minimum aperture value.
  • the minimum aperture value changes with the focal length And gentle change;
  • the zoom camera is used to adjust the aperture value according to the corresponding relationship during the zooming process to eliminate sudden changes in image brightness.
  • the sixth aspect of the embodiments of the present application provides an unmanned aerial vehicle equipped with a combined camera, and the combined camera includes a zoom camera and a wide-angle camera;
  • the wide-angle camera is used to obtain the overall brightness of the captured image; obtain the target area selected by the user in the captured image;
  • the zoom camera is used to pre-adjust the current exposure parameters according to ideal exposure parameters when zooming and shooting the target area; wherein, the ideal exposure parameters are based on the target area in the wide-angle camera.
  • the brightness difference between the brightness in the captured image and the overall brightness of the image captured by the wide-angle camera is determined.
  • a seventh aspect of the embodiments of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, it implements the steps of the image processing method in any one of the above-mentioned embodiments of the first aspect.
  • the eighth aspect of the embodiments of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, it implements the steps of the image processing method in any one of the implementation manners of the second aspect.
  • the embodiment of the application provides an image processing method.
  • the aperture value is adjusted according to the corresponding relationship between the pre-configured focal length and the minimum aperture value.
  • the minimum aperture value changes with the focal length. And the change is gentle. It can be seen that since the minimum aperture value changes smoothly during the zooming process, the image brightness will not change suddenly.
  • Fig. 1A is a variation curve of the minimum aperture value in the existing aperture value adjustment strategy.
  • FIG. 1B is a curve of image brightness change when zooming using the existing aperture value adjustment strategy in manual mode.
  • Fig. 2 is a flowchart of an image processing method provided by the first aspect of the embodiments of the present application.
  • FIG. 3A is a schematic diagram of the change of the minimum aperture value with the focal length in an exemplary aperture value adjustment strategy provided by an embodiment of the present application.
  • FIG. 3B is a curve of image brightness change when zooming is performed using the aperture value adjustment strategy shown in FIG. 3A in manual mode.
  • FIG. 3C is a schematic diagram of the change of the minimum aperture value with the focal length in another exemplary aperture value adjustment strategy provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of the structure of a combination camera of a UAV and a gimbal provided by an embodiment of the present application.
  • Fig. 5 is a flowchart of an image processing method provided by the second aspect of the embodiments of the present application.
  • FIG. 6 is a schematic structural diagram of a zoom camera provided by the third aspect of the embodiments of the present application.
  • FIG. 7 is a schematic structural diagram of a combined camera provided in the fourth aspect of the embodiments of the present application.
  • FIG. 8 is a schematic structural diagram of an unmanned aerial vehicle provided by the fifth aspect of the embodiments of the present application.
  • FIG. 9 is a schematic structural diagram of an unmanned aerial vehicle provided in the sixth aspect of the embodiments of the present application.
  • FIG. 1A shows the change curve of the minimum aperture value in the existing aperture value adjustment strategy.
  • the upper curve represents the change curve of the minimum aperture value over time
  • the lower curve represents the change curve of the focal length over time.
  • the focal length first increases and then decreases, and the corresponding image brightness first decreases and then increases.
  • the change of image brightness corresponds to the change of the minimum aperture value over time in Figure 1A.
  • the minimum aperture value remains unchanged with the change of the focal length, the image brightness can also remain stable.
  • the minimum aperture value changes drastically with the change of the focal length, The image brightness changes suddenly.
  • FIG. 2 is a flowchart of an image processing method provided by the first aspect of the embodiments of the present application. The method includes the steps:
  • the method provided in the embodiments of the present application can be applied to a zoom camera, and of course, can also be applied to other devices including a zoom lens, such as a video camera, a mobile phone, a tablet, a notebook, a monitoring device, and so on.
  • a zoom lens such as a video camera, a mobile phone, a tablet, a notebook, a monitoring device, and so on.
  • FIG. 3A shows a schematic diagram of the change of the minimum aperture value with the focal length in an exemplary aperture value adjustment strategy provided by an embodiment of the present application.
  • the upper curve represents the change curve of the minimum aperture value over time
  • the lower curve represents the change curve of the focal length over time. It can be seen that the minimum aperture value gradually increases with the increase of the focal length.
  • FIG. 3B is the change curve of the image brightness when zooming using the aperture value adjustment strategy shown in FIG. 3A in the manual mode.
  • the focal length first increases and then decreases, and the corresponding image brightness first decreases and then increases. It can be seen that after the aperture value adjustment strategy shown in FIG. 3A is adopted, there will be no sudden changes in the image brightness.
  • the focal length is increased in the manual mode, the image brightness can be gently decreased as the aperture value increases.
  • the minimum aperture value changes gently with the change of focal length, which can be embodied in many forms in practice.
  • the minimum aperture value may be positively correlated with the focal length, and the step length of the minimum aperture value with the focal length is smaller than the preset value.
  • the so-called positive correlation means that when the focal length increases, the minimum aperture value also increases; and the change step is smaller than the preset value, that is, the minimum unit of change in the minimum aperture value is less than the preset value.
  • the change step length may not be a fixed value, as long as the change step length is less than the preset value.
  • the minimum aperture value and the focal length are not in a linear relationship.
  • the default value can be set to 0.8
  • the focal length is increased from 10mm to 15mm
  • the minimum aperture value is increased by 0.4 (that is, the change step is 0.4, less than 0.8)
  • the focal length is increased from 15mm to 20mm
  • the minimum aperture value is increased by 0.5 (that is, the change step is 0.5, which is less than 0.8).
  • the minimum aperture value changes gently with the change of the focal length.
  • the minimum aperture value may change stepwise as the focal length changes, as shown in FIG. 3C.
  • FIG. 3C shows another exemplary aperture value adjustment strategy provided by an embodiment of the present application. Schematic diagram of the change of value with focal length. It can be seen that the minimum aperture value can remain unchanged when the focal length changes in a small range, but as a whole, the minimum aperture value still changes gently with the change of focal length, so the brightness of the image will not change suddenly.
  • the correspondence relationship between the focal length and the minimum aperture value can be obtained in advance through correction.
  • a specific example can be given. For example, in the process of increasing from the shortest focal length 18mm to the longest focal length 55mm, the minimum aperture value will inevitably increase from F2.8 to F5.6, and the luma value of the corresponding image brightness will change from When 260 drops to 60, it can be determined that the starting point in the above corresponding relationship is (18, 2.8) and the end point is (55, 5.6).
  • some focal lengths can be selected as sample points, and a desired image brightness value can be set for each sample point.
  • the focal length 18mm corresponds to the luma value of 260
  • you can The luma value corresponding to the focal length 20mm is 250
  • the luma value corresponding to the focal length 22mm is 240...Under the focal length corresponding to each sample point, the original factory minimum aperture value is corrected according to the set image brightness, so that you can Determine the minimum aperture value after correction for each sample point. Further, curve fitting can be performed on each sample point to obtain the corresponding relationship between the focal length and the minimum aperture value, and in the corresponding relationship, the minimum aperture value changes smoothly with the change of the focal length.
  • the aperture value is adjusted through the above corresponding relationship, the image brightness will not change suddenly, but the image brightness will continue to change smoothly.
  • the focal length is adjusted to the shortest focal length, and the aperture value is set to the minimum aperture value, then in the process of zooming from the shortest focal length to the longest focal length, as the focal length increases .
  • the aperture value is constantly adjusted by the corresponding relationship provided above, the aperture value will also increase gently, and because other exposure parameters (such as sensitivity ISO and shutter time) remain unchanged in manual mode, the image brightness varies with the aperture value A gentle increase will slow down.
  • the automatic exposure mode can be used.
  • the automatic exposure algorithm in the camera can automatically adjust the ISO, shutter time and aperture value to keep the captured image at the proper brightness.
  • the automatic exposure algorithm can be modified, and the corresponding relationship provided above can be modified into the automatic exposure algorithm, so that the automatic exposure algorithm can calculate the new aperture value according to the corresponding relationship provided above, and The calculated new aperture value is applied to the camera.
  • the automatic exposure algorithm may also call the corresponding relationship provided above when calculating the new aperture value, so as to adjust the aperture value.
  • the aperture value can be adjusted according to the corresponding relationship provided above.
  • Other exposure parameters such as ISO and shutter time, can be adjusted to adapt to changes in the aperture value.
  • the amount of change in the aperture value corresponding to zooming from the current focal length to the target focal length is determined; according to the amount of change in the aperture value, the automatic exposure algorithm is used to determine the change in other exposure parameters.
  • the amount of change in the aperture value can also be estimated. For example, if it is determined that the current focal length is 35mm and the target focal length is 50mm, the change in the aperture value corresponding to the focal length changing from 35mm to 50mm can be determined according to the correspondence between the focal length and the minimum aperture value.
  • the determined change in the aperture value can be provided to the automatic exposure algorithm.
  • the automatic exposure algorithm can calculate the change in other exposure parameters based on the change in the aperture value, and can adjust other exposure parameters according to the calculated change in other exposure parameters. In this way, the compensation for the change of the aperture value is realized, and the brightness of the captured image is stabilized, and it will not change with the change of the aperture value.
  • the automatic exposure algorithm can adjust the ISO and shutter time to make the captured image The brightness is maintained, which is equivalent to making up for the amount of change in the aperture value.
  • the aperture value adjustment strategy in the prior art since the minimum aperture value changes too drastically, even if the automatic exposure algorithm compensates for the rate of change of the aperture value from ISO and shutter time, it cannot be compensated and the image brightness is still Mutations will occur. Therefore, only after the corresponding relationship between the focal length and the minimum aperture value provided in the embodiment of the present application is adopted, and the automatic exposure algorithm is combined, the image brightness can be stabilized during the zooming process.
  • the target focal length may be determined in response to a user's trigger instruction.
  • the user may slide a control on the touch screen to adjust the focus, and the target focal length may be determined according to the sliding position of the user.
  • the user may select a certain area in the captured image as the focus area, and the target focal length may be determined according to the focus area selected by the user.
  • the target focal length can also be determined.
  • the image processing methods in the various embodiments provided above can be applied to a zoom camera.
  • the zoom camera itself can be an independent product, but it can also be a part of a product, for example, it can be one of the cameras in a combination camera. It is understandable that multiple cameras can be integrated into a product with shooting function.
  • a mobile terminal device a mobile phone can integrate a variety of cameras, such as a wide-angle camera, a telephoto camera, an ultra-wide-angle camera, and so on.
  • the pan-tilt camera carried by the drone may also be a combined camera combining multiple cameras, as shown in FIG. 4, which is a schematic structural diagram of a pan-tilt combined camera of a drone provided in an embodiment of the present application.
  • the combined pan-tilt camera may include an infrared camera 401, a wide-angle camera 402, and a zoom camera 403.
  • the combined pan-tilt camera may include an infrared camera 401, a wide-angle camera 402, and
  • an optional implementation is that the zoom camera can combine the information provided by the wide-angle camera to cooperate with the wide-angle camera to perform exposure to accelerate the convergence of the exposure parameters.
  • the process of the automatic exposure algorithm calculating the exposure parameters can be considered as the convergence process of the exposure parameters.
  • the automatic exposure algorithm can compensate for the change in aperture value, calculate and apply new exposure parameters.
  • the automatic exposure algorithm will calculate the new exposure parameters again according to the changed image brightness... Repeat this many times until the image brightness meets the requirements and the exposure parameters converge. It can be seen that the convergence time of the exposure parameters is directly related to the speed at which the image brightness is restored to stability. The shorter the convergence time of the exposure parameters is, the faster the image brightness can be restored to stability.
  • the image processing method provided above can be applied to a zoom camera, which can also be connected to a wide-angle camera, and the image processing method is also It includes the following steps:
  • the current exposure parameters are pre-adjusted according to the ideal exposure parameters.
  • the ideal exposure parameter is determined according to the brightness difference between the brightness of the target area in the image captured by the wide-angle camera and the overall brightness of the image captured by the wide-angle camera.
  • the zoom camera's shooting area changes with the focal length during the zooming process, for example, when adjusting from a short focal length to a long focal length, the area that can be photographed will become smaller.
  • the wide-angle camera usually has a larger shooting area, and because it is a fixed-focus camera, its shooting area remains the same. Therefore, when switching from the shooting area of the wide-angle camera to the area where the zoom camera is about to focus, you can use the image taken by the wide-angle camera For reference, to speed up the convergence of the zoom camera's exposure parameters.
  • the area where the zoom camera is about to focus can be referred to as the target area, and the target area is a certain part of the wide-angle image captured by the wide-angle camera.
  • the brightness of the target area in the image captured by the wide-angle camera can be determined, and the brightness corresponding to the determined target area can be compared with the overall brightness of the image captured by the wide-angle camera to obtain a brightness difference.
  • ideal exposure parameters can be determined, and the ideal exposure parameters are provided to the zoom camera to help accelerate the convergence of the zoom camera's exposure parameters.
  • the determination of the overall brightness is mainly based on the metering mode.
  • metering modes including but not limited to: spot metering (matrix metering), evaluative metering (multiple metering), partial metering, and center-weighted average metering.
  • the ideal exposure parameter is the exposure parameter for the aforementioned target area.
  • the wide-angle camera has its own exposure parameter, but the exposure parameter is calculated by the automatic exposure algorithm for the overall brightness of the captured image, and for the local area of the captured image, the brightness of the local area usually does not reach the ideal brightness.
  • a slightly specific example can be given. For example, in a landscape image taken by a wide-angle camera, the overall brightness of the landscape image meets the set requirements, but the local area under the shade of the tree in the landscape image (this local area is selected as the target Area) is still too dark, not reaching the desired brightness. Therefore, an automatic exposure algorithm can be used to calculate the corresponding ideal exposure parameter for the target area. Under the ideal exposure parameter, the brightness of the target area will reach the ideal brightness.
  • the calculation of ideal exposure parameters can be performed by a wide-angle camera or a zoom camera.
  • the calculation of ideal exposure parameters can be performed by the zoom camera.
  • the wide-angle camera can send its own current exposure parameters and the determined brightness difference to the zoom camera.
  • the zoom camera uses the information provided by the wide-angle camera and combines it with its current current exposure parameters. Calculate the ideal exposure parameters with the exposure parameters.
  • an optional implementation is that the zoom camera can use the exposure parameters provided by the wide-angle camera and its own exposure parameters to calculate the conversion ratio, and correct the brightness difference provided by the wide-angle camera by the conversion ratio.
  • After the corrected brightness difference is provided to the zoom camera's own automatic exposure algorithm, there is an automatic exposure algorithm that calculates the ideal exposure parameters based on the corrected brightness difference.
  • the wide-angle camera needs to provide relevant information to the zoom camera, and interaction between the wide-angle camera and the zoom camera is required, and the calculation efficiency is not high. Therefore, another optional implementation manner is that the calculation of the ideal exposure parameter can be performed by a wide-angle camera, and the wide-angle camera can calculate the corresponding ideal exposure parameter for the target area through its own automatic exposure algorithm. Specifically, during calculation, an optional implementation manner is that the wide-angle camera may use the overall brightness of the captured image as the target brightness of the target area to calculate the ideal exposure parameter corresponding to the target area. It is not difficult to find that if the wide-angle camera uses the calculated ideal exposure parameters, the brightness of the corresponding part of the target area in the captured image can reach the above-mentioned target brightness.
  • the partial image corresponding to the target area in the image taken by the wide-angle camera can be intercepted, and the intercepted partial image can be analyzed for brightness, and the analyzed brightness can be used as the target
  • the brightness of the area in the image taken by the wide-angle camera can also be divided into multiple blocks, and the brightness of each block can be recorded.
  • the block corresponding to the target area in the captured image can be determined, and the brightness of the corresponding block is taken as the brightness of the target area in the image captured by the wide-angle camera.
  • the captured image can be divided into n*n squares, and the brightness of each square can be recorded.
  • the determined target area may correspond to multiple blocks.
  • the average brightness of the multiple blocks can be used as the brightness of the target area.
  • the target area may be a focus area determined by the wide-angle camera in response to a user's trigger.
  • the user can click on the real-time image captured by the wide-angle camera, sense the user's click, and confirm the area clicked by the user as the target area.
  • the target area may also be determined by the user clicking on the real-time image captured by the zoom camera.
  • the zoom camera may notify the wide-angle camera of the target area selected by the user.
  • the calculated ideal exposure parameters can be provided to the zoom camera to increase the speed at which the exposure parameters converge.
  • the calculated ideal exposure parameters can be used in combination with the current exposure parameters of the zoom camera itself to calculate the new exposure parameters of the zoom camera.
  • the new exposure parameter of the zoom camera may be a linear combination of the current exposure parameter and the ideal exposure parameter.
  • a weight coefficient may be preset, and the preset weight coefficient may be denoted by a.
  • the new exposure parameters can be calculated in the following way:
  • the new exposure parameter of the zoom camera initial exposure parameter ⁇ (1-a)+ideal exposure parameter ⁇ a.
  • a can be any number between 0 and 1.
  • the new exposure parameter can be directly equal to the ideal exposure parameter.
  • the new exposure parameter initial exposure parameter ⁇ 0.8+ideal exposure parameter ⁇ 0.2.
  • the calculated new exposure parameter can be directly used as the exposure parameter to be switched by the zoom camera.
  • the ideal exposure parameter may be corrected first.
  • the ideal exposure parameter may be corrected by a preset correction coefficient.
  • the corrected ideal exposure parameter can be directly used as the current exposure parameter, that is, the current exposure parameter can be set as the corrected ideal exposure parameter.
  • the zoom camera can pre-adjust the exposure parameters according to the ideal exposure parameters. After the pre-adjustment, the zoom camera It is possible to further converge the exposure parameters through its own automatic exposure algorithm. Since the current exposure parameters have been pre-adjusted to the new exposure parameters or the corrected ideal exposure parameters, the current exposure parameters are not much different from the exposure parameters that meet the convergence conditions.
  • the automatic exposure algorithm updates the exposure parameters on this basis , The exposure parameters can quickly converge, and the image brightness can quickly return to stability.
  • the aperture value can be adjusted according to the correspondence between the focal length and the minimum aperture value provided in this application, because in this correspondence, the minimum aperture value is gentle with the focal length Therefore, the brightness of the image will not change suddenly.
  • FIG. 5 is a flowchart of the image processing method provided by the second aspect of the embodiments of the present application.
  • the method may be performed by a device (such as a combination camera) including a zoom camera and a wide-angle camera, where the zoom camera is connected to the wide-angle camera.
  • the method includes:
  • S501 Obtain the overall brightness of the captured image through a wide-angle camera.
  • S502 Acquire a target area selected by the user in the captured image.
  • S503 Pre-adjust the current exposure parameter of the zoom camera according to the ideal exposure parameter when zooming and shooting the target area by the zoom camera.
  • the ideal exposure parameter is determined according to the brightness difference between the brightness of the target area in the image captured by the wide-angle camera and the overall brightness of the image captured by the wide-angle camera.
  • the combination camera may include a zoom camera and a wide-angle camera.
  • a zoom camera during the zooming process of the zoom camera, its shooting area changes with the focal length. For example, when the zoom camera is adjusted from a short focal length to a long focal length, the area that can be photographed becomes smaller.
  • the wide-angle camera usually has a larger shooting area, and because it is a fixed-focus camera, its shooting area remains the same. Therefore, when switching from the shooting area of the wide-angle camera to the area where the zoom camera is about to focus, you can use the image taken by the wide-angle camera For reference, to speed up the convergence of the zoom camera's exposure parameters.
  • the overall brightness of the captured image can be obtained through a wide-angle camera.
  • the wide-angle camera may be used to calculate the brightness difference between the brightness of the target area in the image taken by itself and the obtained overall brightness.
  • ideal exposure parameters can be calculated.
  • the ideal exposure parameter may be the ideal exposure parameter of the target area on the wide-angle camera. If the wide-angle camera uses the ideal exposure parameter, the brightness of the target area will reach the ideal brightness under the ideal exposure parameter.
  • the ideal exposure parameter can be provided to the zoom camera, and the zoom camera pre-adjusts the current own exposure parameter through the ideal exposure parameter.
  • the exposure parameters of the zoom camera are not much different from the most suitable exposure parameters for focusing on the target area. Therefore, the exposure parameters can be quickly calculated when the exposure parameters are further calculated by the self-exposure algorithm. Convergence, tends to a stable value, so that the image brightness can quickly return to stability.
  • the ideal exposure parameter is determined by the wide-angle camera and sent to the zoom camera.
  • the ideal exposure parameter is determined by the wide-angle camera for the target area by taking the overall brightness of the captured image as the target brightness of the target area.
  • the image taken by the wide-angle camera is divided into a plurality of blocks, and the brightness of the target area in the image taken by the wide-angle camera is the corresponding area of the target area in the image taken by the wide-angle camera The brightness of the block.
  • the brightness of the target area is the average brightness of the multiple blocks.
  • the ideal exposure parameter is corrected by a preset weight coefficient before being used for pre-adjustment.
  • the pre-adjusting the current exposure parameters of the zoom camera according to the ideal exposure parameters includes:
  • the current exposure parameter of the zoom camera is set as the corrected ideal exposure parameter.
  • the target area is a focus area determined by the wide-angle camera in response to a user's trigger.
  • the current exposure parameters are pre-adjusted, and the pre-adjusted exposure parameters meet the convergence conditions.
  • the exposure parameters are not much different, so in the subsequent calculation of the automatic exposure algorithm, the exposure parameters can quickly converge, and the image brightness can quickly return to stability.
  • FIG. 6 is a schematic structural diagram of a zoom camera according to a third aspect of an embodiment of the present application.
  • the zoom camera includes a zoom lens 601, a processor 602, and a memory 603.
  • the memory 603 is configured to store the correspondence relationship between the focal length and the minimum aperture value, and in the correspondence relationship, the minimum aperture value changes gently with the change of the focal length;
  • the processor 602 is configured to adjust the aperture value according to the corresponding relationship stored in the memory 603 during the zooming process of the zoom lens 601, so as to eliminate sudden changes in image brightness.
  • the minimum aperture value is positively correlated with the focal length, and the step length of the minimum aperture value with the focal length is smaller than the preset value.
  • the processor is further configured to use an automatic exposure algorithm to adjust the aperture value according to the corresponding relationship when the zoom lens is zoomed in the automatic exposure mode.
  • the processor is further configured to, according to the corresponding relationship, determine the amount of change in the aperture value corresponding to the zoom lens from the current focal length to the target focal length, and use the automatic exposure according to the amount of change in the aperture value.
  • the algorithm determines the amount of change of other exposure parameters, and adjusts the other exposure parameters according to the amount of change of the other exposure parameters to compensate for the amount of change of the aperture value.
  • the target focal length is determined in response to a user's trigger instruction.
  • the target focal length is determined according to the focus area selected by the user and/or the focus magnification set by the user.
  • the other exposure parameters include one or more of the following: sensitivity ISO, shutter time.
  • the zoom camera is connected to a wide-angle camera
  • the processor is also used for pre-adjusting current exposure parameters according to ideal exposure parameters during the zooming process of switching from the shooting area of the wide-angle camera to the target area in the shooting area; wherein, the ideal The exposure parameter is determined according to the brightness difference between the brightness of the target area in the image captured by the wide-angle camera and the overall brightness of the image captured by the wide-angle camera.
  • the ideal exposure parameter is determined by the wide-angle camera and sent to the zoom camera.
  • the ideal exposure parameter is determined by the wide-angle camera for the target area by taking the overall brightness of the captured image as the target brightness of the target area.
  • the image taken by the wide-angle camera is divided into a plurality of blocks, and the brightness of the target area in the image taken by the wide-angle camera is the corresponding area of the target area in the image taken by the wide-angle camera The brightness of the block.
  • the brightness of the target area is the average brightness of the multiple blocks.
  • the ideal exposure parameter is corrected by a preset weight coefficient before being used for pre-adjustment.
  • the processor is specifically configured to set the current exposure parameter as the corrected ideal exposure parameter.
  • the target area is a focus area determined by the wide-angle camera in response to a user's trigger.
  • Fig. 7 is a schematic structural diagram of a combined camera provided by the fourth aspect of the embodiments of the present application.
  • the combined camera includes: a wide-angle camera 701 and a zoom camera 702.
  • the wide-angle camera 701 is used to obtain the overall brightness of the captured image; obtain the target area selected by the user in the captured image;
  • the zoom camera 702 is used for pre-adjusting the current exposure parameters according to ideal exposure parameters when zooming and shooting the target area; wherein, the ideal exposure parameters are based on the target area in the wide-angle camera
  • the brightness difference between the brightness of the image captured by 701 and the overall brightness of the image captured by the wide-angle camera 701 is determined.
  • the ideal exposure parameter is determined by the wide-angle camera and sent to the zoom camera.
  • the ideal exposure parameter is determined by the wide-angle camera for the target area by taking the overall brightness of the captured image as the target brightness of the target area.
  • the image taken by the wide-angle camera is divided into a plurality of blocks, and the brightness of the target area in the image taken by the wide-angle camera is the corresponding area of the target area in the image taken by the wide-angle camera The brightness of the block.
  • the brightness of the target area is the average brightness of the multiple blocks.
  • the ideal exposure parameter is corrected by a preset weight coefficient before being used for pre-adjustment.
  • the zoom camera is specifically used to set the current exposure parameter as the corrected ideal exposure parameter.
  • FIG. 8 is a schematic structural diagram of an unmanned aerial vehicle according to the fifth aspect of the embodiments of the present application.
  • the drone includes a fuselage 810 with a zoom camera 820 mounted on the fuselage.
  • the zoom camera 820 is pre-configured with a correspondence relationship between a focal length and a minimum aperture value. In the correspondence relationship, the minimum aperture value varies with the focal length.
  • the zoom camera 820 is used to adjust the aperture value according to the corresponding relationship during the zooming process to eliminate sudden changes in image brightness.
  • the minimum aperture value is positively related to the focal length, and the step length of the minimum aperture value with the focal length is smaller than a preset value.
  • the zoom camera is further configured to use an automatic exposure algorithm to adjust the aperture value according to the corresponding relationship when zooming in the automatic exposure mode.
  • the zoom camera is further configured to determine the change in aperture value corresponding to zooming from the current focal length to the target focal length according to the corresponding relationship, and use the automatic exposure algorithm to determine other exposures according to the change in aperture value.
  • the amount of change of the parameter is adjusted according to the amount of change of the other exposure parameter to compensate for the amount of change of the aperture value.
  • the target focal length is determined in response to a user's trigger instruction.
  • the target focal length is determined according to the focus area selected by the user and/or the focus magnification set by the user.
  • the other exposure parameters include one or more of the following: sensitivity ISO, shutter time.
  • the drone is also equipped with a wide-angle camera, and the wide-angle camera is connected to the zoom camera;
  • the zoom camera is also used for pre-adjusting current exposure parameters according to ideal exposure parameters during the zooming process of switching from the shooting area of the wide-angle camera to the target area in the shooting area;
  • the ideal exposure parameter is determined according to the brightness difference between the brightness of the target area in the image captured by the wide-angle camera and the overall brightness of the image captured by the wide-angle camera.
  • the ideal exposure parameter is determined by the wide-angle camera and sent to the zoom camera.
  • the ideal exposure parameter is determined by the wide-angle camera for the target area by taking the overall brightness of the captured image as the target brightness of the target area.
  • the image taken by the wide-angle camera is divided into a plurality of blocks, and the brightness of the target area in the image taken by the wide-angle camera is the corresponding area of the target area in the image taken by the wide-angle camera The brightness of the block.
  • the brightness of the target area is the average brightness of the multiple blocks.
  • the ideal exposure parameter is corrected by a preset weight coefficient before being used for pre-adjustment.
  • the zoom camera is specifically used to set the current exposure parameter as the corrected ideal exposure parameter.
  • the target area is a focus area determined by the wide-angle camera in response to a user's trigger.
  • FIG. 9 is a schematic structural diagram of an unmanned aerial vehicle according to the sixth aspect of the embodiments of the present application.
  • the drone includes a fuselage 910 with a combined camera 920 mounted on the fuselage, and the combined camera 920 includes a zoom camera 922 and a wide-angle camera 921;
  • the wide-angle camera 921 is used to obtain the overall brightness of the captured image; obtain the target area selected by the user in the captured image;
  • the zoom camera 922 is used for pre-adjusting current exposure parameters according to ideal exposure parameters when zooming and shooting the target area; wherein, the ideal exposure parameters are based on the target area in the wide-angle camera The brightness difference between the brightness of the captured image and the overall brightness of the image captured by the wide-angle camera is determined.
  • the ideal exposure parameter is determined by the wide-angle camera and sent to the zoom camera.
  • the ideal exposure parameter is determined by the wide-angle camera for the target area by taking the overall brightness of the captured image as the target brightness of the target area.
  • the image taken by the wide-angle camera is divided into a plurality of blocks, and the brightness of the target area in the image taken by the wide-angle camera is the corresponding area of the target area in the image taken by the wide-angle camera The brightness of the block.
  • the brightness of the target area is the average brightness of the multiple blocks.
  • the ideal exposure parameter is corrected by a preset weight coefficient before being used for pre-adjustment.
  • the zoom camera is specifically used to set the current exposure parameter as the corrected ideal exposure parameter.
  • a seventh aspect of the embodiments of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, it implements the steps of the image processing method in any one of the above-mentioned implementations of the first aspect.
  • An eighth aspect of the embodiments of the present application provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the image processing method in any one of the above-mentioned second aspect are implemented.
  • Computer-readable storage media suitable for storing computer program instructions and data include all forms of non-volatile memory, media, and memory devices, including, for example, semiconductor memory devices (such as EPROM, EEPROM, and flash memory devices), magnetic disks (such as internal hard disks or Removable disks), magneto-optical disks, CD ROM and DVD-ROM disks.
  • semiconductor memory devices such as EPROM, EEPROM, and flash memory devices
  • magnetic disks such as internal hard disks or Removable disks
  • magneto-optical disks CD ROM and DVD-ROM disks.
  • the processor and the memory can be supplemented by or incorporated into a dedicated logic circuit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

本申请实施例提供了一种图像处理方法，包括：在变焦过程中，根据预先配置的焦距与最小光圈值的对应关系对光圈值进行调整，以消除图像亮度的突变；在所述对应关系中，最小光圈值随焦距的变化而平缓变化。本申请实施例提供的图像处理方法，意在解决相机在变焦过程中所拍摄图像的亮度会发生突变的技术问题。本申请实施例还提供了一种变焦相机、相机负载装置及无人机。

Description

图像处理方法、变焦相机、相机负载装置、无人机 技术领域
本申请涉及图像处理技术领域，尤其涉及一种图像处理方法、变焦相机、相机负载装置、无人机及计算机可读存储介质。
背景技术
在使用相机进行拍摄时，为拍摄出高质量的图像，用户通常会使用相机的最小光圈值(即最大光圈)进行拍摄。而在焦距增大的过程中，为保持最小光圈值，镜头的通光孔径也会随焦距增大。但镜头的通光孔径受到最大孔径的限制，在达到最大孔径后，若焦距继续增大，相机的最小光圈值将无法保持。
目前市面上的相机，在变焦过程中最小光圈值随焦距的变化较为激烈，从而导致变焦过程中所拍摄图像的亮度会发生突变，大大降低用户的体验。
发明内容
有鉴于此，本申请实施例提供一种图像处理方法、变焦相机、相机负载装置及无人机，意在解决相机在变焦过程中所拍摄图像的亮度会发生突变的技术问题。
本申请实施例第一方面提供了一种图像处理方法，包括：
在变焦过程中，根据预先配置的焦距与最小光圈值的对应关系对光圈值进行调整，以消除图像亮度的突变；
在所述对应关系中，最小光圈值随焦距的变化而平缓变化。
本申请实施例第二方面提供了一种图像处理方法，所述方法包括：
通过广角相机获取所拍摄图像的整体亮度；
获取用户在所拍摄图像中选择的目标区域；
在通过变焦相机对所述目标区域进行变焦拍摄时，根据理想曝光参数对所述变焦相机当前的曝光参数进行预调整；
其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
本申请实施例第三方面提供了一种变焦相机，包括：变焦镜头、处理器与存储器；
所述存储器，用于存储焦距与最小光圈值的对应关系，在所述对应关系中，最小光圈值随焦距的变化而平缓变化；
所述处理器，用于在所述变焦镜头的变焦过程中，根据所述存储器中存储的所述对应关系对光圈值进行调整，以消除图像亮度的突变。
本申请实施例第四方面提供了一种组合相机，包括：广角相机与变焦相机；
所述广角相机用于，获取所拍摄图像的整体亮度；获取用户在所拍摄图像中选择的目标区域；
所述变焦相机用于，在对所述目标区域进行变焦拍摄时，根据理想曝光参数对当前的曝光参数进行预调整；其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
本申请实施例第五方面提供了一种无人机，装载有变焦相机，所述变焦相机预先配置有焦距与最小光圈值的对应关系，在所述对应关系中，最小光圈值随焦距的变化而平缓变化；
所述变焦相机用于，在变焦过程中，根据所述对应关系对光圈值进行调整，以消除图像亮度的突变。
本申请实施例第六方面提供了一种无人机，装载有组合相机，所述组合相机包括：变焦相机与广角相机；
所述广角相机用于，获取所拍摄图像的整体亮度；获取用户在所拍摄图像中选择的目标区域；
所述变焦相机用于，在对所述目标区域进行变焦拍摄时，根据理想曝光参数对当前的曝光参数进行预调整；其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
本申请实施例第七方面提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述第一方面的任一种实施方式下的图像处理方法的步骤。
本申请实施例第八方面提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述第二方面的任一种实施方式下的图像处理方法的步骤。
本申请实施例提供了一种图像处理方法，在变焦过程中，根据预先配置的焦距与最小光圈值的对应关系对光圈值进行调整，其中，在该对应关系中，最小光圈值随焦 距的变化而平缓变化。可见，由于变焦过程中，最小光圈值是平缓变化的，因此图像亮度也不会发生突变。
附图说明
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1A是现有的光圈值调整策略中最小光圈值的变化曲线。
图1B是在手动模式下使用现有的光圈值调整策略进行变焦时图像亮度的变化曲线。
图2是本申请实施例第一方面提供的一种图像处理方法的流程图。
图3A是本申请实施例提供的一种示例性的光圈值调整策略中最小光圈值随焦距的变化示意图。
图3B是在手动模式下使用图3A所示的光圈值调整策略进行变焦时图像亮度的变化曲线。
图3C是本申请实施例提供的另一种示例性的光圈值调整策略中最小光圈值随焦距的变化示意图。
图4是本申请实施例提供的一种无人机的云台组合相机的结构示意图。
图5是本申请实施例第二方面提供的图像处理方法的流程图。
图6是本申请实施例第三方面提供的一种变焦相机的结构示意图。
图7是本申请实施例第四方面提供的一种组合相机的结构示意图。
图8是本申请实施例第五方面提供的一种无人机的结构示意图。
图9是本申请实施例第六方面提供的一种无人机的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
光圈值，是镜头的焦距与镜头通光孔径的比值。若光圈值用F表示，焦距用f表示，通光孔径用d表示，则光圈值的计算公式为F＝f/d。可以理解的是，通常所说的最大光圈实际是对应最小光圈值，如最大光圈F2.8，其含义与最小光圈值为F2.8相同。
在大多数的拍摄场景中，用户都希望能够使用相机的最大光圈，以拍摄出质量较高的图像。但在变焦过程中，由于焦距f持续变化，光圈值F通常难以保持不变。比如对于支持1X-17.5X变焦倍率的相机，若从1X使用最小光圈值，并从1X向17.5X进行变焦，随着焦距f的持续增大，为保持光圈值F不变，镜头的通光孔径d也需要随之增大。但镜头的通光孔径d受到最大孔径的限制，在达到最大孔径后，若焦距f仍继续增大，则光圈值F也只能增大。
上述问题在浮动光圈镜头中虽然无法避免，但也有相应的调整策略。由于用户通常希望其使用的光圈值(一般使用的是最大光圈)能够维持，因此在现有的光圈值调整策略中都是侧重于使变焦过程中光圈值尽可能少的变化。可以参见图1A，图1A示出现有的光圈值调整策略中最小光圈值的变化曲线。
图1A中，位于上方的曲线表示最小光圈值随时间的变化曲线，而下方的曲线表示焦距随时间的变化曲线。结合两者可知，在现有的调整策略中，当焦距在某些特定焦段内变化时，最小光圈值可以保持不变，但相应的，当焦距在其他焦段内变化时，最小光圈值的变化斜率很大。可见，在现有的调整策略中，由于最小光圈值在变化时较为激烈，因此所拍摄图像的亮度会发生突变，影响图像质量，给用户的体验较差。可以参见图1B，图1B是在手动模式下使用现有的光圈值调整策略进行变焦时图像亮度的变化曲线。在图1B中，焦距先增大后减小，对应图像亮度先下降后上升。其中，图像亮度的变化与图1A的最小光圈值随时间的变化是相对应的，最小光圈值随焦距变化保持不变时，图像亮度也可以保持稳定，最小光圈值随焦距变化激烈变化时，图像亮度发生突变。
为解决上述问题，本申请实施例第一方面提供一种图像处理方法，可以参见图2，图2是本申请实施例第一方面提供的一种图像处理方法的流程图，该方法包括步骤：
S201：获取变焦指令；
S202：响应于变焦指令进行变焦的过程中，根据预先配置的焦距与最小光圈值的对应关系对光圈值进行调整，以消除图像亮度的突变，其中，在所述对应关系中，最小光圈值随焦距的变化而平缓变化。
本申请实施例提供的方法可以应用于变焦相机中，当然也可以应用于其他包括变焦镜头的设备，如摄像机、手机、平板、笔记本、监控设备等等。
为方便理解，可以参见图3A，图3A示出本申请实施例提供的一种示例性的光圈值调整策略中最小光圈值随焦距的变化示意图。与图1A相同，位于上方的曲线表示最小光圈值随时间的变化曲线，而下方的曲线表示焦距随时间的变化曲线。可见，最小光圈值随焦距的增大而平缓增大。
由于最小光圈值随焦距的变化是平缓的，因此所拍摄图像的亮度受光圈值的影响也是平缓的，从而不会出现亮度突变。可以参见图3B，图3B是在手动模式下使用图3A所示的光圈值调整策略进行变焦时图像亮度的变化曲线。在图3B中，与图1B相同的，焦距先增大后减小，对应图像亮度先下降后上升。可见，采用图3A所示的光圈值调整策略后，图像亮度不会发生突变，在手动模式下增大焦距时，图像亮度可以随着光圈值的增大而平缓下降。
对于最小光圈值随焦距变化而平缓变化，在实际中可以体现为多种形式。比如，在一种实施中，最小光圈值可以与焦距正相关，且最小光圈值随焦距的变化步长小于预设值。所谓正相关，表明焦距增大时，最小光圈值也增大；而变化步长小于预设值，即最小光圈值变化的最小单位小于预设值。
需要注意的是，变化步长可以不是一个固定的值，变化步长只要小于预设值即可，如图3A所示的对应关系中，最小光圈值与焦距之间并非呈线性关系。比如在一种实施中，可以设定预设值为0.8，焦距从10mm增大至15mm，最小光圈值增大0.4(即变化步长为0.4，小于0.8)；而焦距从15mm增大至20mm，最小光圈值增大0.5(即变化步长为0.5，小于0.8)。
当然，最小光圈值随焦距变化而平缓变化也有其他的实施方式。比如，在另一种实施中，最小光圈值可以随焦距变化而阶梯式的变化，可以参见图3C，图3C示出本申请实施例提供的另一种示例性的光圈值调整策略中最小光圈值随焦距的变化示意图。可见，最小光圈值在小范围焦距变化时可以保持不变，但整体上看，最小光圈值仍然随焦距的变化而平缓变化，因此图像的亮度也不会发生突变。
焦距与最小光圈值的对应关系可以预先通过校正的方式获得。可以举个具体的例子，比如从最短焦距18mm增大到最长焦距55mm的过程中，最小光圈值不可避免的会从F2.8增大至F5.6，对应的图像亮度的luma值会从260下降到60，则可以确定上述对应关系中的起点是(18，2.8)与终点是(55，5.6)。在具体校正时，由于希望焦距增大时图像亮度平滑下降，因此可以选取一些焦距作为样本点，针对每个样本点设定一个期望的图像亮度值，比如焦距18mm对应luma值是260，则可以设定焦距20mm对应的luma值是250，焦距22mm对应的luma值是240……在每个样本点对应的焦距 下，根据设定的图像亮度，对原始出厂的最小光圈值进行校正，从而可以确定各个样本点对应校正后的最小光圈值。进一步的，可以对各个样本点进行曲线拟合，得到焦距与最小光圈值的对应关系，且该对应关系中，最小光圈值随焦距的变化平缓变化。
需要注意的是，通过上述对应关系对光圈值进行调整，图像亮度虽然不会出现突变，但图像亮度仍然会持续的平滑变化。如图3B所示，若采用手动模式、将焦距调至最短焦距、将光圈值设定为最小光圈值，那么，在从最短焦距向最长焦距进行变焦的过程中，随着焦距的增大，光圈值不断通过上述提供的对应关系进行调整，光圈值也将平缓的增大，而由于手动模式下其他曝光参数(如感光度ISO与快门时间)均保持不变，因此图像亮度随光圈值平缓的增大将平缓的下降。
图像亮度的下降通常会降低图像的质量，这不是用户希望看见的。因此，在另一种场景中，可以使用自动曝光模式。在自动曝光模式下，相机中的自动曝光算法可以自动的对ISO、快门时间以及光圈值进行调整，以使所拍摄的图像保持合适的亮度。具体的，在一种实施中，可以对自动曝光算法进行修改，将上述提供的对应关系修改至自动曝光算法中，以使自动曝光算法可以根据上述提供的对应关系计算新的光圈值，并将计算得到的新的光圈值应用到相机。在另一种实施中，也可以使自动曝光算法在计算新的光圈值时调用上述提供的对应关系，从而对光圈值进行调整。
自动曝光算法所调整的曝光参数中，光圈值可以根据上述提供的对应关系进行调整。而其他曝光参数，如ISO与快门时间，可以适应光圈值的变化进行调整。
在一个可选的实施方式中，其他曝光参数可以通过以下方式确定：
根据上述提供的对应关系，确定从当前焦距变焦至目标焦距对应的光圈值变化量；根据所述光圈值变化量，利用所述自动曝光算法确定其他曝光参数的变化量。
由于光圈值将根据上述提供的对应关系进行调整，因此，当变焦范围确定时，光圈值变化量也可以预估出来。比如，若确定当前焦距是35mm，目标焦距是50mm，则可以根据焦距与最小光圈值的对应关系，确定焦距从35mm变化至50mm对应的光圈值变化量。确定出的光圈值变化量可以提供给自动曝光算法，自动曝光算法可以根据光圈值变化量计算其他曝光参数的变化量，并可以根据计算出的其他曝光参数的变化量对其他曝光参数进行调整，从而实现对光圈值变化量的补偿，使所拍摄图像的亮度稳定，不会随着光圈值的变化而变化。
比如上述例子中，焦距从35mm变化至50mm，最小光圈值将会增大，最小光圈值的增大将引起所拍摄图像亮度的降低，而自动曝光算法可以通过调整ISO和快门时间，使所拍摄图像的亮度得以保持，相当于弥补了光圈值的变化量。而若仍然采用现 有技术中的光圈值调整策略，由于最小光圈值的变化过于激烈，即便自动曝光算法从ISO和快门时间下手对光圈值的变化率进行补偿，也无法补平，图像亮度仍然会发生突变。因此，只有在采用本申请实施例提供的焦距与最小光圈值的对应关系后，再结合自动曝光算法，才能实现变焦过程中图像亮度稳定不变。
需要说明的是，目标焦距可以是响应于用户的触发指令确定的。在一种场景中，可以是用户滑动触摸屏上的控件进行调焦，并根据用户滑动的位置确定目标焦距。在另一种场景中，可以是用户选定所拍摄图像中的某一区域作为对焦区域，则可以根据用户选定的对焦区域确定目标焦距。当然，还有其他的场景，比如在具有识别功能的相机中，可以智能的识别图像中的目标对象，并自动对焦到该目标对象上，此时目标焦距也可以确定得到。
以上所提供的各种实施方式下的图像处理方法可以应用于变焦相机。变焦相机本身可以是一个独立的产品，但其也可以某个产品的一部分，比如其可以是组合相机中的其中一个相机。可以理解的，一个具有拍摄功能的产品中可以集成多种相机。比如手机作为一种移动终端设备，就可以集成多种相机，如广角相机、长焦相机、超广角相机等等。又比如，无人机搭载的云台相机也可以是结合多种相机的组合相机，可以参见图4，图4是本申请实施例提供的一种无人机的云台组合相机的结构示意图。如图4所示，云台组合相机中可以包括红外相机401、广角相机402与变焦相机403。当然还有其他产品，在此不一一列举。
在包括有广角相机与变焦相机的产品中，一种可选的实施方式是，变焦相机可以结合广角相机提供的信息，协同广角相机进行曝光，以加快曝光参数的收敛。
自动曝光算法计算曝光参数的过程可以认为是曝光参数的收敛过程。在变焦相机的变焦过程中，由于光圈值将发生改变，因此所拍摄图像的亮度受光圈值的影响也会发生改变。此时，自动曝光算法可以对光圈值变化量进行补偿，计算出新的曝光参数并应用。而应用后图像亮度发生改变，自动曝光算法将再次根据改变后的图像亮度计算新的曝光参数……如此循环多次，直至图像亮度满足要求、曝光参数收敛。可见，曝光参数的收敛时间与图像亮度恢复稳定的速度是直接关联的，曝光参数的收敛时间越短，则图像亮度恢复稳定的速度则更快。
为缩短曝光参数的收敛时间，提高收敛速度，在本可选的实施方式中，上述所提供的图像处理方法可以应用于变焦相机，该变焦相机还可以与一广角相机连接，该图像处理方法还包括以下步骤：
在由广角相机的拍摄区域切换至拍摄区域中的目标区域的变焦过程中，根据理想 曝光参数对当前的曝光参数进行预调整。
其中，理想曝光参数是根据目标区域在广角相机所拍摄图像中的亮度与广角相机所拍摄图像的整体亮度的亮度差确定的。
考虑到变焦相机在变焦过程中，其拍摄区域随焦距变化，比如从短焦距调整至长焦距时，能拍摄到的区域将变小。而广角相机通常拍摄区域较大，且由于是定焦相机，其拍摄区域保持不变，因此，在从广角相机的拍摄区域切换到变焦相机即将对焦过去的区域时，可以以广角相机所拍摄图像为参考，从而加快变焦相机的曝光参数收敛。
具体的，可以将变焦相机即将对焦过去的区域称为目标区域，该目标区域是广角相机所拍摄的广角图像中某一部分。进一步的，可以确定该目标区域在广角相机所拍摄图像中的亮度，将确定出目标区域对应的亮度与广角相机所拍摄图像的整体亮度进行比较，得到亮度差。根据该亮度差，可以确定理想曝光参数，该理想曝光参数提供给变焦相机，以帮助加快变焦相机曝光参数的收敛。
上述的广角相机所拍摄图像的整体亮度，在确定时可以有多种方式。具体的，整体亮度的确定主要基于测光模式。可以采用的测光模式有多种，包括但不限于：点测光(矩阵测光)、评价测光(多重测光)、局部测光、中央重点平均测光。
需要说明的是，理想曝光参数是针对上述目标区域的曝光参数。广角相机有自身的曝光参数，但该曝光参数是自动曝光算法针对所拍摄图像的整体亮度计算出来的，而对于所拍摄图像的局部区域，该局部区域的亮度通常并未达到理想亮度。可以举一个稍具体的例子，比如在广角相机所拍摄的风景图像中，风景图像的整体亮度符合设定的要求，但风景图像中的树荫下的局部区域(该局部区域被选定为目标区域)却仍然太暗，未达到理想中的亮度。因此，可以通过自动曝光算法针对该目标区域计算对应的理想曝光参数，在该理想曝光参数下，目标区域的亮度将达到理想中的亮度。
理想曝光参数的计算可以由广角相机进行，也可以由变焦相机进行。在一种实施中，理想曝光参数的计算可以由变焦相机进行，广角相机可以将其自身当前的曝光参数以及确定的亮度差发送给变焦相机，变焦相机利用广角相机提供的信息，并结合自身当前的曝光参数计算理想曝光参数。具体的，在计算时，一种可选的实施方式是，变焦相机可以利用广角相机提供的曝光参数与自身的曝光参数计算出折算比例，通过该折算比例对广角相机所提供的亮度差进行修正，在将修正后的亮度差提供给变焦相机自身的自动曝光算法，有自动曝光算法根据修正后的亮度差计算出理想曝光参数。
虽然理想曝光参数由变焦相机计算是可行的，但广角相机需要向变焦相机提供相关的信息，广角相机与变焦相机之间需要交互，计算效率并不高。因此，另一种可选 的实施方式是，理想曝光参数的计算可以由广角相机进行，广角相机可以通过自身的自动曝光算法针对该目标区域计算对应的理想曝光参数。具体的，在计算时，一种可选的实施方式是，广角相机可以以所拍摄图像的整体亮度为目标区域的目标亮度，计算目标区域对应的理想曝光参数。不难发现，若广角相机使用计算出的理想曝光参数，所拍摄图像中目标区域对应部分的亮度可以达到上述的目标亮度。
上述的目标区域在广角相机所拍摄图像中的亮度，在确定时有多种实施方式。比如，在一种实施中，可以在目标区域确定后，截取出该目标区域在广角相机所拍摄图像中对应的局部图像，并对截取出的局部图像进行亮度分析，将分析出的亮度作为目标区域在广角相机所拍摄图像中的亮度。在另一种实施中，还可以将广角相机所拍摄图像划分为多个区块，并针对每一个区块进行亮度记录。在目标区域确定后，可以确定该目标区域在所拍摄图像中对应的区块，将对应的区块的亮度作为目标区域在广角相机所拍摄图像中的亮度。可以理解，广角相机所拍摄图像的划分有多种实施方式，比如可以将所拍摄图像划分为n*n的方格，并记录下每个方格的亮度，当然，也并不一定要划分成方格，本领域技术人员可以根据需要采用各种划分方案。
需要注意的是，若划分的区块比较小，则确定的目标区域可能对应多个区块，此时可以将多个区块的平均亮度作为目标区域的亮度。
目标区域在具体确定时，也有多种可行的实施方式。在一个实施例中，目标区域可以是广角相机响应用户的触发确定的对焦区域。比如，用户可以在广角相机所拍摄的实时画面上进行点击，感应到用户的点击，可以将用户点击的区域确认为目标区域。在另一个实施例中，目标区域也可以是用户在变焦相机所拍摄的实时画面上进行点击而确定的，当然，变焦相机可以将用户选择的目标区域通知广角相机。
计算出的理想曝光参数可以提供给变焦相机以提高曝光参数收敛的速度。而变焦相机在利用理想曝光参数时，可以有多种实施方式。在一种实施方式中，可以利用计算出的理想曝光参数，并结合变焦相机自身当前的曝光参数，计算出变焦相机的新的曝光参数。具体计算时，在一个例子中，变焦相机的新的曝光参数可以是当前的曝光参数与理想曝光参数的线型组合。比如，可以预设一个权重系数，可以将该预设的权重系数用a表示。在一个例子中，可以通过以下方式计算新的曝光参数：
变焦相机的新的曝光参数＝初始曝光参数×(1-a)+理想曝光参数×a。
其中，a可以为0～1之间的任何数。比如，当a＝1时，则新的曝光参数可以直接等于理想曝光参数，当a＝0.2时，则新的曝光参数＝初始曝光参数×0.8+理想曝光参数×0.2。
计算出的新的曝光参数可以直接作为变焦相机待切换的曝光参数。
在另一种实施方式中，可以先对理想曝光参数进行修正，具体的，可以通过预设修正系数对理想曝光参数进行修正。修正后的理想曝光参数可以直接作为当前的曝光参数，即可以将当前的曝光参数设置为修正后的理想曝光参数。
在本实施例提供的图像处理方法中，在从广角相机的拍摄区域切换到变焦相机的目标区域的过程中，变焦相机可以根据理想曝光参数进行曝光参数的预调整，在预调整之后，变焦相机可以进一步通过自身的自动曝光算法对曝光参数进行收敛计算。由于当前的曝光参数已经预调整为新的曝光参数或修正后的理想曝光参数，因此当前的曝光参数与符合收敛条件的曝光参数已经相差不大，自动曝光算法在此基础上对曝光参数进行更新，曝光参数能够很快收敛，图像亮度能够快速恢复平稳。而在画面切换至目标区域之后，若进行变焦过程，则可以继续根据本申请提供的焦距与最小光圈值的对应关系对光圈值进行调整，由于在该对应关系中，最小光圈值随焦距是平缓变化的，因此图像亮度也不会发生突变。
以上为对本申请实施例第一方面提供图像处理方法进行的详细说明。
下面请参见图5，图5是本申请实施例第二方面提供的图像处理方法的流程图。该方法可以由包括变焦相机与广角相机的设备(如组合相机)执行，其中变焦相机与广角相机连接。该方法包括：
S501、通过广角相机获取所拍摄图像的整体亮度。
S502、获取用户在所拍摄图像中选择的目标区域。
S503、在通过变焦相机对所述目标区域进行变焦拍摄时，根据理想曝光参数对所述变焦相机当前的曝光参数进行预调整。
其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
组合相机可以包括有变焦相机与广角相机。其中，变焦相机在变焦过程中，其拍摄区域随焦距变化，比如从短焦距调整至长焦距时，能拍摄到的区域将变小。而广角相机通常拍摄区域较大，且由于是定焦相机，其拍摄区域保持不变，因此，在从广角相机的拍摄区域切换到变焦相机即将对焦过去的区域时，可以以广角相机所拍摄图像为参考，从而加快变焦相机的曝光参数收敛。
具体的，可以通过广角相机获取所拍摄图像的整体亮度。在获取到用户选择目标区域后，可以通过广角相机计算目标区域在自身所拍摄图像中的亮度与获取的整体亮度的亮度差。根据该亮度差可以计算出理想曝光参数。该理想曝光参数可以是目标区 域在广角相机上的理想曝光参数，若广角相机使用该理想曝光参数，在该理想曝光参数下，目标区域的亮度将达到理想中的亮度。
该理想曝光参数可以提供给变焦相机，由变焦相机通过该理想曝光参数对当前自身的曝光参数进行预调整。
由于在预调整之后，变焦相机的曝光参数与对焦到目标区域的最合适的曝光参数已经相差不大，因此在通过自身的自动曝光算法对曝光参数进行进一步的收敛计算时，曝光参数能够很快收敛，趋于一个稳定值，使得图像亮度能够快速恢复平稳。
可选的，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
可选的，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
可选的，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
可选的，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
可选的，所述理想曝光参数在被用于预调整之前经过了预设权重系数的修正。
可选的，所述根据理想曝光参数对所述变焦相机当前的曝光参数进行预调整，包括：
将所述变焦相机当前的曝光参数设置为修正后的理想曝光参数。
可选的，所述目标区域是所述广角相机响应用户的触发确定的对焦区域。
本申请实施例第二方面提供的图像处理方法，其中所包含的各种实施方式在前文中已有展开的说明，在此不再赘述。
本申请实施例第二方面提供的图像处理方法，在变焦相机通过自身的自动曝光算法对曝光参数进行收敛计算之前，对当前的曝光参数进行了预调整，预调整后的曝光参数与符合收敛条件的曝光参数已经相差不大，因此在自动曝光算法的后续计算中，曝光参数能够很快收敛，图像亮度能够快速恢复平稳。
下面请参见图6，图6是本申请实施例第三方面提供的一种变焦相机的结构示意图，该变焦相机包括：变焦镜头601、处理器602与存储器603。
所述存储器603，用于存储焦距与最小光圈值的对应关系，在所述对应关系中，最小光圈值随焦距的变化而平缓变化；
所述处理器602，用于在所述变焦镜头601的变焦过程中，根据所述存储器603 中存储的所述对应关系对光圈值进行调整，以消除图像亮度的突变。
可选的，最小光圈值与焦距正相关，且最小光圈值随焦距的变化步长小于预设值。
可选的，所述处理器还用于，在自动曝光模式下对所述变焦镜头进行变焦时，利用自动曝光算法根据所述对应关系对光圈值进行调整。
可选的，所述处理器还用于，根据所述对应关系，确定所述变焦镜头从当前焦距变焦至目标焦距对应的光圈值变化量，根据所述光圈值变化量，利用所述自动曝光算法确定其他曝光参数的变化量，根据所述其他曝光参数的变化量对所述其他曝光参数进行调整，以对所述光圈值变化量进行补偿。
可选的，所述目标焦距是响应于用户的触发指令确定的。
可选的，所述目标焦距是根据用户选定的对焦区域和/或用户设定的对焦倍率确定的。
可选的，所述其他曝光参数包括以下一种或多种：感光度ISO、快门时间。
可选的，所述变焦相机与广角相机连接；
所述处理器还用于，在由所述广角相机的拍摄区域切换至所述拍摄区域中的目标区域的变焦过程中，根据理想曝光参数对当前的曝光参数进行预调整；其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
可选的，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
可选的，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
可选的，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
可选的，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
可选的，所述理想曝光参数在被用于预调整之前经过了预设权重系数的修正。
可选的，所述处理器具体用于，将当前的曝光参数设置为修正后的理想曝光参数。
可选的，所述目标区域是所述广角相机响应用户的触发确定的对焦区域。
本申请实施例第三方面提供的变焦相机，其中所包含的各种实施方式在前文中已有展开的说明，在此不再赘述。
下面请参见图7，图7是本申请实施例第四方面提供的一种组合相机的结构示意 图。该组合相机包括：广角相机701与变焦相机702。
所述广角相机701用于，获取所拍摄图像的整体亮度；获取用户在所拍摄图像中选择的目标区域；
所述变焦相机702用于，在对所述目标区域进行变焦拍摄时，根据理想曝光参数对当前的曝光参数进行预调整；其中，所述理想曝光参数是根据所述目标区域在所述广角相机701所拍摄图像中的亮度与所述广角相机701所拍摄图像的整体亮度的亮度差确定的。
可选的，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
可选的，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
可选的，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
可选的，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
可选的，所述理想曝光参数在被用于预调整之前经过了预设权重系数的修正。
可选的，所述变焦相机具体用于，将当前的曝光参数设置为修正后的理想曝光参数。
本申请实施例第四方面提供的组合相机，其中所包含的各种实施方式在前文中已有展开的说明，在此不再赘述。
下面请参见图8，图8是本申请实施例第五方面提供的一种无人机的结构示意图。该无人机包括机身810，机身上装载有变焦相机820，所述变焦相机820预先配置有焦距与最小光圈值的对应关系，在所述对应关系中，最小光圈值随焦距的变化而平缓变化；
所述变焦相机820用于，在变焦过程中，根据所述对应关系对光圈值进行调整，以消除图像亮度的突变。
可选的，在所述对应关系中，最小光圈值与焦距正相关，且最小光圈值随焦距的变化步长小于预设值。
可选的，所述变焦相机还用于，在自动曝光模式下进行变焦时，利用自动曝光算法根据所述对应关系对光圈值进行调整。
可选的，所述变焦相机还用于，根据所述对应关系，确定从当前焦距变焦至目标 焦距对应的光圈值变化量，根据所述光圈值变化量，利用所述自动曝光算法确定其他曝光参数的变化量，根据所述其他曝光参数的变化量对所述其他曝光参数进行调整，以对所述光圈值变化量进行补偿。
可选的，所述目标焦距是响应于用户的触发指令确定的。
可选的，述目标焦距是根据用户选定的对焦区域和/或用户设定的对焦倍率确定的。
可选的，所述其他曝光参数包括以下一种或多种：感光度ISO、快门时间。
可选的，无人机还装载有广角相机，所述广角相机与所述变焦相机连接；
所述变焦相机还用于，在由所述广角相机的拍摄区域切换至所述拍摄区域中的目标区域的变焦过程中，根据理想曝光参数对当前的曝光参数进行预调整；
其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
可选的，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
可选的，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
可选的，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
可选的，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
可选的，所述理想曝光参数在被用于预调整之前经过了预设权重系数的修正。
可选的，所述变焦相机具体用于，将当前的曝光参数设置为修正后的理想曝光参数。
可选的，所述目标区域是所述广角相机响应用户的触发确定的对焦区域。
本申请实施例第五方面提供的无人机，其中所包含的各种实施方式在前文中已有展开的说明，在此不再赘述。
下面请参见图9，图9是本申请实施例第六方面提供的一种无人机的结构示意图。该无人机包括机身910，机身上装载有组合相机920，所述组合相机920包括：变焦相机922与广角相机921；
所述广角相机921用于，获取所拍摄图像的整体亮度；获取用户在所拍摄图像中选择的目标区域；
所述变焦相机922用于，在对所述目标区域进行变焦拍摄时，根据理想曝光参数对当前的曝光参数进行预调整；其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
可选的，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
可选的，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
可选的，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
可选的，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
可选的，所述理想曝光参数在被用于预调整之前经过了预设权重系数的修正。
可选的，所述变焦相机具体用于，将当前的曝光参数设置为修正后的理想曝光参数。
本申请实施例第六方面提供的无人机，其中所包含的各种实施方式在前文中已有展开的说明，在此不再赘述。
本申请实施例第七方面提供一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述第一方面任一种实施方式下的图像处理方法的步骤。
本申请实施例第八方面提供一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述第二方面任一种实施方式下的图像处理方法的步骤。
以上实施例中提供的技术特征，只要不存在冲突或矛盾，本领域技术人员可以根据实际情况对各个技术特征进行组合，从而构成各种不同的实施例。而本申请文件限于篇幅，未对各种不同的实施例展开说明，但可以理解的是，各种不同的实施例也属于本申请实施例公开的范围。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。
适合于存储计算机程序指令和数据的计算机可读存储介质包括所有形式的非易失性存储器、媒介和存储器设备，例如包括半导体存储器设备(例如EPROM、EEPROM和闪存设备)、磁盘(例如内部硬盘或可移动盘)、磁光盘以及CD ROM和DVD-ROM盘。处理器和存储器可由专用逻辑电路补充或并入专用逻辑电路中。
以上对本申请实施例所提供的方法和装置进行了详细介绍，本文中应用了具体个例对本发明的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本发明的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本申请的限制。

Claims (69)

  1. 一种图像处理方法，其特征在于，包括：
    在变焦过程中，根据预先配置的焦距与最小光圈值的对应关系对光圈值进行调整，以消除图像亮度的突变；
    在所述对应关系中，最小光圈值随焦距的变化而平缓变化。
  2. 根据权利要求1所述的图像处理方法，其特征在于，在所述对应关系中，最小光圈值与焦距正相关，且最小光圈值随焦距的变化步长小于预设值。
  3. 根据权利要求1所述的图像处理方法，其特征在于，在变焦过程中，根据所述对应关系对光圈值进行调整，包括：
    在自动曝光模式下进行变焦时，利用自动曝光算法根据所述对应关系对光圈值进行调整。
  4. 根据权利要求3所述的图像处理方法，其特征在于，利用自动曝光算法根据所述对应关系对光圈值进行调整之后，还包括：
    根据所述对应关系，确定从当前焦距变焦至目标焦距对应的光圈值变化量；
    根据所述光圈值变化量，利用所述自动曝光算法确定其他曝光参数的变化量；
    根据所述其他曝光参数的变化量对所述其他曝光参数进行调整，以对所述光圈值变化量进行补偿。
  5. 根据权利要求4所述的图像处理方法，其特征在于，所述目标焦距是响应于用户的触发指令确定的。
  6. 根据权利要求4所述的图像处理方法，其特征在于，所述目标焦距是根据用户选定的对焦区域和/或用户设定的对焦倍率确定的。
  7. 根据权利要求4所述的图像处理方法，其特征在于，所述其他曝光参数包括以下一种或多种：感光度ISO、快门时间。
  8. 根据权利要求1所述的图像处理方法，其特征在于，所述方法适用于变焦相机，所述变焦相机与广角相机连接，所述根据预先配置的焦距与最小光圈值的对应关系对光圈值进行调整，以消除图像亮度的突变之前，还包括：
    在由所述广角相机的拍摄区域切换至所述拍摄区域中的目标区域的变焦过程中，根据理想曝光参数对当前的曝光参数进行预调整；
    其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
  9. 根据权利要求8所述的图像处理方法，其特征在于，所述理想曝光参数是所述 广角相机确定出来后发送给所述变焦相机的。
  10. 根据权利要求9所述的图像处理方法，其特征在于，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
  11. 根据权利要求8所述的图像处理方法，其特征在于，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
  12. 根据权利要求11所述的图像处理方法，其特征在于，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
  13. 根据权利要求8所述的图像处理方法，其特征在于，所述根据理想曝光参数对当前的曝光参数进行预调整，包括：
    结合理想曝光参数与当前的曝光参数进行计算，根据计算出的新的曝光参数进行预调整。
  14. 根据权利要求13所述的图像处理方法，其特征在于，所述新的曝光参数是所述当前的曝光参数与所述理想曝光参数的线性组合。
  15. 根据权利要求8所述的图像处理方法，其特征在于，所述目标区域是所述广角相机响应用户的触发确定的对焦区域。
  16. 一种图像处理方法，其特征在于，所述方法包括：
    通过广角相机获取所拍摄图像的整体亮度；
    获取用户在所拍摄图像中选择的目标区域；
    在通过变焦相机对所述目标区域进行变焦拍摄时，根据理想曝光参数对所述变焦相机当前的曝光参数进行预调整；
    其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
  17. 根据权利要求16所述的图像处理方法，其特征在于，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
  18. 根据权利要求17所述的图像处理方法，其特征在于，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
  19. 根据权利要求16所述的图像处理方法，其特征在于，所述广角相机所拍摄图 像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
  20. 根据权利要求19所述的图像处理方法，其特征在于，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
  21. 根据权利要求16所述的图像处理方法，其特征在于，所述根据理想曝光参数对所述变焦相机当前的曝光参数进行预调整，包括：
    结合理想曝光参数与当前的曝光参数进行计算，根据计算出的新的曝光参数进行预调整。
  22. 根据权利要求21所述的图像处理方法，其特征在于，所述新的曝光参数是所述当前的曝光参数与所述理想曝光参数的线性组合。
  23. 根据权利要求16所述的图像处理方法，其特征在于，所述目标区域是所述广角相机响应用户的触发确定的对焦区域。
  24. 一种变焦相机，其特征在于，包括：变焦镜头、处理器与存储器；
    所述存储器，用于存储焦距与最小光圈值的对应关系，在所述对应关系中，最小光圈值随焦距的变化而平缓变化；
    所述处理器，用于在所述变焦镜头的变焦过程中，根据所述存储器中存储的所述对应关系对光圈值进行调整，以消除图像亮度的突变。
  25. 根据权利要求24所述的变焦相机，其特征在于，在所述对应关系中，最小光圈值与焦距正相关，且最小光圈值随焦距的变化步长小于预设值。
  26. 根据权利要求24所述的变焦相机，其特征在于，所述处理器还用于，在自动曝光模式下对所述变焦镜头进行变焦时，利用自动曝光算法根据所述对应关系对光圈值进行调整。
  27. 根据权利要求26所述的变焦相机，其特征在于，所述处理器还用于，根据所述对应关系，确定所述变焦镜头从当前焦距变焦至目标焦距对应的光圈值变化量，根据所述光圈值变化量，利用所述自动曝光算法确定其他曝光参数的变化量，根据所述其他曝光参数的变化量对所述其他曝光参数进行调整，以对所述光圈值变化量进行补偿。
  28. 根据权利要求27所述的变焦相机，其特征在于，所述目标焦距是响应于用户的触发指令确定的。
  29. 根据权利要求27所述的变焦相机，其特征在于，所述目标焦距是根据用户选 定的对焦区域和/或用户设定的对焦倍率确定的。
  30. 根据权利要求27所述的变焦相机，其特征在于，所述其他曝光参数包括以下一种或多种：感光度ISO、快门时间。
  31. 根据权利要求24所述的变焦相机，其特征在于，所述变焦相机与广角相机连接；
    所述处理器还用于，在由所述广角相机的拍摄区域切换至所述拍摄区域中的目标区域的变焦过程中，根据理想曝光参数对当前的曝光参数进行预调整；其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
  32. 根据权利要求31所述的变焦相机，其特征在于，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
  33. 根据权利要求32所述的变焦相机，其特征在于，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
  34. 根据权利要求31所述的变焦相机，其特征在于，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
  35. 根据权利要求34所述的变焦相机，其特征在于，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
  36. 根据权利要求31所述的变焦相机，其特征在于，所述处理器具体用于，结合理想曝光参数与当前的曝光参数进行计算，根据计算出的新的曝光参数进行预调整。
  37. 根据权利要求36所述的变焦相机，其特征在于，所述新的曝光参数是所述当前的曝光参数与所述理想曝光参数的线性组合。
  38. 根据权利要求31所述的变焦相机，其特征在于，所述目标区域是所述广角相机响应用户的触发确定的对焦区域。
  39. 一种组合相机，其特征在于，包括：广角相机与变焦相机；
    所述广角相机用于，获取所拍摄图像的整体亮度；获取用户在所拍摄图像中选择的目标区域；
    所述变焦相机用于，在对所述目标区域进行变焦拍摄时，根据理想曝光参数对当前的曝光参数进行预调整；其中，所述理想曝光参数是根据所述目标区域在所述广角 相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
  40. 根据权利要求39所述的组合相机，其特征在于，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
  41. 根据权利要求40所述的组合相机，其特征在于，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
  42. 根据权利要求39所述的组合相机，其特征在于，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
  43. 根据权利要求42所述的组合相机，其特征在于，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
  44. 根据权利要求39所述的组合相机，其特征在于，所述变焦相机具体用于，结合理想曝光参数与当前的曝光参数进行计算，根据计算出的新的曝光参数进行预调整。
  45. 根据权利要求44所述的组合相机，其特征在于，所述新的曝光参数是所述当前的曝光参数与所述理想曝光参数的线性组合。
  46. 一种无人机，其特征在于，装载有变焦相机，所述变焦相机预先配置有焦距与最小光圈值的对应关系，在所述对应关系中，最小光圈值随焦距的变化而平缓变化；
    所述变焦相机用于，在变焦过程中，根据所述对应关系对光圈值进行调整，以消除图像亮度的突变。
  47. 根据权利要求46所述的无人机，其特征在于，在所述对应关系中，最小光圈值与焦距正相关，且最小光圈值随焦距的变化步长小于预设值。
  48. 根据权利要求46所述的无人机，其特征在于，所述变焦相机还用于，在自动曝光模式下进行变焦时，利用自动曝光算法根据所述对应关系对光圈值进行调整。
  49. 根据权利要求48所述的无人机，其特征在于，所述变焦相机还用于，根据所述对应关系，确定从当前焦距变焦至目标焦距对应的光圈值变化量，根据所述光圈值变化量，利用所述自动曝光算法确定其他曝光参数的变化量，根据所述其他曝光参数的变化量对所述其他曝光参数进行调整，以对所述光圈值变化量进行补偿。
  50. 根据权利要求49所述的无人机，其特征在于，所述目标焦距是响应于用户的触发指令确定的。
  51. 根据权利要求49所述的无人机，其特征在于，所述目标焦距是根据用户选定的对焦区域和/或用户设定的对焦倍率确定的。
  52. 根据权利要求49所述的无人机，其特征在于，所述其他曝光参数包括以下一种或多种：感光度ISO、快门时间。
  53. 根据权利要求46所述的无人机，其特征在于，还装载有广角相机，所述广角相机与所述变焦相机连接；
    所述变焦相机还用于，在由所述广角相机的拍摄区域切换至所述拍摄区域中的目标区域的变焦过程中，根据理想曝光参数对当前的曝光参数进行预调整；
    其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
  54. 根据权利要求53所述的无人机，其特征在于，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
  55. 根据权利要求54所述的无人机，其特征在于，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
  56. 根据权利要求53所述的无人机，其特征在于，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
  57. 根据权利要求56所述的无人机，其特征在于，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
  58. 根据权利要求53所述的无人机，其特征在于，所述变焦相机具体用于，结合理想曝光参数与当前的曝光参数进行计算，根据计算出的新的曝光参数进行预调整。
  59. 根据权利要求58所述的无人机，其特征在于，所述新的曝光参数是所述当前的曝光参数与所述理想曝光参数的线性组合。
  60. 根据权利要求53所述的无人机，其特征在于，所述目标区域是所述广角相机响应用户的触发确定的对焦区域。
  61. 一种无人机，其特征在于，装载有组合相机，所述组合相机包括：变焦相机与广角相机；
    所述广角相机用于，获取所拍摄图像的整体亮度；获取用户在所拍摄图像中选择的目标区域；
    所述变焦相机用于，在对所述目标区域进行变焦拍摄时，根据理想曝光参数对当前的曝光参数进行预调整；其中，所述理想曝光参数是根据所述目标区域在所述广角相机所拍摄图像中的亮度与所述广角相机所拍摄图像的整体亮度的亮度差确定的。
  62. 根据权利要求61所述的无人机，其特征在于，所述理想曝光参数是所述广角相机确定出来后发送给所述变焦相机的。
  63. 根据权利要求62所述的无人机，其特征在于，所述理想曝光参数是，所述广角相机针对所述目标区域、以所拍摄图像的整体亮度为所述目标区域的目标亮度确定的。
  64. 根据权利要求61所述的无人机，其特征在于，所述广角相机所拍摄图像被划分为多个区块，所述目标区域在所述广角相机所拍摄图像中的亮度是所述目标区域在所述广角相机所拍摄图像中对应区块的亮度。
  65. 根据权利要求64所述的无人机，其特征在于，当所述目标区域对应多个区块时，所述目标区域的亮度为所述多个区块的平均亮度。
  66. 根据权利要求61所述的无人机，其特征在于，所述变焦相机具体用于，结合理想曝光参数与当前的曝光参数进行计算，根据计算出的新的曝光参数进行预调整。
  67. 根据权利要求66所述的无人机，其特征在于，所述新的曝光参数是所述当前的曝光参数与所述理想曝光参数的线性组合。
  68. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现权利要求1～15任一所述的图像处理方法的步骤。
  69. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现权利要求16～23任一所述的图像处理方法的步骤。
PCT/CN2020/083310 2020-04-03 2020-04-03 图像处理方法、变焦相机、相机负载装置、无人机 WO2021196208A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/083310 WO2021196208A1 (zh) 2020-04-03 2020-04-03 图像处理方法、变焦相机、相机负载装置、无人机

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/083310 WO2021196208A1 (zh) 2020-04-03 2020-04-03 图像处理方法、变焦相机、相机负载装置、无人机

Publications (1)

Publication Number Publication Date
WO2021196208A1 true WO2021196208A1 (zh) 2021-10-07

Family

ID=77930338

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/083310 WO2021196208A1 (zh) 2020-04-03 2020-04-03 图像处理方法、变焦相机、相机负载装置、无人机

Country Status (1)

Country Link
WO (1) WO2021196208A1 (zh)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110176227A1 (en) * 2010-01-20 2011-07-21 Fei-Hsin Tsai Single focus wide-angle lens module
CN103108135A (zh) * 2011-11-11 2013-05-15 佳能株式会社 摄像设备和光圈控制方法
CN104202518A (zh) * 2014-08-25 2014-12-10 深圳市菲特数码技术有限公司 一体化摄像机的变焦方法及系统
CN105578021A (zh) * 2014-10-15 2016-05-11 上海弘视通信技术有限公司 双目相机的成像方法及其装置
CN106454140A (zh) * 2015-08-06 2017-02-22 联想(北京)有限公司 一种信息处理方法及电子设备
CN108377335A (zh) * 2018-04-20 2018-08-07 浙江大华技术股份有限公司 一种摄像机聚焦方法及摄像机
CN109644258A (zh) * 2016-08-31 2019-04-16 华为技术有限公司 用于变焦摄影的多相机系统
CN110493539A (zh) * 2019-08-19 2019-11-22 Oppo广东移动通信有限公司 自动曝光处理方法、处理装置和电子设备

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110176227A1 (en) * 2010-01-20 2011-07-21 Fei-Hsin Tsai Single focus wide-angle lens module
CN103108135A (zh) * 2011-11-11 2013-05-15 佳能株式会社 摄像设备和光圈控制方法
CN104202518A (zh) * 2014-08-25 2014-12-10 深圳市菲特数码技术有限公司 一体化摄像机的变焦方法及系统
CN105578021A (zh) * 2014-10-15 2016-05-11 上海弘视通信技术有限公司 双目相机的成像方法及其装置
CN106454140A (zh) * 2015-08-06 2017-02-22 联想(北京)有限公司 一种信息处理方法及电子设备
CN109644258A (zh) * 2016-08-31 2019-04-16 华为技术有限公司 用于变焦摄影的多相机系统
CN108377335A (zh) * 2018-04-20 2018-08-07 浙江大华技术股份有限公司 一种摄像机聚焦方法及摄像机
CN110493539A (zh) * 2019-08-19 2019-11-22 Oppo广东移动通信有限公司 自动曝光处理方法、处理装置和电子设备

Similar Documents

Publication Publication Date Title
US7469097B2 (en) Method and apparatus for coping with condition in which subject is too close to digital imaging device for acceptable focus
US8638373B2 (en) Imaging device that resets an exposure by feedback control, method for controlling imaging device and program product
JP5656579B2 (ja) 光学部材に起因する画質の低下を補正可能な撮像装置、撮像装置の制御方法およびプログラム
JP5948788B2 (ja) 動作制御装置および動作制御方法、撮像装置、並びにプログラム
US6618091B1 (en) Image pickup apparatus having image signal state adjusting means a response characteristic of which is controlled in accordance with image magnification rate
US20070070216A1 (en) Imaging apparatus, and exposure control apparatus, method, and program
US9712758B2 (en) Imaging apparatus and imaging method
US9307137B2 (en) Imaging apparatus and imaging method which perform focus adjustment while performing live-view display
JP5967902B2 (ja) 撮像装置及び絞り制御方法
CN110022433A (zh) 摄像设备、镜头设备及其控制方法
US7646977B2 (en) Depth of field bracketing
CN104038688B (zh) 具备光学变焦机构的摄像装置以及视角修正方法
US9658428B2 (en) Optical instrument and control method for lens
JP6556480B2 (ja) 撮像装置および撮像方法
US20090169191A1 (en) Method for automatically selecting scene mode
US9167150B2 (en) Apparatus and method for processing image in mobile terminal having camera
WO2021196208A1 (zh) 图像处理方法、变焦相机、相机负载装置、无人机
JP2024029115A (ja) 撮像装置及びその制御方法とプログラム
US20120133820A1 (en) Autofocus method and an image capturing system
JP2012090041A (ja) 画像処理装置及び方法、並びにプログラム
US8488020B2 (en) Imaging device, method for controlling the imaging device, and recording medium recording the method
JP2022170553A (ja) 撮像装置、その制御方法とプログラム
JP6515962B2 (ja) 制御装置、制御方法および露光制御システム
WO2022209478A1 (ja) 情報処理装置、情報処理方法、情報処理プログラム
JP2004129002A (ja) カメラ制御システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20929363

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20929363

Country of ref document: EP

Kind code of ref document: A1