WO2020038074A1 - Exposure control method and apparatus, and electronic device - Google Patents

Exposure control method and apparatus, and electronic device Download PDF

Info

Publication number
WO2020038074A1
WO2020038074A1 PCT/CN2019/090627 CN2019090627W WO2020038074A1 WO 2020038074 A1 WO2020038074 A1 WO 2020038074A1 CN 2019090627 W CN2019090627 W CN 2019090627W WO 2020038074 A1 WO2020038074 A1 WO 2020038074A1
Authority
WO
WIPO (PCT)
Prior art keywords
exposure
acquired
frame
image
sensitivity
Prior art date
Application number
PCT/CN2019/090627
Other languages
French (fr)
Chinese (zh)
Inventor
张弓
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2020038074A1 publication Critical patent/WO2020038074A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/71Circuitry for evaluating the brightness variation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time

Definitions

  • An embodiment of one aspect of the present disclosure provides an exposure control method, including:
  • a determining module configured to determine the exposure duration of the images to be acquired in each frame according to the target exposure of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame;
  • a control module is configured to perform exposure control according to the exposure duration and sensitivity of the images to be collected in each frame.
  • the exposure duration of each frame to be acquired is determined according to the degree of jitter of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame to be acquired is updated according to the lower limit of the duration, and finally based on the updated
  • the exposure duration and sensitivity of each frame of images to be collected, and exposure control, and then imaging not only improves the dynamic range and overall brightness of the captured image in the night scene shooting mode, effectively suppresses the noise in the captured image, and improves the night shot image. Quality and improved user experience.
  • Embodiments of still another aspect of the present disclosure provide one or more non-volatile computer-readable storage media containing computer-executable instructions on which a computer program is stored, characterized in that the program is implemented as described above when executed by a processor.
  • the exposure control method according to the embodiment according to the embodiment.
  • the degree of jitter of the imaging device is different, and the night scene mode applicable to the current shooting scene is also different. Therefore, the preset exposure compensation value of the image to be acquired determined for each frame is also different.
  • the mapping relationship between the degree of jitter of the imaging device and the exposure compensation value may be preset to determine the preset exposure compensation value of the image to be acquired in each frame currently based on the degree of jitter of the imaging device.
  • the exposure time is greater than or equal to the lower limit of the duration of the image to be captured is 4 frames
  • the preset sensitivity value of each frame is 100 ISO according to the degree of jitter of the imaging device
  • the exposure durations of the 4 frames of image to be captured are respectively 100ms, 200ms, 400ms, and 800ms.
  • the value is 10ms / 1.5ms, that is, 20/3. Therefore, it is determined that the exposure time of the four frames to be collected is expanded to the original 20/3 times of 100ms, 200ms, 400ms and 800ms.
  • the exposure control apparatus 100 further includes:
  • the first determining module may also be specifically used for
  • the preset sensitivity value is the second sensitivity value, wherein the first sensitivity value is greater than the second sensitivity value.
  • the photometric module 110 may also be specifically used for:
  • the reference exposure amount includes the reference exposure duration and the reference sensitivity
  • An obtaining unit for obtaining a preview picture An obtaining unit for obtaining a preview picture.
  • the first determining unit is configured to determine that the current shooting scene belongs to a night scene according to the picture content of the preview picture.
  • the second determining module is configured to determine a ratio between an updated exposure time of the at least one frame of the image to be acquired and an updated exposure time before the update.
  • the first update module is configured to update the sensitivity or exposure duration of the remaining frames of images to be acquired based on the ratio of the remaining frames of images to be collected whose exposure time is greater than or equal to the lower limit of the duration.
  • the product of the ratio and the sensitivity of the remaining frames to be acquired before being updated is used as the sensitivity of the remaining frames to be acquired after being updated.
  • the product of the ratio and the exposure time before the images to be acquired in the remaining frames are updated is used as the exposure time after the images in the remaining frames are to be updated.
  • a second update module configured to update the sensitivity of an image to be acquired whose exposure time is longer than the upper limit of the duration according to the corresponding target exposure amount and upper limit of the duration;
  • the exposure duration of the image to be acquired whose exposure duration is greater than the upper limit of the duration is updated.
  • the exposure control device determines the target exposure amount of the images to be acquired by each frame through photometry; and determines the target exposure of each frame according to the target exposure amount of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame.
  • the exposure duration of the captured image If the exposure duration of at least one frame of the to-be-collected image is less than the lower limit of time, the exposure duration of at least one frame of the to-be-acquired image is updated according to the lower limit of time, and finally, Exposure control.
  • the exposure duration of each frame to be acquired is determined according to the degree of jitter of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame to be acquired is updated according to the lower limit of the duration, and finally based on the updated
  • the exposure duration and sensitivity of each frame of images to be collected, exposure control, and then imaging not only improves the dynamic range and overall brightness of the captured image in the night scene shooting mode, but also effectively suppresses noise in the captured image and improves the night scene captured image Quality and improved user experience.
  • the exposure duration of at least one frame of the image to be acquired is less than the lower limit of time, updating the sensitivity of the at least one frame of the image to be acquired according to the target exposure of the at least one frame of the image to be acquired and the lower limit of time; Lower limit of duration, updating the exposure duration of the at least one frame of images to be acquired;
  • the present disclosure also proposes an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the processor executes the program, the implementation is as described above.
  • the present disclosure also provides another electronic device 200.
  • the electronic device 200 includes a memory 50 and a processor 60.
  • the memory 50 stores computer-readable instructions.
  • the processor 60 is caused to execute the exposure control method according to any one of the foregoing embodiments.
  • FIG. 5 is a schematic diagram of the internal structure of the electronic device 200 in an embodiment.
  • the electronic device 200 includes a processor 60, a memory 50 (for example, a non-volatile storage medium), an internal memory 82, a display screen 83, and an input device 84 connected through a system bus 81.
  • the memory 50 of the electronic device 200 stores an operating system and computer-readable instructions.
  • the computer-readable instructions can be executed by the processor 60 to implement the exposure control method of the embodiment of the present disclosure.
  • the processor 60 is used to provide computing and control capabilities to support the operation of the entire electronic device 200.
  • the internal memory 50 of the electronic device 200 provides an environment for execution of computer-readable instructions in the memory 52.
  • the display screen 83 of the electronic device 200 may be a liquid crystal display or an electronic ink display, and the input device 84 may be a touch layer covered on the display screen 83, or may be a button, a trackball or a touch button provided on the housing of the electronic device 200 Board, which can also be an external keyboard, trackpad, or mouse.
  • the electronic device 200 may be a mobile phone, a tablet computer, a notebook computer, a personal digital assistant, or a wearable device (for example, a smart bracelet, a smart watch, a smart helmet, or smart glasses).
  • FIG. 5 is only a schematic diagram of a part of the structure related to the solution of the present disclosure, and does not constitute a limitation on the electronic device 200 to which the solution of the present disclosure is applied.
  • the specific electronic device 200 may include more or fewer components than shown in the figure, or some components may be combined, or have different component arrangements.
  • the electronic device 200 includes an image processing circuit 90.
  • the image processing circuit 90 may be implemented by using hardware and / or software components, including various types of ISP (Image Signal Processing) pipelines. Processing unit.
  • FIG. 6 is a schematic diagram of an image processing circuit 90 in one embodiment. As shown in FIG. 6, for convenience of explanation, only various aspects of the image processing technology related to the embodiments of the present disclosure are shown.
  • the image sensor 934 may also send the original image data to the sensor 94.
  • the sensor 94 may provide the original image data to the ISP processor 91 based on the interface type of the sensor 94, or the sensor 94 stores the original image data into the image memory 95.
  • the ISP processor 91 may perform one or more image processing operations, such as time-domain filtering.
  • the processed image data can be sent to the image memory 95 for further processing before being displayed.
  • the ISP processor 91 receives processing data from the image memory 95, and performs processing on the image data in the original domain and in the RGB and YCbCr color spaces.
  • the image data processed by the ISP processor 91 may be output to a display 97 (the display 97 may include a display screen 83) for viewing by a user and / or further processing by a graphics engine or a GPU (Graphics Processing Unit).
  • the output of the ISP processor 91 can also be sent to the image memory 95, and the display 97 can read image data from the image memory 95.
  • the image memory 95 may be configured to implement one or more frame buffers.
  • the output of the ISP processor 91 may be sent to an encoder / decoder 96 to encode / decode image data.
  • the encoded image data can be saved and decompressed before being displayed on the display 97 device.
  • the encoder / decoder 96 may be implemented by a CPU or a GPU or a coprocessor.
  • control parameters of the camera 93 may include sensor 94 control parameters (such as gain, integration time for exposure control, anti-shake parameters, etc.), camera flash control parameters, lens 932 control parameters (such as focus distance for focusing or zooming), or these parameters The combination.
  • the ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), and lens 932 shading correction parameters.

Abstract

Provided in the present disclosure are an exposure control method and apparatus, an electronic device, and a computer readable storage medium, the method comprising: by means of metering, determining a target exposure of each image frame to be acquired; on the basis of the target exposure of each image frame to be acquired and a preset light sensitivity of each image frame to be acquired, determining the exposure duration of each image frame to be acquired; if the exposure duration of at least one image frame to be acquired is less than a duration minimum, updating the exposure duration of the at least one image frame to be acquired on the basis of the duration minimum; and implementing exposure control on the basis of the exposure duration and light sensitivity of each image frame to be acquired. Thus, the dynamic range and overall brightness of night photography images are improved and the noise in the images is suppressed, and also ghost images and blur caused by hand shake are suppressed, improving the quality of night photography images and enhancing the user experience.

Description

曝光控制方法、装置以及电子设备Exposure control method, device and electronic equipment
相关申请的交叉引用Cross-reference to related applications
本公开要求OPPO广东移动通信有限公司于2018年8月22日提交的、发明名称为“曝光控制方法、装置以及电子设备”的、中国专利申请号“201810963320.5”的优先权。This disclosure claims the priority of China Patent Application No. “201810963320.5” filed by OPPO Guangdong Mobile Communication Co., Ltd. on August 22, 2018 with the invention name “Exposure Control Method, Device and Electronic Equipment”.
技术领域Technical field
本公开涉及成像技术领域,尤其涉及一种曝光控制方法、装置以及电子设备。The present disclosure relates to the field of imaging technology, and in particular, to an exposure control method, device, and electronic device.
背景技术Background technique
随着智能终端技术的发展,移动终端设备(如智能手机、平板电脑等)的使用越来越普及。绝大多数移动终端设备都内置有摄像头,并且随着移动终端处理能力的增强以及摄像头技术的发展,内置摄像头的性能越来越强大,拍摄图像的质量也越来越高。如今,移动终端设备均操作简单又便于携带,在日常生活中越来越多的用户使用智能手机、平板电脑等移动终端设备拍照。With the development of smart terminal technology, the use of mobile terminal equipment (such as smart phones, tablet computers, etc.) is becoming more and more popular. Most mobile terminal devices have built-in cameras, and with the enhancement of mobile terminal processing capabilities and the development of camera technology, the performance of built-in cameras is getting stronger and the quality of captured images is getting higher and higher. Today, mobile terminal devices are simple to operate and portable, and more and more users in daily life use mobile terminal devices such as smartphones and tablets to take pictures.
智能移动终端在给人们的日常拍照带来便捷的同时,人们对拍摄的图像质量的要求也越来越高。然而,由于专业水平限制,人们不知如何根据拍摄场景设置合适的拍摄参数。While smart mobile terminals bring convenience to people's daily photography, people's requirements for the quality of captured images are also getting higher and higher. However, due to the limitation of professional level, people do not know how to set appropriate shooting parameters according to the shooting scene.
发明内容Summary of the Invention
本公开旨在至少在一定程度上解决相关技术中的技术问题之一。The present disclosure aims to solve at least one of the technical problems in the related art.
为此,本公开提出一种曝光控制方法、装置电子设备以及计算机可读存储介质,以解决相关技术中,在拍摄画面偏亮的夜景场景中,由于测光失误导致拍摄的图像动态范围以及周围亮度低,噪声水平高,影响用户体验的技术问题。To this end, the present disclosure proposes an exposure control method, an apparatus electronic device, and a computer-readable storage medium to solve the related art, in a night scene scene where the shooting screen is bright, the dynamic range of the captured image and the surrounding area due to the measurement error. Low brightness, high noise level, technical issues that affect user experience.
本公开一方面实施例提出了一种曝光控制方法,包括:An embodiment of one aspect of the present disclosure provides an exposure control method, including:
测光以确定各帧待采集图像的目标曝光量;Metering to determine the target exposure for each frame of image to be acquired;
根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长;Determining the exposure duration of the images to be acquired in each frame according to the target exposure of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame;
若至少一帧待采集图像的曝光时长小于时长下限,根据所述时长下限,更新所述至少一帧待采集图像的曝光时长;If the exposure duration of at least one frame of the image to be collected is less than the lower limit of time, updating the exposure time of the at least one frame of the image to be collected according to the lower limit of time;
根据各帧待采集图像的曝光时长和感光度,进行曝光控制。Perform exposure control according to the exposure duration and sensitivity of each frame of images to be acquired.
本公开实施例的曝光控制方法,通过测光以确定各帧待采集图像的目标曝光量;根据 各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长,若至少一帧待采集图像的曝光时长小于时长下限,根据时长下限,更新至少一帧待采集图像的曝光时长,最终根据各帧待采集图像的曝光时长和感光度,进行曝光控制。由此,通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度,确定了各帧待采集图像的曝光时长,进而根据时长下限更新至少一帧待采集图像的曝光时长,最终根据更新后的各帧待采集图像的曝光时长和感光度,进行曝光控制,进而成像,不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度,有效抑制了拍摄图像中的噪声,提高了夜景拍摄图像的质量,改善了用户体验。According to the exposure control method of the embodiment of the present disclosure, the target exposure amount of each frame to be acquired is determined by photometry; the target exposure amount of each frame to be acquired and the preset sensitivity of each frame to be acquired are used to determine each frame to be acquired. The exposure duration of the captured image. If the exposure duration of at least one frame of the to-be-collected image is less than the lower limit of time, the exposure duration of at least one frame of the to-be-acquired image is updated according to the lower limit of time, and finally, Exposure control. Therefore, the exposure duration of each frame to be acquired is determined according to the degree of jitter of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame to be acquired is updated according to the lower limit of the duration, and finally based on the updated The exposure duration and sensitivity of each frame of images to be collected, and exposure control, and then imaging, not only improves the dynamic range and overall brightness of the captured image in the night scene shooting mode, effectively suppresses the noise in the captured image, and improves the night shot image. Quality and improved user experience.
本公开又一方面实施例提出了一种曝光控制装置,包括:An embodiment of another aspect of the present disclosure provides an exposure control device, including:
测光模块,用于测光以确定各帧待采集图像的目标曝光量;A light metering module, which is used for light metering to determine the target exposure of each frame of images to be acquired;
确定模块,用于根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长;A determining module, configured to determine the exposure duration of the images to be acquired in each frame according to the target exposure of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame;
更新模块,用于若至少一帧待采集图像的曝光时长小于时长下限,根据所述时长下限,更新所述至少一帧待采集图像的曝光时长;An update module configured to update the exposure duration of the at least one frame of images to be acquired if the exposure duration of the at least one frame of images to be acquired is less than the lower limit of time;
控制模块,用于根据各帧待采集图像的曝光时长和感光度,进行曝光控制。A control module is configured to perform exposure control according to the exposure duration and sensitivity of the images to be collected in each frame.
本公开实施例的曝光控制装置,通过测光以确定各帧待采集图像的目标曝光量;根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长,若至少一帧待采集图像的曝光时长小于时长下限,根据时长下限,更新至少一帧待采集图像的曝光时长,最终根据各帧待采集图像的曝光时长和感光度,进行曝光控制。由此,通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度,确定了各帧待采集图像的曝光时长,进而根据时长下限更新至少一帧待采集图像的曝光时长,最终根据更新后的各帧待采集图像的曝光时长和感光度,进行曝光控制,进而成像,不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度,有效抑制了拍摄图像中的噪声,提高了夜景拍摄图像的质量,改善了用户体验。The exposure control device according to the embodiment of the present disclosure determines the target exposure amount of the images to be acquired by each frame through photometry; and determines the target exposure of each frame according to the target exposure amount of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame. The exposure duration of the captured image. If the exposure duration of at least one frame of the to-be-collected image is less than the lower limit of time, the exposure duration of at least one frame of the to-be-acquired image is updated according to the lower limit of time, and finally, Exposure control. Therefore, the exposure duration of each frame to be acquired is determined according to the degree of jitter of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame to be acquired is updated according to the lower limit of the duration, and finally based on the updated The exposure duration and sensitivity of each frame of images to be collected, and exposure control, and then imaging, not only improves the dynamic range and overall brightness of the captured image in the night scene shooting mode, effectively suppresses the noise in the captured image, and improves the night shot image. Quality and improved user experience.
本公开又一方面实施例提出了一个或多个包含计算机可执行指令的非易失性计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如上述实施例所述的曝光控制方法。Embodiments of still another aspect of the present disclosure provide one or more non-volatile computer-readable storage media containing computer-executable instructions on which a computer program is stored, characterized in that the program is implemented as described above when executed by a processor. The exposure control method according to the embodiment.
本公开又一方面实施例提出了一种电子设备,包括存储器及处理器,所述存储器中储存有计算机可读指令,所述处理器执行所述程序时,实现如上述实施例所述的曝光控制方法。An embodiment of another aspect of the present disclosure provides an electronic device including a memory and a processor. The memory stores computer-readable instructions. When the processor executes the program, the exposure according to the foregoing embodiment is implemented. Control Method.
本公开附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本公开的实践了解到。Additional aspects and advantages of the present disclosure will be given in part in the following description, part of which will become apparent from the following description, or be learned through the practice of the present disclosure.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
本公开上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解,其中:The above and / or additional aspects and advantages of the present disclosure will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
图1为本公开实施例所提供的一种曝光控制方法的流程示意图;FIG. 1 is a schematic flowchart of an exposure control method according to an embodiment of the present disclosure;
图2为本公开实施例所提供的一种确定各帧待采集图像预设的曝光补偿值的流程示意图;2 is a schematic flowchart of determining a preset exposure compensation value of an image to be acquired in each frame according to an embodiment of the present disclosure;
图3为本公开实施例所提供的另一种曝光控制方法的流程示意图;3 is a schematic flowchart of another exposure control method according to an embodiment of the present disclosure;
图4为本公开实施例所提供的一种曝光控制装置的结构示意图;4 is a schematic structural diagram of an exposure control apparatus according to an embodiment of the present disclosure;
图5为本公开某些实施方式的电子设备的模块示意图;5 is a schematic block diagram of an electronic device according to some embodiments of the present disclosure;
图6为本公开某些实施方式的图像处理电路的模块示意图。FIG. 6 is a schematic block diagram of an image processing circuit according to some embodiments of the present disclosure.
具体实施方式detailed description
下面详细描述本公开的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本公开,而不能理解为对本公开的限制。Hereinafter, embodiments of the present disclosure will be described in detail. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the drawings are exemplary, and are intended to explain the present disclosure, and should not be construed as limiting the present disclosure.
相关技术在夜景拍摄场景中,由于光照条件差,为了提高拍摄质量,在拍摄过程中,人们习惯将拍摄主体放在画面中间位置,分别进行长曝光、中曝光和短曝光,再将不同的曝光度下获得的图像合成后输出成像,以改善图像的成像效果。但是,这种拍摄方式在夜景拍摄场景下,拍摄得到的图像动态范围不够宽,图像的整体亮度也比较低,拍摄过程中也可能会引入噪点。Related technologies In night shooting scenes, due to poor lighting conditions, in order to improve the shooting quality, during the shooting process, people are accustomed to placing the subject in the middle of the frame, performing long exposure, medium exposure, and short exposure, and then different exposures The images obtained under the combined image are output for imaging to improve the imaging effect of the image. However, in this shooting mode, the dynamic range of the captured image is not wide enough, and the overall brightness of the image is relatively low. Noise may also be introduced during the shooting process.
本公开实施例针对相关技术中,在夜景场景中拍摄图像时,当拍摄场景中间范围比较亮时导致测光失误,使得拍摄得到的图像的动态范围以及周围暗区亮度都较低,噪声水平高,影响用户体验的问题,提出一种曝光控制方法。The embodiments of the present disclosure are directed to the related art. When shooting an image in a night scene, the metering error occurs when the middle range of the shooting scene is bright, so that the dynamic range of the captured image and the brightness of the surrounding dark area are low, and the noise level is high. , A problem that affects user experience, and proposes an exposure control method.
本公开实施例提供的曝光控制方法,通过测光以确定各帧待采集图像的目标曝光量;根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长,若至少一帧待采集图像的曝光时长小于时长下限,根据时长下限,更新至少一帧待采集图像的曝光时长,最终根据各帧待采集图像的曝光时长和感光度,进行曝光控制。According to the exposure control method provided in the embodiment of the present disclosure, the target exposure amount of the image to be collected is determined by metering; and each frame is determined according to the target exposure amount of the image to be collected and the preset sensitivity of the image to be collected. The exposure duration of the image to be collected, if the exposure duration of at least one frame of the image to be collected is less than the lower limit of time, the exposure time of at least one frame of the image to be collected is updated according to the lower limit of time, and finally according to the exposure time and sensitivity of the image to be collected of each frame, Perform exposure control.
下面参考附图描述本公开实施例的曝光控制方法和装置。Hereinafter, an exposure control method and apparatus according to embodiments of the present disclosure will be described with reference to the drawings.
图1为本公开实施例所提供的一种曝光控制方法的流程示意图。FIG. 1 is a schematic flowchart of an exposure control method according to an embodiment of the present disclosure.
本公开实施例的曝光控制方法,应用于电子设备,该电子设备可以为手机、平板电脑、 个人数字助理、穿戴式设备等具有各种操作系统、成像设备的硬件设备。The exposure control method of the embodiment of the present disclosure is applied to an electronic device. The electronic device may be a hardware device such as a mobile phone, a tablet computer, a personal digital assistant, a wearable device, and other operating systems and imaging devices.
如图1所示,该曝光控制方法包括以下步骤:As shown in FIG. 1, the exposure control method includes the following steps:
步骤101,测光以确定各帧待采集图像的目标曝光量。In step 101, photometry is performed to determine a target exposure of each frame to be acquired.
其中,曝光量,是指成像设备中的感光器件在曝光时长内接受到光的多少,曝光量与光圈、曝光时长和感光度有关。其中,光圈也就是通光口径,决定单位时间内光线通过的数量;曝光时长,是指光线通过镜头的时间;感光度,又称为ISO值,是衡量底片对于光的灵敏程度的指标,用于表示感光器件的感光速度,ISO数值越高就说明该感光元器件的感光能力越强。The exposure amount refers to the amount of light received by the photosensitive device in the imaging device during the exposure time. The exposure amount is related to the aperture, the exposure time, and the sensitivity. Among them, the aperture is the aperture diameter, which determines the amount of light passing through in a unit time; the exposure time refers to the time that the light passes through the lens; the sensitivity, also known as the ISO value, is an index to measure the sensitivity of the film to light. In terms of the light-receiving speed of the light-sensitive device, the higher the ISO value, the stronger the light-receiving capacity of the light-sensitive component.
需要说明的是,当成像设备的感光度较低时,需要曝光更长的时间以达到跟感光度较高时相同的成像效果。数码相机的感光度是一种类似于胶卷感光度的一种指标,数码相机的ISO值可以通过调整感光器件的灵敏度或者合并感光点来调整,也就是说,可以通过提升感光器件的光线敏感度或者合并几个相邻的感光点来达到提升ISO值的目的。当然,为了减少曝光时间,使用相对较高的感光度通常会引入较多的噪声,从而会导致图像质量降低。因此,在夜景场景下,为了得到较佳的噪声抑制效果,希望设置较低的感光度,例如100ISO或200ISO等,同时,由于手机等电子设备的光圈通常采用固定值,从而需要相应提高曝光时长,即快门时长。It should be noted that when the sensitivity of the imaging device is low, longer exposure time is required to achieve the same imaging effect as when the sensitivity is higher. The sensitivity of a digital camera is a kind of index similar to the sensitivity of a film. The ISO value of a digital camera can be adjusted by adjusting the sensitivity of the photosensitive device or combining the sensing points, that is, by increasing the light sensitivity of the photosensitive device. Or combine several adjacent photosensitive points to increase the ISO value. Of course, in order to reduce the exposure time, using a relatively high sensitivity usually introduces more noise, which will lead to a reduction in image quality. Therefore, in night scenes, in order to obtain better noise suppression effects, it is desirable to set a lower sensitivity, such as 100ISO or 200ISO, etc. At the same time, because the aperture of electronic devices such as mobile phones usually adopts a fixed value, it is necessary to increase the exposure time accordingly. , That is, the shutter time.
具体地,通过成像设备获取当前拍摄场景的预览图像,进一步的通过感光器件测量得到预览图像各区域的环境光亮度,进而根据预览图像的亮度信息,确定基准曝光量。其中,在光圈固定的情况下,基准曝光量具体可以包括基准曝光时长和基准感光度。Specifically, the preview image of the current shooting scene is obtained by the imaging device, and the ambient light brightness of each area of the preview image is obtained by measuring by the photosensitive device, and then the reference exposure amount is determined according to the brightness information of the preview image. Where the aperture is fixed, the reference exposure amount may specifically include a reference exposure duration and a reference sensitivity.
本公开实施例中,基准曝光量,是指通过对预览图像进行测光获取的当前环境的亮度信息,确定的与当前环境的亮度信息相适应的曝光量,基准曝光量的取值可以是基准感光度与基准曝光时长之间的乘积。In the embodiment of the present disclosure, the reference exposure amount refers to the brightness information of the current environment obtained by metering the preview image, and the exposure amount determined to be compatible with the brightness information of the current environment. The value of the reference exposure amount may be a reference Product of sensitivity and reference exposure time.
其中,基准感光度,可以是根据成像设备当前的抖动程度,确定的与当前的抖动程度相适应的感光度,还可以是通过测光得到的感光度,本实施例中对此不作限定。可以理解的是,由于曝光量与感光度会影响到整体的拍摄时长,拍摄时长过长,可能会导致手持拍摄时成像设备的抖动程度加剧,从而影响图像质量。因此,在根据成像设备当前的抖动程度,确定基准感光度时,应当使得拍摄时长控制在合适的范围内。The reference sensitivity may be a sensitivity determined in accordance with the current degree of shake of the imaging device according to the current degree of shake, or a sensitivity obtained through photometry, which is not limited in this embodiment. It can be understood that, because the exposure amount and sensitivity affect the overall shooting time, and the shooting time is too long, it may cause the degree of shake of the imaging device to increase during handheld shooting, thereby affecting the image quality. Therefore, when determining the reference sensitivity according to the current shake level of the imaging device, the shooting duration should be controlled within a suitable range.
具体来说,由于曝光量与光圈、曝光时长和感光度有关,当光圈的大小固定时,可根据基准曝光量以及基准感光度,确定出基准曝光时长。将基准曝光时长作为EV0,根据各帧待采集图像预设的曝光补偿值,可确定各帧待采集图像的目标曝光量。Specifically, since the exposure amount is related to the aperture, the exposure duration, and the sensitivity, when the size of the aperture is fixed, the reference exposure duration can be determined according to the reference exposure amount and the reference sensitivity. Taking the reference exposure time as EV0, the target exposure amount of the image to be acquired in each frame can be determined according to the preset exposure compensation value of the image to be acquired in each frame.
其中,预设的曝光补偿值,是指根据当前拍摄场景的环境光亮度预先设定的曝光值(Exposure Value,EV)。在曝光值最初的定义中,曝光值并不是指一个准确的数值,而是 指“能够给出统一的曝光量的所有相机光圈与曝光时长的组合”。感光度、光圈和曝光时长确定了相机的曝光量,不同的参数组合可以产生相等的曝光量,即这些不同组合的EV值是一样的,比如,在感光度相同的情况下,使用1/125秒曝光时长和f11的光圈组合,与使用1/250秒曝光时间与f8快门的组合,获得的曝光量是相同的,即EV值是相同的。EV值为0时,是指感光度为100、光圈系数为f1、曝光时长为1秒时获得的曝光量;曝光量增加一档,即曝光时长增加一倍,或者感光度增加一倍,或者光圈增加一档,EV值增加1,也就是说,EV1对应的曝光量是EV0对应的曝光量的两倍。The preset exposure compensation value refers to an exposure value (Exposure Value, EV) set in advance according to the ambient light brightness of the current shooting scene. In the original definition of the exposure value, the exposure value does not refer to an accurate value, but refers to "the combination of all camera apertures and exposure time that can give a uniform exposure amount". Sensitivity, aperture, and exposure time determine the exposure of the camera. Different parameter combinations can produce equal exposure, that is, the EV values of these different combinations are the same. For example, if the sensitivity is the same, use 1/125. The combination of the exposure time in seconds and the aperture of f11 is the same as that obtained by using the combination of 1/250 second exposure time and f8 shutter, that is, the EV value is the same. When the EV value is 0, it means the exposure amount obtained when the sensitivity is 100, the aperture factor is f1, and the exposure duration is 1 second; the exposure amount is increased by one stop, that is, the exposure duration is doubled, or the sensitivity is doubled, or When the aperture is increased by one stop, the EV value is increased by 1, that is, the exposure amount corresponding to EV1 is twice the exposure amount corresponding to EV0.
作为一种示例,假如成像设备根据测量得到的预览图像的亮度信息,确定各帧待采集图像的基准曝光量为400,此时基准感光度ISO值为100,则基准曝光时长为4s。如果各帧待采集图像预设的曝光补偿值均为EV+1,可确定此时的目标曝光量均为800。其中,EV+1的曝光补偿是指相对于成像设备测光数据对应的曝光量增加一档曝光,即实际曝光量为测光数据对应的曝光量的两倍。As an example, if the imaging device determines that the reference exposure of each frame to be acquired is 400 according to the measured brightness information of the preview image, and the reference sensitivity ISO value is 100 at this time, the reference exposure duration is 4s. If the preset exposure compensation value of each frame to be acquired is EV + 1, it can be determined that the target exposure amount at this time is 800. Among them, EV + 1 exposure compensation refers to an increase in exposure relative to the exposure amount corresponding to the metering data of the imaging device, that is, the actual exposure amount is twice the exposure amount corresponding to the metering data.
在本公开实施例中,预设曝光补偿值时,可以将确定的基准曝光量对应的EV值预设为0,EV+1是指增加一档曝光,即曝光量为基准曝光量的2倍,EV+2是指增加两档曝光,即曝光量为基准曝光量的4倍,EV-1是指减少一档曝光,即曝光量为基准曝光量的0.5倍等等。In the embodiment of the present disclosure, when the exposure compensation value is preset, the EV value corresponding to the determined reference exposure amount can be preset to 0, and EV + 1 means to increase the exposure by one step, that is, the exposure amount is twice the reference exposure amount. , EV + 2 means to increase the exposure by two stops, that is, the exposure is 4 times the reference exposure, and EV-1 means to reduce the exposure by one stop, that is, the exposure is 0.5 times the reference exposure, and so on.
举例来说,若待采集的图像数量为7帧,则对应的预设曝光补偿值EV值可以是[+1,+1,+1,+1,0,-3,-6]。其中,预设曝光补偿值为EV+1的帧,可以解决噪声问题,通过亮度比较高的帧进行时域降噪,在提升暗部细节的同时抑制噪声;预设曝光补偿值为EV-6的帧,可以解决高光过曝的问题,保留高光区域的细节;预设曝光补偿值为EV0和EV-3的帧,则可以用于保持高光到暗区之间的过渡,保持较好的明暗过渡的效果。For example, if the number of images to be acquired is 7 frames, the corresponding preset exposure compensation value EV value may be [+ 1, + 1, + 1, + 1,0, -3, -6]. Among them, the frame with a preset exposure compensation value of EV + 1 can solve the problem of noise. Time-domain noise reduction is performed through the frame with a relatively high brightness, and the details in the dark part are improved while suppressing noise; the preset exposure compensation value is EV-6. Frames can solve the problem of highlight overexposure and preserve the details of highlight areas; frames with preset exposure compensation values of EV0 and EV-3 can be used to maintain the transition from highlights to dark areas and maintain better light and dark transitions Effect.
步骤102,根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长。Step 102: Determine the exposure duration of the image to be acquired in each frame according to the target exposure of the image to be acquired in each frame and the preset sensitivity of the image to be acquired in each frame.
本公开实施例中,作为一种可能的实现方式,当各帧待采集图像预设的感光度相同时,可以根据拍摄场景的环境光亮度,确定各帧待采集图像预设的感光度。在拍摄场景光线比较暗的情况下,提高感光度,可以使快门的速度加快,从而减少画面抖动。In an embodiment of the present disclosure, as a possible implementation manner, when the preset sensitivity of the image to be collected in each frame is the same, the preset sensitivity of the image to be collected in each frame may be determined according to the ambient light brightness of the shooting scene. When the shooting scene is relatively dark, increasing the sensitivity can make the shutter speed faster, thereby reducing picture shake.
作为另一种可能的实现方式,当各帧待采集图像预设的感光度相同时,可以根据抖动程度,确定各帧待采集图像预设的感光度。As another possible implementation manner, when the preset sensitivity of the image to be collected in each frame is the same, the preset sensitivity of the image to be collected in each frame may be determined according to the degree of jitter.
具体地,为了确定抖动程度,可以根据成像设备中设置的位移传感器,采集位移信息,进而,根据采集到的成像设备的位移信息,确定成像设备的抖动程度。当成像设备的抖动程度大于或等于抖动阈值时,确定当前拍摄场景中各帧待采集图像预设的感光度取值为第一感光值;当成像设备的抖动程度小于抖动阈值时,确定当前拍摄场景中各帧待采集图像 预设的感光度取值为第二感光值。其中,抖动阈值,为成像设备中预先设定的用于确定预设感光度取值的抖动值。Specifically, in order to determine the degree of shake, the displacement information may be collected according to a displacement sensor provided in the imaging device, and further, the degree of shake of the imaging device may be determined according to the collected displacement information of the imaging device. When the jitter level of the imaging device is greater than or equal to the jitter threshold, determine the preset sensitivity value of the image to be acquired in each frame in the current shooting scene as the first sensitivity value; when the jitter level of the imaging device is less than the jitter threshold, determine the current shooting The preset sensitivity value of the images to be collected in each frame of the scene is the second sensitivity value. The jitter threshold is a jitter value preset in the imaging device and used to determine a preset sensitivity value.
其中,第一感光值大于第二感光值,第一感光值为第二感光值的预设倍数,预设倍数的取值大于等于2。作为一种可能的实现方式,为了获得较低的噪声,第二感光值可以为成像设备的最小感光度,即第二感光值的取值为100ISO,相应地,第一感光值的取值范围可以为200、400、800或者更高。The first light sensitive value is greater than the second light sensitive value, the first light sensitive value is a preset multiple of the second light sensitive value, and the value of the preset multiple is greater than or equal to two. As a possible implementation manner, in order to obtain lower noise, the second sensitivity value may be the minimum sensitivity of the imaging device, that is, the value of the second sensitivity value is 100 ISO, and accordingly, the value range of the first sensitivity value is It can be 200, 400, 800 or higher.
由于曝光量等于感光度乘以曝光时长,因此,本公开实施例中,根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,可以确定各帧待采集图像的曝光时长。Since the exposure amount is equal to the sensitivity times the exposure time, in the embodiment of the present disclosure, according to the target exposure amount of each frame to be acquired and the preset sensitivity of each frame to be acquired, the exposure of each frame to be acquired may be determined. duration.
作为一种示例,假如测光确定的一帧待采集图像的目标曝光量为800,确定的该帧待采集图像预设的感光度为400ISO,此时采集该帧图像的曝光时长则为2s。通过此方法,可确定各帧待采集图像的曝光时长。As an example, if the target exposure of a frame to be acquired determined by metering is 800, the preset sensitivity of the determined image to be acquired for the frame is 400 ISO, and the exposure time for collecting the image of the frame is 2s. With this method, the exposure time of the images to be acquired in each frame can be determined.
步骤103,若至少一帧待采集图像的曝光时长小于时长下限,根据时长下限,更新至少一帧待采集图像的曝光时长。In step 103, if the exposure duration of at least one frame of the image to be collected is shorter than the lower limit of time, the exposure time of at least one frame of the image to be collected is updated according to the lower limit of time.
其中,曝光时长的时长下限大于或等于10ms。基于实验测得曝光时长在10ms以内时,会出现噪声的恶化,同时,对于一些设备还存在可设置的最小曝光时长为10ms的情况,因此,这里综合考虑以上情况设置时长下限大于或等于10ms。The lower limit of the duration of the exposure duration is greater than or equal to 10 ms. Based on experiments, when the exposure time is less than 10ms, noise degradation will occur. At the same time, for some devices, the minimum exposure time that can be set is 10ms. Therefore, the lower limit of the duration is set to be greater than or equal to 10ms.
本公开实施例中,当至少一帧待采集图像的曝光时长小于曝光时长下限,此时,将该至少一帧待采集图像的曝光时长设定为时长下限。进而,根据至少一帧待采集图像的目标曝光量和时长下限,以及曝光量与感光度和曝光时长的关系,更新该至少一帧待采集图像的感光度。进而根据曝光时长下限,更新该至少一帧待采集图像的曝光时长。In the embodiment of the present disclosure, when the exposure duration of at least one frame of the image to be collected is less than the lower limit of the exposure time, at this time, the exposure duration of the at least one frame of the image to be collected is set to the lower limit of the time. Further, the sensitivity of the at least one frame of the to-be-acquired image is updated according to the target exposure amount and the lower limit of the duration of the image to be collected, and the relationship between the exposure amount and the sensitivity and the exposure time. Furthermore, according to the lower limit of the exposure time, the exposure time of the at least one frame of the image to be acquired is updated.
作为一种示例,假设曝光时长下限为10ms,各帧待采集图像的预设感光度相同均为100ISO,待采集图像为4帧,预设的曝光补偿值EV值可以是[-6、-5、-4、0]。若EV0为100ms、100ISO,则预设的曝光补偿值为EV-6时,采集一帧待采集图像的曝光时长为1.5ms、感光度为100ISO,此时该帧图像的曝光时长1.5ms小于时长下限10ms,则将该帧待采集图像的曝光时长设定为时长下限10ms,进而该帧待采集图像感光度取值为100ISO。可见,通过对该帧待采集图像的曝光时长进行更新,提亮了图像亮度,该帧的目标曝光量从1.5ms×100ISO提高至10ms×100ISO,目标曝光量为更新前的20/3倍。As an example, assuming that the lower limit of the exposure time is 10ms, the preset sensitivity of each frame to be captured is 100 ISO, the image to be collected is 4 frames, and the preset exposure compensation value EV value can be [-6, -5 , -4, 0]. If EV0 is 100ms and 100ISO, when the preset exposure compensation value is EV-6, the exposure time for capturing a frame of images to be captured is 1.5ms and the sensitivity is 100ISO. At this time, the exposure time of the frame image is 1.5ms less than the duration. If the lower limit is 10 ms, the exposure duration of the image to be collected in the frame is set to the lower limit of 10 ms, and the sensitivity of the image to be collected in the frame is set to 100 ISO. It can be seen that by updating the exposure time of the image to be collected in this frame, the image brightness is brightened. The target exposure of the frame is increased from 1.5ms × 100ISO to 10ms × 100ISO, and the target exposure is 20/3 times that before the update.
进一步地,为了使得各帧曝光过渡自然,暗光区域和亮光区域均能够得到较佳的曝光,还可以对其余各帧进行同步提亮。仍参考前述示例,对EV-6图像帧,目标曝光量为更新前的20/3倍,其余各帧目标曝光量也同步为更新前的20/3倍。具体可以通过提高曝光时长,或者通过提高ISO来实现,本实施例中对此不作限定。Further, in order to make the exposure transition of each frame natural, both the dark and bright areas can be better exposed, and the remaining frames can also be simultaneously brightened. Still referring to the foregoing example, for EV-6 image frames, the target exposure amount is 20/3 times before the update, and the target exposure amounts of the remaining frames are also synchronized to 20/3 times before the update. Specifically, this can be achieved by increasing the exposure duration or by increasing the ISO, which is not limited in this embodiment.
步骤104,根据各帧待采集图像的曝光时长和感光度,进行曝光控制。Step 104: Perform exposure control according to the exposure duration and sensitivity of the image to be collected in each frame.
本公开实施例中,成像设备可以根据确定的各帧待采集图像的曝光时长和感光度,进行曝光控制,进而成像。In the embodiment of the present disclosure, the imaging device may perform exposure control according to the determined exposure duration and sensitivity of each frame to be acquired, and then perform imaging.
本公开实施例的曝光控制方法,通过测光以确定各帧待采集图像的目标曝光量;根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长,若至少一帧待采集图像的曝光时长小于时长下限,根据时长下限,更新至少一帧待采集图像的曝光时长,最终根据各帧待采集图像的曝光时长和感光度,进行曝光控制。由此,通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度,确定了各帧待采集图像的曝光时长,进而根据时长下限更新至少一帧待采集图像的曝光时长,最终根据更新后的各帧待采集图像的曝光时长和感光度,进行曝光控制,进而成像,不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度,而且有效抑制了拍摄图像中的噪声,提高了夜景拍摄图像的质量,改善了用户体验。According to the exposure control method of the embodiment of the present disclosure, the target exposure amount of each frame to be acquired is determined by photometry; the target exposure amount of each frame to be acquired and the preset sensitivity of each frame to be acquired are used to determine each frame to be acquired. The exposure duration of the captured image. If the exposure duration of at least one frame of the to-be-collected image is less than the lower limit of time, the exposure duration of at least one frame of the to-be-acquired image is updated according to the lower limit of the duration, and finally based on the exposure time and sensitivity of each frame of the to-be-collected image, Exposure control. Therefore, the exposure duration of each frame to be acquired is determined according to the degree of jitter of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame to be acquired is updated according to the lower limit of the duration, and finally based on the updated The exposure duration and sensitivity of each frame of images to be collected, exposure control, and then imaging, not only improves the dynamic range and overall brightness of the captured image in the night scene shooting mode, but also effectively suppresses noise in the captured image and improves the night scene captured image Quality and improved user experience.
作为一种可能的实现方式,本公开实施例中,根据基准曝光量和各帧待采集图像预设的曝光补偿值,确定各帧待采集图像的目标曝光量之前,首先要确定各帧待采集图像预设的曝光补偿值,参见图2,具体可以包括以下步骤:As a possible implementation manner, in the embodiment of the present disclosure, before determining a target exposure amount of an image to be acquired for each frame according to a reference exposure amount and an exposure compensation value preset for each frame of an image to be acquired, first determine each frame to be acquired. The preset exposure compensation value of the image, as shown in Figure 2, can include the following steps:
步骤201,获取预览画面。Step 201: Obtain a preview picture.
本公开实施例中,可以通过成像设备获取当前拍摄场景的预览画面,用于确定当前拍摄场景是否属于夜景场景。In the embodiment of the present disclosure, a preview screen of a current shooting scene may be obtained through an imaging device, and is used to determine whether the current shooting scene belongs to a night scene.
步骤202,根据预览画面的画面内容,确定当前拍摄场景属于夜景场景。Step 202: According to the picture content of the preview picture, determine that the current shooting scene belongs to a night scene.
具体地,由于不同场景下环境亮度值不同,预览画面内容也不相同,根据当前拍摄场景预览画面的画面内容以及各区域的环境亮度值,判断当前拍摄场景是否属于夜景场景。Specifically, due to different ambient brightness values in different scenes, the contents of the preview screen are also different. Based on the screen contents of the preview scene of the current shooting scene and the ambient brightness values of each area, it is determined whether the current shooting scene belongs to a night scene.
例如,预览画面的画面内容包括夜晚天空或者夜景灯源等,或者预览画面的各区域中环境亮度值符合夜景环境下图像的亮度分布特性,即可确定当前拍摄场景属于夜景场景。For example, if the picture content of the preview screen includes the night sky or night light sources, or the ambient brightness values in each area of the preview screen match the brightness distribution characteristics of the image under the night environment, it can be determined that the current shooting scene belongs to the night scene.
步骤203,根据成像设备的抖动程度和/或预览画面是否包含人脸,识别当前拍摄场景适用的夜景模式。Step 203: Identify a night scene mode applicable to the current shooting scene according to the degree of jitter of the imaging device and / or whether the preview screen contains a human face.
在本公开实施例中,可以通过成像设备设置的位移传感器,采集得到成像设备在拍摄过程中的位移信息,进而根据获取的位移信息确定成像设备当前的抖动程度。由此,可通过成像设备的抖动程度判断使用者是将成像设备固定在脚架上进行拍摄还是通过手持模式拍摄。进而,根据成像设备当前的抖动程度,识别当前拍摄场景适用的夜景模式。In the embodiment of the present disclosure, the displacement information provided by the imaging device may be acquired through a displacement sensor provided by the imaging device, and then the current jitter degree of the imaging device may be determined according to the obtained displacement information. Therefore, it can be judged by the degree of shaking of the imaging device whether the user fixes the imaging device on a tripod for shooting or shoots in a handheld mode. Furthermore, according to the current jitter level of the imaging device, a night scene mode applicable to the current shooting scene is identified.
作为一种示例,可以通过获取电子设备当前的陀螺仪(Gyro-sensor)信息,确定成像设备当前的抖动程度。As an example, the current degree of jitter of the imaging device may be determined by acquiring current Gyro-sensor information of the electronic device.
其中,陀螺仪又叫角速度传感器,可以测量物理量偏转、倾斜时的转动角速度。在成像设备中,陀螺仪可以很好的测量转动、偏转的动作,从而可以精确分析判断出使用者的 实际动作。电子设备的陀螺仪信息(gyro信息)可以包括成像设备在三维空间中三个维度方向上的运动信息,三维空间的三个维度可以分别表示为X轴、Y轴、Z轴三个方向,其中,X轴、Y轴、Z轴为两两垂直关系。Among them, the gyroscope is also called angular velocity sensor, which can measure the rotational angular velocity when the physical quantity is deflected and tilted. In the imaging equipment, the gyroscope can measure the movement of rotation and deflection very well, so that it can accurately analyze and judge the actual movement of the user. The gyroscope information (gyro information) of the electronic device may include the motion information of the imaging device in three dimensions in the three-dimensional space, and the three dimensions of the three-dimensional space may be expressed as the three directions of the X-axis, Y-axis, and Z-axis, respectively. , X-axis, Y-axis, and Z-axis are perpendicular to each other.
由此,本公开实施例中,可以根据电子设备当前的gyro信息,确定成像设备当前的抖动程度。电子设备在三个方向上的gyro运动的绝对值越大,则成像设备的抖动程度越大。具体的,可以预设在三个方向上gyro运动的绝对值阈值,并根据获取到的当前在三个方向上的gyro运动的绝对值之和,与预设的阈值的关系,确定成像设备的当前的抖动程度。Therefore, in the embodiment of the present disclosure, the current jitter degree of the imaging device can be determined according to the current gyro information of the electronic device. The greater the absolute value of the gyro movement of the electronic device in the three directions, the greater the degree of jitter of the imaging device. Specifically, the absolute value threshold of the gyro motion in the three directions can be preset, and the relationship between the absolute value of the currently acquired gyro motion in the three directions and the preset threshold is used to determine the imaging device's The current degree of jitter.
举例来说,假设预设的阈值为第一阈值A、第二阈值B、第三阈值C,且A<B<C,当前获取到的在三个方向上gyro运动的绝对值之和为S。若S<A,则确定成像设备当前的抖动程度为“无抖动”;若A<S<B,则可以确定成像设备当前的抖动程度为“轻微抖动”;若B<S<C,则可以确定成像设备当前的抖动程度为“小抖动”;若S>C,则可以确定成像设备当前的抖动程度为“大抖动”。For example, suppose the preset thresholds are the first threshold A, the second threshold B, and the third threshold C, and A <B <C. The sum of the absolute values of the gyro motion in the three directions currently obtained is S . If S <A, then determine the current jitter of the imaging device as “no jitter”; if A <S <B, you can determine the current jitter of the imaging device as “slight jitter”; if B <S <C, you can It is determined that the current jitter level of the imaging device is "small jitter"; if S> C, it can be determined that the current jitter level of the imaging device is "large jitter".
需要说明的是,上述举例仅为示例性的,不能视为对本公开的限制。实际使用时,可以根据实际需要预设阈值的数量和各阈值的具体数值,以及根据gyro信息与各阈值的关系,预设gyro信息与成像设备抖动程度的映射关系。It should be noted that the above examples are merely exemplary and cannot be regarded as limiting the present disclosure. In actual use, the number of thresholds and specific values of each threshold can be preset according to actual needs, and the mapping relationship between the gyro information and the degree of jitter of the imaging device can be preset according to the relationship between the gyro information and each threshold.
作为另一种可能的实现方式,可通过确定成像设备的预览画面是够包含人脸,进而识别当前拍摄场景适用的夜景模式。As another possible implementation manner, the night view mode applicable to the current shooting scene may be identified by determining that the preview screen of the imaging device is sufficient to include a human face.
在本公开实施例中,预览画面是否包含人脸可通过人脸识别技术来确定。人脸识别技术,是通过分析比较人脸视觉特征信息进行身份鉴别,它属于生物特征识别技术,是对生物体(一般特指人)本身的生物特征来区分生物体个体。目前,人脸识别技术已应用在众多领域当中,例如,数码相机人脸自动对焦和笑脸快门技术;企业、住宅安全和管理;门禁系统;摄像监视系统等。常用的人脸识别算法包括:基于人脸特征点的识别算法(Feature-based recognition algorithms)、基于整幅人脸图像的识别算法(Appearance-based recognition algorithms)、基于模板的识别算法(Template-based recognition algorithms)、利用神经网络进行识别的算法(Recognition algorithms using neural network)等等。In the embodiment of the present disclosure, whether the preview picture includes a human face can be determined by using a face recognition technology. Face recognition technology is to identify the identity by analyzing and comparing the visual characteristic information of the face. It belongs to the biometric recognition technology, which distinguishes the individual organisms from the biological characteristics of the organisms (generally specifically people). At present, face recognition technology has been applied in many fields, such as digital camera face autofocus and smile shutter technology; corporate and residential security and management; access control systems; camera surveillance systems, etc. Commonly used face recognition algorithms include: Feature-based recognition algorithms (Feature-based recognition algorithms), Appearance-based recognition algorithms (Template-based recognition algorithms) recognition algorithms), algorithms using neural networks for recognition (Recognition algorithms, neural networks), and so on.
需要说明的是,当检测到预览画面包含人脸时,成像设备的测光模块会自动以人脸区域为主进行测光,并根据人脸区域的测光结果确定基准曝光量。然而,在夜景场景中,人脸区域的光照度通常较低,从而导致确定的基准曝光量,与未包含人脸时确定的基准曝光量相比较高,若在包含人脸时仍然采集过多的过曝帧,则容易导致人脸区域过曝,从而导致采集图像的成像效果较差。因此,对于相同的抖动程度,预览画面中包含人脸与未包含人脸时相比,采用的夜景模式不相同。It should be noted that when it is detected that the preview image contains a human face, the metering module of the imaging device automatically performs metering mainly on the human face area, and determines the reference exposure amount according to the photometric result of the human face area. However, in night scenes, the light intensity of the face area is usually low, which results in a determined reference exposure amount that is higher than the reference exposure amount determined when the face is not included. Overexposed frames easily lead to overexposure of the human face area, resulting in poor imaging results of the collected images. Therefore, for the same degree of jitter, compared with the case where the face is included in the preview picture, the night scene mode is different.
步骤204,根据夜景模式,确定各帧待采集图像预设的曝光补偿值。Step 204: Determine a preset exposure compensation value for each frame of the image to be acquired according to the night scene mode.
作为一种可能的实现方式,成像设备的抖动程度不同,适用当前拍摄场景的夜景模式也不相同,因此,确定出的各帧待采集的图像预设的曝光补偿值也不相同。在本公开实施例中,可以预设成像设备的抖动程度与曝光补偿值之间的映射关系,以根据成像设备的抖动程度,确定出当前各帧待采集的图像预设的曝光补偿值。As a possible implementation manner, the degree of jitter of the imaging device is different, and the night scene mode applicable to the current shooting scene is also different. Therefore, the preset exposure compensation value of the image to be acquired determined for each frame is also different. In the embodiment of the present disclosure, the mapping relationship between the degree of jitter of the imaging device and the exposure compensation value may be preset to determine the preset exposure compensation value of the image to be acquired in each frame currently based on the degree of jitter of the imaging device.
例如,可以将成像设备的抖动程度为“无抖动”时,各帧待采集的图像对应的曝光补偿值的EV值范围预设为-6~2,且相邻的EV值之间的差值为0.5;将成像设备的抖动程度为“轻微抖动”,各帧待采集的图像对应的曝光补偿值的EV值范围预设为-5~1,且相邻的EV值之间的差值为1,等等。For example, when the degree of jitter of the imaging device is "no jitter", the range of EV values of the exposure compensation values corresponding to the images to be acquired in each frame is preset to -6 to 2, and the difference between adjacent EV values Is 0.5; the jitter level of the imaging device is "slight jitter", the EV value range of the exposure compensation value corresponding to each frame of the image to be acquired is preset to -5 to 1, and the difference between adjacent EV values is 1, wait.
作为另一种可能的实现形式,检测成像设备的预览画面是否包含人脸,预览画面中包含人脸与不包含人脸时,适用当前拍摄场景的夜景模式不相同,由此确定的各帧待采集图像预设的曝光补偿值也不相同。As another possible implementation form, it is detected whether the preview screen of the imaging device includes a human face. When the preview screen contains a human face and does not include a human face, the night scene mode applicable to the current shooting scene is different. The exposure compensation value preset for the captured image is also different.
作为另一种可能的实现方式,对于相同的抖动程度,可以根据预览画面中是否包含人脸,确定各帧待采集图像采用不同的曝光补偿值。因此,对于相同的抖动程度,可以对应于多个曝光补偿值。比如,成像设备的抖动程度为“轻微抖动”,各帧待采集图像预设的曝光补偿值有包含人脸和不含人脸两种情况。As another possible implementation manner, for the same degree of jitter, different exposure compensation values can be determined for each frame of images to be acquired according to whether a preview picture includes a human face. Therefore, for the same degree of jitter, it can correspond to multiple exposure compensation values. For example, the degree of dithering of the imaging device is "slightly dithered", and the preset exposure compensation value of each frame of the image to be collected includes two cases, including a human face and a non-human face.
在夜景模式中,当待采集图像中包含人脸时,人脸区域的光照强度通常较低,从而导致确定的基准曝光量,与未包含人脸时确定的基准曝光量相比较高,若在包含人脸时仍然采集过多的过曝帧,则容易导致人脸区域过曝,从而导致采集图像的成像效果较差,其对应的曝光补偿模式需要具有较低的曝光补偿范围。因此,对于相同的抖动程度,预览画面中包含人脸与未包含人脸时相比,在确定了成像设备当前的抖动程度,以及预览画面是否包含人脸之后,即可确定出与当前的实际情况相符的预设的曝光补偿值。In the night scene mode, when a face is included in the image to be collected, the light intensity of the face area is usually low, which results in a determined reference exposure amount that is higher than the reference exposure amount determined when the face is not included. When too many overexposure frames are still collected when a human face is included, it will easily lead to overexposure of the face area, resulting in poor imaging of the captured image. The corresponding exposure compensation mode needs to have a lower exposure compensation range. Therefore, for the same degree of jitter, compared with the case where the face is included in the preview screen compared to when no face is included, after determining the current degree of jitter of the imaging device and whether the preview screen contains a face, it can be determined from the current actual situation. The preset exposure compensation value matches the situation.
本公开实施例的曝光控制方法,通过获取预览画面,根据预览画面的画面内容,确定当前拍摄场景属于夜景场景,根据成像设备的抖动程度和/或预览画面是否包含人脸,识别当前拍摄场景适用的夜景模式,进而,根据夜景模式,确定各帧待采集图像预设的曝光补偿值。由此,根据成像设备的抖动程度和/或预览画面是否包含人脸,确定该拍摄场景下的夜景模式,进而确定各帧待采集图像预设的曝光补偿值,进一步的用于确定各帧待采集图像的曝光时长,根据时长下限更新至少一帧待采集图像的曝光时长,最终根据更新后的各帧待采集图像的曝光时长和感光度,进行曝光控制,进而成像,不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度,而且有效抑制了拍摄图像中的噪声,提高了夜景拍摄图像的质量,改善了用户体验。According to the exposure control method of the embodiment of the present disclosure, by acquiring a preview screen, it is determined that the current shooting scene belongs to a night scene according to the screen content of the preview screen, and according to the degree of jitter of the imaging device and / or whether the preview screen contains a human face, it is identified that the current shooting scene is applicable. Night scene mode, and further, according to the night scene mode, determine a preset exposure compensation value for each frame of images to be acquired. Therefore, according to the degree of jitter of the imaging device and / or whether the preview screen contains a human face, a night scene mode in the shooting scene is determined, and then a preset exposure compensation value for each frame to be acquired is determined, which is further used to determine each frame to be The exposure time of the captured image is updated according to the lower limit of the duration of at least one frame of the image to be collected. Finally, the exposure is controlled based on the exposure time and sensitivity of the updated image of each frame to be collected, and then imaging is performed, which not only improves the night scene shooting mode Lower the dynamic range and overall brightness of the captured image, and effectively suppress the noise in the captured image, improve the quality of the night scene captured image, and improve the user experience.
为了清楚说明上一实施例,本实施例提供了另一种曝光控制方法,图3为本公开实施 例所提供的另一种曝光控制方法的流程示意图。In order to clearly explain the previous embodiment, this embodiment provides another exposure control method. FIG. 3 is a schematic flowchart of another exposure control method according to an embodiment of the present disclosure.
如图3所示,该曝光控制方法可以包括以下步骤:As shown in FIG. 3, the exposure control method may include the following steps:
步骤301,测光以确定各帧待采集图像的目标曝光量。In step 301, photometry is performed to determine a target exposure of the image to be acquired in each frame.
步骤302,根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长。Step 302: Determine the exposure duration of the image to be acquired in each frame according to the target exposure of the image to be acquired in each frame and the preset sensitivity of the image to be acquired in each frame.
步骤303,若至少一帧待采集图像的曝光时长小于时长下限,根据时长下限,更新至少一帧待采集图像的曝光时长。In step 303, if the exposure duration of at least one frame of the image to be collected is less than the lower limit of time, the exposure time of at least one frame of the image to be collected is updated according to the lower limit of time.
本公开实施例中,上述步骤301-303的具体实现过程及原理,如前述实施例中的步骤101-103中所述,在此不再赘述。In the embodiment of the present disclosure, the specific implementation processes and principles of the above steps 301-303 are as described in steps 101-103 in the foregoing embodiment, and details are not described herein again.
步骤304,对曝光时长大于时长上限的待采集图像,根据对应的目标曝光量和时长上限,更新感光度;以及根据时长上限,更新曝光时长大于时长上限的待采集图像的曝光时长。Step 304: Update the sensitivity of the image to be acquired whose exposure duration is greater than the upper limit of the duration; and update the exposure duration of the image to be acquired whose exposure duration is greater than the upper limit of the duration according to the corresponding target exposure amount and the upper limit of the duration.
其中,曝光时长上限,为预先设定的曝光时长值。The upper limit of the exposure duration is a preset exposure duration value.
具体地,对于曝光时长大于时长上限的待采集图像,将待采集图像的曝光时长设定为时长上限,由于曝光量为感光度与曝光时长的乘积,因此,根据对应的目标曝光量和时长上限,更新待采集图像的感光度为目标曝光量与时长上限之间的比值。Specifically, for an image to be acquired whose exposure time is longer than the upper limit of the duration, the exposure time of the image to be acquired is set to the upper limit of the duration. Since the exposure amount is the product of the sensitivity and the exposure time, the corresponding target exposure amount and the upper limit of the duration , Update the sensitivity of the image to be acquired as the ratio between the target exposure and the upper limit of the duration.
需要说明的是,待采集图像的曝光时长大于时长上限时,如果采用该曝光时长进行曝光,由于曝光时长过长会导致画面抖动,因此将曝光时长大于时长上限的待采集图像的曝光时长更新为时长上限。It should be noted that when the exposure time of the image to be collected is greater than the upper limit, if the exposure time is used for exposure, the exposure time is too long, which will cause screen jitter. Therefore, the exposure time of the image to be collected whose exposure time is longer than the upper limit is updated to Maximum duration.
步骤305,对曝光时长大于或等于时长下限的其余各帧待采集图像,根据比值,更新其余各帧待采集图像的感光度。Step 305: For the remaining frames of images to be acquired whose exposure time is greater than or equal to the lower limit of time, the sensitivity of the remaining frames of images to be acquired is updated according to the ratio.
具体地,对于曝光时长大于或等于时长下限的其余各帧待采集图像,首先确定小于时长下限的待采集图像更新后的曝光时长与更新前的曝光时长之间的比值,再将该比值与其余各帧待采集图像更新前的感光度或曝光时长乘积,作为其余各帧待采集图像更新后的感光度或曝光时长。Specifically, for the remaining frames of images to be acquired whose exposure time is greater than or equal to the lower limit of time, first determine the ratio between the updated exposure time of the to-be-collected images that is less than the lower limit of time and the exposure time before the update, and then compare the ratio with the rest The product of the sensitivity or exposure time before updating of the images to be acquired in each frame is used as the sensitivity or exposure time after updating of the images to be acquired in the remaining frames.
作为一种示例,假如曝光时长大于或等于时长下限的待采集图像为4帧,根据成像设备的抖动程度确定各帧预设的感光度值均为100ISO,且4帧待采集图像的曝光时长分别为100ms、200ms、400ms和800ms。鉴于小于时长下限的待采集图像更新后的曝光时长与更新前的曝光时长之间的比值为10ms/1.5ms,即20/3,由此,确定这4帧待采集图像的曝光时长扩大为原来100ms、200ms、400ms和800ms的20/3倍。As an example, if the exposure time is greater than or equal to the lower limit of the duration of the image to be captured is 4 frames, it is determined that the preset sensitivity value of each frame is 100 ISO according to the degree of jitter of the imaging device, and the exposure durations of the 4 frames of image to be captured are respectively 100ms, 200ms, 400ms, and 800ms. Considering that the ratio between the updated exposure time of the to-be-collected image and the exposure time before the update is less than the lower limit of the time length, the value is 10ms / 1.5ms, that is, 20/3. Therefore, it is determined that the exposure time of the four frames to be collected is expanded to the original 20/3 times of 100ms, 200ms, 400ms and 800ms.
对感光度的更新方式与曝光时长的更新方式类似,仅需要将曝光时长替换为感光度即可,但需要注意的是,仅可根据前述小于时长下限的待采集图像更新后的曝光时长与更新前的曝光时长之间的比值,更新曝光时长和感光度中的一个,若需要对曝光时长和感光度 同时更新,则需要依权重对该比值进行分配后,进行更新。例如:对曝光时长和感光度各占一半权重,若前述小于时长下限的待采集图像更新后的曝光时长与更新前的曝光时长之间的比值为R,将曝光时长扩大为原来的R/2倍,将感光度扩大为原来的R/2倍。The method for updating the sensitivity is similar to the method for updating the exposure duration. It is only necessary to replace the exposure duration with the sensitivity, but it should be noted that the exposure duration and update can only be updated according to the aforementioned to-be-collected images that are less than the lower limit of the duration. One of the ratio between the previous exposure time and the exposure time and the sensitivity is updated. If the exposure time and the sensitivity need to be updated at the same time, the ratio needs to be assigned according to the weight and then updated. For example, the exposure duration and the sensitivity are each half weighted. If the ratio between the updated exposure duration of the to-be-collected image smaller than the lower duration and the exposure duration before the update is R, the exposure duration is enlarged to the original R / 2 To increase the sensitivity to the original R / 2 times.
步骤306,根据各帧待采集图像的曝光时长和感光度,进行曝光控制。Step 306: Perform exposure control according to the exposure duration and sensitivity of the images to be collected in each frame.
本公开实施例中,成像设备可以根据确定的各帧待采集图像的曝光时长和感光度,进行曝光控制,进而成像。In the embodiment of the present disclosure, the imaging device may perform exposure control according to the determined exposure duration and sensitivity of each frame to be acquired, and then perform imaging.
本公开实施例的曝光控制方法,通过测光以确定各帧待采集图像的目标曝光量;根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长,若至少一帧待采集图像的曝光时长小于时长下限,根据时长下限,更新至少一帧待采集图像的曝光时长;对曝光时长大于时长上限的待采集图像,根据对应的目标曝光量和时长上限,更新感光度;以及根据时长上限,更新曝光时长大于时长上限的待采集图像的曝光时长,最终根据各帧待采集图像的曝光时长和感光度,进行曝光控制。由此,通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度,确定了各帧待采集图像的曝光时长,进而根据曝光时长下限与时长上限更新各帧待采集图像的感光度,最终根据更新后的各帧待采集图像的曝光时长和感光度,进行曝光控制,进而成像,不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度,而且有效抑制了拍摄图像中的噪声,提高了夜景拍摄图像的质量,改善了用户体验。According to the exposure control method of the embodiment of the present disclosure, the target exposure amount of each frame to be acquired is determined by photometry; the target exposure amount of each frame to be acquired and the preset sensitivity of each frame to be acquired are used to determine each frame to be acquired. The exposure duration of the captured image. If the exposure duration of at least one frame of the to-be-acquired image is less than the lower duration limit, the exposure duration of at least one frame of the to-be-acquired image is updated according to the lower duration limit; for the to-be-acquired image whose exposure duration is greater than the upper duration limit, the corresponding target The exposure amount and the upper limit of the duration are used to update the sensitivity; and according to the upper limit of the duration, the exposure time of the image to be collected whose exposure time is greater than the upper limit of the duration is updated, and finally exposure control is performed according to the exposure time and sensitivity of the image to be collected for each frame. Therefore, the exposure duration of each frame to be captured is determined according to the degree of jitter of the imaging device and the ambient light brightness of the current shooting scene, and then the sensitivity of each frame to be collected is updated according to the lower limit of exposure duration and the upper limit of duration. The updated exposure time and sensitivity of each frame to be captured after the update, and exposure control, and then imaging, not only improves the dynamic range and overall brightness of the captured image in the night shooting mode, but also effectively suppresses noise in the captured image and improves The quality of night shot images improves the user experience.
为了实现上述实施例,本公开还提出一种曝光控制装置。In order to implement the above embodiments, the present disclosure also proposes an exposure control device.
图4为本公开实施例提供的一种曝光控制装置的结构示意图。FIG. 4 is a schematic structural diagram of an exposure control apparatus according to an embodiment of the present disclosure.
如图4所示,该曝光控制装置100包括:测光模块110、确定模块120、更新模块130以及控制模块140。As shown in FIG. 4, the exposure control device 100 includes a photometric module 110, a determination module 120, an update module 130, and a control module 140.
测光模块110,用于测光以确定各帧待采集图像的目标曝光量。The photometry module 110 is configured to perform photometry to determine a target exposure amount of an image to be acquired in each frame.
确定模块120,用于根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长。The determining module 120 is configured to determine an exposure duration of the image to be acquired in each frame according to a target exposure amount of the image to be acquired in each frame and a preset sensitivity of the image to be acquired in each frame.
更新模块130,用于若至少一帧待采集图像的曝光时长小于时长下限,根据时长下限,更新至少一帧待采集图像的曝光时长。其中,时长下限大于或等于10ms。The update module 130 is configured to update the exposure duration of at least one frame of the image to be acquired if the exposure time of the at least one frame of image to be acquired is less than the lower limit of time. The lower limit of the duration is greater than or equal to 10 ms.
控制模块140,用于根据各帧待采集图像的曝光时长和感光度,进行曝光控制。The control module 140 is configured to perform exposure control according to the exposure duration and sensitivity of the image to be collected in each frame.
作为另一种可能的实现方式,该曝光控制装置100,还包括:As another possible implementation manner, the exposure control apparatus 100 further includes:
第一确定模块,用于根据抖动程度,确定各帧待采集图像所述预设的感光度。The first determining module is configured to determine the preset sensitivity of the image to be collected for each frame according to the degree of jitter.
作为另一种可能的实现方式,第一确定模块,还可以具体用于As another possible implementation manner, the first determining module may also be specifically used for
从成像设备设置的传感器,获取采集到的位移信息;Obtain the collected displacement information from the sensors set by the imaging equipment;
根据位移信息,确定成像设备的抖动程度;Determine the degree of jitter of the imaging device according to the displacement information;
若抖动程度大于或等于抖动阈值,确定预设的感光度取值为第一感光值;If the degree of shaking is greater than or equal to the shaking threshold, determining that the preset sensitivity value is the first sensitivity value;
若抖动程度小于抖动阈值,确定预设的感光度取值为第二感光值;其中,第一感光值大于第二感光值。If the dithering degree is less than the dithering threshold, it is determined that the preset sensitivity value is the second sensitivity value, wherein the first sensitivity value is greater than the second sensitivity value.
其中,第一感光值为第二感光值的预设倍数,并且预设倍数取值大于等于2;第二感光值为成像设备的最小感光度。The first photosensitivity value is a preset multiple of the second photosensitivity value, and the preset multiplier value is greater than or equal to 2; the second photosensitivity value is the minimum sensitivity of the imaging device.
作为另一种可能的实现方式,测光模块110,还可以具体用于:As another possible implementation manner, the photometric module 110 may also be specifically used for:
根据预览图像的亮度信息,确定基准曝光量;基准曝光量包括基准曝光时长和基准感光度;Determine the reference exposure amount according to the brightness information of the preview image; the reference exposure amount includes the reference exposure duration and the reference sensitivity;
根据基准曝光量和各帧待采集图像预设的曝光补偿值,确定各帧待采集图像的目标曝光量。The target exposure amount of the image to be acquired for each frame is determined according to the reference exposure amount and the preset exposure compensation value of the image to be acquired for each frame.
作为另一种可能的实现方式,测光模块110,还包括:As another possible implementation manner, the photometric module 110 further includes:
获取单元,用于获取预览画面。An obtaining unit for obtaining a preview picture.
第一确定单元,用于根据预览画面的画面内容,确定当前拍摄场景属于夜景场景。The first determining unit is configured to determine that the current shooting scene belongs to a night scene according to the picture content of the preview picture.
识别单元,用于根据成像设备的抖动程度和/或预览画面是否包含人脸,识别当前拍摄场景适用的夜景模式。The identification unit is configured to identify a night scene mode applicable to the current shooting scene according to the degree of jitter of the imaging device and / or whether the preview screen contains a human face.
第二确定单元,用于根据夜景模式,确定各帧待采集图像预设的曝光补偿值。The second determining unit is configured to determine a preset exposure compensation value of the image to be acquired in each frame according to the night scene mode.
作为另一种可能的实现方式,该曝光控制装置100,还包括:As another possible implementation manner, the exposure control apparatus 100 further includes:
第二确定模块,用于确定至少一帧待采集图像更新后的曝光时长与更新前的曝光时长之间的比值。The second determining module is configured to determine a ratio between an updated exposure time of the at least one frame of the image to be acquired and an updated exposure time before the update.
第一更新模块,用于对曝光时长大于或等于时长下限的其余各帧待采集图像,根据比值,更新其余各帧待采集图像的感光度或曝光时长。The first update module is configured to update the sensitivity or exposure duration of the remaining frames of images to be acquired based on the ratio of the remaining frames of images to be collected whose exposure time is greater than or equal to the lower limit of the duration.
作为另一种可能的实现方式,第一更新模块,还用于:As another possible implementation manner, the first update module is further configured to:
将比值与其余各帧待采集图像更新前的感光度乘积,作为其余各帧待采集图像更新后的感光度。The product of the ratio and the sensitivity of the remaining frames to be acquired before being updated is used as the sensitivity of the remaining frames to be acquired after being updated.
或者,将比值与其余各帧待采集图像更新前的曝光时长乘积,作为其余各帧待采集图像更新后的曝光时长。Alternatively, the product of the ratio and the exposure time before the images to be acquired in the remaining frames are updated is used as the exposure time after the images in the remaining frames are to be updated.
作为另一种可能的实现方式,该曝光控制装置100,还包括:As another possible implementation manner, the exposure control apparatus 100 further includes:
第二更新模块,用于对曝光时长大于时长上限的待采集图像,根据对应的目标曝光量和时长上限,更新感光度;以及A second update module, configured to update the sensitivity of an image to be acquired whose exposure time is longer than the upper limit of the duration according to the corresponding target exposure amount and upper limit of the duration; and
根据时长上限,更新曝光时长大于时长上限的待采集图像的曝光时长。According to the upper limit of the duration, the exposure duration of the image to be acquired whose exposure duration is greater than the upper limit of the duration is updated.
本公开实施例的曝光控制装置,通过测光以确定各帧待采集图像的目标曝光量;根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝 光时长,若至少一帧待采集图像的曝光时长小于时长下限,根据时长下限,更新至少一帧待采集图像的曝光时长,最终根据各帧待采集图像的曝光时长和感光度,进行曝光控制。由此,通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度,确定了各帧待采集图像的曝光时长,进而根据时长下限更新至少一帧待采集图像的曝光时长,最终根据更新后的各帧待采集图像的曝光时长和感光度,进行曝光控制,进而成像,不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度,而且有效抑制了拍摄图像中的噪声,提高了夜景拍摄图像的质量,改善了用户体验。The exposure control device according to the embodiment of the present disclosure determines the target exposure amount of the images to be acquired by each frame through photometry; and determines the target exposure of each frame according to the target exposure amount of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame. The exposure duration of the captured image. If the exposure duration of at least one frame of the to-be-collected image is less than the lower limit of time, the exposure duration of at least one frame of the to-be-acquired image is updated according to the lower limit of time, and finally, Exposure control. Therefore, the exposure duration of each frame to be acquired is determined according to the degree of jitter of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame to be acquired is updated according to the lower limit of the duration, and finally based on the updated The exposure duration and sensitivity of each frame of images to be collected, exposure control, and then imaging, not only improves the dynamic range and overall brightness of the captured image in the night scene shooting mode, but also effectively suppresses noise in the captured image and improves the night scene captured image Quality and improved user experience.
需要说明的是,前述对曝光控制方法实施例的解释说明也适用于该实施例的曝光控制装置,此处不再赘述。It should be noted that the foregoing explanation of the embodiment of the exposure control method is also applicable to the exposure control device of this embodiment, and details are not described herein again.
为了实现上述实施例,本公开实施例还提供了一种计算机可读存储介质。一个或多个包含计算机可执行指令的非易失性计算机可读存储介质,当所述计算机可执行指令被一个或多个处理器执行时,使得所述处理器执行以下步骤:In order to implement the foregoing embodiments, an embodiment of the present disclosure further provides a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions, when the computer-executable instructions are executed by one or more processors, cause the processors to perform the following steps:
测光以确定各帧待采集图像的目标曝光量;Metering to determine the target exposure for each frame of image to be acquired;
根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长;Determining the exposure duration of the images to be acquired in each frame according to the target exposure of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame;
若至少一帧待采集图像的曝光时长小于时长下限,根据所述至少一帧待采集图像的目标曝光量和所述时长下限,更新所述至少一帧待采集图像的感光度,以及根据所述时长下限,更新所述至少一帧待采集图像的曝光时长;If the exposure duration of at least one frame of the image to be acquired is less than the lower limit of time, updating the sensitivity of the at least one frame of the image to be acquired according to the target exposure of the at least one frame of the image to be acquired and the lower limit of time; Lower limit of duration, updating the exposure duration of the at least one frame of images to be acquired;
根据各帧待采集图像的曝光时长和感光度,进行曝光控制。Perform exposure control according to the exposure duration and sensitivity of each frame of images to be acquired.
为了实现上述实施例,本公开还提出一种电子设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时,实现如上述实施例所述的曝光控制方法。In order to implement the above embodiments, the present disclosure also proposes an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the implementation is as described above. The exposure control method according to the embodiment.
请参阅图5,本公开还提供另一种电子设备200。电子设备200包括存储器50和处理器60。存储器50中存储有计算机可读指令。计算机可读指令被存储器50执行时,使得处理器60执行上述任一实施方式的曝光控制方法。Referring to FIG. 5, the present disclosure also provides another electronic device 200. The electronic device 200 includes a memory 50 and a processor 60. The memory 50 stores computer-readable instructions. When the computer-readable instructions are executed by the memory 50, the processor 60 is caused to execute the exposure control method according to any one of the foregoing embodiments.
图5为一个实施例中电子设备200的内部结构示意图。该电子设备200包括通过系统总线81连接的处理器60、存储器50(例如为非易失性存储介质)、内存储器82、显示屏83和输入装置84。其中,电子设备200的存储器50存储有操作系统和计算机可读指令。该计算机可读指令可被处理器60执行,以实现本公开实施方式的曝光控制方法。该处理器60用于提供计算和控制能力,支撑整个电子设备200的运行。电子设备200的内存储器50为存储器52中的计算机可读指令的运行提供环境。电子设备200的显示屏83可以是液晶显示屏或者电子墨水显示屏等,输入装置84可以是显示屏83上覆盖的触摸层,也可以是 电子设备200外壳上设置的按键、轨迹球或触控板,也可以是外接的键盘、触控板或鼠标等。该电子设备200可以是手机、平板电脑、笔记本电脑、个人数字助理或穿戴式设备(例如智能手环、智能手表、智能头盔、智能眼镜)等。本领域技术人员可以理解,图5中示出的结构,仅仅是与本公开方案相关的部分结构的示意图,并不构成对本公开方案所应用于其上的电子设备200的限定,具体的电子设备200可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。FIG. 5 is a schematic diagram of the internal structure of the electronic device 200 in an embodiment. The electronic device 200 includes a processor 60, a memory 50 (for example, a non-volatile storage medium), an internal memory 82, a display screen 83, and an input device 84 connected through a system bus 81. The memory 50 of the electronic device 200 stores an operating system and computer-readable instructions. The computer-readable instructions can be executed by the processor 60 to implement the exposure control method of the embodiment of the present disclosure. The processor 60 is used to provide computing and control capabilities to support the operation of the entire electronic device 200. The internal memory 50 of the electronic device 200 provides an environment for execution of computer-readable instructions in the memory 52. The display screen 83 of the electronic device 200 may be a liquid crystal display or an electronic ink display, and the input device 84 may be a touch layer covered on the display screen 83, or may be a button, a trackball or a touch button provided on the housing of the electronic device 200 Board, which can also be an external keyboard, trackpad, or mouse. The electronic device 200 may be a mobile phone, a tablet computer, a notebook computer, a personal digital assistant, or a wearable device (for example, a smart bracelet, a smart watch, a smart helmet, or smart glasses). Those skilled in the art can understand that the structure shown in FIG. 5 is only a schematic diagram of a part of the structure related to the solution of the present disclosure, and does not constitute a limitation on the electronic device 200 to which the solution of the present disclosure is applied. The specific electronic device 200 may include more or fewer components than shown in the figure, or some components may be combined, or have different component arrangements.
请参阅图6,本公开实施例的电子设备200中包括图像处理电路90,图像处理电路90可利用硬件和/或软件组件实现,包括定义ISP(Image Signal Processing,图像信号处理)管线的各种处理单元。图6为一个实施例中图像处理电路90的示意图。如图6所示,为便于说明,仅示出与本公开实施例相关的图像处理技术的各个方面。Please refer to FIG. 6. The electronic device 200 according to the embodiment of the present disclosure includes an image processing circuit 90. The image processing circuit 90 may be implemented by using hardware and / or software components, including various types of ISP (Image Signal Processing) pipelines. Processing unit. FIG. 6 is a schematic diagram of an image processing circuit 90 in one embodiment. As shown in FIG. 6, for convenience of explanation, only various aspects of the image processing technology related to the embodiments of the present disclosure are shown.
如图6所示,图像处理电路90包括ISP处理器91(ISP处理器91可为处理器60)和控制逻辑器92。摄像头93捕捉的图像数据首先由ISP处理器91处理,ISP处理器91对图像数据进行分析以捕捉可用于确定摄像头93的一个或多个控制参数的图像统计信息。摄像头93可包括一个或多个透镜932和图像传感器934。图像传感器934可包括色彩滤镜阵列(如Bayer滤镜),图像传感器934可获取每个成像像素捕捉的光强度和波长信息,并提供可由ISP处理器91处理的一组原始图像数据。传感器94(如陀螺仪)可基于传感器94接口类型把采集的图像处理的参数(如防抖参数)提供给ISP处理器91。传感器94接口可以为SMIA(Standard Mobile Imaging Architecture,标准移动成像架构)接口、其它串行或并行照相机接口或上述接口的组合。As shown in FIG. 6, the image processing circuit 90 includes an ISP processor 91 (the ISP processor 91 may be the processor 60) and a control logic 92. The image data captured by the camera 93 is first processed by the ISP processor 91. The ISP processor 91 analyzes the image data to capture image statistical information that can be used to determine one or more control parameters of the camera 93. The camera 93 may include one or more lenses 932 and an image sensor 934. The image sensor 934 may include a color filter array (such as a Bayer filter). The image sensor 934 may obtain light intensity and wavelength information captured by each imaging pixel, and provide a set of raw image data that can be processed by the ISP processor 91. The sensor 94 (such as a gyroscope) may provide parameters (such as image stabilization parameters) of the acquired image processing to the ISP processor 91 based on the interface type of the sensor 94. The sensor 94 interface may be a SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the foregoing interfaces.
此外,图像传感器934也可将原始图像数据发送给传感器94,传感器94可基于传感器94接口类型把原始图像数据提供给ISP处理器91,或者传感器94将原始图像数据存储到图像存储器95中。In addition, the image sensor 934 may also send the original image data to the sensor 94. The sensor 94 may provide the original image data to the ISP processor 91 based on the interface type of the sensor 94, or the sensor 94 stores the original image data into the image memory 95.
ISP处理器91按多种格式逐个像素地处理原始图像数据。例如,每个图像像素可具有8、10、12或14比特的位深度,ISP处理器91可对原始图像数据进行一个或多个图像处理操作、收集关于图像数据的统计信息。其中,图像处理操作可按相同或不同的位深度精度进行。The ISP processor 91 processes the original image data pixel by pixel in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 91 may perform one or more image processing operations on the original image data and collect statistical information about the image data. The image processing operations may be performed with the same or different bit depth accuracy.
ISP处理器91还可从图像存储器95接收图像数据。例如,传感器94接口将原始图像数据发送给图像存储器95,图像存储器95中的原始图像数据再提供给ISP处理器91以供处理。图像存储器95可为存储器50、存储器50的一部分、存储设备、或电子设备内的独立的专用存储器,并可包括DMA(Direct Memory Access,直接直接存储器存取)特征。The ISP processor 91 may also receive image data from the image memory 95. For example, the sensor 94 interface sends the original image data to the image memory 95, and the original image data in the image memory 95 is then provided to the ISP processor 91 for processing. The image memory 95 may be an independent dedicated memory in the memory 50, a part of the memory 50, a storage device, or an electronic device, and may include a DMA (Direct Memory Access) feature.
当接收到来自图像传感器934接口或来自传感器94接口或来自图像存储器95的原始图像数据时,ISP处理器91可进行一个或多个图像处理操作,如时域滤波。处理后的图像 数据可发送给图像存储器95,以便在被显示之前进行另外的处理。ISP处理器91从图像存储器95接收处理数据,并对处理数据进行原始域中以及RGB和YCbCr颜色空间中的图像数据处理。ISP处理器91处理后的图像数据可输出给显示器97(显示器97可包括显示屏83),以供用户观看和/或由图形引擎或GPU(Graphics Processing Unit,图形处理器)进一步处理。此外,ISP处理器91的输出还可发送给图像存储器95,且显示器97可从图像存储器95读取图像数据。在一个实施例中,图像存储器95可被配置为实现一个或多个帧缓冲器。此外,ISP处理器91的输出可发送给编码器/解码器96,以便编码/解码图像数据。编码的图像数据可被保存,并在显示于显示器97设备上之前解压缩。编码器/解码器96可由CPU或GPU或协处理器实现。When receiving raw image data from the image sensor 934 interface or from the sensor 94 interface or from the image memory 95, the ISP processor 91 may perform one or more image processing operations, such as time-domain filtering. The processed image data can be sent to the image memory 95 for further processing before being displayed. The ISP processor 91 receives processing data from the image memory 95, and performs processing on the image data in the original domain and in the RGB and YCbCr color spaces. The image data processed by the ISP processor 91 may be output to a display 97 (the display 97 may include a display screen 83) for viewing by a user and / or further processing by a graphics engine or a GPU (Graphics Processing Unit). In addition, the output of the ISP processor 91 can also be sent to the image memory 95, and the display 97 can read image data from the image memory 95. In one embodiment, the image memory 95 may be configured to implement one or more frame buffers. In addition, the output of the ISP processor 91 may be sent to an encoder / decoder 96 to encode / decode image data. The encoded image data can be saved and decompressed before being displayed on the display 97 device. The encoder / decoder 96 may be implemented by a CPU or a GPU or a coprocessor.
ISP处理器91确定的统计数据可发送给控制逻辑器92单元。例如,统计数据可包括自动曝光、自动白平衡、自动聚焦、闪烁检测、黑电平补偿、透镜932阴影校正等图像传感器934统计信息。控制逻辑器92可包括执行一个或多个例程(如固件)的处理元件和/或微控制器,一个或多个例程可根据接收的统计数据,确定摄像头93的控制参数及ISP处理器91的控制参数。例如,摄像头93的控制参数可包括传感器94控制参数(例如增益、曝光控制的积分时间、防抖参数等)、照相机闪光控制参数、透镜932控制参数(例如聚焦或变焦用焦距)、或这些参数的组合。ISP控制参数可包括用于自动白平衡和颜色调整(例如,在RGB处理期间)的增益水平和色彩校正矩阵,以及透镜932阴影校正参数。The statistical data determined by the ISP processor 91 may be sent to the control logic unit 92. For example, the statistical data may include image sensor 934 statistical information such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, and lens 932 shading correction. The control logic 92 may include a processing element and / or a microcontroller that executes one or more routines (such as firmware). The one or more routines may determine the control parameters of the camera 93 and the ISP processor according to the received statistical data. 91 control parameters. For example, the control parameters of the camera 93 may include sensor 94 control parameters (such as gain, integration time for exposure control, anti-shake parameters, etc.), camera flash control parameters, lens 932 control parameters (such as focus distance for focusing or zooming), or these parameters The combination. The ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), and lens 932 shading correction parameters.
以下为运用图6中图像处理技术实现曝光控制方法的步骤:The following are the steps to implement the exposure control method using the image processing technology in FIG. 6:
测光以确定各帧待采集图像的目标曝光量;根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长;若至少一帧待采集图像的曝光时长小于时长下限,根据所述至少一帧待采集图像的目标曝光量和所述时长下限,更新所述至少一帧待采集图像的感光度,以及根据所述时长下限,更新所述至少一帧待采集图像的曝光时长;根据各帧待采集图像的曝光时长和感光度,进行曝光控制。Metering to determine the target exposure of each frame to be acquired; based on the target exposure of each frame to be acquired and the preset sensitivity of each frame to be acquired, determine the exposure time of each frame to be acquired; if at least one frame The exposure duration of the image to be acquired is less than the lower limit of time, and the sensitivity of the at least one frame of the image to be acquired is updated according to the target exposure of the at least one frame of image to be acquired and the lower limit of time, and according to the lower limit of time, the update is performed. The exposure duration of the at least one frame of images to be acquired; and performing exposure control according to the exposure duration and sensitivity of each frame of images to be acquired.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的程序可存储于一非易失性计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)等。A person of ordinary skill in the art can understand that all or part of the processes in the methods of the foregoing embodiments can be implemented by using a computer program to instruct related hardware. The program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it may include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or the like.
以上所述实施例仅表达了本发明的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进,这些都属于本发明的保护范围。因此,本发明专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several implementation manners of the present invention, and their descriptions are more specific and detailed, but they cannot be understood as limiting the scope of the patent of the present invention. It should be noted that, for those of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can be made, which all belong to the protection scope of the present invention. Therefore, the protection scope of the invention patent shall be subject to the appended claims.

Claims (22)

  1. 一种曝光控制方法,其特征在于,所述方法包括以下步骤:An exposure control method, characterized in that the method includes the following steps:
    测光以确定各帧待采集图像的目标曝光量;Metering to determine the target exposure for each frame of image to be acquired;
    根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长;Determining the exposure duration of the images to be acquired in each frame according to the target exposure of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame;
    若至少一帧待采集图像的曝光时长小于时长下限,根据所述时长下限,更新所述至少一帧待采集图像的曝光时长;If the exposure duration of at least one frame of the image to be collected is less than the lower limit of time, updating the exposure time of the at least one frame of the image to be collected according to the lower limit of time;
    根据各帧待采集图像的曝光时长和感光度,进行曝光控制。Perform exposure control according to the exposure duration and sensitivity of each frame of images to be acquired.
  2. 根据权利要求1所述的曝光控制方法,其特征在于,所述根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长之前,还包括:The exposure control method according to claim 1, wherein before determining the exposure duration of the images to be acquired in each frame according to the target exposure amount of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame, Also includes:
    根据抖动程度,确定各帧待采集图像所述预设的感光度。According to the degree of jitter, the preset sensitivity of the image to be collected for each frame is determined.
  3. 根据权利要求2所述的曝光控制方法,其特征在于,各帧待采集图像所述预设的感光度相同,所述根据抖动程度,确定各帧待采集图像所述预设的感光度,包括:The exposure control method according to claim 2, wherein the preset sensitivity of the image to be collected in each frame is the same, and the determining the preset sensitivity of the image to be collected in each frame according to the degree of jitter comprises: :
    从成像设备设置的传感器,获取采集到的位移信息;Obtain the collected displacement information from the sensors set by the imaging equipment;
    根据所述位移信息,确定所述成像设备的抖动程度;Determining a degree of jitter of the imaging device according to the displacement information;
    若所述抖动程度大于或等于抖动阈值,确定所述预设的感光度取值为第一感光值;If the degree of shaking is greater than or equal to a shaking threshold, determining that the preset sensitivity value is a first sensitivity value;
    若所述抖动程度小于抖动阈值,确定所述预设的感光度取值为第二感光值;其中,所述第一感光值大于所述第二感光值。If the degree of dithering is less than the dithering threshold, it is determined that the preset sensitivity value is a second sensitivity value; wherein the first sensitivity value is greater than the second sensitivity value.
  4. 根据权利要求3所述的曝光控制方法,其特征在于,The exposure control method according to claim 3, wherein
    所述第一感光值为所述第二感光值的预设倍数,所述预设倍数取值大于等于2;The first photosensitive value is a preset multiple of the second photosensitive value, and the preset multiple takes a value greater than or equal to 2;
    所述第二感光值为所述成像设备的最小感光度。The second sensitivity value is a minimum sensitivity of the imaging device.
  5. 根据权利要求1-4任一项所述的曝光控制方法,其特征在于,The exposure control method according to any one of claims 1 to 4, wherein:
    所述时长下限大于或等于10ms。The lower limit of the duration is greater than or equal to 10 ms.
  6. 根据权利要求1-5任一项所述的曝光控制方法,其特征在于,所述测光以确定各帧待采集图像的目标曝光量,包括:The exposure control method according to any one of claims 1 to 5, wherein the metering to determine a target exposure amount of an image to be acquired in each frame comprises:
    根据预览图像的亮度信息,确定基准曝光量;所述基准曝光量包括基准曝光时长和基准感光度;Determining a reference exposure amount according to the brightness information of the preview image; the reference exposure amount includes a reference exposure duration and a reference sensitivity;
    根据所述基准曝光量和各帧待采集图像预设的曝光补偿值,确定各帧待采集图像的目标曝光量。The target exposure amount of the image to be acquired for each frame is determined according to the reference exposure amount and the preset exposure compensation value of the image to be acquired for each frame.
  7. 根据权利要求6所述的曝光控制方法,其特征在于,所述根据所述基准曝光量和各帧待采集图像预设的曝光补偿值,确定各帧待采集图像的目标曝光量之前,还包括:The exposure control method according to claim 6, wherein before determining the target exposure amount of the image to be acquired for each frame according to the reference exposure amount and an exposure compensation value preset for each frame of the image to be acquired, further comprising: :
    获取预览画面;Get preview picture;
    根据所述预览画面的画面内容,确定当前拍摄场景属于夜景场景;Determine that the current shooting scene belongs to a night scene according to the picture content of the preview picture;
    根据成像设备的抖动程度和/或所述预览画面是否包含人脸,识别当前拍摄场景适用的夜景模式;Identifying the night scene mode applicable to the current shooting scene according to the degree of shaking of the imaging device and / or whether the preview picture contains a human face;
    根据所述夜景模式,确定各帧待采集图像预设的曝光补偿值。According to the night scene mode, a preset exposure compensation value of each frame to be acquired is determined.
  8. 根据权利要求1-5任一项所述的曝光控制方法,其特征在于,所述根据所述时长下限,更新所述至少一帧待采集图像的曝光时长之后,还包括:The exposure control method according to any one of claims 1-5, wherein after updating the exposure duration of the at least one frame of the image to be acquired according to the lower limit of duration, further comprising:
    确定所述至少一帧待采集图像更新后的曝光时长与更新前的曝光时长之间的比值;Determining a ratio between an updated exposure time of the at least one frame of images to be acquired and an exposure time before the update;
    对曝光时长大于或等于所述时长下限的其余各帧待采集图像,根据所述比值,更新所述其余各帧待采集图像的感光度或曝光时长。For the remaining frames of images to be acquired whose exposure time is greater than or equal to the lower limit of the time length, the sensitivity or exposure time of the images of the remaining frames to be acquired is updated according to the ratio.
  9. 根据权利要求8所述的曝光控制方法,其特征在于,所述根据所述比值,更新所述其余各帧待采集图像的感光度或曝光时长,包括:The exposure control method according to claim 8, wherein updating the sensitivity or exposure duration of the images to be acquired in the remaining frames according to the ratio comprises:
    将所述比值与所述其余各帧待采集图像更新前的感光度乘积,作为所述其余各帧待采集图像更新后的感光度;Multiplying the ratio by the sensitivity of the remaining frames to be acquired before the image is updated as the sensitivity of the remaining frames to be acquired after the image is updated;
    或者,将所述比值与所述其余各帧待采集图像更新前的曝光时长乘积,作为所述其余各帧待采集图像更新后的曝光时长。Alternatively, the product of the ratio and the exposure duration before the images to be acquired in the remaining frames are updated is used as the exposure duration after the images in the remaining frames are to be updated.
  10. 根据权利要求8或9所述的曝光控制方法,其特征在于,所述对曝光时长大于或等于所述时长下限的其余各帧待采集图像,根据所述比值,更新所述其余各帧待采集图像的感光度之前,还包括:The exposure control method according to claim 8 or 9, wherein the pair of remaining frames to be acquired whose exposure duration is greater than or equal to the lower limit of the duration is updated according to the ratio, and the remaining frames to be acquired are updated Before the sensitivity of the image, it also includes:
    对曝光时长大于时长上限的待采集图像,根据对应的目标曝光量和所述时长上限,更新感光度;以及Update the sensitivity of an image to be acquired whose exposure time is longer than the upper limit of time, according to the corresponding target exposure amount and the upper limit of time; and
    根据所述时长上限,更新所述曝光时长大于时长上限的待采集图像的曝光时长。Update the exposure duration of the image to be acquired whose exposure duration is greater than the duration upper limit according to the duration upper limit.
  11. 一种曝光控制装置,其特征在于,所述装置包括:An exposure control device, characterized in that the device includes:
    测光模块,用于测光以确定各帧待采集图像的目标曝光量;A light metering module, which is used for light metering to determine the target exposure of each frame of images to be acquired;
    确定模块,用于根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度,确定各帧待采集图像的曝光时长;A determining module, configured to determine the exposure duration of the images to be acquired in each frame according to the target exposure of the images to be acquired in each frame and the preset sensitivity of the images to be acquired in each frame;
    更新模块,用于若至少一帧待采集图像的曝光时长小于时长下限,根据所述至少一帧待采集图像的目标曝光量和所述时长下限,更新所述至少一帧待采集图像的感光度,以及根据所述时长下限,更新所述至少一帧待采集图像的曝光时长;An update module for updating the sensitivity of the at least one frame of images to be acquired if the exposure time of the at least one frame of images to be acquired is less than the lower limit of time; And updating the exposure duration of the at least one frame of images to be acquired according to the lower duration limit;
    控制模块,用于根据各帧待采集图像的曝光时长和感光度,进行曝光控制。A control module is configured to perform exposure control according to the exposure duration and sensitivity of the images to be collected in each frame.
  12. 根据权利要求11所述的曝光控制装置,其特征在于,所述装置还包括:The exposure control device according to claim 11, wherein the device further comprises:
    第一确定模块,用于根据抖动程度,确定各帧待采集图像所述预设的感光度。The first determining module is configured to determine the preset sensitivity of the image to be collected for each frame according to the degree of jitter.
  13. 根据权利要求12所述的曝光控制装置,其特征在于,所述第一确定模块,用于:The exposure control device according to claim 12, wherein the first determining module is configured to:
    从成像设备设置的传感器,获取采集到的位移信息;Obtain the collected displacement information from the sensors set by the imaging equipment;
    根据所述位移信息,确定所述成像设备的抖动程度;Determining a degree of jitter of the imaging device according to the displacement information;
    若所述抖动程度大于或等于抖动阈值,确定所述预设的感光度取值为第一感光值;If the degree of shaking is greater than or equal to a shaking threshold, determining that the preset sensitivity value is a first sensitivity value;
    若所述抖动程度小于抖动阈值,确定所述预设的感光度取值为第二感光值;其中,所述第一感光值大于所述第二感光值。If the degree of dithering is less than the dithering threshold, it is determined that the preset sensitivity value is a second sensitivity value; wherein the first sensitivity value is greater than the second sensitivity value.
  14. 根据权利要求13所述的曝光控制装置,其特征在于,The exposure control device according to claim 13, wherein:
    所述第一感光值为所述第二感光值的预设倍数,所述预设倍数取值大于等于2;The first photosensitive value is a preset multiple of the second photosensitive value, and the preset multiple takes a value greater than or equal to 2;
    所述第二感光值为所述成像设备的最小感光度。The second sensitivity value is a minimum sensitivity of the imaging device.
  15. 根据权利要求11-14任一项所述的曝光控制装置,其特征在于,The exposure control device according to any one of claims 11 to 14, wherein:
    所述时长下限大于或等于10ms。The lower limit of the duration is greater than or equal to 10 ms.
  16. 根据权利要求11-15任一项所述的曝光控制装置,其特征在于,所述测光模块,用于:The exposure control device according to any one of claims 11-15, wherein the photometric module is configured to:
    根据预览图像的亮度信息,确定基准曝光量;所述基准曝光量包括基准曝光时长和基准感光度;Determining a reference exposure amount according to the brightness information of the preview image; the reference exposure amount includes a reference exposure duration and a reference sensitivity;
    根据所述基准曝光量和各帧待采集图像预设的曝光补偿值,确定各帧待采集图像的目标曝光量。The target exposure amount of the image to be acquired for each frame is determined according to the reference exposure amount and the preset exposure compensation value of the image to be acquired for each frame.
  17. 根据权利要求16所述的曝光控制装置,其特征在于,所述测光模块,还包括:The exposure control device according to claim 16, wherein the photometry module further comprises:
    获取单元,用于获取预览画面;An obtaining unit for obtaining a preview picture;
    第一确定单元,用于根据所述预览画面的画面内容,确定当前拍摄场景属于夜景场景;A first determining unit, configured to determine that a current shooting scene belongs to a night scene according to the picture content of the preview picture;
    识别单元,用于根据成像设备的抖动程度和/或所述预览画面是否包含人脸,识别当前拍摄场景适用的夜景模式;A recognition unit, configured to identify a night scene mode applicable to the current shooting scene according to the degree of jitter of the imaging device and / or whether the preview picture includes a human face;
    第二确定单元,用于根据所述夜景模式,确定各帧待采集图像预设的曝光补偿值。The second determining unit is configured to determine a preset exposure compensation value of the image to be acquired in each frame according to the night scene mode.
  18. 根据权利要求11-15任一项所述的曝光控制装置,其特征在于,所述曝光控制装置,还包括:The exposure control device according to any one of claims 11-15, wherein the exposure control device further comprises:
    第二确定模块,用于确定所述至少一帧待采集图像更新后的曝光时长与更新前的曝光时长之间的比值;A second determining module, configured to determine a ratio between an updated exposure time of the at least one frame of the image to be acquired and an updated exposure time before the update;
    第一更新模块,用于对曝光时长大于或等于所述时长下限的其余各帧待采集图像,根据所述比值,更新所述其余各帧待采集图像的感光度或曝光时长。A first updating module is configured to update the sensitivity or exposure duration of the remaining frames of images to be acquired according to the ratio for the remaining frames of images to be acquired whose exposure time is greater than or equal to the lower limit of the duration.
  19. 根据权利要求18所述的曝光控制装置,其特征在于,所述第一更新模块,用于:The exposure control device according to claim 18, wherein the first update module is configured to:
    将所述比值与所述其余各帧待采集图像更新前的感光度乘积,作为所述其余各帧待采集图像更新后的感光度;Multiplying the ratio by the sensitivity of the remaining frames to be acquired before the image is updated as the sensitivity of the remaining frames to be acquired after the image is updated;
    或者,将所述比值与所述其余各帧待采集图像更新前的曝光时长乘积,作为所述其余各帧待采集图像更新后的曝光时长。Alternatively, the product of the ratio and the exposure duration before the images to be acquired in the remaining frames are updated is used as the exposure duration after the images in the remaining frames are to be updated.
  20. 根据权利要求18或19所述的曝光控制装置,其特征在于,所述曝光控制装置,还包括:The exposure control device according to claim 18 or 19, wherein the exposure control device further comprises:
    第二更新模块,用于对曝光时长大于时长上限的待采集图像,根据对应的目标曝光量和所述时长上限,更新感光度;以及A second update module, configured to update the sensitivity of an image to be acquired whose exposure duration is greater than the duration upper limit according to the corresponding target exposure amount and the duration upper limit; and
    根据所述时长上限,更新所述曝光时长大于时长上限的待采集图像的曝光时长。Update the exposure duration of the image to be acquired whose exposure duration is greater than the duration upper limit according to the duration upper limit.
  21. 一个或多个包含计算机可执行指令的非易失性计算机可读存储介质,当所述计算机可执行指令被一个或多个处理器执行时,使得所述处理器执行如权利要求1-10中任一项所述的曝光控制方法。One or more non-transitory computer-readable storage media containing computer-executable instructions, when said computer-executable instructions are executed by one or more processors, causing said processors to execute the instructions in claims 1-10 The exposure control method according to any one.
  22. 一种电子设备,包括存储器及处理器,所述存储器中储存有计算机可读指令,所述指令被所述处理器执行时,使得所述处理器执行如权利要求1-10中任一项所述的曝光控制方法。An electronic device includes a memory and a processor. The memory stores computer-readable instructions. When the instructions are executed by the processor, the processor causes the processor to execute the instructions as claimed in any one of claims 1-10. The exposure control method described above.
PCT/CN2019/090627 2018-08-22 2019-06-11 Exposure control method and apparatus, and electronic device WO2020038074A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810963320.5 2018-08-22
CN201810963320.5A CN108900782B (en) 2018-08-22 2018-08-22 Exposure control method, exposure control device and electronic equipment

Publications (1)

Publication Number Publication Date
WO2020038074A1 true WO2020038074A1 (en) 2020-02-27

Family

ID=64358327

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/090627 WO2020038074A1 (en) 2018-08-22 2019-06-11 Exposure control method and apparatus, and electronic device

Country Status (2)

Country Link
CN (1) CN108900782B (en)
WO (1) WO2020038074A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108900782B (en) * 2018-08-22 2020-01-24 Oppo广东移动通信有限公司 Exposure control method, exposure control device and electronic equipment
CN109547703B (en) * 2018-12-28 2021-04-13 北京旷视科技有限公司 Shooting method and device of camera equipment, electronic equipment and medium
CN111435971B (en) * 2019-01-15 2022-04-08 阿里巴巴集团控股有限公司 Image acquisition parameter configuration method and device, terminal and readable storage medium
CN109756680B (en) * 2019-01-30 2021-05-14 Oppo广东移动通信有限公司 Image synthesis method and device, electronic equipment and readable storage medium
CN109788207B (en) * 2019-01-30 2021-03-23 Oppo广东移动通信有限公司 Image synthesis method and device, electronic equipment and readable storage medium
CN109756681A (en) * 2019-01-30 2019-05-14 Oppo广东移动通信有限公司 Image composition method, device, electronic equipment and readable storage medium storing program for executing
CN109919116B (en) * 2019-03-14 2022-05-17 Oppo广东移动通信有限公司 Scene recognition method and device, electronic equipment and storage medium
CN111757015B (en) * 2019-03-28 2021-12-03 杭州海康威视数字技术股份有限公司 Exposure control method and device and electronic equipment
CN110072052B (en) * 2019-04-09 2021-08-27 Oppo广东移动通信有限公司 Image processing method and device based on multi-frame image and electronic equipment
CN110142972B (en) * 2019-05-06 2021-08-06 上海天马微电子有限公司 3D printing method and 3D printing equipment
CN110166711B (en) * 2019-06-13 2021-07-13 Oppo广东移动通信有限公司 Image processing method, image processing apparatus, electronic device, and storage medium
CN110113539A (en) * 2019-06-13 2019-08-09 Oppo广东移动通信有限公司 Exposal control method, device, electronic equipment and storage medium
CN110166709B (en) * 2019-06-13 2022-03-18 Oppo广东移动通信有限公司 Night scene image processing method and device, electronic equipment and storage medium
CN111866390B (en) * 2020-07-29 2022-09-30 浙江立元科技有限公司 Image shooting control method and device, computer equipment and storage medium
CN115297269B (en) * 2022-09-27 2023-04-07 荣耀终端有限公司 Exposure parameter determination method and electronic equipment
CN116485660B (en) * 2022-11-22 2023-11-17 北京迁移科技有限公司 Image acquisition method and three-dimensional reconstruction method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101261422A (en) * 2007-03-08 2008-09-10 亚洲光学股份有限公司 Automatic exposure correction method and system
CN101729665A (en) * 2009-12-11 2010-06-09 惠州Tcl移动通信有限公司 Camera cellphone with tremble prevention function and tremble prevention method in photographing process thereof
CN103227896A (en) * 2012-01-26 2013-07-31 佳能株式会社 Electronic apparatus, electronic apparatus control method, and storage medium
CN103841324A (en) * 2014-02-20 2014-06-04 小米科技有限责任公司 Shooting processing method and device and terminal device
CN105450936A (en) * 2014-05-30 2016-03-30 杭州海康威视数字技术股份有限公司 Method and device for intelligently adjusting camera during automatic exposure
CN105635597A (en) * 2015-12-21 2016-06-01 湖北工业大学 Auto-exposure method and system for vehicle-mounted camera
CN108900782A (en) * 2018-08-22 2018-11-27 Oppo广东移动通信有限公司 Exposal control method, device and electronic equipment

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101359148B (en) * 2007-08-03 2011-04-06 深圳艾科创新微电子有限公司 Method for automatic exposure regulation and control system
US9204048B2 (en) * 2014-03-27 2015-12-01 Facebook, Inc. Stabilization of low-light video
CN105306830B (en) * 2015-12-08 2018-05-29 广东欧珀移动通信有限公司 A kind of camera control method and device
CN106657805A (en) * 2017-01-13 2017-05-10 广东欧珀移动通信有限公司 Shooting method in movement and mobile terminal
CN107071292A (en) * 2017-03-10 2017-08-18 深圳市金立通信设备有限公司 A kind of light compensation method and terminal
CN108419022A (en) * 2018-03-06 2018-08-17 广东欧珀移动通信有限公司 Control method, control device, computer readable storage medium and computer equipment
CN108419025B (en) * 2018-05-30 2020-01-07 北京图森未来科技有限公司 Exposure parameter adjusting method and device and readable medium
CN108419026B (en) * 2018-05-31 2020-05-15 歌尔股份有限公司 Camera exposure time adjusting method, device and equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101261422A (en) * 2007-03-08 2008-09-10 亚洲光学股份有限公司 Automatic exposure correction method and system
CN101729665A (en) * 2009-12-11 2010-06-09 惠州Tcl移动通信有限公司 Camera cellphone with tremble prevention function and tremble prevention method in photographing process thereof
CN103227896A (en) * 2012-01-26 2013-07-31 佳能株式会社 Electronic apparatus, electronic apparatus control method, and storage medium
CN103841324A (en) * 2014-02-20 2014-06-04 小米科技有限责任公司 Shooting processing method and device and terminal device
CN105450936A (en) * 2014-05-30 2016-03-30 杭州海康威视数字技术股份有限公司 Method and device for intelligently adjusting camera during automatic exposure
CN105635597A (en) * 2015-12-21 2016-06-01 湖北工业大学 Auto-exposure method and system for vehicle-mounted camera
CN108900782A (en) * 2018-08-22 2018-11-27 Oppo广东移动通信有限公司 Exposal control method, device and electronic equipment

Also Published As

Publication number Publication date
CN108900782A (en) 2018-11-27
CN108900782B (en) 2020-01-24

Similar Documents

Publication Publication Date Title
WO2020038074A1 (en) Exposure control method and apparatus, and electronic device
JP7371081B2 (en) Night view photography methods, devices, electronic devices and storage media
CN110072051B (en) Image processing method and device based on multi-frame images
US11532076B2 (en) Image processing method, electronic device and storage medium
WO2020034737A1 (en) Imaging control method, apparatus, electronic device, and computer-readable storage medium
WO2020038087A1 (en) Method and apparatus for photographic control in super night scene mode and electronic device
CN109788207B (en) Image synthesis method and device, electronic equipment and readable storage medium
WO2020207262A1 (en) Image processing method and apparatus based on multiple frames of images, and electronic device
WO2020038072A1 (en) Exposure control method and device, and electronic device
CN110191291B (en) Image processing method and device based on multi-frame images
CN109151333B (en) Exposure control method, exposure control device and electronic equipment
CN109348088B (en) Image noise reduction method and device, electronic equipment and computer readable storage medium
CN110166708B (en) Night scene image processing method and device, electronic equipment and storage medium
CN109005369B (en) Exposure control method, exposure control device, electronic apparatus, and computer-readable storage medium
CN109218627B (en) Image processing method, image processing device, electronic equipment and storage medium
WO2020057199A1 (en) Imaging method and device, and electronic device
WO2020207261A1 (en) Image processing method and apparatus based on multiple frames of images, and electronic device
CN109756680B (en) Image synthesis method and device, electronic equipment and readable storage medium
WO2019029573A1 (en) Image blurring method, computer-readable storage medium and computer device
WO2020034739A1 (en) Control method and apparatus, electronic device, and computer readable storage medium
CN110264420B (en) Image processing method and device based on multi-frame images
CN110276730B (en) Image processing method and device and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19851966

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19851966

Country of ref document: EP

Kind code of ref document: A1