CN115134511A - A high dynamic range image photographing method, device and storage medium - Google Patents

Abstract

The present disclosure relates to a high dynamic range image photographing method, device and storage medium. The image processing method includes: in response to the image acquisition device starting the staggered exposure sensor to take a high dynamic range image, and controlling the staggered exposure sensor to expose a first exposure image, a second exposure image and a third exposure image; If an image photographing instruction is received, output a first exposure image, a second exposure image and a third exposure image for synthesizing high dynamic range photographed images; based on the first exposure image, the second exposure image and the For the third exposure image, a high dynamic range photographed image is synthesized to obtain a high dynamic range photographed image. Through the present disclosure, a high-dynamic-range photographed image with high definition can be obtained.

Description

A high dynamic range image photographing method, device and storage medium

technical field

The present disclosure relates to the technical field of photographing high dynamic range images, and in particular, to a method, device and storage medium for photographing high dynamic range images.

Background technique

With the development of science and technology, image acquisition, as a way of information exchange and transmission, has been used by people in all aspects of daily life.

In the related art, a short exposure image and a medium exposure image can be obtained through exposure by a stagger exposure sensor, and the obtained short exposure image and the medium exposure image can be synthesized to obtain a high dynamic range shot image required by the user. However, in the related art, the high dynamic range photographed image obtained by synthesis is low in definition and has many ghost images.

SUMMARY OF THE INVENTION

In order to overcome the problems existing in the related art, the purpose of the present disclosure is to provide a high dynamic range image photographing method, device and storage medium, which can synthesize high dynamic range photographed images to obtain high definition high dynamic range photographed images.

In order to achieve the above object, the technical scheme adopted in the present disclosure is as follows:

According to a first aspect of the embodiments of the present disclosure, there is provided a high dynamic range image photographing method, which is applied to an image acquisition device, the image acquisition device includes an interlaced exposure sensor, and the high dynamic range image photographing method includes:

In response to the image acquisition device starting the staggered exposure sensor to take a high dynamic range image photograph, controlling the staggered exposure sensor to expose a first exposure image, a second exposure image and a third exposure image; if an image is received to take a photograph instruction, then output the first exposure image, the second exposure image and the third exposure image used for synthesizing the high dynamic range photographed image; based on the first exposure image, the second exposure image and the third exposure image, A high dynamic range photographed image is synthesized to obtain a high dynamic range photographed image.

In one embodiment, the outputting the first exposure image, the second exposure image and the third exposure image used for high dynamic range photographic image synthesis includes: outputting a first exposure image with a first exposure duration, a second exposure image with a second exposure time A second exposure image with an exposure duration and a third exposure image with a third exposure duration; wherein the first exposure duration is within the range of the first exposure duration, and the second exposure duration is within the range of the second exposure duration, so The third exposure duration is within the third exposure duration range; the maximum exposure duration within the first exposure duration range is less than the minimum exposure duration within the second exposure duration range, and the maximum exposure duration within the second exposure duration range is is less than the minimum exposure duration within the third exposure duration range.

In one embodiment, the high dynamic range image photographing method further includes: in the image preview stage, based on the first exposure image and the second exposure image, synthesizing the high dynamic range preview image to obtain the high dynamic range preview image; The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within the range of the first exposure duration, and the second exposure duration is within the range of the second exposure duration The maximum exposure duration in the first exposure duration range is less than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the third exposure duration range. The minimum exposure duration.

In one embodiment, in the image preview stage, based on the first exposure image and the second exposure image, synthesizing a high dynamic range preview image is performed to obtain a high dynamic range preview image, which includes: if an image preview instruction is received, outputting an image with the first exposure image. A first exposure image with an exposure duration, a second exposure image with a second exposure duration, and a third exposure image with a fourth exposure duration; wherein the first exposure duration, the second exposure duration, and the first exposure duration The sum of the exposure durations among the four exposure durations is less than the preview exposure duration threshold, the fourth exposure duration is less than the preset exposure duration, and the preset exposure duration is less than the third exposure duration, and the third exposure duration is in the first exposure duration. Within the scope of three exposure durations; discarding the third exposure image, and synthesizing a high dynamic range preview image based on the first exposure image and the second exposure image to obtain a high dynamic range preview image.

In one embodiment, in the image preview stage, based on the first exposure image and the second exposure image, synthesizing a high dynamic range preview image is performed to obtain a high dynamic range preview image, which includes: if an image preview instruction is received, outputting an image with the first exposure image. A first exposure image with an exposure duration and a second exposure image with a second exposure duration; based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image.

According to a second aspect of the embodiments of the present disclosure, there is provided a high dynamic range image photographing device, which is applied to an image acquisition device, the image acquisition device includes an interlaced exposure sensor, and the high dynamic range image photographing device includes:

a control unit, in response to the image acquisition device starting the staggered exposure sensor to take a high dynamic range image, and controlling the staggered exposure sensor to expose a first exposure image, a second exposure image and a third exposure image; an output unit , in the case of receiving the image photographing instruction, output the first exposure image, the second exposure image and the third exposure image used for high dynamic range photographing image synthesis; the synthesis unit, based on the first exposure image, the first exposure image The second exposure image and the third exposure image are combined with a high dynamic range photographed image to obtain a high dynamic range photographed image.

In one embodiment, the output unit outputs the first exposure image, the second exposure image, and the third exposure image for synthesizing the high dynamic range photographic image in the following manner: outputting the first exposure image with the first exposure duration, A second exposure image with a second exposure duration and a third exposure image with a third exposure duration; wherein the first exposure duration is within the first exposure duration range, and the second exposure duration is within the second exposure duration range , the third exposure duration is within the third exposure duration range; the maximum exposure duration of the first exposure duration range is less than the minimum exposure duration within the second exposure duration range, and the second exposure duration range The maximum exposure duration is less than the minimum exposure duration within the third exposure duration range.

In one embodiment, the synthesizing unit is further configured to: in the image preview stage, based on the first exposure image and the second exposure image, perform high dynamic range preview image synthesis to obtain a high dynamic range preview image; the first exposure image The image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within the range of the first exposure duration, and the second exposure duration is within the range of the second exposure duration; The maximum exposure duration in an exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range.

In one embodiment, in the image preview stage, the synthesis unit performs high dynamic range preview image synthesis based on the first exposure image and the second exposure image in the following manner to obtain a high dynamic range preview image: if an image preview instruction is received: , output a first exposure image with a first exposure duration, a second exposure image with a second exposure duration, and a third exposure image with a fourth exposure duration; wherein the first exposure duration, the second exposure duration The sum of the exposure duration between the duration and the fourth exposure duration is less than the preview exposure duration threshold, the fourth exposure duration is less than the preset exposure duration, and the preset exposure duration is less than the third exposure duration, the third exposure duration The duration is within the third exposure duration range; the third exposure image is discarded, and based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image.

In one embodiment, in the image preview stage, the synthesis unit performs high dynamic range preview image synthesis based on the first exposure image and the second exposure image in the following manner to obtain a high dynamic range preview image: if an image preview instruction is received: , output a first exposure image with a first exposure duration and a second exposure image with a second exposure duration; based on the first exposure image and the second exposure image, perform high dynamic range preview image synthesis to obtain a high dynamic range Dynamic range preview image.

According to a third aspect of the embodiments of the present disclosure, there is provided a high dynamic range image photographing device, including:

processor; memory for storing processor-executable instructions;

Wherein, the processor is configured to: execute the high dynamic range image photographing method described in the first aspect or any implementation manner of the first aspect.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a storage medium, where instructions are stored in the storage medium, and when the instructions in the storage medium are executed by a processor of an image capturing device, the image capturing device can execute the first Aspect or the high dynamic range image photographing method described in any one of the implementation manners of the first aspect.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects: in response to the image acquisition device starting the staggered exposure sensor to take high dynamic range images, controlling the staggered exposure sensor to expose three frames of exposure images. If an image photographing instruction is received, three frames of exposure images for composing high dynamic range photographed images are output. The three frames of exposure images are combined with high dynamic range photographed images to obtain high dynamic range photographed images. By using three frames of image parameters output by the staggered exposure sensor at the same time to synthesize the high dynamic range photographed image, the obtained high dynamic range photographed image can have higher definition.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.

Fig. 1 is a flow chart of a method for photographing a high dynamic range image according to an exemplary embodiment.

Fig. 2 is a flow chart of another method for photographing a high dynamic range image according to an exemplary embodiment.

Fig. 3 is a flowchart of a method for acquiring a high dynamic range preview image according to an exemplary embodiment.

Fig. 4 is a flowchart of another method for acquiring a high dynamic range preview image according to an exemplary embodiment.

FIG. 5 is a schematic flowchart of acquiring a high dynamic range preview image according to an exemplary embodiment.

Fig. 6 is another schematic flowchart of acquiring a high dynamic range preview image according to an exemplary embodiment.

Fig. 7 is a block diagram of a high dynamic range image photographing apparatus according to an exemplary embodiment.

Fig. 8 is a block diagram of an apparatus for photographing a high dynamic range image according to an exemplary embodiment.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as recited in the appended claims.

The high dynamic range image photographing method provided by the embodiments of the present disclosure may be applied to a scene where an image acquisition device equipped with a stagger exposure sensor (stagger exposure sensor) performs high dynamic range (High Dynamic Range, HDR) image photographing. Wherein, the image acquisition device with the staggered exposure sensor can control the staggered exposure sensor to expose to obtain images with different exposure durations during the process of taking a high dynamic range image.

In the related art, in a high dynamic range image photographing method, two frames of images (a short exposure image and a medium exposure image) can be obtained by controlling the exposure of the interlaced exposure sensor when the high dynamic range image is photographed. The obtained two frames of images are combined with high dynamic range photographed images to obtain high dynamic range photographed images. The high dynamic range photographed image is synthesized by this method, and the obtained high dynamic range photographed image has low definition. In another high dynamic range image photographing method provided by the related art, when photographing a high dynamic range image, two frames of images (a short exposure image and a medium exposure image) can be obtained by controlling the exposure of the interlaced exposure sensor. The obtained two frames of images and the long-exposure image obtained by subsequent exposure are combined with a high dynamic range photographed image to obtain a high dynamic range photographed image. Since the long-exposure image used in the process of synthesizing the high-dynamic-range photographed image is obtained by subsequent exposure, the obtained high-dynamic-range photographed image will produce more ghost images.

In view of this, an embodiment of the present disclosure provides a method for photographing a high dynamic range image, which can control the exposure of an interlaced exposure sensor to obtain three frames of images (a short exposure image, a medium exposure image and a long exposure image) when taking a high dynamic range image. image). The three frames of images output at the same time are combined with high dynamic range photographed images to obtain high dynamic range photographed images. Through the present disclosure, the sharpness of the high dynamic range photographed image can be improved.

FIG. 1 is a flow chart of a method for photographing a high dynamic range image according to an exemplary embodiment. As shown in FIG. 1 , the method for photographing a high dynamic range image is used in an image acquisition device equipped with an interlaced exposure sensor, including: following steps.

In step S11, in response to the image acquisition device starting the staggered exposure sensor to take a high dynamic range image, the staggered exposure sensor is controlled to expose a first exposure image, a second exposure image and a third exposure image.

In the embodiment of the present disclosure, the first exposure image, the second exposure image, and the third exposure image may be understood as exposure images having different exposure durations.

In step S12, when an image photographing instruction is received, output a first exposure image, a second exposure image and a third exposure image for synthesizing the high dynamic range photographed image.

In step S13, based on the first exposure image, the second exposure image and the third exposure image, a high dynamic range photographed image is synthesized to obtain a high dynamic range photographed image.

In the embodiment of the present disclosure, the first exposure image, the second exposure image, and the third exposure image used for synthesizing the high dynamic range photographic image are output simultaneously. The first exposure image, the second exposure image and the third exposure image are combined with a high dynamic range photographed image, so that a high dynamic range photographed image with higher definition can be obtained, and ghosting of the high dynamic range photographed image can be reduced.

In an example, the first exposure image, the second exposure image and the third exposure image obtained by controlling the exposure of the staggered exposure sensor may be exposure images with different exposure durations.

In the embodiments of the present disclosure, for convenience of description, the short exposure duration is referred to as the first exposure duration, the medium exposure duration is referred to as the second exposure duration, and the long exposure duration is referred to as the third exposure duration.

FIG. 2 is a flowchart of a method for photographing a high dynamic range image according to an exemplary embodiment. As shown in FIG. 2 , the implementation of step S21 and step S23 in the method for photographing a high dynamic range image provided by an embodiment of the present disclosure The process is similar to the execution method of step S11 and step S13 shown in FIG. 1 , and details are not repeated here.

In step S22, in the case of receiving an image photographing instruction, output a first exposure image with a first exposure duration, a second exposure image with a second exposure duration, and a third exposure image with a third exposure duration.

The first exposure duration is within the first exposure duration range, the second exposure duration is within the second exposure duration range, and the third exposure duration is within the third exposure duration range. The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range.

In the high dynamic range image photographing method provided by the embodiment of the present disclosure, the exposure images obtained by the exposure of the staggered exposure sensors may be exposure images with different exposure durations. Combining exposure images with different exposure durations to high dynamic range photographed images can further improve the clarity of the high dynamic range photographed images.

In the embodiment of the present disclosure, in the image preview stage, the first exposure image and the second exposure image may be combined with a high dynamic range preview image to obtain a high dynamic range preview image.

The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within the range of the first exposure duration, and the second exposure duration is within the range of the second exposure duration. The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range.

In the embodiment of the present disclosure, in the case of outputting the first exposure image, the second exposure image, and the third exposure image, the first exposure image and the second exposure image can be selected to perform high dynamic range preview image synthesis, and there is no need to select the third exposure image. Expose the image, thereby reducing power consumption for high dynamic range preview image composition.

Fig. 3 is a flowchart of a method for acquiring a high dynamic range preview image according to an exemplary embodiment, as shown in Fig. 3 , including the following steps.

In step S31, when an image preview instruction is received, a first exposure image with a first exposure duration, a second exposure image with a second exposure duration, and a third exposure image with a fourth exposure duration are output.

The sum of the exposure durations among the first exposure duration, the second exposure duration, and the fourth exposure duration is less than the preview exposure duration threshold, the fourth exposure duration is less than the preset exposure duration, and the preset exposure duration is less than the third exposure duration, and the third exposure duration is less than the third exposure duration. The triple exposure duration is within the range of the third exposure duration.

In step S32, the third exposure image is discarded, and based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image.

In the embodiment of the present disclosure, by reducing the exposure duration of the third exposure image, the preview frame rate of the high dynamic range preview image can be guaranteed.

In an example, since the third exposure image is acquired with the fourth exposure duration, more ghost images will be generated in the third exposure image. Therefore, the third exposure image can be discarded in the process of synthesizing the high dynamic range preview image, so as to ensure the clarity of the high dynamic range preview image. In addition, only using the first exposure image and the second exposure image to perform high dynamic range preview image composition can reduce the power consumption of the image acquisition device and improve the efficiency of high dynamic range preview image composition.

In another example, when an image preview instruction is received, a first exposure image and a second exposure image may be output, and a high dynamic range preview image may be obtained by combining the first exposure image and the second exposure image.

Fig. 4 is a flowchart of a method for acquiring a high dynamic range preview image according to an exemplary embodiment. As shown in Fig. 4 , the method includes the following steps.

In step S41, when an image preview instruction is received, a first exposure image with a first exposure duration and a second exposure image with a second exposure duration are output.

In step S42, based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image.

In the embodiment of the present disclosure, when an image preview instruction is received, the first exposure image and the second exposure image can be output without outputting the third exposure image, thereby reducing the power consumption of outputting the exposure image.

The high dynamic range image photographing method provided by the embodiment of the present disclosure can ensure the preview frame rate of the high dynamic range preview image, and the synthesized high dynamic range preview image has higher definition.

FIG. 5 is a schematic flowchart of acquiring a high dynamic range preview image according to an exemplary embodiment. As shown in FIG. 5 , in the image preview stage, the staggered exposure sensor outputs a short exposure frame image (first exposure duration), a medium exposure frame image (second exposure duration) and a long exposure frame image (fourth exposure duration). In order to ensure that the preview picture is continuous and not stuck, it is usually necessary to ensure that the frame rate of the preview picture is not less than the frame rate threshold (for example, 30FPS). Therefore, it is necessary to ensure that the total exposure duration between the long-exposure frame image, the medium-exposure frame image, and the short-exposure frame image is less than the preview exposure duration threshold (eg, 33 ms). For example, the exposure duration (the fourth exposure duration) of the long-exposure frame image may be set to be smaller than the preset exposure duration. The method can make the exposure duration of the long exposure frame image small enough, so that the sum of the exposure duration between the short exposure frame image, the medium exposure frame image and the long exposure frame image can be smaller than the preview exposure duration threshold. In order to ensure the synthesis effect of the high dynamic range preview image, the long exposure frame image obtained by the long exposure in the fourth exposure time can be discarded, and the short exposure frame image obtained by the exposure and the medium exposure image are used to synthesize the high dynamic range preview image. The desired high dynamic range preview image. In addition, when taking pictures using an image capture device with an interleaved exposure sensor, the frame rate does not need to be guaranteed due to the high dynamic range of taking pictures. Therefore, the sum of the exposure durations among the short-exposure frame images, the middle-exposure frame images, and the long-exposure frame images may exceed the preview exposure duration threshold. For example, in the case of receiving an image photographing instruction, the exposure duration of the long-exposure frame image can be restored to the normal exposure duration (third exposure duration), and the short-exposure frame image (first exposure duration) is output through the staggered exposure sensor. , medium exposure frame images (second exposure duration), and long exposure frame images (third exposure duration). The short-exposure frame image, the medium-exposure frame image, and the long-exposure frame image are combined with the high-dynamic-range photographic image to obtain the required high-dynamic-range photographic image.

FIG. 6 is a schematic flowchart of acquiring a high dynamic range preview image according to an exemplary embodiment. As shown in FIG. 6 , in the image preview stage, the staggered exposure sensor outputs a short exposure frame image (first exposure duration) and a medium exposure frame image (second exposure duration). By synthesizing the exposure frame images in the output short exposure frame images, the required high dynamic range preview image can be obtained. In addition, when taking pictures using an image capturing device having a staggered book exposure sensor, the staggered exposure sensor outputs a short-exposure frame image (first exposure duration), a medium-exposure frame image (second exposure duration), and a long-exposure frame image (third exposure duration). exposure time). A high dynamic range photographed image can be obtained by synthesizing the output short exposure frame image, medium exposure frame image and long exposure frame image with a high dynamic range photographed image.

In the high dynamic range image photographing method provided by the embodiment of the present disclosure, when photographing a high dynamic range image, the interlaced exposure sensor can be controlled to expose a short exposure frame image, a medium exposure frame image and a long exposure frame image. When the long exposure frame is not required to participate in the high dynamic range image composition (high dynamic range preview image composition), only the short exposure frame image and the medium exposure frame image are output, and the long exposure frame image is not output. When the long exposure frame is required to participate in the high dynamic range image synthesis (high dynamic range photographic image synthesis), the short exposure frame image, the medium exposure frame image and the long exposure frame image are output. The method can ensure that the preview interface does not pause when switching from outputting two frames of images to outputting three frames of images, and realizes dynamic and smooth switching from two frames to three frames.

In an example, as shown in FIG. 5 and FIG. 6 , in the case where a short-exposure frame image, a medium-exposure frame image, and a long-exposure frame exposure image are obtained by exposing the staggered exposure sensor, the short-exposure frame image and the medium-exposure frame image can be obtained respectively. The reference frame image is determined from the image and the long exposure frame exposure image. In one embodiment, a reference frame image with the same exposure duration and an adjacent frame image may be combined to obtain a reference frame with higher definition. Further, reference frame images corresponding to the obtained short exposure frame images, medium exposure frame images and long exposure frame exposure images can be output, and high dynamic range images are synthesized by using the output reference frame images to obtain high dynamic range images.

In the embodiment of the present disclosure, in the image preview stage, the short-exposure frame image and the medium-exposure frame image obtained by the interlaced sensor exposure may be used to synthesize the high-dynamic-range preview image to obtain the high-dynamic-range preview image. In the case of receiving the photographing instruction, the short exposure frame image, the medium exposure frame image and the long exposure frame image obtained by the interlaced sensor exposure can be used to synthesize the high dynamic range photographed image to obtain the high dynamic range photographed image. By means of the present disclosure, the sharpness of the high dynamic range photographed image can be improved, and the process of switching from the image preview stage to the photographing can be smooth and continuous without being stuck.

Based on the same concept, an embodiment of the present disclosure also provides a high dynamic range image photographing device.

It can be understood that, in order to realize the above-mentioned functions, the high dynamic range image photographing apparatus provided by the embodiments of the present disclosure includes corresponding hardware structures and/or software modules for executing each function. Combining with the units and algorithm steps of each example disclosed in the embodiments of the present disclosure, the embodiments of the present disclosure can be implemented in hardware or a combination of hardware and computer software. Whether a function is performed by hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the technical solutions of the embodiments of the present disclosure.

Fig. 7 is a block diagram of a high dynamic range image photographing apparatus according to an exemplary embodiment. Referring to FIG. 7 , the apparatus 100 includes a control unit 101 , an output unit 102 and a synthesis unit 103 .

The control unit 101 controls the staggered exposure sensor to expose the first exposure image, the second exposure image and the third exposure image in response to the image acquisition device starting the staggered exposure sensor to take a high dynamic range image. The output unit 102 outputs the first exposure image, the second exposure image, and the third exposure image for synthesizing the high dynamic range photographed image in the case of receiving the image photographing instruction. The synthesizing unit 103, based on the first exposure image, the second exposure image and the third exposure image, performs high dynamic range photographed image synthesis to obtain a high dynamic range photographed image.

In one embodiment, the output unit 102 outputs the first exposure image, the second exposure image, and the third exposure image used for high dynamic range photographic image synthesis in the following manner: outputting a first exposure image with a first exposure duration, A second exposure image with a second exposure duration and a third exposure image with a third exposure duration. The first exposure duration is within the first exposure duration range, the second exposure duration is within the second exposure duration range, and the third exposure duration is within the third exposure duration range. The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range.

In one embodiment, the synthesizing unit 103 is further configured to: in the image preview stage, based on the first exposure image and the second exposure image, perform high dynamic range preview image synthesis to obtain a high dynamic range preview image. The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within the range of the first exposure duration, and the second exposure duration is within the range of the second exposure duration. The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range.

In one embodiment, in the image preview stage, the synthesis unit 103 performs high dynamic range preview image synthesis based on the first exposure image and the second exposure image in the following manner to obtain a high dynamic range preview image: if an image preview instruction is received, Then, a first exposure image with a first exposure duration, a second exposure image with a second exposure duration, and a third exposure image with a fourth exposure duration are output. The sum of the exposure durations among the first exposure duration, the second exposure duration, and the fourth exposure duration is less than the preview exposure duration threshold, the fourth exposure duration is less than the preset exposure duration, and the preset exposure duration is less than the third exposure duration, and the third exposure duration is less than the third exposure duration. The triple exposure duration is within the range of the third exposure duration. The third exposure image is discarded, and based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image.

In one embodiment, in the image preview stage, the synthesis unit 103 performs high dynamic range preview image synthesis based on the first exposure image and the second exposure image in the following manner to obtain a high dynamic range preview image: if an image preview instruction is received, Then, a first exposure image with a first exposure duration and a second exposure image with a second exposure duration are output. Based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image.

Regarding the apparatus in the above-mentioned embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be described in detail here.

FIG. 8 is a block diagram of an apparatus 200 for photographing a high dynamic range image according to an exemplary embodiment. For example, apparatus 200 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, and the like.

8, apparatus 200 may include one or more of the following components: processing component 202, memory 204, power component 206, multimedia component 208, audio component 210, input/output (I/O) interface 212, sensor component 214, and Communication component 216 .

The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or some of the steps of the methods described above. Additionally, processing component 202 may include one or more modules that facilitate interaction between processing component 202 and other components. For example, processing component 202 may include a multimedia module to facilitate interaction between multimedia component 208 and processing component 202.

Memory 204 is configured to store various types of data to support operation at device 200 . Examples of such data include instructions for any application or method operating on the device 200, contact data, phonebook data, messages, pictures, videos, and the like. Memory 204 may be implemented by any type of volatile or non-volatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.

Power components 206 provide power to various components of device 200 . Power components 206 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to device 200 .

The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action. In some embodiments, the multimedia component 208 includes a front-facing camera and/or a rear-facing camera. When the apparatus 200 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.

Audio component 210 is configured to output and/or input audio signals. For example, audio component 210 includes a microphone (MIC) that is configured to receive external audio signals when device 200 is in operating modes, such as call mode, recording mode, and voice recognition mode. The received audio signal may be further stored in memory 204 or transmitted via communication component 216 . In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

The I/O interface 212 provides an interface between the processing component 202 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.

Sensor assembly 214 includes one or more sensors for providing status assessments of various aspects of device 200 . For example, the sensor assembly 214 can detect the open/closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, and the sensor assembly 214 can also detect a change in the position of the device 200 or a component of the device 200 , the presence or absence of user contact with the device 200 , the orientation or acceleration/deceleration of the device 200 and the temperature change of the device 200 . Sensor assembly 214 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. Sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 216 is configured to facilitate wired or wireless communication between apparatus 200 and other devices. Device 200 may access wireless networks based on communication standards, such as WiFi, 2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 216 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, apparatus 200 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.

In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as a memory 204 including instructions, executable by the processor 220 of the apparatus 200 to perform the method described above. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

It should be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, A and B exist at the same time, and B exists alone. The character "/" generally indicates that the associated objects are an "or" relationship. The singular forms "a," "the," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise.

It is further understood that the terms "first", "second", etc. are used to describe various information, but the information should not be limited to these terms. These terms are only used to distinguish the same type of information from one another, and do not imply a particular order or level of importance. In fact, the expressions "first", "second" etc. are used completely interchangeably. For example, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information, without departing from the scope of the present disclosure.

It should be further understood that, unless otherwise specified, "connection" includes a direct connection between the two without other components, and also includes an indirect connection between the two with other elements.

It is further to be understood that, although the operations in the embodiments of the present disclosure are described in a specific order in the drawings, it should not be construed as requiring that the operations be performed in the specific order shown or the serial order, or requiring Perform all operations shown to obtain the desired result. In certain circumstances, multitasking and parallel processing may be advantageous.

Other embodiments of the present disclosure will readily suggest themselves to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or techniques in the technical field not disclosed by the present disclosure . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (12)

1. A high dynamic range image photographing method, characterized in that, applied to an image acquisition device, the image acquisition device comprising an interleaved exposure sensor, and the high dynamic range image photographing method comprising: In response to the image acquisition device activating the staggered exposure sensor to take a high dynamic range image, controlling the staggered exposure sensor to expose a first exposure image, a second exposure image and a third exposure image; If an image photographing instruction is received, outputting the first exposure image, the second exposure image and the third exposure image for synthesizing the high dynamic range photographed image; Based on the first exposure image, the second exposure image and the third exposure image, a high dynamic range photographed image is synthesized to obtain a high dynamic range photographed image. 2. The high dynamic range image photographing method according to claim 1, wherein the outputting the first exposure image, the second exposure image and the third exposure image for synthesizing the high dynamic range photographed image comprises: outputting a first exposure image having a first exposure duration, a second exposure image having a second exposure duration, and a third exposure image having a third exposure duration; Wherein, the first exposure duration is within the first exposure duration range, the second exposure duration is within the second exposure duration range, and the third exposure duration is within the third exposure duration range; The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range . 3. The high dynamic range image photographing method according to claim 1 or 2, wherein the high dynamic range image photographing method further comprises: In the image preview stage, based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image; The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within a first exposure duration range, and the second exposure duration is within a second exposure duration range Inside; The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range. 4 . The high dynamic range image photographing method according to claim 3 , wherein, in the image preview stage, based on the first exposure image and the second exposure image, the high dynamic range preview image is synthesized to obtain the high dynamic range preview image. 5 . ,include: If an image preview instruction is received, outputting a first exposure image with a first exposure duration, a second exposure image with a second exposure duration, and a third exposure image with a fourth exposure duration; Wherein, the sum of the exposure durations among the first exposure duration, the second exposure duration and the fourth exposure duration is less than a preview exposure duration threshold, the fourth exposure duration is less than a preset exposure duration, and the pre-exposure duration It is assumed that the exposure duration is less than the third exposure duration, and the third exposure duration is within the range of the third exposure duration; The third exposure image is discarded, and based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image. 5 . The high dynamic range image photographing method according to claim 3 , wherein, in the image preview stage, based on the first exposure image and the second exposure image, the high dynamic range preview image is synthesized to obtain the high dynamic range preview image. 6 . ,include: If an image preview instruction is received, outputting a first exposure image with a first exposure duration and a second exposure image with a second exposure duration; Based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image. 6. A high dynamic range image photographing device, characterized in that it is applied to an image acquisition device, the image acquisition device comprising an interleaved exposure sensor, and the high dynamic range image photographing device comprising: a control unit, in response to the image acquisition device starting the staggered exposure sensor to take a high dynamic range image photograph, and controlling the staggered exposure sensor to expose a first exposure image, a second exposure image and a third exposure image; The output unit, in the case of receiving the image photographing instruction, outputs the first exposure image, the second exposure image and the third exposure image for synthesizing the high dynamic range photographed image; The synthesizing unit, based on the first exposure image, the second exposure image and the third exposure image, performs high dynamic range photographed image synthesis to obtain a high dynamic range photographed image. 7 . The high dynamic range image photographing device according to claim 6 , wherein the output unit outputs the first exposure image, the second exposure image and the third exposure image for synthesizing the high dynamic range photographed image in the following manner. 8 . image: outputting a first exposure image having a first exposure duration, a second exposure image having a second exposure duration, and a third exposure image having a third exposure duration; Wherein, the first exposure duration is within the first exposure duration range, the second exposure duration is within the second exposure duration range, and the third exposure duration is within the third exposure duration range; The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range . 8. The high dynamic range image photographing device according to claim 6 or 7, wherein the synthesizing unit is further used for: In the image preview stage, based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image; The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within a first exposure duration range, and the second exposure duration is within a second exposure duration range Inside; The maximum exposure duration in the first exposure duration range is smaller than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is smaller than the minimum exposure duration in the third exposure duration range. 9 . The high dynamic range image photographing device according to claim 8 , wherein, in the image preview stage, the synthesis unit adopts the following method to synthesize the high dynamic range preview image based on the first exposure image and the second exposure image. 10 . , to get a high dynamic range preview image: If an image preview instruction is received, outputting a first exposure image with a first exposure duration, a second exposure image with a second exposure duration, and a third exposure image with a fourth exposure duration; Wherein, the sum of the exposure durations among the first exposure duration, the second exposure duration and the fourth exposure duration is less than a preview exposure duration threshold, the fourth exposure duration is less than a preset exposure duration, and the pre-exposure duration It is assumed that the exposure duration is less than the third exposure duration, and the third exposure duration is within the range of the third exposure duration; The third exposure image is discarded, and based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image. 10 . The high dynamic range image photographing device according to claim 8 , wherein, in the image preview stage, the synthesis unit adopts the following method to synthesize the high dynamic range preview image based on the first exposure image and the second exposure image. 11 . , to get a high dynamic range preview image: If an image preview instruction is received, outputting a first exposure image with a first exposure duration and a second exposure image with a second exposure duration; Based on the first exposure image and the second exposure image, a high dynamic range preview image is synthesized to obtain a high dynamic range preview image. 11. A high dynamic range image photographing device, comprising: processor; memory for storing processor-executable instructions; Wherein, the processor is configured to: execute the high dynamic range image photographing method according to any one of claims 1 to 5. 12. A storage medium, characterized in that the storage medium stores instructions, and when the instructions in the storage medium are executed by a processor of an image capture device, the image capture device can execute the steps in claims 1 to 5. Any one of the high dynamic range image photographing methods.

Images