CN115134511A - High dynamic range image photographing method and device and storage medium - Google Patents
High dynamic range image photographing method and device and storage medium Download PDFInfo
- Publication number
- CN115134511A CN115134511A CN202110335518.0A CN202110335518A CN115134511A CN 115134511 A CN115134511 A CN 115134511A CN 202110335518 A CN202110335518 A CN 202110335518A CN 115134511 A CN115134511 A CN 115134511A
- Authority
- CN
- China
- Prior art keywords
- exposure
- image
- high dynamic
- dynamic range
- duration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 50
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 50
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 22
- 230000004044 response Effects 0.000 claims abstract description 8
- 238000003672 processing method Methods 0.000 abstract 1
- 238000004891 communication Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Studio Devices (AREA)
Abstract
The disclosure relates to a high dynamic range image photographing method, device and storage medium. The image processing method includes: starting the staggered exposure sensor to take a high dynamic range image in response to the image acquisition equipment, and controlling the staggered exposure sensor to expose to obtain a first exposure image, a second exposure image and a third exposure image; if an image photographing instruction is received, outputting a first exposure image, a second exposure image and a third exposure image for high dynamic range photographing image synthesis; and synthesizing the high dynamic range photographed image based on the first exposure image, the second exposure image and the third exposure image to obtain the high dynamic range photographed image. The high dynamic range photographing image with high definition can be obtained through the method and the device.
Description
Technical Field
The present disclosure relates to the field of high dynamic range image photographing technologies, and in particular, to a high dynamic range image photographing method, device and storage medium.
Background
With the development of science and technology, image acquisition is used as an information communication and transmission mode in every aspect of daily life.
In the related art, a short exposure image and a medium exposure image can be obtained by exposing with a staggered exposure sensor (stepper exposure sensor), and the obtained short exposure image and medium exposure image are synthesized to obtain a high dynamic range captured image required by a user. However, in the related art, the high dynamic range captured image obtained by synthesis has low definition and many ghosts.
Disclosure of Invention
In order to overcome the problems in the related art, an object of the present disclosure is to provide a method, an apparatus, and a storage medium for photographing a high dynamic range image, which can obtain a high dynamic range photographed image with high definition through high dynamic range photographed image synthesis.
In order to achieve the purpose, the technical scheme adopted by the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, there is provided a high dynamic range image photographing method applied to an image capturing device, where the image capturing device includes an interlaced exposure sensor, the high dynamic range image photographing method includes:
starting the staggered exposure sensor to take a high dynamic range image in response to the image acquisition equipment, and controlling the staggered exposure sensor to expose to obtain a first exposure image, a second exposure image and a third exposure image; if an image photographing instruction is received, outputting a first exposure image, a second exposure image and a third exposure image for high dynamic range photographing image synthesis; and synthesizing the high dynamic range photographed image based on the first exposure image, the second exposure image and the third exposure image to obtain the high dynamic range photographed image.
In one embodiment, the outputting the first exposure image, the second exposure image, and the third exposure image for high dynamic range photographed image synthesis includes: outputting a first exposure image with a first exposure duration, a second exposure image with a second exposure duration and a third exposure image with a third exposure duration; the first exposure duration is within a first exposure duration range, the second exposure duration is within a second exposure duration range, and the third exposure duration is within a third exposure duration range; the maximum exposure time length of the first exposure time length range is less than the minimum exposure time length of the second exposure time length range, and the maximum exposure time length of the second exposure time length range is less than the minimum exposure time length of the third exposure time length range.
In one embodiment, the high dynamic range image photographing method further includes: in the image preview stage, high dynamic range preview image synthesis is carried out based on the first exposure image and the second exposure image to obtain a high dynamic range preview image; the first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within a first exposure duration range, and the second exposure duration is within a second exposure duration range; the maximum exposure time length of the first exposure time length range is less than the minimum exposure time length of the second exposure time length range, and the maximum exposure time length of the second exposure time length range is less than the minimum exposure time length of the third exposure time length range.
In one embodiment, in an image preview stage, performing high dynamic range preview image synthesis based on a first exposure image and a second exposure image to obtain a high dynamic range preview image, includes: if an image preview instruction is received, outputting a first exposure image with first exposure duration, a second exposure image with second exposure duration and a third exposure image with fourth exposure duration; the sum of the exposure durations among the first exposure duration, the second exposure duration and the fourth exposure duration is less than a preview exposure duration threshold, the fourth exposure duration is less than a preset exposure duration, the preset exposure duration is less than a third exposure duration, and the third exposure duration is within a third exposure duration range; and discarding the third exposure image, and performing high dynamic range preview image synthesis based on the first exposure image and the second exposure image to obtain a high dynamic range preview image.
In one embodiment, in an image preview stage, performing high dynamic range preview image synthesis based on a first exposure image and a second exposure image to obtain a high dynamic range preview image, includes: if an image preview instruction is received, outputting a first exposure image with first exposure duration and a second exposure image with second exposure duration; and synthesizing the preview image with the high dynamic range based on the first exposure image and the second exposure image to obtain the preview image with the high dynamic range.
According to a second aspect of the embodiments of the present disclosure, there is provided a high dynamic range image photographing device applied to an image capturing apparatus, the image capturing apparatus includes an interlaced exposure sensor, the high dynamic range image photographing device includes:
the control unit is used for starting the staggered exposure sensor to take high-dynamic-range images in response to the image acquisition equipment and controlling the staggered exposure sensor to be exposed to obtain a first exposure image, a second exposure image and a third exposure image; the output unit is used for outputting a first exposure image, a second exposure image and a third exposure image for high dynamic range photographing image synthesis under the condition of receiving an image photographing instruction; and the synthesis unit is used for synthesizing the high dynamic range photographed image based on the first exposure image, the second exposure image and the third exposure image to obtain the high dynamic range photographed image.
In one embodiment, the output unit outputs the first exposure image, the second exposure image, and the third exposure image for high dynamic range photographic image synthesis in the following manner: outputting a first exposure image with a first exposure duration, a second exposure image with a second exposure duration and a third exposure image with a third exposure duration; the first exposure duration is within a first exposure duration range, the second exposure duration is within a second exposure duration range, and the third exposure duration is within a third exposure duration range; the maximum exposure time length of the first exposure time length range is less than the minimum exposure time length of the second exposure time length range, and the maximum exposure time length of the second exposure time length range is less than the minimum exposure time length of the third exposure time length range.
In one embodiment, the synthesis unit is further configured to: in the image preview stage, high dynamic range preview image synthesis is carried out based on the first exposure image and the second exposure image to obtain a high dynamic range preview image; the first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within a first exposure duration range, and the second exposure duration is within a second exposure duration range; the maximum exposure time length of the first exposure time length range is less than the minimum exposure time length of the second exposure time length range, and the maximum exposure time length of the second exposure time length range is less than the minimum exposure time length of the third exposure time length range.
In one embodiment, in the image preview stage, the combining unit performs high dynamic range preview image combining based on the first exposure image and the second exposure image to obtain a high dynamic range preview image as follows: if an image preview instruction is received, outputting a first exposure image with first exposure duration, a second exposure image with second exposure duration and a third exposure image with fourth exposure duration; the sum of the exposure durations among the first exposure duration, the second exposure duration and the fourth exposure duration is less than a preview exposure duration threshold, the fourth exposure duration is less than a preset exposure duration, the preset exposure duration is less than a third exposure duration, and the third exposure duration is within a third exposure duration range; and discarding the third exposure image, and synthesizing the high dynamic range preview image based on the first exposure image and the second exposure image to obtain the high dynamic range preview image.
In one embodiment, in the image preview stage, the combining unit performs high dynamic range preview image combining based on the first exposure image and the second exposure image to obtain a high dynamic range preview image as follows: if an image preview instruction is received, outputting a first exposure image with first exposure duration and a second exposure image with second exposure duration; and synthesizing the preview image with the high dynamic range based on the first exposure image and the second exposure image to obtain the preview image with the high dynamic range.
According to a third aspect of the embodiments of the present disclosure, there is provided a high dynamic range image photographing apparatus including:
a processor; a memory for storing processor-executable instructions;
wherein the processor is configured to: the method for photographing a high dynamic range image as set forth in the first aspect or any one of the embodiments of the first aspect is performed.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a storage medium having instructions stored therein, where the instructions when executed by a processor of an image capturing apparatus enable the image capturing apparatus to perform the high dynamic range image photographing method according to the first aspect or any one of the embodiments of the first aspect.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: and starting the staggered exposure sensor to take a picture in a high dynamic range in response to the image acquisition equipment, and controlling the staggered exposure sensor to expose to obtain three frames of exposure images. And if the image photographing instruction is received, outputting three-frame exposure images for high dynamic range photographing image synthesis. And carrying out high dynamic range photographing image synthesis on the three frames of exposure images to obtain a high dynamic range photographing image. The three frames of images output by the staggered exposure sensor at the same moment are used for high dynamic range photographed image synthesis, so that the obtained high dynamic range photographed image has higher definition.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flowchart illustrating a high dynamic range image photographing method according to an exemplary embodiment.
Fig. 2 is a flow chart illustrating another high dynamic range image photographing method according to an exemplary embodiment.
FIG. 3 is a flow diagram illustrating a method of acquiring a high dynamic range preview image in accordance with an exemplary embodiment.
FIG. 4 is a flow diagram illustrating another method of acquiring a high dynamic range preview image in accordance with an exemplary embodiment.
Fig. 5 is a flow diagram illustrating a process for acquiring a high dynamic range preview image according to an exemplary embodiment.
Fig. 6 is a schematic diagram illustrating another process for acquiring a high dynamic range preview image according to an exemplary embodiment.
Fig. 7 is a block diagram illustrating a high dynamic range image photographing apparatus according to an exemplary embodiment.
Fig. 8 is a block diagram illustrating an apparatus for high dynamic range image photographing according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the disclosure, as detailed in the appended claims.
The High Dynamic Range image photographing method provided by the embodiment of the disclosure may be applied to a scene in which an image capturing device equipped with a staggered exposure sensor (stabger exposure sensor) performs High Dynamic Range (HDR) image photographing. The image acquisition equipment with the staggered exposure sensor can control the staggered exposure sensor to expose to obtain images with different exposure durations in the process of taking pictures of images with high dynamic ranges.
In the related art, in a high dynamic range image photographing method, two frames of images (a short exposure image and a medium exposure image) can be obtained by controlling an exposure of an interlaced exposure sensor during high dynamic range image photographing. And carrying out high dynamic range photographing image synthesis on the obtained two frames of images to obtain a high dynamic range photographing image. The high dynamic range photographed image is synthesized by the method, and the obtained high dynamic range photographed image has lower definition. In another high dynamic range image photographing method provided by the related art, two frames of images (a short exposure image and a medium exposure image) can be obtained by controlling the exposure of the staggered exposure sensor when the high dynamic range image photographing is performed. And carrying out high dynamic range photographing image synthesis on the obtained two frames of images and the long exposure image obtained by subsequent exposure to obtain a high dynamic range photographing image. In the process of synthesizing the high dynamic range photographed image, the long exposure image is obtained by subsequent exposure, so that the obtained high dynamic range photographed image generates more ghost images.
In view of the above, the embodiments of the present disclosure provide a high dynamic range image photographing method, which can control an interlaced exposure sensor to expose to obtain three frames of images (a short exposure image, a medium exposure image, and a long exposure image) when performing high dynamic range image photographing. And carrying out high dynamic range photographing image synthesis on the three frames of images output at the same time to obtain a high dynamic range photographing image. The method and the device can improve the definition of the high dynamic range photographed image.
Fig. 1 is a flowchart illustrating a high dynamic range image photographing method according to an exemplary embodiment, as shown in fig. 1, the high dynamic range image photographing method is used in an image capturing apparatus mounted with an interlaced exposure sensor, and includes the following steps.
In step S11, in response to the image capturing apparatus activating the interlaced exposure sensor to perform high dynamic range image photographing, the interlaced exposure sensor is controlled to expose to obtain a first exposure image, a second exposure image and a third exposure image.
In the embodiment of the present disclosure, the first exposure image, the second exposure image, and the third exposure image may be understood as exposure images having different exposure durations.
In step S12, in the case where the image photographing instruction is received, the first exposure image, the second exposure image, and the third exposure image for the high dynamic range photographed image synthesis are output.
In step S13, high dynamic range photographed image synthesis is performed based on the first exposure image, the second exposure image, and the third exposure image, resulting in a high dynamic range photographed image.
In the embodiment of the present disclosure, the first exposure image, the second exposure image, and the third exposure image for performing high dynamic range photographic image synthesis are output simultaneously. And carrying out high dynamic range photographing image synthesis on the first exposure image, the second exposure image and the third exposure image to obtain a high dynamic range photographing image with higher definition, so that ghosting of the high dynamic range photographing image is reduced.
In one example, the first exposure image, the second exposure image, and the third exposure image obtained by controlling the exposure of the interlaced exposure sensor may be exposure images having different exposure durations.
In the embodiments of the present disclosure, for convenience of description, the short exposure period is referred to as a first exposure period, the medium exposure period is referred to as a second exposure period, and the long exposure period is referred to as a third exposure period.
Fig. 2 is a flowchart illustrating a high dynamic range image photographing method according to an exemplary embodiment, and as shown in fig. 2, implementation processes of step S21 and step S23 in the high dynamic range image photographing method provided by the embodiment of the present disclosure are similar to implementation processes of step S11 and step S13 shown in fig. 1, and are not described herein again.
In step S22, in the case where the image photographing instruction is received, the first exposure image having the first exposure time length, the second exposure image having the second exposure time length, and the third exposure image having the third exposure time length are output.
The first exposure duration is within the first exposure duration range, the second exposure duration is within the second exposure duration range, and the third exposure duration is within the third exposure duration range. The maximum exposure duration in the first exposure duration range is less than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is less than the minimum exposure duration in the third exposure duration range.
In the high dynamic range image photographing method provided by the embodiment of the present disclosure, the exposure image obtained by exposure of the staggered exposure sensor may be an exposure image with different exposure durations. And the exposure images with different exposure durations are subjected to high dynamic range photographing image synthesis, so that the definition of the high dynamic range photographing image can be further improved.
In the embodiment of the present disclosure, in the image preview stage, the first exposure image and the second exposure image may be subjected to high dynamic range preview image synthesis to obtain a high dynamic range preview image.
The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within the range of the first exposure duration, and the second exposure duration is within the range of the second exposure duration. The maximum exposure duration in the first exposure duration range is less than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is less than the minimum exposure duration in the third exposure duration range.
In the embodiment of the present disclosure, under the condition that the first exposure image, the second exposure image, and the third exposure image are output, the first exposure image and the second exposure image may be selected for high dynamic range preview image synthesis, and the third exposure image is not required to be selected, so that power consumption for high dynamic range preview image synthesis is reduced.
Fig. 3 is a flowchart illustrating a method of acquiring a high dynamic range preview image, according to an exemplary embodiment, as shown in fig. 3, including the following steps.
In step S31, in the case where the image preview instruction is received, the first exposure image having the first exposure time length, the second exposure image having the second exposure time length, and the third exposure image having the fourth exposure time length are output.
The sum of the exposure duration among the first exposure duration, the second exposure duration and the fourth exposure duration is less than the threshold of the preview exposure duration, the fourth exposure duration is less than the preset exposure duration, the preset exposure duration is less than the third exposure duration, and the third exposure duration is within the range of the third exposure duration.
In step S32, the third exposure image is discarded, and the high dynamic range preview image is synthesized based on the first exposure image and the second exposure image, resulting in a high dynamic range preview image.
In the embodiment of the present disclosure, by reducing the exposure duration of the third exposure image, the frame rate of the preview image of the high dynamic range preview image can be ensured.
In one example, the third exposure image may generate more ghost images due to the third exposure image being acquired at the fourth exposure duration. Therefore, the third exposure image can be abandoned in the process of synthesizing the high dynamic range preview image, so as to ensure the definition of the high dynamic range preview image. In addition, only the first exposure image and the second exposure image are used for high dynamic range preview image synthesis, so that the power consumption of the image acquisition equipment can be reduced, and the efficiency of high dynamic range preview image synthesis is improved.
In another example, when an image preview instruction is received, a first exposure image and a second exposure image may be output, and a high dynamic range preview image may be obtained by synthesizing the first exposure image and the second exposure image.
Fig. 4 is a flowchart illustrating a method of acquiring a high dynamic range preview image, as shown in fig. 4, according to an exemplary embodiment, including the following steps.
In step S41, in the case where an image preview instruction is received, a first exposure image having a first exposure time length and a second exposure image having a second exposure time length are output.
In step S42, high dynamic range preview image combining is performed based on the first exposure image and the second exposure image, and a high dynamic range preview image is obtained.
In the embodiment of the disclosure, in the case of receiving an image preview instruction, the first exposure image and the second exposure image can be output without outputting the third exposure image, thereby reducing the power consumption of the output of the exposure images.
The high dynamic range image photographing method provided by the embodiment of the disclosure can ensure the preview frame rate of the high dynamic range preview image, and the synthesized high dynamic range preview image has higher definition.
Fig. 5 is a flow diagram illustrating a process for acquiring a high dynamic range preview image according to an exemplary embodiment. As shown in fig. 5, in the image preview stage, the interlace-type exposure sensor outputs a short-exposure frame image (first exposure period), a medium-exposure frame image (second exposure period), and a long-exposure frame image (fourth exposure period). To ensure that the preview screen is not jammed continuously, it is usually necessary to ensure that the frame rate of the preview screen is not less than a frame rate threshold (e.g. 30 FPS). Therefore, it is necessary to ensure that the sum of the exposure time lengths between the long-exposure frame image, the medium-exposure frame image, and the short-exposure frame image is less than the preview exposure time length threshold (e.g., 33 ms). For example, the exposure time period of the long-exposure frame image (fourth exposure time period) may be set to be smaller than the preset exposure time period. The method can ensure that the exposure time length of the long exposure frame image is small enough, thereby ensuring that the sum of the exposure time lengths among the short exposure frame image, the middle exposure frame image and the long exposure frame image can be smaller than the threshold value of the preview exposure time length. In order to ensure the synthesis effect of the high dynamic range preview image, the long exposure frame image obtained by exposure in the fourth exposure duration can be discarded, and the short exposure frame image and the medium exposure image obtained by exposure are adopted to synthesize the high dynamic range preview image, so that the required high dynamic range preview image is obtained. Further, when photographing is performed using the image pickup apparatus having the staggered exposure sensor, it is not necessary to secure a frame rate since images are photographed with a high dynamic range. Therefore, the sum of the exposure durations between the short-exposure frame image, the middle-exposure frame image, and the long-exposure frame image may exceed the preview exposure duration threshold. For example, in the case where an image photographing instruction is received, the exposure duration of the long-exposure frame image may be restored to the normal exposure duration (third exposure duration), and the short-exposure frame image (first exposure duration), the medium-exposure frame image (second exposure duration), and the long-exposure frame image (third exposure duration) may be output through the interlace exposure sensor. And carrying out high dynamic range photographing image synthesis on the short exposure frame image, the middle exposure frame image and the long exposure frame image to obtain the required high dynamic range photographing image.
FIG. 6 is a flowchart illustrating a method for obtaining a high dynamic range preview image according to an exemplary embodiment. As shown in fig. 6, in the image preview stage, the interlace-type exposure sensor outputs a short-exposure frame image (first exposure period) and a medium-exposure frame image (second exposure period). And synthesizing the exposure frame images in the output short exposure frame images to obtain the required preview image with high dynamic range. Further, when photographing using the image pickup apparatus having the interleaved book exposure sensor, the interleaved exposure sensor outputs a short exposure frame image (first exposure period), a middle exposure frame image (second exposure period), and a long exposure frame image (third exposure period). And carrying out high dynamic range photographing image synthesis on the output short exposure frame image, middle exposure frame image and long exposure frame image to obtain a high dynamic range photographing image.
In the high dynamic range image photographing method provided by the embodiment of the disclosure, when high dynamic range image photographing is performed, the staggered exposure sensor is controlled to be exposed to obtain a short exposure frame image, a medium exposure frame image and a long exposure frame image. When the long exposure frame is not required to participate in the high dynamic range image synthesis (high dynamic range preview image synthesis), only the short exposure frame image and the medium exposure frame image are output, and the long exposure frame image is not output. When a long exposure frame is required to participate in high dynamic range image synthesis (high dynamic range photographed image synthesis), a short exposure frame image, a medium exposure frame image, and a long exposure frame image are output. The method can ensure that the preview interface does not stop under the condition of switching the output of two frames of images to the output of three frames of images, and realizes the dynamic smooth switching from two frames to three frames.
In one example, as shown in fig. 5 and 6, in the case where the staggered exposure sensor is exposed to obtain a short-exposure frame image, a middle-exposure frame image, and a long-exposure frame exposure image, the reference frame image may be determined in the short-exposure frame image, the middle-exposure frame image, and the long-exposure frame exposure image, respectively. In one embodiment, the reference frame image with the same exposure time length and the adjacent frame image may be subjected to image synthesis to obtain a reference frame with higher definition. Further, the reference frame images corresponding to the obtained short exposure frame image, medium exposure frame image and long exposure frame exposure image may be output, and the high dynamic range image may be synthesized by the output reference frame images to obtain the high dynamic range image.
In the embodiment of the disclosure, in the image preview stage, the short exposure frame image and the medium exposure frame image obtained by the exposure of the interlaced sensor may be used to perform the high dynamic range preview image synthesis, so as to obtain the high dynamic range preview image. And under the condition of receiving a photographing instruction, performing high dynamic range photographing image synthesis by using the short exposure frame image, the middle exposure frame image and the long exposure frame image obtained by exposure of the staggered sensor to obtain a high dynamic range photographing image. The method and the device can improve the definition of the high dynamic range photographed image, and the process of switching from the image preview stage to the photographing is smooth and continuous and cannot be blocked.
Based on the same conception, the embodiment of the disclosure also provides a high dynamic range image photographing device.
It is understood that the high dynamic range image photographing apparatus provided by the embodiments of the present disclosure includes hardware structures and/or software modules corresponding to the respective functions in order to implement the functions described above. The disclosed embodiments can be implemented in hardware or a combination of hardware and computer software, in combination with the exemplary elements and algorithm steps disclosed in the disclosed embodiments. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the subject matter of the embodiments of the present disclosure.
Fig. 7 is a block diagram illustrating a high dynamic range image photographing apparatus according to an exemplary embodiment. Referring to fig. 7, the apparatus 100 includes a control unit 101, an output unit 102, and a synthesis unit 103.
The control unit 101 starts the staggered exposure sensor to take a picture in a high dynamic range in response to the image acquisition equipment, and controls the staggered exposure sensor to expose to obtain a first exposure image, a second exposure image and a third exposure image. The output unit 102, upon receiving the image photographing instruction, outputs a first exposure image, a second exposure image, and a third exposure image for high dynamic range photographed image synthesis. And a synthesizing unit 103 for synthesizing the high dynamic range photographed image based on the first exposure image, the second exposure image and the third exposure image to obtain a high dynamic range photographed image.
In one embodiment, the output unit 102 outputs the first exposure image, the second exposure image, and the third exposure image for the high dynamic range photographed image synthesis in the following manner: and outputting a first exposure image with a first exposure duration, a second exposure image with a second exposure duration and a third exposure image with a third exposure duration. The first exposure duration is within the first exposure duration range, the second exposure duration is within the second exposure duration range, and the third exposure duration is within the third exposure duration range. The maximum exposure duration in the first exposure duration range is less than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is less than the minimum exposure duration in the third exposure duration range.
In one embodiment, the synthesis unit 103 is further configured to: and in the image preview stage, synthesizing the high dynamic range preview image based on the first exposure image and the second exposure image to obtain the high dynamic range preview image. The first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within the first exposure duration range, and the second exposure duration is within the second exposure duration range. The maximum exposure duration in the first exposure duration range is less than the minimum exposure duration in the second exposure duration range, and the maximum exposure duration in the second exposure duration range is less than the minimum exposure duration in the third exposure duration range.
In one embodiment, in the image preview stage, combining section 103 performs high dynamic range preview image combining based on the first exposure image and the second exposure image to obtain a high dynamic range preview image as follows: and if the image preview instruction is received, outputting a first exposure image with a first exposure duration, a second exposure image with a second exposure duration and a third exposure image with a fourth exposure duration. The sum of the exposure duration among the first exposure duration, the second exposure duration and the fourth exposure duration is less than the threshold of the preview exposure duration, the fourth exposure duration is less than the preset exposure duration, the preset exposure duration is less than the third exposure duration, and the third exposure duration is within the range of the third exposure duration. And discarding the third exposure image, and synthesizing the high dynamic range preview image based on the first exposure image and the second exposure image to obtain the high dynamic range preview image.
In one embodiment, in the image preview stage, the combining unit 103 performs high dynamic range preview image combining based on the first exposure image and the second exposure image to obtain a high dynamic range preview image as follows: and if the image preview instruction is received, outputting a first exposure image with a first exposure duration and a second exposure image with a second exposure duration. And synthesizing the high dynamic range preview image based on the first exposure image and the second exposure image to obtain the high dynamic range preview image.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 8 is a block diagram illustrating an apparatus 200 for high dynamic range image photographing according to an exemplary embodiment. For example, the apparatus 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 8, the apparatus 200 may include one or more of the following components: a processing component 202, a memory 204, a power component 206, a multimedia component 208, an audio component 210, an input/output (I/O) interface 212, a sensor component 214, and a communication component 216.
The processing component 202 generally controls overall operation of the device 200, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 202 can include one or more modules that facilitate interaction between the processing component 202 and other components. For example, the processing component 202 can include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.
The memory 204 is configured to store various types of data to support operations at the apparatus 200. Examples of such data include instructions for any application or method operating on device 200, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 204 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 200 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 210 is configured to output and/or input audio signals. For example, audio component 210 includes a Microphone (MIC) configured to receive external audio signals when apparatus 200 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 204 or transmitted via the communication component 216. In some embodiments, audio component 210 also includes a speaker for outputting audio signals.
The I/O interface 212 provides an interface between the processing component 202 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 214 includes one or more sensors for providing various aspects of status assessment for the device 200. For example, the sensor assembly 214 may detect an open/closed state of the device 200, the relative positioning of components, such as a display and keypad of the device 200, the sensor assembly 214 may also detect a change in the position of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration/deceleration of the device 200, and a change in the temperature of the device 200. The sensor assembly 214 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 216 is configured to facilitate wired or wireless communication between the apparatus 200 and other devices. The device 200 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 200 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as memory 204, that are executable by processor 220 of device 200 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
It is understood that "a plurality" in this disclosure means two or more, and other words are analogous. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. The singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It will be further understood that the terms "first," "second," and the like, are used to describe various information and should not be limited by these terms. These terms are only used to distinguish one type of information from another and do not denote a particular order or importance. Indeed, the terms "first," "second," and the like are fully interchangeable. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure.
It will be further understood that, unless otherwise specified, "connected" includes direct connections between the two without the presence of other elements, as well as indirect connections between the two with the presence of other elements.
It is further to be understood that while operations are depicted in the drawings in a particular order, this is not to be understood as requiring that such operations be performed in the particular order shown or in serial order, or that all illustrated operations be performed, to achieve desirable results. In certain environments, multitasking and parallel processing may be advantageous.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (12)
1. A high dynamic range image photographing method is applied to image acquisition equipment, the image acquisition equipment comprises an interlaced exposure sensor, and the high dynamic range image photographing method comprises the following steps:
starting the staggered exposure sensor to take a high dynamic range image in response to the image acquisition equipment, and controlling the staggered exposure sensor to expose to obtain a first exposure image, a second exposure image and a third exposure image;
if an image photographing instruction is received, outputting a first exposure image, a second exposure image and a third exposure image which are used for synthesizing a high dynamic range photographing image;
and synthesizing the high dynamic range photographed image based on the first exposure image, the second exposure image and the third exposure image to obtain the high dynamic range photographed image.
2. The high dynamic range image photographing method according to claim 1, wherein the outputting of the first exposure image, the second exposure image, and the third exposure image for high dynamic range photographed image synthesis includes:
outputting a first exposure image with a first exposure duration, a second exposure image with a second exposure duration and a third exposure image with a third exposure duration;
the first exposure duration is within a first exposure duration range, the second exposure duration is within a second exposure duration range, and the third exposure duration is within a third exposure duration range;
the maximum exposure time length in the first exposure time length range is less than the minimum exposure time length in the second exposure time length range, and the maximum exposure time length in the second exposure time length range is less than the minimum exposure time length in the third exposure time length range.
3. The high dynamic range image photographing method according to claim 1 or 2, wherein the high dynamic range image photographing method further comprises:
in the image preview stage, synthesizing a high dynamic range preview image based on the first exposure image and the second exposure image to obtain a high dynamic range preview image;
the first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within a first exposure duration range, and the second exposure duration is within a second exposure duration range;
the maximum exposure time length in the first exposure time length range is less than the minimum exposure time length in the second exposure time length range, and the maximum exposure time length in the second exposure time length range is less than the minimum exposure time length in the third exposure time length range.
4. The method of claim 3, wherein in the image preview stage, the high dynamic range preview image is synthesized based on the first exposure image and the second exposure image to obtain the high dynamic range preview image, and the method comprises:
if an image preview instruction is received, outputting a first exposure image with first exposure duration, a second exposure image with second exposure duration and a third exposure image with fourth exposure duration;
the sum of the exposure durations among the first exposure duration, the second exposure duration and the fourth exposure duration is less than a preview exposure duration threshold, the fourth exposure duration is less than a preset exposure duration, the preset exposure duration is less than a third exposure duration, and the third exposure duration is within a third exposure duration range;
and discarding the third exposure image, and performing high dynamic range preview image synthesis based on the first exposure image and the second exposure image to obtain a high dynamic range preview image.
5. The method for taking pictures of images with high dynamic range according to claim 3, wherein in the image preview stage, the high dynamic range preview image is synthesized based on the first exposure image and the second exposure image, so as to obtain the preview image with high dynamic range, comprising:
if an image preview instruction is received, outputting a first exposure image with first exposure duration and a second exposure image with second exposure duration;
and synthesizing the preview image with the high dynamic range based on the first exposure image and the second exposure image to obtain the preview image with the high dynamic range.
6. The utility model provides a high dynamic range image device of shooing which characterized in that is applied to image acquisition equipment, image acquisition equipment is including interleaved exposure sensor, the high dynamic range image device of shooing includes:
the control unit is used for starting the staggered exposure sensor to take high-dynamic-range images in response to the image acquisition equipment and controlling the staggered exposure sensor to be exposed to obtain a first exposure image, a second exposure image and a third exposure image;
the output unit is used for outputting a first exposure image, a second exposure image and a third exposure image for high dynamic range photographing image synthesis under the condition of receiving an image photographing instruction;
and the synthesis unit is used for synthesizing the high dynamic range photographed image based on the first exposure image, the second exposure image and the third exposure image to obtain the high dynamic range photographed image.
7. The high dynamic range image photographing device according to claim 6, wherein the output unit outputs the first exposure image, the second exposure image, and the third exposure image for high dynamic range photographing image synthesis in the following manner:
outputting a first exposure image with a first exposure duration, a second exposure image with a second exposure duration and a third exposure image with a third exposure duration;
the first exposure duration is within a first exposure duration range, the second exposure duration is within a second exposure duration range, and the third exposure duration is within a third exposure duration range;
the maximum exposure time length of the first exposure time length range is less than the minimum exposure time length of the second exposure time length range, and the maximum exposure time length of the second exposure time length range is less than the minimum exposure time length of the third exposure time length range.
8. The high dynamic range image photographing device according to claim 6 or 7, wherein the combining unit is further configured to:
in the image preview stage, high dynamic range preview image synthesis is carried out based on the first exposure image and the second exposure image to obtain a high dynamic range preview image;
the first exposure image has a first exposure duration, the second exposure image has a second exposure duration, the first exposure duration is within a first exposure duration range, and the second exposure duration is within a second exposure duration range;
the maximum exposure time length of the first exposure time length range is less than the minimum exposure time length of the second exposure time length range, and the maximum exposure time length of the second exposure time length range is less than the minimum exposure time length of the third exposure time length range.
9. The high dynamic range image photographing device according to claim 8, wherein in the image preview stage, the combining unit performs high dynamic range preview image combining based on the first exposure image and the second exposure image in a manner as follows to obtain a high dynamic range preview image:
if an image preview instruction is received, outputting a first exposure image with first exposure duration, a second exposure image with second exposure duration and a third exposure image with fourth exposure duration;
the sum of the exposure durations among the first exposure duration, the second exposure duration and the fourth exposure duration is less than a preview exposure duration threshold, the fourth exposure duration is less than a preset exposure duration, the preset exposure duration is less than a third exposure duration, and the third exposure duration is within a third exposure duration range;
and discarding the third exposure image, and synthesizing the high dynamic range preview image based on the first exposure image and the second exposure image to obtain the high dynamic range preview image.
10. The high dynamic range image photographing device according to claim 8, wherein in the image preview stage, the combining unit performs high dynamic range preview image combining based on the first exposure image and the second exposure image in a manner as follows to obtain a high dynamic range preview image:
if an image preview instruction is received, outputting a first exposure image with first exposure duration and a second exposure image with second exposure duration;
and synthesizing the preview image with the high dynamic range based on the first exposure image and the second exposure image to obtain the preview image with the high dynamic range.
11. A high dynamic range image photographing apparatus, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to: the high dynamic range image photographing method according to any one of claims 1 to 5 is performed.
12. A storage medium having stored therein instructions that, when executed by a processor of an image capturing apparatus, enable the image capturing apparatus to execute the high dynamic range image photographing method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110335518.0A CN115134511A (en) | 2021-03-29 | 2021-03-29 | High dynamic range image photographing method and device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110335518.0A CN115134511A (en) | 2021-03-29 | 2021-03-29 | High dynamic range image photographing method and device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115134511A true CN115134511A (en) | 2022-09-30 |
Family
ID=83375700
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110335518.0A Pending CN115134511A (en) | 2021-03-29 | 2021-03-29 | High dynamic range image photographing method and device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115134511A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107395998A (en) * | 2017-08-24 | 2017-11-24 | 维沃移动通信有限公司 | A kind of image capturing method and mobile terminal |
| CN107613218A (en) * | 2017-09-15 | 2018-01-19 | 维沃移动通信有限公司 | The image pickup method and mobile terminal of a kind of high dynamic range images |
| CN108391059A (en) * | 2018-03-23 | 2018-08-10 | 华为技术有限公司 | A kind of method and apparatus of image procossing |
| CN110035233A (en) * | 2019-04-09 | 2019-07-19 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| US20190281219A1 (en) * | 2018-03-06 | 2019-09-12 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Imaging Control Method, Imaging Device, and Computer Readable Storage Medium |
| CN110381263A (en) * | 2019-08-20 | 2019-10-25 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
-
2021
- 2021-03-29 CN CN202110335518.0A patent/CN115134511A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107395998A (en) * | 2017-08-24 | 2017-11-24 | 维沃移动通信有限公司 | A kind of image capturing method and mobile terminal |
| CN107613218A (en) * | 2017-09-15 | 2018-01-19 | 维沃移动通信有限公司 | The image pickup method and mobile terminal of a kind of high dynamic range images |
| US20190281219A1 (en) * | 2018-03-06 | 2019-09-12 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Imaging Control Method, Imaging Device, and Computer Readable Storage Medium |
| CN108391059A (en) * | 2018-03-23 | 2018-08-10 | 华为技术有限公司 | A kind of method and apparatus of image procossing |
| CN110035233A (en) * | 2019-04-09 | 2019-07-19 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN110381263A (en) * | 2019-08-20 | 2019-10-25 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11539888B2 (en) | Method and apparatus for processing video data | |
| CN114500821B (en) | Photographing method and device, terminal and storage medium | |
| CN111343386B (en) | Image signal processing method and device, electronic device and storage medium | |
| CN110995993A (en) | Star track video shooting method, star track video shooting device and storage medium | |
| CN112333384B (en) | Image preview method, image preview device and storage medium | |
| CN107241535B (en) | Flash lamp adjusting device and terminal equipment | |
| CN111461950B (en) | Image processing method and device | |
| CN112468684A (en) | Camera module and mobile terminal with same | |
| CN112468686A (en) | Camera module and mobile terminal with same | |
| CN108156381B (en) | Photographing method and device | |
| CN111343375A (en) | Image signal processing method and device, electronic device and storage medium | |
| CN111698414B (en) | Image signal processing method and device, electronic device and readable storage medium | |
| CN114079724B (en) | Taking-off snapshot method, device and storage medium | |
| CN210670246U (en) | Camera module and mobile terminal with same | |
| CN210670245U (en) | Camera module and mobile terminal with same | |
| CN115134511A (en) | High dynamic range image photographing method and device and storage medium | |
| CN210670247U (en) | Camera module and mobile terminal with same | |
| CN110876000B (en) | Camera module, image correction method and device, electronic equipment and storage medium | |
| CN114339357A (en) | Image acquisition method, image acquisition device and storage medium | |
| CN112468683A (en) | Camera module and mobile terminal with same | |
| CN115733913B (en) | Continuous photographing method and device and storage medium | |
| CN111225158B (en) | Image generation method and device, electronic equipment and computer readable storage medium | |
| CN113766115B (en) | Image acquisition method, mobile terminal, device and storage medium | |
| CN112087572B (en) | Method and device for controlling zoom of lens, electronic equipment and readable storage medium | |
| CN117956268A (en) | Preview frame rate control method and device thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |