CN115278046A

CN115278046A - Shooting method and device, electronic equipment and storage medium

Info

Publication number: CN115278046A
Application number: CN202210673194.6A
Authority: CN
Inventors: 侯晓龙; 张园
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2022-06-15
Filing date: 2022-06-15
Publication date: 2022-11-01

Abstract

The application discloses a shooting method, a shooting device, electronic equipment and a storage medium, and belongs to the field of shooting. The shooting method comprises the following steps: receiving a first input of a user to a shooting preview interface; responding to the first input, and acquiring at least two frames of target cache images; wherein, the exposure parameters corresponding to each target cache image in the at least two frames of target cache images are different; obtaining a target image based on the at least two frames of target cache images; and the at least two frames of target buffer images are images obtained by exposure according to exposure parameters in the target exposure parameter group based on an overlapping exposure mode before the first input is received.

Description

Shooting method, shooting device, electronic equipment and storage medium

Technical Field

The application belongs to the field of camera shooting, and particularly relates to a shooting method, a shooting device, electronic equipment and a storage medium.

Background

At present, many scenes with high dynamic are often encountered in daily shooting, but the dynamic range of the light sensing of a Complementary Metal Oxide Semiconductor (CMOS) image sensor is limited and is much smaller than the human eye. Therefore, under the scene, the scenery seen by human eyes cannot be well restored, and a picture with underexposure at a low-brightness position and overexposure at a high-brightness position is shot. In order to solve the above problem, when shooting such a High Dynamic scene, a High Dynamic Range Imaging (HDR) algorithm is added to improve the Dynamic Range of shooting, so as to better restore the scene seen by human eyes.

Disclosure of Invention

The embodiment of the application aims to provide a shooting method, a shooting device, an electronic device and a storage medium. The scene seen by human eyes can be better restored in time in a high-dynamic scene.

In a first aspect, an embodiment of the present application provides a shooting method, where the method includes:

receiving a first input of a user to a shooting preview interface;

responding to the first input, and acquiring at least two frames of target cache images; wherein, the exposure parameters corresponding to each target cache image in the at least two frames of target cache images are different;

obtaining a target image based on the at least two frames of target cache images;

and the at least two frames of target buffer images are images obtained by exposure according to exposure parameters in the target exposure parameter group based on an overlapping exposure mode before the first input is received.

In a second aspect, an embodiment of the present application provides a camera, including:

the first receiving module is used for receiving first input of a user to the shooting preview interface;

the image signal processing module is used for responding to the first input and acquiring at least two frames of target cache images; the exposure parameters corresponding to each target cache image in the at least two frames of target cache images are different; obtaining a target image based on the at least two frames of target cache images; and the at least two frames of target buffer images are images obtained by exposure according to exposure parameters in the target exposure parameter group based on an overlapping exposure mode before the first input is received.

In a third aspect, embodiments of the present application provide an electronic device, which includes a processor and a memory, where the memory stores a program or instructions executable on the processor, and the program or instructions, when executed by the processor, implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium, on which a program or instructions are stored, which when executed by a processor, implement the steps of the method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In a sixth aspect, embodiments of the present application provide a computer program product, stored on a storage medium, for execution by at least one processor to implement the method according to the first aspect.

In the embodiment of the application, at least two frames of target cache images obtained by exposing according to exposure parameters in a target exposure parameter set based on an overlapping exposure mode before receiving a first input can be directly obtained by responding to the first input of a user to a shooting preview interface, and then a target image can be obtained based on the at least two frames of target cache images. And because the overlapping exposure technology is adopted to control the shooting device to carry out exposure, the frame interval between different exposure frames is short, and the ghost phenomenon in HDR synthesis processing can be reduced.

Drawings

FIG. 1 is a schematic illustration of an exposure using a common exposure technique, according to an exemplary embodiment;

FIG. 2 is a schematic diagram illustrating exposure using an overlay exposure technique in accordance with an exemplary embodiment;

fig. 3 is a flowchart illustrating a photographing method according to an exemplary embodiment;

FIG. 4 is a schematic diagram illustrating a configuration of a camera according to an exemplary embodiment;

FIG. 5 is a schematic diagram of an electronic device shown in accordance with an exemplary embodiment;

fig. 6 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived from the embodiments in the present application by a person skilled in the art, are within the scope of protection of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

When an existing HDR processing algorithm is used for exposing an image frame, because exposure recalculation is performed on the basis of preview exposure, the calculated exposure needs to be sent to a sensor again, the exposure is delayed by 2 to 4 frames to be effective generally, and then the frame required to be exposed can be captured, so that the shooting speed is low, and the user experience is poor.

In order to solve the above problem, an embodiment of the present application provides a shooting method, where at least two frames of target cache images obtained by exposing according to exposure parameters in a target exposure parameter set based on an overlap exposure manner before receiving a first input of a user on a shooting preview interface can be directly obtained, and then a target image can be obtained based on the at least two frames of target cache images, where the obtained at least two frames of target cache images are obtained by pre-exposing according to the exposure parameters in the target exposure parameter set based on the overlap exposure manner before receiving the first input, so that when a shooting preview interface is shot, the at least two frames of target cache images obtained in advance can be directly obtained, and a target image is directly generated without re-exposure, thereby improving a shooting speed, and making HDR better approach to zero-delay shooting. And because the overlapping exposure technology is adopted to control the shooting device to carry out exposure, the frame interval between different exposure frames is short, and the ghost phenomenon in HDR synthesis processing can be reduced.

Before describing the technical solutions of the embodiments of the present application, the exposure overlay techniques used in the technical solutions of the present application will be described first.

As shown in fig. 1, it is assumed that the exposure time of two frames is different, and during the exposure, after the first line 110 of the first frame is exposed and read, the exposure data of the first line 120 of the second frame can be read only after the last line 140 of the first frame is exposed and read, and the exposure interval H1 of the two frames is larger.

As shown in fig. 2, it is assumed that the exposure time of two frames is different, and during exposure, after the first line 210 of the first frame is exposed and read, the exposure and reading of the first line 220 of the second frame can be directly continued without waiting for the end of the exposure of the last line 240 of the first frame, and the exposure interval H2 between the two frames is relatively short.

The shooting method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

Fig. 3 is a schematic flowchart of a shooting method provided in an embodiment of the present application, where an execution subject of the shooting method may be an electronic device, and it should be noted that the execution subject does not limit the embodiment of the present application.

In the embodiment of the present application, the electronic device may be an intelligent terminal having a shooting function, and specifically, may be, but is not limited to, a Personal Computer (PC), a smart phone, a tablet Computer, a Personal Digital Assistant (PDA), or the like.

As shown in fig. 3, the photographing method provided by the embodiment of the present application may include steps 310 to 340.

And 310, receiving a first input of a user to the shooting preview interface.

Wherein the first input may be an input for photographing the photographing preview interface. The first input may be a click input, a double-click input, a slide input, a voice input, a gesture input, and the like of a user on a shooting control of the electronic device, or may be a combination input of at least two of the above inputs, which is not limited herein.

In some embodiments of the present application, a shooting scene corresponding to the shooting preview interface may be a high dynamic scene.

Step 320, in response to the first input, at least two frames of target buffer images are obtained.

Wherein the target buffer image may be an image frame acquired in response to the first input. The specific target buffer image may be at least one frame of a plurality of images obtained by exposure according to the exposure parameters in the target exposure parameter set based on the overlay exposure mode before the first input is received. Namely, the target cache image is at least one image frame in a multi-frame image obtained by controlling the shooting device to expose the photosensitive unit in the image sensor according to the exposure parameters in the target exposure parameter group based on the overlapping exposure mode from the beginning of accurate shooting (namely displaying a shooting preview interface) by the user until the end of pressing the shooting control by the user.

In some embodiments of the present application, the exposure parameter corresponding to each target buffer image in the at least two frames of target buffer images is different. I.e. each target buffer image is exposed based on different exposure parameters.

Here, multiple frames of images obtained by exposing the photosensitive unit in the image sensor according to the exposure parameters in the target exposure parameter set by the photographing device based on the overlay exposure mode may be stored in different buffer spaces (that is, each exposure parameter may correspond to a different buffer space, and target buffer images obtained by exposing based on different exposure parameters may be stored in different image buffer spaces corresponding to the different buffer spaces), and after receiving a first input to the photographing preview interface from a user, at least two frames of target buffer images are obtained from each buffer space in response to the first input.

The target exposure parameter set here may be at least one exposure parameter. Specifically, for example, the exposure parameter EV0 of the normal exposure (i.e., the first exposure parameter), the exposure parameter EV + of the overexposure (i.e., the second exposure parameter), and the exposure parameter EV- (i.e., the third exposure parameter) of the underexposure may be used.

Step 330, obtaining a target image based on at least two frames of target cache images.

The target image may be an image obtained by fusing at least one acquired frame of target cache image.

In some embodiments of the present application, in order to further increase the shooting speed, before step 310, the shooting method mentioned above may further include:

determining a first exposure parameter, a second exposure parameter and a third exposure parameter according to the light intensity information of a shooting scene;

controlling an image sensor of a shooting device to expose based on an overlapping exposure mode and based on a first exposure parameter, a second exposure parameter and a third exposure parameter respectively to obtain at least one frame of first image, at least one frame of second image and at least one frame of third image respectively;

respectively storing at least one frame of first image, at least one frame of second image and at least one frame of third image to obtain a first cache image sequence, a second cache image sequence and a third cache image sequence;

wherein the first exposure parameter may be an exposure parameter at which exposure is normally performed. That is, it may be EV0.

The second exposure parameter may be an overexposed exposure parameter. I.e., may be EV +.

The third exposure parameter may be an underexposed exposure parameter. I.e., it may be EV-.

The first exposure parameter, the second exposure parameter and the third exposure parameter may be different from each other.

Each exposure parameter includes an exposure time and a gain for the first exposure parameter, the second exposure parameter, and the third exposure parameter.

The first image may be an image obtained by controlling an image sensor of the imaging device to perform exposure based on the first exposure parameter by using a superposition exposure method.

The second image may be an image obtained by controlling an image sensor of the imaging device to perform exposure based on the second exposure parameter by using a superposition exposure method.

The third image may be an image obtained by controlling an image sensor of the imaging device to perform exposure based on the third exposure parameter by using a superposition exposure method.

The resulting luminance value of the first image is less than the luminance value of the second image. The luminance value of the first image is greater than the luminance value of the third image.

The first cached image sequence may be a cached image sequence obtained by caching the first image.

The second cached image sequence may be a cached image sequence obtained by caching the second image.

The third cached image sequence may be a cached image sequence obtained by caching the third image.

In some embodiments of the present application, when performing a shooting preview, an automatic exposure control module in the electronic device may calculate a first exposure parameter EV0 for a normal exposure according to light intensity information in a current shooting scene. Specifically, how to calculate the first exposure parameter EV0 of the normal exposure during shooting the shooting scene according to the light intensity information in the current shooting scene belongs to the prior art, and is not described herein again.

In some embodiments of the present application, when performing a shooting preview, the electronic device may detect light intensity information in a current shooting scene based on an HDR algorithm in the automatic exposure control module, then evaluate a dynamic range of the current shooting scene by combining a histogram or an artificial intelligence method, and then calculate an exposure parameter EV + (i.e., a second exposure parameter) that needs to be overexposed and an exposure parameter EV- (i.e., a third exposure parameter) that needs to be underexposed when a shooting effect is to be improved to a better dynamic range. Specifically, how to calculate the overexposed second exposure parameter and the underexposed third exposure parameter based on the HDR algorithm belongs to the prior art, and is not described herein again.

After obtaining three different sets of exposure parameters (i.e., a first exposure parameter, a second exposure parameter, and a third exposure parameter), the image sensor may send the three different sets of exposure parameters to the image sensor through the I2C transmission bus, and after receiving the three different sets of exposure parameters, the image sensor may control the image sensor of the photographing device to perform exposure based on the first exposure parameter, the second exposure parameter, and the third exposure parameter, respectively, by using an overlay exposure technique, so as to obtain at least one frame of a first image, at least one frame of a second image, and at least one frame of a third image, respectively.

When the image sensor controls the image sensor of the photographing device to perform exposure by using the overlay exposure technique, the sequence of performing exposure by using the first exposure parameter, the second exposure parameter, and the third exposure parameter may be set according to the user's requirement, which is not limited herein. Specifically, the image sensor of the photographing device may be controlled to perform exposure through the second exposure parameter (i.e., EV +) to obtain an image frame, then the image sensor of the photographing device is controlled to perform exposure through the first exposure parameter (i.e., EV 0) to obtain an image frame, and then the image sensor of the photographing device is controlled to perform exposure through the third exposure parameter (i.e., EV-) to obtain an image frame, so that the effect seen by the user is satisfied.

Then, the image sensor may set different Mobile Industry Processor Interface (MIPI) virtual channel identification (VC ID) codes for the images (the first image, the second image, and the third image), for example, set VC ID to 1 for the second image of EV +, set VC ID to 0 for the first image of EV0, set VC ID to 2 for the third image of EV +, and then MIPI transmits the exposed image to the image signal processing module through different VC IDs.

After receiving the second image of EV +, the first image of EV0, and the third image of EV +, the image signal processing module may parse the received images based on a Camera Serial Interface Decoder (CSID), and then store the images into different buffer spaces according to VC ID. For example, the first image of EV0 may be stored in buffer space buffer0, the second image of EV + may be stored in buffer space buffer1, and the third image of EV-may be stored in buffer space buffer 2.

It should be noted that, while the image signal processing module stores the first image of EV0 in the buffer space buffer0, the image signal processing module may also send the first image of EV0 to the capture preview processing stream for processing, specifically, a processing flow sent to the RAW format image to the YUV processing module, where the processing flow includes processing of color, noise, and tone, and then updates the preview image displayed on the capture preview interface, that is, updates the processed first image to the preview image displayed on the capture preview interface.

It should be noted that, for each buffer space, each image in the buffer space has its corresponding VC ID, and the larger the VC ID, the later the image is stored, that is, the shorter the time for storing the image is. The smaller the VC ID, the longer it has been in-store.

In the embodiment of the application, a first exposure parameter, a second exposure parameter and a third exposure parameter are determined according to light intensity information of a shooting scene, then, based on an exposure overlapping mode, an image sensor of a shooting device is controlled to carry out exposure respectively based on the first exposure parameter, the second exposure parameter and the third exposure parameter, at least one frame of first image, at least one frame of second image and at least one frame of third image are obtained respectively, and the at least one frame of first image, the at least one frame of second image and the at least one frame of third image are stored respectively.

In some embodiments of the present application, in order to enhance the user experience, step 320 may specifically include:

and acquiring at least two frames of target cache images from the first cache image sequence, the second cache image sequence and the third cache image sequence based on the gray value of the target image region in the shooting preview interface and the area ratio of the target image region in the shooting preview interface.

The target image area may be an image area corresponding to the target object.

The target object may be an object in a preview image displayed on the shooting preview interface, for example, a billboard, or a person, which is not limited herein.

In the embodiment of the application, at least two frames of target cache images can be obtained from the first cache image sequence, the second cache image sequence and the third cache image sequence based on the gray value of the target image region in the shooting preview interface and the area proportion of the target image region in the shooting preview interface, so that the gray value of the target image region in the shooting preview interface and the area proportion of the target image region in the shooting preview interface can be shot, at least two frames of target cache images are obtained accurately, an accurate target image required by a user is obtained, and user experience is improved.

In some embodiments of the present application, in order to improve a photographing effect, the obtaining at least two frames of target cache images from the first cache image sequence, the second cache image sequence, and the third cache image sequence based on a gray level value of a target image region in the photographing preview interface and an area ratio of the target image region in the photographing preview interface may specifically include:

under the condition that the gray value of the target image area is 0 and the area ratio of the target image area in the shooting preview interface is larger than a first preset threshold value, acquiring at least two frames of target cache images from the first cache image sequence and the second cache image sequence;

and updating the second exposure parameter under the condition that the gray-scale value of the target image area is 0 and the area ratio of the target image area in the shooting preview interface is within a second preset range.

The first preset threshold may be a preset threshold of an area ratio of the target image area in the shooting preview interface, and may be 70%, for example. The specific value can be set according to the user's requirement, and is not limited herein.

The second preset range may be a preset range of an area ratio of the target image area in the photographing preview interface, and may be 30% to 70%, for example.

In one example, if the shooting scene has a small dark area but a large area of black billboard (i.e. target object), the gray-level value of the target image area corresponding to the target object is 0. In this case, the HDR algorithm generally obtains a larger EV + to highlight the low bright region, i.e. the black object region, but the highlighting of the black object region may cause the black object to be frosted seriously. At this time, at least two frames of target cache images can be acquired according to the area ratio of the target image area in the shooting preview interface:

1) If the area ratio of the target image area in the shooting preview interface is larger than a first preset threshold (for example, 70%), obtaining the cache images from only the first cache image sequence and the third cache image sequence, and taking the cache images obtained from the first cache image sequence and the third cache image sequence as the target cache images.

2) If the area ratio of the target image area in the shooting preview interface is within the second preset range (for example, the area ratio of the target image area in the shooting preview interface may be 30% -70%), the HDR algorithm is directly fed back, and the value of EV + is reduced.

In some embodiments of the present application, if the area ratio of the target image area in the shooting preview interface is small (for example, the area ratio of the target image area in the shooting preview interface is less than 30%), no processing is performed.

In the embodiment of the application, under the condition that the gray value of the target image area is 0 and the area ratio of the target image area in the shooting preview interface is greater than a first preset threshold value, at least two frames of target cache images are obtained from the first cache image sequence and the third cache image sequence; and updating the second exposure parameter under the condition that the gray value of the target image area is 0 and the area ratio of the target image area in the shooting preview interface is within a second preset range, so that at least two frames of target cache images can be obtained according to the gray value of the target image area corresponding to the target object and the area ratio of the target image area in the shooting preview interface, and the second exposure parameter is updated, so that the brightness and the contrast of the second image corresponding to the second exposure parameter can be optimized by using the result of scene detection, and the shooting effect is improved.

under the condition that the gray value of the target image area is 255 and the area ratio of the target image area in the shooting preview interface is larger than a third preset threshold value, acquiring at least two frames of target cache images from the first cache image sequence and the second cache image sequence;

and updating the third exposure parameter under the condition that the gray-scale value of the target image area is 255 and the area ratio of the target image area in the shooting preview interface is within a fourth preset range.

The third preset threshold may be an area ratio of a preset target image area in the shooting preview interface, and may be 70%, for example. The specific value can be set according to the user's requirement, and is not limited herein.

The fourth preset range may be a preset range of an area ratio of the target image area in the photographing preview interface, and may be 30% to 70%, for example.

In one example, if a large-area white object, such as a white wall (i.e., a target object), is in the shooting scene, the gray-level value of the target image area corresponding to the target object is 255. In this case, the HDR algorithm generally obtains a relatively large EV — because the EV-is used to suppress highlights during HDR processing, but this is likely to cause the problem that highlights (i.e. white walls) are suppressed too much, the luminance loss is large, the white walls are darkened, and the local contrast loss is also likely to be caused in other scenes. At this time, at least two frames of target cache images can be acquired according to the area ratio of the target image area in the shooting preview interface:

1) If the area ratio of the target image area in the shooting preview interface is larger than a third preset threshold (for example, 70%), obtaining the cache image from only the first cache image sequence and the second cache image sequence, and taking the cache image obtained from the first cache image sequence and the second cache image sequence as the target cache image.

2) If the area ratio of the target image area in the shooting preview interface is within the fourth preset range (for example, the area ratio of the target image area in the shooting preview interface may be 30% -70%), the HDR algorithm is directly fed back, and the value of EV-is increased.

In some embodiments of the present application, if the area ratio of the target image area in the capture preview interface is small (for example, the area ratio of the target image area in the capture preview interface is less than 30%), no processing is performed.

In the embodiment of the application, under the condition that the gray value of the target image region is 255 and the area ratio of the target image region in the shooting preview interface is greater than a third preset threshold, at least two frames of target cache images are obtained from the first cache image sequence and the second cache image sequence; and under the condition that the gray value of the target image area is 255 and the area ratio of the target image area in the shooting preview interface is within a fourth preset range, updating the third exposure parameter, thus acquiring at least two frames of target cache images according to the gray value of the target image area corresponding to the target object and the area ratio of the target image area in the shooting preview interface, and updating the third exposure parameter, so that the brightness and the contrast of the third image corresponding to the third exposure parameter can be optimized by using the scene detection result, and the shooting effect is improved.

In some embodiments of the present application, the exposure parameter may include a gain for any of the first, second, and third exposure parameters.

In some embodiments of the present application, in order to enhance the user experience, before step 330, the above-mentioned shooting method may further include:

and respectively carrying out noise reduction processing on the at least two frames of target cache images under the condition that the light intensity information of the shooting scene is less than the preset intensity and the gains corresponding to the at least two frames of target cache images are greater than the preset gain.

The preset intensity may be light intensity information of a preset shooting scene. The preset intensity can be set according to the user requirement, and is not limited herein.

The preset gain may be a preset gain corresponding to at least two frames of the target buffer image. The preset gain can be set according to the user requirement, and is not limited herein.

In some embodiments of the present application, when it is detected that an environment of a current shooting scene is dark, for example, a night scene, light intensity information of the current shooting scene is smaller than a preset intensity, and since an image signal-to-noise ratio is reduced, that is, exposure gains corresponding to at least two frames of target cache images are larger than a preset exposure gain, noise reduction processing may be performed on the at least two frames of target cache images respectively, so as to obtain at least two frames of target cache images after the noise reduction processing.

In the embodiment of the application, under the condition that the light intensity information of the shooting scene is smaller than the preset intensity and the corresponding gain of the at least two frames of target cache images is larger than the preset gain, the at least two frames of target cache images are subjected to noise reduction respectively, so that the noise reduction treatment is performed on the at least two frames of target cache images respectively by using the result of scene detection, the shooting effect is improved, the target images meeting the user requirements and having better quality are obtained, and the user experience is improved.

In some embodiments of the present application, since EV + is mainly used for the enhancement of the brightness of the image dark in HDR processing, the dark detail is enhanced; EV is mainly used for suppressing the brightness of the image at the highlight part during HDR processing and enhancing the detail at the highlight part. But the local contrast at low and high light for EV + and EV-retrieved from the buffer space may not be good. In this way, in order to further improve the user experience, when the first target cache image in the first cache image sequence, the second target cache image in the second cache image sequence, and the third target cache image in the third cache image sequence are used as at least two frame target cache images, step 330 may specifically include:

determining a first image area of a second target cache image and a second image area of a third target cache image;

and under the condition that the contrast of the brightness value of the first image area and the brightness value of the second image area is less than a preset contrast threshold, performing image enhancement processing on the first image area and the second image area.

The first target buffer image may be any one frame buffer image in the first buffer image sequence.

The second target buffer image may be any one frame buffer image in the second buffer image sequence.

The third target buffer image may be any one frame buffer image in the third buffer image sequence.

The first image region may be a low bright image region in the second target buffer image.

The second image region may be a highlighted image region in the third target cache image.

In some embodiments of the present application, the luminance value of the first image region is less than the first luminance threshold and the luminance value of the second image region is greater than the second luminance threshold.

The first brightness threshold here may be a preset threshold of the brightness value of the first image region, and the first brightness threshold here may be set according to the user's needs, and is not limited here.

The second brightness threshold here may be a preset threshold of the brightness value of the second image region, and the second brightness threshold here may be set according to the user requirement, and is not limited here.

The preset contrast threshold may be a preset threshold for the contrast of the first brightness of the first image area and the second brightness of the second image area. The preset contrast threshold may be set according to the user's requirement, and is not limited herein.

In the embodiment of the application, after the second target cache image corresponding to EV + and the third target cache image corresponding to EV-are obtained, if the luminance value of the first image region is smaller than the first luminance threshold and the luminance value of the second image region is larger than the second luminance threshold, that is, the local contrast of the second target cache image corresponding to V + and the third target cache image corresponding to EV-is not good, the contrast of the luminance value of the first image region and the luminance value of the second image region may be obtained at this time, the local contrast detection may be performed on the EV + low-bright place and the EV-high-bright place, and if the contrast is not ideal (that is, the contrast is smaller than the preset contrast threshold), the local contrast enhancement may be performed on the EV + low-bright place and the EV-high-bright place, so as to improve the local contrast of the image after HDR processing and combining. Therefore, the target image which meets the requirements of users and has good quality can be obtained.

According to the shooting method provided by the embodiment of the application, the execution main body can be a shooting device. The embodiment of the present application takes an example in which a shooting device executes a shooting method, and the shooting device provided in the embodiment of the present application is described.

Fig. 4 is a schematic diagram illustrating a configuration of a photographing apparatus according to an exemplary embodiment.

As shown in fig. 4, the photographing apparatus 400 may include:

a first receiving module 410, configured to receive a first input to the shooting preview interface from a user;

an image signal processing module 420, configured to obtain at least two frames of target buffer images in response to the first input; the exposure parameters corresponding to each target cache image in the at least two frames of target cache images are different; obtaining a target image based on the at least two frames of target cache images; and the at least two frames of target buffer images are images obtained by exposure according to exposure parameters in the target exposure parameter set based on an overlapping exposure mode before the first input is received.

In the embodiment of the application, the image signal processing module is used for responding to a first input, received by the first receiving module, of the user to the shooting preview interface, so that at least two frames of target cache images obtained by exposure according to exposure parameters in a target exposure parameter set based on an overlapping exposure mode before the first input is received can be directly obtained, and then the target image can be obtained based on the at least two frames of target cache images. And because the overlapping exposure technology is adopted to control the shooting device to carry out exposure, the frame interval between different exposure frames is short, and the ghost phenomenon in HDR synthesis processing can be reduced.

In some embodiments of the present application, in order to further increase the shooting speed, the above-mentioned shooting apparatus may further include:

the automatic exposure control module is used for determining a first exposure parameter, a second exposure parameter and a third exposure parameter according to the light intensity information of the shooting scene; wherein the first exposure parameter, the second exposure parameter, and the third exposure parameter are different from each other;

the control module is used for controlling an image sensor of the shooting device to expose based on the first exposure parameter, the second exposure parameter and the third exposure parameter respectively based on an overlapping exposure mode to respectively obtain at least one frame of first image, at least one frame of second image and at least one frame of third image; the image signal processing module is further configured to store the at least one frame of first image, the at least one frame of second image, and the at least one frame of third image, respectively, to obtain a first cache image sequence, a second cache image sequence, and a third cache image sequence;

wherein the luminance value of the first image is smaller than the luminance value of the second image, and the luminance value of the first image is larger than the luminance value of the third image.

In some embodiments of the present application, to enhance the user experience, the image signal processing module 420 includes:

a first obtaining unit, configured to obtain the at least two frames of target cache images from the first cache image sequence, the second cache image sequence, and the third cache image sequence based on a gray scale value of a target image region in the shooting preview interface and an area ratio of the target image region in the shooting preview interface; and the target image area is an image area corresponding to the target object.

In some embodiments of the present application, to improve the photographing effect, the first obtaining unit is specifically configured to:

under the condition that the gray value of the target image area is 0 and the area proportion of the target image area in the shooting preview interface is larger than a first preset threshold value, acquiring the at least two frames of target cache images from the first cache image sequence and the third cache image sequence;

and updating the second exposure parameter under the condition that the gray value of the target image area is 0 and the area ratio of the target image area in the shooting preview interface is within a second preset range.

under the condition that the gray value of the target image region is 255 and the area proportion of the target image region in the shooting preview interface is larger than a third preset threshold value, acquiring the at least two frames of target cache images from the first cache image sequence and the second cache image sequence;

and updating the third exposure parameter under the condition that the gray value of the target image area is 255 and the area ratio of the target image area in the shooting preview interface is within a fourth preset range.

In some embodiments of the present application, the exposure parameter comprises a gain for any one of the first, second and third exposure parameters.

In some embodiments of the present application, to improve the user experience, the image signal processing module 420 may be further specifically configured to:

and respectively carrying out noise reduction processing on the at least two frames of target cache images under the condition that the light intensity information of the shooting scene is less than the preset intensity and the gains corresponding to the at least two frames of target cache images are greater than the preset gains.

In some embodiments of the present application, in order to further improve user experience, in a case that a first target cache image in a first cache image sequence, a second target cache image in a second cache image sequence, and a third target cache image in a third cache image sequence are used as at least two frame target cache images, the image signal processing module may be further specifically configured to:

determining a first image region of the second target cache image and a second image region of the third target cache image, wherein the brightness value of the first image region is smaller than a first brightness threshold value, and the brightness value of the second image region is larger than a second brightness threshold value;

and under the condition that the contrast of the brightness value of the first image area and the brightness value of the second image area is smaller than a preset contrast threshold, performing image enhancement processing on the first image area and the second image area.

The shooting device in the embodiment of the present application may be an electronic device, and may also be a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be a device other than a terminal. The electronic Device may be, for example, a Mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic Device, a Mobile Internet Device (MID), an Augmented Reality (AR)/Virtual Reality (VR) Device, a robot, a wearable Device, an ultra-Mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and may also be a server, a Network Attached Storage (Network Attached Storage, NAS), a personal computer (NAS), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not limited in particular.

The photographing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The shooting device provided in the embodiment of the present application can implement each process implemented in the method embodiment of fig. 3, and is not described here again to avoid repetition.

Optionally, as shown in fig. 5, an electronic device 500 is further provided in an embodiment of the present application, and includes a processor 501 and a memory 502, where the memory 502 stores a program or an instruction that can be executed on the processor 501, and when the program or the instruction is executed by the processor 501, the steps of the foregoing shooting method embodiment are implemented, and the same technical effects can be achieved, and are not described again here to avoid repetition.

It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device described above.

Fig. 6 is a schematic diagram of a hardware structure of an electronic device implementing the embodiment of the present application.

The electronic device 600 includes, but is not limited to: a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, a processor 610, and the like.

Those skilled in the art will appreciate that the electronic device 600 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 610 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 6 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.

The user input unit 607 is configured to receive a first input of the shooting preview interface from a user;

a processor 610 for obtaining at least two frames of target buffer images in response to the first input; and obtaining a target image based on the at least two frames of target cache images.

Therefore, at least two frames of target cache images obtained by exposure according to the exposure parameters in the target exposure parameter group based on the overlapping exposure mode before the first input is received can be directly obtained by responding to the first input of the shooting preview interface by the user, and then the target images can be obtained based on the at least two frames of target cache images. And because the overlapping exposure technology is adopted to control the shooting device to carry out exposure, the frame interval between different exposure frames is short, and the ghost phenomenon in HDR synthesis processing can be reduced.

Optionally, the processor 610 is further configured to determine a first exposure parameter, a second exposure parameter, and a third exposure parameter according to the light intensity information of the shooting scene; controlling an image sensor of the shooting device to expose based on the first exposure parameter, the second exposure parameter and the third exposure parameter respectively based on an overlapping exposure mode to respectively obtain at least one frame of first image, at least one frame of second image and at least one frame of third image; and respectively storing the at least one frame of first image, the at least one frame of second image and the at least one frame of third image to obtain a first cache image sequence, a second cache image sequence and a third cache image sequence.

Therefore, the first exposure parameter, the second exposure parameter and the third exposure parameter are determined according to the light intensity information of the shooting scene, then based on the exposure overlapping mode, the image sensor of the shooting device is exposed respectively based on the first exposure parameter, the second exposure parameter and the third exposure parameter, at least one frame of first image, at least one frame of second image and at least one frame of third image are obtained respectively, and the at least one frame of first image, the at least one frame of second image and the at least one frame of third image are stored respectively.

Optionally, the processor 610 is further configured to obtain the at least two frames of target buffer images from the first buffer image sequence, the second buffer image sequence, and the third buffer image sequence based on a gray scale value of a target image region in the shooting preview interface and an area ratio of the target image region in the shooting preview interface.

Therefore, at least two frames of target cache images can be obtained from the first cache image sequence, the second cache image sequence and the third cache image sequence based on the gray value of the target image region in the shooting preview interface and the area proportion of the target image region in the shooting preview interface, so that the gray value of the target image region in the shooting preview interface and the area proportion of the target image region in the shooting preview interface can be shot, at least two frames of target cache images can be accurately obtained, accurate target images required by a user can be further obtained, and user experience is improved.

Optionally, the processor 610 is further configured to, when the grayscale value of the target image region is 0 and the area ratio of the target image region in the shooting preview interface is greater than a first preset threshold, obtain the at least two frames of target cache images from the first cache image sequence and the third cache image sequence; and updating the second exposure parameter under the condition that the gray value of the target image area is 0 and the area ratio of the target image area in the shooting preview interface is within a second preset range.

In this way, under the condition that the gray value of the target image area is 0 and the area ratio of the target image area in the shooting preview interface is greater than a first preset threshold value, at least two frames of target cache images are obtained from the first cache image sequence and the third cache image sequence; and updating the second exposure parameter under the condition that the gray value of the target image area is 0 and the area ratio of the target image area in the shooting preview interface is within a second preset range, so that at least two frames of target cache images can be obtained according to the gray value of the target image area corresponding to the target object and the area ratio of the target image area in the shooting preview interface, and the second exposure parameter is updated, so that the brightness and the contrast of the second image corresponding to the second exposure parameter can be optimized by using the scene detection result, and the shooting effect is improved.

Optionally, the processor 610 is further configured to, when the gray-level value of the target image region is 255 and the area ratio of the target image region in the shooting preview interface is greater than a third preset threshold, obtain the at least two frames of target buffer images from the first buffer image sequence and the second buffer image sequence;

In this way, under the condition that the gray value of the target image region is 255 and the area ratio of the target image region in the shooting preview interface is greater than a third preset threshold value, at least two frames of target cache images are obtained from the first cache image sequence and the second cache image sequence; and under the condition that the gray value of the target image area is 255 and the area ratio of the target image area in the shooting preview interface is within a fourth preset range, updating the third exposure parameter, thus acquiring at least two frames of target cache images according to the gray value of the target image area corresponding to the target object and the area ratio of the target image area in the shooting preview interface, and updating the third exposure parameter, so that the brightness and the contrast of the third image corresponding to the third exposure parameter can be optimized by using the scene detection result, and the shooting effect is improved.

Optionally, the processor 610 is further configured to perform noise reduction processing on the at least two frames of target buffer images respectively when the light intensity information of the shooting scene is smaller than a preset intensity and the gains corresponding to the at least two frames of target buffer images are larger than a preset gain.

Therefore, under the condition that the light intensity information of the shooting scene is smaller than the preset intensity and the corresponding gains of the at least two frames of target cache images are larger than the preset gains, the at least two frames of target cache images are subjected to noise reduction respectively, the noise reduction processing is performed on the at least two frames of target cache images respectively by using the scene detection result, the shooting effect is improved, the target images with better quality meeting the user requirements are obtained, and the user experience is improved.

Optionally, the processor 610 is further configured to determine a first image region of the second target cache image and a second image region of the third target cache image, where a brightness value of the first image region is smaller than a first brightness threshold, and a brightness value of the second image region is greater than a second brightness threshold; and under the condition that the contrast ratio of a first brightness threshold value of the first image area and a second brightness threshold value of the second image area is smaller than a preset contrast threshold value, performing image enhancement processing on the first image area and the second image area.

Therefore, after the second target cache image corresponding to EV + and the third target cache image corresponding to EV-are obtained, if the brightness value of the first image area is smaller than the first brightness threshold value and the brightness value of the second image area is larger than the second brightness threshold value, namely the local contrast of the second target cache image corresponding to V + and the third target cache image corresponding to EV-is not good, the contrast of the brightness value of the first image area and the brightness value of the second image area can be obtained at the moment, the local contrast detection is carried out on the EV + low-brightness position and the EV-high-brightness position, and if the contrast is not ideal (namely the contrast is smaller than the preset contrast threshold value), the local contrast enhancement can be carried out on the EV + low-brightness position and the EV-high-brightness position, so that the local contrast of the image after HDR processing and synthesis is improved. Therefore, the target image which meets the requirements of users and has good quality can be obtained.

It is to be understood that, in the embodiment of the present application, the input Unit 604 may include a Graphics Processing Unit (GPU) 6041 and a microphone 6042, and the Graphics Processing Unit 6041 processes image data of a still picture or a video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The display unit 606 may include a display panel 6061, and the display panel 6061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 607 includes at least one of a touch panel 6071 and other input devices 6072. A touch panel 6071, also referred to as a touch screen. The touch panel 6071 may include two parts of a touch detection device and a touch controller. Other input devices 6072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.

The memory 609 may be used to store software programs as well as various data. The memory 609 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, application programs or instructions required for at least one function (such as a sound playing function, an image playing function, etc.), and the like. Further, the memory 609 may include volatile memory or nonvolatile memory, or the memory 609 may include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. The volatile Memory may be a Random Access Memory (RAM), a Static Random Access Memory (Static RAM, SRAM), a Dynamic Random Access Memory (Dynamic RAM, DRAM), a Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), a Double Data Rate Synchronous Dynamic Random Access Memory (Double Data Rate SDRAM, ddr SDRAM), an Enhanced Synchronous SDRAM (ESDRAM), a Synchronous Link DRAM (SLDRAM), and a Direct bus RAM (DRRAM). The memory 609 in the embodiments of the subject application include, but are not limited to, these and any other suitable types of memory.

Processor 610 may include one or more processing units; optionally, the processor 610 integrates an application processor, which primarily handles operations involving the operating system, user interface, and applications, and a modem processor, which primarily handles wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into the processor 610.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the program or the instruction implements the processes of the foregoing shooting method embodiment, and can achieve the same technical effects, and in order to avoid repetition, details are not repeated here.

The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read only memory ROM, a random access memory RAM, a magnetic or optical disk, and the like.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement each process of the above shooting method embodiment, and can achieve the same technical effect, and the details are not repeated here to avoid repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

Embodiments of the present application provide a computer program product, where the program product is stored in a storage medium, and the program product is executed by at least one processor to implement the processes of the foregoing shooting method embodiments, and achieve the same technical effects, and in order to avoid repetition, details are not repeated here.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a component of' 8230; \8230;" does not exclude the presence of another like element in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A shooting method is applied to a shooting device and is characterized by comprising the following steps:

receiving a first input of a user to a shooting preview interface;

responding to the first input, and acquiring at least two frames of target cache images; the exposure parameters corresponding to each target cache image in the at least two frames of target cache images are different;

2. The method of claim 1, wherein prior to the receiving a first user input to the capture preview interface, the method further comprises:

determining a first exposure parameter, a second exposure parameter and a third exposure parameter according to the light intensity information of a shooting scene; wherein the first exposure parameter, the second exposure parameter, and the third exposure parameter are different;

controlling an image sensor of the shooting device to expose based on the first exposure parameter, the second exposure parameter and the third exposure parameter respectively based on an overlapping exposure mode to respectively obtain at least one frame of first image, at least one frame of second image and at least one frame of third image;

respectively storing the at least one frame of first image, the at least one frame of second image and the at least one frame of third image to obtain a first cache image sequence, a second cache image sequence and a third cache image sequence;

3. The method of claim 2, wherein said obtaining at least two frames of the target buffer image comprises:

acquiring the at least two frames of target cache images from the first cache image sequence, the second cache image sequence and the third cache image sequence based on the gray value of a target image region in the shooting preview interface and the area ratio of the target image region in the shooting preview interface;

and the target image area is an image area corresponding to the target object.

4. The method according to claim 3, wherein the obtaining the at least two frames of target buffer images from the first buffer image sequence, the second buffer image sequence, and the third buffer image sequence based on a gray-level value of a target image region in the capture preview interface and an area ratio of the target image region in the capture preview interface comprises:

under the condition that the gray value of the target image area is 0 and the area ratio of the target image area in the shooting preview interface is greater than a first preset threshold value, acquiring the at least two frames of target cache images from the first cache image sequence and the third cache image sequence;

5. The method of claim 3, wherein the obtaining the at least two frames of target buffer images from the first buffer image sequence, the second buffer image sequence and the third buffer image sequence based on a gray-level value of a target image region in the capture preview interface and an area ratio of the target image region in the capture preview interface comprises:

6. The method of claim 1, wherein for any of the first exposure parameter, the second exposure parameter, and the third exposure parameter, the exposure parameter comprises a gain, and before the obtaining of the target image based on the at least two frames of target buffer images, the method further comprises:

7. The method according to claim 2, wherein in a case that a first target cache image in a first cache image sequence, a second target cache image in a second cache image sequence, and a third target cache image in a third cache image sequence are used as the at least two frames of target cache images, the obtaining a target image based on the at least two frames of target cache images comprises:

determining a first image region of the second target cache image and a second image region of the third target cache image, wherein a brightness value of the first image region is less than a first brightness threshold value, and a brightness value of the second image region is greater than a second brightness threshold value;

and performing image enhancement processing on the first image area and the second image area when the contrast between the brightness value of the first image area and the brightness value of the second image area is less than a preset contrast threshold.

8. A camera, characterized in that the camera comprises:

the image signal processing module is used for responding to the first input and acquiring at least two frames of target cache images; wherein, the exposure parameters corresponding to each target cache image in the at least two frames of target cache images are different; obtaining a target image based on the at least two frames of target cache images; and the at least two frames of target buffer images are images obtained by exposure according to exposure parameters in the target exposure parameter group based on an overlapping exposure mode before the first input is received.

9. The apparatus of claim 8, further comprising:

wherein a luminance value of the first image is smaller than a luminance value of the second image, and a luminance value of the first image is larger than a luminance value of the third image.

10. The apparatus of claim 9, wherein the image signal processing module comprises:

a first obtaining unit, configured to obtain the at least two frames of target cache images from the first cache image sequence, the second cache image sequence, and the third cache image sequence based on a gray-level value of a target image region in the shooting preview interface and an area ratio of the target image region in the shooting preview interface;

and the target image area is an image area corresponding to the target object.

11. The apparatus according to claim 10, wherein the first obtaining unit is specifically configured to:

12. The apparatus according to claim 10, wherein the first obtaining unit is specifically configured to:

under the condition that the gray value of the target image region is 255 and the area ratio of the target image region in the shooting preview interface is greater than a third preset threshold value, acquiring the at least two frames of target cache images from the first cache image sequence and the second cache image sequence;

13. The apparatus of claim 8, wherein for any one of the first exposure parameter, the second exposure parameter, and the third exposure parameter, the exposure parameter comprises a gain, the image signal processing module is further configured to:

14. The apparatus of claim 9, wherein in a case that the first target buffer image in the first buffer image sequence, the second target buffer image in the second buffer image sequence, and the third target buffer image in the third buffer image sequence are used as the at least two frame target buffer images, the image signal processing module is further configured to:

15. An electronic device, characterized in that it comprises a processor and a memory, said memory storing a program or instructions executable on said processor, said program or instructions, when executed by said processor, implementing the steps of the shooting method according to any one of claims 1 to 7.

16. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the photographing method according to any one of claims 1 to 7.