WO2020207258A1

WO2020207258A1 - Image processing method and apparatus, storage medium and electronic device

Info

Publication number: WO2020207258A1
Application number: PCT/CN2020/081412
Authority: WO
Inventors: 张弓
Original assignee: Oppo广东移动通信有限公司
Priority date: 2019-04-09
Filing date: 2020-03-26
Publication date: 2020-10-15
Also published as: CN109996009B; CN109996009A

Abstract

Disclosed by the embodiment of the application are an image processing method and apparatus, a storage medium, and an electronic device. The present application adopts a corresponding high dynamic range image synthesis method according to the actual state of a shooting scene to obtain a high dynamic range image of the shooting scene, which can flexibly realize the high dynamic range effect of image shooting.

Description

Image processing method, device, storage medium and electronic equipment

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201910280193.3, and the invention title is "Image processing methods, devices, storage media and electronic equipment" on April 9, 2019, the entire contents of which are incorporated by reference In this application.

Technical field

This application relates to the field of computer technology, in particular to an image processing method, device, storage medium and electronic equipment.

Background technique

Due to the hardware limitations of the electronic device itself, the current electronic device can only shoot scenes with a relatively small brightness range. If the scene is shot when the brightness of the scene is too different, the captured images are likely to lose the details of the bright and/or dark areas.

Summary of the invention

The embodiments of the present application provide an image processing method, device, storage medium, and electronic equipment, which can flexibly realize the high dynamic range effect of image shooting.

In the first aspect, an embodiment of the present application provides an image processing method applied to an electronic device, and the image processing method includes:

Detect whether there is a target object meeting preset motion conditions in the shooting scene;

If not, acquiring a plurality of first scene images of the shooting scene according to the same exposure parameter, and synthesizing the plurality of first scene images to obtain the first high dynamic range image of the shooting scene;

If so, acquire multiple second scene images of the shooting scene according to different exposure parameters, and synthesize multiple second scene images to obtain the second high dynamic range image of the shooting scene.

In a second aspect, an embodiment of the present application provides an image processing device, which is applied to electronic equipment, and the image processing device includes:

The detection module is used to detect whether there is a target object meeting preset motion conditions in the shooting scene;

The first synthesis module is configured to obtain multiple first scene images of the shooting scene according to the same exposure parameter when the target object does not exist in the shooting scene, and synthesize the multiple first scene images to obtain the The first high dynamic range image of the shooting scene;

The second synthesis module is used to obtain a plurality of second scene images of the shooting scene according to different exposure parameters when the target object exists in the shooting scene, and synthesize a plurality of the second scene images to obtain the shooting The second highest dynamic range image of the scene.

In the third aspect, an embodiment of the present application provides a storage medium on which a computer program is stored, and when the computer program runs on a computer, the computer is caused to execute:

In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, the memory stores a computer program, and the processor invokes the computer program to execute:

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a schematic flowchart of an image processing method provided by an embodiment of the present application.

FIG. 2 is a schematic diagram of a first high dynamic range image synthesized in an embodiment of the present application.

FIG. 3 is a schematic diagram of the location area of the same object in two cache images of the shooting scene in an embodiment of the present application.

Fig. 4 is a schematic diagram of a combined position area of the same object in an embodiment of the present application.

FIG. 5 is a schematic diagram of the location of the first camera and the second camera of the electronic device in an embodiment of the present application.

FIG. 6 is another schematic flowchart of the image processing method provided by the embodiment of the present application.

FIG. 7 is a schematic structural diagram of an image processing apparatus provided by an embodiment of the present application.

FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

FIG. 9 is another schematic diagram of the structure of an electronic device provided by an embodiment of the present application.

detailed description

Please refer to the drawings, in which the same component symbols represent the same components, and the principle of the present application is implemented in an appropriate computing environment for illustration. The following description is based on the exemplified specific embodiments of the present application, which should not be regarded as limiting other specific embodiments that are not described in detail herein.

The embodiment of the present application first provides an image processing method, which is applied to an electronic device. Wherein, the execution subject of the image processing method may be the image processing device provided in the embodiment of the present application, or an electronic device integrated with the image processing device. The image processing device may be implemented in hardware or software, and the electronic device may be a smart device. Mobile phones, tablet computers, handheld computers, notebook computers, or desktop computers are equipped with processors and have processing capabilities.

This application provides an image processing method, including:

In an embodiment, the detecting whether there is a target object meeting a preset motion condition in the shooting scene includes:

Acquiring two cached images of the shooting scene from a preset image cache queue;

Identifying the location area of the same object in the two cached images;

Combining the location areas of the same object in the two cache images to obtain a combined location area;

It is determined whether the proportion of the combined location area relative to the cache image reaches a preset proportion, if yes, it is determined that the same object is the target object, otherwise it is determined that the target object does not exist in the shooting scene.

In an embodiment, before the acquiring multiple first scene images of the shooting scene according to the same exposure parameter and synthesizing the multiple first scene images to obtain the first high dynamic range image of the shooting scene, the method further includes :

Identifying whether the location area of the target object in the two cache images is a salient area;

If so, acquire multiple first scene images of the shooting scene according to the same exposure parameter, and synthesize the multiple first scene images to obtain the first high dynamic range image of the shooting scene.

In an embodiment, after identifying whether the location area of the target object in the two cache images is a salient area, the method further includes:

If not, acquiring multiple second scene images of the shooting scene according to different exposure parameters, and synthesizing multiple second scene images to obtain a second high dynamic range image of the shooting scene.

In an embodiment, the acquiring multiple first scene images of the shooting scene according to the same exposure parameter includes:

Acquiring the multiple first scene images of the shooting scene through a first camera and a second camera respectively according to the same exposure parameter;

The acquiring multiple second scene images of the shooting scene according to different exposure parameters includes:

The multiple second scene images of the shooting scene are acquired through the first camera and the second camera respectively according to different exposure parameters.

In an embodiment, the image processing method further includes:

The first high dynamic range image or the second high dynamic range image is displayed as a preview image of the shooting scene.

In an embodiment, the image processing method further includes:

Before synthesizing the first high dynamic range image, performing down-sampling processing on a plurality of the first scene images according to the current resolution of the screen;

Alternatively, before the second high dynamic range image is synthesized, the multiple second scene images are down-sampled according to the current resolution of the screen.

Exposing the shooting scene according to a preset short exposure duration to obtain multiple images of the first scene.

In an embodiment, the acquiring multiple second scene images of the shooting scene according to different exposure parameters includes:

The shooting scene is respectively exposed according to the preset overexposure value and the preset underexposure value to obtain two second scene images.

Please refer to FIG. 1, which is a schematic flowchart of an image processing method provided by an embodiment of this application. The image processing method is applied to the electronic device provided in the embodiment of the application. As shown in FIG. 1, the flow of the image processing method provided in the embodiment of the application may be as follows:

In 101, detect whether there is a target object that meets the preset motion conditions in the shooting scene, if yes, go to 103, otherwise go to 102.

Among them, after the electronic device starts a shooting application (for example, the system application "camera" of the electronic device) according to a user operation, the scene to which the camera is aimed is the shooting scene. For example, after the user clicks on the icon of the “camera” application on the electronic device to start the “camera application”, if the user uses the camera of the electronic device to aim at a scene including XX objects, the scene including XX objects is the shooting scene. Based on the above description, those skilled in the art should understand that the shooting scene does not specifically refer to a specific scene, but a scene that is aligned in real time following the direction of the camera.

In the embodiment of the present application, the electronic device first detects whether there is a target object that meets a preset motion condition in the shooting scene, so as to synthesize a high dynamic range image of the shooting scene by using a suitable high dynamic range synthesis technique according to the detection result.

Among them, the method of detecting whether there is a target object in the shooting scene is not specifically limited in the embodiment of this application, and a person of ordinary skill in the art can select a suitable detection method according to actual needs. For example, optical flow method, Residual error method, etc.

It should be noted that an image cache queue is also preset in the electronic device, and the image cache queue may be a fixed-length queue or a variable-length queue. For example, the image cache queue is a fixed-length queue and can cache 8 images. After enabling the camera, the electronic device caches the images collected by the camera in real time into the image cache queue.

Taking the residual method as an example, when the electronic device detects whether there is a target object that meets the preset motion conditions in the shooting scene, it can first obtain two temporally adjacent shooting scenes from its preset image buffer queue. Cache images, denote them as the first cache image and the second cache image. Then, the electronic device subtracts the first buffer image and the second buffer image to obtain residual images of the first buffer image and the second buffer image. Then, the electronic device determines the brightness value of each pixel in the residual image, and determines the proportion of pixels with non-zero brightness in all the pixels. Finally, the electronic device determines whether the ratio of pixels with non-zero brightness to all pixels is less than a preset ratio value (a person of ordinary skill in the art can take an empirical value according to actual needs. For example, the preset ratio value can be configured as 25 %), it is determined that the aforementioned target object exists in the shooting scene.

In addition, it should also be noted that two high dynamic range synthesis methods are provided in the embodiments of this application. After detecting whether there is a target object that meets the preset motion conditions in the shooting scene, the electronic device selects a high dynamic range according to the detection result. Dynamic range synthesis method to synthesize a high dynamic range image of the shooting scene. Among them, if the target object is detected in the shooting scene, then go to 102, select a high dynamic range synthesis method to synthesize the high dynamic range image of the shooting scene; if it is detected that there is no target object in the shooting scene, then go to 103. Select another high dynamic range synthesis method to synthesize a high dynamic range image of the shooting scene.

In 102, a plurality of first scene images of a shooting scene are acquired according to the same exposure parameter, and the plurality of first scene images are synthesized to obtain a first high dynamic range image of the shooting scene.

Wherein, the exposure parameter includes exposure value (commonly known as EV value) or exposure duration. When the electronic device acquires multiple first scene images of the shooting scene according to the same exposure parameter, it can acquire multiple shooting scenes according to the preset short exposure duration. The first scene image. For example, the electronic device controls the camera to perform multiple exposures on the shooting scene according to a preset short exposure time of 1 millisecond, thereby obtaining multiple first scene images of the shooting scene. In other words, the acquired multiple first scene images are Multiple short exposure images of the shooting scene.

In the embodiment of the present application, after acquiring the multiple first scene images of the shooting scene, the electronic device further synthesizes the multiple first scene images in a multi-frame short exposure manner to obtain the first high dynamic range image of the shooting scene.

Wherein, when the electronic device synthesizes the multiple first scene images to obtain the first high dynamic range image of the shooting scene, it first performs multi-frame noise reduction synthesis on the multiple first scene images to obtain a noise reduction composite image. It can be understood that since the first scene image is a short exposure image, it will retain more features of the brighter area in the shooting scene. Similarly, the noise-reduction composite image obtained by performing multi-frame noise reduction synthesis on multiple first scene images also retains more features of the brighter area in the shooting scene. At this time, the electronic device further improves the brightness of the noise-reduction synthesized image, so that the characteristics of the brighter area and the darker area in the shooting scene can be simultaneously presented, and the high dynamic range image of the shooting scene is obtained, which is recorded as the first high dynamic range image .

For example, suppose that the electronic device acquires a total of 4 first scene images of the shooting scene, which are the first scene image A, the first scene image B, the first scene image C, and the first scene image D, respectively.

Referring to FIG. 2, the electronic device first selects one of the first scene image A, the first scene image B, the first scene image C, and the first scene image D as the reference image, assuming that the first scene image A is selected as the reference image , The electronic device aligns the first scene image B, the first scene image C, and the first scene image D with the first scene image A, and then calculates the average pixel value of each pixel based on the aligned images (for example, Assuming that the pixel values of a pixel at a certain position in the four first scene images are: "0.8, 0.9, 1.1, 1.2", the average pixel value of the pixel at this position can be calculated as "1"). After that, the noise-reduction composite image is obtained according to the average pixel value of each position. Among them, the pixel value of each pixel of the reference image (that is, the first scene image A) can be adjusted to the calculated average pixel value to obtain the noise reduction composite image, and the average pixel value can also be calculated according to the calculation to generate A new image, using the generated image as a noise reduction composite image. For the noise reduction composite image, the electronic device further enhances its brightness to obtain the first high dynamic range image of the shooting scene.

In 103, multiple second scene images of the shooting scene are acquired according to different exposure parameters, and the multiple second scene images are synthesized to obtain the second high dynamic range image of the shooting scene.

Among them, as an optional implementation manner, when acquiring multiple second scene images of the shooting scene according to different exposure parameters, the electronic device may acquire the multiple images of the shooting scene in a manner that the preset short exposure duration and the long exposure duration overlap. A second scene image. In other words, among two adjacently exposed second scene images, one second scene image is a short exposure image, and the other second scene image is a long exposure image. In this way, the second high dynamic range image of the shooting scene can be synthesized by combining long and short exposures.

For example, the electronic device acquires a second scene image with a short exposure time and a second scene image with a long exposure time. Because the second scene image with a short exposure time retains the characteristics of the brighter area in the shooting scene, the long exposure time The second scene image retains the characteristics of the darker area in the shooting scene, so when compositing, the features of the darker area in the shooting scene retained by the second scene image with long exposure time and the second scene image with short exposure time can be used The retained features of the brighter area in the shooting scene are synthesized to obtain the second high dynamic range image of the shooting scene.

As another optional implementation manner, after acquiring multiple second scene images of the shooting scene according to different exposure parameters, the electronic device may acquire multiple second scene images of the shooting scene according to different exposure values, where the electronic The device can respectively expose the shooting scene according to the preset overexposure value and the preset underexposure value to obtain two second scene images of the shooting scene. It can also according to the preset overexposure value, preset normal exposure value and preset underexposure value. The exposure values respectively expose the shooting scene to obtain three second scene images of the shooting scene and so on.

For example, the electronic device can control the camera to expose the shooting scene according to the preset normal exposure value EV0, the preset underexposure value EV-2, and the preset overexposure value EV2, thereby obtaining three second scene images of the shooting scene. They are respectively a normal exposure image, an overexposed image, and an underexposed image, so that the second high dynamic range image of the shooting scene is synthesized through the bracketing synthesis method.

It can be seen from the above that, in the embodiment of the present application, the electronic device can detect whether there is a target object that meets the preset motion condition in the shooting scene; if not, it acquires multiple first scene images of the shooting scene according to the same exposure parameter, and synthesizes multiple images. One first scene image to obtain the first high dynamic range image of the shooting scene; if so, multiple second scene images of the shooting scene are obtained according to different exposure parameters, and multiple second scene images are synthesized to obtain the second high dynamic range image of the shooting scene image. The high dynamic range image of the shooting scene is synthesized through the corresponding high dynamic range image synthesis method adopted according to the actual state of the shooting scene, which can flexibly realize the high dynamic range effect of image shooting.

In an embodiment, "detecting whether there is a target object meeting a preset motion condition in the shooting scene" includes:

(1) Obtain two cached images of the shooting scene from the preset image cache queue;

(2) Identify the location area of the same object in two cached images;

(3) Combine the location areas of the same object in the two cache images to obtain a combined location area;

(4) Determine whether the proportion of the combined location area relative to any cached image reaches the preset proportion, if yes, determine the same object as the target object, otherwise determine that there is no target object in the shooting scene.

In the embodiment of the present application, when the electronic device detects whether there is a target object meeting preset motion conditions in the shooting scene, it first obtains two temporally adjacent cached images of the shooting scene from its preset image buffer queue , Mark it as the third cache image and the fourth cache image. Then, the electronic device uses semantic segmentation technology to perform semantic segmentation on the third cached image and the fourth cached image respectively, thereby determining the objects existing in the third cached image and the fourth cached image and their corresponding location regions. Then, the electronic device recognizes the location area of the same object in the third cache image and the fourth cache image according to the semantic segmentation results of the third cache image and the fourth cache image. For example, refer to Figure 3, the object A is in the first cache image. The location area in the fourth buffer image moves a certain distance to the right compared to its location area in the third buffer image. Then, the electronic device merges the position areas of the same object in the third cache image and the fourth cache image to obtain a merged position area, as shown in FIG. 4. Finally, the electronic device determines whether the proportion of the combined location area with respect to the third or fourth cached image reaches the preset proportion, and if yes, it determines that the aforementioned same object is a target object that meets the preset conditions; otherwise, it determines that there is no There is a target object.

It should be noted that the size of the aforementioned preset proportion depends on the proportion of the aforementioned same object relative to the third buffer image (or fourth buffer image), which can be expressed as:

P=p+kp;

Among them, P represents the preset proportion, p represents the proportion of the aforementioned same object relative to the third cache image (or fourth cache image), and k represents the revision coefficient, which can be selected by those of ordinary skill in the art according to actual needs, such as When the value of k is 0.25, P=1.25p. In layman's terms, when the displacement of an object in the shooting scene reaches 1/4 of its occupied position area, the electronic device determines the object as the target object. It is a moving object, and when the displacement of no object in the shooting scene reaches 1/4 of its occupied position area, the electronic device will determine that there is no target object in the shooting scene, that is, there is no moving object.

In an embodiment, before “acquiring multiple first scene images of the shooting scene according to the same exposure parameter, and synthesizing the multiple first scene images to obtain the first high dynamic range image of the shooting scene”, it further includes:

(1) Identify whether the location area of the aforementioned target object in the two cached images is a salient area;

(2) If yes, acquire multiple first scene images of the shooting scene according to the same exposure parameter, and synthesize the multiple first scene images to obtain the first high dynamic range image of the shooting scene.

It should be noted that the salient area of the scene is the area that is easier for users to notice. For example, it is generally believed that people and animals are more salient than the sky, grass, and buildings. Generally, people are more willing to take a prominent area in the shooting scene as the subject for shooting. Therefore, when the proportion of the merged location area corresponding to the same object to any cached image reaches the preset proportion, that is, when the same object is a moving object in the shooting scene, the electronic device further recognizes that the moving object is in the first Whether the location area in the third buffer image or the fourth buffer image is a salient area. For example, a person of ordinary skill in the art can pre-configure the salient area identification method used by the electronic device according to actual needs, so that the electronic device can identify salient areas in the third cached image and the fourth cached image according to the pre-configured salient area identification method. And it is determined whether the location area of the aforementioned moving object in the third cache image is a salient area, and whether the location area of the aforementioned moving object in the fourth cache image is a salient area.

Among them, if it is recognized that the location area of the aforementioned moving object in the third cache image and the fourth cache image is a salient area, multiple first scene images of the shooting scene are acquired according to the same exposure parameter, and multiple first scene images are synthesized to obtain The first high dynamic range image of the shooting scene is taken to avoid ghost images in the first high dynamic range image.

In an embodiment, after "identifying whether the location area of the aforementioned target object in the two cached images is a salient area", it further includes:

If not, acquire multiple second scene images of the shooting scene according to different exposure parameters, and synthesize the multiple second scene images to obtain the second high dynamic range image of the shooting scene.

Wherein, when it is recognized that the location area of the aforementioned target object in the two cached images is not a salient area, that is, the moving object in the shooting scene is not the subject of the shooting, the electronic device acquires multiple second images of the shooting scene according to different exposure parameters. Scene image, and synthesize multiple second scene images to obtain a second high dynamic range image of the shooting scene. In this way, even if there are ghosts in the synthesized second high dynamic range image (corresponding to the aforementioned target object, that is, the moving object in the shooting scene), it will have less impact on the overall image effect, but a better high dynamic range effect can be obtained .

In an embodiment, "acquiring multiple first scene images of the shooting scene according to the same exposure parameter" includes:

Acquiring multiple first scene images of the shooting scene through the first camera and the second camera respectively according to the same exposure parameter;

"Acquiring multiple second scene images of the shooting scene according to different exposure parameters" includes:

Referring to FIG. 5, in the embodiment of the present application, a first camera and a second camera are provided on the same side of the electronic device.

On the one hand, when the electronic device acquires multiple first scene images of the shooting scene according to the same exposure parameter, it can acquire multiple first scene images of the shooting scene through the first camera and the second camera respectively according to the same exposure parameter. Therefore, the acquisition efficiency of the first scene image is improved, and the synthesis efficiency of the first high dynamic range image is improved. For example, the electronic device simultaneously uses the first camera and the second camera to expose the shooting scene according to the short exposure time, and two first scene images of the shooting scene can be acquired with one exposure operation.

On the other hand, when the electronic device acquires multiple second scene images of the shooting scene according to different exposure parameters, it can provide the first camera and the second camera to acquire multiple second scene images of the shooting scene according to different exposure parameters, respectively. Thereby, the acquisition efficiency of the second scene image is improved, so that the synthesis efficiency of the second high dynamic range image is improved. For example, the electronic device exposes the shooting scene according to the short exposure time through the first camera, and exposes the shooting scene according to the long exposure time through the second camera. Two second scene images of the shooting scene can be obtained with one exposure operation. , Respectively, short exposure image and long exposure image.

In an embodiment, the image processing method provided in this application further includes:

In the embodiment of the present application, after the electronic device synthesizes the first high dynamic range image, it displays the synthesized first high dynamic range image as a preview image of the shooting scene, or after synthesizing the second high dynamic range image , The second high dynamic range image obtained by synthesis is displayed as a preview image of the shooting scene.

By displaying the first high dynamic range image or the second high dynamic range image as the preview image of the shooting scene, the user can view the high dynamic range effect of the image obtained by taking a picture of the shooting scene in advance, and help the user better Take pictures.

Perform video encoding according to the first high dynamic range image or the second high dynamic range image to obtain a video of the shooting scene.

The electronic device may also perform video encoding according to the first high dynamic range image or the second high dynamic range image to obtain a video of the shooting scene, that is, when the shooting scene is recorded, the video obtained by the recording also has a high dynamic range effect.

It should be noted that there are no specific restrictions on which video coding format is used for video coding in the embodiments of this application, and a person of ordinary skill in the art can select a suitable video coding format according to actual needs, including but not limited to H.264, H.265, MPEG-4, etc.

Before synthesizing the first high dynamic range image, perform down-sampling processing on the multiple first scene images according to the current resolution of the screen;

Those of ordinary skill in the art should understand that the actual resolution of the preview image is greater than the resolution displayed on the screen, and a better display effect will not be obtained compared to the case where the actual resolution of the preview image is equal to the screen display resolution.

Therefore, before synthesizing the first high dynamic range image, the electronic device first obtains the current resolution of the screen, and then down-sampling the multiple first scene images according to the current resolution of the screen, so that the multiple first scene images The resolution of is consistent with the current resolution of the screen, so that the resolution of the synthesized first high dynamic range image is consistent with the current resolution of the screen. In this way, the synthesis efficiency of the first high dynamic range image can be improved, and the display effect of the first high dynamic range image is not reduced when the first high dynamic range image is displayed as a preview image.

On the other hand, before the electronic device synthesizes the second high dynamic range image, it first obtains the current resolution of the screen, and then down-sampling the multiple second scene images according to the current resolution of the screen, so that multiple second The resolution of the scene image is consistent with the current resolution of the screen, so that the resolution of the synthesized second high dynamic range image is consistent with the current resolution of the screen. In this way, the synthesis efficiency of the second high dynamic range image can be improved, and when the second high dynamic range image is displayed as a preview image, its display effect will not be reduced.

Please refer to FIG. 6. FIG. 6 is a schematic diagram of another flow of an image processing method provided by an embodiment of the application. The flow of the image processing method may include:

In 201, the electronic device obtains two cached images of the shooting scene from a preset image cache queue.

It should be noted that an image cache queue is preset in the electronic device, and the image cache queue may be a fixed-length queue or a variable-length queue. For example, the image cache queue is a fixed-length queue and can cache 8 images. After enabling the camera, the electronic device caches the images collected by the camera in real time into the image cache queue.

Wherein, the electronic device first obtains two temporally adjacent cached images of the shooting scene from its preset image cache queue, and records them as the third cached image and the fourth cached image.

In 202, the electronic device recognizes the location area of the same object in the two cached images.

The electronic device uses semantic segmentation technology to perform semantic segmentation on the third cache image and the fourth cache image respectively, so as to determine the objects existing in the third cache image and the fourth cache image and their corresponding location regions. After that, the electronic device recognizes the location area of the same object in the third cache image and the fourth cache image according to the semantic segmentation results of the third cache image and the fourth cache image. For example, refer to FIG. 3, the object A is in the first cache image. The location area in the fourth buffer image moves a certain distance to the right compared to its location area in the third buffer image.

In 203, the electronic device merges the position areas of the aforementioned same object in the two cache images to obtain a merged position area.

Wherein, the electronic device merges the position areas of the same object in the third cache image and the fourth cache image to obtain a merged position area, as shown in FIG. 4.

In 204, the electronic device judges whether the aforementioned same object is a target object that meets a preset condition according to the proportion of the merged location area relative to any cached image, if yes, go to 206, otherwise go to 205.

For example, the electronic device judges whether the proportion of the combined location area relative to the third or fourth buffer image reaches the preset proportion, and if yes, it judges that the aforementioned same object is a target object that meets the preset condition, otherwise it judges that there is no There is a target object.

P=p+kp;

In 205, the electronic device acquires multiple first scene images of the shooting scene according to the same exposure parameter, and synthesizes the multiple first scene images to obtain the first high dynamic range image of the shooting scene.

Wherein, the exposure parameter includes exposure value (commonly known as EV value) or exposure duration. When the electronic device acquires multiple first scene images of the shooting scene according to the same exposure parameter, it can acquire multiple shooting scenes according to the preset short exposure duration. The first scene image. For example, the electronic device controls the camera to perform multiple exposures on the shooting scene according to a preset short exposure time, thereby obtaining multiple first scene images of the shooting scene. In other words, the acquired multiple first scene images are the shooting scene Of multiple short exposure images.

In the embodiment of the present application, after acquiring the multiple first scene images of the shooting scene, the electronic device further synthesizes the multiple first scene images by means of multi-frame short exposure to obtain the first high dynamic range image of the shooting scene.

In 206, the electronic device acquires multiple second scene images of the shooting scene according to different exposure parameters, and synthesizes the multiple second scene images to obtain the second high dynamic range image of the shooting scene.

As another optional implementation manner, in acquiring multiple second scene images of the shooting scene according to different exposure parameters, the electronic device can respectively expose the shooting scene according to a preset overexposure value and a preset underexposure value. , To obtain two second scene images of the shooting scene, and to respectively expose the shooting scene according to the preset overexposure value, preset normal exposure value and preset underexposure value to obtain three second scene images of the shooting scene, etc. .

In 207, the electronic device displays the first high dynamic range image or the second high dynamic range image as a preview image of the shooting scene.

The embodiment of the present application also provides an image processing device. Please refer to FIG. 7, which is a schematic structural diagram of an image processing apparatus provided by an embodiment of the application. The image processing device is applied to electronic equipment, and the image processing device includes a detection module 501, a first synthesis module 502, and a second synthesis module 503, as follows:

The detection module 501 is configured to detect whether there is a target object meeting preset motion conditions in the shooting scene;

The first synthesis module 502 is configured to obtain multiple first scene images of the shooting scene according to the same exposure parameter when the shooting scene is not in a static state, and synthesize the multiple first scene images to obtain the first high dynamic range image of the shooting scene;

The second synthesis module 503 is configured to obtain multiple second scene images of the shooting scene according to different exposure parameters when the shooting scene is in a static state, and synthesize the multiple second scene images to obtain the second high dynamic range image of the shooting scene.

In an embodiment, when detecting whether there is a target object meeting preset motion conditions in the shooting scene, the detection module 501 may be used to:

Obtain two cached images of the shooting scene from the preset image cache queue;

Identify the location area of the same object in two cached images;

Combine the location areas of the same object in the two cached images to obtain a combined location area;

It is determined whether the proportion of the combined location area relative to any cached image reaches the preset proportion, if yes, it is determined that the aforementioned same object is the target object, otherwise it is determined that there is no target object in the shooting scene.

In an embodiment, before acquiring multiple first scene images of the shooting scene according to the same exposure parameter and synthesizing the multiple first scene images to obtain the first high dynamic range image of the shooting scene, the first synthesis module 502 may also be used for :

Identify whether the location area of the aforementioned target object in the two cached images is a salient area;

If so, multiple first scene images of the shooting scene are acquired according to the same exposure parameter, and the multiple first scene images are synthesized to obtain the first high dynamic range image of the shooting scene.

In one embodiment, after the first synthesis module 502 recognizes whether the location area of the aforementioned target object in the two cached images is a salient area, the second synthesis module 503 is further configured to recognize that the aforementioned same object is in the first synthesis module 502 After whether the location area in the two cached images is a salient area, if the recognition result of the first synthesis module 502 is no, acquire multiple second scene images of the shooting scene according to different exposure parameters, and synthesize multiple second scene images to obtain The second highest dynamic range image of the shooting scene.

In an embodiment, when acquiring multiple first scene images of the shooting scene according to the same exposure parameter, the first synthesis module 502 may be used to:

When acquiring multiple second scene images of the shooting scene according to different exposure parameters, the second synthesis module 503 may be used to:

In an embodiment, the image processing device further includes a preview module for:

In an embodiment, the first synthesis module 502 is further configured to perform down-sampling processing on multiple first scene images according to the current resolution of the screen before the first high dynamic range image is synthesized;

Alternatively, the second synthesis module 503 is further configured to perform down-sampling processing on multiple second scene images according to the current resolution of the screen before the second high dynamic range image is synthesized.

Expose the shooting scene according to a preset short exposure time length to obtain multiple first scene images.

In an embodiment, when acquiring multiple second scene images of the shooting scene according to different exposure parameters, the second synthesis module 503 may be used to:

It should be noted that the image processing device provided in the embodiment of the application belongs to the same concept as the image processing method in the above embodiment, and any method provided in the image processing method embodiment can be run on the image processing device, and its specific implementation For details of the process, refer to the embodiment of the image processing method, which will not be repeated here.

The embodiments of the present application provide a computer-readable storage medium on which a computer program is stored. When the stored computer program is executed on a computer, the computer is caused to execute the steps in the image processing method provided in the embodiment of the present application. Among them, the storage medium may be a magnetic disk, an optical disc, a read only memory (Read Only Memory, ROM,) or a random access device (Random Access Memory, RAM), etc.

An embodiment of the present application also provides an electronic device. Please refer to FIG. 8. The electronic device includes a processor 701 and a memory 702. The processor 701 is electrically connected to the memory 702.

The processor 701 is the control center of the electronic device. It uses various interfaces and lines to connect the various parts of the entire electronic device. It executes the electronic device by running or loading the computer program stored in the memory 702 and calling the data stored in the memory 702. Various functions and process data.

The memory 702 may be used to store software programs and modules. The processor 701 executes various functional applications and data processing by running the computer programs and modules stored in the memory 702. The memory 702 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, a computer program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of electronic equipment, etc. In addition, the memory 702 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices. Correspondingly, the memory 702 may further include a memory controller to provide the processor 701 with access to the memory 702.

In the embodiment of the present application, the processor 701 in the electronic device will load the instructions corresponding to the process of one or more computer programs into the memory 702 according to the following steps, and run the instructions by the processor 701 and store them in the memory 702 The computer program to achieve various functions, as follows:

If not, acquiring multiple first scene images of the shooting scene according to the same exposure parameter, and synthesizing the multiple first scene images to obtain the first high dynamic range image of the shooting scene;

If so, multiple second scene images of the shooting scene are acquired according to different exposure parameters, and the multiple second scene images are synthesized to obtain the second high dynamic range image of the shooting scene.

Please refer to FIG. 9. FIG. 9 is another schematic structural diagram of an electronic device provided by an embodiment of the application. The difference from the electronic device shown in FIG. 8 is that the electronic device further includes components such as an input unit 703 and an output unit 704.

The input unit 703 can be used to receive input numbers, character information, or user characteristic information (such as fingerprints), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

The output unit 704 may be used to display information input by the user or information provided to the user, such as a screen.

If so, acquire multiple second scene images of the shooting scene according to different exposure parameters, and synthesize the multiple second scene images to obtain the second high dynamic range image of the shooting scene.

In an embodiment, when detecting whether there is a target object meeting a preset motion condition in the shooting scene, the processor 701 may execute:

Identify the location area of the same object in two cached images;

In an embodiment, before acquiring multiple first scene images of the shooting scene according to the same exposure parameter, and synthesizing the multiple first scene images to obtain the first high dynamic range image of the shooting scene, the processor 701 may execute:

In an embodiment, after identifying whether the location area of the aforementioned target object in the two cached images is a salient area, the processor 701 may further execute:

In an embodiment, when acquiring multiple first scene images of the shooting scene according to the same exposure parameter, the processor 701 may execute:

When acquiring multiple second scene images of the shooting scene according to different exposure parameters, the processor 701 may execute:

In an embodiment, the processor 701 may also execute:

In an embodiment, when acquiring multiple second scene images of the shooting scene according to different exposure parameters, the processor 701 may execute:

It should be noted that the electronic device provided in this embodiment of the application belongs to the same concept as the image processing method in the above embodiment. Any method provided in the image processing method embodiment can be run on the electronic device. The specific implementation process is detailed. See the embodiment of the feature extraction method, which will not be repeated here.

It should be noted that for the image processing method of the embodiment of the present application, ordinary testers in the field can understand that all or part of the process of implementing the image processing method of the embodiment of the present application can be completed by controlling the relevant hardware through a computer program. The computer program may be stored in a computer readable storage medium, such as stored in the memory of an electronic device, and executed by at least one processor in the electronic device. The execution process may include such as image processing methods. The flow of the embodiment. Wherein, the storage medium can be a magnetic disk, an optical disk, a read-only memory, a random access memory, and the like.

For the image processing device of the embodiment of the present application, its functional modules may be integrated into one processing chip, or each module may exist alone physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium, such as a read-only memory, a magnetic disk or an optical disk, etc. .

The above describes in detail an image processing method, device, storage medium, and electronic equipment provided by the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementations of the present application. The description of the above embodiments is only It is used to help understand the methods and core ideas of this application; at the same time, for those skilled in the art, according to the ideas of this application, there will be changes in the specific implementation and the scope of application. In summary, this specification The content should not be construed as a limitation on this application.

Claims

An image processing method applied to electronic equipment, wherein the image processing method includes:

Detect whether there is a target object meeting preset motion conditions in the shooting scene;

If not, acquiring a plurality of first scene images of the shooting scene according to the same exposure parameter, and synthesizing the plurality of first scene images to obtain the first high dynamic range image of the shooting scene;

If so, acquire multiple second scene images of the shooting scene according to different exposure parameters, and synthesize multiple second scene images to obtain the second high dynamic range image of the shooting scene.
The image processing method according to claim 1, wherein said detecting whether there is a target object meeting a preset motion condition in the shooting scene comprises:

Acquiring two cached images of the shooting scene from a preset image cache queue;

Identifying the location area of the same object in the two cached images;

Combining the location areas of the same object in the two cache images to obtain a combined location area;

It is determined whether the proportion of the combined location area relative to the cache image reaches a preset proportion, if yes, it is determined that the same object is the target object, otherwise it is determined that the target object does not exist in the shooting scene.
The image processing method according to claim 2, wherein said acquiring a plurality of first scene images of said shooting scene according to the same exposure parameter, and synthesizing a plurality of said first scene images to obtain the first height of said shooting scene Before the dynamic range image, it also includes:

Identifying whether the location area of the target object in the two cache images is a salient area;

If so, acquire multiple first scene images of the shooting scene according to the same exposure parameter, and synthesize the multiple first scene images to obtain the first high dynamic range image of the shooting scene.
3. The image processing method according to claim 3, wherein after identifying whether the location area of the target object in the two buffered images is a salient area, the method further comprises:

If not, acquiring multiple second scene images of the shooting scene according to different exposure parameters, and synthesizing multiple second scene images to obtain a second high dynamic range image of the shooting scene.
The image processing method according to claim 1, wherein said acquiring a plurality of first scene images of the shooting scene according to the same exposure parameter comprises:

Acquiring the multiple first scene images of the shooting scene through a first camera and a second camera respectively according to the same exposure parameter;

The acquiring multiple second scene images of the shooting scene according to different exposure parameters includes:

The multiple second scene images of the shooting scene are acquired through the first camera and the second camera respectively according to different exposure parameters.
The image processing method according to claim 1, wherein the image processing method further comprises:

The first high dynamic range image or the second high dynamic range image is displayed as a preview image of the shooting scene.
The image processing method according to claim 6, wherein the image processing method further comprises:

Before synthesizing the first high dynamic range image, performing down-sampling processing on a plurality of the first scene images according to the current resolution of the screen;

Alternatively, before the second high dynamic range image is synthesized, the multiple second scene images are down-sampled according to the current resolution of the screen.
The image processing method according to claim 1, wherein said acquiring a plurality of first scene images of the shooting scene according to the same exposure parameter comprises:

Exposing the shooting scene according to a preset short exposure duration to obtain multiple images of the first scene.
The image processing method according to claim 1, wherein said acquiring a plurality of second scene images of the shooting scene according to different exposure parameters comprises:

The shooting scene is respectively exposed according to the preset overexposure value and the preset underexposure value to obtain two second scene images.
An image processing device applied to electronic equipment, wherein the image processing device includes:

The detection module is used to detect whether there is a target object meeting preset motion conditions in the shooting scene;

The first synthesis module is configured to obtain multiple first scene images of the shooting scene according to the same exposure parameter when the target object does not exist in the shooting scene, and synthesize the multiple first scene images to obtain the The first high dynamic range image of the shooting scene;

The second synthesis module is used to obtain a plurality of second scene images of the shooting scene according to different exposure parameters when the target object exists in the shooting scene, and synthesize a plurality of the second scene images to obtain the shooting The second highest dynamic range image of the scene.
A storage medium having a computer program stored thereon, wherein when the computer program runs on a computer, the computer is caused to execute the steps in the image processing method according to any one of claims 1 to 9.
An electronic device includes a processor and a memory, and the memory stores a computer program, wherein the processor is configured to execute:

Detect whether there is a target object meeting preset motion conditions in the shooting scene;

If not, acquiring a plurality of first scene images of the shooting scene according to the same exposure parameter, and synthesizing the plurality of first scene images to obtain the first high dynamic range image of the shooting scene;

If so, acquire multiple second scene images of the shooting scene according to different exposure parameters, and synthesize multiple second scene images to obtain the second high dynamic range image of the shooting scene.
The electronic device according to claim 12, wherein, when detecting whether there is a target object meeting a preset motion condition in the shooting scene, the processor is configured to execute:

Acquiring two cached images of the shooting scene from a preset image cache queue;

Identifying the location area of the same object in the two cached images;

Combining the location areas of the same object in the two cache images to obtain a combined location area;

It is determined whether the proportion of the combined location area relative to the cache image reaches a preset proportion, if yes, it is determined that the same object is the target object, otherwise it is determined that the target object does not exist in the shooting scene.
The electronic device according to claim 13, wherein in acquiring a plurality of first scene images of the shooting scene according to the same exposure parameter, combining a plurality of the first scene images to obtain the first high dynamic range of the shooting scene Before the image, the processor is also used to execute:

Identifying whether the location area of the target object in the two cache images is a salient area;

If so, acquire multiple first scene images of the shooting scene according to the same exposure parameter, and synthesize the multiple first scene images to obtain the first high dynamic range image of the shooting scene.
The electronic device according to claim 14, wherein after identifying whether the location area of the target object in the two cache images is a salient area, the processor is further configured to execute:

If not, acquiring multiple second scene images of the shooting scene according to different exposure parameters, and synthesizing multiple second scene images to obtain a second high dynamic range image of the shooting scene.
The electronic device according to claim 12, wherein, when acquiring multiple first scene images of the shooting scene according to the same exposure parameter, the processor is configured to execute:

Acquiring the multiple first scene images of the shooting scene through a first camera and a second camera respectively according to the same exposure parameter;

The acquiring multiple second scene images of the shooting scene according to different exposure parameters includes:

The multiple second scene images of the shooting scene are acquired through the first camera and the second camera respectively according to different exposure parameters.
The electronic device according to claim 12, wherein the processor is further configured to execute:

The first high dynamic range image or the second high dynamic range image is displayed as a preview image of the shooting scene.
The electronic device according to claim 17, wherein the processor is further configured to execute:

Before synthesizing the first high dynamic range image, performing down-sampling processing on a plurality of the first scene images according to the current resolution of the screen;

Alternatively, before the second high dynamic range image is synthesized, the multiple second scene images are down-sampled according to the current resolution of the screen.
The electronic device according to claim 12, wherein, when acquiring multiple first scene images of the shooting scene according to the same exposure parameter, the processor is configured to execute:

Exposing the shooting scene according to a preset short exposure duration to obtain multiple images of the first scene.
The electronic device according to claim 12, wherein, when acquiring multiple second scene images of the shooting scene according to different exposure parameters, the processor is configured to execute:

The shooting scene is respectively exposed according to the preset overexposure value and the preset underexposure value to obtain two second scene images.