CN109993722B - Image processing method, image processing device, storage medium and electronic equipment - Google Patents

Abstract

The present application discloses an image processing method, comprising: acquiring a RAW image package, the RAW image package includes at least two frames of RAW images, the at least two frames of RAW images are images acquired in a target scene and have different exposure times; The RAW image package is unpacked to obtain at least two frames of RAW images; at least two frames of RAW images are synthesized to obtain a RAW composite image with a high dynamic range; the operating parameter value of the electronic device is obtained, and the operating parameter value is used to represent the electronic device. The computing power of the device; according to the operating parameter value, it is determined that the RAW composite image is stored in the preset image buffer queue in the target scene, or the RAW composite image is converted into a YUV composite image and then stored in the preset image cache queue; when When a photographing instruction is received, obtain a multi-frame historical cache image of the target scene from the preset image cache queue, and perform multi-frame noise reduction processing on the multi-frame historical cache image to obtain a noise-reduced image; according to the noise-reduced image, respond to the Take pictures command.

Description

Image processing method, device, storage medium and electronic equipment

technical field

The present application belongs to the field of image technology, and in particular relates to an image processing method, device, storage medium and electronic equipment.

Background technique

Due to the hardware limitation of the electronic device itself, the current electronic device can only shoot scenes with a relatively small brightness range. If the scene is shot when the difference between light and dark is too large, the captured image will easily lose details in bright and/or dark places. That is, the imaging effect of the image processed by the electronic device is poor.

Contents of the invention

Embodiments of the present application provide an image processing method, device, storage medium, and electronic equipment, which can improve the imaging effect of an image.

An embodiment of the present application provides an image processing method, including:

Acquire a RAW image package, the RAW image package includes at least two frames of RAW images, the at least two frames of RAW images are images acquired in the target scene and have different exposure times;

Unpacking the RAW image packet to obtain the at least two frames of RAW image;

Synthesizing the at least two frames of RAW images to obtain a RAW composite image with a high dynamic range;

Acquiring an operating parameter value of the electronic device, where the operating parameter value is used to represent the computing capability of the electronic device;

According to the operating parameter value, it is determined to store the RAW composite image in the preset image buffer queue in the target scene, or convert the RAW composite image into a YUV composite image and store it in the preset image cache queue;

When a photographing instruction is received, acquire a multi-frame historical buffer image of the target scene from the preset image buffer queue, and perform multi-frame noise reduction processing on the multi-frame historical buffer image to obtain a noise-reduced image;

Responding to the photographing instruction according to the noise-reduced image.

An embodiment of the present application provides an image processing device, including:

The first acquisition module is configured to acquire a RAW image package, the RAW image package includes at least two frames of RAW images, and the at least two frames of RAW images are images acquired in a target scene and have different exposure times;

An unpacking module, configured to unpack the RAW image packets to obtain the at least two frames of RAW images;

A synthesis module, configured to perform synthesis processing on the at least two frames of RAW images to obtain a RAW synthesis image with a high dynamic range;

The second acquisition module is used to acquire the operating parameter value of the electronic device, and the operating parameter value is used to represent the computing capability of the electronic device;

A cache module, configured to determine, according to the operating parameter value, whether to store the RAW composite image in the preset image cache queue in the target scene, or convert the RAW composite image into a YUV composite image and store it in the preset image cache queue. Set the image cache queue;

A processing module, configured to obtain a multi-frame historical buffer image of the target scene from the preset image buffer queue when a photographing instruction is received, and perform multi-frame noise reduction processing on the multi-frame historical buffer image to obtain a noise reduction image;

The response module is configured to respond to the photographing instruction according to the noise-reduced image.

An embodiment of the present application provides a storage medium on which a computer program is stored, and when the computer program is executed on a computer, the computer executes the image processing method provided in the embodiment of the present application.

The embodiment of the present application also provides an electronic device, including a memory and a processor, and the processor is used to execute the image processing method provided in the embodiment of the present application by invoking a computer program stored in the memory.

In this embodiment, the electronic device can first synthesize RAW images with different exposure times to obtain a RAW composite image with a high dynamic range, and store the RAW composite image or the YUV composite image converted from the RAW composite image into the preset image in the buffer queue. When taking a picture, the electronic device can acquire multiple frames of images with high dynamic range from the preset image buffer queue to perform multiple frame noise reduction to obtain a noise-reduced image, and respond to the camera-taking instruction according to the noise-reduced image. Therefore, the photographed image obtained in this embodiment has a high dynamic range effect and less noise, that is, this embodiment can improve the imaging effect of the image.

Description of drawings

The technical solutions and beneficial effects of the present application will be apparent through the detailed description of the specific embodiments of the present application below in conjunction with the accompanying drawings.

FIG. 1 is a schematic flowchart of an image processing method provided by an embodiment of the present application.

Fig. 2 is a schematic diagram of a RAW image package provided by an embodiment of the present application.

FIG. 3 is another schematic flowchart of the image processing method provided by the embodiment of the present application.

4 to 6 are schematic diagrams of scenes of the image processing method provided by the embodiment of the present application.

FIG. 7 is a schematic structural diagram of an image processing device provided by an embodiment of the present application.

FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

FIG. 9 is another schematic structural diagram of an electronic device provided by an embodiment of the present application.

FIG. 10 is a schematic structural diagram of an image processing circuit provided by an embodiment of the present application.

Detailed ways

Referring to the drawings, where the same reference numerals represent the same components, the principle of the present application is illustrated by being implemented in a suitable computing environment. The following description is based on illustrated specific embodiments of the present application, which should not be construed as limiting other specific embodiments of the present application that are not described in detail here.

It can be understood that, the execution subject of the embodiment of the present application may be an electronic device such as a smart phone or a tablet computer.

Please refer to Fig. 1, Fig. 1 is a schematic flow diagram of the image processing method provided by the embodiment of the present application, the flow may include:

In 101, a RAW image package is acquired, the RAW image package includes at least two frames of RAW images, and the at least two frames of RAW images are images acquired in a target scene and have different exposure times.

The image processing method provided in this embodiment can be applied to an electronic device with a camera module. The camera module of electronic equipment is composed of a lens and an image sensor. The lens is used to collect external light source signals and provide them to the image sensor. The image sensor senses the light source signals from the lens and converts them into digitized original image data, that is, RAW images. data. RAW is an unprocessed and uncompressed format, which can be vividly called "digital negative". The image sensor of the camera module of the electronic device can have a first working mode and a second working mode.

It should be noted that, in the first working mode, the image sensor will generate at least two RAW images with different exposure times within one frame, and output them in the form of RAW image packets. For example, if the frame rate of the image sensor is 30fps, the image sensor will generate two RAW images with different exposure times within one-thirtieth of a second, and output them in the form of RAW image packets. For example, referring to FIG. 2 , the RAW image packet output by the image sensor working in the first working mode may include data of two RAW images, and the exposure time of one RAW image is twice the exposure time of the other RAW image. Of course, the ratio of the exposure time of the two frames of RAW images may also be other values, such as 3:1 or 4:1 or 3:2, etc., which is not specifically limited in this embodiment. For example, the image sensor generates two RAW images with different exposure times in the first one-thirtieth second, such as the first RAW image L1 and the second RAW image S1 . That is, the image sensor does not output the L1 image frame immediately after performing a long exposure to obtain the L1 image frame, but stores the L1 image frame in the buffer of the image sensor, and immediately clears the charge accumulated on the image sensor, A shorter exposure is then performed to obtain an S1 image frame. After reading out the S1 image frame, the electronic device may pack and process the data of the L1 image frame and the S1 image frame into a RAW image packet and output it. The image sensor also generates two RAW images with different exposure times in the second one-thirtieth second, such as the first RAW image L2 and the second RAW image S2. The image sensor generates the first Raw image L3 and the second Raw image S3 within the third one-thirtieth second. The image sensor generates the first Raw image L4 and the second Raw image S4 within the fourth one-thirtieth second, and so on. It should be noted that in this embodiment, images with a longer exposure time in the RAW image package are collectively recorded as the first RAW image, and images with a shorter exposure time are collectively recorded as the second RAW image. In this embodiment, the exposure time of all the first RAW images may be the same, for example, they are all T1. The exposure time of all the second RAW images may be the same, eg T2.

It can be understood that, since the shooting time interval is very short, it can be considered that the RAW images in the RAW image package are images obtained by shooting in the same scene. For example, if the RAW image package includes data of the first RAW image and the second RAW image, it can be considered that the first RAW image and the second RAW image are images captured in the same scene (for example, the target scene).

The above-mentioned second working mode is a normal working mode. In this second working mode, the image sensor will generate a single RAW image instead of a RAW image package within the time of one frame of image. For example, in the normal working mode, if the frame rate of the image sensor is 60fps, the image sensor will generate and output a frame of RAW image every sixtieth of a second.

In this embodiment of the present application, the electronic device may first acquire a RAW image package through an image sensor working in a first working mode. Wherein, the light signal from the current scene converges on the image sensor after passing through the lens of the camera, and the image sensor will perform alternate exposures with different exposure times, and continuously output a RAW image package including at least two frames of RAW images. It can be understood that at least two frames of RAW images included in the RAW image package are acquired under the same scene and have different exposure times.

For example, after the user operates the electronic device to start the camera application, the electronic device enables the image sensor and makes it work in the first working mode. If the user operates the camera of the electronic device to aim at a certain scene, the electronic device will continuously acquire the RAW image package in the scene through the image sensor working in the first working mode, and the RAW image package includes at least two frames with different exposures RAW image of time.

In 102, unpack the RAW image packet to obtain at least two frames of RAW image.

In 103, composite processing is performed on the at least two frames of RAW images to obtain a composite RAW image with a high dynamic range.

For example, 102 and 103 could include:

After acquiring the RAW image package, the electronic device may unpack the RAW image package, so as to obtain at least two frames of RAW images.

After performing unpacking processing on the RAW image package, the electronic device may perform HDR compositing processing on at least two frames of RAW images obtained by unpacking, so as to obtain a RAW composite image with a high dynamic range.

In 104, the operating parameter value of the electronic device is acquired, and the operating parameter value is used to represent the computing capability of the electronic device.

For example, after obtaining a RAW composite image with a high dynamic range, the electronic device may acquire its operating parameter value, where the operating parameter value may be a numerical value of a parameter representing computing capability (processing capability) of the electronic device.

In 105, according to the value of the running parameter, it is determined to store the RAW composite image in the preset image buffer queue in the target scene, or to convert the RAW composite image into a YUV composite image and store it in the preset image cache queue.

For example, after obtaining the operating parameter value, the electronic device can determine whether to store the RAW composite image in the preset image buffer queue in the target scene according to the operating parameter value, or convert the RAW composite image to YUV composite The image is then stored in the preset image cache queue.

For example, if the electronic device determines that the RAW composite image is stored in the preset image buffer queue in the target scene according to the operating parameter value, then the electronic device can store the RAW composite image in the preset image buffer queue.

Alternatively, according to the operating parameter value, the electronic device determines that the RAW composite image is converted into a YUV composite image in the target scene and then stored in the preset image buffer queue. Then, the electronic device may first convert the RAW composite image into a YUV format to obtain a YUV composite image, and then store the YUV composite image in a preset image buffer queue.

It should be noted that in the process of 105, the result determined by the electronic device (that is, storing the RAW composite image in the preset image buffer queue in the target scene, or converting the RAW composite image into a YUV composite image and then storing it in The preset image cache queue) is valid under the target scene (that is, when the scene does not change).

For example, after the user opens the camera application and points the camera at scene A, the electronic device can quickly and continuously acquire RAW image packets. If the electronic device determines to store the RAW composite image in the preset image buffer queue according to the operating parameter value, then all the RAW image packets obtained during the process of the camera aiming at scene A will store the RAW composite image in the Preset image cache queue. For example, in the process of aiming the camera at scene A, after the electronic device obtains the first RAW image packet, it determines according to the operating parameters of the electronic device that the RAW composite image is stored in the preset image buffer queue, and then obtains The received RAW image package of scene A stores the RAW composite image in the preset image buffer queue. For example, if the electronic device acquires 10 RAW image packages in scene A, then the 10 RAW image packages all store the RAW composite images in the preset image buffer queue.

After that, for example, the user moves the camera and points the camera at scene B, then the electronic device can determine whether to store the RAW composite image in the preset image buffer queue in scene B according to the operating parameters, or to store the RAW composite image Converted to a YUV composite image and stored in the preset image cache queue. For example, the electronic device determines to convert the RAW composite image into the YUV composite image and store it in the preset image buffer queue. For example, in the process of aiming the camera at scene B, after the electronic device obtains the first RAW image packet, it determines according to the operating parameters of the electronic device whether to convert the RAW composite image into a YUV composite image and store it in the preset image buffer queue , then the RAW image package of scene B obtained next is to convert the RAW composite image into a YUV composite image and store it in the preset image cache queue. For example, if the electronic device acquires 15 RAW image packets in scene B, the 15 RAW image packets are converted from RAW composite images into YUV composite images and then stored in the preset image buffer queue.

That is to say, whenever the scene changes, the electronic device needs to re-determine according to the operating parameters whether to store the RAW composite image in the preset image buffer queue, or convert the RAW composite image to a YUV composite image and then store it in the preset Image cache queue. For example, after scene B, the user points the camera at scene A again, then the electronic device needs to determine whether to store the RAW composite image in the preset image buffer queue or convert the RAW composite image to YUV according to the operating parameters The combined image is then stored in the preset image cache queue. For example, at this time, the electronic device may determine to convert the RAW composite image into a YUV composite image and then store it in the preset image buffer queue, and so on.

In 106, when a photographing instruction is received, a multi-frame historical buffer image of the target scene is obtained from a preset image buffer queue, and multi-frame noise reduction processing is performed on the multi-frame historical buffer image to obtain a noise-reduced image.

For example, after storing the RAW synthesized image or the YUV synthesized image in the preset image buffer queue, when receiving a photographing instruction for taking pictures of the target scene, the electronic device can obtain information about the target scene from the preset image buffer queue. Multi-frame history buffer images, and performing multi-frame noise reduction processing on the multi-frame history buffer images to obtain a noise-reduced image.

In 107, respond to the camera instruction according to the noise-reduced image.

For example, after obtaining the noise-reduced image, the electronic device may respond to a camera instruction according to the noise-reduced image. For example, the electronic device may display the noise-reduced image as an image obtained by taking pictures in a target scene on an interface of a camera application for the user to view.

For example, the user opens the corresponding application and points the camera at the scene A, then the electronic device can enable the image sensor and make it work in the first working mode. At this point, the electronic device can quickly acquire the RAW image package. After the electronic device obtains the first RAW image packet, it can unpack the RAW image packet to obtain at least two frames of RAW images, and perform synthesis processing on the at least two frames of RAW images, so as to obtain a RAW image with a high dynamic range. composite image. Afterwards, the electronic device can obtain its operating parameter value, and the operating parameter value can be used to indicate the strength of the electronic device's current computing capability. In addition, the electronic device may determine whether to store the RAW composite image in the preset image buffer queue in scenario A, or convert the RAW composite image into a YUV composite image and then store it in the preset image buffer queue according to the operating parameter value. For example, if the electronic device determines that the RAW composite image is stored in the preset image buffer queue in scene A, then the RAW composite images of the RAW image packets acquired in scene A will all be stored in the preset image buffer queue. For example, in scenario A, if the electronic device acquires 10 RAW image packets, the RAW composite images of the 10 RAW image packets will be stored in the preset image buffer queue. When receiving an instruction to take a picture of scene A, the electronic device may obtain multiple frames of historical RAW composite images of scene A from the preset image cache queue, and perform multi-frame noise reduction processing on the multiple frames of historical RAW composite images, Obtain the noise-reduced image, and respond to the camera instruction in scene A according to the noise-reduced image.

After that, for example, the user moves the camera and points the camera at scene B, then the electronic device can also quickly acquire the RAW image package of scene B. After the electronic device acquires the first RAW image packet in scene B, it may unpack the RAW image packet to obtain at least two frames of RAW images, and perform synthesis processing on the at least two frames of RAW images, so as to obtain a RAW composite images with dynamic range. Afterwards, the electronic device can obtain its operating parameter values. In addition, the electronic device can determine whether to store the RAW composite image in the preset image buffer queue in scene B, or convert the RAW composite image into a YUV composite image and then store it in the preset image buffer queue according to the operating parameter value. For example, if the electronic device determines that the RAW synthesized image is converted into a YUV synthesized image in scene B and then stored in the preset image buffer queue, the YUV synthesized image acquired in scene B will be stored in the preset image buffer queue . For example, in scenario B, if the electronic device acquires 15 RAW image packets, the YUV composite images of the 15 RAW image packets will be stored in the preset image buffer queue. When receiving an instruction to take a photo of scene B, the electronic device can obtain multiple frames of historical YUV composite images of scene B from the preset image buffer queue, and perform multi-frame noise reduction processing on the pair of historical YUV composite images to obtain Denoise the image, and respond to the camera instruction in scene B according to the denoised image.

It can be understood that, in this embodiment, the electronic device may first synthesize RAW images with different exposure times to obtain a RAW composite image with a high dynamic range, and convert the RAW composite image or the RAW composite image into a YUV composite image Stored in the preset image cache queue. When taking a picture, the electronic device can acquire multiple frames of images with high dynamic range from the preset image buffer queue to perform multiple frame noise reduction to obtain a noise-reduced image, and respond to the camera-taking instruction according to the noise-reduced image. Therefore, the photographed image obtained in this embodiment has a high dynamic range effect and less noise, that is, this embodiment can improve the imaging effect of the image.

Please refer to FIG. 3. FIG. 3 is another schematic flow diagram of the image processing method provided in the embodiment of the present application. The flow may include:

In 201, the electronic device acquires a RAW image package, the RAW image package includes a first RAW image and a second RAW image exposed in sequence, the first RAW image and the second RAW image are images acquired in a target scene, And the exposure time of the first RAW image is longer than the exposure time of the second RAW image.

In 202, the electronic device unpacks the RAW image packet to obtain the first RAW image and the second RAW image.

In 203, the electronic device performs composite processing on the first RAW image and the second RAW image to obtain a RAW composite image with a high dynamic range.

For example, 201, 202, and 203 could include:

After the user operates the electronic device to start the camera application, the electronic device enables the image sensor and makes it work in the first working mode. If the user operates the camera of the electronic device to aim at a certain scene (for example, the electronic device determines that the certain scene is the target scene), the electronic device will continuously acquire the RAW image of the target scene through the image sensor working in the first working mode. An image package, the RAW image package includes the first RAW image and the second RAW image exposed in sequence. Wherein, the exposure time of the first RAW image is longer than that of the second RAW image.

Afterwards, the electronic device may unpack the obtained RAW image package to obtain the first RAW image and the second RAW image, and perform composite processing on the first RAW image and the second RAW image, thereby obtaining a high dynamic range of RAW composite images.

That is to say, whenever a RAW image packet is acquired, the electronic device may unpack the RAW image packet, so as to obtain the first RAW image and the second RAW image included therein. It should be noted that, in this embodiment, a RAW image with a longer exposure time included in each RAW image package is recorded as a first RAW image, and a RAW image with a shorter exposure time included therein is recorded as a second RAW image.

In 204, the electronic device acquires an operating parameter value, where the operating parameter value is used to represent the computing capability of the electronic device.

For example, after obtaining the first RAW composite image in the target scene A, the electronic device may obtain its operating parameter value, where the operating parameter value may be a numerical value of a parameter representing the computing capability of the electronic device.

In one embodiment, the electronic device obtains the operation parameter value in 204, and the operation parameter value is used to represent the process of computing capability of the electronic device, which may include:

The electronic device obtains a ratio of the remaining running memory capacity to the total running memory capacity, and the ratio is used to represent the computing capability of the electronic device.

For example, when the computing capability of the electronic device needs to be determined, the electronic device may obtain the ratio of its remaining running memory capacity to the total running memory capacity, and use the ratio as the computing capability of the electronic device. Wherein, a larger value of the ratio may indicate a stronger computing capability of the electronic device.

For example, if the electronic device obtains that its remaining operating memory capacity is 3GB, and its total operating memory capacity is 4GB, the ratio of the remaining operating memory capacity to the total operating memory capacity is 75%. For example, the electronic device may preset a preset threshold of 40%. When the ratio of the remaining running memory capacity to the total running memory capacity is greater than 40% of the preset threshold, it can be considered that the current computing capability of the electronic device is strong. When the ratio of the remaining running memory capacity to the total running memory capacity is less than or equal to 40% of the preset threshold, it can be considered that the current computing capability of the electronic device is weak.

In 205, if the operating parameter value indicates that the computing capability of the electronic device is higher than the preset threshold, the electronic device determines that the RAW composite image is stored in the preset image buffer queue in the target scene; if the operating parameter value indicates that the computing capability of the electronic device If the capability is not higher than the preset threshold, the electronic device determines that the RAW composite image is converted into a YUV composite image in the target scene and then stored in the preset image buffer queue.

For example, after acquiring the operating parameter value of the electronic device, the electronic device can determine whether to store the RAW composite image in the preset image buffer queue in the target scene according to the operating parameter value, or to store the RAW composite image After converting to a YUV composite image, it is stored in the preset image cache queue.

For example, in this embodiment, if the operating parameter value indicates that the computing capability of the electronic device is higher than the preset threshold, the electronic device may determine to store the RAW composite image in the preset image buffer queue in the target scene. If the operating parameter value indicates that the computing capability of the electronic device is not higher than the preset threshold, the electronic device may determine that the RAW composite image is converted into a YUV composite image in the target scene and stored in the preset image buffer queue.

In an implementation manner, the preset image buffer queue may be a fixed-length queue. For example, the preset image buffer queue can buffer 30 frames of images. That is, the preset image cache queue can cache the latest 30 frames of images. For example, according to the chronological order stored in the preset image buffer queue, the first frame image, the second frame image, . . . , the 30th frame image are cached in the preset image buffer queue. Then, when the image of the 31st frame is buffered, the preset image buffer queue may clear the earliest stored image of the first frame included therein, and then store the image of the 31st frame into the preset image buffer queue.

In 206, when receiving the photographing instruction, the electronic device determines the target number according to the operating parameter value, and the target number is greater than or equal to 2.

In 207, the electronic device acquires a target number of historical cached images from the preset image cache queue, where the historical cached images are images of the target scene.

For example, 206 and 207 may include:

After storing the RAW composite image or the YUV composite image in the preset image buffer queue, when receiving a photographing instruction for photographing a target scene, the electronic device may determine a target number according to the operating parameter value acquired in 204 . Wherein, the value of the target quantity may be greater than or equal to 2.

After the number of targets is determined, the electronic device may acquire multiple frames of historical cached images of the target scene from the preset image cache queue.

For example, if the electronic device determines that the target number is 4 according to the value of the operating parameter, the electronic device may acquire 4 frames of historical cached images of the target scene from the preset image cache queue.

In an implementation manner, the electronic device may preset at least two numerical values, such as 4 and 2. Wherein, when the operating parameter value indicates that the computing capability of the electronic device is higher than the preset threshold, the electronic device may determine the value 4 as the target quantity. When the operating parameter value indicates that the computing capability of the electronic device is not higher than the preset threshold, the electronic device may determine the value 2 as the target quantity, and so on.

For example, the electronic device may preset three numerical values, such as 4, 3 and 2. Wherein, when the ratio of the remaining running memory capacity to the total running memory capacity is [75%, 100%], the electronic device may determine the value 4 as the target quantity. When the ratio of the remaining running memory capacity to the total running memory capacity is [40%, 75%), the electronic device may determine the value 3 as the target amount. When the ratio of the remaining running memory capacity to the total running memory capacity is lower than 40%, the electronic device may determine the value 2 as the target amount.

In 208, the electronic device performs multi-frame noise reduction processing on the multi-frame history buffer image to obtain a noise-reduced image.

For example, after acquiring multiple frames of historical cached images about the target scene, the electronic device may perform multiple frames of noise reduction processing on the multiple frames of historical cached images, thereby obtaining a noise-reduced image.

The following describes multi-frame noise reduction by taking images P1, P2, P3, and P4 as examples. For example, when performing multi-frame noise reduction processing on image P1, image P2, image P3, and image P4, the electronic device may determine a basic frame from image P1, image P2, image P3, and image P4, for example, image P1 Determined as the basic frame, then the electronic device can perform image alignment on the image P1, the image P2, the image P3 and the image P4. After that, the electronic device can calculate the average pixel value of each pixel based on the aligned images. For example, the pixel values of a pixel at a certain position in four frames of images P1, P2, P3, and P4 are: 101, 102 , 103, 102, then the average pixel value of the pixel at this position can be calculated to be 102. Then, the electronic device can determine the pixel value of the pixel point at this position as 102, and change the pixel value of the basic frame image P1 at this position from 101 to 102. Similarly, the noise-reduced image can be obtained by changing the pixel value of each position in the basic frame image P1 to the corresponding average pixel value.

In 209, the electronic device performs image optimization processing on the noise-reduced image to obtain a processed image.

In 210, the electronic device responds to the photographing instruction according to the processed image, so as to display the processed image as an image obtained by photographing.

For example, 209 and 210 may include:

After obtaining the noise-reduced image, the electronic device may perform optimization processing such as image sharpening on the noise-reduced image to obtain a processed image. Afterwards, the electronic device may respond to the photographing instruction according to the processed image, so as to display the processed image as an image obtained by photographing.

In one embodiment, after step 203, that is, after the electronic device obtains the RAW composite image with a high dynamic range, beautification processing such as YUV format conversion, image sharpening, and image noise reduction can be performed on the RAW composite image, thereby obtaining Beautify the processed image. The beautified image can be used for preview or recording.

For example, after obtaining the RAW composite image, the electronic device can obtain the resolution of the display screen, and perform down-sampling processing on the RAW composite image according to the resolution, and then the down-sampled image undergoes such as YUV format conversion, image sharpening, etc. , image noise reduction and other beautification processing for preview.

For another example, after obtaining the RAW composite image, the electronic device can obtain the video resolution of the recording, and perform down-sampling processing on the RAW composite image according to the video resolution of the recording, and the down-sampling processed image is converted into a format such as YUV , Image sharpening, image noise reduction and other beautification processes are used to save as a frame in the video corresponding to the recording.

For example, the video resolution of the recording can be preset by the user, including but not limited to 1080P, 2K, and 4K. For example, if the video resolution of the recording is preset to 2K by the user, after the electronic device synthesizes a RAW composite image (for example, the resolution is 4K), it can perform down-sampling processing on the RAW composite image to obtain a high dynamic resolution of 2K resolution. range image.

Please refer to FIG. 4 to FIG. 6 . FIG. 4 to FIG. 6 are schematic diagrams of scenes of the image processing method provided by the embodiment of the present application.

For example, the user opens the camera application, and at this moment, the electronic device enters the preview interface of the camera. The electronic device can enable the image sensor and make the image sensor work in the first working mode. In the first working mode, the image sensor will sequentially generate two frames of RAW images with different exposure times within the time of one frame of images, and output them in the form of RAW image packets.

For example, as shown in FIG. 4 , the user points the camera at the scene A, and the scene A includes a person, and the electronic device can quickly acquire the RAW image package of the scene A. After the electronic device obtains the first RAW image packet, it can unpack the RAW image packet to obtain two frames of RAW images, and then synthesize the two frames of RAW images to obtain a RAW composite image with a high dynamic range .

Afterwards, the electronic device can obtain its operating parameter value, and the operating parameter value can be used to indicate the strength of the electronic device's current computing capability. In addition, the electronic device may determine whether to store the RAW composite image in the preset image buffer queue in scenario A, or convert the RAW composite image into a YUV composite image and then store it in the preset image buffer queue according to the operating parameter value. For example, if the current computing capability of the electronic device is relatively strong, it can be determined that the RAW composite image is stored in the preset image buffer queue in scene A, and the RAW composite images of the RAW image package obtained in scene A will be stored in the Preset image cache queue. For example, in scenario A, if the electronic device acquires 10 RAW image packets, the RAW composite images of the 10 RAW image packets will be stored in the preset image buffer queue.

When in the preview interface of the camera application, whenever the electronic device acquires a frame of RAW composite image, the electronic device can display it on the preview interface after processing the RAW composite image such as YUV format conversion, image sharpening and noise reduction. for users to preview.

After the preview, for example, the user presses the camera button, as shown in FIG. 4 , the electronic device may receive an instruction to take a photo of scene A. At this point, the electronic device can acquire 4 frames of historical RAW composite images of scene A from the preset image cache queue, and perform multi-frame noise reduction processing on the 4 frames of historical RAW composite images to obtain a noise-reduced image. For example, as shown in FIG. 5 , the four frames of RAW synthesized images related to scene A obtained by the electronic device from the preset image buffer queue are respectively P1, P2, P3, and P4. The electronic device may determine the image P1 as a basic frame, and then use the images P2, P3, and P4 to perform multi-frame noise reduction on P1. The electronic device can perform image alignment on the image P1, the image P2, the image P3, and the image P4. After that, the electronic device can calculate the average pixel value of each pixel based on the aligned images. For example, the pixel values of the pixel at position L in the four frames of images P1, P2, P3, and P4 are: 101, 102 , 103, 102, then the average pixel value of the pixel at this position can be calculated to be 102. Then, the electronic device can determine the pixel value of the pixel at this position as 102, and change the pixel value of the basic frame image P1 at the L position from 101 to 102. Similarly, the noise-reduced image can be obtained by changing the pixel value of each position in the basic frame image P1 to the corresponding average pixel value.

After obtaining the noise-reduced image, the electronic device may perform processing such as image sharpening on the noise-reduced image to obtain a beautified noise-reduced image. Afterwards, the electronic device can send the beautified and noise-reduced image to the JPEG encoder, and after being processed by the JPEG encoder, it can be output to the camera application interface for display, so that the user can check and take pictures to obtain the image.

For another example, the user then points the camera at the scene B, and the scene B includes two characters, as shown in FIG. 6 , the electronic device can quickly acquire the RAW image package of the scene B. After the electronic device obtains the first RAW image packet in scene B, it can unpack the RAW image packet to obtain two frames of RAW images, and then synthesize the two frames of RAW images to obtain a high dynamic range RAW composite image.

Afterwards, the electronic device can obtain its operating parameter value, and the operating parameter value can be used to indicate the strength of the electronic device's current computing capability. In addition, the electronic device can determine whether to store the RAW composite image in the preset image buffer queue in scene B, or convert the RAW composite image into a YUV composite image and then store it in the preset image buffer queue according to the operating parameter value. For example, if the current computing power of the electronic device is weak, it can be determined that the RAW composite image is converted into a YUV composite image in scene B and then stored in the preset image buffer queue, then the RAW image obtained in scene B The RAW composite image obtained by the package will be stored in the preset image cache queue after being converted into a YUV composite image in YUV format. For example, in scenario B, if the electronic device acquires 15 RAW image packets, the YUV composite images of the 15 RAW image packets will be stored in the preset image buffer queue.

Similarly, when the electronic device is in the preview interface of the camera application, whenever the electronic device acquires a frame of RAW composite image about scene B, the electronic device can perform such functions as YUV format conversion, image sharpening and noise reduction on the RAW composite image. After processing, it is displayed on the preview interface for users to preview.

After the preview, for example, the user presses the camera button, as shown in FIG. 6 , the electronic device may receive an instruction to take a photo of scene B. At this time, the electronic device can acquire 2 frames of historical YUV composite images of scene B from the preset image buffer queue, and perform multi-frame noise reduction processing on the 2 frames of historical YUV composite images to obtain a noise-reduced image. For example, the two frames of YUV synthesized images related to scene B obtained by the electronic device from the preset image buffer queue are P5 and P6 respectively. The electronic device can perform multi-frame noise reduction on the images P5 and P6 to obtain a noise-reduced image.

After obtaining the noise-reduced image, the electronic device may perform processing such as image sharpening on the noise-reduced image to obtain a beautified noise-reduced image. Afterwards, the electronic device can send the beautified and noise-reduced image to the JPEG encoder, and after being processed by the JPEG encoder, it can be output to the camera application interface for display, so that the user can check and take pictures to obtain the image.

Please refer to FIG. 7 . FIG. 7 is a schematic structural diagram of an image processing device provided by an embodiment of the present application. The image processing apparatus 300 may include: a first acquisition module 301 , an unpacking module 302 , a synthesis module 303 , a second acquisition module 304 , a cache module 305 , a processing module 306 , and a response module 307 .

The first acquisition module 301 is configured to acquire a RAW image package, the RAW image package includes at least two frames of RAW images, and the at least two frames of RAW images are images acquired in a target scene and have different exposure times.

The unpacking module 302 is configured to perform unpacking processing on the RAW image packets to obtain the at least two frames of RAW images.

The synthesis module 303 is configured to perform synthesis processing on the at least two frames of RAW images to obtain a RAW synthesis image with a high dynamic range.

The second acquiring module 304 is configured to acquire an operating parameter value of the electronic device, where the operating parameter value is used to represent the computing capability of the electronic device.

The cache module 305 is configured to determine, according to the operating parameter value, whether to store the RAW composite image in the preset image cache queue in the target scene, or convert the RAW composite image into a YUV composite image and store it in the Default image cache queue.

The processing module 306 is configured to obtain a multi-frame historical buffer image of the target scene from the preset image buffer queue when a photographing instruction is received, and perform multi-frame noise reduction processing on the multi-frame historical buffer image to obtain a reduced noisy image.

The response module 307 is configured to respond to the photographing instruction according to the noise-reduced image.

In one embodiment, the caching module 305 can be used to:

If the operating parameter value indicates that the computing capability of the electronic device is higher than a preset threshold, it is determined that the RAW composite image is stored in a preset image buffer queue under the target scene;

If the operating parameter value indicates that the computing capability of the electronic device is not higher than the preset threshold, it is determined that the RAW composite image will be converted into a YUV composite image in the target scene and stored in the preset image buffer queue .

In an implementation manner, the second acquiring module 304 may be used to:

A ratio of the remaining running memory capacity of the electronic device to the total running memory capacity is obtained, and the ratio is used to represent the computing capability of the electronic device.

In one embodiment, the response module 307 may be used to:

performing image optimization processing on the noise-reduced image to obtain a processed image;

Responding to the photographing instruction according to the processed image, so as to display the processed image as an image obtained by photographing.

In one embodiment, the first acquisition module 301 may be configured to: acquire a RAW image package, the RAW image package includes a first RAW image and a second RAW image exposed in sequence, and the first RAW image and The second RAW image is an image acquired in a target scene, and the exposure time of the first RAW image is longer than the exposure time of the second RAW image.

Then, the unpacking module 302 may be configured to: perform unpacking processing on the RAW image packet to obtain the first RAW image and the second RAW image.

The composition module 303 may be configured to: perform composition processing on the first RAW image and the second RAW image to obtain a RAW composite image with a high dynamic range.

In one embodiment, the processing module 306 may be used to:

When a photographing instruction is received, the target number is determined according to the operating parameter value, and the target number is greater than or equal to 2;

Acquiring the target number of historical cache images from the preset image cache queue, where the historical cache images are images of the target scene.

In an implementation manner, the preset image buffer queue is a fixed-length queue.

An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed on a computer, the computer is made to execute the procedures in the image processing method provided in this embodiment.

The embodiment of the present application also provides an electronic device, including a memory and a processor, and the processor is used to execute the procedures in the image processing method provided in the present embodiment by invoking a computer program stored in the memory.

For example, the above-mentioned electronic device may be a mobile terminal such as a tablet computer or a smart phone. Please refer to FIG. 8 . FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

The electronic device 400 may include components such as a camera module 401 , a memory 402 , and a processor 403 . Those skilled in the art can understand that the structure of the electronic device shown in FIG. 8 does not constitute a limitation on the electronic device, and may include more or less components than shown in the figure, or combine some components, or arrange different components.

The camera module 401 may include a lens and an image sensor, wherein the lens is used to collect external light source signals and provide them to the image sensor, and the image sensor senses the light source signals from the lens and converts them into digitized original image data, that is, RAW image data. RAW is an unprocessed and uncompressed format, which can be vividly called "digital negative". The image sensor of the camera module of the electronic device can have a first working mode and a second working mode.

Memory 402 may be used to store applications and data. The application programs stored in the memory 402 include executable codes. Applications can be composed of various functional modules. The processor 403 executes various functional applications and data processing by running the application programs stored in the memory 402 .

The processor 403 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing the application program stored in the memory 402 and calling the data stored in the memory 402, the electronic device executes Various functions and processing data, so as to monitor the electronic equipment as a whole.

In this embodiment, the processor 403 in the electronic device loads the executable code corresponding to the process of one or more application programs into the memory 402 according to the following instructions, and the processor 403 runs the executable code stored in the memory. 402 in the application, thus executing:

Acquire a RAW image package, the RAW image package includes at least two frames of RAW images, the at least two frames of RAW images are images acquired in the target scene and have different exposure times;

Unpacking the RAW image packet to obtain the at least two frames of RAW image;

Synthesizing the at least two frames of RAW images to obtain a RAW composite image with a high dynamic range;

Acquiring an operating parameter value of the electronic device, where the operating parameter value is used to represent the computing capability of the electronic device;

According to the operating parameter value, it is determined to store the RAW composite image in the preset image buffer queue in the target scene, or convert the RAW composite image into a YUV composite image and store it in the preset image buffer queue;

When a photographing instruction is received, acquire a multi-frame historical buffer image of the target scene from the preset image buffer queue, and perform multi-frame noise reduction processing on the multi-frame historical buffer image to obtain a noise-reduced image;

Responding to the photographing instruction according to the noise-reduced image.

Referring to FIG. 9 , an electronic device 500 may include a camera module 501 , a memory 502 , a processor 503 , a touch screen 504 , a speaker 505 , a microphone 506 and other components.

The camera module 501 may include an image processing circuit, which may be implemented by hardware and/or software components, and may include various processing units defining an image signal processing (Image Signal Processing) pipeline. The image processing circuit may at least include: a camera, an image signal processor (Image Signal Processor, ISP processor), a control logic, an image memory, and a display. Wherein the camera may at least include one or more lenses and image sensors. The image sensor may include a color filter array (eg Bayer filter). The image sensor may obtain light intensity and wavelength information captured with each imaging pixel of the image sensor and provide a set of raw image data that may be processed by an image signal processor.

Image signal processors can process raw image data on a pixel-by-pixel basis in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12 or 14 bits, and the image signal processor may perform one or more image processing operations on the raw image data, gather statistical information about the image data. Among other things, image processing operations can be performed with the same or different bit depth precision. The original image data can be stored in the image memory after being processed by the image signal processor. The image signal processor may also receive image data from the image memory.

The image memory may be a part of a memory device, a storage device, or an independent dedicated memory in an electronic device, and may include a DMA (Direct Memory Access) feature.

When receiving image data from the image memory, the image signal processor may perform one or more image processing operations, such as temporal filtering. The processed image data can be sent to an image memory for additional processing before being displayed. The image signal processor may also receive processed data from the image memory and subject the processed data to image data processing in the raw domain and in the RGB and YCbCr color spaces. The processed image data can be output to a display for viewing by a user and/or further processed by a graphics engine or a GPU (Graphics Processing Unit, graphics processing unit). In addition, the output of the image signal processor can also be sent to the image memory, and the display can read the image data from the image memory. In one embodiment, the image memory may be configured to implement one or more frame buffers.

Statistical data determined by the image signal processor may be sent to the control logic. For example, statistics may include image sensor statistics for auto exposure, auto white balance, auto focus, flicker detection, black level compensation, lens shading correction, etc.

Control logic may include a processor and/or microcontroller executing one or more routines (eg, firmware). One or more routines may determine camera control parameters and ISP control parameters based on the received statistical data. For example, camera control parameters may include camera flash control parameters, lens control parameters (such as focal length for focus or zoom), or a combination of these parameters. ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), among others.

Please refer to FIG. 10 . FIG. 10 is a schematic structural diagram of the image processing circuit in this embodiment. As shown in FIG. 10 , for ease of description, only various aspects of the image processing technology related to the embodiment of the present invention are shown.

For example, the image processing circuit may include: a camera, an image signal processor, a control logic, an image memory, and a display. Wherein, the camera may include one or more lenses and image sensors. In some embodiments, the camera can be any one of a telephoto camera or a wide-angle camera.

The first image collected by the camera is transmitted to the image signal processor for processing. After processing the first image, the image signal processor can send statistical data of the first image (such as brightness of the image, contrast value of the image, color of the image, etc.) to the control logic. The control logic can determine the control parameters of the camera according to the statistical data, so that the camera can perform operations such as automatic focus and automatic exposure according to the control parameters. The first image can be stored in the image memory after being processed by the image signal processor. The image signal processor can also read images stored in the image memory for processing. In addition, the first image can be directly sent to the display for display after being processed by the image signal processor. The display can also read images from the image memory for display.

In addition, not shown in the figure, the electronic device may also include a CPU and a power supply module. The CPU is connected to the logic controller, image signal processor, image memory and display, and the CPU is used to realize overall control. The power supply module is used to supply power to each module.

The application programs stored in the memory 502 include executable codes. Applications can be composed of various functional modules. The processor 503 executes various functional applications and data processing by running the application programs stored in the memory 502 .

The processor 503 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing the application program stored in the memory 502 and calling the data stored in the memory 502, the electronic device executes Various functions and processing data, so as to monitor the electronic equipment as a whole.

The touch display screen 504 can be used to receive a user's touch control operation on the electronic device. Speaker 505 can play sound signals. Microphone 506 may be used to pick up sound signals.

In this embodiment, the processor 503 in the electronic device loads the executable code corresponding to the process of one or more application programs into the memory 502 according to the following instructions, and the processor 503 runs the executable code stored in the memory. 502 in the application, thus executing:

Acquire a RAW image package, the RAW image package includes at least two frames of RAW images, the at least two frames of RAW images are images acquired in the target scene and have different exposure times;

Unpacking the RAW image packet to obtain the at least two frames of RAW image;

Synthesizing the at least two frames of RAW images to obtain a RAW composite image with a high dynamic range;

Acquiring an operating parameter value of the electronic device, where the operating parameter value is used to represent the computing capability of the electronic device;

According to the operating parameter value, it is determined to store the RAW composite image in the preset image buffer queue in the target scene, or convert the RAW composite image into a YUV composite image and store it in the preset image buffer queue;

When a photographing instruction is received, acquire a multi-frame historical buffer image of the target scene from the preset image buffer queue, and perform multi-frame noise reduction processing on the multi-frame historical buffer image to obtain a noise-reduced image;

Responding to the photographing instruction according to the noise-reduced image.

In one embodiment, the processor 503 determines to store the RAW composite image in the preset image buffer queue in the target scene or convert the RAW composite image to YUV according to the operation parameter value. When the synthesized image is stored in the preset image cache queue, it may be executed: if the operating parameter value indicates that the computing power of the electronic device is higher than the preset threshold, it is determined that the RAW synthesized image is stored in the target scene Preset image cache queue; if the operating parameter value indicates that the computing power of the electronic device is not higher than the preset threshold, it is determined that the RAW composite image will be converted into a YUV composite image in the target scene and stored in the The preset image cache queue described above.

In one embodiment, when the processor 503 executes the acquiring the operating parameter value of the electronic device, when the operating parameter value is used to represent the computing capability of the electronic device, it may execute: acquiring the remaining operating memory capacity of the electronic device and The ratio of the total capacity of the operating memory, the ratio is used to represent the computing power of the electronic device.

In one embodiment, the processor 503 may execute, when responding to the photographing instruction according to the noise-reduced image, to: perform image optimization processing on the noise-reduced image to obtain a processed image; The image of the image responds to the photographing instruction, so as to display the processed image as an image obtained by photographing.

In one embodiment, the processor 503 executes the acquisition of the RAW image package, the RAW image package includes at least two frames of RAW images, and the at least two frames of RAW images are images acquired in the target scene and have different When the exposure time is reached, it may be performed: acquiring a RAW image package, the RAW image package includes a first RAW image and a second RAW image exposed in sequence, and the first RAW image and the second RAW image are in the target scene The acquired image, and the exposure time of the first RAW image is longer than the exposure time of the second RAW image.

Then, when the processor 503 executes unpacking processing on the RAW image packet to obtain the at least two frames of RAW images, it may execute: performing unpacking processing on the RAW image packet to obtain the first RAW image and the Describe the second RAW image.

When the processor 503 performs synthesis processing on the at least two frames of RAW images to obtain a RAW composite image with a high dynamic range, it may execute: performing synthesis processing on the first RAW image and the second RAW image to obtain a composite image with a high dynamic range. RAW composite images with high dynamic range.

In one embodiment, when the processor 503 executes the step of obtaining the multi-frame history cached image of the target scene from the preset image cache queue when receiving the photographing instruction, it may execute: when receiving the photographing instruction , determine the target number according to the operating parameter value, the target number is greater than or equal to 2; acquire the target number of historical cached images from the preset image cache queue, the historical cached images are the target scene image.

In an implementation manner, the preset image buffer queue is a fixed-length queue.

In the above-mentioned embodiments, the descriptions of each embodiment have their own emphases. For the parts not described in detail in a certain embodiment, please refer to the detailed description of the image processing method above, which will not be repeated here.

The image processing device provided in the embodiment of the present application belongs to the same concept as the image processing method in the above embodiment, and any method provided in the embodiment of the image processing method can be run on the image processing device, and its specific For the implementation process, refer to the embodiment of the image processing method, and details are not repeated here.

It should be noted that, for the image processing method described in the embodiment of the present application, those skilled in the art can understand that all or part of the flow of the image processing method described in the embodiment of the present application can be controlled by computer programs. To complete, the computer program can be stored in a computer-readable storage medium, such as stored in a memory, and executed by at least one processor, and the execution process can include the flow of the embodiment of the image processing method . Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), etc.

For the image processing device in the embodiment of the present application, its various functional modules may be integrated into one processing chip, or each module may exist separately physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are implemented in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium, such as read-only memory, magnetic disk or optical disk, etc. .

An image processing method, device, storage medium, and electronic equipment provided by the embodiments of the present application have been described above in detail. In this paper, specific examples are used to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only It is used to help understand the method and its core idea of this application; at the same time, for those skilled in the art, according to the idea of this application, there will be changes in the specific implementation and application scope. In summary, this specification The content should not be construed as a limitation of the application.

Claims (9)

1. An image processing method, comprising:

acquiring a RAW image packet, wherein the RAW image packet comprises at least two frames of RAW images, and the at least two frames of RAW images are images acquired in a target scene and have different exposure times;

unpacking the RAW image packet to obtain the at least two frames of RAW images;

synthesizing the at least two frames of RAW images to obtain a RAW synthesized image with a high dynamic range;

acquiring an operation parameter value of an electronic device, wherein the operation parameter value is used for representing the computing capacity of the electronic device;

if the operation parameter value indicates that the computing capability of the electronic equipment is higher than a preset threshold value, determining that the RAW composite image is stored in a preset image cache queue in the target scene; if the operation parameter value indicates that the computing capacity of the electronic equipment is not higher than a preset threshold value, determining that the RAW synthetic image is converted into a YUV synthetic image in the target scene and then storing the YUV synthetic image into a preset image cache queue;

when a photographing instruction is received, obtaining multi-frame historical cache images of a target scene from the preset image cache queue, and carrying out multi-frame noise reduction processing on the multi-frame historical cache images to obtain noise reduction images;

and responding to the photographing instruction according to the noise reduction image.

2. The image processing method according to claim 1, wherein the obtaining of an operation parameter value of an electronic device, the operation parameter value being indicative of a computing capability of the electronic device, comprises:

and acquiring the ratio of the residual operation memory capacity of the electronic equipment to the total operation memory capacity, wherein the ratio is used for representing the computing capacity of the electronic equipment.

3. The image processing method according to claim 1, wherein responding to the photographing instruction according to the noise-reduced image comprises:

performing image optimization processing on the noise reduction image to obtain a processed image;

and responding to the photographing instruction according to the processed image so as to display the processed image as a photographed image.

4. The image processing method according to claim 1, wherein the acquiring a RAW image packet, the RAW image packet including at least two frames of RAW images, the at least two frames of RAW images being images acquired in a target scene and having different exposure times, comprises: acquiring a RAW image packet, wherein the RAW image packet comprises a first RAW image and a second RAW image which are sequentially exposed, the first RAW image and the second RAW image are images acquired under a target scene, and the exposure time of the first RAW image is longer than that of the second RAW image;

unpacking the RAW image packet to obtain the at least two frames of RAW images, including: unpacking the RAW image packet to obtain the first RAW image and the second RAW image;

synthesizing the at least two frames of RAW images to obtain a RAW synthesized image with a high dynamic range, comprising: and synthesizing the first RAW image and the second RAW image to obtain a RAW synthesized image with a high dynamic range.

5. The image processing method according to claim 1, wherein when the photographing instruction is received, acquiring a multi-frame historical cache image of the target scene from the preset image cache queue comprises:

when a photographing instruction is received, determining a target number according to the operation parameter value, wherein the target number is greater than or equal to 2;

and obtaining the historical cache images of the target number from the preset image cache queue, wherein the historical cache images are images of the target scene.

6. The image processing method according to claim 1, wherein the preset image buffer queue is a fixed-length queue.

7. An image processing apparatus characterized by comprising:

the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a RAW image packet, the RAW image packet comprises at least two frames of RAW images, and the at least two frames of RAW images are images acquired in a target scene and have different exposure time;

the unpacking module is used for unpacking the RAW image packet to obtain the at least two frames of RAW images;

the synthesis module is used for synthesizing the at least two frames of RAW images to obtain a RAW synthesized image with a high dynamic range;

the second acquisition module is used for acquiring an operation parameter value of the electronic equipment, wherein the operation parameter value is used for representing the computing capacity of the electronic equipment;

the cache module is used for determining that the RAW synthetic image is stored in a preset image cache queue in the target scene if the operation parameter value indicates that the computing capability of the electronic equipment is higher than a preset threshold value; if the operation parameter value indicates that the computing power of the electronic equipment is not higher than a preset threshold value, determining that the RAW synthetic image is converted into a YUV synthetic image in the target scene and then storing the YUV synthetic image into a preset image cache queue;

the processing module is used for acquiring a multi-frame historical cache image of a target scene from the preset image cache queue when a photographing instruction is received, and performing multi-frame noise reduction processing on the multi-frame historical cache image to obtain a noise reduction image;

and the response module is used for responding to the photographing instruction according to the noise-reduced image.

8. A storage medium having stored thereon a computer program, characterized in that the computer program, when executed on a computer, causes the computer to execute the method according to any of claims 1 to 6.

9. An electronic device comprising a memory, a processor, wherein the processor is configured to perform the method of any of claims 1 to 6 by invoking a computer program stored in the memory.

Images