WO2023005336A1

WO2023005336A1 - Image processing method and apparatus, and storage medium and electronic device

Info

Publication number: WO2023005336A1
Application number: PCT/CN2022/092037
Authority: WO
Inventors: 杨平平
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-07-28
Filing date: 2022-05-10
Publication date: 2023-02-02
Also published as: CN115696059A

Abstract

An image processing method. The method comprises: acquiring original data of an initial image, and sending same to a first image processor; the first image processor compressing the original data of the initial image, so as to obtain compressed data, and sending the compressed data to a second image processor; the second image processor decompressing the compressed data, so as to obtain restored data; and extracting YUV data from the restored data, and encoding the YUV data to generate a target image.

Description

Image processing method, device, storage medium and electronic equipment

This application claims the priority of the Chinese patent application with the application number 202110857728.6 and the application name "image processing method, device, storage medium and electronic equipment" submitted to the Patent Office on July 28, 2021, the entire contents of which are incorporated by reference in In this application.

technical field

The present application belongs to the technical field of image processing, and in particular relates to an image processing method, device, storage medium and electronic equipment.

Background technique

With the development of terminal technology, the terminal has gradually changed from simply providing communication equipment in the past to a platform for general software operation. The platform no longer aims to provide call management, but to provide an operating environment including call management, game entertainment, office notes, mobile payment and other application software. With a large number of popularization, it has penetrated into people's All aspects of life and work.

At present, as the hardware performance of smart terminals is getting higher and higher, especially the specifications of camera sensors are getting better and better, and the imaging quality is getting higher and higher.

Contents of the invention

The present application provides an image processing method, device, storage medium and electronic equipment, which can reduce the amount of data to be transmitted, reduce the pressure on the image processing chip to transmit data, and thereby improve image processing efficiency.

In the first aspect, an embodiment of the present application provides an image processing method, which is applied to an electronic device, and the electronic device includes a first image processor and a second image processor, including:

acquiring raw data of an initial image and sending it to the first image processor;

The first image processor compresses the original data of the initial image, obtains compressed data, and sends the compressed data to the second image processor;

The second image processor decompresses the compressed data to obtain restored data;

extracting YUV data in the restored data, and encoding the YUV data to generate a target image.

In a second aspect, an embodiment of the present application provides an image processing apparatus, which is applied to an electronic device, and the electronic device includes a first image processor and a second image processor, including:

an acquisition module, configured to acquire the original data of the initial image and send it to the first image processor;

a compression module, configured for the first image processor to compress the original data of the initial image, obtain compressed data and send the compressed data to the second image processor;

A decompression module, used for the second image processor to decompress the compressed data to obtain restored data;

A generating module, configured to extract YUV data in the restored data, and encode the YUV data to generate a target image.

In a third aspect, the embodiment of the present application provides a storage medium on which a computer program is stored, and when the computer program is run on a computer, the computer is made to execute the above-mentioned image processing method.

In a fourth aspect, an embodiment of the present application provides an electronic device, including a first image processor, a second image processor, a central processing unit, and a memory, the memory stores a plurality of instructions, and the central processing unit loads the Instructions in memory are used to perform the following steps:

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those skilled in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a schematic flowchart of an image processing method provided by an embodiment of the present application.

FIG. 2 is another schematic flowchart of the image processing method provided by the embodiment of the present application.

FIG. 3 is a schematic structural diagram of an image processing device provided by an embodiment of the present application.

FIG. 4 is another schematic structural diagram of an image processing device provided by an embodiment of the present application.

FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

FIG. 6 is another schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

Referring to the drawings, wherein the same reference numerals represent the same components, the principles of the present application are exemplified by being implemented in a suitable computing environment. The following description is based on illustrated specific embodiments of the present application, which should not be construed as limiting other specific embodiments of the present application that are not described in detail here.

In the following description, specific embodiments of the present application will be described with reference to steps and symbols executed by one or more computers, unless otherwise stated. Accordingly, these steps and operations will several times be referred to as being computer-implemented, which herein refers to operations by a computer processing unit of electronic signals representing data in a structured form. This operation transforms the data or maintains it at a location in the computer's memory system that can reconfigure or otherwise alter the operation of the computer in a manner well known to testers in the art. The data structures maintained by the data are physical locations in the memory that have certain characteristics defined by the data format. However, the principle of the present application is described in the above text, which is not meant to be a limitation, and testers in the field will understand that the various steps and operations described below can also be implemented in hardware.

The terms "first", "second" and "third" in this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "include" and "have", as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or modules is not limited to the listed steps or modules, but some embodiments also include steps or modules that are not listed, or some embodiments Other steps or modules inherent to these processes, methods, products or devices are also included.

An embodiment of the present application provides an image processing method, which is applied to an electronic device, and the electronic device includes a first image processor and a second image processor, wherein the method includes the following steps:

In one embodiment, the step of compressing the original data of the initial image by the first image processor includes:

The first image processor acquires the shooting scene corresponding to the initial image;

A target compression rate is determined according to the shooting scene, and the original data of the initial image is compressed at the target compression rate.

In an embodiment, the shooting scene includes a shooting mode and camera parameters, wherein the step of determining the target compression rate according to the shooting scene includes:

Searching for the same shooting scene sample as the shooting mode and camera parameters in the preset corresponding relationship;

A preset compression rate corresponding to the shooting scene sample is obtained, and determined as the target compression rate.

In one embodiment, the step of sending the compressed data to the second image processor includes:

and transmitting the compressed data to the second image processor through MIPI.

In an embodiment, before the first image processor compresses the raw data of the initial image, the method further includes:

If the initial image is multi-frame, then select a reference frame image from the multi-frame initial image;

The multi-frame initial images are synthesized according to the reference frame images.

In one embodiment, the step of selecting a reference frame image from the multiple frames of initial images includes:

An image with the highest average brightness is selected from the multiple frames of initial images as the reference frame image.

A compression mode is determined according to the shooting scene, and the original data of the initial image is compressed in the compression mode, and the compression mode includes lossless compression and lossy compression.

In one embodiment, after encoding the YUV data to generate a target image, the method further includes:

performing noise reduction processing on the target image, and performing tone mapping processing on the image after noise reduction processing, and displaying the image after tone mapping on the screen of the electronic device as a preview image.

Please refer to FIG. 1 . FIG. 1 is a schematic flowchart of an image processing method provided in an embodiment of the present application. The image processing method provided in the embodiment of the present application is applied to an electronic device, and the electronic device includes a first image processor and a second image processor, and the specific process may be as follows:

Step 101, acquire the original data of the initial image and send it to the first image processor.

In an embodiment, the above initial image may be an image of the current scene acquired by the imaging device of the electronic device when shooting. The imaging device may be a front camera, a rear camera, and the like. Start the imaging device of the electronic device, make it enter the photo preview mode, and display the captured scene on the display window of the electronic device, and define the picture displayed in the display window as a preview image. Among them, the hardware of the imaging device generally includes five parts: a housing (motor), a lens, an infrared filter, an image sensor (such as CCD or COMS), and a flexible printed circuit board (FPCB). In the photo preview mode, during the process of displaying the preview image, the lens moves under the drive of the motor, and the object to be photographed passes through the lens and forms an image on the image sensor. The image sensor converts the optical signal into an electrical signal through optical-electrical conversion and sends it to the image processing circuit for subsequent processing. Wherein, the image processing circuit may be realized by hardware and/or software components, and may include various processing units defining an ISP (Image Signal Processing, image signal processing) pipeline.

In one embodiment, the initial image acquired by the camera sensor can be transmitted to the first image processor through the MIPI (Mobile Industry Processor Interface, mobile industry processor interface) protocol, wherein the above-mentioned first image processor is preISP, used for pre-image processing. For example, the initial image can be transmitted using MIPI protocol VCO, all data is sent out by line.

Step 102, the first image processor compresses the original data of the initial image, obtains compressed data, and sends the compressed data to the second image processor.

In one embodiment, the above-mentioned initial image is a Raw image, and the Raw image is the original data converted from the light source signal captured by the CMOS or CCD image sensor into a digital signal. When the first image processor receives the initial image and determines that the reception is complete, the initial image may be compressed and sent to the second image processor after compression, and the second image processor may be an ISP.

Specifically, in the prior art, if the initial image data captured by the camera sensor is directly transmitted to the ISP for processing, the amount of data is relatively large. Take the camera sensor output image size of 100 million pixels, the frame rate of 30 frames in 1 second, and 8 bits per pixel as an example. When transmitting through the MIPI interface, the amount of MIPI data in one second can be known by calculation. 22.35GB. Now, the mainstream platform SM8150 on the market is the Qualcomm Snapdragon 855 processor. This platform supports two physical layers of ports: D-PHY and C-PHY. It is calculated that the platform bandwidth of D-PHY within one second is about 9GB, the platform bandwidth of D-PHY within one second is about 21.56GB, so they are both smaller than the actual transmission capacity of 22.35Gb, so a single CSI (C-PHY/D-PHY) of SM8150 cannot meet the 100 million pixel output of the camera sensor. The general practice in the prior art is to use Binning technology to zoom. Binning is an image readout mode that adds the charges induced by adjacent pixels together and reads out in a pixel mode, which improves sensitivity and output speed, and reduces resolution. For example, the camera sensor outputs a 108M image and after Binning, it outputs a 27M Bayer image, the ISP processes the 27M Bayer image, outputs a 27M YUV image, and the YUV image outputs a 108M image through super-resolution technology. However, this method will reduce the resolution of the image and produce some mosaic areas in the image.

Therefore, in order to solve the above problem, the embodiment of the present application may use the first image processor to compress the original image, for example, to perform lossless compression. The lossless compression refers to decompressing the compressed image data, and the decompressed data is exactly the same as the original data. Lossless compression can make the reconstructed data exactly the same as the original data. The aforementioned lossless compression method may include one of LZ77 algorithm, LZ78 algorithm, LZW algorithm, LZSS algorithm, Huffman coding algorithm, and Shannon-Fano coding algorithm. The image quality is the same after compression as uncompressed, but the resulting file size is approximately 30% to 90% (14-bit RAW), or 45% to 100% (16-bit RAW) of the uncompressed size.

Further, after the first image processor finishes compressing the initial image, it can be sent to the second image processor, for example, the compressed data is sent to the ISP through the MIPI protocol VCO.

In an embodiment, the compression can be performed according to a preset compression ratio, such as 70% or 80, and the preset compression ratio can be set according to the capacity of the image data. Furthermore, after the compression is completed, it can be further judged whether the compressed data meets the preset compression rate. If the ratio of the compressed data size to the pre-compressed data size is not greater than the compression rate, it means that the compression is successful; if the compressed If the ratio of the post-compression data size to the pre-compression data size is greater than the compression ratio, it means that the compression fails.

Step 103, the second image processor decompresses the compressed data to obtain restored data.

In one embodiment, the second image processor first receives the compressed data and directly stores it in the memory, and decompresses it after receiving all the compressed data. The memory can be Synchronous Dynamic Random Access Memory (Synchronous Dynamic Random Access Memory, SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (Double Data Rate SDRAM, DDR SDRAM), Synchronous Graphics Random-Access Memory (SGRAM) or Double rate synchronous graphics random access memory (Double Data Rate SGRAM, DDR SGRAM), etc.

Specifically, through data decompression, the compressed data stored in the image can be decompressed and restored to RAW-DATA, that is, restored data. It should be noted that after data compression, the first image processor also needs to perform data encapsulation. Image data encapsulation uses data to describe actual image data. This type of data is called metadata, which mainly describes data attribute information. After the data is encapsulated, the output is an image file. Therefore, after the second image processor performs decompression, the specific location of the data code stream can be located through the metadata. In addition, you can also judge which compression method is used by the current file through the file suffix name or the metadata generated by the package (for example, the first few bytes of the image file in PBM, PGM, and PPM formats will indicate that the image is It belongs to what type, for example, PBM is P1 or P4, etc.), so as to determine which decompression method should be used to restore the data. Finally, the data code stream is decompressed and restored, and the final output is the RAW-DATA of the image.

Step 104, extracting YUV data in the restored data, and encoding the YUV data to generate a target image.

In an embodiment, data conversion may be performed on the Raw image first to obtain a YUV image, and then a video encoder is used to encode the YUV image to obtain a target image. Wherein, the input target image may be a JPG image or a JPEG image or the like.

In one embodiment, after the target image is generated, it can be displayed as a preview image on the screen of the electronic device. Further, after the target image is generated, subsequent processing may be performed on the target image, such as noise reduction processing, and then the electronic device may perform tone mapping processing (Tone Mapping) on the noise reduction image to obtain a final image. It can be understood that performing tone mapping processing on the noise-reduced image can improve the image contrast of the image, so that the target image has a higher dynamic range and better imaging effect. The electronic device may also display the tone-mapped image on the screen of the electronic device as a preview image of the current scene.

It can be understood that when the actual resolution of the preview image is greater than the resolution of the screen display, a better display effect will not be obtained compared with the case where the actual resolution of the preview image is equal to the resolution of the screen display. Therefore, before the preview image is displayed on the screen of the electronic device, the current resolution of the screen can also be obtained first, and then the preview image is down-sampled according to the current resolution of the screen, so that the resolution of the preview image is the same as that of the screen. The current resolution is the same. In this way, the synthesis efficiency of multi-frame synthesis can be improved, and when the preview image is displayed, its display effect will not be reduced.

It can be seen from the above that the image processing method provided by the embodiment of the present application can obtain the original data of the initial image and send it to the first image processor, and the first image processor will compress the original data of the initial image to obtain compressed data and compress the data Send to the second image processor, the second image processor decompresses the compressed data to obtain the restored data, extracts the YUV data in the restored data, and encodes the YUV data to generate the target image. In the embodiment of the present application, the original data of the initial image may be compressed by the first image processor and then sent to the second image processor for image processing, so as to reduce the amount of transmitted data and improve the efficiency of image processing.

The image processing method of the present application will be further introduced below on the basis of the methods described in the above embodiments. Referring to FIG. 2, FIG. 2 is another schematic flow chart of the image processing method provided by the embodiment of the present application. The image processing method includes:

Step 201, acquire the original data of the initial image and send it to the first image processor.

In an embodiment, the above initial image may be an image of the current scene acquired by the camera sensor of the electronic device when shooting. The initial image acquired by the camera sensor can be transmitted to the first image processor through the MIPI (Mobile Industry Processor Interface, Mobile Industry Processor Interface) protocol, wherein the above-mentioned first image processor is preISP.

Step 202, if the initial image is multi-frame, select a reference frame image from the multi-frame initial image.

In step 203, multiple frames of initial images are synthesized according to the reference frame images.

In an embodiment, if the initial image consists of multiple frames, a high dynamic range image may be acquired through multi-frame synthesis and used as the initial image after synthesis. The above-mentioned multiple frames of images may be images captured multiple times by one camera according to different shooting parameters, or may be images obtained by shooting separately by multiple cameras according to different shooting parameters. For example, the above-mentioned shooting parameters may be exposure parameters, and the exposure parameters include an exposure value (ie, commonly known as an EV value) or an exposure duration. When acquiring multi-frame initial images of the current scene according to different exposure parameters, the electronic device may acquire multi-frame initial images of the current scene in a manner in which the preset short exposure time and long exposure time overlap. In other words, among two adjacently exposed initial images, one initial image is a short-exposure image, and the other initial image is a long-exposure image. In this way, the first high dynamic range image of the current scene can be synthesized by means of long-exposure and short-exposure synthesis.

As another optional implementation manner, when acquiring multiple frames of initial images of the current scene according to different exposure parameters, the electronic device may also acquire multiple frames of initial images of the current scene according to different exposure values, wherein the electronic device may acquire multiple frames of initial images of the current scene according to The preset overexposure value and preset underexposure value respectively expose the current scene to obtain two initial images of the current scene. The scene is exposed, and three initial images of the current scene are obtained.

After obtaining multiple frames of initial images, one image can be further selected as a reference frame, for example, the image with the highest average brightness can be selected as a reference frame, and then multiple frames of initial images are synthesized based on the reference frame.

In step 204, the first image processor acquires the shooting scene corresponding to the synthesized initial image.

Step 205, determine the target compression rate according to the shooting scene, and compress the original data of the initial image with the target compression rate.

In the embodiment of the present application, when compressing the initial image, the first image processor, that is, preISP, can also be used to conveniently obtain the characteristics of the shooting scene of the camera, and determine the corresponding target compression rate according to the shooting scene. For example, the shooting scene can include a shooting mode. For the normal shooting mode, a higher target compression rate can be used for compression. For the night scene shooting mode, since night scene shooting requires more accurate image information, a lower target compression ratio can be used. The target compression ratio for compression.

In another embodiment, the corresponding target compression rate may also be determined according to the parameters of the camera. For example, for the main camera with high camera quality, use a lower target compression rate for compression, and for other cameras such as macro cameras, telephoto cameras, etc., you can use a higher target compression rate for compression. Of course, the above-mentioned shooting modes and camera parameters can also be combined to make a comprehensive judgment, and finally determine the target compression rate. That is to say, the shooting scene includes shooting mode and camera parameters, wherein, the step of determining the target compression rate according to the shooting scene includes:

In an embodiment, different compression methods can also be selected for compression according to the shooting scene, wherein the compression methods include lossless compression and lossy compression. The image quality of lossless compression is the same as that of uncompressed, but The file size is about 30% to 90% (14-bit RAW), or 45% to 100% (16-bit RAW) of the uncompressed, lossless compression. After compressing the RAW image, the image quality is about the same as the uncompressed, But the resulting file size is about 25% to 35% (14-bit RAW), or 30% to 40% (16-bit RAW) of its uncompressed size. For example, lossless compression is used for scenes that require more accurate image information, while lossy compression can be used for other scenes, so as to further reduce the capacity of image data and improve subsequent image processing efficiency.

Step 206, transmit the compressed data to the second image processor via MIPI.

In the embodiment of the present application, the preISP can be sent to the second image processor after being compressed, and the second image processor can be an ISP. Specifically, the compressed data can be sent to the ISP through the MIPI protocol VCO. At this time, the first image processor at the front end, that is, preISP, is used to compress and convert the high-bandwidth image data into image data with a greatly reduced data volume, and then send it to the back-end ISP through MIPI, and then send it to the ISP pipeline for processing after decompression. Reduce bandwidth requirements without reducing size.

Step 207, the second image processor decompresses the compressed data to obtain restored data.

In one embodiment, the second image processor first receives the compressed data and directly stores it in the memory, and decompresses it after receiving all the compressed data. Wherein the memory may be a double rate synchronous graphic random access memory. Through data decompression, the compressed data stored in the image can be decompressed and restored to RAW-DATA, that is, restored data.

Step 208, extract the YUV data in the restored data, and encode the YUV data to generate the target image.

In an embodiment, data conversion may be performed on the Raw image first to obtain a YUV image, and then a video encoder is used to encode the YUV image to obtain a target image. Wherein, the input target image may be a JPG image.

For the low-end platforms currently on the market, the general platform ISP supports multiple CSIs, but one CSI does not support excessive data volume such as 100 million pixel images, and multiple merging can be supported. However, the camera sensor does not support simultaneous output to Multiple CSIs. However, after splitting the data by preISP, this application uses each CSI to share part of the data volume, so as not to violate the transmission quantity of each protocol.

It can be seen from the above that the image processing method provided by the embodiment of the present application can obtain the original data of the initial image and send it to the first image processor. The frame image synthesizes multiple frames of initial images, the first image processor obtains the shooting scene corresponding to the synthesized initial image, determines the target compression rate according to the shooting scene, and compresses the original data of the initial image with the target compression rate, and moves The industrial processor interface MIPI transmits the compressed data to the second image processor, and the second image processor decompresses the compressed data to obtain the restored data, extracts the YUV data in the restored data, and encodes the YUV data to generate the target image. In the embodiment of the present application, the original data of the initial image may be compressed by the first image processor and then sent to the second image processor for image processing, so as to reduce the amount of transmitted data and improve the efficiency of image processing.

Please refer to FIG. 3 . FIG. 3 is a schematic structural diagram of an image processing device provided by an embodiment of the present application. Wherein the image processing device 30 is applied to an electronic device, and the electronic device includes a first image processor and a second image processor, including:

An acquisition module 301, configured to acquire the original data of the initial image and send it to the first image processor;

A compression module 302, configured for the first image processor to compress the original data of the initial image, obtain compressed data and send the compressed data to the second image processor;

a decompression module 303, configured for the second image processor to decompress the compressed data to obtain restored data;

The generating module 304 is configured to extract YUV data in the restored data, and encode the YUV data to generate a target image.

In an embodiment, continue to refer to FIG. 4, wherein the compression module 302 may specifically include:

An acquisition submodule 3021, configured for the first image processor to acquire the shooting scene corresponding to the initial image;

The compression sub-module 3022 is configured to determine a target compression rate according to the shooting scene, and compress the original data of the initial image with the target compression rate to obtain compressed data;

The sending submodule 3023 is configured to send the compressed data to the second image processor.

In an embodiment, the image processing device 30 may further include:

A selection module 305, configured to select a reference frame image from the multi-frame initial image when the initial image is multi-frame;

The synthesis module 306 is configured to synthesize the multiple frames of initial images according to the reference frame images.

In an embodiment, the shooting scene includes a shooting mode and camera parameters, and the compression submodule 3022 can also be used to: search for a shooting scene sample that is the same as the shooting mode and camera parameters in a preset correspondence; obtain the The preset compression ratio corresponding to the shooting scene sample is determined as the target compression ratio.

In an embodiment, the sending submodule 3023 may also be configured to: transmit the compressed data to the second image processor through a mobile industry processor interface MIPI.

In an embodiment, the selection module 305 may also be configured to: select an image with the highest average brightness from the multiple frames of initial images as the reference frame image.

In an embodiment, the compression submodule 3022 can also be used to: determine a compression method according to the shooting scene, and compress the original data of the initial image in the compression method, the compression method includes lossless compression and lossy compression.

In an embodiment, the generation module 304 may also be configured to: perform noise reduction processing on the target image, perform tone mapping processing on the image after noise reduction processing, and display the image after tone mapping as a preview image on the target image. on the screen of the above-mentioned electronic device.

It can be seen from the above that the image processing device 30 of the embodiment of the present application can acquire the original data of the initial image and send it to the first image processor, and the first image processor compresses the original data of the initial image to obtain compressed data and compress the data Send to the second image processor, the second image processor decompresses the compressed data to obtain the restored data, extracts the YUV data in the restored data, and encodes the YUV data to generate the target image. In the embodiment of the present application, the original data of the initial image may be compressed by the first image processor and then sent to the second image processor for image processing, so as to reduce the amount of transmitted data and improve the efficiency of image processing.

In the embodiment of the present application, the image processing device and the image processing method in the above embodiments belong to the same concept, and any method provided in the image processing method embodiment can be run on the image processing device, and its specific implementation process can be found in image processing The embodiment of the method will not be repeated here.

The term "module" as used herein may be considered a software object that executes on the computing system. The various components, modules, engines and services described herein can be considered as implementation objects on the computing system. The devices and methods described herein can be implemented in the form of software, and of course can also be implemented in hardware, all of which are within the protection scope of the present application.

The embodiment of the present application also provides a storage medium on which a computer program is stored, and when the computer program is run on a computer, the computer is made to execute the above-mentioned image processing method.

The embodiment of the present application also provides an electronic device, such as a tablet computer, a mobile phone, and the like. The electronic device includes a first image processor, a second image processor, a central processing unit and a memory, and the central processor in the electronic device will load instructions corresponding to the process of one or more application programs into the memory according to the following steps In, and by the central processing unit to run the application program stored in the memory, so as to achieve various functions:

Reference herein to an "embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The occurrences of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments.

Referring to FIG. 5 , an electronic device 400 includes a processor 401 and a memory 402 . Wherein, the processor 401 is electrically connected with the memory 402 .

The processor 400 is the control center of the electronic device 400. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or loading computer programs stored in the memory 402 and calling data stored in the memory 402, the processor 400 executes electronic functions. various functions of the device 400 and process data, so as to monitor the electronic device 400 as a whole.

The memory 402 can be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by running the computer programs and modules stored in the memory 402 . The memory 402 can mainly include a program storage area and a data storage area, wherein the program storage area can store operating systems, computer programs required by at least one function (such as sound playback function, image playback function, etc.); Data created by the use of electronic devices, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage devices. Correspondingly, the memory 402 may further include a memory controller to provide the processor 401 with access to the memory 402 .

In this embodiment of the application, the processor 401 in the electronic device 400 will follow the steps below to load the instructions corresponding to the process of one or more computer programs into the memory 402, and run the instructions stored in the memory 402 by the processor 401. The computer program in the computer, so as to realize various functions, as follows:

In an embodiment, when the processor 401 executes the step of compressing the original data of the initial image by the first image processor, it may execute: the first image processor acquires the Shooting a scene; determining a target compression rate according to the shooting scene, and compressing the original data of the initial image with the target compression rate.

In an embodiment, the shooting scene includes a shooting mode and camera parameters, and when the processor 401 executes the step of determining the target compression rate according to the shooting scene, it may perform: searching A shooting scene sample with the same mode and camera parameters; obtaining a preset compression rate corresponding to the shooting scene sample, and determining it as the target compression rate.

In an embodiment, when the processor 401 executes the step of sending the compressed data to the second image processor, it may perform: transmit the compressed data to the second image processor through the mobile industry processor interface MIPI image processor.

In an embodiment, before the first image processor compresses the original data of the original image, the processor 401 may execute: if the initial image is multi-frame, from the multi-frame A reference frame image is selected from the initial image; and the multi-frame initial image is synthesized according to the reference frame image.

In an embodiment, when the processor 401 executes the step of selecting a reference frame image from the multiple frames of initial images, it may perform: selecting an image with the highest average brightness from the multiple frames of initial images as the reference frame image.

In an embodiment, when the processor 401 executes the step of compressing the original data of the initial image by the first image processor, it may execute: the first image processor acquires the Shooting the scene; determining a compression method according to the shooting scene, and compressing the original data of the initial image in the compression method, the compression method includes lossless compression and lossy compression.

In an embodiment, after the processor 401 encodes the YUV data to generate a target image, it may perform: performing noise reduction processing on the target image, and performing tone mapping processing on the image after the noise reduction processing , and display the tone-mapped image on the screen of the electronic device as a preview image.

Please refer to FIG. 6 together. In some embodiments, the electronic device 400 may further include: a display 403 , a radio frequency circuit 404 , an audio circuit 405 and a power supply 406 . Wherein, the display 403 , the radio frequency circuit 404 , the audio circuit 405 and the power supply 406 are respectively electrically connected to the processor 401 .

The display 403 can be used to display information input by or provided to the user and various graphical user interfaces, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. The display 403 may include a display panel. In some implementation manners, the display panel may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD) or an organic light-emitting diode (Organic Light-Emitting Diode, OLED).

The radio frequency circuit 404 can be used to send and receive radio frequency signals to establish wireless communication with network equipment or other electronic equipment through wireless communication, and to send and receive signals with network equipment or other electronic equipment. Generally, the radio frequency circuit 501 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM, Subscriber Identity Module) card, a transceiver, a coupler, a low noise amplifier (LNA, Low Noise Amplifier), duplexer, etc.

The audio circuit 405 can be used to provide an audio interface between the user and the electronic device through a speaker or a microphone. The audio circuit 506 can convert the received audio data into an electrical signal, transmit it to the speaker, and convert it into an audio signal for output by the speaker.

The power supply 406 may be used to power various components of the electronic device 400 . In some embodiments, the power supply 406 can be logically connected to the processor 401 through a power management system, so as to implement functions such as managing charging, discharging, and power consumption through the power management system. The power supply 406 may also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

Although not shown in FIG. 6 , the electronic device 400 may also include a camera, a Bluetooth module, etc., which will not be repeated here.

In the embodiment of the present application, the storage medium may be a magnetic disk, an optical disk, a read only memory (Read Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.

It should be noted that for the image processing method of the embodiment of the present application, ordinary testers in the field can understand that all or part of the process of implementing the image processing method of the embodiment of the present application can be completed by controlling the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, such as stored in the memory of an electronic device, and executed by at least one processor in the electronic device. process. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory, a random access memory, and the like.

For the image processing device of the embodiment of the present application, its various functional modules may be integrated into one processing chip, or each module may exist separately physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. If the integrated modules are implemented in the form of software function modules and sold or used as independent products, they can also be stored in a computer-readable storage medium, such as a read-only memory, magnetic disk or optical disk.

An image processing method, device, storage medium, and electronic equipment provided by the embodiments of the present application have been described in detail above. In this paper, specific examples are used to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only It is used to help understand the method and its core idea of this application; at the same time, for those skilled in the art, according to the idea of this application, there will be changes in the specific implementation and application scope. In summary, this specification The content should not be construed as a limitation of the application.

Claims

An image processing method applied to an electronic device, the electronic device comprising a first image processor and a second image processor, wherein the method includes the following steps:

acquiring raw data of an initial image and sending it to the first image processor;

The first image processor compresses the original data of the initial image, obtains compressed data, and sends the compressed data to the second image processor;

The second image processor decompresses the compressed data to obtain restored data;

extracting YUV data in the restored data, and encoding the YUV data to generate a target image.
The image processing method according to claim 1, wherein the step of compressing the original data of the initial image by the first image processor comprises:

The first image processor acquires the shooting scene corresponding to the initial image;

A target compression rate is determined according to the shooting scene, and the original data of the initial image is compressed at the target compression rate.
The image processing method according to claim 2, wherein the shooting scene includes a shooting mode and camera parameters, wherein the step of determining the target compression rate according to the shooting scene includes:

Searching for the same shooting scene sample as the shooting mode and camera parameters in the preset corresponding relationship;

A preset compression rate corresponding to the shooting scene sample is obtained, and determined as the target compression rate.
The image processing method according to claim 1, wherein the step of sending the compressed data to the second image processor comprises:

and transmitting the compressed data to the second image processor through MIPI.
The image processing method according to claim 1, wherein, before the first image processor compresses the original data of the initial image, the method further comprises:

If the initial image is multi-frame, then select a reference frame image from the multi-frame initial image;

The multi-frame initial images are synthesized according to the reference frame images.
The image processing method according to claim 5, wherein the step of selecting a reference frame image from the multi-frame initial image comprises:

An image with the highest average brightness is selected from the multiple frames of initial images as the reference frame image.
The image processing method according to claim 1, wherein the step of compressing the original data of the initial image by the first image processor comprises:

The first image processor acquires the shooting scene corresponding to the initial image;

A compression mode is determined according to the shooting scene, and the original data of the initial image is compressed in the compression mode, and the compression mode includes lossless compression and lossy compression.
The image processing method according to claim 1, wherein, after encoding the YUV data to generate a target image, the method further comprises:

performing noise reduction processing on the target image, and performing tone mapping processing on the image after noise reduction processing, and displaying the image after tone mapping on the screen of the electronic device as a preview image.
An image processing device, applied to an electronic device, the electronic device includes a first image processor and a second image processor, wherein the device includes:

an acquisition module, configured to acquire the original data of the initial image and send it to the first image processor;

a compression module, configured for the first image processor to compress the original data of the initial image, obtain compressed data and send the compressed data to the second image processor;

A decompression module, used for the second image processor to decompress the compressed data to obtain restored data;

A generating module, configured to extract YUV data in the restored data, and encode the YUV data to generate a target image.
The image processing device according to claim 9, wherein the compression module specifically comprises:

An acquisition submodule, configured to control the first image processor to acquire the shooting scene corresponding to the initial image;

A compression submodule, configured to determine a target compression rate according to the shooting scene, and compress the original data of the initial image with the target compression rate to obtain compressed data;

A sending submodule, configured to send the compressed data to the second image processor.
The image processing device according to claim 9, wherein the device further comprises:

A selection module, configured to select a reference frame image from the multi-frame initial image when the initial image is multiple frames;

A synthesis module, configured to synthesize the multi-frame initial images according to the reference frame images.
A storage medium, on which a computer program is stored, wherein, when the computer program is run on a computer, the computer is made to execute the image processing method according to any one of claims 1 to 8.
An electronic device, comprising a first image processor, a second image processor, a central processing unit and a memory, wherein the memory stores a plurality of instructions, wherein the central processing unit loads the instructions in the memory for execution The following steps:

acquiring raw data of an initial image and sending it to the first image processor;

The first image processor compresses the original data of the initial image, obtains compressed data, and sends the compressed data to the second image processor;

The second image processor decompresses the compressed data to obtain restored data;

extracting YUV data in the restored data, and encoding the YUV data to generate a target image.
The electronic device according to claim 13, wherein the central processing unit is further configured to execute:

The first image processor acquires the shooting scene corresponding to the initial image;

A target compression rate is determined according to the shooting scene, and the original data of the initial image is compressed at the target compression rate.
The electronic device according to claim 14, wherein the central processing unit is further configured to execute:

Searching for the same shooting scene sample as the shooting mode and camera parameters in the preset corresponding relationship;

A preset compression rate corresponding to the shooting scene sample is obtained, and determined as the target compression rate.
The electronic device according to claim 13, wherein the central processing unit is further configured to execute:

and transmitting the compressed data to the second image processor through MIPI.
The electronic device according to claim 13, wherein the central processing unit is further configured to execute:

If the initial image is multi-frame, then select a reference frame image from the multi-frame initial image;

The multi-frame initial images are synthesized according to the reference frame images.
The electronic device according to claim 17, wherein the central processing unit is further configured to execute:

An image with the highest average brightness is selected from the multiple frames of initial images as the reference frame image.
The electronic device according to claim 13, wherein the central processing unit is further configured to execute:

The first image processor acquires the shooting scene corresponding to the initial image;

A compression mode is determined according to the shooting scene, and the original data of the initial image is compressed in the compression mode, and the compression mode includes lossless compression and lossy compression.
The electronic device according to claim 13, wherein the central processing unit is further configured to execute:

performing noise reduction processing on the target image, and performing tone mapping processing on the image after noise reduction processing, and displaying the image after tone mapping on the screen of the electronic device as a preview image.