WO2024088163A1

WO2024088163A1 - Image processing method and circuit, device, and medium

Info

Publication number: WO2024088163A1
Application number: PCT/CN2023/125564
Authority: WO
Inventors: 王海
Original assignee: 维沃移动通信有限公司
Priority date: 2022-10-24
Filing date: 2023-10-20
Publication date: 2024-05-02
Also published as: CN115665562A

Abstract

Disclosed in the present application are an image processing method and circuit, a device, and a medium, belonging to the technical field of image processing. The image processing method comprises: when ambient brightness is greater than a brightness threshold, a first chip receives a first image and a second image which are sent by an image sensor; the first chip performs image fusion processing on the first image and the second image to obtain a third image, and sends to a second chip the third image; and when the ambient brightness is less than or equal to the brightness threshold, the first chip receives a fourth image sent by the image sensor and sends to the second chip the fourth image.

Description

Image processing method, circuit, device and medium

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Chinese patent application No. 202211301287.2 filed in China on October 24, 2022, the entire contents of which are incorporated herein by reference.

Technical Field

The present application belongs to the field of image processing technology, and specifically relates to an image processing method, circuit, device and medium.

Background technique

With the continuous development of electronic devices, users have higher requirements on the imaging capabilities of electronic devices, requiring that images taken in brighter external environments have a higher dynamic range, and images taken in darker external environments have better brightness and less noise.

In the related art, when the brightness of the external environment changes, the working mode of the image sensor and the image pipeline state cannot be switched automatically. In order to obtain a better image, the user needs to manually exit shooting and restart shooting to switch the working mode of the image sensor and the image pipeline state. However, manually switching the working mode of the image sensor and the image pipeline state is cumbersome and the image processing efficiency is low.

Summary of the invention

The purpose of the embodiments of the present application is to provide an image processing method, circuit, device and medium, which can solve the problem of low image processing efficiency.

In a first aspect, an embodiment of the present application provides an image processing method, comprising:

When the ambient brightness is greater than a brightness threshold, the first chip receives the first image and the second image sent by the image sensor;

The first chip performs image fusion processing on the first image and the second image to obtain a third image, and sends the third image to the second chip;

When the ambient brightness is less than or equal to the brightness threshold, the first chip receives the fourth image sent by the image sensor, and sends the fourth image to the second chip.

In a second aspect, an embodiment of the present application provides an image processing circuit, including:

A first chip and a second chip, the first chip comprising a first image receiving unit, an image fusion unit and a first image sending unit;

A first image receiving unit, configured to receive the first image and the second image sent by the image sensor when the ambient brightness is greater than a brightness threshold, and to receive the fourth image sent by the image sensor when the ambient brightness is less than or equal to the brightness threshold;

An image fusion unit, used for performing image fusion processing on the first image and the second image to obtain a third image;

The first image sending unit is used to send the third image or the fourth image to the second chip.

In a third aspect, an embodiment of the present application provides an electronic device comprising a processor, a memory and an image sensor, wherein the processor comprises the image processing circuit provided in the second aspect of the embodiment of the present application, and the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the image processing method described in the first aspect are implemented.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the image processing method described in the first aspect are implemented.

In a fifth aspect, an embodiment of the present application provides a chip, including a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the steps of the image processing method described in the first aspect.

In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the steps of the image processing method as described in the first aspect.

In the embodiment of the present application, when the ambient brightness is greater than the brightness threshold, the first chip receives the first image and the second image sent by the image sensor; the first chip performs image fusion processing on the first image and the second image to obtain a third image, and sends the third image to the second chip; when the ambient brightness is less than or equal to the brightness threshold, the first chip receives the fourth image sent by the image sensor, and sends the fourth image to the second chip. In this way, no matter whether the external environment of the electronic device is a bright environment or a dark environment, and the image sensor works in a bright environment working mode or a dark environment working mode, the second chip receives an image, and the second chip does not need to switch the image pipeline, which can improve the image processing efficiency.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a schematic diagram of an image processing process corresponding to an SHDR mode provided by a related art;

FIG2 is a schematic diagram of an image processing process corresponding to a Binning mode provided by a related art;

FIG3 is a schematic diagram of a flow chart of an image processing method provided in an embodiment of the present application;

FIG4 is a schematic diagram of a first process of image processing provided by an embodiment of the present application;

FIG5 is a schematic diagram of a second process of image processing provided by an embodiment of the present application;

FIG6 is a schematic diagram of an image processing process in a dark environment provided by an embodiment of the present application;

FIG7 is a schematic diagram of an image processing process in a bright environment provided by an embodiment of the present application;

FIG8 is a schematic diagram of the structure of an image processing circuit provided in an embodiment of the present application;

FIG9 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

FIG. 10 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

Detailed ways

The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and/or" in the specification and claims represents at least one of the connected objects, and the character "/" generally indicates that the objects associated with each other are in an "or" relationship.

The image sensor in the image acquisition unit (such as a camera) in the related technology provides two working modes: Stagger High Dynamic Range Imaging (SHDR) mode and Binning mode.

When the image sensor works in SHDR mode, for each frame of image collected by the image sensor, the image sensor will output two original, i.e., unprocessed (RAW) images to an image signal processor (ISP), the ISP performs RAW domain image processing on the two RAW images, and outputs the two images obtained after the RAW domain image processing to another ISP, the ISP performs YUV domain image processing on the two images, and fuses the two images obtained after the YUV domain image processing to obtain a high dynamic range (HDR) image, as shown in Figure 1, wherein the two RAW images include a long exposure (Long) RAW image and a short exposure (Short) RAW image; when the image sensor works in Binning mode, for each frame of image collected by the image sensor, the image sensor will output a RAW image to an ISP, the ISP performs RAW domain image processing on the RAW image, and outputs the image obtained after the RAW domain image processing to another ISP, the ISP performs YUV domain image processing on the image to obtain a high-brightness and low-noise image, as shown in Figure 2. In FIG. 1 and FIG. 2 , the two ISPs include ISP1 and ISP2.

When the image sensor works in SHDR mode, the current image pipeline of the image acquisition unit runs in the pipeline state of SHDR mode. In the pipeline state of SHDR mode, ISP1 needs to receive two images; when the image sensor works in Binning mode, the current image pipeline of the image acquisition unit runs in the pipeline state of Binning mode. In the pipeline state of Binning mode, ISP1 needs to receive one image.

When the brightness of the external environment changes, the working mode of the image sensor and the image pipeline state cannot be switched automatically. In order to obtain a better image, the user needs to manually exit shooting and restart shooting to switch the working mode of the image sensor and the image pipeline state. However, manually switching the working mode of the image sensor and the image pipeline state is cumbersome and the image processing efficiency is low.

In order to improve the efficiency of image processing, the embodiments of the present application provide an image processing method, circuit, device and medium. The image processing method, circuit, device and medium provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

FIG3 is a flow chart of an image processing method provided in an embodiment of the present application. As shown in FIG3 , the image processing method may include:

S301: When the ambient brightness is greater than a brightness threshold, the first chip receives a first image and a second image sent by an image sensor;

S302: The first chip performs image fusion processing on the first image and the second image to obtain a third image;

S303: Sending a third image to the second chip;

S304: When the ambient brightness is less than or equal to the brightness threshold, the first chip receives a fourth image sent by the image sensor;

S305: Sending the fourth image to the second chip.

The specific implementation of the above steps will be described in detail below.

In some possible implementations of the embodiments of the present application, the ambient brightness can be acquired when the image acquisition unit in the electronic device is started. For example, when the image acquisition unit in the electronic device is started, the ambient brightness is acquired by using a brightness sensor.

In some possible implementations of the embodiments of the present application, before S301 and S304, the image processing method provided by the embodiments of the present application may further include: the ambient brightness detection module receives image data sent by the image sensor, and performs ambient brightness detection based on the image data.

The embodiment of the present application does not limit the method used to detect ambient brightness based on image data, and any available method can be applied to the embodiment of the present application.

In the embodiment of the present application, the ambient brightness can be detected by the image data sent by the image sensor, and no brightness sensor is required, which can save costs.

In some possible implementations of the embodiments of the present application, before S301 and S304, the image processing method provided by the embodiments of the present application may further include: controlling the working mode of the image sensor according to the ambient brightness, wherein the working mode of the image sensor includes: a bright environment working mode or a dark environment working mode.

In some possible implementations of the embodiments of the present application, the bright environment working mode in the embodiments of the present application may be an SHDR mode, and the dark environment working mode may be a Binning mode.

In some possible implementations of the embodiments of the present application, when the ambient brightness is greater than a brightness threshold, the working mode of the image sensor is controlled to be a bright environment working mode; when the ambient brightness is less than or equal to the brightness threshold, the working mode of the image sensor is controlled to be a dark environment working mode.

When the image sensor operates in a bright environment operating mode, the image sensor outputs two images, namely, a first image and a second image.

When the image sensor operates in the dark environment operating mode, the image sensor outputs only one image, namely, the fourth image.

In some possible implementations of the embodiments of the present application, before S301 and S304, the image processing method provided by the embodiments of the present application may further include: controlling the working state of the first chip according to the ambient brightness, wherein the working state of the first chip includes: Bypass state and Fusion state.

In some possible implementations of the embodiments of the present application, when the ambient brightness is greater than the brightness threshold, the image sensor is controlled to work in a bright environment working mode, and the first chip is controlled to work in a Fusion state. In the Fusion state, the first chip fuses the first image and the second image sent by the image sensor to obtain a third image, and sends the third image to the second chip. When the ambient brightness is not greater than the brightness threshold, the image sensor is controlled to work in a dark environment working mode, and the first chip is controlled to work in a Bypass state. In the Bypass state, the first chip forwards the fourth image sent by the image sensor to the second chip.

In some possible implementations of the embodiments of the present application, the image processing method provided by the embodiments of the present application may also include: the second chip receives the third image sent by the first chip, and performs RAW domain image processing on the third image to obtain a fifth image; or, the second chip receives the fourth image sent by the first chip, and performs RAW domain image processing on the fourth image to obtain a sixth image.

In some possible implementations of the embodiments of the present application, the image processing method provided by the embodiments of the present application may also include: the third chip receives the fifth image or the sixth image sent by the second chip, and performs YUV domain image processing on the fifth image or the sixth image.

The image processing process is shown in Figures 4 and 5, wherein Figure 4 shows the image processing process when the image sensor works in a bright environment working mode and the first chip works in a Fusion state; Figure 5 shows the image processing process when the image sensor works in a dark environment working mode and the first chip works in a Bypass state.

In Figure 4, the image sensor works in SHDR mode, and the first chip works in Fusion mode. The image sensor sends the first image and the second image to the first chip; the first chip fuses the received first image and the second image to obtain a third image, and sends the third image to the second chip; the second chip fuses the third image. The fifth image is obtained by performing RAW domain image processing, and the fifth image is sent to the third chip. The third chip performs YUV domain image processing on the fifth image.

In FIG5 , the image sensor works in Binning mode, and the first chip works in Bypass state. The image sensor sends the fourth image to the first chip; the first chip sends the received fourth image to the second chip; the second chip performs RAW domain image processing on the fourth image to obtain a sixth image, and sends the sixth image to the third chip, and the third chip performs YUV domain image processing on the sixth image.

In the embodiment of the present application, no matter whether the external environment of the electronic device is a bright environment or a dark environment, and whether the image sensor operates in a bright environment working mode or a dark environment working mode, the second chip receives an image, and the second chip does not need to switch the image pipeline, thereby improving image processing efficiency.

In some possible implementations of the embodiments of the present application, the second chip may be a chip for a preview path; or may be a chip for a photo taking path.

The data path of the image acquisition unit includes a preview path and a photo path. Different data paths use different chips. In the preview mode, the image passes through the preview path and the chip of the preview path is used for image processing; in the photo and video modes, the image passes through the photo path and the chip of the photo path is used for image processing.

In some possible implementations of the embodiments of the present application, when the data path of the image acquisition unit is a preview path, the RAW domain image processing in the embodiments of the present application includes but is not limited to: lens correction, bad pixel correction, color interpolation, white balance and other processing; the RAW domain image processing in the embodiments of the present application includes but is not limited to: tone adjustment, noise reduction and other processing. When the data path of the image acquisition unit is a photo taking path, the RAW domain image processing in the embodiments of the present application includes but is not limited to: lens correction, bad pixel correction, color interpolation, white balance and other processing; the RAW domain image processing in the embodiments of the present application may also include bad pixel removal, phase focus, color processing, detail enhancement and other processing.

When the data path of the image acquisition unit includes a preview path and a photographing path, the image processing process is shown in FIG6 and FIG7 , wherein FIG6 shows the image processing process in a dark environment; and FIG7 shows the image processing process in a bright environment.

In FIG6 , the image sensor sends the image it has captured to the ambient brightness detection module, and the ambient brightness detection module performs ambient brightness detection based on the image. When it is detected that the ambient brightness is not greater than the brightness threshold, the image sensor is controlled to work in Binning mode, and the first chip is controlled to work in Bypass state. The data path of the image acquisition unit first works in the preview path. At this time, the image sensor sends an image it has captured at this time to the first chip, and the first chip sends the image to ISP1. ISP1 performs RAW domain image processing on the image, and sends the image obtained after the RAW domain image processing to ISP2. ISP2 performs YUV domain image processing on the image obtained after the RAW domain image processing. When the user clicks the "photo" control or the "record" control, the data path of the image acquisition unit switches to the photo path, and the image sensor sends an image it has captured at this time to the first chip. The first chip sends the image to ISP3, ISP3 performs RAW domain image processing on the image, and sends the image obtained after the RAW domain image processing to ISP4. ISP4 performs YUV domain image processing on the image obtained after the RAW domain image processing.

In FIG7 , the image sensor sends the image it has collected to the environment brightness detection module, and the environment brightness detection module performs environment brightness detection based on the image. When it is detected that the environment brightness is not greater than the brightness threshold, the image sensor is controlled to work in the SHDR mode, and the first chip is controlled to work in the Fusion state. The data path of the image acquisition unit first works in the preview path. At this time, the image sensor sends the two images it has collected to the first chip. The first chip performs fusion processing on the two images, and sends the image obtained after the fusion processing to ISP1. ISP1 performs RAW domain image processing on the image obtained after the fusion processing, and sends the image obtained after the RAW domain image processing to ISP2. ISP2 performs YUV domain image processing on the image obtained after the RAW domain image processing. When the user clicks the "photo" control or the "record" control, the data path of the image acquisition unit is switched to the photo path, and the image sensor sends the two images it has collected to the first chip. The first chip performs fusion processing on the two images, and sends the image obtained after the fusion processing to ISP3. ISP3 performs RAW domain image processing on the image obtained after the fusion processing, and sends the image obtained after the RAW domain image processing to ISP4. ISP4 performs YUV domain image processing on the image obtained after the RAW domain image processing. It should be noted that the chip among the first chip, the second chip and the third chip may be a chip including an image signal processor ISP.

It should be noted that the image processing method provided in the embodiment of the present application can be executed by an image processing circuit. In the embodiment of the present application, the image processing circuit provided in the embodiment of the present application is described by taking the image processing circuit executing the image processing method as an example.

Fig. 8 is a schematic diagram of the structure of an image processing circuit provided in an embodiment of the present application. As shown in Fig. 8, the image processing circuit 800 may include: a first chip 801 and a second chip 802, the first chip 801 includes a first image receiving unit 8011, an image fusion unit 8012 and a first image sending unit 8013;

The first image receiving unit 8011 is configured to receive the first image and the second image sent by the image sensor 500 when the ambient brightness is greater than a brightness threshold, and to receive the fourth image sent by the image sensor 500 when the ambient brightness is less than or equal to the brightness threshold;

An image fusion unit 8012 is used to perform image fusion processing on the first image and the second image to obtain a third image;

The first image sending unit 8013 is configured to send the third image or the fourth image to the second chip 802 .

In some possible implementations of the embodiments of the present application, the image processing circuit 800 may further include: a third chip 803, and the second chip 802 may include: a second image receiving unit 8021, a first image processing unit 8022, and a second image sending unit 8023;

The second image receiving unit 8021 is used to receive the third image or the fourth image sent by the first chip 801;

The first image processing unit 8022 is configured to perform RAW domain image processing on the third image to obtain a fifth image; or perform RAW domain image processing on the fourth image to obtain a sixth image;

The second image sending unit 8023 is configured to send the fifth image or the sixth image to the third chip 803 .

In some possible implementations of the embodiments of the present application, the third chip 803 includes: a third image receiving unit 8031 and a second image processing unit 8032;

The third image receiving unit 8031 is used to receive the fifth image or the sixth image sent by the second chip 802;

The second image processing unit 8032 is used to perform YUV domain image processing on the fifth image or the sixth image.

In some possible implementations of the embodiments of the present application, the second chip 802 may be a preview path chip or a camera path chip.

In some possible implementations of the embodiments of the present application, the image processing circuit 800 may further include:

The environment brightness detection module 804 is used to receive the image data sent by the image sensor 500 and perform environment brightness detection according to the image data.

The image processing circuit provided in the embodiment of the present application can implement each process in the image processing method embodiments of Figures 3 to 7, and will not be described again here to avoid repetition.

Optionally, as shown in Figure 9, an embodiment of the present application further provides an electronic device 900, including a processor 901, a memory 902 and an image sensor 903, the processor 901 includes the image processing circuit 800 provided in the embodiment of the present application, the memory 902 stores a program or instruction that can be executed on the processor 901, and when the program or instruction is executed by the processor 901, the various steps of the above-mentioned image processing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

In some possible implementations of the embodiments of the present application, the processor 901 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

In some possible implementations of the embodiments of the present application, the memory 902 may include a read-only memory (ROM), a random access memory (RAM), a disk storage medium device, an optical storage medium device, a flash memory device, an electrical, optical or other physical/tangible memory storage device. Therefore, generally, the memory 902 includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the image processing method according to the embodiments of the present application.

The electronic device 900 may be a terminal or other device other than a terminal. For example, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR)/virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It may also be a server, a network attached storage (NAS), a personal Personal computer (PC), television (TV), ATM or self-service machine, etc., are not specifically limited in the embodiments of the present application.

The electronic device 900 in the embodiment of the present application may be an electronic device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010 and other components.

Those skilled in the art can understand that the electronic device 1000 can also include a power source (such as a battery) for supplying power to each component, and the power source can be logically connected to the processor 1010 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The electronic device structure shown in FIG10 does not constitute a limitation on the electronic device, and the electronic device can include more or fewer components than shown in the figure, or combine certain components, or arrange components differently, which will not be described in detail here.

The processor 1010 includes the image processing circuit provided in the embodiment of the present application.

Among them, the first chip in the image processing circuit is used to: receive the first image and the second image sent by the image sensor when the ambient brightness is greater than the brightness threshold, and receive the fourth image sent by the image sensor when the ambient brightness is less than or equal to the brightness threshold; perform image fusion processing on the first image and the second image to obtain a third image; and send the third image or the fourth image to the second chip.

In some possible implementations of the embodiments of the present application, the second chip in the image processing circuit may be used for:

receiving the third image or the fourth image sent by the first chip;

Performing RAW domain image processing on the third image to obtain a fifth image; or performing RAW domain image processing on the fourth image to obtain a sixth image;

The fifth image or the sixth image is sent to the third chip.

In some possible implementations of the embodiments of the present application, the third chip in the image processing circuit may be used for:

receiving the fifth image or the sixth image sent by the second chip;

Perform YUV domain image processing on the fifth image or the sixth image.

In some possible implementations of the embodiments of the present application, the second chip may be a preview path chip or a camera path chip.

In some possible implementations of the embodiments of the present application, the processor 1010 may be configured to:

Receive image data sent by the image sensor and perform ambient brightness detection based on the image data.

It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned image processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer-readable storage medium, and examples of the computer-readable storage medium include a non-transitory computer-readable storage medium, such as a ROM, RAM, a magnetic disk or an optical disk.

The embodiment of the present application also provides a chip, including a processor and a communication interface, the communication interface and the processor are coupled, the processor is used to run programs or instructions, implement the various processes of the above-mentioned image processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

An embodiment of the present application also provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned image processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises one..." does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

An image processing method, the method comprising:

When the ambient brightness is greater than a brightness threshold, the first chip receives the first image and the second image sent by the image sensor;

The first chip performs image fusion processing on the first image and the second image to obtain a third image, and sends the third image to the second chip;

When the ambient brightness is less than or equal to the brightness threshold, the first chip receives the fourth image sent by the image sensor, and sends the fourth image to the second chip.
The method according to claim 1, wherein the method further comprises:

The second chip receives the third image sent by the first chip, and performs RAW domain image processing on the third image to obtain a fifth image; or,

The second chip receives the fourth image sent by the first chip, and performs RAW domain image processing on the fourth image to obtain a sixth image.
The method according to claim 2, wherein the method further comprises:

The third chip receives the fifth image sent by the second chip, and performs YUV domain image processing on the fifth image; or,

The third chip receives the sixth image sent by the second chip, and performs YUV domain image processing on the sixth image.
The method according to claim 1, wherein the second chip is a preview path chip or a camera path chip.
The method according to claim 1, wherein before the first chip receives the first image and the second image sent by the image sensor, or before the first chip receives the fourth image sent by the image sensor, the method further comprises:

The environment brightness detection module receives the image data sent by the image sensor, and performs environment brightness detection according to the image data.
An image processing circuit, the circuit comprising: a first chip and a second chip, the first chip comprising a first image receiving unit, an image fusion unit and a first image sending unit;

The first image receiving unit is configured to receive the first image and the second image sent by the image sensor when the ambient brightness is greater than a brightness threshold, and to receive the fourth image sent by the image sensor when the ambient brightness is less than or equal to the brightness threshold;

The image fusion unit is used to perform image fusion processing on the first image and the second image to obtain a third image;

The first image sending unit is used to send the third image or the fourth image to the second chip.
The circuit according to claim 6, wherein the circuit further comprises: a third chip, the second chip comprising: a second image receiving unit, a first image processing unit, and a second image sending unit;

The second image receiving unit is used to receive the third image or the fourth image sent by the first chip;

The first image processing unit is configured to perform RAW domain image processing on the third image to obtain a fifth image; or perform RAW domain image processing on the fourth image to obtain a sixth image;

The second image sending unit is used to send the fifth image or the sixth image to the third chip.
The circuit according to claim 7, wherein the third chip comprises: a third image receiving unit and a second image processing unit;

The third image receiving unit is used to receive the fifth image or the sixth image sent by the second chip;

The second image processing unit is used to perform YUV domain image processing on the fifth image or the sixth image.
The circuit according to claim 6, wherein the second chip is a preview path chip or a photo taking path chip.
The circuit according to claim 6, wherein the circuit further comprises:

The environment brightness detection module is used to receive the image data sent by the image sensor and perform environment brightness detection according to the image data.
An electronic device, comprising: a processor, a memory, and an image sensor;

The processor comprises the image processing circuit according to any one of claims 6 to 10;

The memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the image processing method according to any one of claims 1 to 5 are implemented.
A readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the image processing method according to any one of claims 1 to 5 are implemented.
A chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the steps of the image processing method according to any one of claims 1 to 5.
A computer program product, wherein the program product is stored in a storage medium and is executed by at least one processor to implement the steps of the image processing method according to any one of claims 1 to 5.
An electronic device is configured to execute the steps of the image processing method according to any one of claims 1 to 5.