WO2019019890A1

WO2019019890A1 - Image processing method, computer equipment, and computer-readable storage medium

Info

Publication number: WO2019019890A1
Application number: PCT/CN2018/094625
Authority: WO
Inventors: 袁全
Original assignee: Oppo广东移动通信有限公司
Priority date: 2017-07-27
Filing date: 2018-07-05
Publication date: 2019-01-31
Also published as: CN107341782A; CN107341782B

Abstract

An image processing method, comprising: photographing a same scene by means of a black and white camera and a color camera so as to acquire a black and white image and a color image; acquiring a highest brightness value for the pixels in the black and white image, and using the highest brightness value as an atmospheric light value; acquiring an original transmittance according to the atmospheric light value; performing de-fogging processing on the color image according to the atmospheric light value and the original transmittance.

Description

Image processing method, computer device, and computer readable storage medium

Cross-reference to related applications

This application claims the priority of the Chinese Patent Application, filed on July 27, 2017, the Chinese Patent Application No. PCT Application No. PCT Application No. This is incorporated herein by reference.

Technical field

The present application relates to the field of computer technology, and in particular, to an image processing method, a computer device, and a non-transitory computer readable storage medium.

Background technique

With the rapid development of electronic technology, various electronic devices have cameras. Through the camera, users can record the scenery or self-portraits they see at any time and any place. Due to the influence of the environment, fog is often present in the captured images, which reduces the quality of the image. The traditional defogging method obtains the atmospheric light value, the calculation is complicated, and the defogging efficiency is low.

Summary of the invention

An image processing method, a computer device, and a non-transitory computer readable storage medium are provided in accordance with various embodiments of the present application.

An image processing method comprising:

Obtaining black and white images and color images by shooting the same scene through a black and white camera and a color camera;

Obtaining a maximum brightness value of a pixel in the black and white image, and using the maximum brightness value as an atmospheric light value;

Obtaining the original transmittance according to the atmospheric light value; and

The color image is subjected to a defogging process according to the atmospheric light value and the original transmittance.

A computer device comprising a memory and a processor, the memory storing computer readable instructions, wherein when executed by the processor, the processor causes the processor to:

One or more non-transitory computer readable storage media containing computer executable instructions that, when executed by one or more processors, cause the processor to:

The black and white image and the color camera are used to capture the same scene to obtain the black and white image and the color image, and the maximum brightness value in the black and white image is obtained, and the maximum brightness value is taken as the atmospheric light value, and the calculation amount of the atmospheric light value is small, the speed is fast, and then according to the atmospheric light. The value obtains the original transmittance, and the color image is subjected to dehazing treatment according to the atmospheric light value and the original transmittance, thereby improving the defogging efficiency.

Details of one or more embodiments of the present application are set forth in the accompanying drawings and description below. Other features, objects, and advantages of the invention will be apparent from the description and appended claims.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present application, and other drawings can be obtained according to the drawings without any creative work for those skilled in the art.

1 is an application environment diagram of an image processing method in an embodiment;

2 is a flow chart of an image processing method in an embodiment;

3 is a flow chart of an image processing method in another embodiment;

4 is a flow chart of an image processing method in another embodiment;

Figure 5 is a flow chart of an image processing method in another embodiment;

Figure 6 is a block diagram showing the structure of an image processing apparatus in an embodiment;

Figure 7 is a block diagram showing the structure of an image processing apparatus in another embodiment;

Figure 8 is a block diagram showing the structure of an image processing apparatus in another embodiment;

Figure 9 is a schematic illustration of an image processing circuit in one embodiment.

Detailed ways

In order to make the objects, technical solutions, and advantages of the present application more comprehensible, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.

It will be understood that the terms "first", "second" and the like, as used herein, may be used to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, the first acquisition module may be referred to as a second acquisition module without departing from the scope of the present application, and similarly, the second acquisition module may be referred to as a first acquisition module. Both the first acquisition module and the second acquisition module are acquisition modules, but they are not the same acquisition module.

FIG. 1 is a schematic diagram of an application environment of an image processing method in an embodiment. As shown in FIG. 1, the application environment includes a mobile terminal 110 and a scene 120 with a black and white camera and a color camera. A black and white image is captured by the black and white camera on the mobile terminal 110 to obtain a black and white image, and then the same scene is captured by the color camera to obtain a color image, and the maximum brightness value is obtained according to the black and white image, and the maximum brightness value is taken as the atmospheric light value, and then according to the atmospheric light value. The original transmittance and the calculation of the atmospheric light value are small, and the color image is dehazed according to the atmospheric light value and the original transmittance, thereby improving the defogging efficiency.

2 is a flow chart of an image processing method in one embodiment. As shown in FIG. 2, an image processing method includes:

Operation 202, capturing a black and white image and a color image by capturing the same scene through a black and white camera and a color camera.

Specifically, a black and white camera refers to a camera for taking a black and white image. The color camera is a camera for taking color images. For the same scene, the mobile terminal can capture a black and white camera through a black and white camera, and then capture a color image through a color camera. The scene refers to the place to be photographed, such as the zoo, botanical garden, sky, coastline, etc., or where the person is.

Operation 204: Acquire a maximum brightness value of a pixel point in the black and white image, and use the maximum brightness value as an atmospheric light value.

Specifically, the mobile terminal extracts the brightness values of the respective pixels in the black and white image, sorts the brightness values from small to large or from large to small, selects the maximum brightness value, and uses the maximum brightness value as the atmospheric light value. The mobile terminal can also directly compare the brightness values of the respective pixels to select the maximum brightness value.

Operation 206, obtaining an original transmittance according to the atmospheric light value.

Specifically, after acquiring the atmospheric light value, the mobile terminal can calculate the original transmittance by using a dark primary color prior algorithm.

Operation 208, performing a defogging process on the color image according to the atmospheric light value and the original transmittance.

Specifically, after the mobile terminal acquires the atmospheric light value and the original transmittance, the color image may be subjected to a dehazing process by a primary color prior algorithm.

The operation of defogging a color image based on a dark primary color prior algorithm includes:

Get the atmospheric scattering model:

I(x)=J(x)t(x)+A(1-t(x)) Formula (1)

Where I(x) denotes a foggy image that needs to be defogged, J(x) denotes a fog-free image obtained by dehazing the fogged image, and x denotes the spatial position of a pixel in the image, t( x) is the original transmittance and A is the atmospheric light value. The atmospheric light value can be obtained by calculation of black and white images, or by the correspondence between atmospheric light values and weather conditions and current time. Under normal circumstances, the mobile terminal can select the pixel of the maximum brightness value in the black and white image as an estimate of the atmospheric light value. In this embodiment, the mobile terminal captures a black and white image through a black and white camera, and obtains a maximum brightness value in the black and white image, and uses the maximum brightness value as the atmospheric light value. Suppose A is a known value. In a color image, there are channels with very low channel values in three channels of RGB (Red, Green, Blue), and the channel value is close to zero. :

In the formula (2), J ^dark (x) represents a dark channel image, J ^c (y) represents each color channel of the color image, and Ω (x) represents a window centered on the pixel x. The original transmittance can be obtained by equation (2), which is:

In formula (3),

This is the dark primary color value of the foggy image in the x field.

By taking the atmospheric light value into the formula (3), the original transmittance can be obtained, and then the color image is taken as I(x), the atmospheric light value A and the original transmittance t(x) are taken into the formula (1). The color image J(x) after defogging.

In this embodiment, the black and white image is taken by the black and white camera to obtain the maximum brightness value in the black and white image, and the maximum brightness value is taken as the atmospheric light value, and the calculation amount of the atmospheric light value is small, the speed is fast, and the original transmission is obtained according to the atmospheric light value. Rate, defogging the color image taken in the same scene according to the atmospheric light value and the original transmittance, improving the defogging efficiency.

In one embodiment, a weight ω between 0 and 1 can be introduced to adjust the original transmittance, and the final defogging parameter, that is, the transmittance expression, is as follows:

In the formula (4), I ^c (y) represents the three channels of the pixels R, G, and B of the preview image I(x); ω is called the degree of defogging, and the smaller the ω, the smaller the degree of defogging, and the larger the ω is, The greater the degree of de-fogging.

The mobile terminal uses equation (4) to obtain the transmittance according to the atmospheric light value and the degree of dehazing degree, and then takes the color image as I(x), the atmospheric light value A and the original transmittance t(x) into the formula (1). A color image J(x) after defogging can be obtained.

In addition, in order to ensure the defogging effect, the mobile terminal can set a threshold t ₀ for the transmittance, then the scene without fog is:

3 is a flow chart of an image processing method in another embodiment. As shown in FIG. 3, an image processing method differs from the method of FIG. 2 in that different transmittances are used for different channels to remove fog, including:

In operation 302, the same scene is captured by the black and white camera and the color camera to obtain a black and white image and a color image.

Operation 304: Acquire a maximum brightness value of a pixel point in the black and white image, and use the maximum brightness value as an atmospheric light value.

Specifically, the mobile terminal extracts the brightness values of the respective pixels in the black and white image, sorts the brightness values from small to large or from large to small, selects the maximum brightness value, and uses the maximum brightness value as the atmospheric light value.

Operation 306, obtaining an original transmittance according to the atmospheric light value.

Specifically, after the mobile terminal acquires the atmospheric light value, the original transmittance can be calculated by the dark primary color prior algorithm.

Operation 308, obtaining a transmittance factor of each of the preset three channels of RGB.

For the fog of the same concentration, the degree of influence on the red, green and blue bands is increasing. The transmittance of the three bands of RGB is ranked as follows: the red band has the highest transmittance, the green band is the second, and the blue band is the lowest; therefore, in the foggy area The processing strength of the mobile terminal for the three bands of RGB should be increased.

The thicker the concentration of fog, the greater the difference in the effect of fog on the three bands of RGB, and the greater the difference in processing intensity of the three bands of RGB for mobile terminals. At the same time, in the area without fog, the mobile terminal does not process the three bands of RGB.

To this end, based on the original transmittance, the mobile terminal introduces two adjustment coefficients, namely transmittance factors W _G and W _B . With these two coefficients, the mobile terminal can implement different defogging strengths for the RGB three bands.

T∈[0,1];T _R =t

W _G = (a + b * t) ² ; T _G = W _G * t

W _B =(c+d*t) ² ; T _B =W _B *t

Where t is the original transmittance obtained from the dark primary color prior algorithm, T _R , T _G , T _B respectively represent the band transmittance for the three bands of RGB, and different transmittance values represent the processing of the three bands. Different strengths. The parameters a, b, c, and d can be taken according to actual conditions, for example, a can be 0.9, b can be 0.1, c can be 0.7, and d can be 0.3.

Operation 310, obtaining a band transmittance of each of the three channels of RGB according to the transmittance factor and the original transmittance.

The mobile terminal can obtain the respective band transmittances of the three channels of RGB according to the transmittance factor and the original transmittance.

Operation 312, performing defogging processing on each of the RGB channels of the color image according to the atmospheric light value and the band transmittance of each of the RGB channels.

In the image processing method of the embodiment, the black and white image is taken by the black and white camera to obtain the maximum brightness value in the black and white image, and the maximum brightness value is taken as the atmospheric light value, and the calculation amount of the atmospheric light value is small, the speed is fast, and then the ambient light value is obtained. To the original transmittance, obtain the transmittance factor of RGB three channels, obtain the band transmittance of each channel according to the transmittance factor adjustment and the original transmittance, and defogg the color image by using the band transmittance corresponding to each channel to prevent the image. The bluish color not only improves the efficiency of defogging, but also achieves true and natural color reproduction.

4 is a flow chart of an image processing method in another embodiment. As shown in FIG. 4, an image processing method differs from the method of FIG. 2 in that the defogging level is increased, including:

Operation 402, capturing a black and white image and a color image by capturing the same scene through a black and white camera and a color camera.

Operation 404, obtaining a maximum brightness value of a pixel point in the black and white image, and using the maximum brightness value as an atmospheric light value.

Operation 406, obtaining an original transmittance according to the atmospheric light value.

Operation 408, obtaining a defogging level, and obtaining a corresponding dehazing degree factor according to the defogging level.

In an embodiment, the mobile terminal may preset a correspondence between different defogging levels and a defogging degree factor. For example, the mobile terminal can provide 6 defogging levels for selection, and each defogging level corresponds to a different dehazing degree factor. For example, when the defogging level is zero, the defogging level factor ω0=0.50; the defogging level is At the first stage, the dehazing level factor ω1 = 0.60, and so on. The mobile terminal can search for a preset defogging degree factor corresponding to the defogging level according to the defogging level.

Operation 410, performing a defogging process on the color image according to the dehazing degree factor, the atmospheric light value, and the original transmittance.

The mobile terminal uses formula (4) to calculate the new transmittance, and then defogges the color image according to the new transmittance and the atmospheric light value.

In the image processing method of the embodiment, the black and white image is taken by the black and white camera to obtain the maximum brightness value in the black and white image, and the maximum brightness value is taken as the atmospheric light value, and the calculation amount of the atmospheric light value is small, the speed is fast, and then the ambient light value is obtained. To the original transmittance, obtain the dehazing level, obtain the corresponding defogging degree factor according to the defogging level, adjust the original transmittance according to the defogging degree factor to generate a new transmittance, which can be correspondingly according to the user's defogging demand. Fog to meet the needs of different users.

Figure 5 is a flow chart of an image processing method in another embodiment. As shown in FIG. 5, an image processing method includes:

Operation 502, capturing a black and white image and a color image by capturing the same scene through a black and white camera and a color camera.

Operation 504: Acquire a maximum brightness value of a pixel point in the black and white image, and use the maximum brightness value as an atmospheric light value.

Operation 506, obtaining an original transmittance according to the atmospheric light value.

At operation 508, a dehazing level is obtained, and a corresponding dehazing degree factor is obtained according to the defogging level.

Operation 510, obtaining a transmittance factor of each of the preset three channels of RGB.

Operation 512, obtaining a band transmittance of each of the three channels of RGB according to the transmittance factor, the degree of dehazing factor, and the original transmittance.

Operation 514, performing defogging processing on each of the RGB channels of the color image according to the atmospheric light value and the band transmittance of each of the RGB channels.

Therein, operations 508 and 510 have no order.

In the image processing method of the embodiment, the black and white image is taken by the black and white camera to obtain the maximum brightness value in the black and white image, and the maximum brightness value is taken as the atmospheric light value, and the calculation amount of the atmospheric light value is small, the speed is fast, and then the ambient light value is obtained. To the original transmittance, obtain the transmittance factor of RGB three channels, obtain the transmittance of each channel according to the transmittance factor adjustment and the original transmittance, and defogg the color image by using the band transmittance corresponding to each channel to prevent the image. The bluish blue not only improves the defogging efficiency, but also realizes the true natural color reproduction; and also performs corresponding defogging according to the user's defogging demand to meet the needs of different users.

In an embodiment, the image processing method further includes: detecting a quantity of noise of the color image after the defogging process; and when the number of the noise is greater than a preset threshold, performing noise reduction on the color image after the defogging process deal with.

Specifically, the preset threshold may be set as needed or according to historical statistics. The mobile terminal improves the quality of the image by reducing the noise of the image.

In an embodiment, the image processing method further includes: obtaining a brightness value of each pixel in the color image after the defogging process; and when the brightness value is less than the preset brightness value, adjusting the brightness value as a preset Brightness value.

The preset brightness value can be an empirical value or set as desired. The mobile terminal can improve the quality of the image after defogging by adjusting the brightness value.

The operations in the flowchart of the method of the embodiment of the present application are sequentially displayed in accordance with the indication of the arrows, but the operations are not necessarily performed in the order indicated by the arrows. Except as explicitly stated herein, the execution of these operations is not strictly limited, and may be performed in other sequences. Moreover, at least a part of the operations in the method flowchart of the embodiment of the present application may include multiple sub-operations or multiple stages, which are not necessarily performed at the same time, but may be executed at different times. The order of execution is not necessarily performed sequentially, but may be performed alternately or alternately with at least a portion of the sub-operations or phases of other operations or other operations.

Fig. 6 is a block diagram showing the structure of an image processing apparatus in an embodiment. As shown in FIG. 6 , an image processing apparatus 600 includes an image acquisition module 602 , a first acquisition module 604 , a second acquisition module 606 , and a defogging processing module 608 . among them:

The image acquisition module 602 is configured to capture a black and white image and a color image by capturing the same scene through a black and white camera and a color camera.

The first obtaining module 604 is configured to acquire a maximum brightness value of a pixel point in the black and white image, and use the maximum brightness value as an atmospheric light value.

The second obtaining module 606 is configured to obtain an original transmittance according to the atmospheric light value.

The defogging processing module 608 is configured to perform a defogging process on the color image according to the atmospheric light value and the original transmittance.

In the image processing apparatus of the embodiment, the black and white image is captured by the black and white camera, and the maximum brightness value in the black and white image is obtained, and the maximum brightness value is used as the atmospheric light value, and the calculation amount of the atmospheric light value is small, the speed is fast, and then the ambient light value is obtained. By the original transmittance, the color image taken by the same scene is defogged according to the atmospheric light value and the original transmittance, and the defogging efficiency is improved.

Fig. 7 is a block diagram showing the structure of an image processing apparatus in another embodiment. As shown in FIG. 7 , an image processing apparatus 700 includes an image acquisition module 702 , a first acquisition module 704 , a second acquisition module 706 , a third acquisition module 708 , a fourth acquisition module 710 , and a defogging processing module 712 . The image acquisition module 702, the first acquisition module 704, and the second acquisition module 706 have the same functions as the corresponding modules in FIG.

The third obtaining module 708 is configured to acquire a transmittance factor of each of the preset three channels of RGB after the obtaining the original transmittance according to the atmospheric light value.

The fourth obtaining module 710 is configured to obtain a band transmittance of each of the three channels of the RGB according to the transmittance factor and the original transmittance.

The defogging processing module 712 is further configured to perform a defogging process on each of the RGB channels of the color image according to the atmospheric light value and the band transmittance of each of the RGB channels.

In the image processing apparatus of the embodiment, the black and white image is captured by the black and white camera, and the maximum brightness value in the black and white image is obtained, and the maximum brightness value is used as the atmospheric light value, and the calculation amount of the atmospheric light value is small, the speed is fast, and then the ambient light value is obtained. To the original transmittance, obtain the transmittance factor of RGB three channels, obtain the band transmittance of each channel according to the transmittance factor adjustment and the original transmittance, and defogg the color image by using the band transmittance corresponding to each channel to prevent the image. The bluish color not only improves the efficiency of defogging, but also achieves true and natural color reproduction.

Figure 8 is a block diagram showing the structure of an image processing apparatus in another embodiment. As shown in FIG. 8 , an image processing apparatus 800 includes an image acquisition module 802 , a first acquisition module 804 , a second acquisition module 806 , a defogging level acquisition module 808 , and a defogging processing module 810 . The image acquisition module 802, the first acquisition module 804, and the second acquisition module 806 have the same functions as the corresponding modules in FIG.

The defogging level acquisition module 808 is configured to acquire a defogging level after the obtaining the original transmittance according to the atmospheric light value.

The defogging processing module 810 is configured to perform a defogging process on the color image according to the defogging level, the atmospheric light value, and the original transmittance.

In an embodiment, an image processing apparatus includes an image acquisition module, a first acquisition module, a second acquisition module, a third acquisition module, a defogging level acquisition module, a fourth acquisition module, and a defogging processing module. The image acquisition module is configured to capture the same scene by the black and white camera and the color camera to obtain a black and white image and a color image; the first acquiring module is configured to acquire a maximum brightness value of the pixel in the black and white image, and use the maximum brightness value as the atmospheric light value. The second obtaining module is configured to obtain an original transmittance according to the atmospheric light value; the defogging level acquiring module is configured to acquire a defogging level, and obtain a corresponding defogging degree factor according to the defogging level; the third obtaining module is configured to: Obtaining a transmittance factor of each of the three channels of the preset RGB; the fourth obtaining module is configured to acquire each of the three channels of the RGB according to the transmittance factor, the degree of dehazing factor, and the original transmittance Band Transmittance; The defogging process module is configured to perform defogging processing on each of the RGB channels of the color image according to the atmospheric light value and the band transmittance of each of the RGB channels.

In one embodiment, the image processing apparatus described above may further include a detection module and a noise reduction module. The detecting module is configured to detect a noise quantity of the color image after the defogging process; and the noise reduction module is configured to: when the number of the noise is greater than a preset threshold, perform noise reduction on the color image after the defogging process deal with.

In an embodiment, the image processing apparatus may further include a brightness acquisition module and a brightness adjustment module. The brightness acquisition module is configured to obtain a brightness value of each pixel in the color image after the defogging process. The brightness adjustment module is configured to adjust the brightness value to be a preset brightness value when the brightness value is less than a preset brightness value. The preset brightness value can be an empirical value or set as desired.

The division of each module in the above image processing apparatus is for illustrative purposes only. In other embodiments, the image processing apparatus may be divided into different modules as needed to complete all or part of the functions of the image processing apparatus.

The various modules in the image processing apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in the hardware in the processor or in the memory in the server, or may be stored in the memory in the server, so that the processor calls the corresponding operations of the above modules. As used in this application, the terms "component", "module" and "system" and the like are intended to mean a computer-related entity, which may be hardware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to being, a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. By way of illustration, both an application running on a server and a server can be a component. One or more components can reside within a process and/or executed thread, and the components can be located within one computer and/or distributed between two or more computers.

The embodiment of the present application also provides a non-transitory computer readable storage medium. One or more non-transitory computer readable storage media containing computer executable instructions that, when executed by one or more processors, cause the processor to perform the operations described in the embodiments of the present application Image processing method.

The embodiment of the present application further provides a computer device. A computer device comprising a memory and a processor, the memory storing computer readable instructions, the instructions being executed by the processor, such that the processor is an image processing method as described in the embodiments of the present application.

The embodiment of the present application further provides a computer device. The above computer device includes an image processing circuit, and the image processing circuit may be implemented by hardware and/or software components, and may include various processing units defining an ISP (Image Signal Processing) pipeline. Figure 9 is a schematic illustration of an image processing circuit in one embodiment. As shown in FIG. 9, for convenience of explanation, only various aspects of the image processing technique related to the embodiment of the present application are shown.

As shown in FIG. 9, the image processing circuit includes an ISP processor 940 and a control logic 950. The image data captured by imaging device 910 is first processed by ISP processor 940, which analyzes the image data to capture image statistics that can be used to determine and/or control one or more control parameters of imaging device 910. Imaging device 910 can include a camera having one or more lenses 912 and image sensor 914. Image sensor 914 may include a color filter array (such as a Bayer filter) that may acquire light intensity and wavelength information captured with each imaging pixel of image sensor 914 and provide a set of primitives that may be processed by ISP processor 940 Image data. Sensor 920 can provide raw image data to ISP processor 940 based on sensor 920 interface type. The sensor 920 interface may utilize a SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the above. Sensor 920 can be used to provide parameters for image processing, such as anti-shake parameters, gain parameters, and the like. Imaging device 910 can include a black and white camera and a color camera. The black and white camera captures black and white images, and the color camera captures color images of the same scene as the black and white camera.

The ISP processor 940 processes the raw image data pixel by pixel in a variety of formats. For example, each image pixel can have a bit depth of 8, 10, 12 or 14 bits, and the ISP processor 940 can perform one or more image processing operations on the raw image data, collecting statistical information about the image data. Among them, image processing operations can be performed with the same or different bit depth precision.

ISP processor 940 can also receive pixel data from image memory 930. For example, raw pixel data is sent from the sensor 920 interface to image memory 930, which is then provided to ISP processor 940 for processing. Image memory 930 may be part of a memory device, a storage device, or a separate dedicated memory within a computer device, and may include DMA (Direct Memory Access) features.

When receiving raw image data from the sensor 920 interface or from image memory 930, ISP processor 940 can perform one or more image processing operations, such as time domain filtering. The processed image data can be sent to or to image memory 930 for additional processing prior to being displayed. The ISP processor 940 receives the processed data from the image memory 930 and performs image data processing in the original domain and in the RGB and YCbCr color spaces. The processed image data can be output to display 980 for viewing by a user and/or further processed by a graphics engine or a GPU (Graphics Processing Unit). Additionally, the output of ISP processor 940 can also be sent to image memory 930, and display 980 can read image data from image memory 930. In one embodiment, image memory 930 can be configured to implement one or more frame buffers. Additionally, the output of ISP processor 940 can be sent to encoder/decoder 970 to encode/decode image data. The encoded image data can be saved and decompressed before being displayed on the display 980 device.

The image data processed by the ISP can be sent to the defogging module 960 to defogg the image before being displayed. The defogging module 960 acquires the maximum brightness value of the pixel in the black and white image, takes the maximum brightness value as the atmospheric light value, obtains the original transmittance according to the atmospheric light value, and performs the dehazing treatment on the color image according to the atmospheric light value and the original transmittance. . After the defogging module 960 performs the defogging process on the image data, the image data after the defogging process can be transmitted to the encoder/decoder 970 to encode/decode the image data. The encoded image data can be saved and decompressed before being displayed on the display 980 device. It can be understood that the image data processed by the defogging module 960 can be directly sent to the display 980 for display without passing through the encoder/decoder 970. The image data processed by the ISP processor 940 may also be processed by the encoder/decoder 970 and then processed by the defogging module 960. The defogging module 960 or the encoder/decoder 970 may be a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit) in the mobile terminal.

The statistics determined by the ISP processor 940 can be sent to the control logic 950 unit. For example, the statistics may include image sensor 914 statistics such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, lens 912 shading correction, and the like. Control logic 950 can include a processor and/or a microcontroller that executes one or more routines, such as firmware, and one or more routines can determine control parameters and control of imaging device 910 based on received statistical data. parameter. For example, the control parameters may include sensor 920 control parameters (eg, gain, integration time for exposure control), camera flash control parameters, lens 912 control parameters (eg, focus or zoom focal length), or a combination of these parameters. The ISP control parameters may include a gain level and color correction matrix for automatic white balance and color adjustment (eg, during RGB processing), and a lens 912 shading correction parameter.

One of ordinary skill in the art can understand that all or part of the process of implementing the above embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a non-volatile computer readable storage medium. Wherein, the program, when executed, may include the flow of an embodiment of the methods as described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or the like.

The above-mentioned embodiments are merely illustrative of several embodiments of the present application, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the claims. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the present application. Therefore, the scope of the invention should be determined by the appended claims.

Claims

An image processing method comprising:

Obtaining black and white images and color images by shooting the same scene through a black and white camera and a color camera;

Obtaining a maximum brightness value of a pixel in the black and white image, and using the maximum brightness value as an atmospheric light value;

Obtaining the original transmittance according to the atmospheric light value; and

The color image is subjected to a defogging process according to the atmospheric light value and the original transmittance.
The method according to claim 1, wherein after the obtaining the original transmittance according to the atmospheric light value, the method further comprises:

Obtain a transmittance factor for each of the preset RGB three channels;

Obtaining a band transmittance of each of the three channels of RGB according to the transmittance factor and the original transmittance;

Defogging the color image according to the atmospheric light value and the original transmittance, including:

Decolorizing the respective RGB channels of the color image according to the atmospheric light value and the band transmittance of each of the RGB channels.
The method according to claim 1, wherein after the obtaining the original transmittance according to the atmospheric light value, the method further comprises:

Obtaining a dehazing level, and obtaining a corresponding dehazing degree factor according to the defogging level;

Defogging the color image according to the atmospheric light value and the original transmittance, including:

The color image is subjected to a defogging process according to the dehazing degree factor, the atmospheric light value, and the original transmittance.
The method of claim 1 further comprising:

Detecting the amount of noise of the color image after the defogging process; and

When the number of noises is greater than a preset threshold, the color image after the defogging process is subjected to noise reduction processing.
The method of claim 1 further comprising:

Obtaining the brightness value of each pixel in the color image after the defogging process; and

When the brightness value is less than the preset brightness value, the brightness value is adjusted to be a preset brightness value.
A computer device comprising a memory and a processor, the memory storing computer readable instructions, the instructions being executed by the processor, causing the processor to perform the following operations:

Obtaining black and white images and color images by shooting the same scene through a black and white camera and a color camera;

Obtaining a maximum brightness value of a pixel in the black and white image, and using the maximum brightness value as an atmospheric light value;

Obtaining the original transmittance according to the atmospheric light value; and

The color image is subjected to a defogging process according to the atmospheric light value and the original transmittance.
The computer device according to claim 6, wherein after the obtaining the original transmittance according to the atmospheric light value, the method further comprises:

Obtain a transmittance factor for each of the preset RGB three channels;

Obtaining a band transmittance of each of the three channels of RGB according to the transmittance factor and the original transmittance;

Defogging the color image according to the atmospheric light value and the original transmittance, including:

Decolorizing the respective RGB channels of the color image according to the atmospheric light value and the band transmittance of each of the RGB channels.
The computer device according to claim 6, wherein after the obtaining the original transmittance according to the atmospheric light value, the method further comprises:

Obtaining a dehazing level, and obtaining a corresponding dehazing degree factor according to the defogging level;

Defogging the color image according to the atmospheric light value and the original transmittance, including:

The color image is subjected to a defogging process according to the dehazing degree factor, the atmospheric light value, and the original transmittance.
The computer apparatus of claim 6 wherein said computer executable instructions are executed by said processor such that said processor further executes:

Detecting the amount of noise of the color image after the defogging process; and

When the number of noises is greater than a preset threshold, the color image after the defogging process is subjected to noise reduction processing.
The computer apparatus of claim 6 wherein said computer executable instructions are executed by said processor such that said processor further executes:

Obtaining the brightness value of each pixel in the color image after the defogging process; and

When the brightness value is less than the preset brightness value, the brightness value is adjusted to be a preset brightness value.
One or more non-transitory computer readable storage media containing computer executable instructions that, when executed by one or more processors, cause the processor to:

Obtaining black and white images and color images by shooting the same scene through a black and white camera and a color camera;

Obtaining a maximum brightness value of a pixel in the black and white image, and using the maximum brightness value as an atmospheric light value;

Obtaining the original transmittance according to the atmospheric light value; and

The color image is subjected to a defogging process according to the atmospheric light value and the original transmittance.
The non-transitory computer readable storage medium according to claim 11, wherein after the obtaining the original transmittance according to the atmospheric light value, the method further comprises:

Obtain a transmittance factor for each of the preset RGB three channels;

Obtaining a band transmittance of each of the three channels of RGB according to the transmittance factor and the original transmittance;

Defogging the color image according to the atmospheric light value and the original transmittance, including:

Decolorizing the respective RGB channels of the color image according to the atmospheric light value and the band transmittance of each of the RGB channels.
The non-transitory computer readable storage medium according to claim 11, wherein after the obtaining the original transmittance according to the atmospheric light value, the method further comprises:

Obtaining a dehazing level, and obtaining a corresponding dehazing degree factor according to the defogging level;

Defogging the color image according to the atmospheric light value and the original transmittance, including:

The color image is subjected to a defogging process according to the dehazing degree factor, the atmospheric light value, and the original transmittance.
A non-transitory computer readable storage medium according to claim 11, wherein said computer executable instructions are executed by said processor such that said processor further executes:

Detecting the amount of noise of the color image after the defogging process; and

When the number of noises is greater than a preset threshold, the color image after the defogging process is subjected to noise reduction processing.
The non-transitory computer readable storage medium of claim 11, wherein when the computer executable instructions are executed by one or more processors, the method further comprises:

Obtaining the brightness value of each pixel in the color image after the defogging process; and

When the brightness value is less than the preset brightness value, the brightness value is adjusted to be a preset brightness value.