CN110930319B - Underwater image sharpening method based on self-adaptive transmissivity estimation - Google Patents
Underwater image sharpening method based on self-adaptive transmissivity estimation Download PDFInfo
- Publication number
- CN110930319B CN110930319B CN201911073287.XA CN201911073287A CN110930319B CN 110930319 B CN110930319 B CN 110930319B CN 201911073287 A CN201911073287 A CN 201911073287A CN 110930319 B CN110930319 B CN 110930319B
- Authority
- CN
- China
- Prior art keywords
- underwater
- image
- channel
- transmittance
- red channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 63
- 238000003707 image sharpening Methods 0.000 title abstract description 11
- 238000002834 transmittance Methods 0.000 claims abstract description 73
- 238000003384 imaging method Methods 0.000 claims abstract description 22
- 230000003044 adaptive effect Effects 0.000 claims abstract description 5
- 238000011084 recovery Methods 0.000 claims abstract description 5
- 230000000903 blocking effect Effects 0.000 claims description 12
- 238000005562 fading Methods 0.000 claims description 9
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 7
- 239000011541 reaction mixture Substances 0.000 claims description 4
- 230000002238 attenuated effect Effects 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 claims description 3
- 239000003795 chemical substances by application Substances 0.000 claims description 3
- 125000004122 cyclic group Chemical group 0.000 claims description 3
- 238000005352 clarification Methods 0.000 abstract 1
- 230000000694 effects Effects 0.000 description 46
- 238000007500 overflow downdraw method Methods 0.000 description 7
- 238000010521 absorption reaction Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 239000004575 stone Substances 0.000 description 4
- 238000003672 processing method Methods 0.000 description 3
- 238000013135 deep learning Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 239000002245 particle Substances 0.000 description 2
- 101100136092 Drosophila melanogaster peng gene Proteins 0.000 description 1
- 241001547860 Gaya Species 0.000 description 1
- 125000000205 L-threonino group Chemical group [H]OC(=O)[C@@]([H])(N([H])[*])[C@](C([H])([H])[H])([H])O[H] 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000012535 impurity Substances 0.000 description 1
- 230000031700 light absorption Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention discloses an underwater image sharpening method based on adaptive transmissivity estimation, which comprises the steps of firstly, aiming at the problem of color distortion, respectively carrying out color attenuation compensation on each channel for an input underwater image; secondly, obtaining three transmittance estimates respectively based on the image ambiguity, the underwater red channel prior and the underwater maximum red channel prior; then, self-adaptively judging the characteristics of the underwater image, and obtaining the final transmittance estimation according to the obtained three transmittance estimations; and finally, recovering a clear recovery result by utilizing the estimated underwater background light and the final transmittance estimation according to the underwater imaging model. The underwater image clarification treatment method can effectively treat the underwater image containing an artificial light source or with higher turbidity, and the restored result has natural color and clear details.
Description
Technical Field
The invention belongs to a computer image processing method, and particularly relates to an underwater image sharpening processing method.
Background
Ocean energy is an important strategic resource in China, and the development and protection of ocean resources are important bases for building ocean strong countries in China. In recent years, underwater images have been widely used in the fields of marine energy exploration, marine ecological protection, marine military and the like. However, due to the influence of organic matters, suspended particles and the like in an underwater scene, water has strong absorption and scattering effects on light energy, so that the underwater image has the problems of low contrast, color distortion, detail loss and the like. Therefore, the problem of underwater image sharpening needs to be solved in the fields of computer vision application and digital image processing.
Existing underwater image sharpening methods can be classified into methods based on image enhancement, restoration methods based on imaging models, and methods based on deep learning. The method based on image enhancement mainly comprises an enhancement method based on Retinex theory, a spatial filtering method and an image fusion method. The restoration method based on the imaging model is used for restoring an image by estimating model parameters, and mainly comprises a method suitable for restoring an underwater image based on a dark channel prior theory. The method based on deep learning can realize end-to-end underwater image restoration, but due to the particularity of underwater image imaging, the generalization capability is not ideal. Most of the methods do not consider how to process the underwater images containing the artificial light source, and the color distortion phenomenon is serious when the underwater images with high turbidity are processed.
[ reference documents ]
1.Y.-T.Peng,X.Zhao,and P.C.Cosman,“Single underwater image enhancement using depth estimation based on blurriness,”in 2015IEEE International Conference on Image Processing(ICIP),4952–4956,IEEE(2015).
2.H.Wen,Y.Tian,T.Huang,et al.,“Single underwater image enhancement with a new optical model,”in 2013IEEE International Symposium on Circuits and Systems(ISCAS2013),753–756,IEEE(2013).
3.A.Galdran,D.Pardo,A.Picon,′et al.,“Automatic red-channel underwater image restoration,”Journal of Visual Communication and Image Representation 26,132–145(2015).
4.Y.-T.Peng and P.C.Cosman,“Underwater image restoration based on image blurriness and light absorption,”IEEE transactions on image processing 26(4),1579–1594(2017).
5.F.Li,J.Wu,Y.Wang,et al.,“A color cast detection algorithm of robust performance,”in 2012 IEEE Fifth International Conference on Advanced Computational Intelligence(ICACI),662–664,IEEE(2012).
Disclosure of Invention
Aiming at the prior art, the invention provides an underwater image sharpening method based on self-adaptive transmittance estimation, which can effectively process underwater images containing artificial light sources or high turbidity, and the restored result has natural color and sharp details.
In order to solve the technical problem, the invention provides an underwater image sharpening method based on adaptive transmissivity estimation, which comprises the steps of firstly, respectively carrying out color attenuation compensation on each channel of an input underwater image; secondly, obtaining three transmittance estimates respectively based on the image ambiguity, the underwater red channel prior and the underwater maximum red channel prior; then, self-adaptively judging the characteristics of the underwater image, and obtaining the final transmittance estimation according to the obtained three transmittance estimations; and finally, recovering a clear recovery result by utilizing the estimated underwater background light and the final transmittance estimation according to the underwater imaging model.
The method comprises the following specific steps:
step 1: the input underwater image is Ic(x) To the pair ofThe underwater image is Ic(x) The color fading compensation is respectively carried out on each channel, and the steps comprise: firstly, an underwater image I is judged by a blue-green channel mean valuec(x) Then, based on the color channel corresponding to the basic tone, the color compensation is carried out on the other two channels;
if the primary color of the image is blue, then the red channel is color-fading compensated by equation (1):
wherein, IRC(x) Represents the intensity value at x in the compensated red channel, IR(x)、IB(x) Respectively representing underwater images Ic(x) The intensity values at x in the red and blue channels,
representing underwater images Ic(x) Alpha is a constant; in order to avoid the over-compensation phenomenon of the red channel, only pixels with smaller intensity of the red channel are compensated;
the same color compensation can be done for the green channel:
wherein, IGC(x) Represents the intensity value at x in the green channel after compensation, IG(x)、IB(x) Respectively representing underwater images Ic(x) The intensity values at x in the green and blue channels,
respectively representing underwater images Ic(x) Alpha is a constant;
step 2: the image after color fading compensation is Ic' (x); obtaining transmittance based on image blur
Estimating, using images Ic' (x) estimating the image I by the difference between the intensity value of each pixel and the result of Gaussian filteringc' (x) degree of image blur:
wherein Blur (x) represents the image Ic' (x) a blur map at point x, n being a constant, Y (x) representing an image Ic' (x) brightness value at x Point, Gk,σRepresenting a kernel of k × k and a variance of σ2The Gaussian filter of (1), let k be 2 ═ sigma ═ 2in+1，n＝4；
Carrying out maximum value filtering on the obtained image fuzziness to obtain the transmissivity
And step 3: on the basis of the underwater imaging model shown in the formula (5) and based on the underwater red channel prior shown in the formula (6), the transmissivity obtained in the formula (9) is finally obtained through the calculation of the formulas (7) and (8)
Estimating;
in the formula (5), the reaction mixture is,
representing three channels of red, green and blue,
representing underwater images Ic(x) Corresponding toThe passage is provided with a plurality of channels,
representing the corresponding channel of the recovered underwater image, i.e. the clear image,
which represents the transmittance of the corresponding channel(s),
representing the scattering power of the corresponding channel, i.e.
The intensity of the underwater background light of the corresponding channel;
in the formula (6), JRCP(x) For the restored underwater image, Ω (x) is a local block centered on a pixel point x, R, G, and B respectively represent a red channel, a green channel, and a blue channel of the image, and J (y, R), J (y, G), and J (y, B) respectively represent a red channel map, a green channel map, and a blue channel map of the image;
combining the imaging model of formula (5):
in the formula (7), tβ(x) Is the transmittance, tα(x) Representing the decay rate, i.e. 1-tβ(x)；ARIs the intensity of the background light under water of the red channel, AGIs the intensity of the background light under water of the green channel, ABIs the underwater background light intensity of the blue channel;
and (3) carrying out minimization operation on two sides of the formula (7) at the same time:
obtaining the transmissivity based on the underwater red channel prior
Estimating:
and 4, step 4: obtaining transmissivity based on underwater maximum red channel prior
It is estimated that the greater the red channel intensity value corresponding to a scene point closer to the camera, the greater the transmittance
Expressed as:
and 5: self-adaptively judging the characteristics of the underwater image to obtain the final transmittance of the red channel
Estimating:
in formula (11), ω ═ S (arg (a)c),0.5)，υ＝S(arg(Ir),0.1)，S(x,y)＝[1+e-32(x-y)]-1And arg represents an average value; this is derived from equation (10):
when arg (A)c) > 0.5 and arg (I)r) > 0.1, i.e. the background light is darker but the red channel is attenuated less, ω ≈ 0, upsilon ≈ 1, then the transmittance is used
Estimating transmittance
When arg (A)c) > 0.5 and arg (I)r) > 0.1, i.e., when the background light is bright and the red channel attenuation is weak, ω ≈ 1 and upsilon ≈ 1, the transmittance is used
Estimating transmittance
When arg (I)r) < 0.1, i.e. when attenuation of red channel is very serious, upsilon is approximately equal to 0, then transmissivity is used
Estimating transmittance
Step 6: the transmittance of the red channel is determined by step 5
Then, the transmittance of the other two channels is obtained by the ratio of the attenuation coefficients:
in the formula (12), k ∈ { G, B } represents a blue channel and a green channel,
which represents the transmittance of the corresponding channel(s),
the red channel transmittance obtained by the formula (11) is represented by the following attenuation coefficient ratio:
in formula (13), m is-0.00113, i is 1.62517, λ represents a wavelength, λ isRRepresents the red channel wavelength;
and 7: for image Ic' (x) performing four-time cyclic blocking, selecting the block with the minimum mean value and variance each time, and then corresponding the finally obtained ambiguity block to the underwater image Ic(x) Corresponding positions, and finally, obtaining the average value of each channel, namely the background light estimated value of each channel;
in the first blocking operation, to avoid the influence of artificial light sources on the background light estimation, only image I is usedc' (x) and in subsequent blocking, in order to remove noise and the influence of white objects in the image on the background light estimation, only the block with the minimum mean value and standard deviation is subjected to the next blocking operation;
and 8: obtaining a clear image J according to the underwater imaging model in the formula (5) in the step 3 by utilizing background light estimation and three-channel transmittance estimationRCP(x)。
Compared with the prior art, the invention has the beneficial effects that: the invention can effectively process underwater images containing artificial light sources or having higher turbidity, and the restored result has natural color and clear details.
Drawings
FIG. 1 is a graph comparing the effects of sharpening for underwater images Divers; the underwater image Divers original image (a), the effect of the sharpening through the DCP method (b), the effect of the sharpening through the RCP method (c), the effect of the sharpening through the Blur method (d), the effect of the sharpening through the Fusion method (e) and the effect of the sharpening through the method of the invention (f) are obtained;
FIG. 2 is a graph comparing the sharpening effect for the underwater image Buddha; the underwater image Buddha original image (a) is an underwater image (b) is an effect clarified by a DCP method, (c) is an effect clarified by an RCP method, (d) is an effect clarified by a Blur method, (e) is an effect clarified by a Fusion method, and (f) is an effect clarified by the method;
FIG. 3 is a graph comparing the sharpening effect for an underwater image Stone; the underwater image Stone original image (a), the effect of the sharpening by the DCP method (b), the effect of the sharpening by the RCP method (c), the effect of the sharpening by the Blur method (d), the effect of the sharpening by the Fusion method (e) and the effect of the sharpening by the method of the invention (f) are shown.
Detailed Description
The invention will be further described with reference to the following figures and specific examples, which are not intended to limit the invention in any way.
The invention provides an underwater image sharpening method based on adaptive transmissivity estimation, which mainly comprises the following steps: firstly, color attenuation compensation is respectively carried out on each channel of an input underwater image; secondly, obtaining three transmittance estimates respectively based on the image ambiguity, the underwater red channel prior and the underwater maximum red channel prior; then, self-adaptively judging the characteristics of the underwater image, and obtaining the final transmittance estimation according to the obtained three transmittance estimations; and finally, recovering a clear recovery result by utilizing the estimated underwater background light and the final transmittance estimation according to the underwater imaging model.
As known from the Jaffe-McGlamry underwater imaging model, the light received by the camera can be represented as the sum of three components: the direct component reflected by the object, the scattered portion of the light reflected by the object is called forward scattering, and the light scattered by the ambient light through impurities such as particles is called backward scattering. Forward scatter is generally negligible, and the underwater imaging model can be simplified as follows:
Ic(x)＝Jc(x)·tc(x)+Ac·(1-tc(x))
wherein, Ic(x) Representing the original underwater image, Jc(x) Restored sharp image, AcRepresenting the underwater ambient light, tc(x) Indicating the transmittance. The underwater imaging model can then be represented as:
wherein the content of the first and second substances,
represents tc(x)，tα(x) Represents 1-tc(x)。
The invention provides an underwater image sharpening method based on adaptive transmissivity estimation, which mainly comprises the following steps: for an input underwater image Ic(x) Firstly, aiming at the problem of color distortion, color attenuation compensation is respectively carried out on each channel; secondly, obtaining an underwater scene transmittance estimation method suitable for an artificial light source by utilizing the relation between the image ambiguity and the depth of field, and effectively solving the problem of uneven illumination caused by the artificial light source; then, in order to recover more image details, a scheme of multi-mode transmittance estimation is provided in combination with the underwater red channel prior, namely three transmittance estimations are obtained respectively based on the image ambiguity, the underwater red channel prior and the underwater maximum red channel prior; then, self-adaptively judging the characteristics of the underwater image, and obtaining a final transmittance estimation according to the obtained three transmittance estimations; and finally, recovering a clear recovery result by utilizing the estimated underwater background light and the final transmittance according to the underwater imaging model, thereby obtaining a clear image. The method comprises the following specific steps:
step 1: the input underwater image is Ic(x) For the color distortion problem, the underwater image is Ic(x) The color fading compensation is respectively carried out on each channel, and the steps comprise: firstly, an underwater image I is judged by a blue-green channel mean valuec(x) Then, based on the color channel corresponding to the basic tone, the color compensation is carried out on the other two channels;
if the primary color of the image is blue, then the red channel is color-fading compensated by equation (1):
wherein，IRC(x) Represents the intensity value at x in the compensated red channel, IR(x)、IB(x) Respectively representing underwater images Ic(x) The intensity values at x in the red and blue channels,
representing underwater images Ic(x) Alpha is a constant; in order to avoid the over-compensation phenomenon of the red channel, only pixels with smaller intensity of the red channel are compensated;
the same color compensation can be done for the green channel:
wherein, IGC(x) Represents the intensity value at x in the green channel after compensation, IG(x)、IB(x) Respectively representing underwater images Ic(x) The intensity values at x in the green and blue channels,
respectively representing underwater images Ic(x) Alpha is a constant;
step 2: the image after color fading compensation is Ic' (x); as any point in the underwater image, the pixel intensity and the surrounding pixel points are gradually close to each other along with the increase of the image blurring degree. Therefore, in the present invention, the transmittance is obtained based on the degree of image blur
Estimating, using images Ic' (x) estimating the image I by the difference between the intensity value of each pixel and the result of Gaussian filteringc' (x) image blur, i.e. blur map[1]：
Wherein, blur (x) tableDisplay image Ic' (x) a blur map at point x, n being a constant, Y (x) representing an image Ic' (x) brightness value at x Point, Gk,σRepresenting a kernel of k × k and a variance of σ2The Gaussian filter of (1), let k be 2 ═ sigma ═ 2in+1，n＝4；
Carrying out maximum value filtering on the obtained image fuzziness to obtain the transmissivity
And step 3: wen et al[2]Through deep research on underwater imaging characteristics, a new underwater imaging model is provided on the basis of a simplified Jaffe-McGlamry model: on the basis of the underwater imaging model shown in the formula (5) and based on the underwater red channel prior shown in the formula (6), the transmissivity in the formula (9) is finally obtained through the calculation of the formulas (7) and (8)
Estimating;
in the formula (5), the reaction mixture is,
representing three channels of red, green and blue,
representing underwater images Ic(x) The corresponding channel is arranged on the base plate,
representing the corresponding channel of the recovered underwater image, i.e. the clear image,
which represents the transmittance of the corresponding channel(s),
representing the scattering power of the corresponding channel, i.e.
The intensity of the underwater background light of the corresponding channel;
on the basis of the model, aiming at the characteristics of underwater images, the invention uses a red channel prior estimated transmittance algorithm as one of multi-mode transmittance estimates. Red channel prior algorithm[3]The following were used:
in the formula (6), JRCP(x) For the restored underwater image, Ω (x) is a local block centered on a pixel point x, R, G, and B respectively represent a red channel, a green channel, and a blue channel of the image, and J (y, R), J (y, G), and J (y, B) respectively represent a red channel map, a green channel map, and a blue channel map of the image;
to reduce the effect of red channel attenuation on the transmittance estimate, the imaging model in conjunction with equation (5) can be derived:
in the formula (7), tβ(x) Is the transmittance, tα(x) Representing the decay rate, i.e. 1-tβ(x)；ARIs the intensity of the background light under water of the red channel, AGIs the intensity of the background light under water of the green channel, ABIs the underwater background light intensity of the blue channel;
and (3) carrying out minimization operation on two sides of the formula (7) at the same time:
obtaining the transmissivity based on the underwater red channel prior
Estimating:
and 4, step 4: obtaining transmissivity based on underwater maximum red channel prior
It is estimated that the maximum red channel prior water has a selective absorption effect on light, the absorption effect of water on light increases with increasing wavelength, the attenuation is the strongest because the red channel wavelength is the longest, and the absorption effect increases with increasing propagation distance. Therefore, the closer the scene point to the camera contains more red channel information, and the greater the red channel intensity value of the corresponding point[4]Then transmittance of
Expressed as:
and 5: in order to realize the complementation of transmissivity information, the invention provides the method for adaptively judging the characteristics of the underwater image to obtain the final transmissivity of the red channel
Estimating:
in formula (11), ω ═ S (arg (a)c),0.5)，υ＝S(arg(Ir),0.1)，S(x,y)＝[1+e-32(x-y)]-1And arg represents an average value; this is derived from equation (11):
when arg (A)c) 0.5 and arg (I)r) > 0.1, i.e. the background light is darker but the red channel is attenuated less, ω ≈ 0, upsilon ≈ 1, then the transmittance is used
Estimating transmittance
When arg (A)c) > 0.5 and arg (I)r) > 0.1, i.e., when the background light is bright and the red channel attenuation is weak, ω ≈ 1 and upsilon ≈ 1, the transmittance is used
Estimating transmittance
When arg (I)r) < 0.1, i.e. when attenuation of red channel is very serious, upsilon is approximately equal to 0, then transmissivity is used
Estimating transmittance
Therefore, when the underwater image is processed, the characteristics of the underwater image are judged in a self-adaptive mode, the transmissivity is estimated more accurately, and the underwater image restoration effect is improved.
Step 6: the transmittance of the red channel is determined by step 5
Then, the transmittance of the other two channels is obtained by the ratio of the attenuation coefficients:
in the formula (12), the reaction mixture is,k e G, B represents blue and green channels,
which represents the transmittance of the corresponding channel(s),
the red channel transmittance obtained by the formula (11) is represented by the following attenuation coefficient ratio:
in formula (13), m is-0.00113, i is 1.62517, λ represents a wavelength, λ isRRepresents the red channel wavelength;
and 7: the background light should come from an infinite distance of the scene, with the larger the depth of field and the smaller the transmittance. The image fuzziness can better reflect the real scene depth of the image, and the fuzziness graph obtained in the step two, namely the image Ic' (x) performing four-time cyclic blocking, selecting the block with the minimum mean value and variance each time, and then corresponding the finally obtained ambiguity block to the underwater image Ic(x) Corresponding positions, and finally, obtaining the average value of each channel, namely the background light estimated value of each channel;
in the first blocking operation, to avoid the influence of artificial light sources on the background light estimation, only image I is usedc' (x) and in subsequent blocking, in order to remove noise and the influence of white objects in the image on the background light estimation, only the block with the minimum mean value and standard deviation is subjected to the next blocking operation;
and 8: obtaining a final clear image J by utilizing background light estimation and three-channel transmittance estimation according to the underwater imaging model in the step 3, namely the formula (5)RCP(x)。
The effectiveness of the present invention is verified below with reference to specific examples.
(1) Comparing subjective effects:
in order to illustrate that the effectiveness of the algorithm can be found by comparing with the mainstream algorithm, the invention is compared with the mainstream algorithm method at present. Fig. 1 to fig. 3 are graphs comparing the effect of the sharpening method of the present invention with the effect of the restoration method based on dark channel prior (He et al, DCP), the restoration algorithm based on red channel prior (Galdran et al, RCP), the restoration method based on fuzzy feature (Peng et al, Blur), and the restoration algorithm based on underwater Fusion prior (Gaya et al, Fusion), respectively.
FIG. 1 is a graph comparing the effects of sharpening for underwater images Divers; the underwater image Divers original image (a), the effect of the sharpening through the DCP method (b), the effect of the sharpening through the RCP method (c), the effect of the sharpening through the Blur method (d), the effect of the sharpening through the Fusion method (e) and the effect of the sharpening through the method of the invention (f) are obtained;
FIG. 2 is a graph comparing the sharpening effect for the underwater image Buddha; the underwater image Buddha original image (a) is an underwater image (b) is an effect clarified by a DCP method, (c) is an effect clarified by an RCP method, (d) is an effect clarified by a Blur method, (e) is an effect clarified by a Fusion method, and (f) is an effect clarified by the method;
FIG. 3 is a graph comparing the sharpening effect for an underwater image Stone; the underwater image Stone original image (a), the effect of the sharpening by the DCP method (b), the effect of the sharpening by the RCP method (c), the effect of the sharpening by the Blur method (d), the effect of the sharpening by the Fusion method (e) and the effect of the sharpening by the method of the invention (f) are shown.
Compared with the mainstream method in the prior art, the processing effect of the method is generally superior to that of the current mainstream restoration method, and particularly for underwater images with high turbidity and images containing artificial light sources, the method can well process the color shift problem caused by inaccurate estimation of three-channel transmittance, enhance the image contrast and restore more detailed information.
(2) Objective performance comparison:
in order to objectively evaluate the algorithm, a robust color cast detection method is used for explaining the color cast condition of the color image. Calculated K value[5]The larger the image color shift, the tighter the image color shiftAnd (4) heavy.
Wherein mean _ a and mean _ b respectively represent the mean values of a and b components in Lab color space, M _ a and M _ b respectively represent the average difference of a and b components, and σ2The variance of the L component, Thres, is the threshold, and H, W is the resolution of the image.
Meanwhile, the contrast C of the image is calculated by using the L component of the Lab color space, and the larger C indicates the clearer detail of the image.
Where num represents the number of L component blocks, NiIs the number of pixels of the ith L-component block, Lbi(x) Represents the pixel value, Lb, of a pixel point x in the ith L-component blockiIs the mean of the ith L-component block. Table 1 shows the comparison of the indexes related to each method.
TABLE 1
In conclusion, the underwater image sharpening processing method can effectively process the underwater image containing the artificial light source or having higher turbidity, and the restored result has natural color and clear detail.
While the present invention has been described with reference to the accompanying drawings, the present invention is not limited to the above-described embodiments, which are illustrative only and not restrictive, and various modifications which do not depart from the spirit of the present invention and which are intended to be covered by the claims of the present invention may be made by those skilled in the art.
Claims (1)
1. A method for clarifying an underwater image based on adaptive transmissivity estimation is characterized in that firstly, color attenuation compensation is respectively carried out on each channel of an input underwater image; secondly, obtaining three transmittance estimates respectively based on the image ambiguity, the underwater red channel prior and the underwater maximum red channel prior; then, self-adaptively judging the characteristics of the underwater image, and obtaining the final transmittance estimation according to the obtained three transmittance estimations; finally, recovering a clear recovery result by utilizing the estimated underwater background light and the final transmittance estimation according to the underwater imaging model; the method comprises the following specific steps:
step 1: the input underwater image is Ic(x) For the underwater image is Ic(x) The color fading compensation is respectively carried out on each channel, and the steps comprise: firstly, an underwater image I is judged by a blue-green channel mean valuec(x) Then, based on the color channel corresponding to the basic tone, the color compensation is carried out on the other two channels;
if the primary color of the image is blue, then the red channel is color-fading compensated by equation (1):
wherein, IRC(x) Represents the intensity value at x in the compensated red channel, IR(x)、IB(x) Respectively representing underwater images Ic(x) The intensity values at x in the red and blue channels,
representing underwater images Ic(x) Alpha is a constant; in order to avoid the over-compensation phenomenon of the red channel, only pixels with smaller intensity of the red channel are compensated;
the same color compensation can be done for the green channel:
wherein, IGC(x) Represents the intensity value at x in the green channel after compensation, IG(x)、IB(x) Respectively representing underwater images Ic(x) The intensity values at x in the green and blue channels,
respectively representing underwater images Ic(x) Alpha is a constant;
step 2: the image after color fading compensation is Ic' (x); obtaining transmittance based on image blur
Estimating, using images Ic' (x) estimating the image I by the difference between the intensity value of each pixel and the result of Gaussian filteringc' (x) degree of image blur:
wherein Blur (x) represents the image Ic' (x) degree of blur at point x, n being a constant, Y (x) representing image Ic' (x) brightness value at x Point, Gk,σRepresenting a kernel of k × k and a variance of σ2The Gaussian filter of (1), let k be 2 ═ sigma ═ 2in+1，n＝4；
Carrying out maximum value filtering on the obtained image fuzziness to obtain the transmissivity
And step 3: on the basis of the underwater imaging model shown in the formula (5) and based on the underwater red channel prior shown in the formula (6), the transmissivity in the formula (9) is finally obtained through the calculation of the formulas (7) and (8)
Estimating;
in the formula (5), the reaction mixture is,
representing three channels of red, green and blue,
representing underwater images Ic(x) The corresponding channel is arranged on the base plate,
representing the corresponding channel of the recovered underwater image, i.e. the clear image,
which represents the transmittance of the corresponding channel(s),
representing the scattering power of the corresponding channel, i.e.
The intensity of the underwater background light of the corresponding channel;
in the formula (6), JRCP(x) For the restored underwater image, Ω (x) is a local block centered on the pixel point x, and R, G, and B respectively represent the red channel and the green channel of the imageAnd blue channels, J (y, R), J (y, G), J (y, B) respectively representing a red channel map, a green channel map and a blue channel map of the image;
combining the imaging model of formula (5):
in the formula (7), tβ(x) Is the transmittance, tα(x) Representing the decay rate, i.e. 1-tβ(x)；ARIs the intensity of the background light under water of the red channel, AGIs the intensity of the background light under water of the green channel, ABIs the underwater background light intensity of the blue channel;
and (3) carrying out minimization operation on two sides of the formula (7) at the same time:
obtaining the transmissivity based on the underwater red channel prior
Estimating:
and 4, step 4: obtaining transmissivity based on underwater maximum red channel prior
It is estimated that the greater the red channel intensity value corresponding to a scene point closer to the camera, the greater the transmittance
Expressed as:
and 5: self-adaptively judging the characteristics of the underwater image to obtain the final transmittance of the red channel
Estimating:
in formula (11), ω ═ S (arg (a)c),0.5)，υ＝S(arg(Ir),0.1)，S(x,y)＝[1+e-32(x-y)]-1And arg represents an average value; this is derived from equation (11):
when arg (A)c) 0.5 and arg (I)r) > 0.1, i.e. the background light is darker but the red channel is attenuated less, ω ≈ 0, upsilon ≈ 1, then the transmittance is used
Estimating transmittance
When arg (A)c) > 0.5 and arg (I)r) > 0.1, i.e., when the background light is bright and the red channel attenuation is weak, ω ≈ 1 and upsilon ≈ 1, the transmittance is used
Estimating transmittance
When arg (I)r) < 0.1, i.e. when attenuation of red channel is very serious, upsilon is approximately equal to 0, then transmissivity is used
Estimating transmittance
Step 6: the transmittance of the red channel is determined by step 5
Then, the transmittance of the other two channels is obtained by the ratio of the attenuation coefficients:
in the formula (12), k ∈ { G, B } represents a blue channel and a green channel,
which represents the transmittance of the corresponding channel(s),
the red channel transmittance obtained by the formula (11) is represented by the following attenuation coefficient ratio:
in formula (13), m is-0.00113, i is 1.62517, λ represents a wavelength, λ isRRepresents the red channel wavelength;
and 7: for image Ic' (x) performing four-time cyclic blocking, selecting the block with the minimum mean value and variance each time, and then corresponding the finally obtained ambiguity block to the underwater image Ic(x) Corresponding positions, and finally, obtaining the average value of each channel, namely the background light estimated value of each channel;
in the first blocking operation, to avoid the influence of artificial light sources on the background light estimation, only image I is usedc' (x) and in subsequent blocking, in order to remove noise and the influence of white objects in the image on the background light estimation, only the block with the minimum mean value and standard deviation is subjected to the next blocking operation;
and 8: obtaining a clear image J according to the underwater imaging model in the formula (5) in the step 3 by utilizing background light estimation and three-channel transmittance estimationRCP(x)。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911073287.XA CN110930319B (en) | 2019-11-05 | 2019-11-05 | Underwater image sharpening method based on self-adaptive transmissivity estimation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911073287.XA CN110930319B (en) | 2019-11-05 | 2019-11-05 | Underwater image sharpening method based on self-adaptive transmissivity estimation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110930319A CN110930319A (en) | 2020-03-27 |
| CN110930319B true CN110930319B (en) | 2021-08-03 |
Family
ID=69852457
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911073287.XA Active CN110930319B (en) | 2019-11-05 | 2019-11-05 | Underwater image sharpening method based on self-adaptive transmissivity estimation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110930319B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111586293A (en) * | 2020-04-24 | 2020-08-25 | 山东易华录信息技术有限公司 | Underwater imaging method and device according to influence of seawater turbidity |
| CN111968055B (en) * | 2020-08-17 | 2024-04-09 | 燕山大学 | Underwater image restoration algorithm based on color compensation and color line priori |
| CN115082361B (en) * | 2022-08-23 | 2022-10-28 | 山东国晟环境科技有限公司 | Turbid water body image enhancement method based on image processing |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11024047B2 (en) * | 2015-09-18 | 2021-06-01 | The Regents Of The University Of California | Cameras and depth estimation of images acquired in a distorting medium |
| CN106485681B (en) * | 2016-10-18 | 2019-04-23 | 河海大学常州校区 | Underwater color image restoration method based on color correction and red channel prior |
| CN106570839A (en) * | 2016-11-04 | 2017-04-19 | 天津大学 | Red Channel prior based underwater image sharpening method |
| CN106600547A (en) * | 2016-11-17 | 2017-04-26 | 天津大学 | Underwater image restoration method |
| CN107403418A (en) * | 2017-07-27 | 2017-11-28 | 北京大学深圳研究生院 | Defogging and the underwater picture Enhancement Method of color correction are carried out based on passage transmissivity |
| CN110070480A (en) * | 2019-02-26 | 2019-07-30 | 青岛大学 | A kind of analogy method of underwater optics image |
-
2019
- 2019-11-05 CN CN201911073287.XA patent/CN110930319B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110930319A (en) | 2020-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108596853B (en) | Underwater image enhancement method based on background light statistical model and transmission map optimization | |
| CN110930319B (en) | Underwater image sharpening method based on self-adaptive transmissivity estimation | |
| CN107507145B (en) | Underwater image enhancement method based on different color space self-adaptive histogram stretching | |
| CN107705258B (en) | Underwater image enhancement method based on three-primary-color combined pre-equalization and deblurring | |
| CN109118446B (en) | Underwater image restoration and denoising method | |
| CN108257101B (en) | Underwater image enhancement method based on optimal recovery parameters | |
| CN110689490A (en) | Underwater image restoration method based on texture color features and optimized transmittance | |
| CN112561804A (en) | Low-illumination underwater image enhancement method based on multi-scale detail enhancement | |
| CN108921887B (en) | Underwater scene depth map estimation method based on underwater light attenuation priori | |
| CN110689504B (en) | Underwater image restoration method based on secondary guide transmission diagram | |
| Kumari et al. | Single image fog removal using gamma transformation and median filtering | |
| CN111598800A (en) | Single image defogging method based on space domain homomorphic filtering and dark channel prior | |
| Ueki et al. | Underwater image enhancement based on the iteration of a generalization of dark channel prior | |
| CN113298730B (en) | Defogging restoration method based on image decomposition | |
| Mathur et al. | Dual domain approach for colour enhancement of underwater images | |
| CN105825481B (en) | Underwater picture clarification method based on local SoG | |
| Gujral et al. | A Novel Defogging Technique for Dehazing Images | |
| CN115034985A (en) | Underwater image enhancement method | |
| Huo et al. | Underwater image restoration based on color correction and red channel prior | |
| Powar et al. | A review: Underwater image enhancement using dark channel prior with gamma correction | |
| Moni et al. | Color balance and fusion for underwater image enhancement: Survey | |
| CN111292263B (en) | Image enhancement method based on color correction and deblurring | |
| CN116109513B (en) | Image defogging method based on local ambient light projection constant priori | |
| Kanthamma et al. | Improved CLAHE Enhancement Technique for Underwater Images | |
| Qian et al. | Fast image dehazing algorithm based on multiple filters |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |