CN104657954A - Human vision similarity constraint based image dehazing method, system and equipment - Google Patents
Human vision similarity constraint based image dehazing method, system and equipment Download PDFInfo
- Publication number
- CN104657954A CN104657954A CN201510096613.4A CN201510096613A CN104657954A CN 104657954 A CN104657954 A CN 104657954A CN 201510096613 A CN201510096613 A CN 201510096613A CN 104657954 A CN104657954 A CN 104657954A
- Authority
- CN
- China
- Prior art keywords
- image
- pixel
- represent
- mist
- single channel
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Image Processing (AREA)
Abstract
The invention discloses a human vision similarity constraint based image dehazing method, system and equipment. The method comprises steps as follows: S1, color minimum channel data of a to-be-processed hazy image are computed; S2, the hazy image is subjected to two-channel joint non-local similarity constraint federated filtering twice respectively to obtain atmospheric scattering data; S3, the hazy image is reconstructed according to the obtained atmospheric scattering data so as to obtain an initialized hazy image; S4, the initialized hazy image is subjected to three-channel joint similarity constraint federated filtering respectively to obtain the image after dehazing. According to the human vision similarity constraint based image dehazing method, system and equipment, the atmospheric scattering data can be estimated accurately, the dehazing image is reconstructed accurately, the accuracy is high, the noise is low, and the method, the system and the equipment can be widely applied in the field of digital image processing.
Description
Technical field
The present invention relates to digital image processing field, particularly relate to a kind of image defogging method capable based on human eye vision similarity constraint, system and equipment.
Background technology
In the shooting situation having mist, image capture device is owing to being subject to the scattering process of aerosol, cause the contrast of the digital picture photographed and color larger decay occurs and degrades, thus affect the validity and reliability of later image/video monitoring, graphical analysis.There is a variety of image defogging method capable in prior art, carry out mist elimination process at present mainly adopt dark primary priori defogging method capable to realize to image, the method is by obtaining a large amount of statistical law obtained without mist image viewing.Dark primary priori defogging method capable is succinctly effective, to various types of mist elimination effect that can acquire a certain degree containing mist image.But; dark primary priori defogging method capable can not directly act on view picture natural image; owing to usually can undergo mutation in the edge of scenery in the natural image Scene degree of depth; after causing adopting dark primary priori defogging method capable to carry out mist elimination process; obvious halo effect can be produced in edge; the precision of mist elimination is low, and after may causing mist elimination, the noise of image rises.
Summary of the invention
In order to solve above-mentioned technical matters, the object of this invention is to provide the image defogging method capable based on human eye vision similarity constraint, another object of the present invention is to provide a kind of image mist elimination system based on human eye vision similarity constraint, and another object of the present invention is to provide a kind of image mist elimination equipment based on human eye vision similarity constraint.
The technical solution adopted for the present invention to solve the technical problems is:
Based on the image defogging method capable of human eye vision similarity constraint, comprising:
S1, calculate the pending color smallest passage data having mist image;
S2, to the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtain atmospheric scattering data;
The atmospheric scattering data reconstruction mist elimination image that S3, utilization obtain also obtains initialization mist elimination image;
S4, three-channel associating similarity constraint Federated filter is carried out to initialization mist elimination image, obtain the image after mist elimination.
Further, described step S1, it is specially:
The pending color smallest passage data having mist image are calculated according to following formula:
M
min(l)=min(P
R(l),P
Y(l),P
B(l))
In above formula, l is natural number, represents the position of pixel, M
minl () represents the color smallest passage data of pixel l, P
r(l), P
y(l), P
bl () represents pending respectively has mist image M at red, yellow, blue three color components of pixel l.
Further, described step S2, comprising:
S21, carry out the non local similarity constraint Federated filter of associating of 2 two passages according to following formula respectively to there being mist image and obtaining two filtering images:
In above formula, C1, C2 represent two filtering images of acquisition respectively, and M represents pending has mist image, P
yindicate the luminance components of mist image M, N is natural number, represents the number of each pixel being carried out to the pixel participated in required for Federated filter, β
1, β
2all represent filtering strength;
S22, according to obtain two filtering images calculate the error image D meeting visual characteristics of human eyes:
D(l)=|C1(l)-C2(l)|
In above formula, l is natural number, and represent the position of pixel, D (l) represents the value of error image D at pixel l, and C1 (l), C2 (l) represent the value of two filtering images at pixel l of acquisition respectively;
S23, calculate the initial estimate obtaining atmospheric scattering light according to following formula:
In above formula, φ (l) represents the initial estimate of atmospheric scattering light at pixel l, and θ represents the average brightness value of C1 (l);
S24, revise rear acquisition atmospheric scattering data according to the initial estimate of following formula to atmospheric scattering light:
ψ(l)=max(min(0.91·φ(l),C1(l)),0)
In above formula, ψ (l) represents the atmospheric scattering data at pixel l.
Further, in described step S21, N=40, β
1=0.01, β
2=0.07.
Further, in described step S21, the formula that the non local similarity constraint Federated filter of associating carrying out two passages adopts is SDL (im1, im2, num, β), wherein im1, im2 are two measure-alike single channel image, num is for natural number and represent the number of each pixel being carried out to the pixel participated in required for Federated filter, and β represents filtering strength, and the filtering image finally obtained is:
i(k)=γ
1(k)·im1(k)+γ
2(k)
In above formula, k is natural number, and represent the position of pixel, i (k) represents the value of filtering image at pixel k, and im1 (k) represents the value of the pixel k of single channel image im1, γ
1k () represents the linear coefficient of the filtering of the pixel k of single channel image im1, γ
2k () represents the biased coefficient of the filtering of the pixel k of single channel image im1, γ
1(k) and γ
2k () is obtained by following formulae discovery:
In above formula, im1
minl () represents the color smallest passage data of the pixel l of single channel image im1, SK
krepresent the set of the individual similar pixel of the closest num of pixel k, σ (k) represents the standard variance of the similar pixel of the pixel k of single channel image im1, μ (k) represents the similar pixel average of the pixel k of single channel image im1, and σ (k) and μ (k) is obtained by following formulae discovery:
Further, the S set K of the individual similar pixel of the closest num of pixel k
kbe the set of combining the minimum num of a similarity pixel with k, the computing formula of described associating similarity is as follows:
In above formula, k1, k2 are natural number, all represent the position of pixel, and S (k1, k2) represents pixel k1, k2 associating similarity on single channel image im1, im2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k2, λ represents scale-up factor.
Further, described step S3, comprising:
S31, search and obtain pending have the brightness of mist image front 1.2% the location of pixels set of pixel;
S32, according to the location of pixels set obtained, search the overall brightness Γ of brightness maximum value as mist light having in mist image;
S33, calculate air ature of coal spreading rate according to following formula:
In above formula, ρ (l) represents the air ature of coal spreading rate at pixel l, and ψ (l) represents the atmospheric scattering data at pixel l;
S34, rebuild mist elimination image obtain initialization mist elimination image according to following formula:
In above formula,
represent red, green, blue three color components of initialization mist elimination image respectively, P
r(l), P
y(l), P
bl () represents pending respectively has mist image M at red, yellow, blue three color components of pixel l.
Further, described step S4, it is specially:
According to following formula, three-channel associating similarity constraint Federated filter is carried out to initialization mist elimination image, obtains the image after mist elimination:
In above formula, I
r, I
g, I
brepresent red, green, blue three color components of the image after mist elimination respectively,
represent red, green, blue three single channel image of initialization mist elimination image respectively.
Further, carrying out the formula that three-channel associating similarity constraint Federated filter adopts is JDN (im1, im2, im3, num, β), wherein im1, im2, im3 are three measure-alike single channel image, num is for natural number and represent the number of each pixel being carried out to the pixel participated in required for Federated filter, and β represents filtering strength, and the filtering image finally obtained is:
O(k)=η
1(k)·im1(k)+η
2(k)
In above formula, k is natural number, and represent the position of pixel, O (k) represents the value of filtering image at pixel k, and im1 (k) represents the value of the pixel k of single channel image im1, η
1k () represents the linear coefficient of the filtering of the pixel k of single channel image im1, η
2k () represents the biased coefficient of the filtering of the pixel k of single channel image im1, η
1(k) and η
2k () is obtained by following formulae discovery:
In above formula, im1
minl () represents the color smallest passage data of the pixel l of single channel image im1, SK
krepresent the set of the individual similar pixel of the closest num of pixel k,
represent the standard variance of the similar pixel of the pixel k of single channel image im1,
represent the similar pixel average of the pixel k of single channel image im1,
with
obtained by following formulae discovery:
Further, the S set K of the individual similar pixel of the closest num of pixel k
kbe the set of combining the minimum num of a similarity pixel with k, the computing formula of described associating similarity is as follows:
In above formula, k1, k2 are natural number, all represent the position of pixel, S'(k1, k2) represent pixel k1, k2 associating similarity on single channel image im1, im2, im3,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im3 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im3 centered by pixel k2, λ represents scale-up factor.
Another technical scheme that the present invention adopts for its technical matters of solution is:
Based on the image mist elimination system of human eye vision similarity constraint, comprising:
First processing module, for calculating the pending color smallest passage data having mist image;
Second processing module, for the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtains atmospheric scattering data;
3rd processing module, for utilizing the atmospheric scattering data reconstruction mist elimination image of acquisition and obtaining initialization mist elimination image;
4th processing module, for carrying out three-channel associating similarity constraint Federated filter to initialization mist elimination image, obtains the image after mist elimination.
The another technical scheme that the present invention adopts for its technical matters of solution is:
Based on the image mist elimination equipment of human eye vision similarity constraint, the processor comprising camera and be connected with camera, described camera is for gathering image, and described processor is used for carrying out mist elimination process to the image that camera gathers, and described processor comprises:
First processing module, for calculating the pending color smallest passage data having mist image;
Second processing module, for the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtains atmospheric scattering data;
3rd processing module, for utilizing the atmospheric scattering data reconstruction mist elimination image of acquisition and obtaining initialization mist elimination image;
4th processing module, for carrying out three-channel associating similarity constraint Federated filter to initialization mist elimination image, obtains the image after mist elimination.
The invention has the beneficial effects as follows: the image defogging method capable based on human eye vision similarity constraint of the present invention, comprising: S1, calculate the pending color smallest passage data having mist image; S2, to the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtain atmospheric scattering data; The atmospheric scattering data reconstruction mist elimination image that S3, utilization obtain also obtains initialization mist elimination image; S4, three-channel associating similarity constraint Federated filter is carried out to initialization mist elimination image, obtain the image after mist elimination.This method accurately can estimate atmospheric scattering light data, thus rebuilds mist elimination image exactly, and precision is high and noise is low.
Another beneficial effect of the present invention is: based on the image mist elimination system of human eye vision similarity constraint, comprising: the first processing module, for calculating the pending color smallest passage data having mist image; Second processing module, for the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtains atmospheric scattering data; 3rd processing module, for utilizing the atmospheric scattering data reconstruction mist elimination image of acquisition and obtaining initialization mist elimination image; 4th processing module, for carrying out three-channel associating similarity constraint Federated filter to initialization mist elimination image, obtains the image after mist elimination.Native system accurately can estimate atmospheric scattering light data, thus rebuilds mist elimination image exactly, and precision is high and noise is low.
Another beneficial effect of the present invention is: based on the image mist elimination equipment of human eye vision similarity constraint, the processor comprising camera and be connected with camera, described camera is for gathering image, described processor is used for carrying out mist elimination process to the image that camera gathers, described processor comprises: the first processing module, for calculating the pending color smallest passage data having mist image; Second processing module, for the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtains atmospheric scattering data; 3rd processing module, for utilizing the atmospheric scattering data reconstruction mist elimination image of acquisition and obtaining initialization mist elimination image; 4th processing module, for carrying out three-channel associating similarity constraint Federated filter to initialization mist elimination image, obtains the image after mist elimination.This equipment accurately can estimate atmospheric scattering light data, thus rebuilds mist elimination image exactly, provides precision high and the low output image of noise.
Accompanying drawing explanation
Below in conjunction with drawings and Examples, the invention will be further described.
Fig. 1 is the process flow diagram of the image mist elimination based on human eye vision similarity constraint of the present invention.
Embodiment
With reference to Fig. 1, the invention provides a kind of image defogging method capable based on human eye vision similarity constraint, comprising:
S1, calculate the pending color smallest passage data having mist image;
S2, to the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtain atmospheric scattering data;
The atmospheric scattering data reconstruction mist elimination image that S3, utilization obtain also obtains initialization mist elimination image;
S4, three-channel associating similarity constraint Federated filter is carried out to initialization mist elimination image, obtain the image after mist elimination.
Be further used as preferred embodiment, described step S1, it is specially:
The pending color smallest passage data having mist image are calculated according to following formula:
M
min(l)=min(P
R(l),P
Y(l),P
B(l))
In above formula, l is natural number, represents the position of pixel, M
minl () represents the color smallest passage data of pixel l, P
r(l), P
y(l), P
bl () represents pending respectively has mist image M at red, yellow, blue three color components of pixel l.
Be further used as preferred embodiment, described step S2, comprising:
S21, carry out the non local similarity constraint Federated filter of associating of 2 two passages according to following formula respectively to there being mist image and obtaining two filtering images:
In above formula, C1, C2 represent two filtering images of acquisition respectively, and M represents pending has mist image, P
yindicate the luminance components of mist image M, N is natural number, represents the number of each pixel being carried out to the pixel participated in required for Federated filter, β
1, β
2all represent filtering strength;
S22, according to obtain two filtering images calculate the error image D meeting visual characteristics of human eyes:
D(l)=|C1(l)-C2(l)|
In above formula, l is natural number, and represent the position of pixel, D (l) represents the value of error image D at pixel l, and C1 (l), C2 (l) represent the value of two filtering images at pixel l of acquisition respectively;
S23, calculate the initial estimate obtaining atmospheric scattering light according to following formula:
In above formula, φ (l) represents the initial estimate of atmospheric scattering light at pixel l, and θ represents the average brightness value of C1 (l);
S24, revise rear acquisition atmospheric scattering data according to the initial estimate of following formula to atmospheric scattering light:
ψ(l)=max(min(0.91·φ(l),C1(l)),0)
In above formula, ψ (l) represents the atmospheric scattering data at pixel l.
Be further used as preferred embodiment, in described step S21, N=40, β
1=0.01, β
2=0.07.
Be further used as preferred embodiment, in described step S21, the formula that the non local similarity constraint Federated filter of associating carrying out two passages adopts is SDL (im1, im2, num, β), wherein im1, im2 are two measure-alike single channel image, num is for natural number and represent the number of each pixel being carried out to the pixel participated in required for Federated filter, and β represents filtering strength, and the filtering image finally obtained is:
i(k)=γ
1(k)·im1(k)+γ
2(k)
In above formula, k is natural number, and represent the position of pixel, i (k) represents the value of filtering image at pixel k, and im1 (k) represents the value of the pixel k of single channel image im1, γ
1k () represents the linear coefficient of the filtering of the pixel k of single channel image im1, γ
2k () represents the biased coefficient of the filtering of the pixel k of single channel image im1, γ
1(k) and γ
2k () is obtained by following formulae discovery:
In above formula, im1
minl () represents the color smallest passage data of the pixel l of single channel image im1, SK
krepresent the set of the individual similar pixel of the closest num of pixel k, σ (k) represents the standard variance of the similar pixel of the pixel k of single channel image im1, μ (k) represents the similar pixel average of the pixel k of single channel image im1, and σ (k) and μ (k) is obtained by following formulae discovery:
Be further used as preferred embodiment, the S set K of the individual similar pixel of closest num of pixel k
kbe the set of combining the minimum num of a similarity pixel with k, the computing formula of described associating similarity is as follows:
In above formula, k1, k2 are natural number, all represent the position of pixel, and S (k1, k2) represents pixel k1, k2 associating similarity on single channel image im1, im2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k2, λ represents scale-up factor.
Be further used as preferred embodiment, described step S3, comprising:
S31, search and obtain pending have the brightness of mist image front 1.2% the location of pixels set of pixel;
S32, according to the location of pixels set obtained, search the overall brightness Γ of brightness maximum value as mist light having in mist image;
S33, calculate air ature of coal spreading rate according to following formula:
In above formula, ρ (l) represents the air ature of coal spreading rate at pixel l, and ψ (l) represents the atmospheric scattering data at pixel l;
S34, rebuild mist elimination image obtain initialization mist elimination image according to following formula:
In above formula,
represent red, green, blue three color components of initialization mist elimination image respectively, P
r(l), P
y(l), P
bl () represents pending respectively has mist image M at red, yellow, blue three color components of pixel l.
Be further used as preferred embodiment, described step S4, it is specially:
According to following formula, three-channel associating similarity constraint Federated filter is carried out to initialization mist elimination image, obtains the image after mist elimination:
In above formula, I
r, I
g, I
brepresent red, green, blue three color components of the image after mist elimination respectively,
represent red, green, blue three single channel image of initialization mist elimination image respectively.
Be further used as preferred embodiment, carrying out the formula that three-channel associating similarity constraint Federated filter adopts is JDN (im1, im2, im3, num, β), wherein im1, im2, im3 are three measure-alike single channel image, num is for natural number and represent the number of each pixel being carried out to the pixel participated in required for Federated filter, and β represents filtering strength, and the filtering image finally obtained is:
O(k)=η
1(k)·im1(k)+η
2(k)
In above formula, k is natural number, and represent the position of pixel, O (k) represents the value of filtering image at pixel k, and im1 (k) represents the value of the pixel k of single channel image im1, η
1k () represents the linear coefficient of the filtering of the pixel k of single channel image im1, η
2k () represents the biased coefficient of the filtering of the pixel k of single channel image im1, η
1(k) and η
2k () is obtained by following formulae discovery:
In above formula,
represent the color smallest passage data of the pixel l of single channel image im1, SK
krepresent the set of the individual similar pixel of the closest num of pixel k,
represent the standard variance of the similar pixel of the pixel k of single channel image im1,
represent the similar pixel average of the pixel k of single channel image im1,
with
obtained by following formulae discovery:
Be further used as preferred embodiment, the S set K of the individual similar pixel of closest num of pixel k
kbe the set of combining the minimum num of a similarity pixel with k, the computing formula of described associating similarity is as follows:
In above formula, k1, k2 are natural number, all represent the position of pixel, S'(k1, k2) represent pixel k1, k2 associating similarity on single channel image im1, im2, im3,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im3 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im3 centered by pixel k2, λ represents scale-up factor.
Below in conjunction with specific embodiment, the invention will be further described.
Embodiment one
With reference to Fig. 1, a kind of image defogging method capable based on human eye vision similarity constraint, comprising:
S1, calculate pending color smallest passage data having mist image according to following formula:
M
min(l)=min(P
R(l),P
Y(l),P
B(l))
In above formula, l is natural number, represents the position of pixel, M
minl () represents the color smallest passage data of pixel l, P
r(l), P
y(l), P
bl () represents pending respectively has mist image M at red, yellow, blue three color components of pixel l.
S2, to the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtain atmospheric scattering data.
Define the non local similarity constraint Federated filter of associating of two passages: SDL (im1, im2, num, β), wherein im1, im2 are two measure-alike single channel image, num is for natural number and represent the number of each pixel being carried out to the pixel participated in required for Federated filter, and β represents filtering strength.
In single channel image im1, im2 that 2 width yardsticks are identical, num the similar pixel point finding it is combined for each pixel k.
The neighborhood window of definition pixel k 5 × 5 rectangular windows that to be Blk (k) be centered by pixel k, then for any single channel image im, can obtain the image block centered by pixel k
wherein (l=1,2 ... 25).
The associating similarity of any two pixel k1 and k2 in single channel image im1 and im2 is:
In above formula, k1, k2 are natural number, all represent the position of pixel, and S (k1, k2) represents pixel k1, k2 associating similarity on single channel image im1, im2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k2, λ represents scale-up factor, and wherein λ is preferably 0.25.
Calculate the S (k1, k2) obtained less, the associating similarity of k1, k2 two pixels on im1, im2 is more similar.With whole image for hunting zone, the individual similar pixel SK of closest num can be found for each pixel k
k={ k
1, k
2..., k
num.
Be calculated as follows filtering parameter successively:
For each pixel im1 (k) of single channel image im1, calculate its similar pixel average:
For each pixel im1 (k) of single channel image im1, calculate the standard variance of its similar pixel:
For each pixel im1 (k) of single channel image im1, calculate the linear coefficient of its filtering:
For each pixel im1 (k) of single channel image im1, calculate the biased coefficient of its filtering:
γ
2(k)=μ(k)-γ
1(k)·μ(k)
The most each pixel of the similarity constraint image filtering SDL (im1, im2, num, β) of image im1 participates in following calculating, obtains the filtering image exported:
i(k)=γ
1(k)·im1(k)+γ
2(k)
Based on above-mentioned discussion, step S2 specifically comprises:
S21, carry out the non local similarity constraint Federated filter of associating of 2 two passages according to following formula respectively to there being mist image and obtaining two filtering images:
In above formula, C1, C2 represent two filtering images of acquisition respectively, and M represents pending has mist image, P
yindicate the luminance components of mist image M, N is natural number, represents the number of each pixel being carried out to the pixel participated in required for Federated filter, β
1, β
2all represent filtering strength; Preferably, in the present embodiment, N=40, β
1=0.01, β
2=0.07.
S22, according to obtain two filtering images calculate the error image D meeting visual characteristics of human eyes:
D(l)=|C1(l)-C2(l)|
In above formula, l is natural number, and represent the position of pixel, D (l) represents the value of error image D at pixel l, and C1 (l), C2 (l) represent the value of two filtering images at pixel l of acquisition respectively;
S23, calculate the initial estimate obtaining atmospheric scattering light according to following formula:
In above formula, φ (l) represents the initial estimate of atmospheric scattering light at pixel l, and θ represents the average brightness value of C1 (l);
S24, revise rear acquisition atmospheric scattering data according to the initial estimate of following formula to atmospheric scattering light:
ψ(l)=max(min(0.91·φ(l),C1(l)),0)
In above formula, ψ (l) represents the atmospheric scattering data at pixel l.
The atmospheric scattering data reconstruction mist elimination image that S3, utilization obtain also obtains initialization mist elimination image, comprising:
S31, search and obtain pending have the brightness of mist image front 1.2% the location of pixels set of pixel;
S32, according to the location of pixels set obtained, search the overall brightness Γ of brightness maximum value as mist light having in mist image;
S33, calculate air ature of coal spreading rate according to following formula:
In above formula, ρ (l) represents the air ature of coal spreading rate at pixel l, and ψ (l) represents the atmospheric scattering data at pixel l;
S34, rebuild mist elimination image obtain initialization mist elimination image according to following formula:
In above formula,
represent red, green, blue three color components of initialization mist elimination image respectively, P
r(l), P
y(l), P
bl () represents pending respectively has mist image M at red, yellow, blue three color components of pixel l.
S4, three-channel associating similarity constraint Federated filter is carried out to initialization mist elimination image, obtain the image after mist elimination.
Define three-channel associating similarity constraint Federated filter: JDN (im1, im2, im3, num, β), wherein, im1, im2, im3 are three measure-alike single channel image, im1 is the color channel image needing denoising having mist image, and im2, im3 are the denoising joint channel images needing associating consideration.
Noise-removed filtering process is as follows:
In single channel image im1, im2, im3 that 3 width yardsticks are identical, num the similar pixel point finding it is combined for each pixel k.
Defining the associating similarity of any two pixel k1 and k2 in 3 single channel image im1, im2, im3 is:
In above formula, k1, k2 are natural number, all represent the position of pixel, S'(k1, k2) represent pixel k1, k2 associating similarity on single channel image im1, im2, im3,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im3 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im3 centered by pixel k2, λ represents scale-up factor.In the present embodiment, λ is preferably 0.4.Calculate the S'(k1, the k2 that obtain) less, the associating similarity of k1, k2 two pixels on im1, im2, im3 is more similar.With whole image for hunting zone, the individual similar pixel SK of closest num can be found for each pixel k
k={ k
1, k
2..., k
num.
Be calculated as follows filtering parameter successively:
For each pixel im1 (k) of single channel image im1, calculate its similar pixel average:
For each pixel im1 (k) of single channel image im1, calculate the standard variance of its similar pixel:
For each pixel im1 (k) of single channel image im1, calculate the linear coefficient of its filtering:
For each pixel im1 (k) of single channel image im1, calculate the biased coefficient of its filtering:
The Output rusults of the similarity constraint image filtering JDN (im1, im2, im3, num, β) of image im1 is:
O(k)=η
1(k)·im1(k)+η
2(k)
Based on the above discussion to three-channel associating similarity constraint Federated filter, step S4 is specially:
According to following formula, three-channel associating similarity constraint Federated filter is carried out to initialization mist elimination image, obtains the image after mist elimination:
In above formula, I
r, I
g, I
brepresent red, green, blue three color components of the image after mist elimination respectively,
represent red, green, blue three single channel image of initialization mist elimination image respectively.
This method utilizes the non local similarity Federated filter of the associating of two passages to calculate and obtains atmospheric scattering data, the estimated accuracy of atmospheric scattering data can be improved, and obtain by the non local similarity constraint Federated filter of associating adopting different parameters to carry out two passages the error image meeting visual characteristics of human eyes, the precision of atmospheric scattering data can be improved further, finally adopt three-channel associating similarity constraint Federated filter to rebuild mist elimination image, efficient recovery mist elimination image can be had, the noise of image after further reduction mist elimination.Therefore, this method accurately can estimate atmospheric scattering light data, thus rebuilds mist elimination image exactly, and precision is high and noise is low.
Embodiment two
The present embodiment is and embodiment one floppy disk system one to one:
Based on the image mist elimination system of human eye vision similarity constraint, comprising:
First processing module, for calculating the pending color smallest passage data having mist image;
Second processing module, for the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtains atmospheric scattering data;
3rd processing module, for utilizing the atmospheric scattering data reconstruction mist elimination image of acquisition and obtaining initialization mist elimination image;
4th processing module, for carrying out three-channel associating similarity constraint Federated filter to initialization mist elimination image, obtains the image after mist elimination.
Native system utilizes the non local similarity Federated filter of the associating of two passages to calculate and obtains atmospheric scattering data, the estimated accuracy of atmospheric scattering data can be improved, and obtain by the non local similarity constraint Federated filter of associating adopting different parameters to carry out two passages the error image meeting visual characteristics of human eyes, the precision of atmospheric scattering data can be improved further, finally adopt three-channel associating similarity constraint Federated filter to rebuild mist elimination image, efficient recovery mist elimination image can be had, the noise of image after further reduction mist elimination.Therefore, native system accurately can estimate atmospheric scattering light data, thus rebuilds mist elimination image exactly, and precision is high and noise is low.
Embodiment three
The image mist elimination equipment based on human eye vision similarity constraint of the image defogging method capable of Application Example one, the processor comprising camera and be connected with camera, described camera is for gathering image, described processor is used for carrying out mist elimination process to the image that camera gathers, and described processor comprises:
First processing module, for calculating the pending color smallest passage data having mist image;
Second processing module, for the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtains atmospheric scattering data;
3rd processing module, for utilizing the atmospheric scattering data reconstruction mist elimination image of acquisition and obtaining initialization mist elimination image;
4th processing module, for carrying out three-channel associating similarity constraint Federated filter to initialization mist elimination image, obtains the image after mist elimination.
This equipment is after collection image, utilize the non local similarity Federated filter of the associating of two passages to calculate and obtain atmospheric scattering data, the estimated accuracy of atmospheric scattering data can be improved, and obtain by the non local similarity constraint Federated filter of associating adopting different parameters to carry out two passages the error image meeting visual characteristics of human eyes, the precision of atmospheric scattering data can be improved further, finally adopt three-channel associating similarity constraint Federated filter to rebuild mist elimination image, efficient recovery mist elimination image can be had, the noise of image after further reduction mist elimination.Therefore, this equipment accurately can estimate atmospheric scattering light data, thus rebuilds mist elimination image exactly, provides precision high and the low output image of noise.
More than that better enforcement of the present invention is illustrated, but the invention is not limited to described embodiment, those of ordinary skill in the art also can make all equivalent variations or replacement under the prerequisite without prejudice to spirit of the present invention, and these equivalent modification or replacement are all included in the application's claim limited range.
Claims (12)
1., based on the image defogging method capable of human eye vision similarity constraint, it is characterized in that, comprising:
S1, calculate the pending color smallest passage data having mist image;
S2, to the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtain atmospheric scattering data;
The atmospheric scattering data reconstruction mist elimination image that S3, utilization obtain also obtains initialization mist elimination image;
S4, three-channel associating similarity constraint Federated filter is carried out to initialization mist elimination image, obtain the image after mist elimination.
2. the image defogging method capable based on human eye vision similarity constraint according to claim 1, it is characterized in that, described step S1, it is specially:
The pending color smallest passage data having mist image are calculated according to following formula:
M
min(l)=min(P
R(l),P
Y(l),P
B(l))
In above formula, l is natural number, represents the position of pixel, M
minl () represents the color smallest passage data of pixel l, P
r(l), P
y(l), P
bl () represents pending respectively has mist image M at red, yellow, blue three color components of pixel l.
3. the image defogging method capable based on human eye vision similarity constraint according to claim 1, it is characterized in that, described step S2, comprising:
S21, carry out the non local similarity constraint Federated filter of associating of 2 two passages according to following formula respectively to there being mist image and obtaining two filtering images:
In above formula, C1, C2 represent two filtering images of acquisition respectively, and M represents pending has mist image, P
yindicate the luminance components of mist image M, N is natural number, represents the number of each pixel being carried out to the pixel participated in required for Federated filter, β
1, β
2all represent filtering strength;
S22, according to obtain two filtering images calculate the error image D meeting visual characteristics of human eyes:
D(l)=|C1(l)-C2(l)|
In above formula, l is natural number, and represent the position of pixel, D (l) represents the value of error image D at pixel l, and C1 (l), C2 (l) represent the value of two filtering images at pixel l of acquisition respectively;
S23, calculate the initial estimate obtaining atmospheric scattering light according to following formula:
In above formula, φ (l) represents the initial estimate of atmospheric scattering light at pixel l, and θ represents the average brightness value of C1 (l);
S24, revise rear acquisition atmospheric scattering data according to the initial estimate of following formula to atmospheric scattering light:
ψ(l)=max(min(0.91×φ(l),C1(l)),0)
In above formula, ψ (l) represents the atmospheric scattering data at pixel l.
4. the image defogging method capable based on human eye vision similarity constraint according to claim 3, is characterized in that, in described step S21, and N=40, β
1=0.01, β
2=0.07.
5. the image defogging method capable based on human eye vision similarity constraint according to claim 3, it is characterized in that, in described step S21, the formula that the non local similarity constraint Federated filter of associating carrying out two passages adopts is SDL (im1, im2, num, β), wherein im1, im2 are two measure-alike single channel image, num is for natural number and represent the number of each pixel being carried out to the pixel participated in required for Federated filter, β represents filtering strength, and the filtering image finally obtained is:
i(k)=γ
1(k)·im1(k)+γ
2(k)
In above formula, k is natural number, and represent the position of pixel, i (k) represents the value of filtering image at pixel k, and im1 (k) represents the value of the pixel k of single channel image im1, γ
1k () represents the linear coefficient of the filtering of the pixel k of single channel image im1, γ
2k () represents the biased coefficient of the filtering of the pixel k of single channel image im1, γ
1(k) and γ
2k () is obtained by following formulae discovery:
In above formula, im1
minl () represents the color smallest passage data of the pixel l of single channel image im1, SK
krepresent the set of the individual similar pixel of the closest num of pixel k, σ (k) represents the standard variance of the similar pixel of the pixel k of single channel image im1, μ (k) represents the similar pixel average of the pixel k of single channel image im1, and σ (k) and μ (k) is obtained by following formulae discovery:
。
6. the image defogging method capable based on human eye vision similarity constraint according to claim 5, is characterized in that, the S set K of the individual similar pixel of closest num of pixel k
kbe the set of combining the minimum num of a similarity pixel with k, the computing formula of described associating similarity is as follows:
In above formula, k1, k2 are natural number, all represent the position of pixel, and S (k1, k2) represents pixel k1, k2 associating similarity on single channel image im1, im2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k2, λ represents scale-up factor.
7. the image defogging method capable based on human eye vision similarity constraint according to claim 1, it is characterized in that, described step S3, comprising:
S31, search and obtain pending have the brightness of mist image front 1.2% the location of pixels set of pixel;
S32, according to the location of pixels set obtained, search the overall brightness Γ of brightness maximum value as mist light having in mist image;
S33, calculate air ature of coal spreading rate according to following formula:
In above formula, ρ (l) represents the air ature of coal spreading rate at pixel l, and ψ (l) represents the atmospheric scattering data at pixel l;
S34, rebuild mist elimination image obtain initialization mist elimination image according to following formula:
In above formula,
represent red, green, blue three color components of initialization mist elimination image respectively,
represent pending respectively and have mist image M at red, yellow, blue three color components of pixel l.
8. the image defogging method capable based on human eye vision similarity constraint according to claim 1, it is characterized in that, described step S4, it is specially:
According to following formula, three-channel associating similarity constraint Federated filter is carried out to initialization mist elimination image, obtains the image after mist elimination:
In above formula, I
r, I
g, I
brepresent red, green, blue three color components of the image after mist elimination respectively,
represent red, green, blue three single channel image of initialization mist elimination image respectively.
9. the image defogging method capable based on human eye vision similarity constraint according to claim 8, it is characterized in that, carrying out the formula that three-channel associating similarity constraint Federated filter adopts is JDN (im1, im2, im3, num, β), wherein im1, im2, im3 are three measure-alike single channel image, and num is for natural number and represent the number of each pixel being carried out to the pixel participated in required for Federated filter, β represents filtering strength, and the filtering image finally obtained is:
O(k)=η
1(k)·im1(k)+η
2(k)
In above formula, k is natural number, and represent the position of pixel, O (k) represents the value of filtering image at pixel k, and im1 (k) represents the value of the pixel k of single channel image im1, η
1k () represents the linear coefficient of the filtering of the pixel k of single channel image im1, η
2k () represents the biased coefficient of the filtering of the pixel k of single channel image im1, η
1(k) and η
2k () is obtained by following formulae discovery:
In above formula, im1
minl () represents the color smallest passage data of the pixel l of single channel image im1, SK
krepresent the set of the individual similar pixel of the closest num of pixel k,
represent the standard variance of the similar pixel of the pixel k of single channel image im1,
represent the similar pixel average of the pixel k of single channel image im1,
with
obtained by following formulae discovery:
。
10. the image defogging method capable based on human eye vision similarity constraint according to claim 9, is characterized in that, the S set K of the individual similar pixel of closest num of pixel k
kbe the set of combining the minimum num of a similarity pixel with k, the computing formula of described associating similarity is as follows:
In above formula, k1, k2 are natural number, all represent the position of pixel, S'(k1, k2) represent pixel k1, k2 associating similarity on single channel image im1, im2, im3,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im1 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im2 centered by pixel k2,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im3 centered by pixel k1,
represent the value of the pixel l on the image block of 5 × 5 on single channel image im3 centered by pixel k2, λ represents scale-up factor.
11., based on the image mist elimination system of human eye vision similarity constraint, is characterized in that, comprising:
First processing module, for calculating the pending color smallest passage data having mist image;
Second processing module, for the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtains atmospheric scattering data;
3rd processing module, for utilizing the atmospheric scattering data reconstruction mist elimination image of acquisition and obtaining initialization mist elimination image;
4th processing module, for carrying out three-channel associating similarity constraint Federated filter to initialization mist elimination image, obtains the image after mist elimination.
12. based on the image mist elimination equipment of human eye vision similarity constraint, it is characterized in that, the processor comprising camera and be connected with camera, described camera is for gathering image, described processor is used for carrying out mist elimination process to the image that camera gathers, and described processor comprises:
First processing module, for calculating the pending color smallest passage data having mist image;
Second processing module, for the non local similarity constraint Federated filter of associating having mist image to carry out 2 two passages respectively, and then obtains atmospheric scattering data;
3rd processing module, for utilizing the atmospheric scattering data reconstruction mist elimination image of acquisition and obtaining initialization mist elimination image;
4th processing module, for carrying out three-channel associating similarity constraint Federated filter to initialization mist elimination image, obtains the image after mist elimination.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510096613.4A CN104657954B (en) | 2015-03-04 | 2015-03-04 | Image defogging method, system and equipment based on human eye vision similarity constraint |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510096613.4A CN104657954B (en) | 2015-03-04 | 2015-03-04 | Image defogging method, system and equipment based on human eye vision similarity constraint |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104657954A true CN104657954A (en) | 2015-05-27 |
CN104657954B CN104657954B (en) | 2017-08-04 |
Family
ID=53249032
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201510096613.4A Expired - Fee Related CN104657954B (en) | 2015-03-04 | 2015-03-04 | Image defogging method, system and equipment based on human eye vision similarity constraint |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104657954B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050074140A1 (en) * | 2000-08-31 | 2005-04-07 | Grasso Donald P. | Sensor and imaging system |
CN102663702A (en) * | 2012-04-20 | 2012-09-12 | 西安电子科技大学 | Natural image denoising method based on regional division |
CN103489161A (en) * | 2013-09-12 | 2014-01-01 | 南京邮电大学 | Gray level image colorizing method and device |
CN104253930A (en) * | 2014-04-10 | 2014-12-31 | 西南科技大学 | Real-time video defogging method |
-
2015
- 2015-03-04 CN CN201510096613.4A patent/CN104657954B/en not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050074140A1 (en) * | 2000-08-31 | 2005-04-07 | Grasso Donald P. | Sensor and imaging system |
CN102663702A (en) * | 2012-04-20 | 2012-09-12 | 西安电子科技大学 | Natural image denoising method based on regional division |
CN103489161A (en) * | 2013-09-12 | 2014-01-01 | 南京邮电大学 | Gray level image colorizing method and device |
CN104253930A (en) * | 2014-04-10 | 2014-12-31 | 西南科技大学 | Real-time video defogging method |
Non-Patent Citations (4)
Title |
---|
CHEN ZHEN: "Single Image Defogging Algorithm based on Dark Channel Priority", 《JOURNAL OF MULTIMEDIA》 * |
E. ULLAH 等: "Single Image haze removal using improved Dark Channel Prior", 《MODELLING, IDENTIFICATION & CONTROL》 * |
方帅 等: "单幅雾天图像的同步去噪与复原", 《模式识别与人工智能》 * |
钱小燕: "单一图像多滤波联合快速去雾算法", 《科学技术与工程》 * |
Also Published As
Publication number | Publication date |
---|---|
CN104657954B (en) | 2017-08-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220343598A1 (en) | System and methods for improved aerial mapping with aerial vehicles | |
CN102254313A (en) | Image defogging method based on restoration and fusion of images on foggy days | |
CN109584170B (en) | Underwater image restoration method based on convolutional neural network | |
CN108269244B (en) | Image defogging system based on deep learning and prior constraint | |
US11528435B2 (en) | Image dehazing method and image dehazing apparatus using the same | |
US20140369601A1 (en) | Apparatus and method for enhancing image using color channel | |
CN103049888A (en) | Image/video demisting method based on combination of dark primary color of atmospheric scattered light | |
CN107248174A (en) | A kind of method for tracking target based on TLD algorithms | |
CN103914820B (en) | Image haze removal method and system based on image layer enhancement | |
CN104751432A (en) | Image reconstruction based visible light and infrared image fusion method | |
CN112488948B (en) | Underwater image restoration method based on black pixel point estimation back scattering | |
CN105469372A (en) | Mean filtering-based fog-degraded image sharp processing method | |
CN104272347A (en) | Image processing apparatus for removing haze contained in still image and method thereof | |
CN111192205A (en) | Image defogging method and system and computer readable storage medium | |
CN106657948A (en) | low illumination level Bayer image enhancing method and enhancing device | |
Jang et al. | Deep color transfer for color-plus-mono dual cameras | |
US20160035107A1 (en) | Moving object detection | |
Huang et al. | Enhancing object detection in the dark using U-Net based restoration module | |
McCloskey et al. | Iris capture from moving subjects using a fluttering shutter | |
US9002132B2 (en) | Depth image noise removal apparatus and method based on camera pose | |
Sheng et al. | Guided colorization using mono-color image pairs | |
CN103870847A (en) | Detecting method for moving object of over-the-ground monitoring under low-luminance environment | |
CN105608674A (en) | Image registration, interpolation and denoising-based image enhancement method | |
TWM458747U (en) | Image processing module | |
CN104657954A (en) | Human vision similarity constraint based image dehazing method, system and equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Liu Feng Inventor after: Gan Zongliang Inventor after: Chen Setao Inventor after: Lv Yueyuan Inventor before: Liu Feng Inventor before: Yu Zongliang Inventor before: Chen Setao Inventor before: Lv Yueyuan |
|
CB03 | Change of inventor or designer information | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170804 Termination date: 20200304 |
|
CF01 | Termination of patent right due to non-payment of annual fee |