CN106408520A - High-color fidelity image defogging method - Google Patents

High-color fidelity image defogging method Download PDF

Info

Publication number
CN106408520A
CN106408520A CN201610179995.1A CN201610179995A CN106408520A CN 106408520 A CN106408520 A CN 106408520A CN 201610179995 A CN201610179995 A CN 201610179995A CN 106408520 A CN106408520 A CN 106408520A
Authority
CN
China
Prior art keywords
image
hsi
formula
luminance component
component
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610179995.1A
Other languages
Chinese (zh)
Other versions
CN106408520B (en
Inventor
葛鹏
单译琳
王洪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Zhongshan Institute of Modern Industrial Technology of South China University of Technology
Original Assignee
South China University of Technology SCUT
Zhongshan Institute of Modern Industrial Technology of South China University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT, Zhongshan Institute of Modern Industrial Technology of South China University of Technology filed Critical South China University of Technology SCUT
Publication of CN106408520A publication Critical patent/CN106408520A/en
Application granted granted Critical
Publication of CN106408520B publication Critical patent/CN106408520B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/73Deblurring; Sharpening
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)
  • Processing Of Color Television Signals (AREA)

Abstract

The invention discloses a high-color fidelity image defogging method. The method includes obtaining a group of new HSI imaging models in the frog weather by converting the image from an RGB space to an HSI space; performing defogging based on image enhancement on the image brightness component I in the HSI space and obtaining a new brightness component IJ through the combination with the HSI imaging models; performing modification by means of the new brightness component IJ and obtaining the saturation component SJ of the image through the combination with the HSI imaging models; and maintaining the tone component unchanged and converting the defogging result from an HSI image to an RGB image. Therefore, the defogged image has high color fidelity. The image is processed by the HSI space, so that the image color can be better maintained.

Description

A kind of image defogging method of high color fidelity
Technical field
The present invention relates to the mist elimination technical field based on image enhaucament is and in particular to a kind of image of high color fidelity goes Mist method.
Background technology
In the case of the greasy weather, imaging device is subject to scattering and the absorption of air suspended particles, and atmosphere light participates in imaging Impact, become picture contrast declines, and visibility reduces, and details is smudgy, and picture quality significantly declines.It is basic Imaging model is as follows:
I (x)=J (x) t (x)+A (1-t (x)) (20)
Wherein J (x) is script fog free images, and I (x) is Misty Image, and t (x) is the absorbance of scene, and A is atmospheric environment Light.Scene absorbance t (x) reflects the depth information of Misty Image, and t (x) is less to represent that the fog of impact image is thicker, is subject to Impact bigger.
The general mist elimination algorithm based on image enhaucament, is typically carried out in RGB color, by by R, G, B tri- Channel separation, and process separately as gray level image.But due in processing procedure, have ignored R, tri- passages of G, B completely Between contact it is easy to lead to the distortion of color.
Content of the invention
It is an object of the invention to overcoming deficiencies of the prior art, provide a kind of image of high color fidelity Defogging method.
The purpose of the present invention is achieved through the following technical solutions.
A kind of image defogging method of high color fidelity, comprises the steps:
(1) image is transformed into HSI space by rgb space, obtains the HSI imaging model under one group of new greasy weather;
(2) the luminance component I of image is carried out processing and combine HSI based on the mist elimination of image enhaucament in HSI space As model obtains new luminance component IJ
(4) by new luminance component IJIt is modified and obtains with reference to HSI imaging model the saturation component of image SJ
(4) keep chrominance component constant, mist elimination result is converted to RGB image from HSI image.
Further, image by the change type in rgb space to HSI space is:
For the chrominance component H in HSI component, because fog can't impact to the tone of image script, So having:
HI=HJ(24)
H hereIRepresent haze image tone, HJRepresent fog free images tone.
But for component S saturation and I brightness, due to the impact of fog, saturation S significantly declines, and bright Degree I then rises overally, and contrast reduces, and details reduces.Next according to atmospherical scattering model come to mist figure and artwork Saturation, luminance component relation are derived.
First, the atmospherical scattering model of (1) formula is separated to R, tri- passages of G, B then have:
IR(x)=R (x) t (x)+A (1-t (x)) (25)
IG(x)=G (x) t (x)+A (1-t (x)) (26)
IB(x)=B (x) t (x)+A (1-t (x)) (27)
It is assumed here that absorbance t (x) and atmospheric environment light A are to R, the impact of tri- passages of G, B is all identical.
By obtaining to (6), (7), (8) summation:
IR+IG+IB=(R+G+B) t+A (1-t) (28)
In conjunction with (4) formula, this example can obtain:
II=IJt+A(1-t) (29)
Wherein IIRepresent the luminance component of mist figure, IJRepresent the luminance component of fogless figure.
Minimum Value Operations are carried out in R, G, B triple channel to (1) formula.
Imin(R,G,B)=Jmin(R,G,B)t+Amin(R,G,B)(1-t) (30)
In conjunction with (1) formula and (11) formula, this example can obtain:
In fact, contrast (3), formula (12) left side is actual to be equal to saturation SI, and to molecule denominator on the right of formula (12) Remove A simultaneously, just can obtain, and actually in the case of the greasy weather, this can be considered 0, therefore omit.Then formula (12) abbreviation is:
Formula (13) both sides are simultaneously except the further abbreviation of J is:
So just obtain the imaging model in HSI space in the case of the greasy weather:
In the case of formula (15) illustrates the greasy weather well, the imaging law of the image under HSI color space pattern.We can To process to (15) further, to obtain the form more suitable for image enhaucament.We are permissible for convolution (14) and formula (10) Eliminate absorbance t, obtain:
Wherein
Convolution (3) and formula (16) we can obtain:
Then we have just obtained the HSI imaging model under one group of new greasy weather:
So, we only need to the luminance graph of Misty Image is strengthened so that result just may be used close to min (R, G, B) To obtain by (16), (17) try to achieve IJComponent and SJComponent.
Further, by formula (18), the mist elimination algorithm of the image enhaucament in rgb space can be transformed into by we HSI space is processed.
We obtain the gray level image of the mist elimination of luminance component I by algorithm for image enhancement first, and using result as min (R, G, B) brings (17) formula into, and the result tried to achieve is as new luminance component IJ.Luminance component I due to such estimationJIt is not The image of actual scene, is brought directly to the error that (16) formula is likely to result in required saturation, therefore bright to estimation here Degree component IJIt is modified, introduce correction factor m and go correction formula (16) so as to the luminance component I that brings intoJDistribution value is more Close to actual distribution, so just can substantially estimate saturation SJ, and due to saturation SJTo slight change and details letter Breath is simultaneously insensitive, and therefore after such process, we often can obtain the preferable result of color fidelity:
Due to the brightness I via image enhaucamentJOften bright than the luminance component under practical situation, therefore m generally takes Positive number, simultaneously in order to ensure that luminance component after treatment is not in the situation that data is overflowed, by its least commitment to 0.03.
Further, in process of the test, often assume that atmosphere light A perseverance is 1, repaiied also dependent on practical situation here Just, but in order to simplify algorithm, the present invention directly takes 1.
Compared with prior art, the invention has the advantages that and technique effect:
The present invention provides a kind of image defogging method of high color fidelity, is mainly based upon atmospherical scattering model to HSI Color space model is optimized, so that mist elimination image has higher color fidelity, the present invention adopts HSI space pair Image is processed, and can be very good to keep the color of image.The present invention effectively improves the fidelity of image, can obtain preferably Visual effect.
Brief description
The original haze image of Fig. 1 embodiment one.
Fig. 2 in RGB color model using partial histogram equalization obtained by mist elimination result figure.
The luminance component I that Fig. 3 is tried to achieveJ.
The saturation component S that Fig. 4 is tried to achieveJ.
The final process result of Fig. 5 embodiment one.
The original haze image of Fig. 6 embodiment two.
Fig. 7 in RGB color model using MSR obtained by mist elimination result.
The luminance component I that Fig. 8 is tried to achieveJ.
The saturation component S that Fig. 9 is tried to achieveJ.
The final process result of Figure 10 embodiment two.
Figure 11 is the schematic flow sheet of the image defogging method of high color fidelity.
Specific embodiment
To describe embodiments of the present invention below with reference to drawings and Examples in detail, thus elaborating on how to apply The HSI color space model of the present invention goes to optimize all kinds of image enhaucament mist elimination algorithms, and by using this HSI color space model The mist elimination algorithm of image enhaucament and the image enhaucament mist elimination algorithm in rgb space contrast, thus highlighting this color space mould The superiority of type.
Embodiment one
Example 1 adopts the mist elimination algorithm based on partial histogram equalization algorithm.Fig. 1 illustrates this example will be carried out The haze picture of mist elimination.This example first directly carries out mist elimination process to image in RGB color, and result is as shown in Fig. 2 permissible See that serious cross-color integrally in image.Next processed using the HSI color space model of this example, specifically Step is as follows:
1) Fig. 1 is converted into HSI figure;
2) to luminance component IICarry out partial histogram equalization process, and result is brought into (17) as min (R, G, B) Formula, the result tried to achieve is as new luminance component IJ, result is as shown in Figure 3;
3) by the I obtainingJ, bring formula (19) into thus trying to achieve saturation component SJ, result is as shown in Figure 4;
4) keep chrominance component constant, and result is converted back RGB image, result is as shown in Figure 5.
This example can be seen by being transformed into local histogram equalization algorithm in the HSI color space model of this example Go to process, can effectively improve the fidelity of image, obtain preferable visual effect.And for from run time, In HSI color space model, process time only has 51.5% (matlab R2015b, CPU i5-2410m@of RGB color 2.30GHz) it is seen that this algorithm not only has superior color fidelity, and can also effectively improve operational efficiency.
Embodiment two
Example 2 adopts the mist elimination algorithm based on MSR algorithm.Fig. 6 illustrates the haze figure of this example mist elimination to be carried out Piece.This example first directly carries out mist elimination process to image in RGB color, and result is as shown in Figure 7 it can be seen that image is overall Serious cross-color occurs.Next processed using the HSI color space model of this example, comprised the following steps that:
1) Fig. 6 is converted into HSI figure;
2) to luminance component IICarry out partial histogram equalization process, and result is brought into (17) as min (R, G, B) Formula, the result tried to achieve is as new luminance component IJ, result is as shown in Figure 8;
3) by the I obtainingJ, bring formula (19) into thus trying to achieve saturation component SJ, result is as shown in Figure 9;
4) keep chrominance component constant, and result is converted back RGB image, result is as shown in Figure 10.
Can see by MSR algorithm is transformed in the HSI color space model of this example go process, can be effective Improve the fidelity of image, obtain preferable visual effect.And for from run time, in HSI color space model Process time only has 49.8% (matlab R2015b, CPU i5-2410m@2.30GHz) of RGB color, more can see Obtain superiority and the versatility of this algorithm.Most of image enhaucament class mist elimination algorithm processing in rgb space can pass through This HSI color space model is processed to optimize original algorithm.
Although disclosed herein embodiment as above, described content is only to facilitate understanding the present invention and adopting Embodiment, is not limited to the present invention.Technical staff in any the technical field of the invention, without departing from this On the premise of the disclosed spirit and scope of invention, any modification and change can be made in the formal and details implemented, But the scope of patent protection of the present invention, still must be defined by the scope of which is defined in the appended claims.

Claims (5)

1. a kind of image defogging method of high color fidelity is it is characterised in that comprise the steps:
(1) image is transformed into HSI space by rgb space, obtains the HSI imaging model under one group of new greasy weather;
(2) the luminance component I of image is carried out processing and combine HSI imaging mould based on the mist elimination of image enhaucament in HSI space Type obtains new luminance component IJ
(3) by new luminance component IJIt is modified and obtains with reference to HSI imaging model the saturation component S of imageJ
(4) keep chrominance component constant, mist elimination result is converted to RGB image from HSI image.
2. a kind of image defogging method of high color fidelity according to claim 1 is it is characterised in that step (1) is concrete Including:
The basic imaging model of Misty Image is as follows:
I (x)=J (x) t (x)+A (1-t (x)) (1)
Wherein J (x) is script fog free images, and I (x) is Misty Image, and t (x) is the absorbance of scene, and A is atmospheric environment light;
Image by the change type in rgb space to HSI space is:
H = cos - 1 { 1 2 [ ( R - G ) + ( R - B ) ] ( R - G ) 2 + ( R - B ) ( G - B ) } - - - ( 2 )
S = 1 - 3 R + G + B min ( R + G + B ) - - - ( 3 )
I = 1 3 ( R + G + B ) - - - ( 4 )
For the chrominance component H in HSI component, because fog can't impact to the tone of image script, have:
HI=HJ(5)
H hereIRepresent haze image tone, HJRepresent fog free images tone;
The atmospherical scattering model of (1) formula is separated to R, tri- passages of G, B then have:
IR(x)=R (x) t (x)+A (1-t (x)) (6)
IG(x)=G (x) t (x)+A (1-t (x)) (7)
IB(x)=B (x) t (x)+A (1-t (x)) (8)
Assume absorbance t (x) and atmospheric environment light A to R, the impact of tri- passages of G, B is all identical;
By obtaining to (6), (7), (8) summation:
IR+IG+IB=(RG+B) t+A (1-t) (9)
In conjunction with (4) formula, can obtain:
II=IJt+A(1-t) (10)
Wherein IIRepresent the luminance component of mist figure, IJRepresent the luminance component of fogless figure;
In R, G, B triple channel, minimum Value Operations are carried out to (1) formula,
Imin(R,G,B)=Jmin(R,G,B)t+Amin(R,G,B)(1-t) (11)
In conjunction with (1) formula and (11) formula, obtain:
I - 3 I min ( R , G , B ) I = ( J - 3 J min ( R , G , B ) ) t + ( A - 3 A min ( R , G , B ) ) ( 1 - t ) J t + A ( 1 - t ) - - - ( 12 )
Formula (12) abbreviation is:
S I = ( J - 3 J min ( R , G , B ) ) t I - - - ( 13 )
Formula (13) both sides are simultaneously except the further abbreviation of J is:
S I = S J J t I - - - ( 14 )
Obtain the imaging model in HSI space in the case of the greasy weather:
H I = H J S I = S J J t 1 I I = I J t + A ( 1 - t ) - - - ( 15 )
Convolution (14) and formula (10) eliminate absorbance t, obtain:
S J = k ( A - J J ) - - - ( 16 )
Wherein
Convolution (3) and formula (16) can obtain:
I J = k A + m i n ( R , G , B ) 1 + k - - - ( 17 )
Then obtained the HSI imaging model under one group of new greasy weather:
H J = H I S J = k ( A - I J I J ) I J = k A + min ( R , G , B ) 1 + k - - - ( 18 ) .
3. the image defogging method of described a kind of high color fidelity according to claim 2 is it is characterised in that step (2) specifically include:
The mist elimination algorithm of the image enhaucament in rgb space can be transformed into HSI space and processed by formula (18);Logical first Cross the gray level image that algorithm for image enhancement obtains the mist elimination of luminance component I, and result brought into (17) formula as min (R, G, B), The result tried to achieve is as new luminance component IJ.
4. the image defogging method of described a kind of high color fidelity according to claim 3 is it is characterised in that step (3) specifically include:
Due to new luminance component IJIt is not the image of actual scene, (16) formula that is brought directly to is likely to result in required saturation Error, therefore here to estimation new luminance component IJIt is modified, introduce a correction factor m and go correction formula (16) so as to the luminance component I bringing intoJDistribution value, closer to actual distribution, so just estimates saturation SJ, and due to Saturation SJTo slight change and detailed information and insensitive, therefore can obtain the preferable result of color fidelity:
S J = k ( A - m a x ( 0.03 , ( I J - m ) ) max ( 0.03 , ( I J - m ) ) ) - - - ( 19 )
Due to the new luminance component I via image enhaucamentJOften bright than the luminance component under practical situation, therefore m is usual Take positive number.
5. the image defogging method of described a kind of high color fidelity according to claim 3 is it is characterised in that step (3) by m least commitment to 0.03 in.
CN201610179995.1A 2015-12-27 2016-03-24 A kind of image defogging method of high color fidelity Expired - Fee Related CN106408520B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2015107074744 2015-12-27
CN201510707474 2015-12-27

Publications (2)

Publication Number Publication Date
CN106408520A true CN106408520A (en) 2017-02-15
CN106408520B CN106408520B (en) 2019-05-14

Family

ID=58007170

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610179995.1A Expired - Fee Related CN106408520B (en) 2015-12-27 2016-03-24 A kind of image defogging method of high color fidelity

Country Status (1)

Country Link
CN (1) CN106408520B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107454317A (en) * 2017-07-27 2017-12-08 广东欧珀移动通信有限公司 Image processing method, device, computer-readable recording medium and computer equipment
CN109003238A (en) * 2018-06-26 2018-12-14 西京学院 A kind of image haze minimizing technology based on model and histogram and grey level enhancement
CN110223253A (en) * 2019-06-10 2019-09-10 江苏科技大学 A kind of defogging method based on image enhancement
CN112082738A (en) * 2020-08-24 2020-12-15 南京理工大学 Performance evaluation test system and test method for color night vision camera
US10896488B2 (en) 2018-02-23 2021-01-19 Mobile Drive Technology Co., Ltd. Electronic device and method for removing haze from image

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110135200A1 (en) * 2009-12-04 2011-06-09 Chao-Ho Chen Method for determining if an input image is a foggy image, method for determining a foggy level of an input image and cleaning method for foggy images
CN103632339A (en) * 2012-08-21 2014-03-12 张晓光 Single image defogging method based on variation Retinex and apparatus
US20140140619A1 (en) * 2011-08-03 2014-05-22 Sudipta Mukhopadhyay Method and System for Removal of Fog, Mist, or Haze from Images and Videos
CN103985091A (en) * 2014-04-30 2014-08-13 西安理工大学 Single image defogging method based on luminance dark priori method and bilateral filtering

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110135200A1 (en) * 2009-12-04 2011-06-09 Chao-Ho Chen Method for determining if an input image is a foggy image, method for determining a foggy level of an input image and cleaning method for foggy images
US20140140619A1 (en) * 2011-08-03 2014-05-22 Sudipta Mukhopadhyay Method and System for Removal of Fog, Mist, or Haze from Images and Videos
CN103632339A (en) * 2012-08-21 2014-03-12 张晓光 Single image defogging method based on variation Retinex and apparatus
CN103985091A (en) * 2014-04-30 2014-08-13 西安理工大学 Single image defogging method based on luminance dark priori method and bilateral filtering

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
张红: "雾天图像的清晰化处理与颜色校正算法研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107454317A (en) * 2017-07-27 2017-12-08 广东欧珀移动通信有限公司 Image processing method, device, computer-readable recording medium and computer equipment
US10896488B2 (en) 2018-02-23 2021-01-19 Mobile Drive Technology Co., Ltd. Electronic device and method for removing haze from image
TWI724375B (en) * 2018-02-23 2021-04-11 富智捷股份有限公司 Haze removal method, electronic device and computer readable recording media
CN109003238A (en) * 2018-06-26 2018-12-14 西京学院 A kind of image haze minimizing technology based on model and histogram and grey level enhancement
CN109003238B (en) * 2018-06-26 2021-06-25 西京学院 Image haze removal method based on model, histogram and gray level enhancement
CN110223253A (en) * 2019-06-10 2019-09-10 江苏科技大学 A kind of defogging method based on image enhancement
CN110223253B (en) * 2019-06-10 2023-02-28 江苏科技大学 Defogging method based on image enhancement
CN112082738A (en) * 2020-08-24 2020-12-15 南京理工大学 Performance evaluation test system and test method for color night vision camera
CN112082738B (en) * 2020-08-24 2022-08-16 南京理工大学 Performance evaluation test system and test method for color night vision camera

Also Published As

Publication number Publication date
CN106408520B (en) 2019-05-14

Similar Documents

Publication Publication Date Title
CN106408520A (en) High-color fidelity image defogging method
CN106910175B (en) Single image defogging algorithm based on deep learning
CN102750674B (en) Video image defogging method based on self-adapting allowance
CN102063706B (en) Rapid defogging method
CN106780356A (en) Image defogging method based on convolutional neural networks and prior information
CN103761720B (en) Image defogging method and image demister
CN104794697B (en) A kind of image defogging method based on dark primary priori
CN107767354A (en) A kind of image defogging algorithm based on dark primary priori
CN105023256B (en) A kind of image defogging method and system
CN106251301A (en) A kind of single image defogging method based on dark primary priori
CN103996178A (en) Sand and dust weather color image enhancing method
CN110570360B (en) Retinex-based robust and comprehensive low-quality illumination image enhancement method
CN110570365A (en) image defogging method based on prior information
Wang et al. Variational single nighttime image haze removal with a gray haze-line prior
CN107958465A (en) A kind of single image to the fog method based on depth convolutional neural networks
CN107451966A (en) A kind of real-time video defogging method realized using gray-scale map guiding filtering
CN110136079A (en) Image defogging method based on scene depth segmentation
CN112200746B (en) Defogging method and equipment for foggy-day traffic scene image
WO2024060576A1 (en) Image dehazing method based on dark channel prior
CN104867121A (en) Fast image defogging method based on dark channel prior and Retinex theory
CN103914820A (en) Image haze removal method and system based on image layer enhancement
CN111598814B (en) Single image defogging method based on extreme scattering channel
CN104809700A (en) Low-light video real-time enhancement method based on bright channel
CN107977941B (en) Image defogging method for color fidelity and contrast enhancement of bright area
CN107481211B (en) Night traffic monitoring enhancement method based on gradient domain fusion

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190514

Termination date: 20210324