CN102724541B - Intelligent diagnosis and recovery method for monitoring images - Google Patents

Intelligent diagnosis and recovery method for monitoring images Download PDF

Info

Publication number
CN102724541B
CN102724541B CN201210164075.4A CN201210164075A CN102724541B CN 102724541 B CN102724541 B CN 102724541B CN 201210164075 A CN201210164075 A CN 201210164075A CN 102724541 B CN102724541 B CN 102724541B
Authority
CN
China
Prior art keywords
image
processing
judged
taken
grades
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210164075.4A
Other languages
Chinese (zh)
Other versions
CN102724541A (en
Inventor
尚凌辉
杜雅慧
仝文翰
高勇
刘嘉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZHEJIANG ICARE VISION TECHNOLOGY CO., LTD.
Original Assignee
ZHEJIANG ICARE VISION TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZHEJIANG ICARE VISION TECHNOLOGY Co Ltd filed Critical ZHEJIANG ICARE VISION TECHNOLOGY Co Ltd
Priority to CN201210164075.4A priority Critical patent/CN102724541B/en
Publication of CN102724541A publication Critical patent/CN102724541A/en
Application granted granted Critical
Publication of CN102724541B publication Critical patent/CN102724541B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention relates to an intelligent diagnosis and recovery method for monitoring images. The conventional digital monitored image processing system can be only used for diagnosing simple image problems such as brightness, signal deficiency and color offset and can only judge the problems instead of supplying a proper processing sequence and a proper processing method. The intelligent diagnosis and recovery method is characterized by comprising an image problem base, wherein the image problem base lists all possible image degradation problems, and sequences the problems in an inverted sequence direction of the monitored imaging; during running, the problems are sequentially taken out and judged by using the diagnosis method; if a mark of a judgment result is smaller than a preset threshold value, the problem is real, a corresponding processing measure is taken from the list, and the result is sent to a user; if the mark of the judgment result is greater than the set value, the problem is not real, and the next problem is automatically selected and judged; and the steps are repeated until all the problems in the problem base are browsed. By the method, the requirement on professional knowledge of an operator and practice operation for processing the images is reduced; and the operation process is quick and simple.

Description

One kind monitoring image intelligent diagnostics restoration methods
Technical field
The invention belongs to digital image processing field, especially a kind of monitoring image intelligent diagnostics restoration methods. 
Background technology
Digital supervision image can be produced and degraded due to different factors in whole imaging process, and the performance that degrades includes illumination deficiency, colour cast, fuzzy, noise etc., and Questions types are varied and may be overlapped mutually.Sequencing difference is produced because difference degrades(As illumination problem is produced before compression problem)So that the overlay order that difference degrades is also different.When progress degrades the recovery of image, user is firstly the need of all problems for judging monitor video presence;Secondly need to judge the superposition level of each problem according to the process that degrades of video, so that it is determined that recovering the order of processing;Finally suitable processing method is selected to carry out the recovery that degrades for each problem.It can be seen that, before progress degrades recovery operation, it is necessary to first decision problem, determination order, system of selection.That only degradation problems are looked for is accurate, processing sequence is proper, system of selection is suitable, is possible to preferably remove interference, lifts the quality of image. 
Existing digital picture recovers processing system and is often only conceived to processing function, and is not paid close attention to enough for decision problem, determination order, selecting party rule, fully relies on user's experience in itself and Specialized Quality.Which results in three problems:First, it is that product is harsher for the requirement of user, it is necessary to be that the personnel with suitable professional knowledge and operating experience could preferably use;Second, it is so that the process for the recovery that degrades has carried larger subjective colo(u)r, different people, different time, different conditions are likely to be obtained different results;3rd, the propagation of process experience is detrimental to sharing. 
Usual image procossing is to use photoshop softwares, the use of its function needs user to carry out substantial amounts of relational learning and practical operation exercise with reference to help, various operation skills need to be exchanged by third party's mode such as books, network, cause treatment effeciency low, result can not produce a desired effect;Separately there are some digitized video problem diagnosis methods, such as video quality diagnosis system and its implementation(Application number:201110053434.4, applicant:Beijing Vion Technology Co., Ltd.), the simple image problem such as brightness, signal deletion, colour cast can be only diagnosed, and simply judgement is gone wrong, and suitable processing sequence and method can not be provided. 
The content of the invention
The defect that the present invention exists for prior art, a kind of monitoring image intelligent diagnostics restoration methods are provided, the all problems that monitor video is present can be judged, and rational sorting carries out recovery processing, by unified quality evaluation system and unified process flow, the interference of factor and individual subjective factor in operation can be shielded to a certain extent. 
Therefore, the present invention is adopted the following technical scheme that:One kind monitoring image intelligent diagnostics restoration methods, it is characterised in that including image problem storehouse, all possible image degradation problems are listed in described image problem storehouse, are ranked up each problem with the backward direction of Imaging for Monitoring;During operation, problem is taken out successively, it is judged using diagnostic method, if it is judged that fraction is less than given threshold, then prove that the problem is present, corresponding processing method is now taken out from list, and result is informed into user, if judged result fraction is higher than given threshold, then prove that problem is not present, automatically choose next problem to be judged, circulate above step, until problem is traversed once in problem base. 
The main species of the invention that degrade to monitoring image are summarized, and the presence or absence of every kind of problem and degree are diagnosed respectively by many algorithms, support includes high illumination, low-light (level), contrast deficiency, defocusing blurring, motion blur, random noise, fringes noise, periodic noise, colour cast, blocking effect etc.;The process degraded according to monitoring determines the order recovered, usual Imaging for Monitoring is carried out with the order of target → environment → camera lens → ccd → transmission → compression → storage, its degrade be also according to this sequentially, then carried out when degrading and recovering according to reverse direction, irreversible image being produced to image in view of some recovery operations and primitiveness requirement of the certain methods to image being higher, recovery order is suitably adjusted.Appropriate method is associated for different degradation problems. 
In the presence of a problem is proved, secondary diagnosis is also carried out to the problem and judges that it, with the presence or absence of two grades of problems, is judged two grades of problems using diagnostic method, if judged result fraction is less than given threshold, alignment processing method is then taken out, solution subsequently points to next two grades of problems;If judged result fraction is higher than given threshold, next two grades of problems are pointing directly at;Two grades of problem diagnosis results to the problem judge, if all two grades of problems all solve to finish, are judged automatically into next problem;If not solving all two grades of problems, proceed circulation diagnosis, settlement steps to deal. 
Judge that the fuzziness of image comprises the following steps:1. calculating the Local Extremum of image, the foreground area of image is obtained;2. pair original image carries out the secondary initial value for obscuring, image definition being calculated according to changing rule of the pixel at extreme point under the processing of various fuzzy cores using the Gaussian Blur core of different in width;3. marking a series of Aerial Images of different fog-levels in advance, felt to score one by one according to human eye, a nonlinear fitting is done in definition initial value and human eye vision the effect scoring that step 2 is obtained, the vague marking value after being optimized;4. being finally compared vague marking value with fuzziness threshold value set in advance, that is, obtain fuzzy classification result.
Illumination and contrast problem are diagnosed by foundation of the overall distribution position of image histogram.Carry out illumination when judging when histogram concentrates on low value region for low-light (level), be conversely high illumination;When the more narrow then contrast of histogram range is weaker when contrast judges. 
Colour cast problem is diagnosed with the distributed areas of RGB three channel histograms.During to colour cast Problem judgment, when RGB three channel histograms are when distributing position, scope difference are larger, then it can determine whether as with colour cast. 
For underlying noise, with low pass or the method with passband ripple extract noise contribution;For periodic noise, it is considered to which it detects that the discrete accumulation point of HFS carrys out the stable noise of recognition cycle in spectrogram;For aperiodic fringes noise, separated in the way of contour detecting. 
The problem of described processing method is for high illumination takes enhancing(Over-exposed pattern), gamma, histogram method processing;For low-light (level) problem, enhancing is taken(Night scene mode), gamma methods processing;For colour cast problem, white balance, tone homogenizing, the processing of spatial domain colour cast method of adjustment are taken;For defocusing blurring, Gaussian Blur, sharpening method processing are taken;For motion blur, motion blur method is taken to handle;For shake and other fuzzy, blind deblurring, sharpening method processing are taken;For blocking effect, deblocking method is taken to handle;For noise, NLM, mixing spatial domain denoising, the processing of dual-tree complex wavelet denoising method are taken.Be the suitable processing method of various question recommendings with digital picture principle and algorithm principle, such as the method such as the enhancing of illumination question recommending, luminance contrast, histogram;Environmental problem recommends misty rain to remove and night scene Enhancement Method;Colour cast recommends tone homogenizing or white balance method etc..The step can experiential accumulation constantly improve addition. 
The all problems that the present invention exists by all kinds of diagnosis automatic decision monitor videos, according to vision degradation process, provide for the more rational processing sequence of image problem, finally select suitable processing method to carry out the recovery that degrades for each problem.By image problem and corresponding processing method auto-associating, user is recommended, with user-friendly.By the pattern can also from software view Rapid Popularization good process experience and method.Operating process is fast and convenient to be required to the professional knowledge of image procossing and practice operation present invention reduces operator, Problem judgment order determines that method choice is unified specialized, is easy to new technology and the popularization of good experience to share. 
Brief description of the drawings
Fig. 1 is flow chart of the invention
Embodiment
Below by embodiment, technical scheme is described in further detail. 
As shown in figure 1, the handling process of monitoring image intelligent diagnostics restoration methods is as follows, first all possible image degradation problems are listed, each problem are ranked up with the backward direction of Imaging for Monitoring;During operation, problem is taken out successively, it is judged using diagnostic method, if it is judged that fraction is less than given threshold, then prove that the problem is present, corresponding processing method is now taken out from list, and result is informed into user, if judged result fraction is higher than given threshold, then prove that problem is not present, automatically choose next problem to be judged, circulate above step, until problem is traversed once in problem base.In the presence of a problem is proved, secondary diagnosis is also carried out to the problem and judges that it, with the presence or absence of two grades of problems, is judged two grades of problems using diagnostic method, if judged result fraction is less than given threshold, alignment processing method is then taken out, solution subsequently points to next two grades of problems;If judged result fraction is higher than given threshold, next two grades of problems are pointing directly at;Two grades of problem diagnosis results to the problem judge, if all two grades of problems all solve to finish, are judged automatically into next problem;If not solving all two grades of problems, proceed circulation diagnosis, settlement steps to deal. 
The problem of degrading includes high illumination, low-light (level), contrast deficiency, defocusing blurring, motion blur, random noise, fringes noise, periodic noise, colour cast, blocking effect etc.
Wherein judge that the fuzziness of image comprises the following steps:1. calculating the Local Extremum of image, the foreground area of image is obtained;2. pair original image carries out the secondary initial value for obscuring, image definition being calculated according to changing rule of the pixel at extreme point under the processing of various fuzzy cores using the Gaussian Blur core of different in width;3. marking a series of Aerial Images of different fog-levels in advance, felt to score one by one according to human eye, a nonlinear fitting is done in definition initial value and human eye vision the effect scoring that step 2 is obtained, the vague marking value after being optimized;4. being finally compared vague marking value with fuzziness threshold value set in advance, that is, obtain fuzzy classification result. 
Illumination and contrast problem are diagnosed by foundation of the overall distribution position of image histogram.Carry out illumination when judging when histogram concentrates on low value region for low-light (level), be conversely high illumination;When the more narrow then contrast of histogram range is weaker when contrast judges. 
Colour cast problem is diagnosed with the distributed areas of RGB three channel histograms.During to colour cast Problem judgment, when RGB three channel histograms are when distributing position, scope difference are larger, then it can determine whether as with colour cast. 
For underlying noise, with low pass or the method with passband ripple extract noise contribution;For periodic noise, it is considered to which it detects that the discrete accumulation point of HFS carrys out the stable noise of recognition cycle in spectrogram;For aperiodic fringes noise, separated in the way of contour detecting. 
The problem of in restoration methods for high illumination, takes enhancing(Over-exposed pattern), gamma, histogram method processing;For low-light (level) problem, enhancing is taken(Night scene mode), gamma methods processing;For colour cast problem, white balance, tone homogenizing, the processing of spatial domain colour cast method of adjustment are taken;For defocusing blurring, Gaussian Blur, sharpening method processing are taken;For motion blur, motion blur method is taken to handle;For shake and other fuzzy, blind deblurring, sharpening method processing are taken;For blocking effect, deblocking method is taken to handle;For noise, NLM, mixing spatial domain denoising, the processing of dual-tree complex wavelet denoising method are taken. 
Of particular note is that, the mode of above-described embodiment is only limitted to describe embodiment, but the present invention is not limited to aforesaid way, and those skilled in the art can easily be modified without departing from the scope of the present invention accordingly, therefore the scope of the present invention should include the maximum magnitude of disclosed principle and new feature. 

Claims (6)

1. one kind monitoring image intelligent diagnostics restoration methods, it is characterised in that including image problem storehouse, all possible image degradation problems are listed in described image problem storehouse, are ranked up each problem with the backward direction of Imaging for Monitoring;During operation, problem is taken out successively, it is judged using diagnostic method, if it is judged that fraction is less than given threshold, then prove that the problem is present, corresponding processing method is now taken out from list, and result is informed into user, if judged result fraction is higher than given threshold, then prove that problem is not present, automatically choose next problem to be judged, circulate above step, until problem is traversed once in problem base;Judge that the fuzziness of image comprises the following steps:A. the Local Extremum of image is calculated, the foreground area of image is obtained;B. the secondary initial value for obscuring, image definition being calculated according to changing rule of the pixel at extreme point under the processing of various fuzzy cores is carried out using the Gaussian Blur core of different in width to original image;C. a series of Aerial Images of different fog-levels are marked in advance, are felt to score one by one according to human eye, the obtained definition initial values of step b and the scoring of human eye vision effect are done into a nonlinear fitting, the vague marking value after being optimized;D. finally vague marking value is compared with fuzziness threshold value set in advance, that is, obtains fuzzy classification result.
2. monitoring image intelligent diagnostics restoration methods according to claim 1, it is characterized in that in the presence of a problem is proved, secondary diagnosis is also carried out to the problem judges it with the presence or absence of two grades of problems, two grades of problems are judged using diagnostic method, if judged result fraction is less than given threshold, alignment processing method is then taken out, solution subsequently points to next two grades of problems;If judged result fraction is higher than given threshold, next two grades of problems are pointing directly at;Two grades of problem diagnosis results to the problem judge, if all two grades of problems all solve to finish, are judged automatically into next problem;If not solving all two grades of problems, proceed circulation diagnosis, settlement steps to deal.
3. monitoring image intelligent diagnostics restoration methods according to claim 2, it is characterised in that diagnosed by foundation of the overall distribution position of image histogram to illumination and contrast problem.
4. monitoring image intelligent diagnostics restoration methods according to claim 3, it is characterised in that diagnosed with the distributed areas of RGB three channel histograms to colour cast problem.
5. it is according to claim 4 monitoring image intelligent diagnostics restoration methods, it is characterised in that for underlying noise, with low pass or the method with passband ripple extract noise contribution;For periodic noise, it is considered to which it detects that the discrete accumulation point of HFS carrys out the stable noise of recognition cycle in spectrogram;For aperiodic fringes noise, separated in the way of contour detecting.
6. monitoring image intelligent diagnostics restoration methods according to claim 5, it is characterised in that the problem of described processing method is for high illumination takes enhancing, gamma, histogram method processing;For low-light (level) problem, enhancing, the processing of gamma methods are taken;For colour cast problem, white balance, tone homogenizing, the processing of spatial domain colour cast method of adjustment are taken;For defocusing blurring, Gaussian Blur, sharpening method processing are taken;For motion blur, motion blur method is taken to handle;For shake and other fuzzy, blind deblurring, sharpening method processing are taken;For blocking effect, deblocking method is taken to handle;For noise, NLM, mixing spatial domain denoising, the processing of dual-tree complex wavelet denoising method are taken.
CN201210164075.4A 2012-05-21 2012-05-21 Intelligent diagnosis and recovery method for monitoring images Active CN102724541B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210164075.4A CN102724541B (en) 2012-05-21 2012-05-21 Intelligent diagnosis and recovery method for monitoring images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210164075.4A CN102724541B (en) 2012-05-21 2012-05-21 Intelligent diagnosis and recovery method for monitoring images

Publications (2)

Publication Number Publication Date
CN102724541A CN102724541A (en) 2012-10-10
CN102724541B true CN102724541B (en) 2014-06-04

Family

ID=46950183

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210164075.4A Active CN102724541B (en) 2012-05-21 2012-05-21 Intelligent diagnosis and recovery method for monitoring images

Country Status (1)

Country Link
CN (1) CN102724541B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103886565B (en) * 2014-03-13 2017-02-22 北京工业大学 Nighttime color image enhancement method based on purpose optimization and histogram equalization
CN105338339B (en) * 2014-07-29 2018-02-27 联想(北京)有限公司 Information processing method and electronic equipment
CN105069801A (en) * 2015-08-17 2015-11-18 江苏物联网研究发展中心 Method for preprocessing video image based on image quality diagnosis
CN106993185A (en) * 2015-12-10 2017-07-28 青岛海信网络科技股份有限公司 A kind of video quality diagnosing method and system
CN108230253B (en) * 2017-05-08 2020-11-27 北京市商汤科技开发有限公司 Image restoration method and device, electronic equipment and computer storage medium
CN107613284B (en) * 2017-10-31 2019-10-08 努比亚技术有限公司 A kind of image processing method, terminal and computer readable storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101588505B (en) * 2008-05-21 2011-05-11 英华达(南京)科技有限公司 Method for correcting dead pixel on digital camera device and digital camera device with dead pixel automatic-correction function
CN102176758A (en) * 2011-03-07 2011-09-07 北京文安科技发展有限公司 Video quality diagnosis system and realization method thereof
CN102395043B (en) * 2011-11-11 2013-09-11 北京声迅电子股份有限公司 Video quality diagnosing method
CN102421008A (en) * 2011-12-07 2012-04-18 浙江捷尚视觉科技有限公司 Intelligent video quality detecting system

Also Published As

Publication number Publication date
CN102724541A (en) 2012-10-10

Similar Documents

Publication Publication Date Title
CN102724541B (en) Intelligent diagnosis and recovery method for monitoring images
Liu et al. Image defogging quality assessment: Real-world database and method
CN111079740A (en) Image quality evaluation method, electronic device, and computer-readable storage medium
Cheng et al. Efficient histogram modification using bilateral Bezier curve for the contrast enhancement
Peng et al. Image haze removal using airlight white correction, local light filter, and aerial perspective prior
CN105745914A (en) Methods and systems for inverse tone mapping
CN112767392B (en) Image definition determining method, device, equipment and storage medium
CN105163110A (en) Camera cleanliness detection method and system and shooting terminal
JP2011521521A (en) Optimal video selection
CN104394377B (en) A kind of fuzzy abnormal recognition methods of monitoring image and device
CN105959510B (en) A kind of video rapid defogging method
CN107404647A (en) Camera lens condition detection method and device
KR20140017776A (en) Image processing device and image defogging method
CN106851086A (en) A kind of method and apparatus for carrying out photo generation
CN108961209B (en) Pedestrian image quality evaluation method, electronic device and computer readable medium
Huo et al. Fast fusion-based dehazing with histogram modification and improved atmospheric illumination prior
CN110807406B (en) Foggy day detection method and device
CN113034509A (en) Image processing method and device
Fuh et al. Mcpa: A fast single image haze removal method based on the minimum channel and patchless approach
CN104463812B (en) The method for repairing the video image by raindrop interference when shooting
CN101510306A (en) Estimation method for video image illumination distribution
Abbaspour et al. A new fast method for foggy image enhancement
CN104112266B (en) Image edge blurring detecting method and device
Liu et al. Perceptually relevant ringing region detection method
Veeravasarapu et al. Fast and fully automated video colorization

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C53 Correction of patent for invention or patent application
CB02 Change of applicant information

Address after: Hangzhou City, Zhejiang province Yuhang District 310013 West Street Wuchang No. 998 building 7 East

Applicant after: Zhejiang iCare Vision Technology Co., Ltd.

Address before: 310013, Zhejiang, Xihu District, Hangzhou, Tian Shan Road, No. 398, Kun building, 4 floor, South Block

Applicant before: Zhejiang iCare Vision Technology Co., Ltd.

C14 Grant of patent or utility model
GR01 Patent grant
C56 Change in the name or address of the patentee

Owner name: ZHEJIANG ICARE VISION TECHNOLOGY CO., LTD.

Free format text: FORMER NAME: HANGZHOU ICARE VISION TECHNOLOGY CO., LTD.

CP01 Change in the name or title of a patent holder

Address after: Hangzhou City, Zhejiang province Yuhang District 310013 West Street Wuchang No. 998 building 7 East

Patentee after: ZHEJIANG ICARE VISION TECHNOLOGY CO., LTD.

Address before: Hangzhou City, Zhejiang province Yuhang District 310013 West Street Wuchang No. 998 building 7 East

Patentee before: Zhejiang iCare Vision Technology Co., Ltd.

PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Intelligent diagnosis and recovery method for monitoring images

Effective date of registration: 20190820

Granted publication date: 20140604

Pledgee: Hangzhou Yuhang Financial Holding Co., Ltd.

Pledgor: ZHEJIANG ICARE VISION TECHNOLOGY CO., LTD.

Registration number: Y2019330000016

PC01 Cancellation of the registration of the contract for pledge of patent right
PC01 Cancellation of the registration of the contract for pledge of patent right

Date of cancellation: 20200917

Granted publication date: 20140604

Pledgee: Hangzhou Yuhang Financial Holding Co.,Ltd.

Pledgor: ZHEJIANG ICARE VISION TECHNOLOGY Co.,Ltd.

Registration number: Y2019330000016

PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: An intelligent diagnosis and recovery method for monitoring images

Effective date of registration: 20200921

Granted publication date: 20140604

Pledgee: Hangzhou Yuhang Financial Holding Co.,Ltd.

Pledgor: ZHEJIANG ICARE VISION TECHNOLOGY Co.,Ltd.

Registration number: Y2020330000737