CN104408707A - Rapid digital imaging fuzzy identification and restored image quality assessment method - Google Patents

Rapid digital imaging fuzzy identification and restored image quality assessment method Download PDF

Info

Publication number
CN104408707A
CN104408707A CN201410592425.6A CN201410592425A CN104408707A CN 104408707 A CN104408707 A CN 104408707A CN 201410592425 A CN201410592425 A CN 201410592425A CN 104408707 A CN104408707 A CN 104408707A
Authority
CN
China
Prior art keywords
image
gradient
similarity
picture
index
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410592425.6A
Other languages
Chinese (zh)
Other versions
CN104408707B (en
Inventor
遆晓光
尹磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin University of Technology Robot Group Co., Ltd.
Original Assignee
Harbin Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin Institute of Technology filed Critical Harbin Institute of Technology
Priority to CN201410592425.6A priority Critical patent/CN104408707B/en
Publication of CN104408707A publication Critical patent/CN104408707A/en
Application granted granted Critical
Publication of CN104408707B publication Critical patent/CN104408707B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/73Deblurring; Sharpening
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30168Image quality inspection

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a rapid digital imaging fuzzy identification and restored image quality assessment method, and relates to a fuzzy identification and restored image quality assessment method, for solving the problems of poor real-time performance, incapability of effective identification of a blurred image and a clear image and effective assessment of an image restoration result, and instable output result after fuzzy restoration processing by use of a conventional method. The method is realized through the following steps: 1, obtaining a gradient image G (i, j); 2, calculating an average gray scale gradient value; 3, obtaining statistical distribution information of the gradient image; 4, performing threshold determining on BIM; 5, obtaining a restored image; 6, generating reference images F1 and D1; 7, calculating brightness similarities, contrast similarities and structural similarities between the reference images and an image to be assessed; 8, calculating g(F(i, j), F1) and g(D(i, j), D1); 9, obtaining a non-reference-image assessment index; 10, determining the non-reference-image assessment index; and the like. The rapid digital imaging fuzzy identification and restored image quality assessment method is applied to the field of fuzzy identification and restored image quality assessment.

Description

A kind of fast digital image blur is differentiated and restored image method for evaluating quality
Technical field
The present invention relates to image quality measure field, particularly fuzzy discriminating and restored image quality evaluation field.
Background technology
When digital camera imaging, relative motion between camera lens and imaging scene or camera lens defocus the image or video blur that all can cause collecting, cause that the contrast of image reduces, edge and interior details information weakens, affect picture quality, make the directly perceived and digital image information disposal system of vision be difficult to the area-of-interest detected exactly in image, have a strong impact on the analysis to obtained image and video information and understanding.Generally picture quality be can improve to a certain extent by digital blur image restoration system, a part of edge and image interior details information recovered.But under many circumstances, be limited by the shortage of image prior information and the defect of restoration algorithm, this recuperation may produce more artificial traces as ringing effect etc., cause the picture quality after digital restoration process not even as untreated image.Therefore, one is had to the digital image restoration system of real practicality, carrying out before and after digital restoration to image blur image, two critical processing links must be implemented, namely whether there is image blur to the image obtained to differentiate, after restoration disposal is carried out to blurred picture, carry out image quality evaluation simultaneously, after guaranteeing image restoration, obtain image or the video of better quality.Can aforementioned two information processing links effectively work and really apply real system for digital imagery smear restoration method and have vital role, in civilian intelligent video monitoring system, Intelligent traffic management systems etc. and Military Application as imaging reconnaissance system, space optical remote and missile imaging guidance field in all there is important using value.
In existing digital picture smear restoration system and the image blurring restored method studied, nearly all there is no this step of fuzzy discriminating, be all directly image is restored usually, following two problems can be there is like this:
1) in real time video processing, the image of each frame only has the extremely short processing time by frame per second restriction, and the general frame per second of civil area is between 20 ~ 30, and namely every frame only has the processing time of 30 ~ 50ms, and military domain frame per second is 50 ~ 60, every frame only has the processing time of 15 ~ 20ms.And existing restoration algorithm adopts the mode of iteration to carry out mostly, poor real, even if optimize processing time of the good every frame of the video of restoration algorithm to same size also close to 40ms, in practical application, image blurring recovery is generally just as pre-service link, also to carry out as target detection in the processing time of each two field picture, identify, the tasks such as tracking, if carry out fuzzy discriminating, image blurring recovery time can be used for follow-up work, be more conducive to the realization (instead of improving single frames processing speed) of real time video processing task, if do not add differentiation just to carry out processing the significant wastage that will cause computational resource to image, be difficult to reach requirement of real-time.
2) in the Video processing of reality, not each two field picture is all fuzzy, for picture rich in detail, if carry out smear restoration process, can introduce as part artificial traces such as ringing effects on the contrary, picture frame quality after process declines on the contrary relative to time untreated, has a strong impact on the validity and reliability of smear restoration system.
After image blurring recovery, in order to evaluate restoration algorithm effect, needing to carry out quality evaluation to restored image, thus guaranteeing the restored image obtaining Quality advance.Owing to there is no picture rich in detail as with reference to image, non-reference picture quality appraisement can only be carried out.Current non-reference picture quality appraisement mainly contains two class methods, one is the gradient information of simple computed image, as gradient magnitude, border width, edge sharpness etc., this kind of index is not owing to considering the factor such as brightness of image, contrast, evaluation result is more unilateral, is particularly difficult to identify to the ringing effect of restored image; Two is adopt study mechanism, by a large amount of sample training, draw evaluation result, because sample can not comprise all situations, the performance of this method depends on the large size of sample, once the less situation that will occur data poor fitting of sample, if require higher to nicety of grading in training, there will be the over-fitting of data, no matter occur that situation, picture appraisal result all can be caused inaccurate, after smear restoration process, Output rusults is unstable, can not be used for real system.
Chinese patent CN101996406A proposes a kind of index of structure based sharpness to carry out reference-free quality evaluation, this index improves in structural similarity index, structural similarity is a kind of full reference image quality appraisement index, weigh by calculating the similarity of information to two width images of two width images in brightness, contrast and degree of structuration three, if wherein piece image is picture rich in detail, then can draw the evaluation quality of another piece image, but this index does not consider gradient information, the quality assessment of blurred picture cannot be used for.This patent portrays the impact at edge by the structural similarity of compute gradient image, but due to three indexs gradient image all, what reflect is gradient image analog information, well can not evaluate the similarity of original image, also just can not get an objective appraisal result.
A kind of typical non-reference picture quality appraisement index is average gray gradient G MG (Gray Mean Gradients), this method is by calculating the average gradient value of gray level image as the standard weighing picture quality, this method parameter is single, do not consider the information such as the brightness of image, contrast, do not consider the correlativity between pixel yet.In addition, when there is artificial trace in image as situations such as ringing effects, the average gradient of image can be caused to become large, and the fact is image quality decrease, also just can not get an objective appraisal result, GMG index can not process this kind of situation about often running in smear restoration.
Summary of the invention
It is poor to the object of the invention is to solve current existing method real-time performance, effectively can not differentiate blurred picture and picture rich in detail, effective evaluation can not be carried out to image restoration result, the problem of Output rusults instability after smear restoration process, and the discriminating of a kind of fast digital image blur and restored image method for evaluating quality are proposed.
Above-mentioned goal of the invention is achieved through the following technical solutions:
Step one: input gray level blurred picture F (i, j), obtains the size M × N of gray scale blurred picture F (i, j), calculates the horizontal gradient image G of gray scale blurred picture F (i, j) x(i, j) and VG (vertical gradient) image and G y(i, j), thus obtain gradient image G (i, j); Wherein, M is the width of image, and N is the height of image;
The average gray Grad GMG of step 2: computed image F (i, j);
Step 3: the histogram h of compute gradient image G (i, j), by traveling through histogram h, obtains the statistical distribution information NGN of gradient image;
Step 4: carry out product calculation according to GMG and NGN that step 2 and step 3 obtain, obtains comprehensive fuzzy identification beacon BIM; Threshold determination is carried out to the BIM obtained, if BIM is greater than predetermined threshold value T, is then judged to be that picture rich in detail directly exports; If BIM is less than predetermined threshold value T, then F (i, j) is proceeded to step 5; Wherein, threshold value T obtains according to picture rich in detail and blurred picture statistical study;
Step 5: adopt typical blindly restoring image algorithm to carry out recovery operation to gray scale blurred picture F (i, j), obtain restored image D (i, j);
Step 6: use size is m × m, variance is σ 2gaussian Blur check the reference picture D1 that gray scale blurred picture F (i, j) and restored image D (i, j) carry out reference picture F1 and D (i, j) of secondary fuzzy generation F (i, j); Wherein, the fuzzy use Gaussian Blur of secondary, m is the size of fuzzy core;
Step 7: according to the brightness similarity of F (i, j), F1, D (i, j) and D1 computing reference image and image to be evaluated, contrast similarity and structural similarity; Wherein, image to be evaluated is F (i, j) and D (i, j); Reference picture is F1 and D1; The brightness similarity of reference picture and image to be evaluated comprises l (F (i, j), F1) and l (D (i, j), D1); The contrast similarity c (F (i, j), F1) of reference picture and image to be evaluated and c (D (i, j), D1); The structural similarity s (F (i, j), F1) of reference picture and image to be evaluated and s (D (i, j), D1); L (F (i, j), F1) be two width image F (i, j) and the brightness similarity of F1, l (D (i, j), D1) be two width image D (i, and brightness similarity, the c (F (i of D1 j), j), F1) be the contrast similarity of two width images F (i, j) and F1; C (D (i, j), D1) is the contrast similarity of two width images D (i, j) and D1; S (F (i, j), F1) is the structural similarity of two width images F (i, j) and F1; S (D (i, j), D1) is the structural similarity of two width images D (i, j) and D1;
Step 8: the gradient image g of computing reference image and image to be evaluated respectively f, g f1, g d, g d1, utilize gradient image to calculate gradient similarity g (F (i, j), F1) and the g (D (i, j), D1) of two width images respectively; Wherein, g ffor the gradient image of F (i, j), g f1for the gradient image of F1, g dfor the gradient image of D (i, j); g d1for the gradient image of D1; G (F (i, j), F1) is two width images F (i, j) and F1 gradient similarity; G (D (i, j), D1) is the gradient similarity of two width images D (i, j) and D1;
Step 9: the structural similarity index ISSIM improved according to the brightness similarity of reference picture and image to be evaluated, contrast similarity, structural similarity and gradient Similarity Measure, the structural similarity index ISSIM piecemeal of improvement is tried to achieve M ISSIM index to get its mean value again and obtain MISSIM, calculate non-reference picture evaluation index INRSS according to MISSIM; Wherein, the MISSIM obtained specifically comprises MISSIM (F (i, j), F1) and MISSIM (D (i, j), D1); The structural similarity index ISSIM improved comprises two width image F (i, and the gradient index of similarity ISSIM (F (i of F1 j), j), F1) and two width image D (i, and the gradient index of similarity ISSIM (D (i of D1 j), j), D1);
The computing formula of the structural similarity index ISSIM of described improvement is:
ISSIM(F(i,j),F1)=[l(F(i,j),F1)] α[c(F(i,j),F1)] β[s(F(i,j),F1)] γ[g(F(i,j),F1)] λ
ISSIM(D(i,j),D1)=[l(D(i,j),D1)] α[c(D(i,j),D1)] β[s(D(i,j),D1)] γ[g(D(i,j),D1)] λ
Wherein, α, beta, gamma, λ is every weight;
Step 10: judge according to the non-reference picture evaluation index INRSS that step 9 obtains, INRSS1>INRSS2 then illustrates that quality is not improved, then smear restoration system output gray level blurred picture F (i, j), otherwise key diagram picture element amount improves and exports restored image D (i, j); Wherein, INRSS 1 = 1 - MISSIM ( F ( i , j ) , F 1 ) INRSS 2 = 1 - MISSIM ( D ( i , j ) , D 1 ) ; Namely complete a kind of fast digital image blur to differentiate and restored image method for evaluating quality.
Invention effect
The present invention is a kind of improvement for current blur image restoration technology, both can be used for fuzzy discriminating and the restored image quality assessment work of single image, and also can be used for real time video processing, carry out effective video recuperation more.
The present invention be directed to gray scale blurred picture, for coloured image, only the component extraction of each passage out need to be processed respectively, finally again index be averaged; For existing digital fuzzy video and image restoration system Problems existing, introduce fuzzy identification module and fuzzy discriminating is carried out to pending image, on the PC platform of typical 4GB internal memory, 2.5GHz processor, fuzzy discrimination process is consuming time lower than 1ms, if spectral discrimination is picture rich in detail, then can be used for the image procossing of relevant subsequent the time of each frame 15 ~ 20ms in military domain, for associated video processes the condition of providing in real time.Propose a set of image quality measure method to image structure information and image detail and the comprehensive assessment of marginal information energy simultaneously and quality assessment is carried out to the image after smear restoration, avoid the artificial trace introduced by Image Restoration Algorithm to cause restored image quality to be inferior to problem that original image still exports to user or video and next link of pattern information processing system, particularly carried image quality measure method effectively can identify the adverse effect such as ringing effect and edge fog factor, thus the target recognition and tracking system based on image is effectively worked there is important value.
And for the deficiency that existing smear restoration system exists, this patent mainly solves following technical matters:
1) for current digital imagery smear restoration system, not there is fuzzy distinguishing ability to cause carrying out deblurring restoration disposal to picture rich in detail yet, thus make the problem of restored image quality degradation and waste messaging resource, fuzzy identification module is added to blur image restoration system, propose effective fuzzy identification algorithm, make it to identify the picture frame needing to carry out smear restoration, add the realization that fuzzy identification module is conducive to real time video processing, there is very strong practicality; As Fig. 2 (a), Fig. 2 (b), Fig. 3 (a) and Fig. 3 (b);
2) adopt the statistical law of nature picture rich in detail prior distribution to carry out fuzzy identification algorithm design, fuzzy identification algorithm has scale invariability simultaneously, has the scope of application widely, and this algorithm computation process is simple in addition, and exploitativeness is strong;
3) problem of restored image deterioration is caused for the artificial trace introduced in blur image restoration process, propose a kind of non-reference picture method for evaluating quality of novel improved, thus can assess accurately and effectively restored image quality, avoid restoring output image quality than the ropy problem of initial input blurred picture as Fig. 2 (a) and Fig. 2 (b); Ensure that the reliability of image restoration system, if carry out restoration disposal to a width picture rich in detail, then likely cause Fig. 3 (a) and Fig. 3 (b), shown effect, picture quality clearly after process is lower than quality before treatment, owing to having obvious ringing effect in the image after process, GMG etc. can draw higher evaluation of estimate based on the evaluation index of single gradient information, cause the Output rusults obtaining mistake.And adopt index that the present invention puies forward, owing to considering the correlativity between image pixel, index result can obtain one and tend to fuzzy value, because the correlativity between the larger local neighbor of gradient is less, the structural similarity obtained is less, identifies ringing effect by this species diversity.
4) the image quality measure method carried is by introducing the structure of image, edge and interior details information, strengthen the accuracy of restored image quality evaluation, good distinguishing ability is had especially to the ringing effect that restored image exists, ensure that the objectivity of image quality evaluation and INRSS's of the present invention (the non-reference picture quality appraisement index of the structure based similarity of improvement) is changed to-37.8%, compared with GMG be changed to-15.0% rate of change larger.Make the reliability that this invention ensures that image restoration system;
5) can only for there being picture rich in detail situation as a reference for full reference image quality appraisement method, the present invention, by improving for non-reference picture quality appraisement to full reference image quality appraisement method, has actual applicability widely.
The present invention can differentiate ringing effect mainly for GMG index, because evaluation index considers the structural information of image, gradient information just portrays edge as a part for index, instead of using gradient as sole indicator.The structural information of image is portrayed mainly through the correlativity calculated between pixel, and the correlativity of the local pixel that gradient is larger is less, so just can offset the impact of a part of ring on evaluation result, play certain discriminating effect.
The invention provides a kind of smear restoration system evaluated based on fuzzy discriminating and recovering quality, belong to image and field of video processing.Specifically, the present invention can be used for improving digital imagery smear restoration system work efficiency, improve digital imagery smear restoration system information processing rate and digital image blur recovery effect is effectively assessed.Can be applicable to the fields such as the shooting of civilian Digital photographic, intelligent video monitoring, remote sensing of optical imaging, military imaging reconnaissance and missile imaging guidance.
Fuzzy discriminating step is introduced in digital image blurring recovery system by the present invention first, saves the processing time greatly, for real time video processing task provides more computational resources compared to conventional digital blur image restoration system.Meanwhile, in order to ensure the robustness of restoration result, the present invention has introduced the quality assessment step of restored image, makes output image quality be not less than input picture, ensure that the reliability of smear restoration system.In image blurring discriminating, invention introduces image gradient amplitude and gradient and to distribute two aspect indexs, feature the feature of picture rich in detail more accurately, it is more accurate to differentiate.In restored image quality assessment, the image quality evaluating method of existing structure based similarity is improved, add the gradient index of similarity of picture engraving edge and detailed information, the adverse effect factor such as can evaluate ringing effect in restored image better and blur margin is clear, reflects restored image quality more objectively.Use this patent can significantly improve real-time and the reliability of digital fuzzy video and image restoration system, the application request developing the more satisfied relevant dual-use system of corresponding system made.
Accompanying drawing explanation
A kind of fast digital image blur of Fig. 1 is differentiated and restored image method for evaluating quality process flow diagram;
Fig. 2 (a) is gray scale blurred picture;
Fig. 2 (b) is the improved image after smear restoration quality assessment;
Fig. 3 (a) differentiates, for picture rich in detail, not need the picture rich in detail carrying out Fuzzy Processing through fuzzy identification module;
Fig. 3 (b), for differentiate without fuzzy identification module, restores the image of the Quality Down obtained to picture rich in detail through classic method;
Fig. 4 is the non-reference picture quality appraisement index INRSS calculation flow chart improved.
embodiment
Embodiment one: a kind of fast digital image blur of present embodiment is differentiated and restored image method for evaluating quality, specifically prepares according to following steps:
Step one: input gray level blurred picture F (i, j), obtains the size M × N of gray scale blurred picture F (i, j), calculates the horizontal gradient image G of gray scale blurred picture F (i, j) x(i, j) and VG (vertical gradient) image and G y(i, j), thus obtain gradient image G (i, j); Wherein, M is the width of image, and N is the height of image;
The average gray Grad GMG (Gray Mean Gradients) of step 2: computed image F (i, j), this index reflects the gradient magnitude characteristic of the fuzzy identification beacon of image;
Step 3: statistics with histogram is carried out to gradient image, i.e. compute gradient image G (i, j) histogram h, by traveling through histogram h, obtain the non-zero gray shade scale number NGN (Non-zero Gray Gradient Number) that histogram of gradients h is corresponding, namely obtain the statistical distribution information NGN of gradient image;
Step 4: carry out product calculation (BIM=NGN × GMG) according to GMG and NGN that step 2 and step 3 obtain, obtains comprehensive fuzzy identification beacon BIM (Blur Identification Metric); Threshold determination is carried out to the BIM obtained, if BIM is greater than predetermined threshold value T, is then judged to be that picture rich in detail directly exports; If BIM is less than predetermined threshold value T, then F (i, j) is proceeded to step 5; Wherein, threshold value T obtains according to picture rich in detail and blurred picture statistical study, namely by carrying out analysis integrated to different scene image, draw Fuzzy Threshold T, also threshold value can be changed according to patient fog-level in actual applications, make this index have good adaptability, after definite threshold, can fuzzy judgement be carried out;
Step 5: adopt typical blindly restoring image algorithm to carry out recovery operation as methods such as Tikhonov regularization, full variational regularization to gray scale blurred picture F (i, j), obtain restored image D (i, j);
Step 6: use size is m × m, variance is σ 2gaussian Blur check the reference picture D1 that gray scale blurred picture F (i, j) and restored image D (i, j) carry out reference picture F1 and D (i, j) of secondary fuzzy generation F (i, j); Wherein, the fuzzy use Gaussian Blur of secondary, m is the size of fuzzy core;
Step 7: according to the brightness similarity of F (i, j), F1, D (i, j) and D1 computing reference image and image to be evaluated, contrast similarity and structural similarity; Wherein, image to be evaluated is F (i, j) and D (i, j); Reference picture is F1 and D1; The brightness similarity of reference picture and image to be evaluated comprises l (F (i, j), F1) and l (D (i, j), D1); The contrast similarity c (F (i, j), F1) of reference picture and image to be evaluated and c (D (i, j), D1); The structural similarity s (F (i, j), F1) of reference picture and image to be evaluated and s (D (i, j), D1); L (F (i, j), F1) be two width image F (i, j) and the brightness similarity of F1, l (D (i, j), D1) be two width image D (i, and brightness similarity, the c (F (i of D1 j), j), F1) be the contrast similarity of two width images F (i, j) and F1; C (D (i, j), D1) is the contrast similarity of two width images D (i, j) and D1; S (F (i, j), F1) is the structural similarity of two width images F (i, j) and F1; S (D (i, j), D1) is the structural similarity of two width images D (i, j) and D1;
Step 8: the gradient image g of computing reference image and image to be evaluated respectively f, g f1, g d, g d1, utilize gradient image to calculate gradient similarity g (F (i, j), F1) and the g (D (i, j), D1) of two width images respectively; Wherein, g ffor the gradient image of F (i, j), g f1for the gradient image of F1, g dfor the gradient image of D (i, j); g d1for the gradient image of D1; G (F (i, j), F1) is two width images F (i, j) and F1 gradient similarity; G (D (i, j), D1) is the gradient similarity of two width images D (i, j) and D1;
Step 9: according to the brightness similarity of reference picture and image to be evaluated, contrast similarity, the structural similarity index ISSIM (Improved Structural Similarity) that structural similarity and gradient Similarity Measure improve, for reducing local difference, the structural similarity index ISSIM piecemeal of improvement is tried to achieve M ISSIM index to get its mean value again and obtain MISSIM (Mean of Improved Structural Similarity), non-reference picture evaluation index INRSS (Improved No-Reference Structural Similarity) is calculated according to MISSIM, namely the comprehensive evaluation result of blurred picture and restored image quality comprises brightness, contrast, degree of structuration and marginal information, step 6 ~ nine process flow diagram is as Fig. 4, wherein, the MISSIM obtained specifically comprises MISSIM (F (i, j), F1) and MISSIM (D (i, j), D1), the structural similarity index ISSIM improved comprises two width image F (i, and the gradient index of similarity ISSIM (F (i of F1 j), j), F1) and two width image D (i, and the gradient index of similarity ISSIM (D (i of D1 j), j), D1),
The computing formula of the structural similarity index ISSIM of described improvement is:
ISSIM(F(i,j),F1)=[l(F(i,j),F1)] α[c(F(i,j),F1)] β[s(F(i,j),F1)] γ[g(F(i,j),F1)] λ
ISSIM(D(i,j),D1)=[l(D(i,j),D1)] α[c(D(i,j),D1)] β[s(D(i,j),D1)] γ[g(D(i,j),D1)] λ
Wherein, α, beta, gamma, λ is every weight;
Step 10: judge according to the non-reference picture evaluation index INRSS that step 9 obtains, INRSS1>INRSS2 then illustrates that quality is not improved, for ensureing the stability of restoration result, then smear restoration system output gray level blurred picture F (i, j), output restored image D (i, j) otherwise key diagram picture element amount improves, wherein INRSS 1 = 1 - MISSIM ( F ( i , j ) , F 1 ) INRSS 2 = 1 - MISSIM ( D ( i , j ) , D 1 ) ; Differentiate and restored image method for evaluating quality as namely Fig. 1 completes a kind of fast digital image blur.
Embodiment two: present embodiment and embodiment one unlike: obtain gradient image G (i, j) in step one, computing formula is as follows:
G x ( i , j ) = | F ( i + 1 , j ) - F ( i , j ) | G y ( i , j ) = | F ( i , j + 1 ) - F ( i , j ) | G ( i , j ) = G x ( i , j ) G y ( i , j ) , Wherein, i, j are respectively horizontal stroke corresponding to image slices vegetarian refreshments, ordinate value.Other step and parameter identical with embodiment one.
Embodiment three: present embodiment and embodiment one or two unlike: in step 2, the average gray Grad GMG formula of computed image F (i, j) is as follows:
GMG = Σ i = 1 M - 1 Σ j = 1 N - 1 [ F ( i + 1 , j ) - F ( i , j ) ] 2 + [ F ( i , j + 1 ) - F ( i , j ) ] 2 2 ( M - 1 ) ( N - 1 )
Wherein, M gray scale blurred picture F (i, j) length, the width of N gray scale blurred picture F (i, j).Other step and parameter identical with embodiment one or two.
Embodiment four: one of present embodiment and embodiment one to three unlike: obtain the non-zero gray shade scale number NGN in h in step 3, computing formula is as follows:
h=hist(G(i,j))
NGN=num(h i≠0)
In formula, hist represents histogram manipulation; h ifor the pixel count that i-th gray level in h is corresponding, by calculating NGN index, the trailing portion in picture engraving hangover distribution, in order to differentiate the fog-level of image.Other step and parameter identical with one of embodiment one to three.
Embodiment five: one of present embodiment and embodiment one to four unlike: to gray scale blurred picture F (i in step 5, j) typical blindly restoring image algorithm and full variational regularization method is adopted to carry out blind recovery, can certainly adopt other blind restoration methods, its rejuvenation target function is as follows:
arg min f { λ 2 | | k ⊗ f - F ( i , j ) | | 2 + | | G x | | 1 + | | G y | | 1 }
Wherein, k is unknown fuzzy core, and f is unknown picture rich in detail, for convolution algorithm, for adjustable parameter, G xfor horizontal gradient image, G yfor VG (vertical gradient) image, get final product final restored image D (i, j) by alternately solving above-mentioned rejuvenation target function; Blurred picture and good recovery effect as shown in Figure 2 a and 2 b, with obvious artificial trace poor recovery effect as shown in Figure 3 a and Figure 3 b shows; Fig. 3 a and Fig. 3 b gives prominence to the importance of fuzzy discriminating, and follow-up is the equal of other one heavily to ensure to the evaluation of this two width image, even if guarantee to have carried out smear restoration operation to picture rich in detail mistakenly, also by quality assessment identify, the better picture rich in detail of output quality.Other step and parameter identical with one of embodiment one to four.
Embodiment six: one of present embodiment and embodiment one to five unlike: the detailed process calculating the brightness similarity of reference picture and image to be evaluated, contrast similarity and structural similarity in step 7 is:
Respectively to F (i, j), the first three items of the structural similarity of F1, D (i, j) and D1 computed improved, i.e. brightness similarity l (F (i, j), F1), l (D (i, j), D1), contrast similarity c (F (i, j), F1), c (D (i, j), and structural similarity s (F (i, j), F1) D1), s (D (i, j), D1), computing formula is as follows:
l ( F ( i , j ) , F 1 ) = 2 μ F μ F 1 + C 1 μ F 2 + μ F 1 2 + C 1 , l ( D ( i , j ) , D 1 ) = 2 μ D μ D 1 + C 1 μ D 2 + μ D 1 2 + C 1
c ( F ( i , j ) , F 1 ) = 2 σ F σ F 1 + C 2 σ F 2 + σ F 1 2 + C 2 , c ( D ( i , j ) , D 1 ) = 2 σ D σ D 1 + C 2 σ D 2 + σ D 1 2 + C 2
s ( F ( i , j ) , F 1 ) = 2 σ FF 1 + C 2 σ F σ F 1 + C 2 , s ( D ( i , j ) , D 1 ) = 2 σ DD 1 + C 2 σ D σ D 1 + C 2
Wherein, μ ffor the average of F (i, j) image intensity value, μ f1for the average of F1 image intensity value, μ dfor the average of D (i, j) image intensity value, μ d1for the average of D1 image intensity value, σ ffor F (i, j) image intensity value variance, σ f1for F1 image intensity value variance, σ dfor D (i, j) image intensity value variance, σ d1for D1 image intensity value variance, σ fF1for the covariance of the gray-scale value of F (i, j) and F1 image, σ dD1for the covariance of D (i, j) image and D1 image intensity value, C 1=(k1 × L) 2, C 2=(k2 × L) 2, k1=0.01, k2=0.03, L are pixel grayscale.Other step and parameter identical with one of embodiment one to five.
Embodiment seven: one of present embodiment and embodiment one to six are unlike the gradient image g of respectively computing reference image and image to be evaluated in step 8 f, g f1, g d, g d1, utilize gradient image to calculate the gradient similarity g (F (i, j), F1) of two width images respectively and g (D (i, j), D1) detailed process is:
Respectively to F (i, j), F1 and D (i, j), D1 compute gradient image g f, g f1, g d, g d1, then compute gradient image g f, g f1, g d, g d1gradient similarity, computing formula is as follows:
g ( F ( i , j ) , F 1 ) = 2 Σ i = 1 M Σ j = 1 N g F ( i , j ) g F 1 ( i , j ) + C 4 Σ i = 1 M Σ j = 1 N [ ( g F ( i , j ) ) 2 + ( g F 1 ( i , j ) ) 2 ] + C 4
g ( D ( i , j ) , D 1 ) = 2 Σ i = 1 M Σ j = 1 N g D ( i , j ) g D 1 ( i , j ) + C 4 Σ i = 1 M Σ j = 1 N [ ( g D ( i , j ) ) 2 + ( g D 1 ( i , j ) ) 2 ] + C 4
Wherein, C 4=(k4 × L) 2, k4=0.03, L are pixel grayscale, C 4be a constant, guarantee that denominator is non-vanishing; In the marginal information of image also being taken into account that index of similarity is evaluated by this step, the quality of blurred picture can be evaluated better; Simultaneously compared to other sharpness evaluation indexes, can identify better smear restoration effect poor time the ringing effect introduced, thus ensure the stability of recovery system.Other step and parameter identical with one of embodiment one to six.
Embodiment eight: one of present embodiment and embodiment one to seven unlike: calculate non-reference picture evaluation index INRSS correlation computations formula according to MISSIM in step 9 as follows:
(1) regulate according to actual needs; When actual computation, M block is divided into by image to obtain its ISSIM index respectively; Try to achieve mean value MSSIM, namely adopt following formula to calculate: MTSSIM ( F ( i , j ) , F 1 ) = 1 M Σ i = 1 M ISSIM ( F i , F 1 i ) MISSIM ( D ( i , j ) , D 1 ) = 1 M Σ i = 1 M ISSIM ( D i , D 1 i )
F ifor i-th subimage in gray scale blurred picture F (i, j), D ii-th subimage in image D (i, j) after recovery; F1 ifor i-th subimage in reference picture F1; D1 ii-th subimage in reference picture D1;
(2) obtain the nothing reference evaluation index INRSS improved, computing formula is as follows:
INRSS 1 = 1 - MISSIM ( F ( i , j ) , F 1 ) INRSS 2 = 1 - MISSIM ( D ( i , j ) , D 1 ) . Other step and parameter identical with one of embodiment one to seven.
Following examples are adopted to verify beneficial effect of the present invention:
Embodiment one:
A kind of fast digital image blur of the present embodiment is differentiated and restored image method for evaluating quality, specifically prepares according to following steps:
Step one: input gray level blurred picture F (i, j), obtains the size M × N of gray scale blurred picture F (i, j), calculates the horizontal gradient image G of gray scale blurred picture F (i, j) x(i, j) and VG (vertical gradient) image and G y(i, j), thus obtain gradient image G (i, j); Wherein, M is the width of image, and N is the height of image;
Obtain gradient image G (i, j), computing formula is as follows:
G x ( i , j ) = | F ( i + 1 , j ) - F ( i , j ) | G y ( i , j ) = | F ( i , j + 1 ) - F ( i , j ) | G ( i , j ) = G x ( i , j ) G y ( i , j ) , Wherein, i, j are respectively horizontal stroke corresponding to image slices vegetarian refreshments, ordinate value;
The average gray Grad GMG (Gray Mean Gradients) of step 2: computed image F (i, j), this index reflects the gradient magnitude characteristic of the fuzzy identification beacon of image;
The average gray Grad GMG formula of computed image F (i, j) is as follows:
GMG = Σ i = 1 M - 1 Σ j = 1 N - 1 [ F ( i + 1 , j ) - F ( i , j ) ] 2 + [ F ( i , j + 1 ) - F ( i , j ) ] 2 2 ( M - 1 ) ( N - 1 )
Wherein, M gray scale blurred picture F (i, j) length, the width of N gray scale blurred picture F (i, j).
Step 3: statistics with histogram is carried out to gradient image, i.e. compute gradient image G (i, j) histogram h, by traveling through histogram h, obtain the non-zero gray shade scale number NGN (Non-zero Gray Gradient Number) that histogram of gradients h is corresponding, namely obtain the statistical distribution information NGN of gradient image;
Obtain the non-zero gray shade scale number NGN in h, computing formula is as follows:
h=hist(G(i,j))
NGN=num(h i≠0)
In formula, hist represents histogram manipulation; h ifor the pixel count that i-th gray level in h is corresponding, by calculating NGN index, the trailing portion in picture engraving hangover distribution, in order to differentiate the fog-level of image.
Step 4: carry out product calculation (BIM=NGN × GMG) according to GMG and NGN that step 2 and step 3 obtain, obtains comprehensive fuzzy identification beacon BIM (Blur Identification Metric); Threshold determination is carried out to the BIM obtained, if BIM is greater than predetermined threshold value T, is then judged to be that picture rich in detail directly exports; If BIM is less than predetermined threshold value T, then F (i, j) is proceeded to step 5; Wherein, threshold value T obtains according to picture rich in detail and blurred picture statistical study, namely by carrying out analysis integrated to different scene image, draw Fuzzy Threshold T, also threshold value can be changed according to patient fog-level in actual applications, make this index have good adaptability, can carry out fuzzy judgement after definite threshold, general value is 700 ~ 900;
Step 5: adopt typical blindly restoring image algorithm and full variational regularization method to carry out blind recovery to gray scale blurred picture F (i, j), can certainly adopt other blind restoration methods, its rejuvenation target function is as follows:
arg min f { λ 2 | | k ⊗ f - F ( i , j ) | | 2 + | | G x | | 1 + | | G y | | 1 }
Wherein, k is unknown fuzzy core, and f is unknown picture rich in detail, for convolution algorithm, for adjustable parameter, G xfor horizontal gradient image, G yfor VG (vertical gradient) image, get final product final restored image D (i, j) by alternately solving above-mentioned rejuvenation target function; Blurred picture and good recovery effect as shown in Figure 2 a and 2 b, with obvious artificial trace poor recovery effect as shown in Figure 3 a and Figure 3 b shows.Fig. 3 a and Fig. 3 b gives prominence to the importance of fuzzy discriminating, and follow-up is the equal of other one heavily to ensure to the evaluation of this two width image, even if guarantee to have carried out smear restoration operation to picture rich in detail mistakenly, also by quality assessment identify, the better picture rich in detail of output quality.
Step 6: use size is m × m, variance is σ 2gaussian Blur check the reference picture D1 that gray scale blurred picture F (i, j) and restored image D (i, j) carry out reference picture F1 and D (i, j) of secondary fuzzy generation F (i, j); Here use m × m size to be 7 × 7, variance be 6 Gaussian Blur core carry out secondary Fuzzy Processing, be ensure secondary blur effect, m and σ 2general value is respectively 5 ~ 8; Wherein, the fuzzy use Gaussian Blur of secondary, m is the size of fuzzy core;
Step 7: be according to the brightness similarity of F (i, j), F1, D (i, j) and D1 computing reference image and image to be evaluated, contrast similarity and structural similarity detailed process:
Respectively to F (i, j), the first three items of the structural similarity of F1, D (i, j) and D1 computed improved, i.e. brightness similarity l (F (i, j), F1), l (D (i, j), D1), contrast similarity c (F (i, j), F1), c (D (i, j), and structural similarity s (F (i, j), F1) D1), s (D (i, j), D1), computing formula is as follows:
l ( F ( i , j ) , F 1 ) = 2 μ F μ F 1 + C 1 μ F 2 + μ F 1 2 + C 1 , l ( D ( i , j ) , D 1 ) = 2 μ D μ D 1 + C 1 μ D 2 + μ D 1 2 + C 1
c ( F ( i , j ) , F 1 ) = 2 σ F σ F 1 + C 2 σ F 2 + σ F 1 2 + C 2 , c ( D ( i , j ) , D 1 ) = 2 σ D σ D 1 + C 2 σ D 2 + σ D 1 2 + C 2
s ( F ( i , j ) , F 1 ) = 2 σ FF 1 + C 2 σ F σ F 1 + C 2 , s ( D ( i , j ) , D 1 ) = 2 σ DD 1 + C 2 σ D σ D 1 + C 2
Wherein, μ ffor the average of F (i, j) image intensity value, μ f1for the average of F1 image intensity value, μ dfor the average of D (i, j) image intensity value, μ d1for the average of D1 image intensity value, σ ffor F (i, j) image intensity value variance, σ f1for F1 image intensity value variance, σ dfor D (i, j) image intensity value variance, σ d1for D1 image intensity value variance, σ fF1for the covariance of the gray-scale value of F (i, j) and F1 image, σ dD1for the covariance of D (i, j) image and D1 image intensity value, C 1=(k1 × L) 2, C 2=(k2 × L) 2, k1=0.01, k2=0.03, L are pixel grayscale, are generally 255.Image to be evaluated is F (i, j) and D (i, j); Reference picture is F1 and D1; The brightness similarity of reference picture and image to be evaluated comprises l (F (i, j), F1) and l (D (i, j), D1); The contrast similarity c (F (i, j), F1) of reference picture and image to be evaluated and c (D (i, j), D1); The structural similarity s (F (i, j), F1) of reference picture and image to be evaluated and s (D (i, j), D1); L (F (i, j), F1) be two width image F (i, j) and the brightness similarity of F1, l (D (i, j), D1) be two width image D (i, and brightness similarity, the c (F (i of D1 j), j), F1) be the contrast similarity of two width images F (i, j) and F1; C (D (i, j), D1) is the contrast similarity of two width images D (i, j) and D1; S (F (i, j), F1) is the structural similarity of two width images F (i, j) and F1; S (D (i, j), D1) is the structural similarity of two width images D (i, j) and D1;
Step 8: the gradient image g of computing reference image and image to be evaluated respectively f, g f1, g d, g d1, utilize gradient image to calculate gradient similarity g (F (i, j), F1) and the g (D (i, j), D1) of two width images respectively;
Respectively to F (i, j), F1 and D (i, j), D1 compute gradient image g f, g f1, g d, g d1, then compute gradient image g f, g f1, g d, g d1gradient similarity, computing formula is as follows:
g ( F ( i , j ) , F 1 ) = 2 Σ i = 1 M Σ j = 1 N g F ( i , j ) g F 1 ( i , j ) + C 4 Σ i = 1 M Σ j = 1 N [ ( g F ( i , j ) ) 2 + ( g F 1 ( i , j ) ) 2 ] + C 4
g ( D ( i , j ) , D 1 ) = 2 Σ i = 1 M Σ j = 1 N g D ( i , j ) g D 1 ( i , j ) + C 4 Σ i = 1 M Σ j = 1 N [ ( g D ( i , j ) ) 2 + ( g D 1 ( i , j ) ) 2 ] + C 4
Wherein, C 4=(k4 × L) 2, k4=0.03, L are pixel grayscale, are generally 255, C 4be a constant, guarantee that denominator is non-vanishing.In the marginal information of image also being taken into account that index of similarity is evaluated by this step, the quality of blurred picture can be evaluated better.Simultaneously compared to other sharpness evaluation indexes, can identify better smear restoration effect poor time the ringing effect introduced, thus ensure the stability of recovery system.G ffor the gradient image of F (i, j), g f1for the gradient image of F1, g dfor the gradient image of D (i, j); g d1for the gradient image of D1; G (F (i, j), F1) is two width images F (i, j) and F1 gradient similarity; G (D (i, j), D1) is the gradient similarity of two width images D (i, j) and D1;
Step 9: according to the brightness similarity of reference picture and image to be evaluated, contrast similarity, the structural similarity index ISSIM (Improved Structural Similarity) that structural similarity and gradient Similarity Measure improve, for reducing local difference, the structural similarity index ISSIM piecemeal of improvement is tried to achieve M ISSIM index to get its mean value again and obtain MISSIM (Mean of Improved Structural Similarity), non-reference picture evaluation index INRSS (Improved No-Reference Structural Similarity) is calculated according to MISSIM, namely the comprehensive evaluation result of blurred picture and restored image quality comprises brightness, contrast, degree of structuration and marginal information, M ∈ (1,12) step 6 ~ nine process flow diagram is as Fig. 4, wherein, the MISSIM obtained specifically comprises MISSIM (F (i, j), F1) and MISSIM (D (i, j), D1), the structural similarity index ISSIM improved comprises two width image F (i, and the gradient index of similarity ISSIM (F (i of F1 j), j), F1) and two width image D (i, and the gradient index of similarity ISSIM (D (i of D1 j), j), D1),
The computing formula of the structural similarity index ISSIM of described improvement is:
ISSIM(F(i,j),F1)=[l(F(i,j),F1)] α[c(F(i,j),F1)] β[s(F(i,j),F1)] γ[g(F(i,j),F1)] λ
ISSIM(D(i,j),D1)=[l(D(i,j),D1)] α[c(D(i,j),D1)] β[s(D(i,j),D1)] γ[g(D(i,j),D1)] λ
Wherein, α, beta, gamma, λ is every weight;
(1) regulate according to actual needs; When actual computation, M block is divided into by image to obtain its ISSIM index respectively; Try to achieve mean value MSSIM, namely adopt following formula to calculate: MTSSIM ( F ( i , j ) , F 1 ) = 1 M Σ i = 1 M ISSIM ( F i , F 1 i ) MISSIM ( D ( i , j ) , D 1 ) = 1 M Σ i = 1 M ISSIM ( D i , D 1 i )
F ifor i-th subimage in gray scale blurred picture F (i, j), D ii-th subimage in image D (i, j) after recovery; F1 ifor i-th subimage in reference picture F1; D1 ii-th subimage in reference picture D1;
(2) obtain the nothing reference evaluation index INRSS improved, computing formula is as follows:
INRSS1=1-MISSIM(F(i,j),F1)
INRSS2=1-MISSIM(D(i,j),D1)
The INRSS evaluation result obtained Fig. 2 a and Fig. 2 b two width image is as shown in the table:
Index Before recovery After recovery Change
INRSS 0.3172 0.5769 29.05%
INRSS index is obtained to Fig. 3 (a) and Fig. 3 (b) two width image and GMG index comparing result is as shown in the table:
Index Before recovery After recovery Change
INRSS 0.4063 0.2527 -37.8%
GMG 7.0012 5.9559 -15.0%
Result shows that INRSS has good evaluation effect to image, and more effectively can distinguish the impact of artificial trace on restoration result.
Step 10: judge according to the non-reference picture evaluation index INRSS that step 9 obtains, INRSS1>INRSS2 then illustrates that quality is not improved, for ensureing the stability of restoration result, then smear restoration system output gray level blurred picture F (i, j), output restored image D (i, j) otherwise key diagram picture element amount improves, wherein INRSS 1 = 1 - MISSIM ( F ( i , j ) , F 1 ) INRSS 2 = 1 - MISSIM ( D ( i , j ) , D 1 ) ; Differentiate and restored image method for evaluating quality as namely Fig. 1 completes a kind of fast digital image blur.
The present invention also can have other various embodiments; when not deviating from the present invention's spirit and essence thereof; those skilled in the art are when making various corresponding change and distortion according to the present invention, but these change accordingly and are out of shape the protection domain that all should belong to the claim appended by the present invention.

Claims (8)

1. fast digital image blur is differentiated and a restored image method for evaluating quality, it is characterized in that: a kind of fast digital image blur discriminating and restored image method for evaluating quality specifically carry out according to the following steps:
Step one: input gray level blurred picture F (i, j), obtains the size M × N of gray scale blurred picture F (i, j), calculates the horizontal gradient image G of gray scale blurred picture F (i, j) x(i, j) and VG (vertical gradient) image and G y(i, j), thus obtain gradient image G (i, j); Wherein, M is the width of image, and N is the height of image;
The average gray Grad GMG of step 2: computed image F (i, j);
Step 3: the histogram h of compute gradient image G (i, j), by traveling through histogram h, obtains the statistical distribution information NGN of gradient image;
Step 4: carry out product calculation according to GMG and NGN that step 2 and step 3 obtain, obtains comprehensive fuzzy identification beacon BIM; Threshold determination is carried out to the BIM obtained, if BIM is greater than predetermined threshold value T, is then judged to be that picture rich in detail directly exports; If BIM is less than predetermined threshold value T, then F (i, j) is proceeded to step 5; Wherein, threshold value T obtains according to picture rich in detail and blurred picture statistical study;
Step 5: adopt typical blindly restoring image algorithm to carry out recovery operation to gray scale blurred picture F (i, j), obtain restored image D (i, j);
Step 6: use size is m × m, variance is σ 2gaussian Blur check the reference picture D1 that gray scale blurred picture F (i, j) and restored image D (i, j) carry out reference picture F1 and D (i, j) of secondary fuzzy generation F (i, j); Wherein, the fuzzy use Gaussian Blur of secondary, m is the size of fuzzy core;
Step 7: according to the brightness similarity of F (i, j), F1, D (i, j) and D1 computing reference image and image to be evaluated, contrast similarity and structural similarity; Wherein, image to be evaluated is F (i, j) and D (i, j); Reference picture is F1 and D1; The brightness similarity of reference picture and image to be evaluated comprises l (F (i, j), F1) and l (D (i, j), D1); The contrast similarity c (F (i, j), F1) of reference picture and image to be evaluated and c (D (i, j), D1); The structural similarity s (F (i, j), F1) of reference picture and image to be evaluated and s (D (i, j), D1); L (F (i, j), F1) be two width image F (i, j) and the brightness similarity of F1, l (D (i, j), D1) be two width image D (i, and brightness similarity, the c (F (i of D1 j), j), F1) be the contrast similarity of two width images F (i, j) and F1; C (D (i, j), D1) is the contrast similarity of two width images D (i, j) and D1; S (F (i, j), F1) is the structural similarity of two width images F (i, j) and F1; S (D (i, j), D1) is the structural similarity of two width images D (i, j) and D1;
Step 8: the gradient image g of computing reference image and image to be evaluated respectively f, g f1, g d, g d1, utilize gradient image to calculate gradient similarity g (F (i, j), F1) and the g (D (i, j), D1) of two width images respectively; Wherein, g ffor the gradient image of F (i, j), g f1for the gradient image of F1, g dfor the gradient image of D (i, j); g d1for the gradient image of D1; G (F (i, j), F1) is two width images F (i, j) and F1 gradient similarity; G (D (i, j), D1) is the gradient similarity of two width images D (i, j) and D1;
Step 9: the structural similarity index ISSIM improved according to the brightness similarity of reference picture and image to be evaluated, contrast similarity, structural similarity and gradient Similarity Measure, the structural similarity index ISSIM piecemeal of improvement is tried to achieve M ISSIM index to get its mean value again and obtain MISSIM, calculate non-reference picture evaluation index INRSS according to MISSIM; Wherein, the MISSIM obtained specifically comprises MISSIM (F (i, j), F1) and MISSIM (D (i, j), D1); The structural similarity index ISSIM improved comprises two width image F (i, and the gradient index of similarity ISSIM (F (i of F1 j), j), F1) and two width image D (i, and the gradient index of similarity ISSIM (D (i of D1 j), j), D1); The computing formula of the structural similarity index ISSIM of described improvement is:
ISSIM(F(i,j),F1)=[l(F(i,j),F1)] α[c(F(i,j),F1)] β[s(F(i,j),F1)] γ[g(F(i,j),F1)] λ
ISSIM(D(i,j),D1)=[l(D(i,j),D1)] α[c(D(i,j),D1)] β[s(D(i,j),D1)] γ[g(D(i,j),D1)] λ
Wherein, α, beta, gamma, λ is every weight;
Step 10: judge according to the non-reference picture evaluation index INRSS that step 9 obtains, INRSS1>INRSS2 then illustrates that quality is not improved, then smear restoration system output gray level blurred picture F (i, j), otherwise key diagram picture element amount improves and exports restored image D (i, j); Wherein, namely complete a kind of fast digital image blur to differentiate and restored image method for evaluating quality.
2. a kind of fast digital image blur is differentiated and restored image method for evaluating quality according to claim 1, it is characterized in that: obtain gradient image G (i, j) in step one, computing formula is as follows:
wherein, i, j are respectively horizontal stroke corresponding to image slices vegetarian refreshments, ordinate value.
3. a kind of fast digital image blur is differentiated and restored image method for evaluating quality according to claim 1, it is characterized in that: in step 2, the average gray Grad GMG formula of computed image F (i, j) is as follows:
Wherein, M gray scale blurred picture F (i, j) length, the width of N gray scale blurred picture F (i, j).
4. a kind of fast digital image blur is differentiated and restored image method for evaluating quality according to claim 1, it is characterized in that: obtain the non-zero gray shade scale number NGN in h in step 3, computing formula is as follows:
h=hist(G(i,j))
NGN=num(h i≠0)
In formula, hist represents histogram manipulation; h ifor the pixel count that i-th gray level in h is corresponding.
5. a kind of fast digital image blur is differentiated and restored image method for evaluating quality according to claim 1, it is characterized in that: to gray scale blurred picture F (i in step 5, j) adopt typical blindly restoring image algorithm to adopt full variational regularization method to carry out blind recovery, its rejuvenation target function is as follows:
Wherein, k is unknown fuzzy core, and f is unknown picture rich in detail, for convolution algorithm, λ, for adjustable parameter, G xfor horizontal gradient image, G yfor VG (vertical gradient) image, get final product final restored image D (i, j) by alternately solving above-mentioned rejuvenation target function.
6. a kind of fast digital image blur is differentiated and restored image method for evaluating quality according to claim 1, it is characterized in that: the detailed process calculating the brightness similarity of reference picture and image to be evaluated, contrast similarity and structural similarity in step 7 is:
Respectively brightness similarity l (F (i, j) is calculated to F (i, j), F1, D (i, j) and D1, F1), l (D (i, j), D1), contrast similarity c (F (i, j), F1), c (D (i, j), D1) and structural similarity s (F (i, j), F1), s (D (i, j), D1), computing formula is as follows:
Wherein, μ ffor the average of F (i, j) image intensity value, μ f1for the average of F1 image intensity value, μ dfor the average of D (i, j) image intensity value, μ d1for the average of D1 image intensity value, σ ffor F (i, j) image intensity value variance, σ f1for F1 image intensity value variance, σ dfor D (i, j) image intensity value variance, σ d1for D1 image intensity value variance, σ fF1for the covariance of the gray-scale value of F (i, j) and F1 image, σ dD1for the covariance of D (i, j) image and D1 image intensity value, C 1=(k1 × L) 2, C 2=(k2 × L) 2, k1=0.01, k2=0.03, L are pixel grayscale.
7. a kind of fast digital image blur is differentiated and restored image method for evaluating quality according to claim 1, it is characterized in that: the gradient image g of difference computing reference image and image to be evaluated in step 8 f, g f1, g d, g d1, utilize gradient image to calculate the gradient similarity g (F (i, j), F1) of two width images respectively and g (D (i, j), D1) detailed process is:
Respectively to F (i, j), F1 and D (i, j), D1 compute gradient image g f, g f1, g d, g d1, then compute gradient image g f, g f1, g d, g d1gradient similarity, computing formula is as follows:
Wherein, C 4=(k4 × L) 2, k4=0.03, L are pixel grayscale, C 4it is a constant.
8. a kind of fast digital image blur is differentiated and restored image method for evaluating quality according to claim 1, it is characterized in that: calculate non-reference picture evaluation index INRSS correlation computations formula according to MISSIM in step 9 as follows:
(1) M block is divided into by image to obtain its ISSIM index respectively; Try to achieve mean value MSSIM, namely adopt following formula to calculate:
F ifor i-th subimage in gray scale blurred picture F (i, j), D ii-th subimage in image D (i, j) after recovery; F1 ifor i-th subimage in reference picture F1; D1 ii-th subimage in reference picture D1;
(2) obtain the nothing reference evaluation index INRSS improved, computing formula is as follows:
INRSS1=1-MISSIM(F(i,j),F1)
INRSS2=1-MISSIM(D(i,j),D1)。
CN201410592425.6A 2014-10-28 2014-10-28 Rapid digital imaging fuzzy identification and restored image quality assessment method Active CN104408707B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410592425.6A CN104408707B (en) 2014-10-28 2014-10-28 Rapid digital imaging fuzzy identification and restored image quality assessment method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410592425.6A CN104408707B (en) 2014-10-28 2014-10-28 Rapid digital imaging fuzzy identification and restored image quality assessment method

Publications (2)

Publication Number Publication Date
CN104408707A true CN104408707A (en) 2015-03-11
CN104408707B CN104408707B (en) 2017-04-19

Family

ID=52646336

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410592425.6A Active CN104408707B (en) 2014-10-28 2014-10-28 Rapid digital imaging fuzzy identification and restored image quality assessment method

Country Status (1)

Country Link
CN (1) CN104408707B (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105469413A (en) * 2015-12-10 2016-04-06 哈尔滨工业大学 Normalized ringing weighting based no-reference comprehensive quality assessment method for fuzzy restored image
CN107545251A (en) * 2017-08-31 2018-01-05 北京图铭视界科技有限公司 Face quality discrimination and the method and device of picture enhancing
CN107767350A (en) * 2017-10-17 2018-03-06 青岛海信医疗设备股份有限公司 Video image restoring method and device
CN108109147A (en) * 2018-02-10 2018-06-01 北京航空航天大学 A kind of reference-free quality evaluation method of blurred picture
CN108428232A (en) * 2018-03-20 2018-08-21 合肥工业大学 A kind of blind appraisal procedure of cartoon image quality
CN108681684A (en) * 2018-04-16 2018-10-19 佛山市顺德区中山大学研究院 A kind of two-dimensional barcode image reference-free quality evaluation method and its device, system
CN108985350A (en) * 2018-06-27 2018-12-11 北京中安未来科技有限公司 It is a kind of that the method and apparatus of blurred picture are identified based on gradient magnitude sparse features information, calculate equipment and storage medium
CN109003296A (en) * 2018-05-31 2018-12-14 南京航空航天大学 A kind of feature extracting method characterizing restored image ringing effect
CN109242790A (en) * 2018-08-22 2019-01-18 大连理工大学 A kind of image deblurring appraisal procedure towards fields of measurement
CN109360157A (en) * 2018-08-22 2019-02-19 浙江工业大学 Space-variant blur image recovery method based on TV and small echo regularization
CN109712134A (en) * 2018-12-28 2019-05-03 武汉虹识技术有限公司 Iris image quality evaluation method, device and electronic equipment
CN110211105A (en) * 2019-05-24 2019-09-06 厦门美柚信息科技有限公司 A kind of blurred picture detection method, apparatus and system
CN111914898A (en) * 2020-06-30 2020-11-10 电子科技大学 Airborne SAR task adaptability evaluation method based on adaptive threshold
CN112767327A (en) * 2021-01-08 2021-05-07 上海大学 Image quality management system and method based on neural network
CN117593192A (en) * 2024-01-18 2024-02-23 大连云间来客科技有限公司 Gynecological cervical image enhancement analysis method
CN118075449A (en) * 2024-04-18 2024-05-24 智广海联(天津)大数据技术有限公司 Method and device for evaluating camera monitoring video quality

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102339460A (en) * 2011-08-19 2012-02-01 清华大学 Adaptive satellite image restoration method
US8214793B1 (en) * 2007-06-28 2012-07-03 Adobe Systems Incorporated Automatic restoration of tool configuration while navigating layers of a composition
US20130243319A1 (en) * 2012-03-13 2013-09-19 Postech Academy-Industry Foundation Method and apparatus for deblurring non-uniform motion blur in large scale input image based on tile unit
CN103559693A (en) * 2013-11-18 2014-02-05 东南大学 Image local structure self-adaption recovery method based on non-continuity indicator

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8214793B1 (en) * 2007-06-28 2012-07-03 Adobe Systems Incorporated Automatic restoration of tool configuration while navigating layers of a composition
CN102339460A (en) * 2011-08-19 2012-02-01 清华大学 Adaptive satellite image restoration method
US20130243319A1 (en) * 2012-03-13 2013-09-19 Postech Academy-Industry Foundation Method and apparatus for deblurring non-uniform motion blur in large scale input image based on tile unit
CN103559693A (en) * 2013-11-18 2014-02-05 东南大学 Image local structure self-adaption recovery method based on non-continuity indicator

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
范媛媛 等: "基于对比度敏感度的无参考图像清晰度评价", 《光学精密工程》 *

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105469413B (en) * 2015-12-10 2017-12-26 哈尔滨工业大学 It is a kind of based on normalization ring weighting without refer to smear restoration image synthesis method for evaluating quality
CN105469413A (en) * 2015-12-10 2016-04-06 哈尔滨工业大学 Normalized ringing weighting based no-reference comprehensive quality assessment method for fuzzy restored image
CN107545251A (en) * 2017-08-31 2018-01-05 北京图铭视界科技有限公司 Face quality discrimination and the method and device of picture enhancing
CN107767350A (en) * 2017-10-17 2018-03-06 青岛海信医疗设备股份有限公司 Video image restoring method and device
CN108109147A (en) * 2018-02-10 2018-06-01 北京航空航天大学 A kind of reference-free quality evaluation method of blurred picture
CN108109147B (en) * 2018-02-10 2022-02-18 北京航空航天大学 No-reference quality evaluation method for blurred image
CN108428232B (en) * 2018-03-20 2019-07-19 合肥工业大学 A kind of blind appraisal procedure of cartoon image quality
CN108428232A (en) * 2018-03-20 2018-08-21 合肥工业大学 A kind of blind appraisal procedure of cartoon image quality
CN108681684A (en) * 2018-04-16 2018-10-19 佛山市顺德区中山大学研究院 A kind of two-dimensional barcode image reference-free quality evaluation method and its device, system
CN108681684B (en) * 2018-04-16 2021-02-02 佛山市顺德区中山大学研究院 Non-reference quality evaluation method, device and system for two-dimensional bar code image
CN109003296A (en) * 2018-05-31 2018-12-14 南京航空航天大学 A kind of feature extracting method characterizing restored image ringing effect
CN109003296B (en) * 2018-05-31 2020-08-14 南京航空航天大学 Feature extraction method for representing ringing effect of restored image
CN108985350A (en) * 2018-06-27 2018-12-11 北京中安未来科技有限公司 It is a kind of that the method and apparatus of blurred picture are identified based on gradient magnitude sparse features information, calculate equipment and storage medium
CN109360157A (en) * 2018-08-22 2019-02-19 浙江工业大学 Space-variant blur image recovery method based on TV and small echo regularization
CN109360157B (en) * 2018-08-22 2020-08-25 浙江工业大学 TV and wavelet regularization-based spatial variation blurred image restoration method
CN109242790A (en) * 2018-08-22 2019-01-18 大连理工大学 A kind of image deblurring appraisal procedure towards fields of measurement
CN109712134A (en) * 2018-12-28 2019-05-03 武汉虹识技术有限公司 Iris image quality evaluation method, device and electronic equipment
CN109712134B (en) * 2018-12-28 2020-11-06 武汉虹识技术有限公司 Iris image quality evaluation method and device and electronic equipment
CN110211105A (en) * 2019-05-24 2019-09-06 厦门美柚信息科技有限公司 A kind of blurred picture detection method, apparatus and system
CN111914898A (en) * 2020-06-30 2020-11-10 电子科技大学 Airborne SAR task adaptability evaluation method based on adaptive threshold
CN111914898B (en) * 2020-06-30 2022-06-28 电子科技大学 Adaptive threshold-based airborne SAR task adaptability evaluation method
CN112767327A (en) * 2021-01-08 2021-05-07 上海大学 Image quality management system and method based on neural network
CN117593192A (en) * 2024-01-18 2024-02-23 大连云间来客科技有限公司 Gynecological cervical image enhancement analysis method
CN117593192B (en) * 2024-01-18 2024-03-26 大连云间来客科技有限公司 Gynecological cervical image enhancement analysis method
CN118075449A (en) * 2024-04-18 2024-05-24 智广海联(天津)大数据技术有限公司 Method and device for evaluating camera monitoring video quality

Also Published As

Publication number Publication date
CN104408707B (en) 2017-04-19

Similar Documents

Publication Publication Date Title
CN104408707B (en) Rapid digital imaging fuzzy identification and restored image quality assessment method
CN108388885B (en) Multi-person close-up real-time identification and automatic screenshot method for large live broadcast scene
Quelhas et al. Cell nuclei and cytoplasm joint segmentation using the sliding band filter
WO2021003824A1 (en) Image recognition-based illegal building identification method and device
CN107633226B (en) Human body motion tracking feature processing method
CN105279772B (en) A kind of trackability method of discrimination of infrared sequence image
CN109544592B (en) Moving object detection algorithm for camera movement
CN101739551A (en) Method and system for identifying moving objects
CN108537787B (en) Quality judgment method for face image
CN111611907B (en) Image-enhanced infrared target detection method
CN103455994A (en) Method and equipment for determining image blurriness
CN107146217A (en) A kind of image detecting method and device
CN112365497A (en) High-speed target detection method and system based on Trident Net and Cascade-RCNN structures
CN112464933A (en) Intelligent recognition method for small dim target of ground-based staring infrared imaging
CN116129195A (en) Image quality evaluation device, image quality evaluation method, electronic device, and storage medium
CN114972339A (en) Data enhancement system for bulldozer structural member production abnormity detection
CN114037650B (en) Ground target visible light damage image processing method for change detection and target detection
Hagwood et al. Evaluation of segmentation algorithms on cell populations using CDF curves
CN105469413A (en) Normalized ringing weighting based no-reference comprehensive quality assessment method for fuzzy restored image
CN108491796A (en) A kind of time domain period point target detecting method
CN115830351B (en) Image processing method, apparatus and storage medium
CN115830514B (en) Whole river reach surface flow velocity calculation method and system suitable for curved river channel
CN114943869B (en) Airport target detection method with enhanced style migration
CN108665479B (en) Infrared target tracking method based on compressed domain multi-scale feature TLD
CN106778913B (en) Fuzzy license plate detection method based on pixel cascade characteristic

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20190614

Address after: 150000 Heilongjiang Harbin Dalian economic and Trade Zone, the North Road and Xingkai Road intersection

Patentee after: Harbin University of Technology Robot Group Co., Ltd.

Address before: 150001 No. 92 West straight street, Nangang District, Heilongjiang, Harbin

Patentee before: Harbin Institute of Technology

TR01 Transfer of patent right