CN106960436A - A kind of remote sensing image process performance appraisal procedure - Google Patents

A kind of remote sensing image process performance appraisal procedure Download PDF

Info

Publication number
CN106960436A
CN106960436A CN201710165709.0A CN201710165709A CN106960436A CN 106960436 A CN106960436 A CN 106960436A CN 201710165709 A CN201710165709 A CN 201710165709A CN 106960436 A CN106960436 A CN 106960436A
Authority
CN
China
Prior art keywords
image
edge
mtf
frequency
texture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710165709.0A
Other languages
Chinese (zh)
Inventor
智喜洋
江世凯
张伟
胡建明
李鸿飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin Institute of Technology
Original Assignee
Harbin Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin Institute of Technology filed Critical Harbin Institute of Technology
Priority to CN201710165709.0A priority Critical patent/CN106960436A/en
Publication of CN106960436A publication Critical patent/CN106960436A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10032Satellite or aerial image; Remote sensing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30168Image quality inspection

Landscapes

  • Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

A kind of remote sensing image process performance appraisal procedure, belongs to remote sensing image processing and assessment technique field.Methods described step is as follows:The image objective evaluation index system of gradation of image, texture and marginal information is set up, Processing Algorithm is assessed and process performance enhanced with definition is kept to details;With reference to the modulation transfer function method of estimation based on edge of a knife picture and natural image, overall improving performance of the Processing Algorithm to each frequency band MTF is assessed using the integral area of MTF (modulation transfer function) curve;Signal noise ratio (snr) of image SNR evaluation index and method is proposed, the integrated treatment performance that Processing Algorithm keeps enhancing and noise suppressed to details is assessed;The evaluation method of ring and aliasing effect is proposed, the process performance that Processing Algorithm suppresses to pseudomorphism is assessed.The method have the advantages that the performance for being applicable to comprehensive objective appraisal Image Restoration Algorithm is good and bad, Processing Algorithm parameter optimization and model refinement are instructed.

Description

A kind of remote sensing image process performance appraisal procedure
Technical field
The invention belongs to remote sensing image processing and assessment technique field, and in particular to a kind of remote sensing image processing Performance estimating method.
Background technology
Link, due to being influenceed by factors such as atmospheric environment, camera, Platform Vibrations, remote sensing images are imaged for optical remote sensing Degenerated in the presence of fuzzy, noise iseikonia matter, in-orbit image quality is generally lifted using image restoration treatment technology, while the system of reduction Development difficulty.Research at present on remote sensing image Processing Algorithm is a lot, and these algorithms can be obviously improved image tune Modulation trnasfer function (MTF) and definition, but the problem of still suffer from certain, while being mainly reflected in MTF liftings, in fact it could happen that make an uproar There is the problems such as grain details holding capacity is not strong while pseudomorphism, noise suppressed in sound amplification, adjacent edges, therefore for above-mentioned The image synthesis processing lifting of recovering quality problem has turned into one of important development direction that image restoration is handled.And obvious image The comprehensive assessment of processing improving performance is premise and the guarantee of the research of image synthesis processing boosting algorithm, checking and optimization, therefore Be badly in need of setting up more perfect image procossing Performance Evaluation index system and method, this method should be able to realize image MTF liftings, The image synthesises such as noise suppressed, grain details are kept, pseudomorphism suppression handle the assessment of improving performance, so as to assess more fully hereinafter The process performance of restoration algorithm, while instructing the optimization design of algorithm, also may be directly applied to image quality evaluation, instruct simultaneously The optimization design of optical remote sensing imaging system.
The content of the invention
The purpose of the present invention is to assess and instruct algorithm design for remote sensing image facture process performance with changing Enter the demand of optimization, propose a kind of remote sensing image process performance appraisal procedure.
The present invention considers phenogram as the objective parameter of every picture quality of quality good or not sets up evaluation index system With method, in index system in addition to comprising image modulation transmission function (MTF) and signal noise ratio (snr) of image (SNR), also comprising figure As details is kept and definition enhancing, noise suppressed, the objective evaluation index of pseudomorphism rejection ability, while in view of practical application Problem proposes the appraisal procedure of indices, compared with the objective evaluation index of traditional image and its recovering quality, Neng Gougeng Plus comprehensively, objectively reflect integrated treatment improving performance of the Image Restoration Algorithm to picture quality, while more efficiently instructing The optimization design of Processing Algorithm and optical remote sensing imaging system.
To achieve the above object, the technical scheme that the present invention takes is as follows:
A kind of remote sensing image process performance appraisal procedure, methods described step is as follows:
Step one:The image objective evaluation index system of gradation of image, texture and marginal information is set up, Processing Algorithm is assessed Process performance enhanced with definition is kept to details;
Step 2:With reference to the modulation transfer function method of estimation based on edge of a knife picture and natural image, MTF curve is utilized Integral area assess Processing Algorithm to each frequency band MTF overall improving performance;
Step 3:Propose signal noise ratio (snr) of image SNR evaluation index and method, assess Processing Algorithm details is kept enhancing and The integrated treatment performance of noise suppressed;
Step 4:The evaluation method of ring and aliasing effect is proposed, the process performance that Processing Algorithm suppresses to pseudomorphism is assessed.
The present invention is relative to the beneficial effect of prior art:
(1) compared with traditional method, this method can realize image MTF liftings, noise suppressed, grain details keep, The image synthesises such as pseudomorphism suppression handle the comprehensive assessment of improving performance, so that reflection Processing Algorithm is excellent more completely, exactly It is bad, the optimization design of algorithm is and guided, image quality evaluation is also may be directly applied to, while guiding opticses remote-sensing imaging system Optimization design;
(2) consider not including in the in-orbit image of Optical remote satellite the edge of a knife as characteristic feature scenery such as, bridges The actual application problem that MTF is assessed, the present invention is using the MTF methods of estimation combined based on edge of a knife picture and based on any natural image MTF evaluations are carried out, while lifting energy of the Processing Algorithm to each frequency band of scenery can be reflected more fully hereinafter in view of MTF areas Power, using the area of MTF curved surfaces institute envelope as evaluation index, when in image comprising the edge of a knife as when be based on using internationally recognized The MTF extracting methods of edge of a knife picture, otherwise using the MTF methods of estimation based on natural image, by comparing image MTF after before processing Area, assesses improving performance of the Processing Algorithm to different frequency bands MTF, so as to ensure that integrality and engineering that image MTF is assessed Feasibility;
(3) consider to suppress noise, while it is to investigate the good and bad important finger of Processing Algorithm to keep image texture details ability Mark, and be only capable of reflecting rejection of the Processing Algorithm to noise using traditional signal noise ratio (snr) of image evaluation index, the present invention is proposed The method of joint image flat site and non-planar regions (edge, texture relatively enrich region) comprehensive assessment signal noise ratio (snr) of image, puts down The signal noise ratio (snr) of image that smooth region is defined can reflect process performance of the Processing Algorithm to noise suppressed, the figure that non-planar regions are defined The ability of grain details is kept while can reflecting Processing Algorithm to noise suppressed as signal to noise ratio;
(4) image artifacts that Processing Algorithm is caused include ringing effect and frequency alias, influence the subjective interpretation matter of image Amount, therefore lifting image MTF, while the ability for suppressing pseudomorphism is to investigate the good and bad important indicator of Processing Algorithm, the present invention is directed to The adjacent edges of image are likely to occur the vibration texture problem of class Gibbs Distribution after processing, based on edge response function, according to It assesses the ring rejection of Processing Algorithm through the overshoot height at edge, while high frequency blocks caused frequency when being directed to imaging Rate is aliasing in processing procedure the problem of may being exaggerated, mixed than inhibition of the assessment algorithm to aliasing effect based on image letter Can, so as to effectively assess the pseudomorphism rejections of Processing Algorithm lifting image MTF simultaneously.
To sum up, the invention provides a kind of remote sensing image process performance appraisal procedure.Consider restoration algorithm pair Factor in terms of image detail holding and definition enhancing performance, pseudomorphism rejection ability and MTF and SNR winding levels, is applicable It is good and bad in the performance of comprehensive objective appraisal Image Restoration Algorithm, instruct Processing Algorithm parameter optimization and model refinement.
Brief description of the drawings
Fig. 1 is a kind of remote sensing image process performance evaluation system figure.
Embodiment
Technical scheme is further described with reference to embodiment and accompanying drawing, but is not limited thereto, It is every technical solution of the present invention to be modified or equivalent, without departing from the spirit and scope of technical solution of the present invention, It all should cover in protection scope of the present invention.
Embodiment one:As shown in figure 1, present embodiment record is that a kind of remote sensing image process performance is commented Estimate method, methods described step is as follows:
Step one:The image objective evaluation index system of gradation of image, texture and marginal information is set up, Processing Algorithm is assessed Process performance enhanced with definition is kept to details;
Step 2:With reference to the modulation transfer function method of estimation based on edge of a knife picture and natural image, MTF (modulation is utilized Transmission function) integral area of curve assesses Processing Algorithm to each frequency band MTF overall improving performance;
Step 3:Propose signal noise ratio (snr) of image SNR evaluation index and method, assess Processing Algorithm details is kept enhancing and The integrated treatment performance of noise suppressed;
Step 4:The evaluation method of ring and aliasing effect is proposed, the process performance that Processing Algorithm suppresses to pseudomorphism is assessed.
Embodiment two:A kind of remote sensing image process performance appraisal procedure described in embodiment one, The step one is comprised the following steps that:
The details retentivity of remote sensing image Processing Algorithm is assessed according to gradation of image level, texture and marginal information Performance can be strengthened with definition, mainly evaluated using the characterization parameter of gradation of image, texture and marginal information, according to image The objective parameter representative technique study of image of restoration algorithm, the image components of texture and edge details can be characterized by drawing, described Image components mainly include:Grey-scale contrast, definition, spatial frequency, texture entropy;
(1) grey-scale contrast
Grey-scale contrast refers to most bright part and most the ratio between dark-part density or logarithmic difference in image, is the different atural objects of reflection Between contrast and image clearly degree important indicator, the rill of texture is deeper in the picture, and crestal line is more prominent, and contrast is got over Greatly, image visual effect is better;Its expression formula is:
Wherein, f1Represent grey-scale contrast;L represents the gray level of image;I, j represent the gray value of two pixels respectively;P (i, j) represents gray level co-occurrence matrixes;It is P (i, j) normalized value;
It can be seen that f from formula (1)1Significantly amplification gray scale larger gray scale pair can be differed, so that texture is thin Clearly picture contrast is larger for section;When Same Scene image comparison, the picture contrast that Texture Boundaries tend to be fuzzy is smaller, The more visible picture contrast of Texture Boundaries is larger;It can be seen that, contrast can reflect detailed information before and after image enhancement processing Situation of change;
(2) definition
Definition refers to the obvious degree between the adjacent image that human eye can be felt;Clearly image is included than blurred picture More details and information content, this is the foundation that image quality evaluation is carried out using definition;It is evaluation image scenery thin portion The index of ability to express;Definition is high, and the effect of image is all right, and gray scale is sharper with the change of position, and image detail change is fast, The distinguishable degree at the edge of image is high;It can be seen that, definition can directly reflect that image enhancement processing algorithm details keeps and strengthened Performance;The numerical value of definition is in itself a kind of index for being compared to each other, computational methods are as follows without absolute sense:By Individual every in image takes 8 neighborhood points to subtract each other therewith, first seeks the weighted sum of 8 differences, and the size of power depends on distance, then will There is an income value to be added divided by pixel total number;Its expression formula is:
In formula (2), f2Represent definition;wαFor weight factor;(x, y) is pixel position coordinates in the picture;Dp tables Show that two pixel gray levels are poor;Dl represents pixel spacing;| | it is absolute value sign;M, n represent picturedeep, columns respectively;α is Eight neighborhood points numbering of pixel;
(3) spatial frequency
In original image, adjacent pixel gray value is obtained into difference image g as difference along row, column direction respectively1(x,y)、g2 (x, y), then the expression formula of spatial frequency be:
In formula (3), f3Representation space frequency;
(4) texture entropy
Texture entropy is the measurement for the information content that image has, and can preferably reflect the number of information expressed by image, It determines the uncertainty degree of image, is mainly used to weigh the randomness of image;When the texture of image is extremely inconsistent, gray scale is common The value of each element will be less than normal in raw matrix GLCM, and this will mean that the texture has the complexity of larger entropy, i.e. texture higher Mean that amount of image information is bigger, its entropy is also bigger;It can be seen that, texture entropy can reflect image information before and after image enhancement processing Situation of change;Its expression formula is:
Wherein, f4Represent texture entropy, when all P (i, j) are equal, f4Take maximum;Ln () refers to natural logrithm computing; Because P (i, j) is the statistics based on GLCM points pair, the more traditional gray level entropy formula of its value can more reflect image texture details and The situation of edge mutation;
Finally, These parameters are added by certain weight proportion:
f01f12f23f34f4 (5)
Wherein, f0For details retention property and definition enhancing Evaluation results, α1234For weight factor.
Embodiment three:A kind of remote sensing image process performance appraisal procedure described in embodiment one, The step 2 is comprised the following steps that:
According to the scene features included in image, using the MTF methods of estimation based on edge of a knife picture or based on natural scene MTF methods of estimation extract the MTF of image, and then assess the MTF improving performances of remote sensing image Processing Algorithm;Work as original image Scenery in when including edge of a knife picture (sword side) feature, select MTF methods of estimation based on edge of a knife picture to extract the area of MTF curve; Otherwise, the in-orbit system MTF algorithm for estimating for being taken based on natural scene is extracted;
(1) the MTF methods of estimation based on edge of a knife picture
First look for the knife-edge point in given image, be fitted knife-edge curve, by pixel and knife-edge Distance carries out resampling, obtains edge-spread function (ESF) data distribution with sub-pixed mapping interval, afterwards the side to collecting Edge spread function data make smoothing processing and fit corresponding curve, carry out differential to the curve that fitting is obtained, just can obtain To the line spread function of system, carry out be exactly after Fourier transformation optical system one-dimensional MTF;
(2) the MTF methods of estimation based on natural scene
This method is intended to be directed to the problem of in-orbit MTF has coupling with object scene in observed image, by target Scenery and in-orbit MTF carry out parametrization sign respectively, and the remotely sensed image statistics for setting up association scenery parameter and MTF parameters characterizes mould Type, and the estimation for realizing MTF is solved to model parameter progress;
The transmission capacity of each frequency bandwidth characteristics can be characterized in view of the area of MTF curve institute envelope, the area of envelope is got over Greatly, treatment effect is better, than being evaluated more fully only with the mtf value at nyquist frequency, therefore uses MTF areas Carry out hoisting power of the evaluation image processing method to image MTF.
Embodiment four:A kind of remote sensing image process performance appraisal procedure described in embodiment one, The step 3 is comprised the following steps that:
The enhancing of suppression and image non-planar regions (edge, texture-rich) echo signal from image flat site noise Two aspects of degree assess the SNR improving performances of remote sensing image Processing Algorithm;Image SNR is carried out using two kinds of evaluation indexes The assessment of improving performance;
(1) the SNR improving performances towards image flat site noise suppressed are assessed
The SNR evaluation indexes and conventional method are consistent;Appraisal procedure is:In image to be assessed select one piece it is flat In region, the region should comprising few edge as far as possible and textural characteristics (in such region, the change master of gradation of image distribution If as caused by noise), noise level can be assessed by extracting the gradation of image variance in the region;Image in SNR indexs Signal section is then represented using the average of the area grayscale;In the assessment of noise characteristic and noise level, selected areas exists Accounting in entire image should try one's best greatly, truly to reflect the noise situations of entire image;
After image quality inverting enhancing before processing, the gray average of image flat site should be held essentially constant, because If this index is same approximate constant, show that image quality inverting enhancing algorithm has stronger rejection ability to noise;
(2) the SNR improving performances towards image non-planar regions signal enhancing are assessed
Included in remote sensing image, in image roof, road surface, waters, desert flat site and vehicle, house, Military target edge non-planar regions (region of edge and texture-rich), non-flat forms information for identification target provide it is important according to According to;Therefore, it is proposed to which a kind of SNR evaluation indexes specifically designed for image non-planar regions signal enhancing, are defined as:
Wherein,Represent the local variance of image, i.e., the gray variance calculated in pixel (i, j) neighborhood;I Represent the set of entire image coordinate points;Max () is maximum symbol;Min () is minimum value symbol;
Circular is:Piecemeal (usual window is taken as 3 × 3~7 × 7) is carried out to original image, statistics calculates figure The local variance in each region as in, finds the corresponding image-region of local variance maximum and minimum value;Obviously, local variance is maximum The variance in region characterizes the edge and texture-rich degree of image object signal, and the variance of local variance Minimum Area is illustrated Noise level;In fact, minimum variance is the noise variance measured in flat site, this with traditional noise evaluation method still It is so consistent, signal noise ratio (snr) of image can be accessed by the ratio of the two;
Because minimum variance is the noise variance that measures in flat site, maximum variance characterizes picture signal, therefore The index is that can effectively assess image quality inverting to strengthen algorithm to the enhancing degree of image object signal, again can be preferable Assess inhibition level of the enhancing algorithm to noise in ground.
Embodiment five:A kind of remote sensing image process performance appraisal procedure described in embodiment one, The step 4 is comprised the following steps that:
Although most image processing algorithm can numerically preferably approximate original image, due to using model Inaccuracy and influenceed by noise that inappropriate property is selected with Processing Algorithm parameter, all can be attached at more obvious edge Closely produce in original image and non-existent deceptive information, we are referred to as image artifacts.Image artifacts rejections is commented Estimating mainly includes:Ring suppression and the evaluation of aliasing inhibition level after remote sensing image before processing.
(1) the ring rejection of remote sensing image Processing Algorithm is assessed based on normalization edge response function
It is that the high frequency of image in a frequency domain is blocked that ring, which should be approximately considered, shows as the neighbour in gradation of image acute variation There is the vibration of class Gibbs Distribution, i.e. restored image edge ringing effect and is usually expressed as in domain:It is particularly terraced in image border The larger edge of angle value, can occur repeating vibration texture with artwork edge shape identical after recovery in the adjacent edges of image; Image ringing effect can be reflected by edge response function (ER):
Wherein:Snet(fx,fy) represent whole system transmission function;uxRepresent that the normalization of optical system on x directions is cut Only frequency;uyRepresent the normalization cut-off frequency of optical system on y directions;D represents one horizontal pixel center response of distance Position;fxAnd fyX and y directions frequency is represented respectively;π is pi;ERxAnd ER (d)y(d) edge for referring to x and y directions respectively rings Answer function;
(2) based on the mixed aliasing rejection than assessing remote sensing image Processing Algorithm of letter
Image aliasing is due to that signal has been carried out into periodic continuation in detector sampling process, during continuation, The information of some low frequencies may replicate into radio-frequency component, cause frequency aliasing, and these false compositions will be in image procossing During be exaggerated;Image aliasing effect can be reflected by letter is mixed than (SAR);
First, find with the strong sub-block of Energy-orientation;Content is less complicated in image but includes edge again simultaneously Sub-block is object to be found;Define local contrast Cy(m,n)
Wherein, μy(m,n)、σy(m, n) be respectively centered on (m, n), window size for 7 × 7 sub-images average and Standard deviation, and calculate the variance of correspondence sub-block;The big explanation region of variance is complex, the figure included in the big explanation region of contrast Picture marginal information is more, and variance is small and there is the sub-block region of larger local contrast to be likely to contain substantial amounts of edge;Choosing Take and so meet after the sub-block of condition, the sub-block pixel value of the condition that is unsatisfactory for all is zeroed, then find out big big of contrast It is small be 64 × 64 sub-block;
Then the direction of each fritter is found out;The strong direction of energy comparison is there may be aliasing, and not by low frequency energy With the influence of the strong aliased portion of any medium-high frequency;Accurate direction estimation can accurately find aliased portion in frequency domain;To every One fritter is estimated with Blackman-Harris windows travel direction;Calculate the discrete Fourier transform width for 64 × 64 sub-blocks selected Value square is designated as Zp(i, j) (wherein-p/2≤i, j < p/2, p=64), and low frequency is moved into center;Ms(i, j) is used as frequency domain In from (- s ,-p/2+1) arrive (s, p/2-1) direction template, wherein variable s values be-p/2 < s < p/2;Ms (i, j) is wide The two-value template of ω=5;Similar establishment aliasing template As(i, j), As(i, j) is the continuation of direction template;Direction finding algorithm is such as Under:
Define primary iteration control variable k=1 and initial Q=(i, j) | 3≤| i |, | j |≤α (p/2) };Initial E= ∑(i,j)∈QZp(i,j);Its correspondence direction energy d is calculated each ss, as shown in formula:
If maxds< β E, make kmax=k-1, then terminates, otherwise, will make dsMaximized s saves as s (k);Then By Ms(i, j) and AsThe frequency of (i, j) removes Q;K=k+1 is finally set, top-operation is repeated, through Setup Experiments α=0.4, β= 0.05;
The signal without aliasing is carried out to each sub-block to estimate;In this link, the most strong side first found out based on previous step The signal energy containing aliasing is estimated to s (k), it is M respectively to set two setPAnd AP, it is all k≤k respectivelymaxMs(i, J), AsThe set of (i, j);MPFrequency domain include the very strong signal energy for covering aliased energy;Therefore, aliased energy is measured Frequency domain selection is included in APIn without in MPIn;
The energy of isotropic is calculated, from ZpRemoved in (i, j) and be included in MPStrong oriented energy corresponding to middle frequency is obtainedThis constitutes estimation in APIn without in MPIn frequency signal energy Low threshold, high threshold is Zp(i,j); Estimating signal energy It is Zp(i's, j) is each The average value in individual direction;Finally, the ratio between estimating signal and aliasing are:
Wherein, P is the set of all sub-blocks;The size of the aliasing effect of piece image can be evaluated by SAR;But need Be pointed out that this method be according at image strong edge, what the aliasing of power spectrum performance was solved, and in the absence of The flat site of strong edge is not applied to simultaneously, and in the cities and towns scene comprising strong edge, whether complicated or simple scene, all The mixed ratio of letter can be extracted with the method.

Claims (5)

1. a kind of remote sensing image process performance appraisal procedure, it is characterised in that:Methods described step is as follows:
Step one:The image objective evaluation index system of gradation of image, texture and marginal information is set up, Processing Algorithm is assessed to thin Section keeps process performance enhanced with definition;
Step 2:With reference to the modulation transfer function method of estimation based on edge of a knife picture and natural image, the product of MTF curve is utilized Facet product assesses overall improving performance of the Processing Algorithm to each frequency band MTF;
Step 3:Signal noise ratio (snr) of image SNR evaluation index and method is proposed, Processing Algorithm is assessed and enhancing and noise is kept to details The integrated treatment performance of suppression;
Step 4:The evaluation method of ring and aliasing effect is proposed, the process performance that Processing Algorithm suppresses to pseudomorphism is assessed.
2. a kind of remote sensing image process performance appraisal procedure according to claim 1, it is characterised in that:The step One comprises the following steps that:
Assessed according to gradation of image level, texture and marginal information remote sensing image Processing Algorithm details retention property and Definition strengthens performance, is mainly evaluated using the characterization parameter of gradation of image, texture and marginal information, according to image quality The objective parameter representative technique study of the enhanced image of inverting, the image components of texture and edge details can be characterized by drawing, described Image components mainly include:Grey-scale contrast, definition, spatial frequency, texture entropy;
(1) grey-scale contrast
Grey-scale contrast refers to most bright part and most the ratio between dark-part density or logarithmic difference in image, is reflected between different atural objects Contrast and image clearly degree important indicator, the rill of texture is deeper in the picture, and crestal line is more prominent, and contrast is bigger, Image visual effect is better;Its expression formula is:
f 1 = Σ i = 0 L - 1 Σ j = 0 L - 1 ( i - j ) 2 p ^ ( i , j ) - - - ( 1 )
Wherein, f1Represent grey-scale contrast;L represents the gray level of image;I, j represent the gray value of two pixels respectively;P(i,j) Represent gray level co-occurrence matrixes;It is P (i, j) normalized value;
It can be seen that f from formula (1)1Significantly amplification gray scale larger gray scale pair can be differed, so that grain details are clear Picture contrast it is larger;When Same Scene image comparison, the picture contrast that Texture Boundaries tend to be fuzzy is smaller, texture side The more visible picture contrast in boundary is larger;It can be seen that, contrast can reflect the change feelings of detailed information before and after image enhancement processing Condition;
(2) definition
Definition refers to the obvious degree between the adjacent image that human eye can be felt;Clearly image includes more than blurred picture Details and information content, this be using definition carry out image quality evaluation foundation;It is the expression of evaluation image scenery thin portion The index of ability;Definition is high, and the effect of image is all right, and gray scale is sharper with the change of position, and image detail change is fast, image Edge distinguishable degree it is high;It can be seen that, definition can directly reflect that image enhancement processing algorithm details is kept and enhanced property Energy;The numerical value of definition is in itself a kind of index for being compared to each other, computational methods are as follows without absolute sense:It is right one by one Every in image takes 8 neighborhood points to subtract each other therewith, first seeks the weighted sum of 8 differences, and the size of power depends on distance, then will be all Point income value is added divided by pixel total number;Its expression formula is:
f 2 = Σ x = 1 m Σ y = 1 n Σ α = 1 8 w α | d p / d l | m × n - - - ( 2 )
In formula (2), f2Represent definition;wαFor weight factor;(x, y) is pixel position coordinates in the picture;M × n is represented Image size;Dp represents that two pixel gray levels are poor;Dl represents pixel spacing;| | it is absolute value sign;M, n represent image respectively Line number, columns;α numbers for eight neighborhood points of pixel;
(3) spatial frequency
In original image, adjacent pixel gray value is obtained into difference image g as difference along row, column direction respectively1(x,y)、g2(x, y), Then the expression formula of spatial frequency is:
f 3 = Σ x = 1 m Σ y = 1 n [ g 1 2 ( x , y ) + g 2 2 ( x , y ) ] m × n - - - ( 3 )
In formula (3), f3Representation space frequency;
(4) texture entropy
Texture entropy is the measurement for the information content that image has, and the number of information expressed by image can be preferably reflected, it determines Determine the uncertainty degree of image, be mainly used to weigh the randomness of image;When the texture of image is extremely inconsistent, gray scale symbiosis square The value of each element will be less than normal in battle array GLCM, and this will mean that the texture has the higher just meaning of the complexity of larger entropy, i.e. texture Taste that amount of image information is bigger, and its entropy is also bigger;It can be seen that, texture entropy can reflect the change of image information before and after image enhancement processing Change situation;Its expression formula is:
f 4 = - Σ i = 0 L - 1 Σ j = 0 L - 1 P ^ ( i , j ) l n P ^ ( i , j ) - - - ( 4 )
Wherein, f4Represent texture entropy, when all P (i, j) are equal, f4Take maximum;Ln () refers to natural logrithm computing;Due to P (i, j) is the statistics based on GLCM points pair, and the more traditional gray level entropy formula of its value can more reflect image texture details and edge The situation of mutation;
Finally, These parameters are added by certain weight proportion:
f01f12f23f34f4 (5)
Wherein, f0For details retention property and definition enhancing Evaluation results, α1234For weight factor.
3. a kind of remote sensing image process performance appraisal procedure according to claim 1, it is characterised in that:The step Two comprise the following steps that:
According to the scene features included in image, estimated using the MTF methods of estimation based on edge of a knife picture or the MTF based on natural scene Meter method extracts the MTF of image, and then assesses the MTF improving performances of remote sensing image Processing Algorithm;When the scape of original image When including the edge of a knife as feature in thing, the MTF methods of estimation based on edge of a knife picture are selected to extract the area of MTF curve;Otherwise, base is taken Extracted in the in-orbit system MTF algorithm for estimating of natural scene;
(1) the MTF methods of estimation based on edge of a knife picture
The knife-edge point in given image is first looked for, knife-edge curve is fitted, by pixel and the distance of knife-edge Resampling is carried out, the edge-spread function data distribution with sub-pixed mapping interval is obtained, afterwards the edge-diffusion letter to collecting Number data make smoothing processing and fit corresponding curve, carry out differential to the curve that fitting is obtained, just can obtain system It is exactly the one-dimensional MTF of optical system after line spread function, progress Fourier transformation;
(2) the MTF methods of estimation based on natural scene
This method is intended to be directed to the problem of in-orbit MTF has coupling with object scene in observed image, by object scene Parametrization sign is carried out respectively with in-orbit MTF, sets up the remotely sensed image statistics characterization model of association scenery parameter and MTF parameters, And model parameter is carried out to solve the estimation for realizing MTF;
The transmission capacity of each frequency bandwidth characteristics can be characterized in view of the area of MTF curve institute envelope, the area of envelope is bigger, located Manage effect better, commented than being evaluated more fully only with the mtf value at nyquist frequency, therefore using MTF areas Hoisting power of the valency image processing method to image MTF.
4. a kind of remote sensing image process performance appraisal procedure according to claim 1, it is characterised in that:The step Three comprise the following steps that:
Light is assessed in terms of the suppression of image flat site noise and the enhancing degree two of image non-planar regions echo signal Learn the SNR improving performances of remote sensing image processing algorithm;The assessment of image SNR improving performances is carried out using two kinds of evaluation indexes;
(1) the SNR improving performances towards image flat site noise suppressed are assessed
The SNR evaluation indexes and conventional method are consistent;Appraisal procedure is:One piece of flat region is selected in image to be assessed It should be extracted the gradation of image variance in the region comprising few edge and textural characteristics as far as possible and can assess and make an uproar in domain, the region Sound level;Image signal part in SNR indexs is then represented using the average of the area grayscale;In noise characteristic and noise water In flat assessment, accounting of the selected areas in entire image should try one's best greatly, truly to reflect the noise situations of entire image;
After image quality inverting enhancing before processing, the gray average of image flat site should be held essentially constant, if therefore The index is same approximate constant, then shows that image quality inverting enhancing algorithm has stronger rejection ability to noise;
(2) the SNR improving performances towards image non-planar regions signal enhancing are assessed
Roof, road surface, waters, desert flat site and vehicle, house, military affairs are included in remote sensing image, in image Object edge non-planar regions, non-flat forms information provides important evidence for identification target;Therefore, it is proposed to which one kind is specifically designed for figure As the SNR evaluation indexes of non-planar regions signal enhancing, it is defined as:
S N R = m a x ( i , j ) ∈ I σ l o c a l 2 ( i , j ) min ( i , j ) ∈ I σ l o c a l 2 ( i , j ) - - - ( 6 )
Wherein,Represent the local variance of image, i.e., the gray variance calculated in pixel (i, j) neighborhood;I is represented The set of entire image coordinate points;Max () is maximum symbol;Min () is minimum value symbol;
Circular is:Piecemeal is carried out to original image, statistics calculates the local variance in each region in image, find local The corresponding image-region of variance maximum and minimum value;Obviously, the variance of local variance maximum region characterizes image object signal Edge and texture-rich degree, the variance of local variance Minimum Area illustrates noise level;In fact, minimum variance is The noise variance measured in flat site, this is still consistent with traditional noise evaluation method, is by the ratio of the two Signal noise ratio (snr) of image can be obtained.
5. a kind of remote sensing image process performance appraisal procedure according to claim 1, it is characterised in that:The step Four comprise the following steps that:
(1) the ring rejection of remote sensing image Processing Algorithm is assessed based on normalization edge response function
It is that the high frequency of image in a frequency domain is blocked that ring, which should be approximately considered, shows as going out in the neighborhood of gradation of image acute variation The vibration of existing class Gibbs Distribution, i.e. restored image edge ringing effect is usually expressed as:In image border, particularly Grad Larger edge, can occur repeating vibration texture with artwork edge shape identical after recovery in the adjacent edges of image;Image Ringing effect can be reflected by edge response function:
ER x ( d ) = 0.5 + 1 π ∫ 0 ( u x ) [ S n e t ( f x , 0 ) f x × s i n ( 2 πf x d ) ] df x - - - ( 7 )
ER y ( d ) = 0.5 + 1 π ∫ 0 ( u y ) [ S n e t ( 0 , f y ) f y × s i n ( 2 πf y d ) ] df y - - - ( 8 )
Wherein:Snet(fx,fy) represent whole system transmission function;uxRepresent the normalization cutoff frequency of optical system on x directions Rate;uyRepresent the normalization cut-off frequency of optical system on y directions;D represents the position of one horizontal pixel center response of distance; fxAnd fyX and y directions frequency is represented respectively;π is pi;ERxAnd ER (d)y(d) the skirt response letter in x and y directions is referred to respectively Number;
(2) based on the mixed aliasing rejection than assessing remote sensing image Processing Algorithm of letter
Image aliasing is due to that signal has been carried out into periodic continuation in detector sampling process, during continuation, some The information of low frequency may replicate into radio-frequency component, cause frequency aliasing, and these false compositions will be in image processing process In be exaggerated;Image aliasing effect can be reflected by the mixed ratio of letter;
First, find with the strong sub-block of Energy-orientation;Content is less complicated in image but includes the sub-block at edge again simultaneously It is object to be found;Define local contrast Cy(m,n)
C y ( m , n ) = σ y ( m , n ) μ y ( m , n ) - - - ( 9 )
Wherein, μy(m,n)、σy(m, n) is that centered on (m, n), window size is the average and standard of 7 × 7 sub-images respectively Difference, and calculate the variance of correspondence sub-block;The big explanation region of variance is complex, the image side included in the big explanation region of contrast Edge information is more, and variance is small and there is the sub-block region of larger local contrast to be likely to contain substantial amounts of edge;Choose this Sample is met after the sub-block of condition, the sub-block pixel value for the condition that is unsatisfactory for all is zeroed, then finding out the big size of contrast is 64 × 64 sub-block;
Then the direction of each fritter is found out;By low frequency energy and appoint there may be aliasing, and not in the strong direction of energy comparison The influence of what strong aliased portion of medium-high frequency;Accurate direction estimation can accurately find aliased portion in frequency domain;To each small Block is estimated with Blackman-Harris windows travel direction;Calculate the discrete Fourier transform amplitude for 64 × 64 sub-blocks selected Square it is designated as Zp(i, j) (wherein-p/2≤i, j < p/2, p=64), and low frequency is moved into center;Ms(i, j) is as in frequency domain (s, p/2-1) direction template is arrived from (- s ,-p/2+1), wherein variable s values are-p/2 < s < p/2;Ms(i, j) is wide ω=5 Two-value template;Similar establishment aliasing template As(i, j), As(i, j) is the continuation of direction template;Direction finding algorithm is as follows:
Define primary iteration control variable k=1 and initial Q=(i, j) | 3≤| i |, | j |≤α (p/2) };Initial E= ∑(i,j)∈QZp(i,j);Its correspondence direction energy d is calculated each ss, as shown in formula:
d s = Σ ( i , j ) ∈ Q M s ( i , j ) Z p ( i , j ) - - - ( 10 )
If max ds< β E, make kmax=k-1, then terminates, otherwise, will make dsMaximized s saves as s (k);Then will Ms(i, j) and AsThe frequency of (i, j) removes Q;K=k+1 is finally set, top-operation is repeated, through Setup Experiments α=0.4, β= 0.05;
The signal without aliasing is carried out to each sub-block to estimate;In this link, the most strong direction s first found out based on previous step (k) signal energy containing aliasing is estimated, it is M respectively to set two setPAnd AP, it is all k≤k respectivelymaxMs(i, j), AsThe set of (i, j);MPFrequency domain include the very strong signal energy for covering aliased energy;Therefore, the frequency domain of aliased energy measurement Selection is included in APIn without in MPIn;
The energy of isotropic is calculated, from ZpRemoved in (i, j) and be included in MPStrong oriented energy corresponding to middle frequency is obtainedThis constitutes estimation in APIn without in MPIn frequency signal energy Low threshold, high threshold is Zp(i,j); Estimating signal energy It is Zp(i's, j) is each The average value in individual direction;Finally, the ratio between estimating signal and aliasing are:
S A R = 10 log 10 ( Σ { p ∈ P } Σ i , j Z s i g p ( i , j ) Σ { p ∈ P } Σ i , j ( Z p ( i , j ) - Z s i g p ( i , j ) ) ) - - - ( 11 )
Wherein, P is the set of all sub-blocks;The size of the aliasing effect of piece image can be evaluated by SAR.
CN201710165709.0A 2017-03-20 2017-03-20 A kind of remote sensing image process performance appraisal procedure Pending CN106960436A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710165709.0A CN106960436A (en) 2017-03-20 2017-03-20 A kind of remote sensing image process performance appraisal procedure

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710165709.0A CN106960436A (en) 2017-03-20 2017-03-20 A kind of remote sensing image process performance appraisal procedure

Publications (1)

Publication Number Publication Date
CN106960436A true CN106960436A (en) 2017-07-18

Family

ID=59470239

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710165709.0A Pending CN106960436A (en) 2017-03-20 2017-03-20 A kind of remote sensing image process performance appraisal procedure

Country Status (1)

Country Link
CN (1) CN106960436A (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107743226A (en) * 2017-11-06 2018-02-27 潘柏霖 One kind monitors accurate environmental monitoring system
CN107806863A (en) * 2017-11-07 2018-03-16 潘柏霖 A kind of unattended reservoir monitoring system
CN107833433A (en) * 2017-11-06 2018-03-23 龚土婷 A kind of accurate mountain area natural calamity early warning system of early warning
CN107832944A (en) * 2017-11-07 2018-03-23 龚土婷 A kind of natural hybridized orbit monitoring system
CN107862281A (en) * 2017-11-06 2018-03-30 钟永松 A kind of smart city planning system
CN107886234A (en) * 2017-11-07 2018-04-06 钟永松 A kind of efficient Urban Planning System
CN108174060A (en) * 2017-11-23 2018-06-15 珠海格力节能环保制冷技术研究中心有限公司 Processing method, device, storage medium and the processor of focal plane arrays (FPA)
CN108369731A (en) * 2018-02-02 2018-08-03 深圳前海达闼云端智能科技有限公司 Template optimization method and device, electronic equipment and computer program product
CN109376638A (en) * 2018-10-15 2019-02-22 西安建筑科技大学 A kind of literary ground rate calculation method based on remote sensing images and GIS-Geographic Information System
CN109472751A (en) * 2018-10-29 2019-03-15 中国资源卫星应用中心 A kind of remote sensing satellite image processing method enhancing contrast
CN110378275A (en) * 2019-07-15 2019-10-25 易诚高科(大连)科技有限公司 A kind of Algorithm for gait recognition appraisal procedure based on quality dimensions
CN111899261A (en) * 2020-08-31 2020-11-06 西北工业大学 Underwater image quality real-time evaluation method
CN111986082A (en) * 2020-07-22 2020-11-24 中国西安卫星测控中心 Self-adaptive image processing resolution evaluation method
CN112419275A (en) * 2020-11-25 2021-02-26 苏宁金融科技(南京)有限公司 Image quality determination method, device and system
CN112767242A (en) * 2020-12-09 2021-05-07 佛山职业技术学院 Image processing method and device based on frequency domain deconvolution and electronic equipment
CN113630608A (en) * 2020-05-06 2021-11-09 北京君正集成电路股份有限公司 Frequency domain denoising and filtering method
CN113628119A (en) * 2020-05-06 2021-11-09 北京君正集成电路股份有限公司 Method for identifying block to be denoised in image denoising process
CN113726981A (en) * 2021-09-30 2021-11-30 北京耐德佳显示技术有限公司 Image data processing method, electronic device, and storage medium
CN114708432A (en) * 2022-04-02 2022-07-05 广西壮族自治区自然资源遥感院 Weighted measurement method based on rule grid discretization target segmentation region
CN117648451A (en) * 2024-01-30 2024-03-05 青岛漫斯特数字科技有限公司 Data management method, system, device and medium for image processing
CN113630608B (en) * 2020-05-06 2024-05-28 北京君正集成电路股份有限公司 Method for denoising and filtering in frequency domain

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103576165A (en) * 2013-11-08 2014-02-12 中国科学院遥感与数字地球研究所 Intelligent satellite earth observation pattern base acquiring method and system
CN105551019A (en) * 2015-12-03 2016-05-04 哈尔滨工业大学 On-orbit transfer function estimation method based on arbitrary natural scene image

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103576165A (en) * 2013-11-08 2014-02-12 中国科学院遥感与数字地球研究所 Intelligent satellite earth observation pattern base acquiring method and system
CN105551019A (en) * 2015-12-03 2016-05-04 哈尔滨工业大学 On-orbit transfer function estimation method based on arbitrary natural scene image

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
马旭东: "光学遥感影像压缩及融合的质量评价研究", 《中国博士学位论文全文数据库信息科技辑》 *
鲁敏: "遥感图像质量评价方法研究", 《中国优秀硕士学位论文全文数据库信息科技辑》 *

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107743226A (en) * 2017-11-06 2018-02-27 潘柏霖 One kind monitors accurate environmental monitoring system
CN107833433A (en) * 2017-11-06 2018-03-23 龚土婷 A kind of accurate mountain area natural calamity early warning system of early warning
CN107862281A (en) * 2017-11-06 2018-03-30 钟永松 A kind of smart city planning system
CN107806863A (en) * 2017-11-07 2018-03-16 潘柏霖 A kind of unattended reservoir monitoring system
CN107832944A (en) * 2017-11-07 2018-03-23 龚土婷 A kind of natural hybridized orbit monitoring system
CN107886234A (en) * 2017-11-07 2018-04-06 钟永松 A kind of efficient Urban Planning System
CN108174060A (en) * 2017-11-23 2018-06-15 珠海格力节能环保制冷技术研究中心有限公司 Processing method, device, storage medium and the processor of focal plane arrays (FPA)
CN108369731A (en) * 2018-02-02 2018-08-03 深圳前海达闼云端智能科技有限公司 Template optimization method and device, electronic equipment and computer program product
CN109376638A (en) * 2018-10-15 2019-02-22 西安建筑科技大学 A kind of literary ground rate calculation method based on remote sensing images and GIS-Geographic Information System
CN109376638B (en) * 2018-10-15 2022-03-04 西安建筑科技大学 Text-to-ground rate calculation method based on remote sensing image and geographic information system
CN109472751B (en) * 2018-10-29 2021-04-02 中国资源卫星应用中心 Remote sensing satellite image processing method for enhancing contrast
CN109472751A (en) * 2018-10-29 2019-03-15 中国资源卫星应用中心 A kind of remote sensing satellite image processing method enhancing contrast
CN110378275B (en) * 2019-07-15 2023-03-24 易诚高科(大连)科技有限公司 Gait recognition algorithm evaluation method based on quality dimension
CN110378275A (en) * 2019-07-15 2019-10-25 易诚高科(大连)科技有限公司 A kind of Algorithm for gait recognition appraisal procedure based on quality dimensions
CN113630608A (en) * 2020-05-06 2021-11-09 北京君正集成电路股份有限公司 Frequency domain denoising and filtering method
CN113628119A (en) * 2020-05-06 2021-11-09 北京君正集成电路股份有限公司 Method for identifying block to be denoised in image denoising process
CN113630608B (en) * 2020-05-06 2024-05-28 北京君正集成电路股份有限公司 Method for denoising and filtering in frequency domain
CN113628119B (en) * 2020-05-06 2024-05-03 北京君正集成电路股份有限公司 Method for identifying block to be denoised in image denoising process
CN111986082A (en) * 2020-07-22 2020-11-24 中国西安卫星测控中心 Self-adaptive image processing resolution evaluation method
CN111986082B (en) * 2020-07-22 2022-06-21 中国西安卫星测控中心 Self-adaptive image processing resolution evaluation method
CN111899261A (en) * 2020-08-31 2020-11-06 西北工业大学 Underwater image quality real-time evaluation method
CN112419275A (en) * 2020-11-25 2021-02-26 苏宁金融科技(南京)有限公司 Image quality determination method, device and system
CN112767242A (en) * 2020-12-09 2021-05-07 佛山职业技术学院 Image processing method and device based on frequency domain deconvolution and electronic equipment
CN112767242B (en) * 2020-12-09 2023-01-24 佛山职业技术学院 Image processing method and device based on frequency domain deconvolution and electronic equipment
CN113726981B (en) * 2021-09-30 2022-05-17 北京耐德佳显示技术有限公司 Image data processing method, electronic device, and storage medium
CN113726981A (en) * 2021-09-30 2021-11-30 北京耐德佳显示技术有限公司 Image data processing method, electronic device, and storage medium
CN114708432A (en) * 2022-04-02 2022-07-05 广西壮族自治区自然资源遥感院 Weighted measurement method based on rule grid discretization target segmentation region
CN117648451A (en) * 2024-01-30 2024-03-05 青岛漫斯特数字科技有限公司 Data management method, system, device and medium for image processing
CN117648451B (en) * 2024-01-30 2024-04-19 青岛漫斯特数字科技有限公司 Data management method, system, device and medium for image processing

Similar Documents

Publication Publication Date Title
CN106960436A (en) A kind of remote sensing image process performance appraisal procedure
CN103295191B (en) Multiple scale vision method for adaptive image enhancement and evaluation method
CN101727662B (en) SAR image nonlocal mean value speckle filtering method
Ma et al. SAR image despeckling by the use of variational methods with adaptive nonlocal functionals
Saevarsson et al. Combined wavelet and curvelet denoising of SAR images
Schmitt Multiscale and multidirectional multilooking for SAR image enhancement
CN101982835A (en) Level set method for edge detection of SAR images of airport roads
CN101847257A (en) Image denoising method based on non-local means and multi-level directional images
US9892542B2 (en) Creating bump and normal maps from images with multi-scale control
CN110070539A (en) Image quality evaluating method based on comentropy
CN108564597A (en) A kind of video foreground target extraction method of fusion gauss hybrid models and H-S optical flow methods
CN106327451A (en) Image restorative method of ancient animal fossils
CN104657951A (en) Multiplicative noise removal method for image
CN104463814A (en) Image enhancement method based on local texture directionality
CN103700077B (en) A kind of method for adaptive image enhancement based on human-eye visual characteristic
CN101887578B (en) Image impulse noise suppression method based on two-stage interpolation
Ozdarici et al. A comparison of SAR filtering techniques on agricultural area identification
CN101533507B (en) Self-adaptive method for watermarking intensive image texture
CN102722879A (en) SAR (synthetic aperture radar) image despeckle method based on target extraction and three-dimensional block matching denoising
CN104036530A (en) Processing method and device for SAR images
CN106940782A (en) High score SAR based on variogram increases construction land newly and extracts software
CN111476723A (en) Method for recovering lost pixels of remote sensing image with failed L andsat-7 scanning line corrector
CN104951800A (en) Resource exploitation-type area-oriented remote sensing image fusion method
CN111311508B (en) Noise reduction method for pavement crack image with noise
CN104463805B (en) A kind of polarization SAR Approach for Coherent Speckle Reduction based on homogeney significance and set direction

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170718