CN103984746A - Semi-supervised classification and regional distance measurement based SAR (Synthetic Aperture Radar) image identification method - Google Patents

Semi-supervised classification and regional distance measurement based SAR (Synthetic Aperture Radar) image identification method Download PDF

Info

Publication number
CN103984746A
CN103984746A CN201410224797.3A CN201410224797A CN103984746A CN 103984746 A CN103984746 A CN 103984746A CN 201410224797 A CN201410224797 A CN 201410224797A CN 103984746 A CN103984746 A CN 103984746A
Authority
CN
China
Prior art keywords
image
piece
region
query image
query
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410224797.3A
Other languages
Chinese (zh)
Other versions
CN103984746B (en
Inventor
焦李成
唐旭
马文萍
侯小瑾
侯彪
王爽
马晶晶
杨淑媛
刘静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xidian University
Original Assignee
Xidian University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xidian University filed Critical Xidian University
Priority to CN201410224797.3A priority Critical patent/CN103984746B/en
Publication of CN103984746A publication Critical patent/CN103984746A/en
Application granted granted Critical
Publication of CN103984746B publication Critical patent/CN103984746B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Library & Information Science (AREA)
  • Artificial Intelligence (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a semi-supervised classification and regional distance measurement based SAR (Synthetic Aperture Radar) image identification method. The implementation steps of the semi-supervised classification and regional distance measurement based SAR image identification method comprise establishing an image library through original SAR image segmentation and selecting SAR image blocks which are single in target from the image library; extracting feature vectors of the image blocks in the image library; dividing the selected SAR images into a plurality of classes, utilizing the corresponding feature vectors to serve as a training sample, training a semi-supervised classifier and performing classification on the image library through the semi-supervised classifier; obtaining the classes of the query image blocks through the trained classifier, wherein the query image blocks are input by users; calculating a class set of the query image blocks according to a confusion matrix, calculating regional similarity distances between the query image blocks and image blocks and returning the user required number of image blocks according to the order that the distances are from small to large, wherein the image blocks belong to the class set in the image library. According to the semi-supervised classification and regional distance measurement based SAR image identification method, the classification error can be corrected, the information identification accuracy is high, and interpretation can be performed on a plurality of SAR images simultaneously.

Description

The SAR image-recognizing method of estimating based on semi-supervised classification and region distance
Technical field
The invention belongs to technical field of image processing, relate to a kind of recognition methods of SAR image, can be applicable to several SAR images to carry out decipher simultaneously.
Background technology
SAR image is because have round-the-clock, a round-the-clock detectivity, and optical imagery is to the complete ind feature of weather conditions especially relatively, and the expansion progressively of its application, comprises military affairs, agricultural, navigation, geographical monitor etc.Cutting apart of SAR image, denoising, changing detection etc. is all study hotspot field, and an important foundation of these research fields is exactly SAR image recognition.Some traditional recognition technologies are mainly for the problem of accuracy of identification, and are mostly applied to the identification problem of region among a small circle of individual SAR image.But these technology have not obviously met the applied environment that SAR amount of images magnanimity increases instantly.In order to overcome above-mentioned technical disadvantages, the present invention estimates and under the framework of CBIR technology, has proposed a kind of SAR image recognition technology in conjunction with graph theory semi-supervised learning method and improved region distance.This technology realizes simple, not only ensures accuracy of identification but also can meet the application scenarios that a large amount of SAR images are identified simultaneously.
In practical problems, what easily obtain has label data often than without label data much less.In order to solve problems, semi-supervised learning method is arisen at the historic moment.Semi-supervised learning method is the One class learning method between supervised learning and unsupervised learning, and the method has been utilized exemplar simultaneously and without exemplar, utilized whole geometry structure to complete class mark and propagate.In semi-supervised learning field, the semi-supervised learning method based on graph theory was most active research direction in recent years.The most famous and the widely used semi-supervised learning method based on graph theory comprises: minimum blanking method, gaussian random field method etc., respectively referring to A.Blum and S.Chawla.Learning from labeled and unlabeled data using graph mincuts.In Prnceedings of the18th International Conference on Machine Learning.Morgan Kaufmann, San Francisco, CA, 2001.19-26; Zhu, Xiaojin, Zoubin Ghahramani, and John Lafferty. " Semi-supervised learning using gaussian fields and harmonic functions. " ICML.Vol.3.2003.These methods using have label and without label data the summit as figure, the similarity between data is as limit and the weights of connect Vertex, and utilizes the geometrical property of figure to complete class mark from having the data of label to the propagation of the data without label, thereby reaches the object of classification.Because gaussian random field method computation complexity is low, consider the ageing of recognition system, the present invention adopts the method.
CBIR CBIR is that visual signature based on image low level completes in image data base retrieval and query image consistent or similar image collection process in terms of content.This technology comprises a series of image processing method, comprises feature extraction, similarity measurement, user feedback etc.So far, existing a lot of ripe, famous searching system is suggested, as SIMPLIcity searching system, referring to James Z.Wang, Jia Li, Gio Wiederhold.SIMPLIcity:Semantics-Sensitive Integrated Matching for Picture Llbraries.IEEE Trans.on Pattern Analysis and Machine Intelligence, 2001, 23 (9): 947-963, this SIMPLIcity searching system is successfully applied to the natural image search problem of magnanimity, but due to technical limitation and SAR image own characteristic, it is directly applied in SAR image recognition to effect also desirable.The SAR image indexing system of the combination gauss hybrid models classification and for example proposing for 2009, it is GMM searching system, referring to Hou, B., Tang, X., Jiao, L., & Wang, S. (2009, October) .SAR image retrieval based on Gaussian Mixture Model classification.In Synthetic Aperture Radar, 2009.APSAR2009.2nd Asian-Pacific Conference on (pp.796-799) .IEEE, the method is towards SAR image, in retrieving, effectively use textural characteristics, but owing to utilizing supervised classification method to make its popularization ability in realistic problem lower, simultaneously because the similarity matching technique of the method is not considered the feature of SAR image, make retrieval effectiveness unsatisfactory.Although provided outstanding experimental result in this article, but these results depend on the original SAR image of overlapping cutting and set up picture library, the image block that this strategy obtains has the cluster characteristic of height, be that sample separation in same class is very little, inhomogeneous sample separation is very large, such data distribution distributes with the data in practical application, and often difference is large, and the experimental result obtaining can not be verified the validity of its method fully.
Summary of the invention
The object of the invention is the defect existing for above-mentioned prior art, according to the special imaging characteristics of SAR image, under the framework of traditional CBIR, a kind of SAR image-recognizing method of estimating based on semi-supervised classification and improvement region distance is proposed, to reduce the difference that in experimental data and practical application, data distribute, improve the information accuracy of identification in practical application.
The technical scheme that realizes the object of the invention is: use discrete wavelet, resolve the texture information in SAR image, use texture information, utilize Gaussian random field semi-supervised learning method to complete the classification work of SAR image library, and adopt improved regional complex feature similarity matching algorithm to complete the similarity coupling of SAR image.Its specific implementation step comprises as follows:
1) original SAR image is carried out to zero lap cutting, to set up SAR image library { p 1, p 2..., p n, from this image library, select image block { p according to the single principle of target 1, p 2..., p l, wherein l < < N, N represents the SAR image block number in picture library, and l represents the SAR image block number of picking out, and the single principle of described target refers to that in image block, certain target accounts for the over half of total image area;
2) extract the sub belt energy of three layers of conversion of discrete wavelet of all image blocks, as the proper vector of image block { f 1 , f 2 , &CenterDot; &CenterDot; &CenterDot; , f n &OverBar; } , Wherein, n &OverBar; = 10 ;
3) by the SAR image block { p picking out 1, p 2..., p lbe divided into { c according to semantic content i, 1≤i≤k} class, wherein k represents the number of semantic classes, and with characteristic of correspondence vector as training sample, training Gaussian random field semi-supervised classifier, utilizes this sorter to whole SAR image library { p 1, p 2..., p nclassification, obtain having class target SAR image library;
4) the query image piece p ' to user's input, adopting and step 2) identical method extracts its proper vector f ', and use and step 3) identical training sample and the Gaussian random field semi-supervised classifier training, the classification that obtains query image piece is counted c i;
5) according to step 4) classification that obtains counts c iand experience confusion matrix, calculate query image piece classification set c}:
5a) in classified SAR image library, pick out the front K width image block of each class, form new image pattern collection, from then on random choose training sample training Gaussian random field semi-supervised classifier in sample set, carry out 100 random assortments with this sorter and test, obtain experience confusion matrix Con ∈ R k × k, confusion matrix Con is square formation, wherein i capable j row Con (i, j) represent to belong to c ithe sample of class is divided into c jthe number of class, 1≤i≤k, 1≤j≤k;
5b) experience confusion matrix is carried out to row normalization, the each element in being listed as by, divided by the summation of this column element, obtains the posterior probability Matrix C onP ∈ R of experience k × k;
5c) threshold value T is set, by the capable j row of the i ConP (i in posterior probability matrix, j) compare with threshold value T, in the time of ConP (i, j)≤T, by ConP (i, j) be set to 0, otherwise ConP (i, j) remains unchanged, the size of threshold value T is set according to the nonzero element number of each row of expecting;
5d) count c according to the classification of query image piece i, the position of searching nonzero element in the i row in posterior probability Matrix C onP, finally obtains classification set { c};
6) calculate in query image piece p ' and picture library and belong to the classification set { region distance of all image blocks in c};
7) according to step 6) region distance that obtains, return to order from small to large the image that user needs quantity, complete image recognition.
The present invention has the following advantages compared with prior art:
1, the present invention, owing to creating SAR image library with non-overlapping cutting method, reduces the gap of test sample book and real data, has increased the confidence level of recognition result;
2, the present invention, owing to adopting Gaussian random field semi-supervised learning method to classify to picture library, has reduced the workload of hand picking training sample, has reduced the impact of artificial subjective factor on classification results;
3, the present invention, owing to adopting the strategy of correcting classification error, has effectively reduced the impact of classification error on similarity coupling;
4, the present invention is directed to SAR image singularity, improved the similarity measure of regional complex feature, make SAR image similarity matching result more accurate, improved accuracy of identification.
Brief description of the drawings
Fig. 1 is realization flow schematic diagram of the present invention;
Fig. 2 is for setting up the original SAR image of SAR image library in the present invention;
Fig. 3 is the SAR image block sample figure that the present invention picks out in SAR picture library;
Fig. 4 is the present invention and GMM searching system overall performance comparison diagram;
Fig. 5 is the present invention and the performance comparison diagram of GMM searching system in each semantic classes.
Embodiment
With reference to Fig. 1, specific implementation step of the present invention is as follows:
Step 1, sets up SAR image library { p 1, p 2..., p n, and select SAR image block according to the single principle of target.
Being implemented as follows of this step:
1a) select pixel size to be followed successively by 19035 × 7330,7082 × 7327 2 width large scale SAR images, as the original SAR image of setting up picture library, respectively as Fig. 2 (a), shown in Fig. 2 (b);
1b) 2 selected original SAR images are carried out to non-overlapping cutting, after cutting, obtain size and be 256 × 256 2828 width SAR image blocks, set up SAR image library { p with this 1, p 2..., p n, wherein N=2828;
1c) in image library, select SAR image block { p according to the single principle of target 1, p 2..., p l, wherein l < < N, the SAR image block number in N presentation video storehouse, l represents the SAR image block number of picking out, the single principle of described target refers to that in image block, certain target accounts for the over half of total image area.The present invention, in the time selecting, has selected 28 width SAR image blocks, i.e. l=28 altogether.
Step 2, carries out feature extraction to all image blocks in picture library.
Select the sub belt energy ξ of three layers of conversion of discrete wavelet as the proper vector of image block wherein, the dimension of representation feature vector, this example is selected but be not limited to 10.To a certain subband, energy definition is:
&xi; = ( &Sigma; n 1 = 1 m 1 &Sigma; n 2 = 1 m 2 b ( n 1 , n 2 ) 2 ) 1 2 / ( m 1 &times; m 2 ) - - - < 1 >
Wherein, m 1× m 2for subband size, (n 1, n 2) represent the index of this sub-band coefficients, b (n 1, n 2) represent n in this subband 1row n 2the coefficient value of row, the energy of all the other 9 subbands calculates according to <1> formula.
Step 3, to whole SAR image library { p 1, p 2..., p nclassification, obtain having class target SAR image library.
Being implemented as follows of this step:
3a) in the l width SAR image block of having picked out, carry out artificial semantic classification, this example adopts the strategy of area percentage to judge image category, even in a sub-picture piece p, and c ithe total area size of class object exceedes 50% of this total image area, just specifies that this is c as piece p iclass, l width SAR image block people is for being divided into mountain region, ocean, city, suburb totally 4 classes the most at last, each class 7 width image block.As shown in Figure 3, wherein Fig. 3 (a) is mountain region to master drawing, and Fig. 3 (b) is ocean, and Fig. 3 (c) is city, Fig. 3 (d) suburb;
3b) according to each class image block, the sub belt energy feature of three layers of conversion of corresponding one group of discrete wavelet, obtain 4 stack features vectors, and using this 4 stack features vector as training sample, utilize Gaussian random field semi-supervised learning sorter to carry out the classification of SAR image library:
The energy feature of the 28 width image blocks of 3b1) picking out by step 1 is as there being exemplar { (x 1, y 1) ... (x l, y l), with the energy feature that remains 2800 width SAR image blocks in SAR image library as without exemplar { x l+1... x l+u; with having exemplar and without exemplar foundation figure G=(V, E), wherein l < < u; u indicates the number without exemplar; l+u=N, N represents the number of total sample, the summit of V presentation graphs G; the limit of E presentation graphs G; and l=28, u=2800, N=2828;
3b2) try to achieve the similar matrix W of figure G according to formula <2>,
W = ( &omega; ~ i ~ , j ~ ) N &times; N , &omega; ~ i ~ , j ~ = exp ( - &Sigma; d ~ = 1 n &OverBar; ( x i ~ d ~ - x j ~ d ~ ) 2 &sigma; d ~ 2 ) - - - < 2 >
Wherein, represent similar matrix W the row the element of row, the dimension of presentation video block eigenvector, represent sample dimension component, represent sample dimension component, the super parameter of dimension, 1 &le; i ~ &le; N , 1 &le; j ~ &le; N , 1 &le; d ~ &le; n &OverBar; , n &OverBar; = 10 ;
3b3) according to the energy function of formula <3> structural map G:
E ( f s ) = &infin; &Sigma; i ~ ( f s ( i ~ ) - y i ~ ) 2 + 1 2 &Sigma; i ~ , j ~ &omega; ~ i ~ , j ~ ( f s ( i ~ ) - f s ( j ~ ) ) 2 - - - < 3 >
Wherein, E (f s) energy function of presentation graphs G, indicate the real function of exemplar on figure G, indicate the real function on figure G without exemplar, represent functional value, the similar matrix W of presentation graphs G row the element of row, 1 &le; i ~ &le; N , 1 &le; j ~ &le; N ;
3b4) solve energy function E (f s) optimum solution argminE (f s), obtain classification results, the final classification results that is 2828 width image blocks in image library is mountain region 1143 width successively, ocean 748 width, city 344 width, suburb 593 width, amount to 2828 width SAR image blocks, the target of this step is that SAR image library is become and has class target SAR image library, to reduce the workload of similarity coupling, improves recognition speed.
Step 4, classifies to the query image piece p ' of user's input.
Being implemented as follows of this step:
4a) adopt the method identical with step 2 to extract the proper vector f ' of query image piece p ';
4b) use the training sample identical with step 3 and Gaussian random field semi-supervised classifier, the classification that obtains query image piece p ' is counted c i.
Step 5, in order to reduce the impact of classification error on recognition result, the classification obtaining according to step 4 is counted c iand experience confusion matrix, the classification set { c} of calculating query image piece p '.
Being implemented as follows of this step:
5a) in classified SAR image library, pick out the front 100 width image blocks of each class, form new image pattern collection, from then on random choose training sample training Gaussian random field semi-supervised classifier in sample set, carrying out 100 random assortments with this sorter tests, wherein the ratio of training sample and test sample book is 1:99, thereby obtains experience confusion matrix Con ∈ R k × k, confusion matrix Con is square formation, wherein i capable j row Con (i, j) represent to belong to c ithe sample of class is divided into c jthe number of class, 1≤i≤k, 1≤j≤k, k represents semantic classes number, and R represents real number field, and table 1 has provided experience confusion matrix Con ∈ R k × ksample, wherein semantic classes number k=4, is respectively mountain region, ocean, city, suburb, each numeric representation belongs to c ithe sample of class is divided into c jthe number of class, for example Con (1,1) represents that the number that the sample that belongs to mountain region is divided into mountain region is 41;
100 random assortments of table 1 are tested the confusion matrix obtaining
Con∈R k×k Mountain region Ocean City Suburb
Mountain region 41 20 0 38
Ocean 6 93 0 0
City 0 0 97 2
Suburb 26 0 13 60
5b) to experience confusion matrix Con ∈ R k × kcarry out row normalization, be about to a wherein each element being listed as and, divided by the summation of this column element, obtain the posterior probability Matrix C onP ∈ R of experience k × k.Table 2 has provided posterior probability Matrix C onP ∈ R k × ksample, wherein semantic classes number k=4, is respectively mountain region, ocean, city, suburb, each numerical value is the experience confusion matrix Con ∈ R that his-and-hers watches 1 provide k × kcarry out that row normalization obtains;
The posterior probability matrix of table 2 experience
ConP∈R k×k Mountain region Ocean City Suburb
Mountain region 0.5616 0.1770 0 0.3800
Ocean 0.0822 0.8230 0 0
City 0 0 0.8818 0.0200
Suburb 0.3562 0 0.1182 0.6000
5c) threshold value T is set, by posterior probability Matrix C onP ∈ R k × kin the capable j row of i ConP (i, j) compare with threshold value T, in the time of ConP (i, j)≤T, by ConP (i, j) be set to 0, otherwise ConP (i, j) remains unchanged, the size of threshold value T is set according to the nonzero element number of each row of expecting, this example is established T=0.1, and table 3 has provided the posterior probability Matrix C onP ∈ R after threshold process k × ksample, wherein semantic classes number k=4, is respectively mountain region, ocean, city, suburb, each numerical value is the posterior probability Matrix C onP ∈ R that his-and-hers watches 2 provide k × kcarry out that threshold process obtains;
Posterior probability matrix after table 3 threshold process
ConP∈R k×k Mountain region Ocean City Suburb
Mountain region 0.5616 0.1770 0 0.3800
Ocean 0 0.8230 0 0
City 0 0 0.8818 0
Suburb 0.3562 0 0.1182 0.6000
5d) count c according to the classification of query image piece i, the position of searching nonzero element in the i row in posterior probability Matrix C onP, finally obtains classification set { c}.
Step 6, calculates in query image piece p ' and picture library and belongs to the classification set { region distance of all image blocks in c}.
Being implemented as follows of this step:
6a) for image block p and query image piece p ', respectively taking 4 × 4 area size as unit, calculate the high-frequency sub-band energy of discrete wavelet one deck conversion and gray feature and use as cutting apart feature, utilize adaptive k-means algorithm to carry out cluster to cutting apart feature, obtain the texture region collection R1={r of image block p 1, r 2..., r h... r mand the texture region collection R of query image piece p ' 2=r ' 1, r ' 2..., r ' o... r ' n, r h, r ' oeach region after presentation video piece p and query image piece p ' utilize textural characteristics to cut apart respectively, wherein 1≤h≤m, 1≤o≤n, the number of the texture region of m presentation video piece p, n represents the number of the texture region of query image piece p ';
In order to make the adaptive work of k-means algorithm, this example adopts following two kinds of strategies to complete adaptive k-means to cut apart:
6a1) to divergence D (num) setting threshold T num=0.035, wherein D (num) is defined as follows:
D ( num ) = &Sigma; i &OverBar; = 1 L min 1 &le; j &OverBar; &le; num ( X i &OverBar; - X ^ j &OverBar; ) 2 , 1 &le; i &OverBar; &le; L , 1 &le; j &OverBar; &le; num - - - < 4 >
In formula, num represents cluster number, and L represents to cut apart Characteristic Number, represent a certain proper vector of cutting apart, represent the cluster centre of a certain class, the value of num increases progressively since 2, as D (num) < T numtime, num stops increasing progressively, and cluster number num determines, on the contrary the value of num increases by 1;
6a2) cluster number num is arranged to upper limit num max=5, as num > num maxtime, num stops increasing progressively, and cluster number num determines, on the contrary the value of num increases by 1;
6b) according to the distance d (r between formula <5> computed image piece p and query image piece p ' texture region h, r ' o),
Wherein, for texture region r in image block p haveraged feature vector, for the middle texture region r ' of query image piece p ' oaveraged feature vector, for the weight coefficient of each vector, wherein and
6c) for image block p and query image piece p ', utilize Prewitt operator and binary segmentation method to obtain the fringe region collection RE of image block p 1={ re vand the fringe region collection RE of query image piece p ' 2=re ' z, re v, re ' zeach region after presentation video piece p and query image piece p ' utilize edge feature to cut apart respectively, wherein 1≤v≤2,1≤z≤2;
6c1) set Prewitt operator:
Wherein λ=4, g yrepresent the edge detection operator of vertical direction, g xrepresent respectively the edge detection operator of horizontal direction;
6c2) according to Prewitt operator, the marginal information of computed image piece p vertical direction and the marginal information of horizontal direction respectively:
G y = p &CircleTimes; g y , G x = p &CircleTimes; g x - - - < 7 >
Wherein, G ythe marginal information of presentation video piece p vertical direction, G xthe marginal information of presentation video piece p horizontal direction, represent linear convolution;
6c3) according to the marginal information G of image block p vertical direction ymarginal information G with horizontal direction x, the edge feature f of computed image piece p e:
f E = ( G y ) 2 + ( G x ) 2 - - - < 8 >
Utilize binary segmentation method edge feature f ecut apart and obtain fringe region collection;
6d) according to the distance d (re between formula <9> computed image piece p and query image piece p ' fringe region v, re ' z):
d ( re v , re z &prime; ) = &Sigma; kk = 1 2 &omega;e kk ( fe kk - fe kk &prime; ) 2 - - - < 9 >
Wherein, kk=1,2, in the time of kk=1, fe kkfor fringe region re in image block p vcharacteristics of mean, fe ' kkfor the middle fringe region re ' of query image piece p ' zcharacteristics of mean; In the time of kk=2, fe kkfor fringe region re in image block p vvariance feature, fe ' kkfor the middle fringe region re ' of query image piece p ' zvariance feature, ω e kkfor the weight coefficient of each vector, and &Sigma; kk = 1 2 &omega;e kk = 1 ;
6e) according to the Significance factors s mating between formula <10> computed image piece p and the each texture region of query image piece p ' h,o,
&Sigma; o = 1 n s h , o = P h , h = 1 , &CenterDot; &CenterDot; &CenterDot; , m &Sigma; h = 1 m s h , o = P o &prime; , o = 1 , &CenterDot; &CenterDot; &CenterDot; , n - - - < 10 >
Wherein, P hfor texture region r in image block p haccount for the area percentage of image block, P ' ofor the middle texture region r ' of query image piece p ' oaccount for the area percentage of query image piece, the number of the texture region of m presentation video piece p, n represents the number of the texture region of query image piece p ';
6f) according to the Significance factors s mating between formula <11> computed image piece p and the each fringe region of query image piece p ' v,z,
&Sigma; z = 1 2 s v , z = P v , v = 1 , 2 &Sigma; v = 1 2 s v , z = P z &prime; , z = 1 , 2 - - - < 11 >
Wherein, P vfor fringe region re in image block p vaccount for the area percentage of image block, P ' zfor the middle fringe region re ' of query image piece p ' zaccount for the area percentage of query image piece;
6g) according to the Significance factors s mating between texture region h,o, the Significance factors s mating between fringe region v,z, the distance d (r between texture region h, r ' o), the distance d (re between fringe region v, re ' z), obtain the region distance d of query image piece p ' and image block p according to formula <12>,
d=ω 1×dT(R 1,R 2)+ω 2×dE(RE 1,RE 2),ω 12=1 <12>
Wherein, presentation video piece p and the distance of query image piece p ' based on texture region, 1≤h≤m, 1≤o≤n; presentation video piece p and the distance of query image piece p ' based on fringe region, 1≤v≤2,1≤z≤2; ω 1represent dT (R 1, R 2) weights, ω 2represent dE (RE 1, RE 2) weights;
6h) by step 6a) to 6g) method, calculate in query image piece p ' and picture library and belong to the classification set { region distance of all image blocks in c}.
Step 7, the region distance obtaining according to step 6, returns to order from small to large the image that user needs quantity, completes image recognition.
Effect of the present invention can further illustrate by following emulation:
1. simulated conditions
This Case Simulation condition is as follows: CORE i5 3.2GHz PC Windows 7 operating systems, Matlab2012 operation platform.
2. emulation content and result
100 width SAR image blocks are chosen at random in emulation 1. from image library, respectively the SAR image block of choosing are identified to emulation by the present invention and GMM searching system, calculate the ensemble average precision ratio of simulation result, and result as shown in Figure 4.Wherein, precision ratio precision is defined as follows:
precision=n c/n s <13>
In formula, n cthe image block number satisfying condition in the image block that expression system is returned, n sthe image block number that expression system is returned.The image block quantity that in Fig. 4, transverse axis method for expressing returns, the longitudinal axis represents average precision.
As can be seen from Figure 4, ensemble average accuracy of identification of the present invention is wanted excellent and GMM searching system.
100 width SAR image blocks are chosen at random in emulation 2. from image library, respectively the SAR image block of choosing is identified to emulation by the present invention and GMM searching system, calculate the precision ratio of each semantic classes in simulation result, as shown in Figure 5, wherein require to return to image block quantity is 35 to result.Transverse axis represents each semantic classes, and the longitudinal axis represents precision ratio.
As can be seen from Figure 5, every kind of semantic classes, accuracy of identification of the present invention is wanted excellent and GMM searching system.
Can be illustrated by above experiment, on for SAR problem of image recognition, no matter the present invention is overall precision ratio or the precision ratio of each semantic classes, all be better than existing GMM searching system.

Claims (6)

1. a SAR image-recognizing method of estimating based on semi-supervised classification and region distance, comprises the steps:
1) original SAR image is carried out to zero lap cutting, to set up SAR image library { p 1, p 2..., p n, from this image library, select image block { p according to the single principle of target 1, p 2..., p l, wherein l < < N, N represents the SAR image block number in picture library, and l represents the SAR image block number of picking out, and the single principle of described target refers to that in image block, certain target accounts for the over half of total image area;
2) extract the sub belt energy of three layers of conversion of discrete wavelet of all image blocks, as the proper vector of image block wherein, n &OverBar; = 10 ;
3) by the SAR image block { p picking out 1, p 2..., p lbe divided into { c according to semantic content i, 1≤i≤k} class, wherein k represents the number of semantic classes, and with characteristic of correspondence vector as training sample, training Gaussian random field semi-supervised classifier, utilizes this sorter to whole SAR image library { p 1, p 2..., p nclassification, obtain having class target SAR image library;
4) the query image piece p ' to user's input, adopting and step 2) identical method extracts its proper vector f ', and use and step 3) identical training sample and the Gaussian random field semi-supervised classifier training, the classification that obtains query image piece is counted c i;
5) according to step 4) classification that obtains counts c iand experience confusion matrix, calculate query image piece classification set c}:
5a) in classified SAR image library, pick out the front K width image block of each class, form new image pattern collection, from then on random choose training sample training Gaussian random field semi-supervised classifier in sample set, carry out 100 random assortments with this sorter and test, obtain experience confusion matrix Con ∈ R k × k, confusion matrix Con is square formation, wherein i capable j row Con (i, j) represent to belong to c ithe sample of class is divided into c jthe number of class, 1≤i≤k, 1≤j≤k;
5b) experience confusion matrix is carried out to row normalization, the each element in being listed as by, divided by the summation of this column element, obtains the posterior probability Matrix C onP ∈ R of experience k × k;
5c) threshold value T is set, by the capable j row of the i ConP (i in posterior probability matrix, j) compare with threshold value T, in the time of ConP (i, j)≤T, by ConP (i, j) be set to 0, otherwise ConP (i, j) remains unchanged, the size of threshold value T is set according to the nonzero element number of each row of expecting;
5d) count c according to the classification of query image piece i, the position of searching nonzero element in the i row in posterior probability Matrix C onP, finally obtains classification set { c};
6) calculate in query image piece p ' and picture library and belong to the classification set { region distance of all image blocks in c};
7) according to step 6) region distance that obtains, return to order from small to large the image that user needs quantity, complete image recognition.
2. SAR image-recognizing method according to claim 1, wherein step 6) belong in described calculating query image piece p ' and picture library classification set the region distance of all image blocks in c}, carry out as follows:
6a) for image block p and query image piece p ', respectively taking 4 × 4 area size as unit, calculate the high-frequency sub-band energy of discrete wavelet one deck conversion and gray feature and use as cutting apart feature, utilize adaptive k-means algorithm to carry out cluster to cutting apart feature, obtain the texture region collection R of image block p 1={ r 1, r 2..., r h... r mand the texture region collection R of query image piece p ' 2=r ' 1, r ' 2..., r ' o... r ' n, r h, r ' oeach region after presentation video piece p and query image piece p ' utilize textural characteristics to cut apart respectively, wherein 1≤h≤m, 1≤o≤n, the number of the texture region of m presentation video piece p, n represents the number of the texture region of query image piece p ';
6b) distance d (the r between computed image piece p and query image piece p ' texture region h, r ' o);
6c) for image block p and query image piece p ', utilize Prewitt operator and binary segmentation method to obtain the fringe region collection RE of image block p 1={ re vand the fringe region collection RE of query image piece p ' 2=re ' z, re v, re ' zeach region after presentation video piece p and query image piece p ' utilize edge feature to cut apart respectively, wherein 1≤v≤2,1≤z≤2;
6d) distance d (the re between computed image piece p and query image piece p ' fringe region v, re ' z);
Significance factors s 6e) mating between computed image piece p and the each texture region of query image piece p ' h,o, the Significance factors s mating between image block p and the each fringe region of query image piece p ' v, z;
6f) according to the Significance factors s mating between texture region h,o, the Significance factors s mating between fringe region v,z, the distance d (r between texture region h, r ' o), the distance d (re between fringe region v, re ' z), obtain the region distance d of query image piece p ' and image block p:
d=ω 1×dT(R 1,R 2)+ω 2×dE(RE 1,RE 2),ω 12=1,
Wherein, presentation video piece p and the distance of query image piece p ' based on texture region, 1≤h≤m, 1≤o≤n; presentation video piece p and the distance of query image piece p ' based on fringe region, 1≤v≤2,1≤z≤2; ω 1represent dT (R 1, R 2) weights, ω 2represent dE (RE 1, RE 2) weights;
6g) by step 6a) to 6f) method, calculate in query image piece p ' and picture library and belong to the classification set { region distance of all image blocks in c}.
3. SAR image-recognizing method according to claim 2, wherein said step 6b) in distance d (r between computed image piece p and query image piece p ' texture region h, r ' o), calculate by following formula:
Wherein, for texture region r in image block p haveraged feature vector, for the middle texture region r ' of query image piece p ' oaveraged feature vector, for the weight coefficient of each vector, wherein and
4. SAR image-recognizing method according to claim 2, wherein said step 6d) in distance d (re between computed image piece p and query image piece p ' fringe region v, re ' z), calculate by following formula:
d ( re v , re z &prime; ) = &Sigma; kk = 1 2 &omega;e kk ( fe kk - fe kk &prime; ) 2 ,
Wherein, kk=1,2, in the time of kk=1, fe kkfor fringe region re in image block p vcharacteristics of mean, fe ' kkfor the middle fringe region re ' of query image piece p ' zcharacteristics of mean; In the time of kk=2, fe kkfor fringe region re in image block p vvariance feature, fe ' kkfor the middle fringe region re ' of query image piece p ' zvariance feature, ω e kkfor the weight coefficient of each vector, and
5. SAR image-recognizing method according to claim 2, wherein said step 6e) in the Significance factors s that mates between computed image piece p and the each texture region of query image piece p ' h,o, calculate by following formula:
&Sigma; o = 1 n s h , o = P h , h = 1 , &CenterDot; &CenterDot; &CenterDot; , m &Sigma; h = 1 m s h , o = P o &prime; , o = 1 , &CenterDot; &CenterDot; &CenterDot; , n ,
Wherein, P hfor texture region r in image block p haccount for the area percentage of image block, P ' ofor the middle texture region r ' of query image piece p ' oaccount for the area percentage of query image piece, the number of the texture region of m presentation video piece p, n represents the number of the texture region of query image piece p '.
6. SAR image-recognizing method according to claim 2, wherein said step 6e) in the Significance factors s that mates between computed image piece p and the each fringe region of query image piece p ' respectively v,z, calculate by following formula:
&Sigma; z = 1 2 s v , z = P v , v = 1 , 2 &Sigma; v = 1 2 s v , z = P z &prime; , z = 1 , 2 ,
Wherein, P vfor fringe region re in image block p vaccount for the area percentage of image block, P ' zfor the middle fringe region re ' of query image piece p ' zaccount for the area percentage of query image piece.
CN201410224797.3A 2014-05-26 2014-05-26 Based on the SAR image recognition methodss that semisupervised classification and region distance are estimated Active CN103984746B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410224797.3A CN103984746B (en) 2014-05-26 2014-05-26 Based on the SAR image recognition methodss that semisupervised classification and region distance are estimated

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410224797.3A CN103984746B (en) 2014-05-26 2014-05-26 Based on the SAR image recognition methodss that semisupervised classification and region distance are estimated

Publications (2)

Publication Number Publication Date
CN103984746A true CN103984746A (en) 2014-08-13
CN103984746B CN103984746B (en) 2017-03-29

Family

ID=51276719

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410224797.3A Active CN103984746B (en) 2014-05-26 2014-05-26 Based on the SAR image recognition methodss that semisupervised classification and region distance are estimated

Country Status (1)

Country Link
CN (1) CN103984746B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104217438A (en) * 2014-09-19 2014-12-17 西安电子科技大学 Image significance detection method based on semi-supervision
CN106021362A (en) * 2016-05-10 2016-10-12 百度在线网络技术(北京)有限公司 Query picture characteristic representation generation method and device, and picture search method and device
CN107169532A (en) * 2017-06-14 2017-09-15 北京航空航天大学 A kind of car networking fuel consumption data method for evaluating quality based on wavelet analysis and semi-supervised learning
CN109034853A (en) * 2017-06-09 2018-12-18 北京京东尚科信息技术有限公司 Similar users method, apparatus, medium and electronic equipment are found based on seed user
CN109740671A (en) * 2019-01-03 2019-05-10 北京妙医佳信息技术有限公司 A kind of image-recognizing method and device
CN110874584A (en) * 2019-11-21 2020-03-10 河北工业大学 Blade fault diagnosis method based on improved prototype clustering
CN113963322A (en) * 2021-10-29 2022-01-21 北京百度网讯科技有限公司 Detection model training method and device and electronic equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101299243A (en) * 2008-06-27 2008-11-05 西安电子科技大学 Method of image segmentation based on immune spectrum clustering
CN101515369A (en) * 2009-04-02 2009-08-26 西安电子科技大学 Multiscale SAR image segmentation method based on semi-supervised learning
CN103456019A (en) * 2013-09-08 2013-12-18 西安电子科技大学 Image segmentation method of semi-supervised kernel k-mean clustering based on constraint pairs

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101299243A (en) * 2008-06-27 2008-11-05 西安电子科技大学 Method of image segmentation based on immune spectrum clustering
CN101515369A (en) * 2009-04-02 2009-08-26 西安电子科技大学 Multiscale SAR image segmentation method based on semi-supervised learning
CN103456019A (en) * 2013-09-08 2013-12-18 西安电子科技大学 Image segmentation method of semi-supervised kernel k-mean clustering based on constraint pairs

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
A.BLUM: "Learning from Labeled and Unlabeled Data using Graph Mincuts", 《PROCEEDINGS OF THE EIGHTEENTH INTERNATIONAL CONFERENCE ON MACHINE LEARNING 》 *
BIAO HOU: "SAR Image Retrieval Based on Gaussian Mixture Model Classification", 《SYNTHETIC APERTURE RADER,2009.APSAR 2009.2ND ASIAN-PACIFIC CONFERENCE ON》 *
JAMES Z. WANG: "SIMPLIcity:Semantics-Sensitive integrated Matching for Picture LIbraries", 《IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE》 *
S.P.GOU: "An Analysis of the Eigenvalues Method for Polarimetric SAR Image Classification", 《GEOSCIENCE AND REMOTE SENSING SYMPOSIUM(IGARSS),2011 IEEE INTERNATIONAL》 *
XIAOJIN ZHU: "Semi-supervised learning using gaussian fields and harmonic functions", 《PROCEEDINGS OF THE TWENTIETH INTERNATIONAL CONFERENCE ON MACHINE LEARNING(ICML-2003)》 *
唐旭: "基于高斯混合模型分类的SAR图像检索", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104217438A (en) * 2014-09-19 2014-12-17 西安电子科技大学 Image significance detection method based on semi-supervision
CN104217438B (en) * 2014-09-19 2017-03-01 西安电子科技大学 Based on semi-supervised image significance detection method
CN106021362A (en) * 2016-05-10 2016-10-12 百度在线网络技术(北京)有限公司 Query picture characteristic representation generation method and device, and picture search method and device
CN106021362B (en) * 2016-05-10 2018-04-13 百度在线网络技术(北京)有限公司 Generation, image searching method and the device that the picture feature of query formulation represents
CN109034853A (en) * 2017-06-09 2018-12-18 北京京东尚科信息技术有限公司 Similar users method, apparatus, medium and electronic equipment are found based on seed user
CN107169532A (en) * 2017-06-14 2017-09-15 北京航空航天大学 A kind of car networking fuel consumption data method for evaluating quality based on wavelet analysis and semi-supervised learning
CN107169532B (en) * 2017-06-14 2020-07-03 北京航空航天大学 Internet of vehicles fuel consumption data quality evaluation method based on wavelet analysis and semi-supervised learning
CN109740671A (en) * 2019-01-03 2019-05-10 北京妙医佳信息技术有限公司 A kind of image-recognizing method and device
CN109740671B (en) * 2019-01-03 2021-02-23 北京妙医佳信息技术有限公司 Image identification method and device
CN110874584A (en) * 2019-11-21 2020-03-10 河北工业大学 Blade fault diagnosis method based on improved prototype clustering
CN113963322A (en) * 2021-10-29 2022-01-21 北京百度网讯科技有限公司 Detection model training method and device and electronic equipment
CN113963322B (en) * 2021-10-29 2023-08-25 北京百度网讯科技有限公司 Detection model training method and device and electronic equipment

Also Published As

Publication number Publication date
CN103984746B (en) 2017-03-29

Similar Documents

Publication Publication Date Title
Ranjan et al. Learning to count everything
CN103984746A (en) Semi-supervised classification and regional distance measurement based SAR (Synthetic Aperture Radar) image identification method
CN102903122B (en) Video object tracking method based on feature optical flow and online ensemble learning
CN102324038B (en) Plant species identification method based on digital image
CN104966081B (en) Spine image-recognizing method
CN106408030A (en) SAR image classification method based on middle lamella semantic attribute and convolution neural network
CN108764019A (en) A kind of Video Events detection method based on multi-source deep learning
CN108171119B (en) SAR image change detection method based on residual error network
CN110751027B (en) Pedestrian re-identification method based on deep multi-instance learning
CN104484890A (en) Video target tracking method based on compound sparse model
CN105989336A (en) Scene recognition method based on deconvolution deep network learning with weight
CN103971106A (en) Multi-view human facial image gender identification method and device
Chen et al. Locating crop plant centers from UAV-based RGB imagery
CN113902901B (en) Object separation method and system based on lightweight detection
CN111598155A (en) Fine-grained image weak supervision target positioning method based on deep learning
CN102930294A (en) Chaotic characteristic parameter-based motion mode video segmentation and traffic condition identification method
CN108734200A (en) Human body target visible detection method and device based on BING features
CN110263644A (en) Classifying Method in Remote Sensing Image, system, equipment and medium based on triplet&#39;s network
CN103413154A (en) Human motion identification method based on normalized class Google measurement matrix
Li et al. An aerial image segmentation approach based on enhanced multi-scale convolutional neural network
CN104331711B (en) SAR image recognition methods based on multiple dimensioned fuzzy mearue and semi-supervised learning
Liu et al. An improved lightweight network based on deep learning for grape recognition in unstructured environments
Ataş Performance Evaluation of Jaccard-Dice Coefficient on Building Segmentation from High Resolution Satellite Images
Sun et al. Deep learning based pedestrian detection
CN102129570B (en) Method for designing manifold based regularization based semi-supervised classifier for dynamic vision

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant