CN103020978A - SAR (synthetic aperture radar) image change detection method combining multi-threshold segmentation with fuzzy clustering - Google Patents
SAR (synthetic aperture radar) image change detection method combining multi-threshold segmentation with fuzzy clustering Download PDFInfo
- Publication number
- CN103020978A CN103020978A CN2012105964061A CN201210596406A CN103020978A CN 103020978 A CN103020978 A CN 103020978A CN 2012105964061 A CN2012105964061 A CN 2012105964061A CN 201210596406 A CN201210596406 A CN 201210596406A CN 103020978 A CN103020978 A CN 103020978A
- Authority
- CN
- China
- Prior art keywords
- representing
- pixel
- membership
- threshold segmentation
- pixels
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000008859 change Effects 0.000 title claims abstract description 91
- 230000011218 segmentation Effects 0.000 title claims abstract description 57
- 238000001514 detection method Methods 0.000 title claims abstract description 55
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 37
- 238000000034 method Methods 0.000 claims abstract description 34
- 239000002245 particle Substances 0.000 claims abstract description 33
- 238000005457 optimization Methods 0.000 claims abstract description 17
- 238000010606 normalization Methods 0.000 claims abstract description 10
- 238000001914 filtration Methods 0.000 claims abstract description 6
- 230000006870 function Effects 0.000 claims description 17
- 239000011159 matrix material Substances 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 5
- 230000010354 integration Effects 0.000 claims description 4
- 238000005259 measurement Methods 0.000 claims description 4
- 230000007547 defect Effects 0.000 abstract description 3
- 238000004088 simulation Methods 0.000 description 20
- 230000000694 effects Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 238000010835 comparative analysis Methods 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 238000006424 Flood reaction Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000010367 cloning Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Landscapes
- Image Analysis (AREA)
Abstract
The invention discloses an SAR (synthetic aperture radar) image change detection method combining multi-threshold segmentation with fuzzy clustering. The method mainly aims at overcoming the defect of existing fuzzy clustering algorithms and is used for SAR image change detection by combining multi-threshold segmentation with fuzzy clustering. The implementation steps of the method include: (1), subjecting two SAR images to median filtering; (2), calculating to obtain a logarithmic ratio differential image after normalization; (3), adopting the Otsu method based on standard particle swarm optimization to perform multi-threshold segmentation to the logarithmic ratio differential image after normalization; (4), initializing membership matrixes U0 and U1; (5), adopting the FLICM (fuzzy local information C-means) algorithm to perform fuzzy clustering to pixels which cannot be determined whether changes occur or not after multi-threshold segmentation; (6), deblurring; and (7), outputting change detection results. The multi-threshold segmentation and fuzzy clustering are combined for SAR image change detection, so that change detection time is reduced, and change detection accuracy is improved.
Description
Technical Field
The invention belongs to the technical field of computers, and further relates to an SAR image change detection method combining multi-threshold segmentation and fuzzy clustering in the technical field of image processing. The SAR image change detection method based on the fuzzy clustering obtains the difference image from the two SAR images with different time phases, then performs multi-threshold segmentation and fuzzy clustering on the difference image, realizes SAR image change detection, and can be used in the fields of ground object coverage and utilization, natural disaster monitoring and evaluation, city planning, map updating and the like.
Background
Synthetic Aperture Radar (SAR) technology has become more and more widely used in recent years. Compared with the common optical remote sensing image, the SAR image has the characteristic of all-weather acquisition, and along with the continuous improvement of the resolution of the SAR image, more and more image processing technologies are provided based on the SAR image. The image change detection technology is used for obtaining the landform change information of the area in two periods by comparing and analyzing two remote sensing images of the same area at different times. At present, a change detection technology based on SAR images has been applied more, such as forest coverage change, natural disaster monitoring and evaluation and the like.
There are roughly two approaches to how to find the varying regions from the two SAR images: one is a comparison after classification method, namely, different SAR images are classified respectively, and then the classified results are compared to find out a changed area; the other method is to obtain the difference images of different SAR images from different SAR images and analyze the difference images to find the change area, and the latter method is applied to a plurality of methods at present. The processing of the difference image is actually to perform a two-class division on the difference image, so that a clustering algorithm can be used for solving the problem of the classification of the difference image.
The Fuzzy C-Means (FCM) algorithm is one of the most popular clustering algorithms, and is characterized in that uncertainty description of sample classes is established by adopting a Fuzzy theory, membership degrees of the samples to all clustering centers are obtained by optimizing an objective function, and then the class of each sample is judged. However, since the FCM does not consider the spatial information of the samples, it is sensitive to noise, and the clustering effect is affected. The Fuzzy Local information C-Means (FLICM) algorithm is a relatively new clustering algorithm, and is improved aiming at the defect that FCM is relatively sensitive to noise, and the Local spatial information of samples is introduced into a clustering objective function, so that a better clustering effect than FCM is achieved, but the calculation of neighborhood information is increased for all samples, and the calculation amount is larger compared with FCM.
The patent of the seian university of electronic technology "method for detecting SAR image change based on quantum immune cloning" (patent application No. 201010230980.6, publication No. CN101908213A), which defines a cluster center by quantum bits, searches for an optimal cluster center and obtains a global threshold, but has a disadvantage that only an objective function of FCM is used to construct an antibody affinity function, and neighborhood information of pixels is not considered.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, and combines multi-threshold segmentation and fuzzy clustering for SAR image change detection so as to reduce the change detection time and improve the change detection precision.
In order to achieve the purpose, when the change detection is carried out, the invention firstly uses multi-threshold segmentation to judge the category of the simple pixels, and then the rest difficult pixels are reserved for the FLICM fuzzy clustering algorithm to be judged.
The invention comprises the following steps:
(1) median filtering
Selecting a common 3 x 3 median filter to preprocess the two SAR images to be detected to obtain two median-filtered images;
(2) obtaining a normalized logarithmic ratio difference image
2a) Calculating a logarithmic ratio difference image from the two median-filtered images by adopting a logarithmic ratio difference formula;
2b) carrying out normalization processing on the log ratio difference image by adopting a normalization formula to obtain a normalized log ratio difference image;
(3) multi-threshold segmentation
And performing multi-threshold segmentation on the normalized logarithmic ratio difference image by adopting an Otsu method based on standard particle swarm optimization, wherein pixels in the segmented image are divided into three types: pixels that have not changed, pixels that have changed, and pixels that cannot determine whether a change has occurred;
(4) initializing membership matrix
4a) Initializing membership matrix U0,U0Storing membership degree of pixel under non-variable class, wherein the membership degree is in interval [0, 1 ]]The real number of the up value is used for representing that the pixel which is not changed after multi-threshold segmentation is in U0The membership degree in (1) is selected, and after multi-threshold segmentation, the membership degree belongs to the changed pixels in U0The membership degree in (1) is 0, and after multi-threshold segmentation, the pixel which can not determine whether change occurs is in U0The membership degree in (1) is randomly generated;
4b) initializing membership matrix U1,U1Storing the membership degree of the pixel under the variation class, wherein the membership degree is in the interval [0, 1 ]]The real number of the up value is used for representing that the pixel which is not changed after multi-threshold segmentation is in U1The membership degree in (1) is 0, and after multi-threshold segmentation, the membership degree belongs to the changed pixels in U1The membership degree in (1) is 1, and after multi-threshold segmentation, the pixel which can not determine whether the change occurs belongs to U1The degree of membership in (1) is then equal to 1 minus the pixel in U0Degree of membership in (1);
(5) fuzzy clustering
Performing fuzzy clustering on pixels which cannot determine whether change occurs after multi-threshold segmentation by using an FLICM (flash memory integration control algorithm), and performing iterative updating until a preset termination condition is reached, namely the maximum change of membership degrees before and after iteration is less than 0.00001;
(6) deblurring
According to the membership value of each pixel in the normalized log ratio difference image, which is subordinate to a non-change class and a change class, the pixel is judged to be the class with a larger membership value, so that all the pixels in the normalized log ratio difference image are divided into two classes: a non-change class and a change class;
(7) and outputting a change detection result.
Compared with the prior art, the invention has the following advantages:
1. the method firstly judges the category of the simple pixels by utilizing multi-threshold segmentation, and then reserves the rest difficult pixels for the FLICM algorithm to judge, and compared with the prior FLICM algorithm which directly clusters and judges the pixels, the method reduces the operation amount and the running time of change detection.
2. When the invention uses FLICM algorithm to carry out fuzzy clustering, the local window NiThe classes of some non-central pixels in the image are determined in a multi-threshold segmentation stage, and the determined neighborhood information improves the fuzzy clustering effect in the prior art, so that the change detection precision is further improved.
Drawings
FIG. 1 is a flow chart of the present invention;
FIG. 2 is a result of change detection performed on a floods SAR image in an Ottawa area in a simulation experiment;
FIG. 3 shows the result of SAR image variation detection of fire in Mexico area in simulation experiment;
fig. 4 is a result of change detection performed on the Bern urban flood SAR image in the simulation experiment.
Detailed Description
Referring to fig. 1, the method for detecting the change of the SAR image by combining multi-threshold segmentation and fuzzy clustering in the invention comprises the following steps:
(1) median filtering
Selecting a common 3 x 3 median filter to preprocess the two SAR images to be detected to obtain two median-filtered images;
(2) obtaining a normalized logarithmic ratio difference image
2a) And solving a log ratio difference image from the two median-filtered images by adopting a log ratio difference formula as follows:
I3=|log(I1+1)-log(I2+1)|
wherein, I3Representing pixel gray values of a logarithmic ratio difference image, I1And I2Respectively representing pixel gray values of the two images after median filtering;
2b) carrying out normalization processing on the log ratio difference image by adopting a normalization formula as follows to obtain a normalized log ratio difference image:
wherein, IDTo representNormalized pixel gray value, I, of log ratio difference image3Representing pixel gray values of a logarithmic ratio difference image, ImaxIs represented by3Middle maximum gray value, IminIs represented by3The smallest gray value;
(3) multi-threshold segmentation
Performing multi-threshold segmentation on the normalized logarithm ratio difference image by adopting an Otsu method based on standard particle swarm optimization, wherein pixels in the segmented image are divided into three types: pixels that have not changed, pixels that have changed, and pixels that cannot determine whether a change has occurred;
the specific steps of multi-threshold segmentation are as follows:
3a) encoding n thresholds for segmenting the image as one n-dimensional particle in a standard particle swarm optimization;
3b) using a standard particle swarm optimization search to maximize the objective function of Otsu's method by n thresholds, the Otsu's objective function is as follows:
Maximize σ2=ω0(μ0-μT)2+ω1(μ1-μT)2+...+ωn(μn-μT)2
the normalized logarithmic ratio difference image may be divided into n +1 parts by n thresholds, in the above formula, σ2Represents the variance, ω, between the n +1 parts0,ω1,...,ωnRespectively representing the probability of occurrence of the respective portions, mu0,μ1,…,μnRespectively representing the mean value of the gray levels, mu, of the respective partsTA gray level average value representing the entire image;
the updating formula of the d-dimension flight speed of the particles in the standard particle swarm optimization is as follows:
wherein,representing the d-dimensional flight velocity of the ith particle in the population, omega representing the inertial weight, c1And c2Which represents a factor of learning that is,representing the d-dimensional position of the ith particle in the population,andis two independent random numbers, pBest, uniformly distributed between 0 and 1iIs the historical optimum position of the ith particle, and gBest is the historical optimum position of the whole population;
the updating formula of the d-dimension position of the particle in the standard particle swarm optimization is as follows:
wherein,representing the d-dimensional position of the ith particle in the population,representing the d-dimension flight speed of the ith particle in the population;
3c) through the search of standard particle swarm optimization, n thresholds which enable the Otsu method objective function to be maximum are found, the n thresholds divide the logarithmic ratio difference image after normalization into n +1 parts, and the parts are recorded as follows according to the sequence of gray values from small to large: c0,C1,...,Cn. Handle C0The pixels in (A) are classified as unchanged pixels, and C is setnThe pixels in (A) are classified as changed pixels, and C is set1To Cn-1The pixels in the image are classified into pixels which can not determine whether the change occurs, so that the pixels in the normalized logarithmic ratio difference image are divided into three types;
(4) initializing membership matrix
4a) Initializing membership matrix U0,U0Storing membership degree of pixel under non-variable class, wherein the membership degree is in interval [0, 1 ]]The real number of the up value is used for representing that the pixel which is not changed after multi-threshold segmentation is in U0The membership degree in (1) is selected, and after multi-threshold segmentation, the membership degree belongs to the changed pixels in U0The membership degree in (1) is 0, and after multi-threshold segmentation, the membership degree cannot be determined whether to send or notChanged pixel is in U0The membership degree in (1) is randomly generated;
4b) initializing membership matrix U1,U1Storing the membership degree of the pixel under the variation class, wherein the membership degree is in the interval [0, 1 ]]The real number of the up value is used for representing that the pixel which is not changed after multi-threshold segmentation is in U1The membership degree in (1) is 0, and after multi-threshold segmentation, the membership degree belongs to the changed pixels in U1The membership degree in (1) is 1, and after multi-threshold segmentation, the pixel which can not determine whether the change occurs belongs to U1The degree of membership in (1) is then equal to 1 minus the pixel in U0Degree of membership in (1);
(5) fuzzy clustering
Performing fuzzy clustering on pixels which cannot determine whether change occurs after multi-threshold segmentation by using an FLICM (flash memory integration control algorithm), and performing iterative updating until a preset termination condition is reached, namely the maximum change of membership degrees before and after iteration is less than 0.00001;
5a) the FLICM algorithm uses membership degree to represent the degree of possible pixel belonging to a certain class, and simultaneously considers image gray information and spatial neighborhood information in the clustering process, and the target function of the FLICM is as follows:
wherein J represents an objective function value, N represents a set of pixels which cannot be determined whether change occurs after multi-threshold segmentation, C is the number of classes with a value of 2, and u is the number of classes with a value of 2kiRepresenting degree of membership, x, of the ith pixel in the kth classiRepresenting the gray value of the ith pixel, vkDenotes the cluster center of the kth class, d2(xi,vk) Represents the distance measure from the ith pixel to the cluster center of the kth class, m represents a fuzzy weighting index with a value of 2, GkiRepresents the blurring coefficient between the ith pixel and the cluster center of the kth class, which is defined as follows:
wherein G iskiRepresenting the blurring coefficient between the i-th pixel and the cluster center of the k-th class, NiRepresenting a local window of size 3 x 3, x, centered on the ith pixeljThe gray value of the jth pixel is shown and falls into the local window NiV is a non-central pixel ofkDenotes the cluster center of the kth class, ukjRepresenting degree of membership of the jth pixel in the kth class, eijRepresenting the spatial Euclidean distance, d, between the ith and jth pixels2(xj,vk) Representing the distance measurement from the jth pixel to the kth class of clustering center, and m representing a fuzzy weighting index with a value of 2;
5b) the FLICM algorithm adopts an iterative calculation mode to obtain a group of membership values which enable the objective function to be minimum, and the iterative calculation formula of the membership in the FLICM algorithm is as follows:
wherein u iskiRepresenting the degree of membership of the ith pixel in the kth class, C being the number of classes taking the value 2, xiRepresenting the gray value of the ith pixel, vkRepresenting the cluster center of the kth class, vtDenotes the cluster center of the t-th class, GkiRepresenting the blurring coefficient between the i-th pixel and the cluster center of the k-th class, GtiRepresenting the blurring coefficient between the ith pixel and the cluster center of the t-th class, d2(xi,vk) Representing a distance measure of the ith pixel to the cluster center of the kth class, d2(xi,vt) Representing the distance measurement from the ith pixel to the clustering center of the t-th class, wherein m represents a fuzzy weighting index with the value of 2;
5c) the iterative calculation formula of the clustering center in the FLICM algorithm is as follows:
wherein v iskRepresenting the cluster center of the kth class, N representing a set of pixels that cannot be determined whether a change has occurred after multi-threshold segmentation, ukiRepresenting degree of membership, x, of the ith pixel in the kth classiExpressing the gray value of the ith pixel, and m represents a fuzzy weighting index with the value of 2;
(6) deblurring
According to the membership value of each pixel in the normalized log ratio difference image, which is subordinate to a non-change class and a change class, the pixel is judged to be the class with a larger membership value, so that all the pixels in the normalized log ratio difference image are divided into two classes: a non-change class and a change class;
(7) and outputting a change detection result.
The effect of the invention can be further illustrated by the following simulation experiment:
1. simulation experiment conditions
Simulation experiment environment: the operating system is Windows XP, the CPU is AMD Athlon1.60GHz, the memory is 1.75GB, and the programming platform is Visual C + + 6.0.
The simulation experiment is that the SAR image change detection of flood in Ottawa area is 290 × 350, the image size is shown in FIG. 2(a) as SAR image in 5 months 1997, FIG. 2(b) as SAR image in 8 months 1997, FIG. 2(c) as the corresponding change detection reference image, FIG. 2(d) as the change detection result of FCM algorithm, FIG. 2(e) as the change detection result of FLICM algorithm, and FIG. 2(f) as the change detection result of the invention.
The second simulation experiment is the change detection of the SAR image of a fire in the mexico region, the image size is 512 × 512, fig. 3(a) is the SAR image of 4 months in 2000, fig. 3(b) is the SAR image of 5 months in 2002, fig. 3(c) is a change detection reference map, fig. 3(d) is the change detection result of the FCM algorithm, fig. 3(e) is the change detection result of the FLICM algorithm, and fig. 3(f) is the change detection result of the present invention.
The third simulation experiment is the change detection of the SAR image in Bern urban flood, the image size is 301 × 301, fig. 4(a) is the SAR image in 4 months 1999, fig. 4(b) is the SAR image in 5 months 1999, fig. 4(c) is the change detection reference map, fig. 4(d) is the change detection result of the FCM algorithm, fig. 4(e) is the change detection result of the FLICM algorithm, and fig. 4(f) is the change detection result of the present invention.
2. Contents and results of simulation experiments
The parameters in the simulation experiment were set as follows: the threshold number n of the multi-threshold segmentation is set to be 3 (the selected basis is given in the parameter analysis simulation experiment of the threshold number later); in the invention, two learning factors of the standard particle swarm optimization are set to be 2.0, the inertia weight is linearly reduced from 0.9 to 0.4 along with the searching process, and the termination condition of the standard particle swarm optimization is that the evaluation frequency of the objective function reaches 5000 times; in the simulation experiment, the termination conditions of the fuzzy clustering process in the three methods are set to be that the maximum change of membership degrees before and after iteration is less than 0.00001. The data in the following simulation experiments are the average results of 20 independent runs.
Simulation experiment I: the results of the three methods for detecting the change in this problem are shown in FIGS. 2(d) to (f), and the specific comparative analysis of the results is shown in Table 1. As can be seen from FIG. 2, the detection results of the present invention are most similar to the reference image. As can be seen from Table 1, the number of missed pixels is 1246 and 1309 less than FCM and FLICM, respectively, and the total number of error pixels is 1003 and 372 less than the two, respectively. Meanwhile, as can be seen from the aspect of running time, although the multi-threshold segmentation process is added, the task amount of fuzzy clustering later is reduced, so that the running time is still much faster than that of clustering by directly using the FLICM algorithm.
TABLE 1Ottawa regional flood disaster change detection results
And (2) simulation experiment II: the results of the three methods for detecting the change in this problem are shown in FIGS. 3(d) to (f), and the specific comparative analysis of the results is shown in Table 2. As can be seen from Table 2, the number of missing pixels is 623 and 530 less than that of FCM and FLICM, respectively, and the total number of error pixels is 149 and 383 less than that of FCM and FLICM, respectively. The invention organically combines multi-threshold segmentation only considering gray information and an FLICM algorithm mainly considering neighborhood information, improves the anti-noise performance, greatly reduces the number of missed detections and ensures that the overall detection performance is superior to that of the two compared methods. Also from Table 2, it can be seen that the runtime of the present invention is about 30% of the FLICM algorithm.
TABLE 2 Mexico area fire change detection results
And (3) simulation experiment III: the results of the three methods for detecting the change in this problem are shown in FIGS. 4(d) to (f), and the specific comparative analysis of the results is shown in Table 3. As can be seen from table 3, for the change detection problem, the present invention still has a significant advantage in the number of missed detections, so the total number of error pixels is also small, only 112, the error detection rate is only 0.12%, and the running time is also short, and is less than 25% of the flimc algorithm.
TABLE 3Bern urban flood change test results
The average run time reduction of the present invention in the above three sets of simulation experiments was calculated to be about 70% lower than the FLICM algorithm using the following formula:
where T represents the reduction ratio of the runtime of the present invention compared to the FLICM algorithm, T1Represents the running time, T, of the invention2Representing the runtime of the FLICM algorithm.
3. Threshold number of parametric analysis simulation experiments
The selection of the number n of thresholds when performing multi-threshold segmentation in the present invention has a large influence on the effect of change detection. In order to select the size of the threshold number n reasonably, the threshold number n is subjected to parameter analysis, the method of the invention is independently operated for 10 times under different threshold numbers, and the detection result after averaging is shown in table 4. As can be seen from table 4, the threshold number n being too small will significantly increase the false detection rate of change detection; an excessive threshold number n causes an increase in the operation time. Taking the threshold number n to be 3 is a reasonable choice after comprehensive consideration.
TABLE 4 results of parameter analysis simulation experiments for threshold number n in the present invention
Claims (5)
1. A SAR image change detection method combining multi-threshold segmentation and fuzzy clustering comprises the following steps:
(1) median filtering
Selecting a common 3 x 3 median filter to preprocess the two SAR images to be detected to obtain two median-filtered images;
(2) obtaining a normalized logarithmic ratio difference image
2a) Calculating a logarithmic ratio difference image from the two median-filtered images by adopting a logarithmic ratio difference formula;
2b) carrying out normalization processing on the log ratio difference image by adopting a normalization formula to obtain a normalized log ratio difference image;
(3) multi-threshold segmentation
And performing multi-threshold segmentation on the normalized logarithmic ratio difference image by adopting an Otsu method based on standard particle swarm optimization, wherein pixels in the segmented image are divided into three types: pixels that have not changed, pixels that have changed, and pixels that cannot determine whether a change has occurred;
(4) initializing membership matrix
4a) Initializing membership matrix U0,U0Storing membership degree of pixel under non-variable class, wherein the membership degree is in interval [0, 1 ]]The real number of the up value is used for representing that the pixel which is not changed after multi-threshold segmentation is in U0The membership degree in (1) is selected, and after multi-threshold segmentation, the membership degree belongs to the changed pixels in U0The membership degree in (1) is 0, and after multi-threshold segmentation, the pixel which can not determine whether change occurs is in U0The membership degree in (1) is randomly generated;
4b) initializing membership matrix U1,U1Storing the membership degree of the pixel under the variation class, wherein the membership degree is in the interval [0, 1 ]]The real number of the up value is used for representing that the pixel which is not changed after multi-threshold segmentation is in U1The membership degree in (1) is 0, and after multi-threshold segmentation, the membership degree belongs to the changed pixels in U1The membership degree in (1) is 1, and after multi-threshold segmentation, the pixel which can not determine whether the change occurs belongs to U1The degree of membership in (1) is then equal to 1 minus the pixel in U0Degree of membership in (1);
(5) fuzzy clustering
Performing fuzzy clustering on pixels which cannot determine whether change occurs after multi-threshold segmentation by using an FLICM (flash memory integration control algorithm), and performing iterative updating until a preset termination condition is reached, namely the maximum change of membership degrees before and after iteration is less than 0.00001;
(6) deblurring
According to the membership value of each pixel in the normalized log ratio difference image, which is subordinate to a non-change class and a change class, the pixel is judged to be the class with a larger membership value, so that all the pixels in the normalized log ratio difference image are divided into two classes: a non-change class and a change class;
(7) and outputting a change detection result.
2. The method for detecting changes in SAR images combining multi-threshold segmentation and fuzzy clustering according to claim 1, wherein the logarithmic ratio difference formula in step 2a) is as follows:
I3=|log(I1+1)-log(I2+1)|
wherein, I3Representing pixel gray values of a logarithmic ratio difference image, I1And I2Respectively representing the pixel gray values of the two images after median filtering.
3. The method for detecting changes in SAR images combining multi-threshold segmentation and fuzzy clustering according to claim 1, wherein the normalization formula in step 2b) is as follows:
wherein, IDRepresenting pixel gray values, I, of the normalized log ratio difference image3Representing pixel gray values of a logarithmic ratio difference image, ImaxIs represented by3Zhongji (Chinese character of 'Zhongji')Large gray value, IminIs represented by3The smallest gray value.
4. The SAR image change detection method combining multi-threshold segmentation and fuzzy clustering according to claim 1, characterized in that the step (3) of performing multi-threshold segmentation on the normalized logarithmic ratio difference image based on the Otsu method of standard particle swarm optimization comprises the following specific steps:
the method comprises the steps of firstly, encoding n thresholds used for segmenting an image into one n-dimensional particle in standard particle swarm optimization;
secondly, using standard particle swarm optimization search to make the maximum n thresholds of the Otsu method objective function, wherein the Otsu method objective function is as follows:
Maximize σ2=ω0(μ0-μT)2+ω1(μ1-μT)2+...+ωn(μn-μT)2
the normalized logarithmic ratio difference image may be divided into n +1 parts by n thresholds, in the above formula, σ2Represents the variance, ω, between the n +1 parts0,ω1,...,ωnRespectively representing the probability of occurrence of the respective portions, mu0,μ1,...,μnRespectively representing the mean value of the gray levels, mu, of the respective partsTA gray level average value representing the entire image;
the updating formula of the d-dimension flight speed of the particles in the standard particle swarm optimization is as follows:
wherein,representing the d-dimensional flight velocity of the ith particle in the population, omega representing the inertial weight, c1And c2Which represents a factor of learning that is,representing the d-dimensional position of the ith particle in the population,andis two independent random numbers, pBest, uniformly distributed between 0 and 1iIs the historical optimum position of the ith particle, and gBest is the historical optimum position of the whole population;
the updating formula of the d-dimension position of the particle in the standard particle swarm optimization is as follows:
wherein,representing the d-dimensional position of the ith particle in the population,representing the d-dimension flight speed of the ith particle in the population;
thirdly, finding n thresholds which enable the Otsu method target function to be maximum through searching of standard particle swarm optimization, dividing the normalized logarithmic ratio difference image into n +1 parts by the n thresholds, and recording the parts as follows according to the sequence of gray values from small to large: c0,C1,...,Cn(ii) a Handle C0The pixels in (A) are classified as unchanged pixels, and C is setnThe pixels in (A) are classified as changed pixels, and C is set1To Cn-1The pixels in (1) are classified as pixels that cannot be determined whether a change has occurred, and thus the pixels in the normalized logarithmic ratio difference image are classified into three types.
5. The SAR image change detection method combining multi-threshold segmentation and fuzzy clustering according to claim 1, characterized in that the implementation of the FLICM fuzzy clustering algorithm in step (5) is as follows:
the FLICM algorithm uses membership degree to represent the degree of possible pixel belonging to a certain class, and simultaneously considers image gray information and spatial neighborhood information in the clustering process, and the target function of the FLICM is as follows:
wherein J represents an objective function value, N represents a set of pixels which cannot be determined whether change occurs after multi-threshold segmentation, C is the number of classes with a value of 2, and u is the number of classes with a value of 2kiRepresenting degree of membership, x, of the ith pixel in the kth classiRepresenting the gray value of the ith pixel, vkDenotes the cluster center of the kth class, d2(xi,vk) Represents the distance measure from the ith pixel to the cluster center of the kth class, m represents a fuzzy weighting index with a value of 2, GkiRepresents the blurring coefficient between the ith pixel and the cluster center of the kth class, which is defined as follows:
wherein G iskiRepresenting the blurring coefficient between the i-th pixel and the cluster center of the k-th class, NiRepresenting a local window of size 3 x 3, x, centered on the ith pixeljThe gray value of the jth pixel is shown and falls into the local window NiV is a non-central pixel ofkDenotes the cluster center of the kth class, ukjRepresenting degree of membership of the jth pixel in the kth class, eijRepresenting the spatial Euclidean distance, d, between the ith and jth pixels2(xj,vk) Representing the distance measurement from the jth pixel to the kth class of clustering center, and m representing a fuzzy weighting index with a value of 2;
the FLICM algorithm adopts an iterative calculation mode to obtain a group of membership values which enable the objective function to be minimum, and the iterative calculation formula of the membership in the FLICM algorithm is as follows:
wherein u iskiRepresenting the degree of membership of the ith pixel in the kth class, C being the number of classes taking the value 2, xiRepresenting the gray value of the ith pixel, vkRepresenting the cluster center of the kth class, vtDenotes the cluster center of the t-th class, GkiRepresenting the blurring coefficient between the i-th pixel and the cluster center of the k-th class, GtiRepresenting the blurring coefficient between the ith pixel and the cluster center of the t-th class, d2(xi,vk) Representing a distance measure of the ith pixel to the cluster center of the kth class, d2(xi,vt) Representing the distance measurement from the ith pixel to the clustering center of the t-th class, wherein m represents a fuzzy weighting index with the value of 2;
the iterative calculation formula of the clustering center in the FLICM algorithm is as follows:
wherein v iskRepresenting the cluster center of the kth class, N representing a set of pixels that cannot be determined whether a change has occurred after multi-threshold segmentation, ukiRepresenting degree of membership, x, of the ith pixel in the kth classiExpressing the gray value of the ith pixel, and m represents a fuzzy weighting index with the value of 2;
and carrying out fuzzy clustering on pixels which cannot determine whether change occurs after multi-threshold segmentation by using an FLICM (flash memory integration) algorithm until a preset termination condition is reached, namely the maximum change of membership degrees before and after iteration is less than 0.00001.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210596406.1A CN103020978B (en) | 2012-12-14 | 2012-12-14 | SAR (synthetic aperture radar) image change detection method combining multi-threshold segmentation with fuzzy clustering |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210596406.1A CN103020978B (en) | 2012-12-14 | 2012-12-14 | SAR (synthetic aperture radar) image change detection method combining multi-threshold segmentation with fuzzy clustering |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103020978A true CN103020978A (en) | 2013-04-03 |
CN103020978B CN103020978B (en) | 2015-07-15 |
Family
ID=47969544
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201210596406.1A Expired - Fee Related CN103020978B (en) | 2012-12-14 | 2012-12-14 | SAR (synthetic aperture radar) image change detection method combining multi-threshold segmentation with fuzzy clustering |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103020978B (en) |
Cited By (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103218823A (en) * | 2013-05-08 | 2013-07-24 | 西安电子科技大学 | Remote sensing image change detection method based on nuclear transmission |
CN103413316A (en) * | 2013-08-24 | 2013-11-27 | 西安电子科技大学 | SAR image segmentation method based on superpixels and optimizing strategy |
CN103458242A (en) * | 2013-07-02 | 2013-12-18 | 北京京北方信息技术有限公司 | Method for compressing and uncompressing image based on color classification and cluster |
CN103700109A (en) * | 2013-12-24 | 2014-04-02 | 西安电子科技大学 | Synthetic aperture radar (SAR) image change detection method based on multi-objective evolutionary algorithm based on decomposition (MOEA/D) and fuzzy clustering |
CN103810699A (en) * | 2013-12-24 | 2014-05-21 | 西安电子科技大学 | SAR (synthetic aperture radar) image change detection method based on non-supervision depth nerve network |
CN104408482A (en) * | 2014-12-08 | 2015-03-11 | 电子科技大学 | Detecting method for high-resolution SAR (Synthetic Aperture Radar) image object |
CN105118065A (en) * | 2015-09-14 | 2015-12-02 | 中国民航大学 | Polari SAR (metric synthetic aperture radar) image variation detection method of wavelet domain polarization distance transformation |
CN106204608A (en) * | 2016-07-17 | 2016-12-07 | 西安电子科技大学 | On-line talking SAR image change detection based on sample local density |
CN106203521A (en) * | 2016-07-15 | 2016-12-07 | 西安电子科技大学 | Based on disparity map from the SAR image change detection of step study |
CN106842349A (en) * | 2015-12-03 | 2017-06-13 | 北京国网富达科技发展有限责任公司 | Transmission line of electricity external force damage prevention detection method and device |
CN106971402A (en) * | 2017-04-21 | 2017-07-21 | 西安电子科技大学 | A kind of SAR image change detection aided in based on optics |
CN107240119A (en) * | 2017-04-19 | 2017-10-10 | 北京航空航天大学 | Utilize the method for improving the fuzzy clustering algorithm extraction uneven infrared pedestrian of gray scale |
CN107256409A (en) * | 2017-05-22 | 2017-10-17 | 西安电子科技大学 | The High Resolution SAR image change detection method detected based on SAE and conspicuousness |
CN107423771A (en) * | 2017-08-04 | 2017-12-01 | 河海大学 | A kind of two phase method for detecting change of remote sensing image |
CN107437091A (en) * | 2016-03-23 | 2017-12-05 | 西安电子科技大学 | Multilayer limits the positive and negative class change detecting method of SAR image of Boltzmann machine |
CN107610155A (en) * | 2016-07-12 | 2018-01-19 | 香港理工大学深圳研究院 | SAR remote sensing imagery change detection method and devices |
CN108038851A (en) * | 2017-12-11 | 2018-05-15 | 中国科学技术大学 | A kind of radar image difference detecting method based on feedback and iteration |
CN108873901A (en) * | 2018-06-27 | 2018-11-23 | 深圳市创艺工业技术有限公司 | A kind of Unmanned Systems |
CN109893100A (en) * | 2019-04-18 | 2019-06-18 | 盐城工学院 | A kind of method that breast density quantification calculates in breast cancer risk assessment |
CN110648348A (en) * | 2019-09-30 | 2020-01-03 | 重庆邮电大学 | Quantum image segmentation method based on NEQR expression |
CN111091569A (en) * | 2019-10-31 | 2020-05-01 | 重庆邮电大学 | Local parameter self-adaptive industrial CT image segmentation method |
CN112348750A (en) * | 2020-10-27 | 2021-02-09 | 西安电子科技大学 | SAR image change detection method based on threshold fusion and neighborhood voting |
CN113408370A (en) * | 2021-05-31 | 2021-09-17 | 西安电子科技大学 | Forest change remote sensing detection method based on adaptive parameter genetic algorithm |
CN113420658A (en) * | 2021-04-30 | 2021-09-21 | 中国电子科技集团公司第十四研究所 | SAR image sea-land segmentation method based on FCM clustering and OTSU segmentation |
CN114066815A (en) * | 2021-10-21 | 2022-02-18 | 西安理工大学 | SAR image change detection method based on fuzzy c-means clustering |
CN115601364A (en) * | 2022-12-14 | 2023-01-13 | 惠州威尔高电子有限公司(Cn) | Golden finger circuit board detection method based on image analysis |
CN116385866A (en) * | 2023-02-09 | 2023-07-04 | 中国铁道科学研究院集团有限公司铁道建筑研究所 | SAR image-based railway line color steel house change detection method and device |
CN116563312A (en) * | 2023-07-11 | 2023-08-08 | 山东古天电子科技有限公司 | Method for dividing display image of double-screen machine |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6622118B1 (en) * | 2001-03-13 | 2003-09-16 | Alphatech, Inc. | System and method for comparing signals |
CN102509288A (en) * | 2011-10-19 | 2012-06-20 | 西安电子科技大学 | SAR (Synthetic Aperture Radar) image change detection method based on Memetic kernel clustering |
-
2012
- 2012-12-14 CN CN201210596406.1A patent/CN103020978B/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6622118B1 (en) * | 2001-03-13 | 2003-09-16 | Alphatech, Inc. | System and method for comparing signals |
CN102509288A (en) * | 2011-10-19 | 2012-06-20 | 西安电子科技大学 | SAR (Synthetic Aperture Radar) image change detection method based on Memetic kernel clustering |
Non-Patent Citations (3)
Title |
---|
MAOGUO GONG等: "Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering", 《IEEE TRANSACTIONS ON IMAGE PROCESSING》, vol. 21, no. 4, 30 April 2012 (2012-04-30), pages 2141 - 2151 * |
YILIU等: "Optimal Multilevel Thresholding Using the Modified Adaptive Particle Swarm Optimization", 《INTERNATIONAL JOURNAL OF DIGITAL CONTENT TECHNOLOGY AND ITS APPLICATIONS》, vol. 6, no. 15, 31 August 2012 (2012-08-31), pages 208 - 219 * |
陈富龙等: "SAR变化检测技术发展综述", 《遥感技术与应用》, vol. 22, no. 1, 28 February 2007 (2007-02-28), pages 109 - 115 * |
Cited By (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103218823B (en) * | 2013-05-08 | 2016-04-13 | 西安电子科技大学 | Based on the method for detecting change of remote sensing image that core is propagated |
CN103218823A (en) * | 2013-05-08 | 2013-07-24 | 西安电子科技大学 | Remote sensing image change detection method based on nuclear transmission |
CN103458242B (en) * | 2013-07-02 | 2016-12-28 | 京北方信息技术股份有限公司 | Method for compressing image based on color classification Yu cluster |
CN103458242A (en) * | 2013-07-02 | 2013-12-18 | 北京京北方信息技术有限公司 | Method for compressing and uncompressing image based on color classification and cluster |
CN103413316B (en) * | 2013-08-24 | 2016-03-02 | 西安电子科技大学 | Based on the SAR image segmentation method of super-pixel and optimisation strategy |
CN103413316A (en) * | 2013-08-24 | 2013-11-27 | 西安电子科技大学 | SAR image segmentation method based on superpixels and optimizing strategy |
CN103810699B (en) * | 2013-12-24 | 2017-01-11 | 西安电子科技大学 | SAR (synthetic aperture radar) image change detection method based on non-supervision depth nerve network |
CN103810699A (en) * | 2013-12-24 | 2014-05-21 | 西安电子科技大学 | SAR (synthetic aperture radar) image change detection method based on non-supervision depth nerve network |
CN103700109A (en) * | 2013-12-24 | 2014-04-02 | 西安电子科技大学 | Synthetic aperture radar (SAR) image change detection method based on multi-objective evolutionary algorithm based on decomposition (MOEA/D) and fuzzy clustering |
CN103700109B (en) * | 2013-12-24 | 2016-06-22 | 西安电子科技大学 | SAR image change detection based on multiple-objection optimization MOEA/D and fuzzy clustering |
CN104408482A (en) * | 2014-12-08 | 2015-03-11 | 电子科技大学 | Detecting method for high-resolution SAR (Synthetic Aperture Radar) image object |
CN104408482B (en) * | 2014-12-08 | 2019-02-12 | 电子科技大学 | A kind of High Resolution SAR Images object detection method |
CN105118065A (en) * | 2015-09-14 | 2015-12-02 | 中国民航大学 | Polari SAR (metric synthetic aperture radar) image variation detection method of wavelet domain polarization distance transformation |
CN106842349A (en) * | 2015-12-03 | 2017-06-13 | 北京国网富达科技发展有限责任公司 | Transmission line of electricity external force damage prevention detection method and device |
CN106842349B (en) * | 2015-12-03 | 2019-06-07 | 北京国网富达科技发展有限责任公司 | Transmission line of electricity external force damage prevention detection method and device |
CN107437091A (en) * | 2016-03-23 | 2017-12-05 | 西安电子科技大学 | Multilayer limits the positive and negative class change detecting method of SAR image of Boltzmann machine |
CN107610155B (en) * | 2016-07-12 | 2020-05-05 | 香港理工大学深圳研究院 | SAR image change detection method and device |
CN107610155A (en) * | 2016-07-12 | 2018-01-19 | 香港理工大学深圳研究院 | SAR remote sensing imagery change detection method and devices |
CN106203521B (en) * | 2016-07-15 | 2019-03-26 | 西安电子科技大学 | The SAR image change detection learnt based on disparity map from step |
CN106203521A (en) * | 2016-07-15 | 2016-12-07 | 西安电子科技大学 | Based on disparity map from the SAR image change detection of step study |
CN106204608A (en) * | 2016-07-17 | 2016-12-07 | 西安电子科技大学 | On-line talking SAR image change detection based on sample local density |
CN107240119B (en) * | 2017-04-19 | 2019-11-08 | 北京航空航天大学 | The method for extracting the uneven infrared pedestrian of gray scale using fuzzy clustering algorithm is improved |
CN107240119A (en) * | 2017-04-19 | 2017-10-10 | 北京航空航天大学 | Utilize the method for improving the fuzzy clustering algorithm extraction uneven infrared pedestrian of gray scale |
CN106971402B (en) * | 2017-04-21 | 2020-03-17 | 西安电子科技大学 | SAR image change detection method based on optical assistance |
CN106971402A (en) * | 2017-04-21 | 2017-07-21 | 西安电子科技大学 | A kind of SAR image change detection aided in based on optics |
CN107256409B (en) * | 2017-05-22 | 2021-01-01 | 西安电子科技大学 | High-resolution SAR image change detection method based on SAE and significance detection |
CN107256409A (en) * | 2017-05-22 | 2017-10-17 | 西安电子科技大学 | The High Resolution SAR image change detection method detected based on SAE and conspicuousness |
CN107423771A (en) * | 2017-08-04 | 2017-12-01 | 河海大学 | A kind of two phase method for detecting change of remote sensing image |
CN107423771B (en) * | 2017-08-04 | 2020-04-03 | 河海大学 | Two-time-phase remote sensing image change detection method |
CN108038851A (en) * | 2017-12-11 | 2018-05-15 | 中国科学技术大学 | A kind of radar image difference detecting method based on feedback and iteration |
CN108038851B (en) * | 2017-12-11 | 2020-02-07 | 中国科学技术大学 | Radar image difference detection method based on feedback and iteration |
CN108873901A (en) * | 2018-06-27 | 2018-11-23 | 深圳市创艺工业技术有限公司 | A kind of Unmanned Systems |
CN109893100A (en) * | 2019-04-18 | 2019-06-18 | 盐城工学院 | A kind of method that breast density quantification calculates in breast cancer risk assessment |
CN110648348A (en) * | 2019-09-30 | 2020-01-03 | 重庆邮电大学 | Quantum image segmentation method based on NEQR expression |
CN110648348B (en) * | 2019-09-30 | 2021-12-28 | 重庆邮电大学 | Quantum image segmentation method based on NEQR expression |
CN111091569B (en) * | 2019-10-31 | 2024-02-13 | 重庆邮电大学 | Industrial CT image segmentation method with self-adaptive local parameters |
CN111091569A (en) * | 2019-10-31 | 2020-05-01 | 重庆邮电大学 | Local parameter self-adaptive industrial CT image segmentation method |
CN112348750B (en) * | 2020-10-27 | 2023-08-18 | 西安电子科技大学 | SAR image change detection method based on threshold fusion and neighborhood voting |
CN112348750A (en) * | 2020-10-27 | 2021-02-09 | 西安电子科技大学 | SAR image change detection method based on threshold fusion and neighborhood voting |
CN113420658A (en) * | 2021-04-30 | 2021-09-21 | 中国电子科技集团公司第十四研究所 | SAR image sea-land segmentation method based on FCM clustering and OTSU segmentation |
CN113408370B (en) * | 2021-05-31 | 2023-12-19 | 西安电子科技大学 | Forest change remote sensing detection method based on adaptive parameter genetic algorithm |
CN113408370A (en) * | 2021-05-31 | 2021-09-17 | 西安电子科技大学 | Forest change remote sensing detection method based on adaptive parameter genetic algorithm |
CN114066815A (en) * | 2021-10-21 | 2022-02-18 | 西安理工大学 | SAR image change detection method based on fuzzy c-means clustering |
CN114066815B (en) * | 2021-10-21 | 2024-02-13 | 西安理工大学 | SAR image change detection method based on fuzzy c-means clustering |
CN115601364A (en) * | 2022-12-14 | 2023-01-13 | 惠州威尔高电子有限公司(Cn) | Golden finger circuit board detection method based on image analysis |
CN116385866A (en) * | 2023-02-09 | 2023-07-04 | 中国铁道科学研究院集团有限公司铁道建筑研究所 | SAR image-based railway line color steel house change detection method and device |
CN116385866B (en) * | 2023-02-09 | 2024-05-10 | 中国铁道科学研究院集团有限公司铁道建筑研究所 | SAR image-based railway line color steel house change detection method and device |
CN116563312A (en) * | 2023-07-11 | 2023-08-08 | 山东古天电子科技有限公司 | Method for dividing display image of double-screen machine |
CN116563312B (en) * | 2023-07-11 | 2023-09-12 | 山东古天电子科技有限公司 | Method for dividing display image of double-screen machine |
Also Published As
Publication number | Publication date |
---|---|
CN103020978B (en) | 2015-07-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103020978B (en) | SAR (synthetic aperture radar) image change detection method combining multi-threshold segmentation with fuzzy clustering | |
CN110097755B (en) | Highway traffic flow state identification method based on deep neural network | |
CN103632382B (en) | A kind of real-time multiscale target tracking based on compressed sensing | |
CN102938071B (en) | Fuzzy clustering analysis method for detecting synthetic aperture radar (SAR) image changes based on non-local means | |
CN112101278A (en) | Hotel point cloud classification method based on k nearest neighbor feature extraction and deep learning | |
CN110298235B (en) | Hyperspectral anomaly detection method and system based on manifold constraint self-coding network | |
CN106897738A (en) | A kind of pedestrian detection method based on semi-supervised learning | |
CN103473540B (en) | The modeling of intelligent transportation system track of vehicle increment type and online method for detecting abnormality | |
CN103294792B (en) | Based on the polarization SAR terrain classification method of semantic information and polarization decomposing | |
CN104182985A (en) | Remote sensing image change detection method | |
Chawan et al. | Automatic detection of flood using remote sensing images | |
CN110020712B (en) | Optimized particle swarm BP network prediction method and system based on clustering | |
CN109029993A (en) | In conjunction with the bearing fault detection algorithm of genetic algorithm optimization parameter and machine vision | |
CN108171119B (en) | SAR image change detection method based on residual error network | |
CN104751185A (en) | SAR image change detection method based on mean shift genetic clustering | |
CN110147795A (en) | A kind of adaptive non local fuzzy C-means clustering SAR image partitioning algorithm | |
CN111488879A (en) | Method and apparatus for improving segmentation performance using dual-embedding configuration | |
CN111539422A (en) | Flight target cooperative identification method based on fast RCNN | |
CN110443139A (en) | A kind of target in hyperspectral remotely sensed image noise wave band detection method of Classification Oriented | |
CN104680536A (en) | Method for detecting SAR image change by utilizing improved non-local average algorithm | |
CN103700109A (en) | Synthetic aperture radar (SAR) image change detection method based on multi-objective evolutionary algorithm based on decomposition (MOEA/D) and fuzzy clustering | |
CN115272882A (en) | Discrete building detection method and system based on remote sensing image | |
CN105787505A (en) | Infrared image clustering segmentation method combining sparse coding and spatial constraints | |
CN113962900A (en) | Method, device, equipment and medium for detecting infrared dim target under complex background | |
CN112348750B (en) | SAR image change detection method based on threshold fusion and neighborhood voting |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150715 Termination date: 20201214 |
|
CF01 | Termination of patent right due to non-payment of annual fee |