CN102737237A - Face image dimension reducing method based on local correlation preserving - Google Patents

Face image dimension reducing method based on local correlation preserving Download PDF

Info

Publication number
CN102737237A
CN102737237A CN2012102486462A CN201210248646A CN102737237A CN 102737237 A CN102737237 A CN 102737237A CN 2012102486462 A CN2012102486462 A CN 2012102486462A CN 201210248646 A CN201210248646 A CN 201210248646A CN 102737237 A CN102737237 A CN 102737237A
Authority
CN
China
Prior art keywords
vector
matrix
facial image
row
calculate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2012102486462A
Other languages
Chinese (zh)
Other versions
CN102737237B (en
Inventor
张化祥
张悦童
曹林林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Normal University
Original Assignee
Shandong Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Normal University filed Critical Shandong Normal University
Priority to CN201210248646.2A priority Critical patent/CN102737237B/en
Publication of CN102737237A publication Critical patent/CN102737237A/en
Application granted granted Critical
Publication of CN102737237B publication Critical patent/CN102737237B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a face image dimension reducing method based on local correlation preserving. The method comprises the following steps of: expressing a face image by using multi-dimensional vectors, acquiring k neighbors of each vector according to the norm of two difference vectors, and calculating normalization weight of the k neighbors of each vector according to a radial basis function; calculating a difference vector of each vector and the sum of the weights of the k neighbors of each vector, acquiring a matrix by multiplying transposition of each difference vector by each difference vector, and adding the matrixes corresponding all the vectors to acquire a local correlation preserving matrix; and calculating characteristic values and characteristic vectors of the local correlation preserving matrix, and selecting the characteristic vectors corresponding to partial large characteristic values as basic vectors to form a projection matrix, and thus realizing dimension reduction. The dimension reduced face image well preserves local data association, the method is beneficial to image identification, and the classification effect after characteristics are extracted by the method is superior to those of primal component analysis (PCA) and locality preserving projection (LPP); and calculation complexity is reduced, and a relation among the new method, the PCA and the LPP is disclosed.

Description

Facial image dimension reduction method based on the local association maintenance
Technical field
The present invention relates to a kind of facial image dimension reduction method, relate in particular to a kind of facial image dimension reduction method that keeps based on local association.
Background technology
Facial image is made up of a large amount of pixel point values, representes through high dimension vector or high level matrix, and facial image identification needs a large amount of calculating and storage cost; Cause dimension disaster, therefore before to the facial image operation, need carry out dimension-reduction treatment facial image; Be about to primitive man's face image mapped to a lower dimensional space; Obtain lower dimensional space and represent the main characteristic of facial image, reduce and calculate and storage cost, realize the automatic identification of facial image.
The classical at present dimension reduction method of not considering the data category mark is that (Primal Component Analysis: principal component analysis (PCA)) simple aspect calculating and theoretical analysis, eigenface is PCA foremost application in facial image identification to PCA.The PCA dimensionality reduction is only considered the overall distribution characteristics of data, has ignored the nonlinear organization characteristic of data.KPCA has expanded the PCA algorithm, through by the nuclear conversion with data map to higher dimensional space more, and in new space data are carried out linear feature and extract, realize extracting based on the nonlinear characteristic of nuclear.The advantage of method is not need clear and definite Nonlinear Mapping function, and feature extraction only need be calculated higher dimensional space inner product of vectors kernel function, and the characteristic of extraction has been described the nonlinear organization of facial image more effectively.The facial image data have stream shape characteristic, and application flow shape learning art is realized the facial image dimensionality reduction, and keep the stream shape characteristic of source images.Main algorithm has LLE (local linear Embedding: local linearity embeds), NPE (Neighborhood Preserving Embedding: the local maintenance embeds), LPP (Locality Preserving Projection: the part keeps projection).In essence on the basis that keeps local relation between data, the nonlinear characteristic that learning data is inherent helps the identification of facial image more based on the feature extraction of manifold learning.The shortcoming of above-mentioned manifold learning method is a calculation of complex, does not provide clear and definite nonlinear transformation matrix, can not directly obtain the transform characteristics of unmarked facial image.
Summary of the invention
The object of the invention is exactly in order to address the above problem, and a kind of facial image dimension reduction method that keeps based on local association is provided, and it has under the prerequisite that keeps the view data local association, realizes face characteristic dimensionality reduction advantage through simple computation.
To achieve these goals, the present invention adopts following technical scheme:
A kind of feature dimension reduction method that keeps based on the facial image local association; At first represent facial image with multi-C vector; Norm according to two vectorial differences vector obtains each vectorial k neighbour, and calculates each vectorial k neighbour's normalized weight according to RBF.Calculate each vector and difference vector of its k neighbour's weighting sum, the transposition through each difference vector obtains matrix with itself multiplying each other, and with the matrix addition of institute's directed quantity correspondence, obtains local association maintenance matrix.Keep the eigenwert and the proper vector of matrix through the calculating local association, and select the big eigenwert characteristic of correspondence vector of part to form projection matrix, realize dimensionality reduction as base vector.Facial image is hinted obliquely at lower dimensional space through projection matrix, realizes facial image identification at lower dimensional space.
Concrete steps of the present invention are:
Step 1: the capable vector x that m width of cloth size is expressed as s * t dimension for the facial image of s * t pixel 1, x 2..., x i..., x m, wherein m is the facial image number, and s is the image line pixel number, and t is a row image column pixel number, x iRepresent the row vector of the corresponding s of i width of cloth facial image * t dimension, this m width of cloth facial image comprises p people, everyone
Figure BDA00001901979400021
Width of cloth image;
Step 2: for any capable vector x i(i ∈ 1,2 ..., m}), calculate d Ij=‖ x i-x j‖ (j ∈ 1,2 ..., m} and j ≠ i) therefrom select k (k=9) to make d IjMinimum row vector is formed set and is designated as Ne (x i).Wherein ‖ ‖ representes the norm of vector, and d representes x i-x jThe norm of gained difference vector;
Step 3: calculate weight matrix W, the capable j row of matrix i member is designated as w Ij
Step 4: calculate the corresponding difference vector of each row vector, and calculate local association maintenance matrix V;
Step 5: find the solution the eigenwert and the proper vector of matrix V, select d biggest characteristic value characteristic of correspondence vector, and form a matrix as row, be called projection matrix M by this d proper vector; D=min (m, n), wherein n=r (V) is the order of matrix V;
Step 6: any people's face image line vector of p people is mapped to lower dimensional space through the projection matrix M that step 5 obtains.
The capable j row of the i member w of weight matrix W in the said step 3 IjDefine as follows:
Figure BDA00001901979400022
Parameter σ=2 wherein.
The difference vector computing method are in the said step 4: for any capable vector x i, calculate the difference vector r of the weighting sum of the individual neighbour's row of itself and k (k=9) vector i
r i = x i - Σ j ∈ ne ( x i ) w ij Σ j ∈ ne ( x i ) w ij x j - - - ( 2 )
It is following that local association keeps the calculating of matrix V in the said step 4:
V = Σ i = 1 m r i T r i - - - ( 3 )
In the said step 6, for any capable vector x i, calculate x iM obtains a d dimension row vector, and wherein (m, n) s * t tie up thereby facial image is dropped to d d=min, realize the facial image dimensionality reduction.
Beneficial effect of the present invention: the facial image behind the dimensionality reduction has kept the data local association well, helps image recognition, and the error in classification rate on the Yale face database relatively is superior to PCA and LPP through the classifying quality after the inventive method extraction characteristic; The present invention has reduced computational complexity, has disclosed the relation between new method and PCA and LPP simultaneously, works as k=m, and parameter σ is when enough big, and new method deteriorates to PCA; Analysis shows, new method characteristic=LPP characteristic+complex nonlinear recessive character.
Description of drawings
Fig. 1 is a dimension reduction method process flow diagram of the present invention.
Embodiment
Below in conjunction with accompanying drawing and embodiment the present invention is described further.
Be illustrated in figure 1 as dimension reduction method process flow diagram of the present invention, a kind of facial image dimension reduction method that keeps based on local association,
Concrete steps are:
Step 1: the capable vector x that m width of cloth size is expressed as s * t dimension for the facial image of s * t pixel 1, x 2..., x i..., x m, wherein m is the facial image number, and s is the image line pixel number, and t is a row image column pixel number, x iRepresent the row vector of the corresponding s of i width of cloth facial image * t dimension, this m width of cloth facial image comprises p people, everyone
Figure BDA00001901979400032
Width of cloth image;
Step 2: for any capable vector x i(i ∈ 1,2 ..., m}), calculate d Ij=‖ x i-x j‖ (j ∈ 1,2 ..., m} and j ≠ i) therefrom select k (k=9) to make d IjMinimum row vector is formed set and is designated as Ne (x i).Wherein ‖ ‖ representes the norm of vector, d IjExpression x i-x jThe norm of gained difference vector;
Step 3: calculate weight matrix W, the capable j row of matrix i member is designated as w Ij
Step 4: calculate the corresponding difference vector of each row vector, and calculate local association maintenance matrix V;
Step 5: find the solution the eigenwert and the proper vector of matrix V, select d biggest characteristic value characteristic of correspondence vector, and form a matrix as row, be called projection matrix M by this d proper vector; D=min (m, n), wherein n=r (V) is the order of matrix V;
Step 6: any people's face image line vector of p people is mapped to lower dimensional space through the projection matrix M that step 5 obtains.
The capable j row of the i member w of weight matrix W in the said step 3 IjDefine as follows:
Figure BDA00001901979400041
Parameter σ=2 wherein.
The difference vector computing method are in the said step 4: for any capable vector x i, calculate the difference vector r of the weighting sum of the individual neighbour's row of itself and k (k=9) vector i
r i = x i - Σ j ∈ ne ( x i ) w ij Σ j ∈ ne ( x i ) w ij x j - - - ( 2 )
It is following that local association keeps the calculating of matrix V in the said step 4:
V = Σ i = 1 m r i T r i - - - ( 3 )
In the said step 6, for any capable vector x i, calculate x iM obtains a d dimension row vector, wherein
Figure BDA00001901979400044
Thereby facial image is dropped to the d dimension, realize the facial image dimensionality reduction.
As embodiment, this database comprises 15 people's total 165 width of cloth facial images with the Yale face database in the present invention, and everyone 11 width of cloth images obtain under different illumination conditions and different expression respectively.Facial image is transformed to the image of 32x32 pixel, gray level 255.Before the dimensionality reduction data being carried out normalization handles.Concrete experimental procedure is following:
(1) selecting everyone preceding 4 width of cloth images, is the row vector of 1024 dimensions with every width of cloth image transformation, amounts to 60 vectors;
(2) norm of the difference vector of compute vector between is in twos selected 9 vectors nearest with it to form its neighbour's vector to each vector and is gathered;
(3) calculate weight matrix according to formula (1), this matrix is the matrix of 60X60, and calculates the corresponding difference vector of each vector according to formula (2), and this difference vector is the row vector of 1024 dimensions;
(4) calculate local association according to formula (3) and keep matrix V, this matrix is a 1024X1024 dimension matrix;
(5) eigenwert and the proper vector of calculating V, this rank of matrix is n=1024, greater than 60, is 60 so select the dimension behind the dimensionality reduction; Get 60 eigenwert characteristic of correspondence vectors of the minimum of V, form the mapping matrix M of 1024X60 dimension by row;
(6) an optional secondary facial image in the Yale face database converts 1024 dimension row vectors into, according to 60 dimensional feature vectors of inventing after step 6 obtains corresponding conversion, realizes dimensionality reduction.
Error in classification rate on the Yale face database relatively (adopts linear band penalty term SVM SVMs sorting algorithm, the parameters C among the SVM=1); Data set Yale, adopt five folding cross validation classification results as shown in table 1 behind 165 width of cloth figure dimensionality reductions:
Dimension reduction method Nicety of grading and variance
The inventive method 65.7303±1.0744
The PCA dimensionality reduction 63.6364±0.5051
The LPP dimensionality reduction 60±1.5335
The error in classification rate of table 1 on the Yale face database relatively
Though the above-mentioned accompanying drawing specific embodiments of the invention that combines is described; But be not restriction to protection domain of the present invention; One of ordinary skill in the art should be understood that; On the basis of technical scheme of the present invention, those skilled in the art need not pay various modifications that creative work can make or distortion still in protection scope of the present invention.

Claims (5)

1. facial image dimension reduction method that keeps based on local association; It is characterized in that; At first represent facial image with multi-C vector, the norm vectorial according to two vectorial differences obtains each vectorial k neighbour, and calculates each vectorial k neighbour's normalized weight according to RBF; Calculate each vector and difference vector of its k neighbour's weighting sum, the transposition through each difference vector obtains matrix with itself multiplying each other, and with the matrix addition of institute's directed quantity correspondence, obtains local association maintenance matrix; Keep the eigenwert and the proper vector of matrix through the calculating local association, and select the big eigenwert characteristic of correspondence vector of part to form projection matrix, realize dimensionality reduction as base vector; Facial image is hinted obliquely at lower dimensional space through projection matrix, realizes facial image identification at lower dimensional space.
2. facial image dimension reduction method that keeps based on local association is characterized in that concrete steps are:
Step 1: the capable vector x that m width of cloth size is expressed as s * t dimension for the facial image of s * t pixel 1, x 2..., x i..., x m, wherein m is the facial image number, and s is the image line pixel number, and t is a row image column pixel number, x iRepresent the row vector of the corresponding s of i width of cloth facial image * t dimension, this m width of cloth facial image comprises p people, everyone
Figure FDA00001901979300011
Width of cloth image;
Step 2: for any capable vector x i(i ∈ 1,2 ..., m}), calculate
Figure FDA00001901979300012
(j ∈ 1,2 ..., m} and j ≠ i) therefrom select k (k=9) to make d IjMinimum row vector is formed set and is designated as Ne (x i); Wherein ‖ ‖ representes the norm of vector, d IjExpression x i-x jThe norm of gained difference vector;
Step 3: calculate weight matrix W, the capable j row of matrix i member is designated as w Ij
Step 4: calculate the corresponding difference vector of each row vector, and calculate local association maintenance matrix V;
Step 5: find the solution the eigenwert and the proper vector of matrix V, select d biggest characteristic value characteristic of correspondence vector, and form a matrix as row, be called projection matrix M by this d proper vector; D=min (m, n), wherein n=r (V) is the order of matrix V;
Step 6: any people's face image line vector of p people is mapped to lower dimensional space through the projection matrix M that step 5 obtains.
3. like the said a kind of facial image dimension reduction method that keeps based on local association of claim 2, it is characterized in that the capable j row of the i member w of weight matrix W in the said step 3 IjDefine as follows:
Figure FDA00001901979300021
Wherein σ = Σ i = 1 m Σ j = 1 m | | x i - x j | | 2 / m ( m - 1 ) .
4. like the said a kind of facial image dimension reduction method that keeps based on local association of claim 2, it is characterized in that the difference vector computing method are in the said step 4: for any capable vector x i, calculate the difference vector r of the weighting sum of itself and k neighbour row vector i, k=9;
r i = x i - Σ j ∈ ne ( x i ) w ij Σ j ∈ ne ( x i ) w ij x j - - - ( 2 )
Said local association keeps the calculating of matrix V following:
V = Σ i = 1 m r i T r i - - - ( 3 ) .
5. like the said a kind of facial image dimension reduction method that keeps based on local association of claim 2, it is characterized in that, in the said step 6, for any capable vector x i, calculate x iM obtains a d dimension row vector, and wherein (m, n) s * t tie up thereby facial image is dropped to d d=min, realize the facial image dimensionality reduction.
CN201210248646.2A 2012-07-18 2012-07-18 Face image dimension reducing method based on local correlation preserving Expired - Fee Related CN102737237B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210248646.2A CN102737237B (en) 2012-07-18 2012-07-18 Face image dimension reducing method based on local correlation preserving

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210248646.2A CN102737237B (en) 2012-07-18 2012-07-18 Face image dimension reducing method based on local correlation preserving

Publications (2)

Publication Number Publication Date
CN102737237A true CN102737237A (en) 2012-10-17
CN102737237B CN102737237B (en) 2014-06-18

Family

ID=46992706

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210248646.2A Expired - Fee Related CN102737237B (en) 2012-07-18 2012-07-18 Face image dimension reducing method based on local correlation preserving

Country Status (1)

Country Link
CN (1) CN102737237B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103514443A (en) * 2013-10-15 2014-01-15 中国矿业大学 Single sample face identification transfer learning method based on LPP feature extraction
CN103679709A (en) * 2013-11-28 2014-03-26 深圳职业技术学院 Spectral image processing method
CN104063717A (en) * 2014-07-09 2014-09-24 哈尔滨工业大学 Complex system monitoring data graph embedment visualization method for global supervision through local structure preservation
CN104881682A (en) * 2015-05-26 2015-09-02 东南大学 Image classification method based on locality preserving mapping and principal component analysis
CN106338977A (en) * 2016-10-17 2017-01-18 沈阳化工大学 Nonlinear process fault detection method based on differential locality preserving projection (DLPP)
CN106407982A (en) * 2016-09-23 2017-02-15 厦门中控生物识别信息技术有限公司 Data processing method and equipment
CN107704887A (en) * 2017-10-20 2018-02-16 北京工业大学 A kind of image-recognizing method of the locality preserving projections based on F norms
CN108121965A (en) * 2017-12-21 2018-06-05 深圳大学 Image-recognizing method based on robust joint sparse feature extraction
CN109885578A (en) * 2019-03-12 2019-06-14 西北工业大学 Data processing method, device, equipment and storage medium
CN111553417A (en) * 2020-04-28 2020-08-18 厦门大学 Image data dimension reduction method and system based on discriminant regularization local preserving projection

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101079103A (en) * 2007-06-14 2007-11-28 上海交通大学 Human face posture identification method based on sparse Bayesian regression
CN101187986A (en) * 2007-11-27 2008-05-28 海信集团有限公司 Face recognition method based on supervisory neighbour keeping inlaying and supporting vector machine

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101079103A (en) * 2007-06-14 2007-11-28 上海交通大学 Human face posture identification method based on sparse Bayesian regression
CN101187986A (en) * 2007-11-27 2008-05-28 海信集团有限公司 Face recognition method based on supervisory neighbour keeping inlaying and supporting vector machine

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
SHI CHAO ET AL.: "Feature dimension reduction for microarray data analysis using locally linear embedding", 《THE ASIA PACIFIC BIOINFORMATICS CONFERENCE》 *
刘晓宁等: "流形学习在三维人脸特征降维中的应用", 《计算机应用研究》 *

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103514443B (en) * 2013-10-15 2016-12-07 中国矿业大学 A kind of single sample recognition of face transfer learning method based on LPP feature extraction
CN103514443A (en) * 2013-10-15 2014-01-15 中国矿业大学 Single sample face identification transfer learning method based on LPP feature extraction
CN103679709B (en) * 2013-11-28 2017-08-01 深圳职业技术学院 Spectrum picture processing method
CN103679709A (en) * 2013-11-28 2014-03-26 深圳职业技术学院 Spectral image processing method
CN104063717B (en) * 2014-07-09 2017-03-22 哈尔滨工业大学 Complex system monitoring data graph embedment visualization method for global supervision through local structure preservation
CN104063717A (en) * 2014-07-09 2014-09-24 哈尔滨工业大学 Complex system monitoring data graph embedment visualization method for global supervision through local structure preservation
CN104881682B (en) * 2015-05-26 2019-03-05 东南大学 A kind of image classification method based on guarantor office mapping and principal component analysis
CN104881682A (en) * 2015-05-26 2015-09-02 东南大学 Image classification method based on locality preserving mapping and principal component analysis
CN106407982A (en) * 2016-09-23 2017-02-15 厦门中控生物识别信息技术有限公司 Data processing method and equipment
CN106407982B (en) * 2016-09-23 2019-05-14 厦门中控智慧信息技术有限公司 A kind of data processing method and equipment
CN106338977A (en) * 2016-10-17 2017-01-18 沈阳化工大学 Nonlinear process fault detection method based on differential locality preserving projection (DLPP)
CN107704887A (en) * 2017-10-20 2018-02-16 北京工业大学 A kind of image-recognizing method of the locality preserving projections based on F norms
CN107704887B (en) * 2017-10-20 2021-04-02 北京工业大学 Image identification method based on F norm local preserving projection
CN108121965A (en) * 2017-12-21 2018-06-05 深圳大学 Image-recognizing method based on robust joint sparse feature extraction
CN108121965B (en) * 2017-12-21 2020-04-21 深圳大学 Image identification method based on robust joint sparse feature extraction
CN109885578A (en) * 2019-03-12 2019-06-14 西北工业大学 Data processing method, device, equipment and storage medium
CN109885578B (en) * 2019-03-12 2021-08-13 西北工业大学 Data processing method, device, equipment and storage medium
CN111553417A (en) * 2020-04-28 2020-08-18 厦门大学 Image data dimension reduction method and system based on discriminant regularization local preserving projection
CN111553417B (en) * 2020-04-28 2022-04-22 厦门大学 Image data dimension reduction method and system based on discriminant regularization local preserving projection

Also Published As

Publication number Publication date
CN102737237B (en) 2014-06-18

Similar Documents

Publication Publication Date Title
CN102737237B (en) Face image dimension reducing method based on local correlation preserving
Qiao New SVD based initialization strategy for non-negative matrix factorization
Li et al. Complex contourlet-CNN for polarimetric SAR image classification
CN106570183B (en) A kind of Color Image Retrieval and classification method
Zhang et al. Combining sparse representation and singular value decomposition for plant recognition
CN105095902B (en) Picture feature extracting method and device
CN105574534A (en) Significant object detection method based on sparse subspace clustering and low-order expression
Herdiyeni et al. Combination of morphological, local binary pattern variance and color moments features for indonesian medicinal plants identification
CN104268593A (en) Multiple-sparse-representation face recognition method for solving small sample size problem
CN105118048A (en) Method and device for identifying copying certificate image
Krishnamoorthi A multiresolution approach for rotation invariant texture image retrieval with orthogonal polynomials model
CN102542252A (en) Intelligent advertisement delivery system
CN103971122B (en) Three-dimensional face based on depth image describes method
Meshgi et al. Expanding histogram of colors with gridding to improve tracking accuracy
Ye et al. Detecting USM image sharpening by using CNN
CN106780450A (en) A kind of image significance detection method based on low-rank Multiscale Fusion
Dong et al. Feature extraction through contourlet subband clustering for texture classification
CN107301643A (en) Well-marked target detection method based on robust rarefaction representation Yu Laplce's regular terms
CN106780336A (en) A kind of image downscaling method and device
Peluffo-Ordónez et al. Short review of dimensionality reduction methods based on stochastic neighbour embedding
CN108629405B (en) Method and device for improving calculation efficiency of convolutional neural network
CN102592129A (en) Scenario-driven image characteristic point selection method for smart phone
CN108491883B (en) Saliency detection optimization method based on conditional random field
CN114049491A (en) Fingerprint segmentation model training method, fingerprint segmentation device, fingerprint segmentation equipment and fingerprint segmentation medium
CN105975940A (en) Palm print image identification method based on sparse directional two-dimensional local discriminant projection

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20140618

Termination date: 20200718

CF01 Termination of patent right due to non-payment of annual fee