CN204924273U - Three -dimensional laser sensor data calibrating device of panorama - Google Patents

Three -dimensional laser sensor data calibrating device of panorama Download PDF

Info

Publication number
CN204924273U
CN204924273U CN201520669840.7U CN201520669840U CN204924273U CN 204924273 U CN204924273 U CN 204924273U CN 201520669840 U CN201520669840 U CN 201520669840U CN 204924273 U CN204924273 U CN 204924273U
Authority
CN
China
Prior art keywords
dimensional laser
laser sensor
panorama
data
laser
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201520669840.7U
Other languages
Chinese (zh)
Inventor
赵忆文
卜春光
庄严
闫飞
高英丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dalian University of Technology
Shenyang Institute of Automation of CAS
Original Assignee
Dalian University of Technology
Shenyang Institute of Automation of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dalian University of Technology, Shenyang Institute of Automation of CAS filed Critical Dalian University of Technology
Priority to CN201520669840.7U priority Critical patent/CN204924273U/en
Application granted granted Critical
Publication of CN204924273U publication Critical patent/CN204924273U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

The utility model relates to a three -dimensional laser sensor data calibrating device of panorama. The device is including three -dimensional laser sensor and calibration device. Three -dimensional laser sensor includes rotatory cloud platform and sets up in the two -dimentional laser sensor of rotatory cloud bench, calibration device is located the settlement distance in three -dimensional laser sensor the place ahead. The utility model provides a manual human error who selects the matched pair to introduce uncontrollable with the big problem of time expense, consider fully that the influence number is according to the possible factor of precision, improvement transducer calibration precision to calibration method's commonality has been promoted.

Description

A kind of panorama three-dimensional laser sensing data calibrating installation
Technical field
The utility model belongs to technical field of environmental perception, and a kind of device improving three-dimensional laser range measurement system collection panoramic view data precision, particularly relates to a kind of panorama three-dimensional laser sensing data calibrating installation specifically.
Background technology
Laser sensor belongs to active sensor, antijamming capability is strong, depth information accurately can be provided, environment geometric properties can be described in detail, the three-dimensional model of direct quick obtaining environment, therefore dominate in three-dimensional environment perception, has larger using value in fields such as comprising the navigation of intricately anthropomorphic robot, engineering survey.At present, have many manufacturers of selling three-dimensional laser detection systems in the world, as Austrian Riegl, Switzerland Leica, Japanese Topcon, U.S. Faro etc., these sensors are expensive, and often complex structure, be unfavorable for safeguarding and maintenance.
In order to reduce costs, most three-dimensional laser sensors on the basis of two-dimensional laser, adds one dimension rotate, thus obtain three-dimensional laser data (Jes ú sMorales, JorgeL.Mart í nez, AnthonyMandow, Alejandro andAlfonsoGarc í a-Cerezo, " DesignandDevelopmentofaFastandPreciseLow-Cost3DLaserRang efinder ", inProceedingsofthe2011IEEEInternationalConferenceonMecha tronics, 2011).Due to when installation two-dimensional laser sensor, the deviation on angle and position cannot being avoided, so in order to obtain three-dimensional laser data accurately, before this three-dimensional laser sensor of use, needing to demarcate sensor inherent parameters.
Document (Yu Zujun, Yang Yanan, Zhu Liqiang, " research of three-dimensional laser scanning measurement system scaling method ", electronic surveying and instrument journal, 21 (6), 31-35,2007) the demarcation object in is made up of a LMS200 two-dimensional laser sensor and a translating device, utilize two kinds of calibrating templates to realize rotation parameter between three-dimensional laser sensor coordinate system and extraneous measuring basis coordinate and translation parameters, this parameter can not correct the data error because installation question produces.
Document (Jes ú sMorales, JorgeL.Mart í nez, AnthonyMandow, AntonioJ.Reina, Alejandro andAlfonsoGarc í a-Cerezo, " BoresightCalibrationofConstructionMisalignmentsfor3DScan nersBuiltwitha2DLaserRangefinderRotatingonItsOpticalCent er ", Sensors, 14 (11), 20025-20040, 2014.) Nelder-Mead method is utilized to carry out flatness and the process of area largest optimization to panel data, demarcate two anglecs of rotation of two-dimensional laser sensor relative to three-dimensional data coordinate system, although three-dimensional data more accurately can be obtained, but owing to have ignored partial 3-D laser internal parameter, in time there is alignment error, still certain data error can be introduced.Equally, document (Gu Xiaojie, Bu Chunguang, Chen Cheng, week dredges wise man, " three-dimensional laser Ranging System and scaling method are studied ", Shenyang Univ. of Science and Engineering's journal, 33 (5), 10-14,47,2014) only considered the partial interior parameter of three-dimensional laser sensor, can not demarcate various three-dimensional laser sensor as general method.
Utility model content
For the above-mentioned problems in the prior art, problem to be solved in the utility model proposes a kind of panorama three-dimensional laser sensing data calibrating installation.
The technical scheme that the utility model is adopted for achieving the above object is: a kind of panorama three-dimensional laser sensing data calibrating installation comprises three-dimensional laser sensor and caliberating device; Described three-dimensional laser sensor comprises rotary head and is arranged at the two-dimensional laser sensor on rotary head; Described caliberating device is positioned at the setpoint distance in three-dimensional laser sensor front.
Described caliberating device is printing paper, square black square and white square that printing paper surface air brushing has n × m mutually to replace; There is hollow out the center of each black square and white square.
The shape of described hollow out is circular.
Described iteration optimization algorithms is least square method or Newton tangential method.
The utility model has following beneficial effect and advantage:
1. the utility model is only using three-dimensional laser sensor as measurement mechanism, with feature selected from environment for basis, realizes the calibration to panorama three-dimensional laser data.
2. the utility model solves panorama three-dimensional laser sensor internal parameter calibration problem, just can realize multiple unique point easily automatically extract by means of only a data acquisition.
3. the utility model solves manually to click and mates to introduced personal error the uncontrollable and large problem of time overhead, takes into full account the possible factor affecting data precision, improves transducer calibration precision, and improve the versatility of scaling method.
4. the utility model is that the transducer calibration of panorama three-dimensional laser lays the foundation, and can be used on the fields such as the navigation of intricately anthropomorphic robot, engineering survey.
5. the calibration steps that the utility model proposes considers position between the two-dimensional laser coordinate system that may exist and three-dimensional laser coordinate system and rotation error comprehensively, improves the versatility of method.
6. the caliberating device that the utility model adopts is convenient to make, easy to carry, reusable.
Accompanying drawing explanation
Fig. 1 is panorama three-dimensional laser sensor model schematic diagram;
Fig. 2 is three-dimensional laser sensor 3 angular error schematic diagram one;
Fig. 3 is three-dimensional laser sensor 3 angular error schematic diagram two;
Fig. 4 is three-dimensional laser sensor 3 angular error schematic diagram three;
Fig. 5 is caliberating device schematic diagram;
Fig. 6 is caliberating device angle point grid schematic diagram;
Fig. 7 is three-dimensional laser sensor construction schematic diagram;
Fig. 8 is panorama three-dimensional laser sensor;
Fig. 9 is for correcting panorama three-dimensional laser point cloud data experimental result picture in cup;
Figure 10 is the cloud data experimental result picture after correcting.
Embodiment
Below in conjunction with drawings and Examples, the utility model is described in further detail.
The maximum innovative point of the utility model is the angle comprehensively considering may exist in installation process and site error, is applicable to multiple panorama three-dimensional laser sensor parameters and demarcates.Between two-dimensional laser coordinate system and three-dimensional laser coordinate system three angle parameter and one are deflected heart distance parameter as parameter to be calibrated by the utility model for this reason, through plane fitting, laser data binaryzation, angle point grid process, the unique point belonging to caliberating device is extracted respectively from two parts three-dimensional laser data gathered, adopt iterative optimization method to treat calibrating parameters to solve, thus the angle obtained between two-dimensional laser coordinate system and three-dimensional laser coordinate system and location parameter.
The utility model is using the angle parameter of 3 between two-dimensional laser coordinate system and three-dimensional laser coordinate system and 1 location parameter as parameter to be calibrated, utilize the phenomenon that the angle point in two parts laser data on caliberating device can not overlap, adopt iterative optimization method to solve calibrating parameters, the data that this calibrating parameters can meet multiple panorama three-dimensional laser sensor correct demand.Concrete steps are as follows:
A) be placed in Experimental Area by caliberating device, the OK range of the spacing of caliberating device and three-dimensional laser sensor is between 2m-10m;
B) scan-data of SICKLMS200 laser sensor is pressed y lbe positive and negatively equally divided into two parts, every part scanning angle is 90 degree, and when rotary head drives LMS200 laser rotary 360 degree time, positive and negative two parts laser data just in time forms two space three-dimensional cloud datas;
C) according to the putting position of caliberating device, filter out the data in caliberating device region, parallel planes matching of going forward side by side, foundation caliberating device region laser spots data carry out binary conversion treatment to the distance value d of institute's fit Plane to area data
I i = 255 d i < d &OverBar; 0 d i > = d &OverBar;
Wherein I ifor the value after i point binaryzation in region, for experience distance threshold, after binaryzation, the data in hollow out circular hole region are 0, and other area datas are 255, and by the distribution histogram of counting of row statistics 0 and 255, statistics obtains row coordinate by row
i = m e d i a n ( arg m a x i &Sigma; j b i n 1 ( I i j = 0 ) ) j = m e d i a n ( arg m a x j &Sigma; i b i n 1 ( I i j = 0 ) )
Wherein i, j represent ranks subscript respectively, and function 1 () is 0-1 function, if condition is very in bracket, being worth is 1, otherwise be 0, median () are intermediate value choice function, I ijrepresent binaryzation value, thus determine hollow out centre coordinate, and can further according to four neighborhood relationships determination black and white lattice angular coordinates;
D) distance that in two parts three-dimensional laser point cloud, corresponding angle point is right is calibration process is optimization distance formula
D = m i n &alpha; , &beta; , &gamma; , l &Sigma; k = 1 n | | P P k + - P P k - | | = m i n &alpha; , &beta; , &gamma; , l &Sigma; k = 1 n | | ( R L P k + RP L k + + T L P k + ) - ( R L P k - RP L k - + T L P k - ) | |
Wherein R lPand T lPbe respectively rotation and translation matrix that two-dimensional laser coordinate is tied to three-dimensional laser ordinate transform, l is the site error between two-dimensional laser coordinate system and three-dimensional laser coordinate system,
R = cos &beta; cos &gamma; - sin &alpha; sin &beta; sin &gamma; - cos &beta; sin &gamma; - sin &alpha; sin &beta; cos &gamma; - cos &alpha; sin &beta; cos &alpha; sin &gamma; cos &alpha; cos &gamma; - sin &alpha; sin &beta; cos &gamma; + sin &alpha; cos &beta; sin &gamma; - sin &beta; sin &gamma; + sin &alpha; cos &beta; cos &gamma; cos &alpha; cos &beta;
α, β, γ are the spaced winding x of two-dimensional laser coordinate system and three-dimensional laser coordinate system laxle, y laxle, z lthe error angle that axle rotates, utilizes iteration optimization algorithms, obtains calibration result, be i.e. the actual value of α, β, γ and l.
Specific embodiments of the present utility model is as follows:
1. panorama three-dimensional laser sensor characteristic is analyzed
The panorama three-dimensional laser sensor be made up of two-dimensional laser sensor and rotary head, its system model as shown in Figure 1, can use formula to describe:
Wherein, with be respectively the coordinate of a laser spots in two-dimensional laser coordinate system and three-dimensional laser coordinate system, be the The Cloud Terrace anglec of rotation corresponding to i-th group of laser data, with be respectively rotation and translation matrix that two-dimensional laser coordinate is tied to three-dimensional laser ordinate transform.Different owing to often organizing the corresponding The Cloud Terrace anglec of rotation of laser data, so rotation matrix and translation matrix are not fixed.What above formula described is ideal coordinates system relation, but in actual applications, owing to there is alignment error, above-mentioned ideal relationship formula cannot be met, rotation between needing equipment and translation relation are estimated, namely systematic parameter is demarcated, need to demarcate the rotation relationship between two-dimensional laser coordinate system and three-dimensional laser coordinate system and translation relation.
Owing to there is alignment error, need consideration three angular errors when carrying out coordinate system rotational transform, as shown in figs. 2 to 4.Definition rotation matrix R, by laser spots from there is the laser scanning Plane Rotation of error to ideal situation, after namely rotating, can there are not α, β and γ tri-angular errors in this matrix between laser scanning plane and rotary head plane.Coordinate transform formula after rectification is expressed as:
P P i j = R L P i RP L i j + T L P i - - - ( 2 )
So need the parameter of demarcating to have 4: α, β, γ and l.
2. the design of caliberating device
Different medium has different reflectivity to the laser beam that laser sensor is launched, wherein the reflectivity of glossy object is higher than matt object, same different incidence angles is on the impact also highly significant of range finding, but target object surface Color pair range finding impact is little.For above-mentioned laser characteristics, develop three-dimensional laser caliberating device (as shown in Figure 5), the material of device is glossy printing paper, to ensure having high reflectance to laser.Go out the square black and white lattice of 4 × 5 in printing paper surface air brushing, the length of side of each black and white lattice is 25cm.Hollow out is carried out, the circle of hollow out shape to be radius be 5cm in each black and white lattice center.Through experimental verification, select the circular impact being robustness in order to ensure algorithm as hollow out shape and avoiding Laser edge effect to produce.
3. demarcate the extraction of required laser data unique point
(1) the rough position scope of caliberating device is determined.According to the putting position of caliberating device, the coordinate parameters of caliberating device in three-dimensional laser coordinate system is set in scaling method, filters out the data in this region according to this parameter in conjunction with laser spots three-dimensional coordinate.
(2) according to scope determination plane.According to the data point fit Plane in region, namely
a = arg m i n a &Sigma; i = 1 n | | a T q i | | 2 - - - ( 3 )
Wherein a=[a 1, a 2, a 3] tfor planar process vector, q i=[x, y, z] tfor area coordinate point.In order to improve counting yield, directly plane equation can be determined according to four of a device in-scope boundary point.N is the laser spots number in region.
(3) laser ranging data binaryzation.Foundation caliberating device region laser spots data carry out binary conversion treatment to the distance value d of institute's fit Plane to area data.
I i = 255 d i < d &OverBar; 0 d i > = d &OverBar; - - - ( 4 )
Wherein I ifor the value after i point binaryzation in region, for experience distance threshold, =15cm.After binaryzation, the data in hollow out circular hole region are 0, and other area datas are 255, thus can use for reference image processing method further and carry out angle point grid.
(4) angle point is extracted.Caliberating device simulation reduced graph as shown in Figure 6,7, in the black and white lattice of 4 × 5, circular expression void region, the cross at center represents hollow out center, and the round dot between void region represents the angle point of black and white lattice, and plane evenly divides by dotted line.To utilize in (3) the data obtained after binaryzation, first by the distribution histogram of counting of row statistics 0 and 255, and according to the row-coordinate at peak point determination hollow out center, in like manner also can add up by row and obtain row coordinate, specifically see following formula:
i = m e d i a n ( arg m a x i &Sigma; j b i n 1 ( I i j = 0 ) ) j = m e d i a n ( arg m a x j &Sigma; i b i n 1 ( I i j = 0 ) ) - - - ( 5 )
Wherein i, j represent ranks subscript respectively, and function 1 () is 0-1 function, if condition is very in bracket, being worth is 1, otherwise is 0.Median () is intermediate value choice function, I ijrepresent binaryzation value.Thus determine the hollow out centre coordinate of 4 × 5, and the black and white lattice angular coordinate of 3 × 4 can be determined further according to four neighborhood relationships.
4. calculate calibrating parameters value
Due to the existence of alignment error, as shown in Figure 8, when The Cloud Terrace rotating 360 degrees gathers laser data time, the panorama three-dimensional laser point cloud of composition can produce distortion.In order to calculate calibrating parameters, laser data is divided into two parts by region, laser spots y l>0, uses P +represent, laser spots y l<0, uses P -represent.When The Cloud Terrace rotating 360 degrees, build two three-dimensional point clouds, there is one-to-one relationship from two groups of angle points two some clouds, the distance of corresponding angle point is calibration process is corresponding laser spots range formula between optimization two some clouds:
D = m i n &alpha; , &beta; , &gamma; , l &Sigma; k = 1 n | | P P k + - P P k - | | = m i n &alpha; , &beta; , &gamma; , l &Sigma; k = 1 n | | ( R L P k + RP L k + + T L P k + ) - ( R L P k - RP L k - + T L P k - ) | | - - - ( 6 )
In order to two groups of angle points as input, can adopt the optimized algorithm such as least square method or Newton tangential method, according to formula &lsqb; &alpha; k + 1 , &beta; k + 1 , &gamma; k + 1 , l k + 1 &rsqb; T = &lsqb; &alpha; k , &beta; k , &gamma; k , l k &rsqb; T + D D &prime; Iterative computation α, β, γ and l, k and k+1 represents kth and kth+1 iteration respectively, and D' is the derivative of D to α, β, γ and l.
In order to verify the validity of this method, the sensing system constructed by Fig. 6 is utilized to carry out the checking of scaling method.Panorama three laser sensor is made up of SICKLMS200 type laser sensor and rotary head, and wherein laser sensor plane scan angles is 0-180 degree, and the range of application of the frequency of The Cloud Terrace stepper motor is 500-2500Hz.Driven by motor laser sensor is utilized to obtain the three-dimensional laser ranging data of scene.
Be placed on by caliberating device in Experimental Area, the OK range of the spacing of caliberating device and three-dimensional laser sensor is between 2m-10m.The scan-data of LMS200 laser sensor is pressed y lbe positive and negatively equally divided into two parts, every part scanning angle is 90 degree, and when rotary head drives LMS200 laser rotary 360 degree time, positive and negative two parts laser data just in time forms two space three-dimensional cloud datas.After plane fitting, laser data binaryzation, angle point grid process, the Corresponding matching point pair of two groups of data can being obtained, to point to carrying out Iterative matching, three-dimensional laser transducer calibration parameter can be calculated:
&alpha; = 0.0095 r a d &beta; = 0.0017 r a d &gamma; = - 0.0353 r a d l = 0.004 m
From angle analysis qualitatively, by judging whether two groups of laser data overlap visual verification is carried out to calibration result.Ideally, two parts laser data of synchronization collection should overlap completely, but owing to there is error, as shown in Figure 9, there is certain deviation in two three-dimensional laser point clouds, utilizes calibrating parameters to correct three-dimensional laser data, and Figure 10 shows two groups of laser point cloud datas after rectification, can find out that laser data is more accurate, can description three-dimensional scenic strictly according to the facts.

Claims (3)

1. a panorama three-dimensional laser sensing data calibrating installation, is characterized in that, comprises three-dimensional laser sensor and caliberating device; Described three-dimensional laser sensor comprises rotary head and is arranged at the two-dimensional laser sensor on rotary head; Described caliberating device is positioned at the setpoint distance in three-dimensional laser sensor front.
2. a kind of panorama three-dimensional laser sensing data calibrating installation according to claim 1, it is characterized in that, described caliberating device is printing paper, square black square and white square that printing paper surface air brushing has n × m mutually to replace; There is hollow out the center of each black square and white square.
3. a kind of panorama three-dimensional laser sensing data calibrating installation according to claim 2, is characterized in that, the shape of described hollow out is circular.
CN201520669840.7U 2015-08-31 2015-08-31 Three -dimensional laser sensor data calibrating device of panorama Expired - Fee Related CN204924273U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201520669840.7U CN204924273U (en) 2015-08-31 2015-08-31 Three -dimensional laser sensor data calibrating device of panorama

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201520669840.7U CN204924273U (en) 2015-08-31 2015-08-31 Three -dimensional laser sensor data calibrating device of panorama

Publications (1)

Publication Number Publication Date
CN204924273U true CN204924273U (en) 2015-12-30

Family

ID=54973389

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201520669840.7U Expired - Fee Related CN204924273U (en) 2015-08-31 2015-08-31 Three -dimensional laser sensor data calibrating device of panorama

Country Status (1)

Country Link
CN (1) CN204924273U (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105067023A (en) * 2015-08-31 2015-11-18 中国科学院沈阳自动化研究所 Panorama three-dimensional laser sensor data calibration method and apparatus
CN110456328A (en) * 2019-07-24 2019-11-15 佛山市云展智能科技有限公司 Multi-line laser radar calibration system and scaling method
CN111433570A (en) * 2017-11-30 2020-07-17 韩国机器人融合研究院 Multi-sensor calibration system and multi-sensor calibration method
CN113721227A (en) * 2021-08-06 2021-11-30 上海有个机器人有限公司 Offset angle calculation method of laser

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105067023A (en) * 2015-08-31 2015-11-18 中国科学院沈阳自动化研究所 Panorama three-dimensional laser sensor data calibration method and apparatus
CN105067023B (en) * 2015-08-31 2017-11-14 中国科学院沈阳自动化研究所 A kind of panorama three-dimensional laser sensing data calibration method and device
CN111433570A (en) * 2017-11-30 2020-07-17 韩国机器人融合研究院 Multi-sensor calibration system and multi-sensor calibration method
CN110456328A (en) * 2019-07-24 2019-11-15 佛山市云展智能科技有限公司 Multi-line laser radar calibration system and scaling method
CN113721227A (en) * 2021-08-06 2021-11-30 上海有个机器人有限公司 Offset angle calculation method of laser

Similar Documents

Publication Publication Date Title
CN105067023A (en) Panorama three-dimensional laser sensor data calibration method and apparatus
CN112669393B (en) Laser radar and camera combined calibration method
CN204924273U (en) Three -dimensional laser sensor data calibrating device of panorama
CN101699313B (en) Method and system for calibrating external parameters based on camera and three-dimensional laser radar
CN109269430B (en) Multi-standing-tree breast height diameter passive measurement method based on deep extraction model
CN101814185B (en) Line structured light vision sensor calibration method for micro-size measurement
CN101698303B (en) Automatic calibration method between three-dimensional laser and monocular vision
CN105157609A (en) Two-sets-of-camera-based global morphology measurement method of large parts
CN105716542B (en) A kind of three-dimensional data joining method based on flexible characteristic point
CN105203023B (en) A kind of one-stop scaling method of vehicle-mounted three-dimensional laser scanning system placement parameter
CN101673397B (en) Digital camera nonlinear calibration method based on LCDs
CN106291512A (en) A kind of method of array push-broom type laser radar range Nonuniformity Correction
CN109685855B (en) Camera calibration optimization method under road cloud monitoring platform
CN106097348A (en) A kind of three-dimensional laser point cloud and the fusion method of two dimensional image
CN109900713B (en) Camera-guided unmanned aerial vehicle wind power blade defect dynamic detection system and method thereof
CN102013099B (en) Interactive calibration method for external parameters of vehicle video camera
CN102589530B (en) Method for measuring position and gesture of non-cooperative target based on fusion of two dimension camera and three dimension camera
CN105157592A (en) Binocular vision-based method for measuring deformation shape and deformation rate of flexible trailing edge of adaptive wing
CN105627948A (en) Large-scale complex curved surface measurement system and application thereof
CN102506711B (en) Line laser vision three-dimensional rotate scanning method
CN104616325A (en) Rapid and high-precision method for extracting light strip center on large surface
CN103983343A (en) Satellite platform chattering detection method and system based on multispectral image
CN105678757A (en) Object displacement measurement method
CN104019829A (en) Vehicle-mounted panorama camera based on POS (position and orientation system) and external parameter calibrating method of linear array laser scanner
CN104207801A (en) Ultrasonic detection image three-dimensional calibration method

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20151230

Termination date: 20170831