CN104931021A - Crack multi-parameter observation device based on close-range photogrammetry - Google Patents

Crack multi-parameter observation device based on close-range photogrammetry Download PDF

Info

Publication number
CN104931021A
CN104931021A CN201510142878.3A CN201510142878A CN104931021A CN 104931021 A CN104931021 A CN 104931021A CN 201510142878 A CN201510142878 A CN 201510142878A CN 104931021 A CN104931021 A CN 104931021A
Authority
CN
China
Prior art keywords
crack
image
module
picture
pattern picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510142878.3A
Other languages
Chinese (zh)
Other versions
CN104931021B (en
Inventor
魏世玉
杨建国
李少荣
刘星
姚光华
邓涛
陈立川
吴孟
杨富军
陈柏林
赵火焱
李逾睿
王玥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CHONGQING HUADI ENGINEERING SURVEY AND DESIGN INSTITUTE
Chongqing Institute of Geology and Mineral Resources
Original Assignee
CHONGQING HUADI ENGINEERING SURVEY AND DESIGN INSTITUTE
Chongqing Institute of Geology and Mineral Resources
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CHONGQING HUADI ENGINEERING SURVEY AND DESIGN INSTITUTE, Chongqing Institute of Geology and Mineral Resources filed Critical CHONGQING HUADI ENGINEERING SURVEY AND DESIGN INSTITUTE
Priority to CN201510142878.3A priority Critical patent/CN104931021B/en
Publication of CN104931021A publication Critical patent/CN104931021A/en
Application granted granted Critical
Publication of CN104931021B publication Critical patent/CN104931021B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C1/00Measuring angles

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Multimedia (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)

Abstract

The invention discloses a crack multi-parameter observation device based on close-range photogrammetry, which comprises: the image acquisition module is used for acquiring the state of the crack and generating a crack image; the orientation determining module is used for determining the orientation of the crack, marking the orientation on the crack image and generating a marked image; the image processing module is used for analyzing the crack image, generating crack parameters, marking the crack parameters on the marked image and generating a result image; and the storage module is used for storing the crack image and the result image. Therefore, the data of the observed crack is more accurate, the reliability is high, the operation is simple and convenient, and the crack monitoring efficiency is effectively improved.

Description

A kind of crack multiparameter observation device based on close-range photogrammetry
Technical field
The present invention relates to gap observation field, be specifically related to a kind of crack multiparameter observation device based on close-range photogrammetry.
Background technology
Geologic hazard professional monitoring comprises the contents such as geometric deformation monitoring, influence factor monitoring and ess-strain monitoring, wherein the growth of ground fissure can reflect deformable body macroscopic deformation situation, the key content of geologic hazard geometric deformation monitoring, for Geological Hazards Monitoring early warning provides important data supporting.
Buildings or structures deformation monitoring and quality testing comprise that in-plane displancement is monitored, perpendicular displacement is monitored, tilt that (verticality) monitors, Crack Monitoring, ess-strain are monitored and the content such as structural intergrity, the stressed detection of material.Structural cracks developmental state is reflect structure deformation not only, reflects structure stress distribution situation simultaneously, and therefore Crack Monitoring is the important content of structural deformation monitoring and quality testing, significant to the control tool of structural safety state.
At present, the equipment for Crack Monitoring mainly contains reading microscope, crack gauge and New Instrument for Crack Width etc., and wherein reading microscope observation utilizes optical microphotograph principle realize the amplification in crack and measure; Crack gauge pre-plugged, to works surface or inner, mainly utilizes type vibration wire sensing principle to realize the observation of Fracture Deformation situation; New Instrument for Crack Width mainly utilizes infrared scan and image-forming principle to realize fracture width and measures.
Above-mentioned several equipment or observation device Problems existing mainly contain following some:
1, monitoring parameter is single, and this kind equipment lays particular emphasis on the observation of fracture width parameter more at present;
2, automaticity is low, obvious in industry working time boundary line indoor and out of doors.Regularly arrive monitoring point carry out manual operation, record owing to needing technician, then carry out industry in observation data and arrange and analyze, monitoring efficiency is comparatively low;
3, to set up requirement in advance higher for equipment pre-plugged or observation monument.Strict its requirement of installation must carry out for ensureing that accuracy of observation crack gauge is buried underground, adopting when New Instrument for Crack Width or reading microscope and must set up obvious observation monument, once observation monument is impaired, Monitoring Data sequence interruptions will be caused;
4, observation data precision of inner coincidence is difficult to ensure.Because above-mentioned several scope or observed pattern are affected by human factors comparatively large, thus cause that multiple observations data are poor even exceedes true strain amount.
Therefore, proposing a kind of new gap observation device, needing the problem of consideration by becoming technician.
Summary of the invention
The technical problem to be solved in the present invention is, provides a kind of crack multiparameter observation device based on close-range photogrammetry, and make the data of observation more accurate, reliability is high, easy and simple to handle, thus effectively raises the efficiency of Crack Monitoring.
In order to solve the problems of the technologies described above, the invention provides a kind of crack multiparameter observation device based on close-range photogrammetry, comprising:
Image capture module, for obtaining the situation in crack, generates crack pattern picture;
Orientation determination module, for determining the orientation in described crack, and is marked on described crack pattern picture, generates marking image;
Image processing module, for analyzing described crack pattern picture, generating fracture parameters, and being marked on described marking image by described fracture parameters, generate result map picture;
Memory module, for storing described crack pattern picture and described result map picture.
Preferably, described image capture module comprises: focus digital camera lens and demarcating module, described in focus digital camera lens, for obtaining the situation in described crack; Described demarcating module, is made up of orthogonal two groups of triangle collimation marks, for demarcating image yardstick, and to the described distortion correction focusing digital camera lens.
Preferably, described orientation determination module comprises: GPS locator and electronic compass and double-shaft tilt angle sensor, and described GPS locator, for obtaining the geographic position in described crack, and described geographic position is labeled on described crack pattern picture, described geographic position comprises longitude and latitude; Described electronic compass, for determining the horizontal direction that described crack is grown in described geographic position, generating direction angle, and described position angle is labeled on described crack pattern picture; Described double-shaft tilt angle sensor, for determining the vertical direction that described crack is grown in described geographic position, generating pitch angle, and being labeled on described crack pattern picture at described pitch angle.
Preferably, described electronic compass is provided with obliquity sensor, the horizontal direction that during for tilting to described electronic compass, measured described crack is grown in described geographic position compensates.
Preferably, described fracture parameters comprises: observation time and fracture width and observational error.
Preferably, described device is also provided with wireless communication module, for described result map picture is sent to destination address.
Preferably, described result map picture is sent to destination address and adopts GPRS or GSM communication mode to carry out communication.
Preferably, described device is also provided with display screen, for showing the situation of described crack pattern picture or result map picture or described crack.
Preferably, described display screen is provided with screen protective cover, for the protection of described display screen.
Preferably, described memory module is the internal memory or the SD card that are integrated in described device.
Beneficial effect of the present invention is, measurement parameter aspect, this device achieves multiparameter observation, compared with the observation laying particular emphasis on fracture width parameter with prior art, the parameter that this device obtains not only comprises fracture width, also comprise: pitch angle, position angle, the longitude and latitude of observation place, the correlation parameters such as observation time, make the more concrete of the data of observation, comprehensively, can realize providing when the analysis and research in crack real data comprehensively; Robotization aspect, this device achieves the automatic hourly observation place of device, time, pitch angle, the relevant informations such as position angle, have so just avoided manually manual operation, simultaneously because this device is directly stored in data in figure phase, just avoid the later stage manually to the step of data preparation, thus effectively raise the efficiency of measurement; Flexibility ratio aspect, this device does not need the foundation in advance by pre-plugged or observation monument, just can realize the observation of fracture accurately, this reduces the requirement of fracture observation, makes gap observation flexibility ratio higher; Data accuracy aspect, because the man's activity be subject to during this measurement device is less, just makes the result of measurement more objective.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is one-piece construction schematic diagram of the present invention;
Fig. 2 is the structural representation of middle demarcating module of the present invention;
Fig. 3 is the schematic diagram in observation process of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Main thought of the present invention is, the real time status in crack is gathered by image capture module, thus generate crack pattern picture, afterwards, determined the orientation in actual crack by orientation determination module, be marked on crack pattern picture, meanwhile, image processing module is also analyzed at opposite joint image, generates fracture parameters, and fracture parameters is recorded on the labeled crack pattern picture of orientation determination module, generate result map picture; Finally crack pattern picture and result map picture are unifiedly stored in memory module.So just make the data of observation more accurate, reliability is high, easy and simple to handle, thus effectively raises the efficiency of Crack Monitoring.
With reference to shown in Fig. 1, the present invention includes: image capture module 101, orientation determination module 102, image processing module 103, memory module 104, wireless communication module 105 and display screen 106.
Image capture module 101, for obtaining the situation in described crack, generates crack pattern picture;
Orientation determination module 102, for determining the orientation in described crack, and is marked on described crack pattern picture, generates marking image;
Image processing module 103, for analyzing described crack pattern picture, generating fracture parameters, and being marked on described marking image by described fracture parameters, generate result map picture;
Memory module 104, for storing described crack pattern picture and described result map picture.
Image capture module 101 comprises: focus digital camera lens 1011 and demarcating module 1012 and LED (light emitting diode) lamp 1013; Describedly focus digital camera lens 1011, for obtaining the situation in described crack; As preferably, the pixel value focusing digital camera lens 1011 is greater than 1,000,000, so just can ensure the sharpness obtaining image, and digital camera lens employing focuses digital camera lens 1011 advantage and is that he has large aperture, and the image quality of acquisition image is high.Can according to camera lens elements of interior orientation (x 0y 0f) design apparatus apparent size (comprising diameter and bus length), final acquisition optimal digital image.With reference to shown in Fig. 1 or Fig. 2, described demarcating module 1012, is made up of orthogonal two groups of triangle collimation marks, for demarcating image yardstick, and to the described distortion correction focusing digital camera lens.Size between any two collimation marks of this collimation mark can accurately obtain, and can resolve picture planar dimension relation and clear and definite observational error after imaging by extracting described collimation mark; LED 1013, the light for fracture plays supplementary function, thus improves the crack image effect obtained.
Orientation determination module 102 comprises: double-shaft tilt angle sensor 1021 and electronic compass 1022 and GPS (GPS) steady arm 1023, described GPS locator 1023, for obtaining the geographic position in described crack, and described geographic position is labeled on described seam image, described geographic position comprises longitude and latitude; Described double-shaft tilt angle sensor 1021, determines for the change by measuring static weight acceleration the vertical direction that described crack is grown in described geographic position, generates pitch angle, and is labeled on described crack pattern picture at described pitch angle.Double-shaft tilt angle sensor 1021 has significant load capacity and extraordinary Impacting endurance, can be realized the measurement at 360 degree of inclination angles by the cooperation of twin shaft, can use inner filter function simultaneously, to realize the target measuring inclination angle in vibration occasion.Described electronic compass 1022, for being utilized terrestrial magnetic field to specify magnetic north direction by electronic technology, determines the horizontal direction that described crack is grown in described geographic position, generating direction angle, and is labeled at described position angle on described crack pattern picture; Electronic compass 1022 is provided with obliquity sensor, so just overcome electronic compass 1022 strict restriction in use, the horizontal direction that described crack measured when electronic compass 1022 is tilted is grown in described geographic position compensates, and so just improves the reliability of fracture development azimuthal observation data greatly.
Image processing module 103, for passing through point, line feature extraction and localization process, solving target fracture width, evaluate its accuracy of observation, described crack pattern picture is analyzed through Image Fusion, generate the fracture parameters such as observation time, fracture width, observational error, and described fracture parameters is marked on described marking image, generate result map picture.Observation time be crack pattern as during imaging from the time that system obtains;
With reference to shown in Fig. 1 or Fig. 3, O is the focus focusing digital camera lens 1011; L is visual field inner left frame mark; R is visual field inner right frame mark; S is crack developed width; D is the left and right collimation mark physical size in the visual field, and s is size on crack pattern; Size on the collimation mark figure of left and right in the d visual field; Wherein, D just can accurately obtain when demarcating module 1012 sets, s and d reads acquisition all automatically; Therefore, the physical size computing formula of fracture width is: S=D*s/d;
Gap observation error is calculated by following formula:
m S 2 = ( s d ) 2 m D 2 + ( D d ) 2 m s 2 + ( S · D d 2 ) m d 2 Obtain.Wherein, s represents the tested fracture scale of image space, and d represents image space collimation mark yardstick, and S represents object space fracture scale, and D represents object space collimation mark yardstick, represent crack imaging medial error, represent that collimation mark demarcates medial error, represent collimation mark imaging medial error.
Memory module 104, for pluggable SD (storage card of based semiconductor flash technology) blocks or be integrated in the storage inside of device, for storing described crack pattern picture and described result map picture.SD card is a kind of storage card of based semiconductor flash technology, has the feature of Large Copacity, high-performance, safety.
Wireless communication module 105, for described result map picture is sent to destination address, GPRS (packet switching communication technology) or GSM (global system for mobile communications) communication mode is adopted to send when result map picture sends, when can effectively ensure like this to do industry outside, observation information is sent to assigned address in time, realize in office operation, and do the object of industry integration in outdoor.
Display screen 106; for showing the situation of described crack pattern picture or result map picture or described crack; and on described display screen 106, screen protective cover 1061 is set; screen protective cover 1061 can effectively protect display screen 106, and then effectively reduces in the scuffing of outside work to display screen 106.
USB interface, for reading the crack pattern picture in memory module 104 or result map picture or other data write in memory module 104.Battery is be no less than the chargeable high-capacity lithium battery of 1 piece, effectively can meet the demand that long-term field working equipment is powered.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1., based on a crack multiparameter observation device for close-range photogrammetry, it is characterized in that, comprising:
Image capture module, for obtaining the situation in crack, generates crack pattern picture;
Orientation determination module, for determining the orientation in described crack, and is marked on described crack pattern picture, generates marking image;
Image processing module, for analyzing described crack pattern picture, generating fracture parameters, and being marked on described marking image by described fracture parameters, generate result map picture;
Memory module, for storing described crack pattern picture and described result map picture.
2. device as claimed in claim 1, it is characterized in that, described image capture module comprises: focus digital camera lens and demarcating module, described in focus digital camera lens, for obtaining the situation in described crack; Described demarcating module, is made up of orthogonal two groups of triangle collimation marks, for demarcating image yardstick, and to the described distortion correction focusing digital camera lens.
3. device as claimed in claim 1, it is characterized in that, described orientation determination module comprises: GPS locator and electronic compass and double-shaft tilt angle sensor, described GPS locator, for obtaining the geographic position in described crack, and described geographic position is labeled on described crack pattern picture, described geographic position comprises longitude and latitude;
Described electronic compass, for determining the horizontal direction that described crack is grown in described geographic position, generating direction angle, and described position angle is labeled on described crack pattern picture;
Described double-shaft tilt angle sensor, for determining the vertical direction that described crack is grown in described geographic position, generating pitch angle, and being labeled on described crack pattern picture at described pitch angle.
4. device as claimed in claim 3, is characterized in that, described electronic compass is provided with obliquity sensor, and the horizontal direction that during for tilting to described electronic compass, measured described crack is grown in described geographic position compensates.
5. device as claimed in claim 1, it is characterized in that, described fracture parameters comprises: observation time and fracture width and observational error.
6. device as claimed in claim 1, it is characterized in that, described device is also provided with wireless communication module, for described result map picture is sent to destination address.
7. device as claimed in claim 6, is characterized in that, described result map picture is sent to destination address and adopts GPRS or GSM communication mode to carry out communication.
8. device as claimed in claim 1, it is characterized in that, described device is also provided with display screen, for showing the situation of described crack pattern picture or result map picture or described crack.
9. device as claimed in claim 8, is characterized in that, described display screen is provided with screen protective cover, for the protection of described display screen.
10. device as claimed in claim 1, it is characterized in that, described memory module is the internal memory or the SD card that are integrated in described device.
CN201510142878.3A 2015-03-30 2015-03-30 Crack multi-parameter observation device based on close-range photogrammetry Expired - Fee Related CN104931021B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510142878.3A CN104931021B (en) 2015-03-30 2015-03-30 Crack multi-parameter observation device based on close-range photogrammetry

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510142878.3A CN104931021B (en) 2015-03-30 2015-03-30 Crack multi-parameter observation device based on close-range photogrammetry

Publications (2)

Publication Number Publication Date
CN104931021A true CN104931021A (en) 2015-09-23
CN104931021B CN104931021B (en) 2017-06-30

Family

ID=54118299

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510142878.3A Expired - Fee Related CN104931021B (en) 2015-03-30 2015-03-30 Crack multi-parameter observation device based on close-range photogrammetry

Country Status (1)

Country Link
CN (1) CN104931021B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109373980A (en) * 2018-10-09 2019-02-22 福建汇川物联网技术科技股份有限公司 A kind of monitoring method and system based on video monitoring measuring instrument and deviational survey terminal
CN109990712A (en) * 2019-03-28 2019-07-09 唐山钢铁集团有限责任公司 A kind of width gage on-line calibration method
CN110657747A (en) * 2019-08-27 2020-01-07 中国十七冶集团有限公司 Laser scanning type crack observation instrument and observation method thereof
CN110987936A (en) * 2019-11-20 2020-04-10 天津大学 Dam surface crack intelligent identification measuring device towards unmanned aerial vehicle

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006242646A (en) * 2005-03-01 2006-09-14 Chuden Gijutsu Consultant Kk Earth fall monitoring system and rock mass anomaly measuring method
CN101275841A (en) * 2007-03-30 2008-10-01 爱信艾达株式会社 Feature information collecting apparatus and feature information collecting method
CN101788288A (en) * 2010-02-11 2010-07-28 长安大学 Positioning system and positioning method for pavement cracks
CN103234525A (en) * 2013-04-12 2013-08-07 王德荣 Geology shooting instrument
CN204612702U (en) * 2015-03-30 2015-09-02 重庆华地工程勘察设计院 Crack multi-parameter observation device based on close-range photogrammetry

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006242646A (en) * 2005-03-01 2006-09-14 Chuden Gijutsu Consultant Kk Earth fall monitoring system and rock mass anomaly measuring method
CN101275841A (en) * 2007-03-30 2008-10-01 爱信艾达株式会社 Feature information collecting apparatus and feature information collecting method
CN101788288A (en) * 2010-02-11 2010-07-28 长安大学 Positioning system and positioning method for pavement cracks
CN103234525A (en) * 2013-04-12 2013-08-07 王德荣 Geology shooting instrument
CN204612702U (en) * 2015-03-30 2015-09-02 重庆华地工程勘察设计院 Crack multi-parameter observation device based on close-range photogrammetry

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109373980A (en) * 2018-10-09 2019-02-22 福建汇川物联网技术科技股份有限公司 A kind of monitoring method and system based on video monitoring measuring instrument and deviational survey terminal
CN109990712A (en) * 2019-03-28 2019-07-09 唐山钢铁集团有限责任公司 A kind of width gage on-line calibration method
CN110657747A (en) * 2019-08-27 2020-01-07 中国十七冶集团有限公司 Laser scanning type crack observation instrument and observation method thereof
CN110987936A (en) * 2019-11-20 2020-04-10 天津大学 Dam surface crack intelligent identification measuring device towards unmanned aerial vehicle

Also Published As

Publication number Publication date
CN104931021B (en) 2017-06-30

Similar Documents

Publication Publication Date Title
EP2098820B1 (en) Geographical data collecting device
US8280677B2 (en) Geographical data collecting device
US8539685B2 (en) Integrated surveying and leveling
CN104779551B (en) Portable multi-function Intelligent line patrolling instrument and power-line patrolling system
CN105716593B (en) A kind of test device and method of testing for electro optical reconnaissance system direction and location accuracy test
CN104931021A (en) Crack multi-parameter observation device based on close-range photogrammetry
RU2705514C1 (en) Method of checking inclination compensation at rtk measurement accuracy
CN110057344A (en) Settle detection method and platform
CN104567816A (en) Panoramic normal-case forest sample plot photographing mobile phone device and tree measuring method thereof
KR101941501B1 (en) Acquisition system of location information for digital map
CN113654536B (en) National forest and grass monitoring method and device based on Beidou RTK, electronic equipment and computer readable storage medium
CN205051245U (en) Line appearance is patrolled to portable multi -functional intelligence
CN104236529A (en) Minitype forest observation photography super-station instrument and measuring method thereof
CN204612702U (en) Crack multi-parameter observation device based on close-range photogrammetry
CN111426304B (en) Accurate attitude positioning method based on vision, satellite positioning and GIS algorithm
CN103400498A (en) Accident spot map generation method based on electronic map and data acquisition system
CN204885997U (en) Line appearance is patrolled to portable multi -functional intelligence with solid function of making a video recording
KR101144200B1 (en) Map data collecting system for plotting instrument
CN107063180A (en) Portable Geotechnical Engineering dual-axis inclinometer
CN106895821B (en) A kind of settlement monitoring street lamp based on BEI-DOU position system
KR101223243B1 (en) Geodetic survey data management system
KR101329564B1 (en) Input apparatus for facilities information using a smart device, a method thereof, and a record medium where a program for executing the same is recorded
El-Ashmawy Accuracy, time cost and terrain independence comparisons of levelling techniques
CN107560606B (en) Free telescopic hidden point measuring device
CN201885703U (en) Oil derrick calibration instrument in oil field

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170630