CN114022536B - Leaf area solving method based on foundation laser radar point cloud data - Google Patents
Leaf area solving method based on foundation laser radar point cloud data Download PDFInfo
- Publication number
- CN114022536B CN114022536B CN202111207990.2A CN202111207990A CN114022536B CN 114022536 B CN114022536 B CN 114022536B CN 202111207990 A CN202111207990 A CN 202111207990A CN 114022536 B CN114022536 B CN 114022536B
- Authority
- CN
- China
- Prior art keywords
- leaf
- point
- blade
- cloud data
- point cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/28—Measuring arrangements characterised by the use of optical techniques for measuring areas
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Abstract
The invention belongs to the technical field of ground laser radar point cloud data processing, and particularly relates to a leaf area solving method based on ground laser radar point cloud data. The invention utilizes the Alpha-shape algorithm to construct polygons and polyhedrons from a pile of disordered three-dimensional points, thereby carrying out envelope surface fitting on the blade points with separated branches and leaves, reconstructing the surface of the blade and carrying out accurate blade area solution. The method can get rid of the dependence of the traditional physical model-based leaf area solving method on parameters, overcomes the difficulty of data acquisition caused by the complexity of the model, and has excellent precision of extracting the leaf area.
Description
Technical Field
The invention belongs to the technical field of ground laser radar point cloud data processing, and particularly relates to a leaf area solving method based on ground laser radar point cloud data, wherein an Alpha-shape algorithm is used for carrying out envelope surface fitting.
Background
Trees are important components in natural ecology, and the three-dimensional reconstruction of the trees has important application value in aspects of plant digital storage, scene rendering, agriculture and forestry research and the like (Livny et al, 2010;et al, 2012; bremer et al, 2013). The Leaf Area Index (LAI) is one half of the total area of the leaves per unit of surface area, and is one of the most important features of trees. For single woodIn this respect, the solution of the leaf area index is built on the solution of the leaf area of the single tree, and the measurement of the leaf area of the single tree is an indispensable part of the solution. The leaf area solving needs to obtain the area of each leaf from the laser radar point cloud data, and is an important premise for extracting the single-wood scale leaf area data. Due to the complexity of tree structure and leaf surface details, such as asymmetric branches, irregular epidermal shapes, complex-textured leaves, etc., it is difficult to accurately extract leaf information from only two-dimensional images. Therefore, the modern remote sensing technology faces new challenges in accurately and quickly obtaining the three-dimensional structural information of the vegetation.
The LiDAR (Light Detection And Ranging) is an active remote sensing technology which is developed rapidly in recent years, and mainly shows accurate three-dimensional structure information of a target object by measuring the propagation distance of laser Light emitted by a sensor between the sensor And the target object, analyzing information such as the size of reflection energy on the surface of the target object And the amplitude, frequency And phase of a reflection spectrum And the like. The ground-based three-dimensional Laser Scanner (TLS) has unique advantages of acquiring high-density and high-precision geometric structure information of the surface of a target object to be detected by observing the target object from different positions. In recent decades, the inversion and calculation of leaf area have been the hot direction for the research of laser radar forestry application. With the continuous improvement of the branch and leaf separation algorithm, the high spatial resolution of the foundation laser radar data has the capability of directly measuring the area of the leaf.
Scholars at home and abroad make a lot of researches on leaf areas by using ground-based laser radar data, and mainly use two inversion methods of Lambert-beer law and contact frequency. The first applicable scenario of lambert-beer law is a turbid solution, and the process of passing electromagnetic waves of a given frequency through a low-concentration solution is successfully described by using the assumption that extinction factors are randomly distributed.
Wherein I is the intensity of the emitted light, I 0 Is the intensity of the incident light, I/I0 is the proportion of light passing through the canopy, k is the extinction coefficient, ρ is the solute density in the solution, and l is the depth of the solution. By adjusting the form of the above formula, further:
since k · ρ · L represents the extinction area of a single solute multiplied by the number of solutes per unit area, the solutes are replaced by leaves, and k · ρ · L is the leaf area index LAI. The leaf area index is defined as the area of the blade per unit of ground, and thus multiplying the leaf area index by the ground surface area yields the leaf area. By solving and assuming that the leaf surface direction is the same as the electromagnetic wave propagation direction, the methodIs the gap ratio P. Thus, LAI can be solved by the following equation:
LAI=-ln(P)
but the gap rate P cannot be measured directly by LiDAR but needs to be derived by processing point cloud data. Forest et al (2018) solved the clearance ratio by a bin projection method by projecting the blade points into a unit hemispherical space and rasterizing the unit hemispherical space, the clearance ratio being the ratio of the grid projected by the blade points to the total grid number by statistics. However, the accuracy of this method is very sensitive to the grid size, and it is difficult to determine the optimal grid size for different data sets. Xushu sailing sails and the like (2021) simulate laser beams to detect canopies through a Monte Carlo method to obtain a numerical solution of the clearance rate, the precision of the numerical solution obtained by the method is related to the simulation times, and the method has limitation on obtaining the high-precision clearance rate of a large range of forest stands.
Disclosure of Invention
Aiming at the problems or the defects, the invention provides a leaf area solving method based on foundation laser radar point cloud data, aiming at solving the problem that the existing leaf area solving method has strong dependency on empirical parameters. The method gets rid of the constraint based on statistics and model assumptions in the past, fully utilizes the characteristic of high spatial resolution of the foundation laser radar, and solves the leaf area based on morphology.
A method for solving the leaf area based on foundation laser radar point cloud data comprises the following steps:
the point cloud data obtained by the laser radar scanning equipment is a sample of an object in the real world, so the point cloud data comprises different types of points such as tree points, ground points and the like. The leaf area solving method only aims at the leaf point cloud data, so that ground point filtering and branch and leaf separation processing are required to be carried out on the original foundation laser radar point cloud data, and the leaf point cloud data are extracted from the original foundation point cloud data to obtain the leaf points.
(1) Taking the leaf points obtained in the step 1 as input, setting default codes of the leaf points to be 0 and setting initial values to be 0In which a leaf point with code 0 is arbitrarily foundAnd setting the searched leaf code of the point as K, wherein K is more than or equal to 1, and the leaf codes of all points on the same leaf are the same.
The blade code marked as the point in the middle is 0 as each point code is the default code, and when a certain point determines the blade attribution, the blade code becomesThe subscript i represents that the point is the ith point in the corresponding code K set, and i is respectively numbered and assigned as the number of points in the K blades increases.
(2) Traversing the leaf point set with the code of 0, and solving each pointAnd points coded as KWith a minimum euclidean distance R therebetween min The calculation formula of the euclidean distance R is as follows:
wherein (x) a ,y a ,z a ),(x b ,y b ,z b ) Respectively representing the coordinates of a point a and a point b, which are respectively corresponding to the pointsAnd
if it is notAnd withMinimum Euclidean distance R between points min Less than a given threshold R th Wherein R is th The value of (A) is set to be 1 to 10 times of the spatial resolution of the ground-based laser radar data, the point is considered to beBelonging to the leaf coded K, willIs set to K and corresponding i, i
If it is usedAnd withIs the minimum euclidean distance R between points min Greater than R th If the point does not belong to the K blade, thenThe encoding of the dots remains unchanged.
Until there is no new point in one traversalAnd if the number is K, the leaf with the leaf number of K is considered to be completely divided.
(3) And if the set S with the code of 0 in the blade points is not empty, taking the set S at the moment as the input of (1), assigning the value of K to be K + m, wherein m is the cycle execution frequency of the step (2), and continuing to circularly execute the steps (1) to (2) until the set S is empty when the codes of all the blade points are not 0, namely the set S is empty, and executing the step 3.
utilizing Alpha-shape algorithm to establish envelope surface for each encoded point set obtained in step 2, and solving surface Area of each envelope surface K (where superscript indicates that the surface area is the surface area of the envelope created by the set of points encoded as K). Taking half of the surface area of the enveloping surface as the area of the blade.
and (4) accumulating the blade areas of all the numbered blades obtained in the step (3) to obtain the total blade area. The specific physical meaning of the total leaf area is determined by the input point cloud data: if the input point cloud data is point cloud data of a single tree, the obtained total leaf area is the total leaf area of the single tree; and if the input point cloud data is point cloud data of the forest stand, the obtained total leaf area is the total leaf area of the forest stand.
Further, R in the step 2 th The spatial resolution of the foundation laser radar point cloud data is set to be 2-3 times, so that the guarantee of high precision of technical results and the consideration of relatively low solving complexity are ensured.
Firstly, extracting leaf points from point cloud data, and separating leaf points and non-leaf points from original foundation laser radar point cloud; then, single-leaf segmentation is carried out to obtain a point set of each leaf; then carrying out envelope surface fitting on the blade point data obtained after the single-blade segmentation to obtain the surface area of an envelope surface, and taking half of the surface area as the blade area of the blade; finally, the total leaf area of the whole sample is obtained by accumulating the leaf areas of the leaves, and the flow is shown in fig. 1.
The method comprises the steps of obtaining tree blade three-dimensional laser point cloud data by using a foundation laser radar, analyzing gaps among blades according to morphological characteristics of the blades, extracting blade points, segmenting single blades, fitting an envelope surface, solving blade area and solving total blade area according to the relation between the points, and establishing the method for extracting the total blade area from the blade points based on the original foundation laser point cloud. The invention utilizes the Alpha-shape algorithm to construct polygons and polyhedrons from a pile of unordered three-dimensional points, so that the envelope surface fitting is carried out on the blade points after the branches and the leaves are separated, the surface of the blade is reconstructed, and the accurate area of the blade is solved, which has very important significance for forest management.
In conclusion, the method can get rid of the dependence of the traditional physical model-based leaf area solving method on parameters, overcome the difficulty in data acquisition caused by the complexity of the model, and has excellent precision in leaf area extraction.
Drawings
FIG. 1 is a schematic flow diagram of the present invention;
FIG. 2 is a graph showing the results of single-leaf segmentation in the example;
FIG. 3 is a diagram of envelope surface fitting of each blade based on Alpha-shape algorithm according to the embodiment.
Detailed Description
The invention is described in further detail below by way of example with reference to the accompanying drawings:
the development environment is MATLAB and Dev-C + +5.11, and the programming language is MATLAB and C + + mixed programming.
And 2, according to the first step of the technical scheme, extracting the blade points after the original foundation laser point cloud is obtained, removing noise points in the point cloud data, and dividing the blade points and non-blade points from the point cloud data.
And 3, according to the step one of the technical scheme, performing single-leaf segmentation on the leaf points obtained in the step 2, and obtaining 7 leaves by total segmentation (as shown in fig. 2).
And 4, carrying out envelope surface fitting (shown in figure 3) based on an Alpha-shape algorithm on each leaf, and solving the area of the envelope surface. The area of the envelope surface of each blade is shown in table 1, and the area of each blade is measured by manual cutting.
TABLE 1 blade surface results
And 5, accumulating the areas of the blades to obtain the total blade area, wherein the total blade area of the seven blades in the experiment is 402.3 square centimeters, the total blade area of the seven blades obtained through measurement is 394.7 square centimeters, and the relative error is 2 percent.
According to the embodiments, the three-dimensional laser point cloud data of the tree leaves are obtained by using the foundation laser radar, gaps among the leaves are analyzed according to morphological characteristics of the leaves, and the total leaf area is extracted from the leaf points based on the original foundation laser point cloud established through leaf point extraction, single leaf segmentation, envelope surface fitting, leaf area solving and total leaf area solving according to the relation between points. The method can get rid of the dependence of the traditional physical model-based leaf area solving method on parameters, overcomes the difficulty of data acquisition caused by the complexity of the model, and has excellent precision of extracting the leaf area.
Claims (2)
1. A method for solving a leaf area based on foundation laser radar point cloud data is characterized by comprising the following steps:
step 1, extracting blade point cloud data of foundation laser radar point cloud data:
carrying out ground point filtering and branch and leaf separation processing on original foundation laser radar point cloud data of a target area, and extracting leaf point cloud data from the original foundation laser radar point cloud data to obtain leaf points;
step 2, single-leaf segmentation:
(1) Taking the leaf points obtained in the step 1 as the outputIn, default code of leaf point is 0 and all set initial value asIn which a leaf point with code 0 is arbitrarily foundSetting the searched leaf code of the point as K, wherein K is more than or equal to 1, and the leaf codes of all points on the same leaf are the same;
the blade code marked as the point in the middle is 0 as each point code is the default code, and when a certain point determines the blade attribution, the blade code becomesSubscript i represents that the point is the ith point in the corresponding coding K set, and i is respectively numbered and assigned with the increasing of the number of points in the K blades;
(2) Traversing the leaf point set with the code of 0 and solving each pointAnd points coded as KWith a minimum euclidean distance R therebetween min The calculation formula of the euclidean distance R is as follows:
wherein (x) a ,y a ,z a ),(x b ,y b ,z b ) Respectively represent the coordinates of a point a and a point b, and the points a and b respectively correspond to the pointsAnd
if it is notAndminimum Euclidean distance R between points min Less than a given threshold R th Wherein R is th The value of (A) is set to be 1 to 10 times of the spatial resolution of the ground-based laser radar data, the point is considered to beBelonging to the leaf coded K, willIs set to K and corresponding i, i
If it is notAndis the minimum euclidean distance R between points min Greater than R th If the point is not the K blade, thenThe occupied code remains unchanged;
until there is no new point in one traversalIf the blade is coded as K, the blade coded as K is considered to be completely divided;
(3) If the set S with the code of 0 in the blade points is not empty, taking the set S at the moment as the input of (1), assigning the value of K to be K + m, wherein m is the cycle execution frequency of the step (2), and continuing to circularly execute the steps (1) to (2) until the set S is empty when the codes of all the blade points are not 0, and executing the step 3;
step 3, solving the blade area of the blade:
utilizing Alpha-shape algorithm to establish envelope surface for each encoded point set obtained in step 2, and solving surface Area of each envelope surface K Wherein the superscript indicates that the surface area is the surface area of an envelope surface established by a point set encoded as K, and half of the surface area of the envelope surface is taken as the blade area of the blade;
step 4, solving the total leaf area:
accumulating the leaf areas of all numbered leaves obtained in the step (3) to obtain the total leaf area;
the specific physical meaning of the total leaf area is determined by the input point cloud data: if the input point cloud data is point cloud data of a single tree, the obtained total leaf area is the total leaf area of the single tree; and if the input point cloud data is point cloud data of the forest stand, the obtained total leaf area is the total leaf area of the forest stand.
2. The method of claim 1 for solving leaf area based on ground-based lidar point cloud data, wherein:
r in the step 2 th Setting the spatial resolution of the foundation laser radar point cloud data to be 2-3 times.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111207990.2A CN114022536B (en) | 2021-10-18 | 2021-10-18 | Leaf area solving method based on foundation laser radar point cloud data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111207990.2A CN114022536B (en) | 2021-10-18 | 2021-10-18 | Leaf area solving method based on foundation laser radar point cloud data |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114022536A CN114022536A (en) | 2022-02-08 |
CN114022536B true CN114022536B (en) | 2023-03-10 |
Family
ID=80056357
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111207990.2A Active CN114022536B (en) | 2021-10-18 | 2021-10-18 | Leaf area solving method based on foundation laser radar point cloud data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114022536B (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104457626A (en) * | 2014-12-08 | 2015-03-25 | 中国科学院合肥物质科学研究院 | Plant leaf area index measurement method based on laser radar point cloud technology |
CN105806266A (en) * | 2016-05-24 | 2016-07-27 | 南京林业大学 | Tree canopy leaf area calculation method based on laser scanning data |
CN110223314A (en) * | 2019-06-06 | 2019-09-10 | 电子科技大学 | A kind of single wooden dividing method based on the distribution of tree crown three-dimensional point cloud |
CN111667529A (en) * | 2020-05-25 | 2020-09-15 | 东华大学 | Plant point cloud blade segmentation and phenotype characteristic measurement method |
CN112348829A (en) * | 2020-11-02 | 2021-02-09 | 东华理工大学 | Method for separating branches and leaves of ground LiDAR point cloud based on modal point evolution |
CN112907520A (en) * | 2021-02-05 | 2021-06-04 | 南京林业大学 | Single tree crown detection method based on end-to-end deep learning method |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102009023896B4 (en) * | 2009-06-04 | 2015-06-18 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for detecting a plant |
-
2021
- 2021-10-18 CN CN202111207990.2A patent/CN114022536B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104457626A (en) * | 2014-12-08 | 2015-03-25 | 中国科学院合肥物质科学研究院 | Plant leaf area index measurement method based on laser radar point cloud technology |
CN105806266A (en) * | 2016-05-24 | 2016-07-27 | 南京林业大学 | Tree canopy leaf area calculation method based on laser scanning data |
CN110223314A (en) * | 2019-06-06 | 2019-09-10 | 电子科技大学 | A kind of single wooden dividing method based on the distribution of tree crown three-dimensional point cloud |
CN111667529A (en) * | 2020-05-25 | 2020-09-15 | 东华大学 | Plant point cloud blade segmentation and phenotype characteristic measurement method |
CN112348829A (en) * | 2020-11-02 | 2021-02-09 | 东华理工大学 | Method for separating branches and leaves of ground LiDAR point cloud based on modal point evolution |
CN112907520A (en) * | 2021-02-05 | 2021-06-04 | 南京林业大学 | Single tree crown detection method based on end-to-end deep learning method |
Non-Patent Citations (5)
Title |
---|
Hangkai You 等.Leaf Area Index Retrieval for Broadleaf Trees by Envelope Fitting Method Using Terrestrial Laser Scanning Data.2022,第19卷1-5. * |
Ronghai Hu 等.Estimating the leaf area of an individual tree in urban areas using terrestrial laser scanner and path length distribution model.2018,第144卷357-368. * |
张美娜 等.基于三维激光点云的靶标叶面积密度计算方法.2017,第48卷(第11期),172-178. * |
苏伟 等.基于地基激光雷达的玉米真实叶面积提取方法研究.2016,第47卷(第07期),345-353. * |
苏宝峰 等.基于三维点云的叶面积估算方法.2019,第50卷(第12期),240-246+254. * |
Also Published As
Publication number | Publication date |
---|---|
CN114022536A (en) | 2022-02-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107274417B (en) | Single tree segmentation method based on airborne laser point cloud aggregation relation | |
CN110223314B (en) | Single tree segmentation method based on tree crown three-dimensional point cloud distribution | |
CN107479065A (en) | A kind of three-dimensional structure of forest gap method for measurement based on laser radar | |
CN104484882A (en) | City region power line detection method based on airborne LiDAR (light detection and ranging) data | |
Li et al. | Retrieval of tree branch architecture attributes from terrestrial laser scan data using a Laplacian algorithm | |
CN104050474A (en) | Method for automatically extracting island shoreline based on LiDAR data | |
CN106157309A (en) | A kind of airborne LiDAR ground point cloud filtering method based on virtual Seed Points | |
Bucksch et al. | Breast height diameter estimation from high-density airborne LiDAR data | |
WO2022067598A1 (en) | Method of individual tree crown segmentation from airborne lidar data using novel gaussian filter and energy function minimization | |
Lin et al. | Estimating aboveground biomass of urban forest trees with dual-source UAV acquired point clouds | |
CN110765962A (en) | Plant identification and classification method based on three-dimensional point cloud contour dimension values | |
Hu et al. | A fast and simple method of building detection from LiDAR data based on scan line analysis | |
Ni et al. | Joint clusters and iterative graph cuts for ALS point cloud filtering | |
Li et al. | A new approach for estimating living vegetation volume based on terrestrial point cloud data | |
Sun et al. | Feasibility study on the estimation of the living vegetation volume of individual street trees using terrestrial laser scanning | |
CN114022536B (en) | Leaf area solving method based on foundation laser radar point cloud data | |
Jochem et al. | Object detection in airborne LIDAR data for improved solar radiation modeling in urban areas | |
You et al. | Segmentation of individual mangrove trees using UAV-based LiDAR data | |
Reddy et al. | Automatic tree identification and diameter estimation using single scan terrestrial laser scanner data in central indian forests | |
Lin et al. | A multilevel slicing based coding method for tree detection | |
Bao et al. | Synchronous estimation of DTM and fractional vegetation cover in forested area from airborne LIDAR height and intensity data | |
CN111369604A (en) | Grid-based topographic feature point extraction method and processing terminal | |
CN116503727A (en) | Vegetation aggregation index estimation method based on Poisson distribution and point cloud clustering | |
Wan et al. | Plot-level wood-leaf separation of trees using terrestrial LiDAR data based on a segmentwise geometric feature classification method | |
Eto et al. | Precise Calculation Of Cross Sections And Volume For Tree Stem Using Point Clouds |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |