CN103018728B - Laser radar real-time imaging and building characteristic extracting method - Google Patents

Laser radar real-time imaging and building characteristic extracting method Download PDF

Info

Publication number
CN103018728B
CN103018728B CN201210479031.0A CN201210479031A CN103018728B CN 103018728 B CN103018728 B CN 103018728B CN 201210479031 A CN201210479031 A CN 201210479031A CN 103018728 B CN103018728 B CN 103018728B
Authority
CN
China
Prior art keywords
laser
line
scanning line
ideal
elevation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201210479031.0A
Other languages
Chinese (zh)
Other versions
CN103018728A (en
Inventor
徐立军
李小路
孔德明
李端
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beihang University
Original Assignee
Beihang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beihang University filed Critical Beihang University
Priority to CN201210479031.0A priority Critical patent/CN103018728B/en
Publication of CN103018728A publication Critical patent/CN103018728A/en
Application granted granted Critical
Publication of CN103018728B publication Critical patent/CN103018728B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

本发明公开了一种激光雷达实时成像和建筑物特征提取的方法。将激光雷达获得的扫描线上的激光脚点映射至其理想扫描线上;对理想扫描线进行栅格化处理;通过线性插值方法,得到理想扫描线上各个栅格位置处的高程信息;通过对理想扫描线中的高程信息进行灰度化处理,实现对扫描线所对应的探测区域进行成像;利用离散平稳小波变换提取出理想扫描线中的建筑物特征信息。利用上述方法将激光雷达点云数据中的激光脚点按照其各自所属的扫描线逐条进行处理,实现在激光雷达扫描过程中进行实时成像、建筑物特征提取等操作。

The invention discloses a method for laser radar real-time imaging and building feature extraction. Map the laser feet on the scanning line obtained by the lidar to its ideal scanning line; rasterize the ideal scanning line; obtain the elevation information at each grid position on the ideal scanning line through linear interpolation; The elevation information in the ideal scan line is gray-scaled to realize imaging of the detection area corresponding to the scan line; the feature information of buildings in the ideal scan line is extracted by discrete stationary wavelet transform. Using the above method, the laser footpoints in the lidar point cloud data are processed one by one according to their respective scanning lines, so as to realize real-time imaging and building feature extraction during the lidar scanning process.

Description

一种激光雷达实时成像和建筑物特征提取的方法A method of lidar real-time imaging and building feature extraction

【技术领域】【Technical field】

本发明涉及遥感测绘领域,尤其是一种激光雷达实时成像和建筑物特征提取的方法。The invention relates to the field of remote sensing surveying and mapping, in particular to a method for laser radar real-time imaging and building feature extraction.

【背景技术】【Background technique】

建筑物作为三维地理信息系统中的重要组成部分,由于其具有相对固定的位置和相对规则的外形,通常将其作为激光雷达点云数据中的重要标定物。因此,在激光雷达点云数据的处理过程中,如何实时、准确地提取出其中所包含的建筑物位置信息和顶面类型信息是一项急需解决的重要问题。目前,针对激光雷达点云数据进行滤波、分割处理的方法基本上都是采用“后处理”的方式,如:数学形态学滤波方法、三角网格滤波方法、区域生长方法、随机采样一致性方法和K-means聚类分析方法等。这些方法较为适合于处理片状点云数据,虽然具有较高的精度,但所需的运算时间较长,很难满足在扫描过程中进行实时成像和建筑物特征提取的需求。As an important part of the 3D geographic information system, buildings are usually used as important calibration objects in lidar point cloud data due to their relatively fixed positions and relatively regular shapes. Therefore, in the process of processing lidar point cloud data, how to extract the building location information and top surface type information contained in it in real time and accurately is an important problem that needs to be solved urgently. At present, the methods for filtering and segmenting lidar point cloud data basically adopt the "post-processing" method, such as: mathematical morphology filtering method, triangular mesh filtering method, region growing method, random sampling consistency method And K-means cluster analysis method, etc. These methods are more suitable for processing flake point cloud data. Although they have high precision, they require a long calculation time, and it is difficult to meet the needs of real-time imaging and building feature extraction during the scanning process.

在胡翔云、李小凯申请的发明专利(申请号:201110337099.0)所述方法中,激光雷达的点云数据被按照其所包含的各条扫描线分别进行滤波处理。借助于该方法可以在激光雷达的扫描过程中对点云数据进行实时处理,但该方法无法满足实时成像和建筑物特征提取等处理要求。在郝泳涛申请的发明专利(申请号:200710045734.1)所述方法中,离散小波变换被应用于二维激光雷达点云数据处理中。但在该所述方法中小波变换仅被作为一种去噪方式,并不涉及地面及建筑物的分类和建筑物特征提取等处理。In the method described in the invention patent (application number: 201110337099.0) applied by Hu Xiangyun and Li Xiaokai, the point cloud data of the lidar is filtered according to each scanning line it contains. With the help of this method, point cloud data can be processed in real time during the scanning process of lidar, but this method cannot meet the processing requirements of real-time imaging and building feature extraction. In the method described in the invention patent (application number: 200710045734.1) applied by Hao Yongtao, the discrete wavelet transform is applied to the two-dimensional laser radar point cloud data processing. But in this method, the wavelet transform is only used as a denoising method, and does not involve the classification of the ground and buildings and the extraction of building features.

在本发明所述方法中,对在激光雷达扫描过程中完成扫描的一条扫描线,利用最小二乘拟合方法计算出其所对应的理想扫描直线,将扫描线上的激光脚点映射到理想扫描直线上。通过栅格化和线性插值的方法,根据各条理想扫描线上激光脚点的高程值计算出各条理想扫描线上栅格位置的高程值,从而,将各条扫描线上激光脚点的位置和高程值转换为一组规则的高程值序列。利用平稳离散小波变换对高程值序列进行分析,从获得的小波细节系数中提取出建筑物位置信息和顶面类型信息等。通过时空关联性分析,利用相邻扫描线上的高程值和小波细节系数等对各条扫描线的提取结果进行校验,保证数据提取的准确性。与传统点云数据处理方法相比,本发明所提的方法具有可以在激光雷达扫描过程中对点云数据进行实时处理的特点,所获得的处理结果的数据更新频率等于所采用激光雷达的线扫描频率。In the method of the present invention, for a scanning line that is scanned during the laser radar scanning process, the corresponding ideal scanning line is calculated by using the least squares fitting method, and the laser foot point on the scanning line is mapped to the ideal scanning line. Scan in a straight line. By means of rasterization and linear interpolation, the elevation values of the grid positions on each ideal scanning line are calculated according to the elevation values of the laser foot points on each ideal scanning line. The position and elevation values are converted to a regular set of sequences of elevation values. The elevation sequence is analyzed by stationary discrete wavelet transform, and the building location information and roof type information are extracted from the obtained wavelet detail coefficients. Through spatio-temporal correlation analysis, the extraction results of each scanning line are verified by using the elevation value and wavelet detail coefficient on adjacent scanning lines to ensure the accuracy of data extraction. Compared with the traditional point cloud data processing method, the method proposed in the present invention has the characteristics that the point cloud data can be processed in real time during the laser radar scanning process, and the data update frequency of the obtained processing results is equal to the line rate of the laser radar used. scanning frequency.

【发明内容】【Content of invention】

本发明是一种激光雷达实时成像和建筑物特征提取的方法。利用最小二乘拟合方法计算出激光雷达点云数据中各条扫描线的理想直线表达式。利用栅格化和线性插值的方法计算出理想直线上各个栅格位置对应的高程值。利用离散平稳小波变换提取出各条扫描线高程值序列的高程变化信息,并从中提取出建筑物边缘位置信息,以及建筑物的顶面类型信息。利用灰度化的方法对各条扫描线的高程值序列和小波细节系数进行灰度值计算,得出其所对应探测区域的实时图像信息。利用时空关联性方法分析相邻扫描线上对应栅格位置的高程值、小波细节系数以及建筑物位置信息和建筑物的顶面类型信息,对所得到的点云数据提取结果进行校验,提高建筑物特征提取的准确度。The invention is a method for laser radar real-time imaging and building feature extraction. The ideal straight line expression of each scanning line in the lidar point cloud data is calculated by using the least squares fitting method. The elevation value corresponding to each grid position on the ideal straight line is calculated by means of rasterization and linear interpolation. Using discrete stationary wavelet transform to extract the elevation change information of each scanning line elevation value sequence, and extract the edge position information of the building and the top surface type information of the building. Using the method of grayscale to calculate the grayscale value of the elevation value sequence and wavelet detail coefficient of each scanning line, the real-time image information of the corresponding detection area is obtained. Use the time-space correlation method to analyze the elevation value of the corresponding grid position on the adjacent scanning line, the wavelet detail coefficient, the building position information and the top surface type information of the building, and verify the obtained point cloud data extraction results to improve Accuracy of building feature extraction.

本发明的技术方案是这样实现的:Technical scheme of the present invention is realized like this:

本发明的一种激光雷达实时成像和建筑物特征提取的方法,步骤如下:A kind of laser radar real-time imaging and the method for building feature extraction of the present invention, the steps are as follows:

步骤一、对点云数据中同属于一条扫描线的激光脚点在xoy平面内进行直线化处理。Step 1. Linearize the laser footpoints belonging to the same scan line in the point cloud data in the xoy plane.

理想条件下,激光雷达通过扫描机构中棱镜转动所获得的一条扫描线上的激光脚点在笛卡尔三维xyz坐标系内的xoy平面上应该较为均匀地分布在同一条直线上。但是在实际情况中,由于地面物体的高程变化,以及激光雷达载荷平台在复杂气流影响下出现的航向角、侧滚角和俯仰角偏差,各条扫描线上的激光脚点与其理想扫描线之间存在一定的距离偏差。在激光雷达扫描过程中,利用最小二乘拟合方法计算出实际获得扫描线所对应的理想扫描线方程,使在xoy平面内,扫描线上所有激光脚点到该理想直线的距离平方和最小。计算各个激光脚点在xoy平面内与该理想直线的垂线,并以各条垂线与该理想直线在xoy平面内的交点坐标作为各个激光脚点经过直线化处理后的x轴和y轴坐标。Under ideal conditions, the laser footpoints on a scanning line obtained by the laser radar through the rotation of the prism in the scanning mechanism should be relatively evenly distributed on the same straight line on the xoy plane in the Cartesian three-dimensional xyz coordinate system. However, in actual situations, due to the elevation changes of ground objects and the deviation of the heading angle, roll angle, and pitch angle of the lidar payload platform under the influence of complex airflow, the distance between the laser foot point on each scanning line and its ideal scanning line There is a certain distance difference between them. During the laser radar scanning process, the ideal scan line equation corresponding to the actually obtained scan line is calculated by using the least square fitting method, so that in the xoy plane, the sum of the squares of the distances from all laser foot points on the scan line to the ideal line is the smallest . Calculate the perpendicular line between each laser foot point and the ideal line in the xoy plane, and take the intersection coordinates of each vertical line and the ideal line in the xoy plane as the x-axis and y-axis of each laser foot point after linearization coordinate.

步骤二、在理想扫描线上,对直线化处理后的激光脚点进行高程值栅格化处理。Step 2: On the ideal scanning line, perform rasterization processing of elevation values on the linearized laser footpoints.

经过直线化处理后,理想扫描线上的激光脚点为一直线形式分布,以各个激光脚点在该直线上的间距的平均值作为栅格的间距值。以该间距值将直线从第一个激光脚点开始分割成若干栅格。利用直线上各个激光脚点的高程值,采用线性插值的方法,计算出该理想直线上各个栅格位置处的高程值。After linearization, the laser footpoints on the ideal scanning line are distributed in a straight line, and the average value of the spacing of each laser footpoint on the straight line is used as the grid spacing value. Divide the line from the first laser foot point into several grids with this spacing value. Using the elevation value of each laser foot point on the straight line, the elevation value at each grid position on the ideal straight line is calculated by using the method of linear interpolation.

步骤三、基于平稳小波变换的激光雷达实时成像和建筑物特征提取处理。Step 3, real-time imaging of laser radar and extraction of building features based on stationary wavelet transform.

通过步骤一和步骤二中的直线化和高程值栅格化等操作,将扫描线上的激光脚点转化为规则的离散高程数据序列,采用离散平稳小波变换对其进行处理,按照所得的小波细节系数的特征,提取其中所包含的建筑物边缘位置信息,以及建筑物的顶面类型信息。通过灰度化的方法,计算出栅格化后的规则离散高程数据序列和小波细节系数的灰度值。在激光雷达的扫描过程中,按照上述方法对其所获得的每条扫描线上的激光脚点数据进行实时处理,从而实现对对应探测区域进行实时成像。Through operations such as linearization and elevation value rasterization in step 1 and step 2, the laser footpoints on the scanning line are converted into regular discrete elevation data sequences, which are processed by discrete stationary wavelet transform. According to the obtained wavelet The feature of the detail coefficient extracts the edge position information of the building contained in it, as well as the top surface type information of the building. Through the method of grayscale, the grayscale value of the regular discrete elevation data sequence and wavelet detail coefficient after rasterization is calculated. During the scanning process of the laser radar, the laser footpoint data obtained on each scanning line is processed in real time according to the above method, so as to realize real-time imaging of the corresponding detection area.

步骤四、采用时空关联性分析的方法对各条扫描线的提取结果进行校验。Step 4, verifying the extraction results of each scanning line by using the method of spatio-temporal correlation analysis.

通过步骤三的操作,可以实时提取出各条扫描线激光脚点中所包含建筑物边缘位置信息和建筑物顶面类型信息,并可以根据各扫描线的高程信息和小波细节系数,对其所对应的探测区域进行实时成像。但每条扫描线上的高程信息仅来自于激光雷达的扫描方向,而不包含其载荷平台行进方向上的信息。因此,利用时空关联性分析的方法对扫描过程中各条相邻扫描线上对应的栅格位置的高程值、小波细节系数以及其包含的各个建筑物的位置和顶面类型信息进行分析和校验,提高建筑物特征提取的准确性。Through the operation of step 3, the building edge position information and building top surface type information contained in the laser foot points of each scanning line can be extracted in real time, and can be calculated according to the elevation information and wavelet detail coefficient of each scanning line. The corresponding detection area is imaged in real time. However, the elevation information on each scan line only comes from the scanning direction of the lidar, and does not include the information in the direction of travel of the load platform. Therefore, the method of spatio-temporal correlation analysis is used to analyze and correct the elevation value, wavelet detail coefficient and the position and top surface type information of each building in the corresponding grid position on each adjacent scanning line during the scanning process. To improve the accuracy of building feature extraction.

本发明的有益效果:利用平面直线化和高程值栅格化等处理方法,将点云数据中各条扫描线上无序、不规则的激光脚点转化为一组组规则的高程离散序列。利用离散平稳小波对高程离散序列进行分析。相比于传统的激光雷达点云数据处理方法,本发明可以在激光雷达扫描过程中实时地进行成像和建筑物特征提取处理。借助于时空关联性分析,利用相邻扫描线上对应栅格位置的高程值和小波细节系数对所获得的各条扫描线上的建筑物位置和建筑物顶面类型等信息进行校验,保证采用本发明所述方法进行激光雷达点云数据处理的准确性。Beneficial effects of the present invention: By using processing methods such as plane linearization and elevation value rasterization, the disordered and irregular laser foot points on each scanning line in the point cloud data are converted into a group of regular elevation discrete sequences. Using discrete stationary wavelet to analyze the elevation discrete sequence. Compared with the traditional laser radar point cloud data processing method, the present invention can perform imaging and building feature extraction processing in real time during the laser radar scanning process. With the help of spatio-temporal correlation analysis, use the elevation value of the corresponding grid position on the adjacent scanning line and the wavelet detail coefficient to verify the information such as the location of the building on each scanning line and the type of the top surface of the building to ensure that The accuracy of laser radar point cloud data processing by adopting the method of the invention.

【说明书附图】【Instructions attached】

图1是本发明所述的一种激光雷达实时成像和建筑物特征提取的方法的示意图;Fig. 1 is a schematic diagram of a method for real-time imaging of laser radar and feature extraction of buildings according to the present invention;

图2是利用本发明所述方法对一真实激光雷达点云数据进行处理的具体实施例的示意图。Fig. 2 is a schematic diagram of a specific embodiment of processing a real lidar point cloud data by using the method of the present invention.

【具体实施方式】【Detailed ways】

本发明的一种激光雷达实时成像和建筑物特征提取的方法,步骤如下:A kind of laser radar real-time imaging and the method for building feature extraction of the present invention, the steps are as follows:

步骤一、对点云数据中同属于一条扫描线的激光脚点在xoy平面内进行直线化处理。Step 1. Linearize the laser footpoints belonging to the same scan line in the point cloud data in the xoy plane.

理想条件下,激光雷达通过扫描机构中棱镜的转动获得的一条扫描线上的激光脚点在xoy平面上应该较为均匀地分布在同一条直线上。但是在实际情况中,由于地面物体的高程变化,以及扫描机构载荷平台在复杂气流影响下出现的航向角、侧滚角和俯仰角偏差,各条扫描线上的激光脚点与其理想扫描线之间存在一定的距离偏差。在复杂外界条件的影响下,第k条扫描线上的激光脚点通常分布于其理想扫描线的周围。第k条扫描线对应的理想扫描线Lk在xoy平面上的数学表达式可以被定义为:y=ax+b。将激光脚点Pi(i∈[0,N],且i∈Z)在xoy平面上与其所属的理想扫描线之间的距离记为dist(Lk,Pi)。将第k条扫描线上的全部N+1个激光脚点与理想扫描线之间的距离平方和定义为目标函数sumdistLk

Figure BDA00002447350600031
利用最小二乘拟合方法计算出当目标函数sumdistLk取最小值时理想扫描线Lk的相关参数:a和b的值。将这N+1个激光脚点的x轴和y轴坐标分别映射至该理想扫描线上,并将激光脚点Pi(xi,yi)在扫描线Lk上直线化的结果定义为P′i(x′i,y′i)。根据Pi,P′i和Lk之间的关系,建立方程组: dist ( L k , P i ) = ( y i - y i ′ ) 2 + ( x i - x i ′ ) 2 ( y i - y i ′ ) ( x i - x i ′ ) · a = - 1 , 通过对方程组进行求解,计算出P′i点的x轴和y轴坐标:(x′i,y′i)。对第k条扫描线上的N+1个激光脚点均采用这样的方式进行处理,完成其在xoy平面上的直线化处理过程。Under ideal conditions, the laser feet on a scanning line obtained by the lidar through the rotation of the prism in the scanning mechanism should be relatively evenly distributed on the same straight line on the xoy plane. However, in actual situations, due to the elevation change of ground objects and the deviation of the heading angle, roll angle, and pitch angle of the loading platform of the scanning mechanism under the influence of complex airflow, the distance between the laser foot point on each scanning line and its ideal scanning line There is a certain distance difference between them. Under the influence of complex external conditions, the laser footpoints on the kth scanning line are usually distributed around the ideal scanning line. The mathematical expression of the ideal scan line L k corresponding to the kth scan line on the xoy plane can be defined as: y=ax+b. The distance between the laser footpoint P i (i∈[0, N], and i∈Z) on the xoy plane and the ideal scanning line to which it belongs is recorded as dist(L k , P i ). The sum of the squares of the distances between all N+1 laser foot points on the kth scan line and the ideal scan line is defined as the objective function sumdistL k :
Figure BDA00002447350600031
The relevant parameters of the ideal scan line L k when the objective function sumdistL k takes the minimum value are calculated by using the least square fitting method: the values of a and b. Map the x-axis and y-axis coordinates of the N+1 laser footpoints to the ideal scanning line respectively, and define the result of linearizing the laser footpoint P i ( xi , y i ) on the scanning line L k is P′ i (x′ i , y′ i ). According to the relationship between P i , P′ i and L k , establish a system of equations: dist ( L k , P i ) = ( the y i - the y i ′ ) 2 + ( x i - x i ′ ) 2 ( the y i - the y i ′ ) ( x i - x i ′ ) · a = - 1 , By solving the equations, the x-axis and y-axis coordinates of point P′ i are calculated: (x′ i , y′ i ). The N+1 laser foot points on the k-th scanning line are all processed in this way, and the linearization process on the xoy plane is completed.

步骤二、对直线化处理后的激光脚点进行高程值栅格化处理。Step 2: Rasterizing the elevation value of the linearized laser footpoints.

经过直线化处理后,第k条理想扫描线上的激光脚点之间的水平距离呈离散、不均匀分布。为简化计算复杂度,提高运算速度,将各个被映射激光脚点的三维坐标简化为在包含Lk并且垂直于xoy平面的剖平面上的二维坐标,并对直线化后的各个激光脚点所包含的高程信息进行栅格化。将理想扫描线起始位置处的激光脚点P′0(x′0,y′0,z0)的二维坐标形式定义为P′0(X0,z0),并将其作为栅格的起始位置G0(0,z0),其中z0为P′0点的高程值。通过计算其它激光脚点与栅格起始位置之间的距离,得出其各自在剖平面上的横坐标Xi

Figure BDA00002447350600041
将栅格间距grid定义为理想扫描线Lk上的N+1个激光脚点的平均点间距:
Figure BDA00002447350600042
通过线性插值的方法,将理想扫描线上的激光脚点的高程值信息映射至等间隔分布的各个栅格位置处。栅格位置Gi处的横坐标为i·grid,将其高程信息定义为z′i。Gi与在理想扫描线上其两侧最邻近激光脚点P′i-1(Xi-1,zi-1)和P′i(Xi,zi)的位置和高程信息之间的关系可以表示为:
Figure BDA00002447350600043
进而求解出Gi处的高程信息z′i
Figure BDA00002447350600044
按照该方法,对Lk上所有栅格位置的高程值进行计算,其中,栅格序列左右两端点由于不满足存在两侧最邻近激光脚点的条件,直接以其最邻近激光脚点的高程值对其进行赋值。通过上述处理方法,Lk上原本不均匀、散乱分布在三维空间中的激光脚点被映射为二维空间内的规则离散数学序列。After linearization, the horizontal distance between the laser feet on the k ideal scanning line is discrete and unevenly distributed. In order to simplify the calculation complexity and improve the calculation speed, the three-dimensional coordinates of each mapped laser foot point are simplified to two-dimensional coordinates on the section plane that contains L k and is perpendicular to the xoy plane, and each laser foot point after linearization The included elevation information is rasterized. Define the two-dimensional coordinate form of the laser foot point P′ 0 (x′ 0 , y′ 0 , z 0 ) at the starting position of the ideal scanning line as P′ 0 (X 0 , z 0 ), and use it as the grid The starting position G 0 (0, z 0 ) of the grid, where z 0 is the elevation value of point P′ 0 . By calculating the distance between other laser foot points and the starting position of the grid, their respective abscissa coordinates X i on the section plane are obtained:
Figure BDA00002447350600041
The grid spacing grid is defined as the average point spacing of N+1 laser foot points on the ideal scanning line L k :
Figure BDA00002447350600042
By means of linear interpolation, the elevation value information of the laser footpoint on the ideal scanning line is mapped to each grid position distributed at equal intervals. The abscissa at grid position G i is i·grid, and its elevation information is defined as z′ i . Between G i and the position and elevation information of the nearest laser feet P′ i-1 (X i-1 , zi -1 ) and P′ i (X i , zi ) on both sides of the ideal scanning line The relationship can be expressed as:
Figure BDA00002447350600043
Then solve the elevation information z′ i at G i :
Figure BDA00002447350600044
According to this method, the elevation values of all grid positions on L k are calculated, and the left and right ends of the grid sequence do not satisfy the condition of the nearest laser footpoints on both sides, so the elevation values of the nearest laser footpoints Value is assigned to it. Through the above processing method, the laser footpoints on Lk that are originally uneven and scattered in the three-dimensional space are mapped to a regular discrete mathematical sequence in the two-dimensional space.

步骤三、基于平稳小波变换的实时成像和建筑物特征提取。Step three, real-time imaging and building feature extraction based on stationary wavelet transform.

通过步骤一和步骤二中的xoy平面直线化和高程值栅格化等操作,将第k条扫描线上的激光脚点转化为规则的离散高程数据序列。采用离散平稳小波变换对其进行处理,按照所得的小波细节系数的特征,提取出该扫描线中包含的建筑物位置信息,以及建筑物的顶面类型信息。根据建筑物顶面形状的不同,点云数据中所包含的建筑物可分为:平顶面建筑物、坡顶面建筑物和人字形顶面建筑物三大类。对这三类建筑物进行扫描,将所获得的各条扫描线上的激光脚点通过直线化、栅格化等处理方法转化为规则的离散序列。采用离散平稳小波变换(Discrete Stationary Wavelet Transform,DSWT)的方法对激光脚点的离散序列进行分析,提取出其包含的高程变化信息。DSWT变换除具有离散小波变换的快速运算能力外,相对于其它离散小波变换,其所具有的重要特点是具有冗余性和平移不变性。通过DSWT变换所得的各级尺度的小波细节系数的信号长度均等于原始数据的信号长度,因此,对小波细节系数中所表现出的特征信号可以通过其相应的时移参数快速、准确地确定出其在原始离散序列中所处的位置。将根据扫描线Lk上的激光脚点Pi(i∈[0,N],且i∈Z)计算得到的栅格位置数据Gi(i∈[0,N],且i∈Z)所组成的规则离散序列命名为Gk,采用低通滤波器h和高通滤波器g对序列Gk进行平稳离散小波变换: dhGk = h ⊗ Gk dgGk = g ⊗ Gk , 其中,

Figure BDA00002447350600052
表示卷积运算,dhGk和dgGk分别表示通过DSWT变换获取的小波近似系数和小波细节系数。分析离散小波变换的性质可知,序列Gk中所包含高程变化信息主要包含于其小波细节系数dgGk内。采用本发明所述的直线化和栅格化方法对平顶面建筑物、坡顶面建筑物和人字形顶面建筑物三类建筑物顶面的激光脚点进行处理获得三组离散序列。对三组离散序列进行一阶DSWT变换,获得三组小波细节系数。对得到的小波细节系数进行分析,对应于建筑物顶面的边缘位置,小波细节系数的波形会出现冲击信号,其中,建筑物的高程上升沿位置对应负值冲击信号,高程下降沿位置对应正值冲击信号。由于DSWT变换所采用的是线性滤波器,因此可以根据冲击信号幅值反向解算出建筑物的高程值。平顶型建筑物顶面部分不存在高程变化,相应的,在负值冲击信号和正值冲击信号之间小波细节系数均为0值。坡型建筑物顶面部分存在一定斜率,若该斜率为一固定正值,相应的,在负值冲击信号和正值冲击信号之间小波细节系数为一固定负值;反之,若该斜率为一固定负值,则对应的小波细节系数为一固定正值。人字型屋顶可理解为由两斜率互为相反数的坡型顶面组成,其顶面部分的小波系数为一负值序列和一对应的正值序列组成。通过对这三种典型的建筑物顶面模型进行组合扩展,可得到大量复杂建筑物顶面模型。采用上述的方法,根据冲击信号的位置判断建筑物顶面边界,根据建筑物顶面内部区域的小波细节系数对其顶面类型进行判断,得出激光雷达点云数据中的建筑物顶面类型信息。通过灰度化的方法,计算出栅格化后的规则离散高程数据序列和小波细节系数的灰度值,实现对对应探测区域进行实时成像处理。Through operations such as linearization of the xoy plane and rasterization of elevation values in steps 1 and 2, the laser footpoints on the kth scanning line are converted into regular discrete elevation data sequences. Discrete stationary wavelet transform is used to process it, and according to the characteristics of the obtained wavelet detail coefficients, the location information of the building contained in the scan line and the top surface type information of the building are extracted. According to the shape of the top of the building, the buildings contained in the point cloud data can be divided into three categories: flat top buildings, slope top buildings and herringbone top buildings. These three types of buildings are scanned, and the obtained laser footpoints on each scanning line are converted into regular discrete sequences through linearization, rasterization and other processing methods. Discrete Stationary Wavelet Transform (DSWT) method is used to analyze the discrete sequence of laser footpoints and extract the elevation change information it contains. In addition to the fast computing capability of discrete wavelet transform, DSWT transform, compared with other discrete wavelet transforms, has the important characteristics of redundancy and translation invariance. The signal lengths of the wavelet detail coefficients at all scales obtained through DSWT transformation are equal to the signal length of the original data. Therefore, the characteristic signals shown in the wavelet detail coefficients can be quickly and accurately determined by their corresponding time-shift parameters. Its position in the original discrete sequence. The grid position data G i (i ∈ [0, N], and i ∈ Z) calculated according to the laser footpoint P i (i ∈ [0, N], and i ∈ Z) on the scanning line L k The formed regular discrete sequence is named Gk, and the sequence Gk is subjected to a stationary discrete wavelet transform using the low-pass filter h and the high-pass filter g: wxya = h ⊗ K wxya = g ⊗ K , in,
Figure BDA00002447350600052
Indicates the convolution operation, dhGk and dgGk respectively indicate the wavelet approximation coefficient and wavelet detail coefficient obtained through DSWT transformation. Analyzing the properties of the discrete wavelet transform shows that the elevation change information contained in the sequence Gk is mainly contained in its wavelet detail coefficient dgGk. The linearization and rasterization methods of the present invention are used to process the laser footpoints on the top surfaces of three types of buildings, namely flat roof buildings, slope roof buildings and herringbone roof buildings, to obtain three sets of discrete sequences. First-order DSWT transformation is performed on three groups of discrete sequences to obtain three groups of wavelet detail coefficients. Analyzing the obtained wavelet detail coefficients, corresponding to the edge position of the top surface of the building, the waveform of the wavelet detail coefficients will appear shock signals, in which the position of the rising edge of the building’s elevation corresponds to a negative shock signal, and the position of the falling edge of the elevation corresponds to a positive value. Value shock signal. Since the DSWT transformation uses a linear filter, the elevation value of the building can be calculated inversely based on the amplitude of the shock signal. There is no elevation change on the top surface of a flat-roofed building, and correspondingly, the wavelet detail coefficients are all 0 between the negative impact signal and the positive impact signal. There is a certain slope on the top of the slope-shaped building. If the slope is a fixed positive value, correspondingly, the wavelet detail coefficient between the negative impact signal and the positive impact signal is a fixed negative value; otherwise, if the slope is A fixed negative value, the corresponding wavelet detail coefficient is a fixed positive value. The herringbone roof can be understood as being composed of two slope-shaped top surfaces whose slopes are opposite to each other, and the wavelet coefficients of the top surface part are composed of a negative value sequence and a corresponding positive value sequence. By combining and extending these three typical building top models, a large number of complex building top models can be obtained. Using the above method, the boundary of the building top surface is judged according to the position of the impact signal, and the top surface type is judged according to the wavelet detail coefficient of the inner area of the building top surface, and the building top surface type in the lidar point cloud data is obtained information. Through the method of grayscale, the grayscale value of the regular discrete elevation data sequence and wavelet detail coefficient after rasterization is calculated, and the real-time imaging processing of the corresponding detection area is realized.

步骤四、采用时空关联性分析的方法对各条扫描线的提取结果进行校验。Step 4, verifying the extraction results of each scanning line by using the method of spatio-temporal correlation analysis.

通过步骤三的操作,可以实时提取出各条扫描线激光脚点中所包含的建筑物位置信息和建筑物顶面类型信息,并根据各扫描线的高程信息和小波细节系数,对其所对应的探测区域进行实时成像。但每条扫描线上的高程信息仅来自于激光雷达的扫描方向,而不包含其载荷平台行进方向上的信息,因此利用时空关联性分析对扫描过程中各条相邻扫描线上对应的栅格位置的高程值、小波细节系数以及其中包含的各个建筑物的位置和顶面类型信息进行分析和校验。以小波系数为例,对每条扫描线的小波细节系数进行分类,并利用所得结果对对应的栅格位置进行标记。在小波细节系数中,若存在一个区间,其一侧为一负值冲击信号,另一侧为一正值冲击信号,该区间被判断为一建筑物。其中,负值冲击信号的起始位置表示建筑物顶面的上升沿边缘,将其对应的栅格位置标记为1;正值冲击信号的起始位置表示建筑物顶面的下降沿边缘,将其对应的栅格位置标记为2。区间内部的栅格位置按照其对应的小波细节系数值进行分类标记:当小波系数为0值,该位置处无高程变化,将其标记为3,表示是平顶面;当小波系数为负值,将其标记为4,表示是斜率为正的坡顶面;当小波系数为正值,将其标记为5,表示是斜率为负的坡顶面;当小波系数由正数和负数组合而成,将其标记为4&5,表示是人字型顶面。对标记后的各条扫描线栅格值进行时空关联性分析,利用前向和后向扫描线的相应栅格位置的标记值与所得的建筑物特征提取结果的标记值进行比较,对所得的建筑物特征提取结果进行校验。Through the operation of step 3, the building position information and building top surface type information contained in the laser foot points of each scanning line can be extracted in real time, and according to the elevation information and wavelet detail coefficient of each scanning line, the corresponding Real-time imaging of the detection area. However, the elevation information on each scanning line only comes from the scanning direction of the lidar, and does not include the information on the traveling direction of the load platform. The elevation value of the grid position, the wavelet detail coefficient, and the position and top surface type information of each building contained in it are analyzed and verified. Taking the wavelet coefficients as an example, the wavelet detail coefficients of each scan line are classified, and the corresponding grid positions are marked with the obtained results. In the wavelet detail coefficient, if there is an interval with a negative impact signal on one side and a positive impact signal on the other side, the interval is judged as a building. Among them, the starting position of the negative impact signal represents the rising edge of the building top, and its corresponding grid position is marked as 1; the starting position of the positive shock signal represents the falling edge of the building top, and Its corresponding grid position is marked as 2. The grid position inside the interval is classified and marked according to its corresponding wavelet detail coefficient value: when the wavelet coefficient is 0, there is no elevation change at this position, and it is marked as 3, indicating a flat top surface; when the wavelet coefficient is negative , mark it as 4, which means it is a slope top surface with positive slope; when the wavelet coefficient is positive, mark it as 5, which means it is a slope top surface with negative slope; when the wavelet coefficient is a combination of positive and negative numbers and , mark it as 4&5, which means it is a herringbone top surface. The spatial-temporal correlation analysis is carried out on the grid values of each marked scanning line, and the marked values of the corresponding grid positions of the forward and backward scanning lines are compared with the marked values of the obtained building feature extraction results, and the obtained The results of building feature extraction are verified.

通过应用本发明所述方法对一真实激光雷达点云数据进行实时处理的具体实施例对本发明所述方法做进一步说明:The method of the present invention is further described by applying the method of the present invention to a specific embodiment of real-time processing of real laser radar point cloud data:

该真实激光雷达点云数据及其对应的扫描区域的遥感影像分别如图2(a),2(b)所示。利用本发明所述方法将该点云数据中的激光脚点按照其各自所属的扫描线进行处理,得到的该点云数据高程图像如图2(c)所示,小波细节系数图像如图2(d)所示。利用本发明所述方法对所得的各条扫描线的小波细节系数进行分析,得出其中的建筑物特征,并按照步骤四中所述方法进行标记,利用时空关联性分析方法对得到的结果进行校验,得出该点云数据中的建筑物位置和顶面类型信息,如图2(e)所示。通过对图2(e)观察可知,采用本发明所述方法可以很好地对激光雷达点云数据进行处理,实现实时成像和建筑物特征提取等操作。The real lidar point cloud data and the remote sensing image of the corresponding scanning area are shown in Fig. 2(a) and 2(b) respectively. Utilize the method described in the present invention to process the laser feet in the point cloud data according to their respective scan lines, the point cloud data elevation image obtained is as shown in Figure 2 (c), and the wavelet detail coefficient image is as shown in Figure 2 (d) shown. Utilize the method described in the present invention to analyze the wavelet detail coefficients of each scanning line obtained, obtain the building features wherein, and mark according to the method described in step 4, utilize the time-space correlation analysis method to obtain the result Check to get the building position and top surface type information in the point cloud data, as shown in Figure 2(e). From the observation of Fig. 2(e), it can be seen that the laser radar point cloud data can be well processed by using the method of the present invention, and operations such as real-time imaging and building feature extraction can be realized.

以上所述,仅为本发明具体实施方法的基本方案,但本发明的保护范围并不局限于此,任何熟悉本技术领域的人员在本发明公开的技术范围内,可想到的变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应该以权利要求的保护范围为准。所有落入权利要求的等同的含义和范围内的变化都将包括在权利要求的范围之内。The above is only the basic scheme of the specific implementation method of the present invention, but the protection scope of the present invention is not limited thereto, and any conceivable change or replacement within the technical scope disclosed by the present invention by anyone familiar with the technical field, All should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims. All changes that come within the equivalent meaning and range of the claims are intended to be included in the scope of the claims.

Claims (1)

1.一种激光雷达实时成像和建筑物特征提取的方法,其特征在于包括以下四个步骤:1. a method for laser radar real-time imaging and building feature extraction, is characterized in that comprising following four steps: 步骤一、对点云数据中同属于一条扫描线的激光脚点在xoy平面内进行直线化处理;Step 1. Linearize the laser footpoints belonging to the same scanning line in the point cloud data in the xoy plane; 理想条件下,激光雷达通过扫描机构中棱镜的转动获得的一条扫描线上的激光脚点在笛卡尔三维xyz坐标系内的xoy平面上应该较为均匀地分布在同一条直线上,但是在实际情况中,由于地面物体高程的变化,以及激光雷达载荷平台在复杂气流影响下出现的航向角、侧滚角和俯仰角偏差,各条扫描线上的激光脚点与其理想扫描线之间存在一定的距离偏差,在激光雷达扫描过程中,利用最小二乘拟合方法计算出已完成的扫描线所对应的理想扫描线方程,使在xoy平面内,扫描线上所有激光脚点到该理想直线的距离平方和最小,计算各个激光脚点在xoy平面内与该理想直线的垂线,并以各条垂线与该理想直线在xoy平面内的交点坐标作为各个激光脚点经过直线化处理后的x轴和y轴坐标;Under ideal conditions, the laser foot points on a scanning line obtained by the lidar through the rotation of the prism in the scanning mechanism should be relatively evenly distributed on the same straight line on the xoy plane in the Cartesian three-dimensional xyz coordinate system, but in actual conditions In the process, due to the change of the elevation of ground objects and the deviation of the heading angle, roll angle and pitch angle of the lidar payload platform under the influence of complex airflow, there is a certain gap between the laser foot point on each scanning line and its ideal scanning line. Distance deviation, during the laser radar scanning process, use the least squares fitting method to calculate the ideal scan line equation corresponding to the completed scan line, so that in the xoy plane, the distance between all laser foot points on the scan line and the ideal line The sum of the squares of the distances is the smallest, calculate the perpendicular line between each laser foot point in the xoy plane and the ideal line, and take the intersection coordinates of each vertical line and the ideal line in the xoy plane as the linearized coordinates of each laser foot point x-axis and y-axis coordinates; 步骤二、在理想扫描线上,对直线化处理后的激光脚点进行高程值栅格化处理;Step 2, on the ideal scanning line, perform elevation value rasterization processing on the linearized laser foot points; 经过直线化处理后,理想扫描线上的激光脚点为一直线形式分布,以各个激光脚点在该直线上的间距的平均值作为栅格间距值,以该间距值将直线从第一个激光脚点开始分割成若干栅格,利用直线上各个激光脚点的高程值,采用线性插值的方法,计算出该理想直线上各个栅格位置处的高程值;After linearization, the laser footpoints on the ideal scanning line are distributed in a straight line, and the average value of the distance between each laser footpoint on the straight line is used as the grid spacing value, and the straight line is drawn from the first The laser footpoint starts to be divided into several grids, and the elevation value of each grid position on the ideal straight line is calculated by using the elevation value of each laser footpoint on the line and the method of linear interpolation; 步骤三、基于平稳小波变换的激光雷达实时成像和建筑物特征提取处理;Step 3. Lidar real-time imaging and building feature extraction processing based on stationary wavelet transform; 通过步骤一和步骤二中的直线化和高程值栅格化操作,将扫描线上的激光脚点转化为规则的离散高程数据序列,采用离散平稳小波变换对其进行处理,按照所得的小波细节系数的特征,提取其中所包含的建筑物边缘位置信息,以及建筑物的顶面类型信息,通过灰度化的方法,计算出栅格化后的规则离散高程数据序列和小波细节系数的灰度值,在激光雷达的扫描过程中按照上述方法对其所获得的每条扫描线上的激光脚点数据进行实时处理,从而实现对对应探测区域进行实时成像;Through the linearization and elevation value rasterization operations in step 1 and step 2, the laser footpoints on the scanning line are converted into regular discrete elevation data sequences, which are processed by discrete stationary wavelet transform. According to the obtained wavelet details The characteristics of the coefficients, extract the edge position information of the buildings contained in it, and the top surface type information of the buildings, and calculate the grayscale of the regular discrete elevation data sequence and wavelet detail coefficient after rasterization by grayscale method During the scanning process of the laser radar, the laser footpoint data obtained on each scanning line is processed in real time according to the above method, so as to realize real-time imaging of the corresponding detection area; 步骤四、采用时空关联性分析的方法对各条扫描线的提取结果进行校验;Step 4, using the method of spatio-temporal correlation analysis to verify the extraction results of each scanning line; 通过步骤三的操作,实时提取出各条扫描线激光脚点中所包含建筑物边缘位置信息和建筑物顶面类型信息,并利用各扫描线的高程信息和小波细节系数进行实时成像处理,但每条扫描线上的高程信息仅来自于激光雷达的扫描方向,而不包含其载荷平台行进方向上的信息,因此利用时空关联性分析对扫描过程中各条相邻扫描线上对应的栅格位置的高程值、小波细节系数以及其包含的各个建筑物的位置和顶面类型信息进行分析和校验,提高特征提取的准确性。Through the operation of step 3, the edge position information of the building and the type information of the building top surface contained in the laser foot points of each scanning line are extracted in real time, and the elevation information and wavelet detail coefficient of each scanning line are used for real-time imaging processing, but The elevation information on each scanning line only comes from the scanning direction of the lidar, and does not include the information on the traveling direction of its load platform. The elevation value of the location, the wavelet detail coefficient, and the location and top surface type information of each building contained in it are analyzed and verified to improve the accuracy of feature extraction.
CN201210479031.0A 2012-11-22 2012-11-22 Laser radar real-time imaging and building characteristic extracting method Expired - Fee Related CN103018728B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210479031.0A CN103018728B (en) 2012-11-22 2012-11-22 Laser radar real-time imaging and building characteristic extracting method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210479031.0A CN103018728B (en) 2012-11-22 2012-11-22 Laser radar real-time imaging and building characteristic extracting method

Publications (2)

Publication Number Publication Date
CN103018728A CN103018728A (en) 2013-04-03
CN103018728B true CN103018728B (en) 2014-06-18

Family

ID=47967545

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210479031.0A Expired - Fee Related CN103018728B (en) 2012-11-22 2012-11-22 Laser radar real-time imaging and building characteristic extracting method

Country Status (1)

Country Link
CN (1) CN103018728B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107358655B (en) * 2017-07-27 2020-09-22 秦皇岛燕大燕软信息系统有限公司 Identification method of hemispherical surface and conical surface models based on discrete stationary wavelet transform
CN107862656B (en) * 2017-10-30 2020-11-06 北京零壹空间科技有限公司 Regularization realization method and system for 3D image point cloud data
CN109828280A (en) * 2018-11-29 2019-05-31 亿嘉和科技股份有限公司 A kind of localization method and autonomous charging of robots method based on three-dimensional laser grid
JP7279469B2 (en) * 2019-03-28 2023-05-23 セイコーエプソン株式会社 Three-dimensional measuring device and robot system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101726255A (en) * 2008-10-24 2010-06-09 中国科学院光电研究院 Method for extracting interesting buildings from three-dimensional laser point cloud data
CN102520401A (en) * 2011-12-21 2012-06-27 南京大学 Building area extraction method based on LiDAR data
CN102645209A (en) * 2012-04-24 2012-08-22 长江勘测规划设计研究有限责任公司 Joint positioning method for spatial points by means of onboard LiDAR point cloud and high resolution images

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010000443A (en) * 2000-09-29 2001-01-05 서정헌 Media that can record computer program sources for extracting building by fusion with photogrammetric image and lidar data, and system and method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101726255A (en) * 2008-10-24 2010-06-09 中国科学院光电研究院 Method for extracting interesting buildings from three-dimensional laser point cloud data
CN102520401A (en) * 2011-12-21 2012-06-27 南京大学 Building area extraction method based on LiDAR data
CN102645209A (en) * 2012-04-24 2012-08-22 长江勘测规划设计研究有限责任公司 Joint positioning method for spatial points by means of onboard LiDAR point cloud and high resolution images

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
Qinghong Zeng等.Simple Building Reconstruction from LIDAR Point Cloud.《Audio,Language and Image Processing,2008.ICALIP2008.International Conference on》.2008,1040-1044.
Simple Building Reconstruction from LIDAR Point Cloud;Qinghong Zeng等;《Audio,Language and Image Processing,2008.ICALIP2008.International Conference on》;20080709;1040-1044 *
基于扫描线的车载激光雷达点云滤波方法;杨洋等;《测绘科学技术学报》;20100630;第27卷(第3期);209-212 *
平台运动误差对记载LiDAR激光脚点分布的影响分析;李小路等;《武汉大学学报.信息科学版》;20111130;第36卷(第11期);1270-1274,1279 *
李小路等.平台运动误差对记载LiDAR激光脚点分布的影响分析.《武汉大学学报.信息科学版》.2011,第36卷(第11期),1270-1274,1279.
杨洋等.基于扫描线的车载激光雷达点云滤波方法.《测绘科学技术学报》.2010,第27卷(第3期),209-212.

Also Published As

Publication number Publication date
CN103018728A (en) 2013-04-03

Similar Documents

Publication Publication Date Title
CN102521835B (en) Method for extracting point cloud data of tree height based on space three-dimensional template
WO2019153746A1 (en) Geological linear body extraction method based on tensor voting coupled with hough transform
CN107451982B (en) High-canopy-density forest stand crown area acquisition method based on unmanned aerial vehicle image
CN110807781B (en) Point cloud simplifying method for retaining details and boundary characteristics
CN106997049A (en) A kind of method and apparatus of the detection barrier based on laser point cloud data
CN103268496B (en) SAR Image Target Recognition Method
CN104200471B (en) SAR image change detection based on adaptive weight image co-registration
CN104299260A (en) Contact network three-dimensional reconstruction method based on SIFT and LBP point cloud registration
CN103018728B (en) Laser radar real-time imaging and building characteristic extracting method
CN101504770B (en) A method for extracting the center of a structured light strip
CN108562885B (en) High-voltage transmission line airborne LiDAR point cloud extraction method
JP2015200615A (en) Laser measurement result analysis system
CN112668534B (en) Forest zone vegetation height inversion method based on digital orthographic images and digital surface models
CN114299318A (en) Method and system for rapid point cloud data processing and target image matching
CN106022694B (en) A kind of system of scattered groceries field stacker-reclaimer localization method and realization the method based on Point Cloud Processing technology
JP6929207B2 (en) Road image processing device, road image processing method, road image processing program, and recording medium
Bao et al. Step edge detection method for 3d point clouds based on 2d range images
CN110988876B (en) Closed robust double-baseline InSAR phase unwrapping method and system and readable storage medium
CN111983637A (en) A method for extracting paths between rows of orchards based on lidar
CN114966560A (en) Ground penetrating radar backward projection imaging method and system
CN103886289B (en) Direction self-adaptive method and system for identifying on-water bridge targets
CN108038086B (en) DEM data error evaluation and correction method based on pixel scale
CN111915724A (en) Point cloud model slice shape calculation method
CN101937083A (en) A Method of Airborne Interferometric SAR Combined with Geocoding to Suppress Hillshade
CN106709923B (en) A kind of variation detection and its test method towards heterologous sequence image

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20140618

Termination date: 20141122

EXPY Termination of patent right or utility model