CN115753643A - Intelligent recognition method and system for rock mass fissures combining 3D scanning and image spectrum - Google Patents

Intelligent recognition method and system for rock mass fissures combining 3D scanning and image spectrum Download PDF

Info

Publication number
CN115753643A
CN115753643A CN202211291423.4A CN202211291423A CN115753643A CN 115753643 A CN115753643 A CN 115753643A CN 202211291423 A CN202211291423 A CN 202211291423A CN 115753643 A CN115753643 A CN 115753643A
Authority
CN
China
Prior art keywords
rock mass
spectral
fissure
point cloud
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202211291423.4A
Other languages
Chinese (zh)
Other versions
CN115753643B (en
Inventor
潘东东
赵晟喆
谢辉辉
韩涛
李珊
李轶惠
石恒
许振浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong University
Original Assignee
Shandong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong University filed Critical Shandong University
Priority to CN202211291423.4A priority Critical patent/CN115753643B/en
Publication of CN115753643A publication Critical patent/CN115753643A/en
Application granted granted Critical
Publication of CN115753643B publication Critical patent/CN115753643B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/30Assessment of water resources

Landscapes

  • Length Measuring Devices With Unspecified Measuring Means (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

本发明公开了一种融合三维扫描与图像光谱的岩体裂隙智能识别系统及方法,包括:通过三维扫描获取目标岩体的三维点云数据;对三维点云数据进行处理,得到二维坐标系下的裂隙点云数据集;通过光谱扫描获取目标岩体的图像信息和光谱信息;基于光谱信息提取矿物分布特征,基于图像信息提取裂隙图像特征;基于矿物分布特征和裂隙图像特征,利用充填裂隙边界智能识别模型,得到充填裂隙的边界坐标以及充填矿物信息;将充填裂隙的边界坐标与二维坐标系下的裂隙点云数据集进行校核归并,实现岩体裂隙的全面精准识别。本发明可以有效弥补三维激光扫描对充填裂隙无法实现精准识别与参数的高效提取的缺陷,大大提高了裂隙识别的精度。

Figure 202211291423

The invention discloses a system and method for intelligent identification of rock mass fissures combining three-dimensional scanning and image spectrum, comprising: obtaining three-dimensional point cloud data of the target rock mass through three-dimensional scanning; processing the three-dimensional point cloud data to obtain a two-dimensional coordinate system The following fracture point cloud data set; the image information and spectral information of the target rock mass are obtained by spectral scanning; the mineral distribution characteristics are extracted based on the spectral information, and the fracture image features are extracted based on the image information; The boundary intelligent recognition model obtains the boundary coordinates and filling mineral information of the fissures; the boundary coordinates of the fissures are checked and merged with the fissure point cloud data set in the two-dimensional coordinate system to realize the comprehensive and accurate identification of rock mass fissures. The invention can effectively make up for the defect that three-dimensional laser scanning cannot realize accurate identification and efficient extraction of parameters for filling cracks, and greatly improves the accuracy of crack identification.

Figure 202211291423

Description

融合三维扫描与图像光谱的岩体裂隙智能识别方法及系统Method and system for intelligent identification of rock mass fissures by combining 3D scanning and image spectrum

技术领域technical field

本发明涉及岩体裂隙识别技术领域,尤其涉及一种融合三维扫描与图像光谱的岩体裂隙智能识别方法及系统。The invention relates to the technical field of rock mass fissure recognition, in particular to an intelligent rock mass fissure recognition method and system that integrates three-dimensional scanning and image spectrum.

背景技术Background technique

本部分的陈述仅仅是提供了与本发明相关的背景技术信息,不必然构成在先技术。The statements in this section merely provide background information related to the present invention and do not necessarily constitute prior art.

岩体中存在大量的裂隙结构,这些结构对岩体的物理力学性能指标、变形特性、渗流性质以及长期稳定性有较大影响。裂隙根据是否被充填可分为充填裂隙与非充填裂隙两类,常见的裂隙充填物有由构造作用或风化作用、地下水作用形成的角砾、砂土和石灰岩等,与围岩成分区分度大,成分一致概率低。There are a large number of fracture structures in the rock mass, and these structures have a great influence on the physical and mechanical performance indicators, deformation characteristics, seepage properties and long-term stability of the rock mass. Fissures can be divided into filled and non-filled fissures according to whether they are filled or not. Common fissure fillings include breccia, sand, and limestone formed by tectonic, weathering, and groundwater effects, which are highly differentiated from the composition of surrounding rocks. , the probability of composition consistency is low.

纵观岩体裂隙识别领域,目前常见的识别方法有肉眼观察法、图像识别法、三维激光扫描法等。肉眼观察法往往过于依赖人工经验,对观察者专业技能知识储备要求高,无法实现对裂隙的精确定量化分析,易受天气、光线等环境因素限制,工作量大、效率低,人工成本高,经济效益低下;图像识别法往往受限于图像质量,对算法、模型完整度要求高,训练数据往往需要预处理,不能直接利用原始模型参数,最终识别精度有待提高;三维激光扫描技术通过三维激光扫描设备直接对岩体表面进行三维采样,相比于传统技术而言,虽可对岩体裂隙进行快速、原位、高精度识别,但由于三维扫描只能对岩体表面进行数据采样,而充填裂隙的裂隙内部空间被矿物等填充,经扫描得到的此类裂隙边界易出现失真甚至误判等情况。综上所述,单单使用一种技术进行裂隙识别在识别精度方面存在一定的局限性。Throughout the field of rock mass fissure identification, the current common identification methods include naked eye observation, image recognition, and three-dimensional laser scanning. The naked eye observation method often relies too much on manual experience, requires a high reserve of professional skills and knowledge of the observer, and cannot achieve accurate quantitative analysis of cracks. It is easily restricted by environmental factors such as weather and light, and has a large workload, low efficiency, and high labor costs. Low economic benefits; image recognition methods are often limited by image quality, have high requirements for algorithm and model integrity, training data often need to be preprocessed, cannot directly use the original model parameters, and the final recognition accuracy needs to be improved; 3D laser scanning technology through 3D laser The scanning equipment directly performs three-dimensional sampling on the surface of the rock mass. Compared with the traditional technology, although it can quickly, in-situ, and high-precision identify the cracks in the rock mass, because the three-dimensional scanning can only sample data on the surface of the rock mass, and The internal space of the fissures filled with fissures is filled with minerals, etc., and the boundaries of such fissures obtained by scanning are prone to distortion or even misjudgment. To sum up, there are certain limitations in the identification accuracy of using only one technology for crack identification.

发明内容Contents of the invention

为了解决上述问题,本发明提出了一种融合三维扫描与图像光谱的岩体裂隙智能识别方法及系统,利用三维扫描技术实现对非充填裂隙的精确识别以及对充填裂隙的模糊识别,利用图像光谱技术结合神经网络实现对充填裂隙的精确识别,并对三维扫描结果进行补充与校核,最终实现对岩体裂隙的精准、全面、快速、智能的识别。In order to solve the above problems, the present invention proposes a method and system for intelligent identification of rock mass fissures that integrate 3D scanning and image spectrum, using 3D scanning technology to realize accurate identification of non-filled cracks and fuzzy recognition of filled cracks, using image spectrum Technology combined with neural network to realize accurate identification of filling fissures, supplement and check the 3D scanning results, and finally realize accurate, comprehensive, fast and intelligent identification of rock mass fissures.

在一些实施方式中,采用如下技术方案:In some embodiments, the following technical solutions are adopted:

一种融合三维扫描与图像光谱的岩体裂隙智能识别方法,包括:An intelligent identification method for rock mass fissures that combines 3D scanning and image spectrum, including:

通过三维扫描获取目标岩体的三维点云数据;Obtain 3D point cloud data of the target rock mass through 3D scanning;

对所述三维点云数据进行处理,提取不连续点点集坐标,对提取的不连续点点集坐标进行维度变换,得到二维坐标系下的裂隙点云数据集;Processing the three-dimensional point cloud data, extracting the coordinates of the discontinuous point set, and performing dimension transformation on the extracted coordinates of the discontinuous point set, to obtain the crack point cloud data set under the two-dimensional coordinate system;

通过光谱扫描获取目标岩体的图像信息和光谱信息;Obtain the image information and spectral information of the target rock mass through spectral scanning;

基于光谱信息提取矿物分布特征,基于图像信息提取裂隙图像特征;基于所述矿物分布特征和裂隙图像特征,利用充填裂隙边界智能识别模型,得到充填裂隙的边界坐标以及充填矿物信息;Mineral distribution features are extracted based on spectral information, and fissure image features are extracted based on image information; based on the mineral distribution features and fissure image features, the boundary coordinates of the filled fissures and the filling mineral information are obtained by using the intelligent identification model of the filled fissure boundary;

将充填裂隙的边界坐标与二维坐标系下的裂隙点云数据集进行校核归并,实现岩体裂隙的全面精准识别。The boundary coordinates of the filled fissures are checked and merged with the fissure point cloud data sets in the two-dimensional coordinate system to achieve comprehensive and accurate identification of rock mass fissures.

作为进一步地方案,对提取的不连续点点集坐标进行维度变换,具体过程为:对提取出的不连续点点集的三维(x,y,z)坐标,对z方向数据进行人工删除,转换成二维坐标系下的裂隙点云数据集。As a further solution, carry out dimension transformation to the coordinates of the extracted discontinuous point set, the specific process is: for the three-dimensional (x, y, z) coordinates of the extracted discontinuous point set, manually delete the data in the z direction, and convert it into Fracture point cloud dataset in 2D coordinate system.

作为进一步地方案,基于光谱信息提取矿物分布特征,具体过程为:As a further solution, mineral distribution features are extracted based on spectral information, and the specific process is as follows:

获取图像中每一个像素点的光谱曲线,基于相邻两个光谱曲线的光谱角是否小于设定阈值,来确定这两个像素点是否属于同一类岩体,将光谱曲线与光谱数据库进行匹配,确定该光谱曲线对应的具体的矿物类型;从而确定出每一个像素点对应的矿物类型以及矿物分布情况,并进行矿物填图;其中,光谱数据库中预存有光谱曲线以及与其匹配的矿物分子式。Obtain the spectral curve of each pixel in the image, and determine whether the two pixel points belong to the same type of rock mass based on whether the spectral angle of two adjacent spectral curves is smaller than the set threshold, and match the spectral curve with the spectral database. Determine the specific mineral type corresponding to the spectral curve; thereby determine the mineral type and mineral distribution corresponding to each pixel point, and perform mineral mapping; where the spectral curve and the matching mineral molecular formula are pre-stored in the spectral database.

作为进一步地方案,基于所述矿物分布特征和裂隙图像特征,利用充填裂隙边界智能识别模型,得到充填裂隙的边界坐标以及充填矿物信息,具体过程为:输入经处理成像光谱图像立方体得到的裂隙图像特征与矿物分布特征,对目标岩体同一位置的裂隙坐标与矿物填图区域进行匹配,对两区域的重合区域边界进行提取,将其视为充填裂隙区域,结合矿物填图最终实现对充填裂隙边界坐标与矿物成分的输出。As a further solution, based on the mineral distribution characteristics and fracture image features, using the intelligent identification model of the filling fracture boundary, the boundary coordinates of the filling fracture and the filling mineral information are obtained. The specific process is: input the fracture image obtained by processing the imaging spectral image cube Features and mineral distribution characteristics, match the crack coordinates at the same position of the target rock mass with the mineral mapping area, extract the overlapping area boundaries of the two areas, regard it as the filling crack area, and finally realize the filling of cracks in combination with mineral mapping Output of boundary coordinates and mineral composition.

作为进一步地方案,所述充填裂隙边界智能识别模型采用设定的神经网络模型,对于充填裂隙边界智能识别模型的识别过程,具体包括:As a further solution, the intelligent identification model for filling the fracture boundary adopts a set neural network model, and the identification process of the intelligent identification model for filling the fracture boundary specifically includes:

根据已有数据库中的成像光谱图像立方体进行图像特征与光谱特征的提取,将设定比例划分为训练集与测试集,将训练集输入到神经网络模型中进行训练,利用测试集对训练好的神经网络模型优化验证,得到最优的神经网络模型;将需要进行充填裂隙识别的目标岩体的图像特征与光谱特征输入到训练好的神经网络模型中,得到充填裂隙识别结果及其边界坐标集,结合矿物成分,得到充填裂隙的边界坐标以及充填矿物信息。According to the imaging spectral image cube in the existing database, the image features and spectral features are extracted, and the set ratio is divided into training set and test set, and the training set is input into the neural network model for training, and the trained set is used for training. The neural network model is optimized and verified to obtain the optimal neural network model; the image characteristics and spectral characteristics of the target rock mass that need to be identified for filling cracks are input into the trained neural network model to obtain the identification results of filling cracks and their boundary coordinates , combined with the mineral composition, the boundary coordinates of the filled fractures and the information of the filled minerals are obtained.

作为进一步地方案,将充填裂隙的边界坐标与二维坐标系下的裂隙点云数据集进行校核归并,具体为:As a further solution, check and merge the boundary coordinates of the filled cracks with the crack point cloud data set in the two-dimensional coordinate system, specifically:

将二维坐标系下的裂隙点云数据坐标与充填裂隙的边界坐标进行配准,将两种坐标统一到同一个参考坐标系下,将充填裂隙的边界坐标替换相对应位置的二维坐标系下的裂隙点云数据坐标。Register the coordinates of the crack point cloud data in the two-dimensional coordinate system with the boundary coordinates of the crack filling, unify the two coordinates into the same reference coordinate system, and replace the boundary coordinates of the crack filling with the two-dimensional coordinate system of the corresponding position The coordinates of the fracture point cloud data below.

作为进一步地方案,得到岩体裂隙的识别结果,具体包括:裂隙的位置、充填矿物信息以及裂隙的尺寸。As a further solution, an identification result of rock mass fissures is obtained, specifically including: the location of the fissures, the information of filling minerals, and the size of the fissures.

在另一些实施方式中,采用如下技术方案:In other embodiments, the following technical solutions are adopted:

一种融合三维扫描与图像光谱的岩体裂隙智能识别系统,包括:An intelligent identification system for rock mass fissures that combines 3D scanning and image spectrum, including:

点云数据获取模块,用于通过三维扫描获取目标岩体的三维点云数据;The point cloud data acquisition module is used to obtain the three-dimensional point cloud data of the target rock mass through three-dimensional scanning;

裂隙点云数据预处理模块,用于对所述三维点云数据进行处理,提取不连续点点集坐标,对提取的不连续点点集坐标进行维度变换,得到二维坐标系下的裂隙点云数据集;The fracture point cloud data preprocessing module is used to process the three-dimensional point cloud data, extract the coordinates of the discontinuous point set, perform dimension transformation on the extracted discontinuous point set coordinates, and obtain the fissure point cloud data in the two-dimensional coordinate system set;

图像光谱数据获取模块,用于通过光谱扫描获取目标岩体的图像信息和光谱信息;The image spectrum data acquisition module is used to acquire the image information and spectral information of the target rock mass through spectral scanning;

充填裂隙数据获取模块,用于基于光谱信息提取矿物分布特征,基于图像信息提取裂隙图像特征;基于所述矿物分布特征和裂隙图像特征,利用充填裂隙边界智能识别模型,得到充填裂隙的边界坐标以及充填矿物信息;The fissure filling data acquisition module is used to extract mineral distribution features based on spectral information, and to extract fissure image features based on image information; based on the mineral distribution characteristics and fissure image features, the boundary coordinates of the fissure filling and the filling mineral information;

数据融合模块,用于将充填裂隙的边界坐标与二维坐标系下的裂隙点云数据集进行校核归并,得到岩体裂隙的识别结果。The data fusion module is used to check and merge the boundary coordinates of the filled cracks with the crack point cloud data sets in the two-dimensional coordinate system to obtain the identification results of rock mass cracks.

作为进一步地方案,所述数据融合模块将二维坐标系下的裂隙点云数据坐标与充填裂隙的边界坐标进行配准,将两种坐标统一到同一个参考坐标系下,将充填裂隙的边界坐标替换相对应位置的二维坐标系下的裂隙点云数据坐标。As a further solution, the data fusion module registers the coordinates of the crack point cloud data in the two-dimensional coordinate system with the boundary coordinates of the crack filling, and unifies the two coordinates into the same reference coordinate system, and the boundary coordinates of the crack filling The coordinates replace the coordinates of the fracture point cloud data in the two-dimensional coordinate system of the corresponding position.

在另一些实施方式中,采用如下技术方案:In other embodiments, the following technical solutions are adopted:

一种融合三维扫描与图像光谱的岩体裂隙智能识别装置,用于实现上述的融合三维扫描与图像光谱的岩体裂隙智能识别方法,其特征在于,所述系统包括:An intelligent identification device for rock mass fissures that integrates three-dimensional scanning and image spectra, used to realize the above-mentioned intelligent identification method for rock mass fissures that fuses three-dimensional scanning and image spectra, is characterized in that the system includes:

工作平台;working platform;

设置在工作平台上的电磁波收发装置,所述电磁波收发装置能够向侧面岩壁发射电磁波,利用所述电磁波往返的传播时间能够得到电磁波收发装置与侧面岩壁之间的距离,以控制工作平台按照设定的路线自动移动;The electromagnetic wave transceiver device arranged on the working platform, the electromagnetic wave transceiver device can emit electromagnetic waves to the side rock wall, and the distance between the electromagnetic wave transceiver device and the side rock wall can be obtained by using the round-trip propagation time of the electromagnetic wave, so as to control the working platform according to the The set route moves automatically;

相对设置在工作平台上的横梁,所述横梁分别通过可升降装置与工作平台连接;三维扫描装置和光谱扫描装置分别搭载在不同的横梁上,并能够沿横梁转动和平移;所述工作平台能够带动三维扫描装置和光谱扫描装置自动移动至设定的目标位置进行数据采集;Relative to the beams arranged on the working platform, the beams are respectively connected to the working platform through liftable devices; the three-dimensional scanning device and the spectral scanning device are respectively mounted on different beams, and can rotate and translate along the beams; the working platform can Drive the three-dimensional scanning device and the spectral scanning device to automatically move to the set target position for data collection;

控制单元,用于接收三维扫描装置和光谱扫描装置采集到的数据,基于所述数据分别得到裂隙点云数据集和充填裂隙的边界坐标数据集,对两个数据集进行归并处理,得到目标岩体的全部裂隙。The control unit is used to receive the data collected by the three-dimensional scanning device and the spectral scanning device, obtain a fracture point cloud data set and a boundary coordinate data set for filling the fracture based on the data, and merge and process the two data sets to obtain the target rock All fissures of the body.

作为进一步地方案,还包括:设置在工作平台上的微型定位相机,所述微型定位相机通过多角度拍摄定位目标岩体特征点对待测岩体识别范围进行精确定位,将定位信息传送至三维扫描装置,实现对待测目标区域的区域锁定。As a further solution, it also includes: a micro-positioning camera arranged on the working platform, the micro-positioning camera accurately locates the identification range of the rock mass to be measured by taking pictures of the feature points of the target rock mass from multiple angles, and transmits the positioning information to the three-dimensional scanning The device realizes the area locking of the target area to be measured.

与现有技术相比,本发明的有益效果是:Compared with prior art, the beneficial effect of the present invention is:

(1)本发明提出采用图像光谱技术对充填裂隙进行精准识别,基于已有的岩性光谱信息数据库(数据库由成像光谱图像立方体及各类矿物的光谱图像与对应光谱编号、分子式组成,结合裂隙图像信息特征),结合神经网络模型训练出一种充填裂隙智能识别模型,实现充填裂隙边界坐标集与充填物参数的智能提取输出,最终实现对充填裂隙的精准识别与参数(参数包括裂隙形状、大小、位置、填充物矿物成分等)的高效提取。(1) The present invention proposes to use image spectrum technology to accurately identify the filled cracks, based on the existing lithology spectral information database (the database consists of imaging spectral image cubes and spectral images of various minerals and corresponding spectral numbers and molecular formulas, combined with cracks Image information features), combined with the neural network model to train an intelligent identification model for filling cracks, realize the intelligent extraction output of the boundary coordinate set of filling cracks and filling parameters, and finally realize the accurate identification and parameters of filling cracks (parameters include crack shape, Efficient extraction of size, location, mineral composition of fillers, etc.).

(2)本发明结合三维激光扫描技术对目标岩体裂隙进行识别,两种裂隙识别结果互做补充与校核,实现目标岩体裂隙的全面精准识别。本发明方法可以有效弥补三维激光扫描对充填裂隙无法实现精准识别与充填物质无法提取的缺陷,提高数据质量,大大提高了裂隙识别的精度。(2) The present invention combines three-dimensional laser scanning technology to identify target rock mass fissures, and the two types of crack identification results complement and check each other to realize comprehensive and accurate identification of target rock mass fissures. The method of the invention can effectively make up for the defects that three-dimensional laser scanning cannot realize accurate identification of filling cracks and filling materials cannot be extracted, improves data quality, and greatly improves the accuracy of crack identification.

(3)本发明设计了一种融合三维扫描与图像光谱的岩体裂隙智能识别系统,该系统能够基于预定的路线自主移动至目标位置进行三维扫描和光谱扫描,同时能够自主调节扫描装置的具体位置,可以远程操控裂隙识别过程,实现裂隙识别的全智能化精准识别与高效处理,大大提高了岩体裂隙识别的工作效率。(3) The present invention designs an intelligent identification system for rock mass fissures that combines 3D scanning and image spectrum. The location can remotely control the crack identification process, realize fully intelligent accurate identification and efficient processing of crack identification, and greatly improve the work efficiency of rock mass crack identification.

本发明的其他特征和附加方面的优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本方面的实践了解到。Other features and advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

附图说明Description of drawings

图1为本发明实施例中的融合三维扫描与图像光谱的岩体裂隙智能识别方法流程图;Fig. 1 is the flow chart of the intelligent recognition method for rock mass fissures of fusion of three-dimensional scanning and image spectrum in the embodiment of the present invention;

图2为本发明实施例中的融合三维扫描与图像光谱的岩体裂隙智能识别系统流程图;Fig. 2 is the flow chart of the rock mass fissure intelligent recognition system that fuses three-dimensional scanning and image spectrum in the embodiment of the present invention;

图3为本发明实施例中的融合三维扫描与图像光谱的岩体裂隙智能识别装置结构示意图;Fig. 3 is a schematic structural diagram of an intelligent identification device for rock mass fissures fused with three-dimensional scanning and image spectrum in an embodiment of the present invention;

图4为本发明实施例中岩体裂隙智能识别装置高度调节示意图;Fig. 4 is a schematic diagram of the height adjustment of the rock mass fissure intelligent identification device in the embodiment of the present invention;

其中,1.三维激光扫描仪;2.光谱成像仪;3.横梁;4.机械臂;5.液压柱;6.工作平台;7.智能操作显示屏;8.光源;9.微型定位相机;10.配电箱;11.把手;12.补光灯;13电磁波收发装置。Among them, 1. 3D laser scanner; 2. Spectral imager; 3. Beam; 4. Mechanical arm; 5. Hydraulic column; 6. Working platform; 7. Intelligent operation display screen; 8. Light source; ; 10. Distribution box; 11. Handle; 12. Fill light; 13 Electromagnetic wave transceiver.

具体实施方式Detailed ways

应该指出,以下详细说明都是例示性的,旨在对本申请提供进一步的说明。除非另有指明,本发明使用的所有技术和科学术语具有与本申请所属技术领域的普通技术人员通常理解的相同含义。It should be pointed out that the following detailed description is exemplary and intended to provide further explanation to the present application. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.

需要注意的是,这里所使用的术语仅是为了描述具体实施方式,而非意图限制根据本申请的示例性实施方式。如在这里所使用的,除非上下文另外明确指出,否则单数形式也意图包括复数形式,此外,还应当理解的是,当在本说明书中使用术语“包含”和/或“包括”时,其指明存在特征、步骤、操作、器件、组件和/或它们的组合。It should be noted that the terminology used here is only for describing specific implementations, and is not intended to limit the exemplary implementations according to the present application. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural, and it should also be understood that when the terms "comprising" and/or "comprising" are used in this specification, they mean There are features, steps, operations, means, components and/or combinations thereof.

实施例一Embodiment one

在一个或多个实施方式中,公开了一种融合三维扫描与图像光谱的岩体裂隙智能识别方法,将裂隙细致划分为充填裂隙与非充填裂隙两类,采用三维扫描技术与数据处理模型对非充填裂隙进行精确提取,对充填裂隙进行模糊提取,采用图像光谱技术结合图像特征与矿物分布特征,并结合神经网络对充填裂隙进行精确识别,两者各司其职,结果又互为补充与校核,最终实现裂隙的全覆盖化的完整、智能、高效识别。In one or more embodiments, a method for intelligent identification of rock mass fissures that combines 3D scanning and image spectrum is disclosed, and the fissures are divided into two types: filled fissures and non-filled fissures, and three-dimensional scanning technology and data processing model are used to identify Accurate extraction of non-filled fissures, fuzzy extraction of filled fissures, image spectrum technology combined with image features and mineral distribution characteristics, combined with neural network to accurately identify filled fissures, both perform their duties, and the results complement each other. Check, and finally realize the complete, intelligent and efficient identification of the full coverage of cracks.

结合图1,本实施例方法具体包括如下过程:In conjunction with Figure 1, the method of this embodiment specifically includes the following processes:

步骤(1):通过三维扫描获取目标岩体的三维点云数据;Step (1): Obtain the 3D point cloud data of the target rock mass through 3D scanning;

步骤(2):对三维点云数据进行噪声过滤处理,进而提取不连续点点集坐标,对提取的不连续点点集坐标进行维度变换,对提取出的不连续点点集的三维(x,y,z)坐标,对深度(z)方向数据进行人工删除,得到二维坐标系下的裂隙点云数据集,该数据集包含了非充填裂隙点云数据集和充填裂隙点云数据集,其中,充填裂隙点云数据集的识别结果可能会存在偏差,因此,与经充填裂隙边界智能识别模型得到的二维充填裂隙数据集坐标进行融合归并,可以得到准确全面的非充填和充填裂隙点云数据集。Step (2): Perform noise filtering on the 3D point cloud data, and then extract the coordinates of the discontinuous point set, perform dimension transformation on the coordinates of the extracted discontinuous point set, and perform three-dimensional (x, y, z) coordinates, manually delete the data in the depth (z) direction, and obtain the fracture point cloud data set in the two-dimensional coordinate system, which includes the non-filled fracture point cloud data set and the filled fracture point cloud data set, wherein, There may be deviations in the identification results of the point cloud data set for filling fractures. Therefore, by merging and merging with the coordinates of the two-dimensional filling fracture data set obtained by the intelligent identification model of the filling fracture boundary, accurate and comprehensive non-filling and filling fracture point cloud data can be obtained. set.

需要说明的是,在三维点云数据采集过程中,通过三维扫描仪器对物体表面进行测量,所得到数据一般也会存在许多的几何不连续处,通常表现为离散点的形式,称之为不连续点。It should be noted that in the process of 3D point cloud data acquisition, the surface of the object is measured by a 3D scanning instrument, and the data obtained generally have many geometric discontinuities, which are usually in the form of discrete points, called discontinuities. continuous point.

本实施例中,对三维点云数据进行处理具体包括:点云强度校正、不同视角下的点云数据配准以及非目标点云过滤等过程;In this embodiment, the processing of the three-dimensional point cloud data specifically includes: point cloud intensity correction, point cloud data registration under different viewing angles, and non-target point cloud filtering processes;

其中,点云强度校正具体为通过预设点云强度校核模型对点云强度进行校正,选择最合适的激光入射角度、最优激光扫描仪位置等;Among them, the point cloud intensity correction is specifically to correct the point cloud intensity through the preset point cloud intensity check model, select the most suitable laser incident angle, the optimal laser scanner position, etc.;

不同视角下的点云数据配准具体为采用基于反射值影像的点云数据自动拼接方法对多次扫描获取的点云数据进行配准。The point cloud data registration under different viewing angles is specifically to use the point cloud data automatic splicing method based on reflection value images to register the point cloud data acquired by multiple scans.

步骤(3):通过光谱扫描获取目标岩体的图像信息和光谱信息;Step (3): Obtain image information and spectral information of the target rock mass through spectral scanning;

本实施例中,对获取的光谱信息采用方差归一化进行预处理,用于消除因固体颗粒大小不同、散射或测量光程引起的样品间光谱误差,方差归一化方法如下:In this embodiment, the obtained spectral information is preprocessed by variance normalization, which is used to eliminate the spectral error between samples caused by different solid particle sizes, scattering or measurement optical path. The variance normalization method is as follows:

Figure BDA0003898444730000081
Figure BDA0003898444730000081

其中,Isnv为经光谱扫描得到的光谱数据,将首次扫描得到的光谱数据设置为样本,并求出其方差Eα与光谱方差σ。Among them, I snv is the spectral data obtained by spectral scanning, the spectral data obtained by the first scanning is set as a sample, and its variance E α and spectral variance σ are calculated.

步骤(4):基于光谱信息提取矿物分布特征,基于图像信息提取裂隙图像特征;基于所述矿物分布特征和裂隙图像特征,利用充填裂隙边界智能识别模型,得到充填裂隙的边界坐标以及充填矿物信息;Step (4): Mineral distribution features are extracted based on spectral information, and fissure image features are extracted based on image information; based on the mineral distribution features and fissure image features, the boundary coordinates of the filled fissures and the filling mineral information are obtained by using the intelligent recognition model of the filled fissure boundary ;

本实施例中,基于光谱信息提取矿物分布特征,具体过程为:In this embodiment, mineral distribution features are extracted based on spectral information, and the specific process is as follows:

获取图像中每一个像素点的光谱曲线,基于相邻两个光谱曲线的光谱角是否小于设定阈值,来确定这两个像素点是否属于同一类岩体,将光谱曲线与光谱数据库进行匹配,确定该光谱曲线对应的具体的矿物类型;从而确定出每一个像素点对应的矿物类型以及矿物分布情况,并在此基础上进行矿物填图;其中,光谱数据库中预存有光谱曲线以及与其匹配的矿物分子式。Obtain the spectral curve of each pixel in the image, and determine whether the two pixel points belong to the same type of rock mass based on whether the spectral angle of two adjacent spectral curves is smaller than the set threshold, and match the spectral curve with the spectral database. Determine the specific mineral type corresponding to the spectral curve; thus determine the mineral type and mineral distribution corresponding to each pixel point, and perform mineral mapping on this basis; wherein, the spectral curve and its matching Mineral formula.

对含有裂隙岩体的图像信息进行裂隙检测、过滤、布点、边界线的拟合、连接与修正等,得到裂隙图像特征。Perform crack detection, filtering, point distribution, boundary line fitting, connection and correction on the image information containing cracked rock mass to obtain the crack image features.

然后利用提取出的图像特征与光谱特征,利用训练好的充填裂隙边界智能识别模型,实现对充填裂隙的边界坐标提取以及充填矿物的信息输出。Then, using the extracted image features and spectral features, and using the trained intelligent recognition model of the filled fracture boundary, the extraction of the boundary coordinates of the filled fractures and the information output of the filled minerals are realized.

本实施例中,充填裂隙边界智能识别模型可以选用现有的神经网络模型来实现,比如:深度神经网络模型,充填裂隙边界智能识别模型对输入数据的具体处理过程如下:In this embodiment, the intelligent identification model for filling the crack boundary can be realized by selecting an existing neural network model, such as: a deep neural network model, and the specific processing process of the input data for the intelligent identification model for filling the crack boundary is as follows:

输入经处理成像光谱图像立方体得到的裂隙图像特征与矿物分布特征,对目标岩体同一位置的裂隙坐标与矿物填图区域进行匹配,对两区域的重合区域边界进行提取,将其视为充填裂隙区域,结合矿物填图最终实现对充填裂隙边界坐标与矿物成分的输出。Input the fissure image features and mineral distribution characteristics obtained from the processed imaging spectral image cube, match the fissure coordinates at the same position of the target rock mass with the mineral mapping area, extract the overlapping area boundaries of the two areas, and regard them as filling fissures area, combined with mineral mapping to finally realize the output of the boundary coordinates and mineral composition of filled fractures.

本实施例中,对于神经网络模型的训练过程如下:In this embodiment, the training process for the neural network model is as follows:

根据已有数据库中的成像光谱图像立方体进行上述的图像特征与光谱特征提取,将其按3:1的比例分为训练集与测试集,将训练集输入到神经网络模型中进行训练,利用测试集对训练好的神经网络模型优化验证,得到最优的神经网络模型;将需要进行充填裂隙识别的目标岩体的图像特征与光谱特征输入到训练好的神经网络模型中,得到充填裂隙识别结果及其边界坐标集,结合矿物成分,完成充填裂隙的输出。According to the imaging spectral image cube in the existing database, the above-mentioned image features and spectral features are extracted, and it is divided into a training set and a test set according to a ratio of 3:1, and the training set is input into the neural network model for training. Set-pair the trained neural network model optimization verification to obtain the optimal neural network model; input the image characteristics and spectral characteristics of the target rock mass that needs to be identified for filling fissures into the trained neural network model to obtain the results of fissure filling identification And its boundary coordinate set, combined with mineral composition, completes the output of filling cracks.

步骤(5):将二维坐标系下的裂隙点云数据集与充填裂隙的边界坐标进行归并处理,得到目标岩体的全部裂隙参数数据;具体包括:裂隙形状、大小、位置及填充物矿物成分等数据。Step (5): Merge the crack point cloud data set in the two-dimensional coordinate system and the boundary coordinates of the filled cracks to obtain all the crack parameter data of the target rock mass; specifically include: crack shape, size, position and filler minerals ingredient data.

其中,进行归并处理的过程具体为:将经维度变换得到的二维不连续点集与充填裂隙边界坐标进行配准,使得两坐标系统一到同一参考坐标系下,结合两种技术所得到的图像信息,确定出同一位置存在两个裂隙识别结果的裂隙坐标数据集,将充填裂隙边界数据对原有裂隙坐标集进行替换,最终确定目标岩体的全部裂隙数据。Among them, the process of merging is specifically as follows: register the two-dimensional discontinuous point set obtained through dimension transformation with the boundary coordinates of the crack filling, so that the two coordinate systems are placed in the same reference coordinate system, and the result obtained by combining the two techniques Based on the image information, it is determined that there are two fracture coordinate datasets in the same position, and the fracture boundary data will be filled to replace the original fracture coordinate set, and finally all the fracture data of the target rock mass will be determined.

将合并的裂隙边界数据进行二次处理,依次对其进行边界线的拟合、连接与修正等操作。The merged fracture boundary data is processed twice, and the boundary line fitting, connection and correction are performed sequentially.

结合充填裂隙填充物分布,将图像光谱数据与裂隙数据输入素描系统实现岩体裂隙素描图的绘制,绘制过程中实现素描图与裂隙参数的一一对应,以便数据调用。Combined with the distribution of fillers for filling fissures, the image spectrum data and fissure data are input into the sketch system to realize the drawing of rock mass fissure sketches.

实施例二Embodiment two

在一个或多个实施方式中,公开了一种融合三维扫描与图像光谱的岩体裂隙智能识别系统;结合图2,本实施例系统具体包括:In one or more embodiments, an intelligent identification system for rock mass fissures that integrates three-dimensional scanning and image spectrum is disclosed; in combination with Figure 2, the system of this embodiment specifically includes:

区域圈定模块,用于实现对待测目标区域的圈定,减少冗余数据获取,降低后期数据处理难度。The area delineation module is used to delineate the target area to be measured, reduce redundant data acquisition, and reduce the difficulty of later data processing.

点云数据获取模块,用于通过三维扫描获取目标岩体的三维点云数据;The point cloud data acquisition module is used to obtain the three-dimensional point cloud data of the target rock mass through three-dimensional scanning;

裂隙点云数据预处理模块,用于对所述三维点云数据进行噪声过滤处理,提取不连续点点集坐标,对提取的不连续点点集坐标进行维度变换,得到二维坐标系下的裂隙点云数据集;The fissure point cloud data preprocessing module is used to perform noise filtering processing on the three-dimensional point cloud data, extract the coordinates of the discontinuous point set, perform dimension transformation on the extracted discontinuous point set coordinates, and obtain the fissure point under the two-dimensional coordinate system cloud dataset;

图像光谱数据获取模块,用于通过光谱扫描获取目标岩体的图像信息和光谱信息;The image spectrum data acquisition module is used to acquire the image information and spectral information of the target rock mass through spectral scanning;

充填裂隙智能提取模块,用于基于光谱信息提取矿物分布特征,基于图像信息提取裂隙图像特征;基于所述矿物分布特征和裂隙图像特征,利用充填裂隙边界智能识别模型,得到充填裂隙的边界坐标以及充填矿物信息;The filling crack intelligent extraction module is used for extracting mineral distribution features based on spectral information, and extracting crack image features based on image information; based on the mineral distribution features and crack image features, using the filling crack boundary intelligent recognition model to obtain the boundary coordinates of the filling crack and filling mineral information;

数据融合模块,用于将裂隙点云数据集与充填裂隙的边界坐标进行校核归并处理,得到岩体裂隙的识别结果。The data fusion module is used for checking and merging the crack point cloud data set and the boundary coordinates of filling cracks to obtain the recognition result of rock mass cracks.

需要说明的是,上述各模块的具体实现方法已经在实施例一中进行了说明,此处不再详述。It should be noted that the specific implementation methods of the above modules have been described in Embodiment 1, and will not be described in detail here.

实施例三Embodiment three

在一个或多个实施方式中,公开了一种融合三维扫描与图像光谱的岩体裂隙智能识别系统,该系统能够实现实施例一中所述的融合三维扫描与图像光谱的岩体裂隙智能识别方法;In one or more embodiments, an intelligent identification system for rock mass fissures that integrates 3D scanning and image spectra is disclosed. method;

结合图3,本实施例系统具体包括:In conjunction with Fig. 3, the system of this embodiment specifically includes:

平台的两侧分别设置有横梁3,两个横梁3分别通过可升降装置与工作平台6连接;三维扫描装置和光谱扫描装置分别搭载在不同的横梁上,横梁上设置有传送装置和转轴,通过横梁上的传送装置及转轴,可实现三维扫描装置或光谱扫描装置的水平位移与转动。The two sides of the platform are respectively provided with beams 3, and the two beams 3 are respectively connected to the working platform 6 through liftable devices; the three-dimensional scanning device and the spectrum scanning device are respectively mounted on different beams, and the beams are provided with transmission devices and rotating shafts. The transmission device and the rotating shaft on the beam can realize the horizontal displacement and rotation of the three-dimensional scanning device or the spectral scanning device.

本实施例中,可升降装置采用液压柱5,可实现自由调节高度,如图4所示,保证两个横梁上的装置互不遮挡,液压柱上还装配有机械臂4,可以实现对设备的远程调控。In this embodiment, the liftable device adopts a hydraulic column 5, which can be adjusted freely. As shown in Figure 4, it is ensured that the devices on the two beams do not block each other. The hydraulic column is also equipped with a mechanical arm 4, which can realize the adjustment of equipment remote control.

三维扫描装置主要由三维激光扫描仪1组成,光谱扫描装置主要由光源、光谱成像仪2构成,光源8采用卤素灯,光源亮度及角度可调。The three-dimensional scanning device is mainly composed of a three-dimensional laser scanner 1. The spectrum scanning device is mainly composed of a light source and a spectral imager 2. The light source 8 is a halogen lamp, and the brightness and angle of the light source are adjustable.

工作平台上还设有微型定位相机9、补光灯12、智能操作显示屏7及其他试验设备与台上物,微型定位相机9,通过多角度拍摄定位目标岩体特征点对待测岩体识别范围进行精确定位,将定位信息通过传感器同步至三维激光扫描仪,实现对待测目标区域的区域锁定,降低后期数据处理难度。补光灯12采用高亮LED光源,对于隧道等光线不足的环境进行补光,保证图像数据采集与微型相机定位工作的顺利进行。The working platform is also equipped with a micro-positioning camera 9, a supplementary light 12, an intelligent operation display screen 7 and other test equipment and objects on the stage, and a micro-positioning camera 9, which can identify the rock mass to be tested by taking pictures from multiple angles and locating the feature points of the target rock mass. Accurate positioning within the range, and the positioning information is synchronized to the 3D laser scanner through the sensor, so as to realize the area locking of the target area to be measured and reduce the difficulty of later data processing. The supplementary light 12 adopts a high-brightness LED light source to supplement light in environments with insufficient light such as tunnels, so as to ensure the smooth progress of image data collection and micro-camera positioning.

工作平台配备有缓震耐磨高性能轮胎,保证装置的平稳移动;工作平台能够带动三维扫描装置和光谱扫描装置移动至设定的目标位置进行数据采集。The working platform is equipped with cushioning and wear-resistant high-performance tires to ensure the smooth movement of the device; the working platform can drive the three-dimensional scanning device and the spectral scanning device to move to the set target position for data collection.

工作平台上还配置有多个电磁波收发装置,电磁波收发装置13通过内置脉冲发生器发射电磁波,利用脉冲在测线上往返传播时间间隔的脉冲个数以求得与周围岩壁的距离,从而可以控制工作平台在既定的路线上自动行驶。本装置还包含配电箱10,其目的在于为整个装置提供能量,将电能进行合理的配置。A plurality of electromagnetic wave transceivers are also arranged on the working platform. The electromagnetic wave transceiver 13 emits electromagnetic waves through a built-in pulse generator, and utilizes the number of pulses at the time interval of the pulse to and fro on the survey line to obtain the distance from the surrounding rock walls, thereby enabling Control the working platform to drive automatically on the established route. The device also includes a power distribution box 10, the purpose of which is to provide energy for the entire device and reasonably configure the electric energy.

本装置还包含把手11,用于短距离的装置运输及人工位置调整。The device also includes a handle 11 for short-distance device transportation and manual position adjustment.

本实施例系统还包括:控制单元,用于接收三维扫描装置和光谱扫描装置采集到的数据,基于这些数据分别得到非充填裂隙点云数据集和充填裂隙的边界坐标数据集,对两个数据集进行归并处理,得到目标岩体的全部裂隙。The system of this embodiment also includes: a control unit, which is used to receive the data collected by the three-dimensional scanning device and the spectral scanning device, and obtain the non-filled fracture point cloud data set and the boundary coordinate data set of the filled fracture based on these data respectively. For the two data The sets are merged to obtain all the fractures of the target rock mass.

控制单元的具体工作过程与实施例一中公开的方法一致,控制单元主要包括一下组成部分:The specific working process of the control unit is consistent with the method disclosed in Embodiment 1, and the control unit mainly includes the following components:

(1)数据收集与处理系统:由数据收集模块与数据处理模块组成。所述数据收集模块负责接受裂隙扫描集成系统获取到的图像、光谱、点云等数据,并对这些数据进行分类、中转等工作;所述数据处理模块由光谱数据处理单元与点云数据处理单元组成。光谱数据处理单元首先对光谱信息进行预处理与图像及矿物特征提取,再将提取特征输入充填裂隙智能识别模型。充填裂隙智能识别模型,通过提取出的图像特征与光谱特征利用神经网络实现对充填裂隙边界坐标集的提取与填充物参数的输出。点云数据处理单元将点云数据与图像数据输入到点云数据智能处理模型中,对点云数据进行处理。点云数据智能处理模型可对点云数据依次进行包含点云强度校正、不同视角下的点云数据配准、非目标点云过滤与不连续点点集坐标提取工作,在此基础上对所得坐标集进行深度维度剔除实现坐标的维度转换。(1) Data collection and processing system: It consists of data collection module and data processing module. The data collection module is responsible for receiving images, spectra, point clouds and other data obtained by the fracture scanning integrated system, and classifying and transferring these data; the data processing module is composed of a spectral data processing unit and a point cloud data processing unit composition. The spectral data processing unit first preprocesses the spectral information and extracts image and mineral features, and then inputs the extracted features into the intelligent identification model for filling cracks. The intelligent identification model for filling cracks, through the extracted image features and spectral features, uses the neural network to realize the extraction of the boundary coordinate set of filling cracks and the output of filling parameters. The point cloud data processing unit inputs the point cloud data and image data into the point cloud data intelligent processing model to process the point cloud data. The point cloud data intelligent processing model can sequentially perform point cloud data including point cloud intensity correction, point cloud data registration under different viewing angles, non-target point cloud filtering, and coordinate extraction of discontinuous point sets. On this basis, the obtained coordinates The set performs depth dimension elimination to realize the dimension transformation of coordinates.

(2)数据归并与储存系统:由数据整合模块与储存模块组成;数据整合模块将接收到的经数据处理后的填充裂隙边界坐标数据集与经维度转换后的裂隙点云数据进行归并处理与裂隙编号,并实现对充填裂隙裂隙与充填物的配对。归并处理实现对来源不同的二维坐标集进行坐标配准、坐标校核、坐标剔除与坐标合并,将归并的裂隙边界坐标数据进行二次处理后输入到岩体裂隙输出系统;所述数据储存模块用于储存数据信息与程序信息,以便数据挪移备份分析及程序的升级检测与修复。(2) Data merging and storage system: It is composed of a data integration module and a storage module; the data integration module merges the received data processing filled crack boundary coordinate data set and the crack point cloud data after dimension conversion. Fissure numbering, and realize the pairing of filling fissures fissures and fillings. The merging process realizes coordinate registration, coordinate checking, coordinate elimination and coordinate merging of two-dimensional coordinate sets from different sources, and the merged crack boundary coordinate data is input to the rock mass crack output system after secondary processing; the data storage The module is used to store data information and program information, so as to facilitate data migration backup analysis and program upgrade detection and repair.

(3)岩体裂隙输出系统:由岩体裂隙素描模块与裂隙参数输出模块组成;所述岩体裂隙素描模块指将裂隙数据输入到裂隙素描软件中,实现对岩体裂隙的图像化描绘与输出,对每条裂隙进行详细绘制。裂隙输出模块由裂隙输出单元与液晶显示屏构成,裂隙输出单元实现对裂隙图像与参数数据的匹配与输出,最终由液晶显示屏显示,通过显示屏可实现对系统的操控、裂隙数据查询与提取等功能。输出的参数信息主要包括:裂隙的方位、形状、大小、充填裂隙填充物的矿物组成成分;(3) Rock mass fissure output system: it is composed of a rock mass fissure sketch module and a fissure parameter output module; the rock mass fissure sketch module refers to inputting fissure data into the fissure sketch software to realize the graphical depiction and analysis of rock mass fissures Output, a detailed plot of each fracture. The crack output module is composed of a crack output unit and a liquid crystal display. The crack output unit realizes the matching and output of the crack image and parameter data, which is finally displayed by the liquid crystal display. The control of the system and the query and extraction of crack data can be realized through the display. and other functions. The output parameter information mainly includes: the orientation, shape, size of the fracture, and the mineral composition of the filler filling the fracture;

(4)智能控制系统:智能控制系统可对系统进行远程遥控,通过控制单元中的无线信号收发器与传感器实现对光谱仪与三维激光扫描仪的启停与姿态调整,实现机械臂、横梁上的传送装置及转轴、光源的自由调节,实现对电磁波收发装置的控制,保证装置的精准移动。实现各系统及配套设施的最优调度与合理配置。还可通过智能控制系统结合远程控制平台实现对上述过程的移动端远程操作,以及对裂隙与参数信息的查看与提取。(4) Intelligent control system: The intelligent control system can remotely control the system, realize the start-stop and attitude adjustment of the spectrometer and 3D laser scanner through the wireless signal transceiver and sensor in the control unit, and realize the control of the robot arm and beam. The free adjustment of the transmission device, the rotating shaft and the light source realizes the control of the electromagnetic wave transceiver device and ensures the precise movement of the device. Realize the optimal scheduling and reasonable allocation of various systems and supporting facilities. It is also possible to realize the remote operation of the mobile terminal of the above process through the combination of the intelligent control system and the remote control platform, as well as the viewing and extraction of crack and parameter information.

上述虽然结合附图对本发明的具体实施方式进行了描述,但并非对本发明保护范围的限制,所属领域技术人员应该明白,在本发明的技术方案的基础上,本领域技术人员不需要付出创造性劳动即可做出的各种修改或变形仍在本发明的保护范围以内。Although the specific implementation of the present invention has been described above in conjunction with the accompanying drawings, it does not limit the protection scope of the present invention. Those skilled in the art should understand that on the basis of the technical solution of the present invention, those skilled in the art do not need to pay creative work Various modifications or variations that can be made are still within the protection scope of the present invention.

Claims (10)

1.一种融合三维扫描与图像光谱的岩体裂隙智能识别方法,其特征在于,包括:1. A method for intelligent identification of rock mass fissures that combines three-dimensional scanning and image spectrum, characterized in that it includes: 通过三维扫描获取目标岩体的三维点云数据;Obtain 3D point cloud data of the target rock mass through 3D scanning; 对所述三维点云数据进行处理,提取不连续点点集坐标,对提取的不连续点点集坐标进行维度变换,得到二维坐标系下的裂隙点云数据集;Processing the three-dimensional point cloud data, extracting the coordinates of the discontinuous point set, and performing dimension transformation on the extracted coordinates of the discontinuous point set, to obtain the crack point cloud data set under the two-dimensional coordinate system; 通过光谱扫描获取目标岩体的图像信息和光谱信息;Obtain the image information and spectral information of the target rock mass through spectral scanning; 基于光谱信息提取矿物分布特征,基于图像信息提取裂隙图像特征;基于所述矿物分布特征和裂隙图像特征,利用充填裂隙边界智能识别模型,得到充填裂隙的边界坐标以及充填矿物信息;Mineral distribution features are extracted based on spectral information, and fissure image features are extracted based on image information; based on the mineral distribution features and fissure image features, the boundary coordinates of the filled fissures and the filling mineral information are obtained by using the intelligent identification model of the filled fissure boundary; 将充填裂隙的边界坐标与二维坐标系下的裂隙点云数据集进行校核归并,得到岩体裂隙的识别结果。The boundary coordinates of the filled fissures are checked and merged with the fissure point cloud data sets in the two-dimensional coordinate system to obtain the identification results of rock mass fissures. 2.如权利要求1所述的一种融合三维扫描与图像光谱的岩体裂隙智能识别方法,其特征在于,对所述三维点云数据进行处理,提取不连续点点集坐标之后,对提取出的不连续点点集坐标进行维度变换,具体过程为:对提取出的不连续点点集的三维(x,y,z)坐标,对z方向数据进行人工删除,转换成二维坐标系下的裂隙点云数据集。2. A kind of rock mass fissure intelligent identification method of fusion three-dimensional scanning and image spectrum as claimed in claim 1, it is characterized in that, described three-dimensional point cloud data is processed, after extracting the coordinates of discontinuous point set, extracting The coordinates of the discontinuous point set are dimensionally transformed. The specific process is: for the extracted three-dimensional (x, y, z) coordinates of the discontinuous point set, manually delete the data in the z direction, and convert it into a crack in the two-dimensional coordinate system. point cloud dataset. 3.如权利要求1所述的一种融合三维扫描与图像光谱的岩体裂隙智能识别方法,其特征在于,基于光谱信息提取矿物分布特征,具体过程为:3. A kind of rock mass fissure intelligent identification method of fusion three-dimensional scanning and image spectrum as claimed in claim 1, it is characterized in that, extract mineral distribution feature based on spectral information, specific process is: 获取图像中每一个像素点的光谱曲线,基于相邻两个光谱曲线的光谱角是否小于设定阈值,来确定这两个像素点是否属于同一类岩体,将光谱曲线与光谱数据库进行匹配,确定该光谱曲线对应的具体的矿物类型;从而确定出每一个像素点对应的矿物类型以及矿物分布情况,并进行矿物填图;其中,光谱数据库中预存有光谱曲线以及与其匹配的矿物分子式。Obtain the spectral curve of each pixel in the image, and determine whether the two pixel points belong to the same type of rock mass based on whether the spectral angle of two adjacent spectral curves is smaller than the set threshold, and match the spectral curve with the spectral database. Determine the specific mineral type corresponding to the spectral curve; thereby determine the mineral type and mineral distribution corresponding to each pixel point, and perform mineral mapping; where the spectral curve and the matching mineral molecular formula are pre-stored in the spectral database. 4.如权利要求1所述的一种融合三维扫描与图像光谱的岩体裂隙智能识别方法,其特征在于,所述充填裂隙边界智能识别模型采用设定的神经网络模型,对于充填裂隙边界智能识别模型的识别过程,具体包括:4. A kind of rock mass fissure intelligent identification method of fusion three-dimensional scanning and image spectrum as claimed in claim 1, it is characterized in that, described filling fissure boundary intelligent recognition model adopts the neural network model of setting, for filling fissure boundary intelligence Identify the identification process of the model, specifically including: 根据已有数据库中的成像光谱图像立方体进行图像特征与光谱特征的提取,将设定比例划分为训练集与测试集,将训练集输入到神经网络模型中进行训练,利用测试集对训练好的神经网络模型优化验证,得到最优的神经网络模型;将需要进行充填裂隙识别的目标岩体的图像特征与光谱特征输入到训练好的神经网络模型中,得到充填裂隙识别结果及其边界坐标集,结合矿物成分,得到充填裂隙的边界坐标以及充填矿物信息。According to the imaging spectral image cube in the existing database, the image features and spectral features are extracted, and the set ratio is divided into training set and test set, and the training set is input into the neural network model for training, and the trained set is used for training. The neural network model is optimized and verified to obtain the optimal neural network model; the image characteristics and spectral characteristics of the target rock mass that need to be identified for filling cracks are input into the trained neural network model to obtain the identification results of filling cracks and their boundary coordinates , combined with the mineral composition, the boundary coordinates of the filled fractures and the information of the filled minerals are obtained. 5.如权利要求1所述的一种融合三维扫描与图像光谱的岩体裂隙智能识别方法,其特征在于,将充填裂隙的边界坐标与二维坐标系下的裂隙点云数据集进行校核归并,具体为:5. A method for intelligent identification of rock mass fissures fused with three-dimensional scanning and image spectrum as claimed in claim 1, characterized in that the boundary coordinates of the filled fissures are checked against the fissure point cloud datasets under the two-dimensional coordinate system Merge, specifically: 将二维坐标系下的裂隙点云数据坐标与充填裂隙的边界坐标进行配准,将两种坐标统一到同一个参考坐标系下,将充填裂隙的边界坐标替换相对应位置的二维坐标系下的裂隙点云数据坐标。Register the coordinates of the crack point cloud data in the two-dimensional coordinate system with the boundary coordinates of the crack filling, unify the two coordinates into the same reference coordinate system, and replace the boundary coordinates of the crack filling with the two-dimensional coordinate system of the corresponding position The coordinates of the fracture point cloud data below. 6.如权利要求1所述的一种融合三维扫描与图像光谱的岩体裂隙智能识别方法,其特征在于,得到岩体裂隙的识别结果,具体包括:裂隙的位置、充填矿物信息以及裂隙的尺寸。6. A method for intelligent identification of rock mass fissures fused with three-dimensional scanning and image spectrum as claimed in claim 1, characterized in that the identification results of rock mass fissures are obtained, which specifically include: the position of the fissure, the filling mineral information and the information of the fissure. size. 7.一种融合三维扫描与图像光谱的岩体裂隙智能识别系统,其特征在于,包括:7. An intelligent identification system for rock mass fissures that integrates three-dimensional scanning and image spectrum, characterized in that it includes: 点云数据获取模块,用于通过三维扫描获取目标岩体的三维点云数据;The point cloud data acquisition module is used to obtain the three-dimensional point cloud data of the target rock mass through three-dimensional scanning; 裂隙点云数据预处理模块,用于对所述三维点云数据进行处理,提取不连续点点集坐标,对提取的不连续点点集坐标进行维度变换,得到二维坐标系下的裂隙点云数据集;The fracture point cloud data preprocessing module is used to process the three-dimensional point cloud data, extract the coordinates of the discontinuous point set, perform dimension transformation on the extracted discontinuous point set coordinates, and obtain the fissure point cloud data in the two-dimensional coordinate system set; 图像光谱数据获取模块,用于通过光谱扫描获取目标岩体的图像信息和光谱信息;The image spectrum data acquisition module is used to acquire the image information and spectral information of the target rock mass through spectral scanning; 充填裂隙数据获取模块,用于基于光谱信息提取矿物分布特征,基于图像信息提取裂隙图像特征;基于所述矿物分布特征和裂隙图像特征,利用充填裂隙边界智能识别模型,得到充填裂隙的边界坐标以及充填矿物信息;The fissure filling data acquisition module is used to extract mineral distribution features based on spectral information, and to extract fissure image features based on image information; based on the mineral distribution characteristics and fissure image features, the boundary coordinates of the fissure filling and the filling mineral information; 数据融合模块,用于将充填裂隙的边界坐标与二维坐标系下的裂隙点云数据集进行校核归并,得到岩体裂隙的识别结果。The data fusion module is used to check and merge the boundary coordinates of the filled cracks with the crack point cloud data sets in the two-dimensional coordinate system to obtain the identification results of rock mass cracks. 8.如权利要求7所述的一种融合三维扫描与图像光谱的岩体裂隙智能识别系统,其特征在于,所述数据融合模块将二维坐标系下的裂隙点云数据坐标与充填裂隙的边界坐标进行配准,将两种坐标统一到同一个参考坐标系下,将充填裂隙的边界坐标替换相对应位置的二维坐标系下的裂隙点云数据坐标。8. A kind of rock mass fissure intelligent recognition system of fusion three-dimensional scanning and image spectrum as claimed in claim 7, it is characterized in that, described data fusion module combines the fissure point cloud data coordinates under the two-dimensional coordinate system and the fissure filling fissure The boundary coordinates are registered, and the two coordinates are unified into the same reference coordinate system, and the boundary coordinates of the filled cracks are replaced with the crack point cloud data coordinates in the two-dimensional coordinate system of the corresponding position. 9.一种融合三维扫描与图像光谱的岩体裂隙智能识别系统,用于实现权利要求1-7任一项所述的融合三维扫描与图像光谱的岩体裂隙智能识别方法,其特征在于,所述系统包括:9. An intelligent identification system for rock mass fissures that fuses three-dimensional scanning and image spectra, for realizing the intelligent identification method for rock mass fissures that fuses three-dimensional scanning and image spectra according to any one of claims 1-7, characterized in that, The system includes: 工作平台;working platform; 设置在工作平台上的电磁波收发装置,所述电磁波收发装置能够向侧面岩壁发射电磁波,利用所述电磁波往返的传播时间能够得到电磁波收发装置与侧面岩壁之间的距离,以控制工作平台按照设定的路线自动移动;The electromagnetic wave transceiver device arranged on the working platform, the electromagnetic wave transceiver device can emit electromagnetic waves to the side rock wall, and the distance between the electromagnetic wave transceiver device and the side rock wall can be obtained by using the round-trip propagation time of the electromagnetic wave, so as to control the working platform according to the The set route moves automatically; 相对设置在工作平台上的横梁,所述横梁分别通过可升降装置与工作平台连接;三维扫描装置和光谱扫描装置分别搭载在不同的横梁上,并能够沿横梁转动和平移;所述工作平台能够带动三维扫描装置和光谱扫描装置自动移动至设定的目标位置进行数据采集;Relative to the beams arranged on the working platform, the beams are respectively connected to the working platform through liftable devices; the three-dimensional scanning device and the spectral scanning device are respectively mounted on different beams, and can rotate and translate along the beams; the working platform can Drive the three-dimensional scanning device and the spectral scanning device to automatically move to the set target position for data collection; 控制单元,用于接收三维扫描装置和光谱扫描装置采集到的数据,基于所述数据分别得到裂隙点云数据集和充填裂隙的边界坐标数据集,对两个数据集进行归并处理,得到目标岩体的全部裂隙。The control unit is used to receive the data collected by the three-dimensional scanning device and the spectral scanning device, obtain a fracture point cloud data set and a boundary coordinate data set for filling the fracture based on the data, and merge and process the two data sets to obtain the target rock All fissures of the body. 10.如权利要求9所述的一种融合三维扫描与图像光谱的岩体裂隙智能识别系统,其特征在于,还包括:设置在工作平台上的微型定位相机,所述微型定位相机通过多角度拍摄定位目标岩体特征点对待测岩体识别范围进行精确定位,将定位信息传送至三维扫描装置,实现对待测目标区域的区域锁定。10. A rock mass fissure intelligent recognition system that integrates three-dimensional scanning and image spectrum as claimed in claim 9, further comprising: a miniature positioning camera arranged on the working platform, and the miniature positioning camera passes through multi-angle Shoot and locate the feature points of the target rock mass to accurately locate the identification range of the rock mass to be measured, and transmit the positioning information to the 3D scanning device to realize the area locking of the target area to be measured.
CN202211291423.4A 2022-10-19 2022-10-19 Rock mass fracture intelligent identification method and system integrating three-dimensional scanning and image spectrum Active CN115753643B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211291423.4A CN115753643B (en) 2022-10-19 2022-10-19 Rock mass fracture intelligent identification method and system integrating three-dimensional scanning and image spectrum

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211291423.4A CN115753643B (en) 2022-10-19 2022-10-19 Rock mass fracture intelligent identification method and system integrating three-dimensional scanning and image spectrum

Publications (2)

Publication Number Publication Date
CN115753643A true CN115753643A (en) 2023-03-07
CN115753643B CN115753643B (en) 2024-12-27

Family

ID=85352515

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211291423.4A Active CN115753643B (en) 2022-10-19 2022-10-19 Rock mass fracture intelligent identification method and system integrating three-dimensional scanning and image spectrum

Country Status (1)

Country Link
CN (1) CN115753643B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116309807A (en) * 2023-04-04 2023-06-23 中南大学 A Core Ground Relocation System Based on Digital Image Intelligent Recognition
CN117218448A (en) * 2023-09-28 2023-12-12 西安科技大学 Coal and rock identification method based on Bayesian model fusion geological information
CN118171351A (en) * 2024-03-07 2024-06-11 山东大学 A tunnel twin virtual body modeling method and system based on multi-source data drive
CN118397209A (en) * 2024-06-27 2024-07-26 河北华勘地质勘查有限公司 Visualization method and system for mine goaf measurement data

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111189864A (en) * 2020-01-13 2020-05-22 中国石油天然气股份有限公司 EPMA-WDX full-rock mineral identification and plane imaging method and device
CN112348880A (en) * 2020-11-10 2021-02-09 重庆科技学院 Construction method of unconventional reservoir multi-scale and multi-component digital core
CN113191330A (en) * 2021-05-27 2021-07-30 宜宾学院 Method for identifying area growth pores by fusing secondary electrons and back scattering electron images
CN113609696A (en) * 2021-08-16 2021-11-05 中国地质大学(北京) Multi-scale and multi-component digital core construction method and system based on image fusion
CN114418965A (en) * 2021-12-29 2022-04-29 西南石油大学 A method for outcrop crack identification based on lidar technology
CN114648563A (en) * 2022-03-24 2022-06-21 中国石油大学(华东) Registration method of core CT scanning image and spliced SEM image
CN114894814A (en) * 2022-03-24 2022-08-12 佛山市公路桥梁工程监测站有限公司 Bridge and culvert detection method, computer and equipment
CN115019010A (en) * 2022-06-23 2022-09-06 江苏燕宁工程科技集团有限公司 Tunnel structure disease display method based on three-dimensional laser scanning and BIM technology

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111189864A (en) * 2020-01-13 2020-05-22 中国石油天然气股份有限公司 EPMA-WDX full-rock mineral identification and plane imaging method and device
CN112348880A (en) * 2020-11-10 2021-02-09 重庆科技学院 Construction method of unconventional reservoir multi-scale and multi-component digital core
CN113191330A (en) * 2021-05-27 2021-07-30 宜宾学院 Method for identifying area growth pores by fusing secondary electrons and back scattering electron images
CN113609696A (en) * 2021-08-16 2021-11-05 中国地质大学(北京) Multi-scale and multi-component digital core construction method and system based on image fusion
CN114418965A (en) * 2021-12-29 2022-04-29 西南石油大学 A method for outcrop crack identification based on lidar technology
CN114648563A (en) * 2022-03-24 2022-06-21 中国石油大学(华东) Registration method of core CT scanning image and spliced SEM image
CN114894814A (en) * 2022-03-24 2022-08-12 佛山市公路桥梁工程监测站有限公司 Bridge and culvert detection method, computer and equipment
CN115019010A (en) * 2022-06-23 2022-09-06 江苏燕宁工程科技集团有限公司 Tunnel structure disease display method based on three-dimensional laser scanning and BIM technology

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
姚骏屏;王卫星;: "一种基于图像融合的岩石裂隙充填物分割方法", 重庆邮电学院学报(自然科学版), no. 01, 28 February 2006 (2006-02-28) *
孙刚;: "基于显微CT扫描的膨胀岩土体的裂隙结构与分形特征研究", 化工矿物与加工, no. 09, 20 September 2018 (2018-09-20) *
潘东东: "考虑剪切接触与碎屑充填的裂隙渗流模型与数值分析", 中南大学学报(自然科学版), vol. 50, no. 7, 31 July 2019 (2019-07-31) *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116309807A (en) * 2023-04-04 2023-06-23 中南大学 A Core Ground Relocation System Based on Digital Image Intelligent Recognition
CN116309807B (en) * 2023-04-04 2024-04-26 中南大学 A core ground relocation system based on digital image intelligent recognition
CN117218448A (en) * 2023-09-28 2023-12-12 西安科技大学 Coal and rock identification method based on Bayesian model fusion geological information
CN117218448B (en) * 2023-09-28 2024-08-27 西安科技大学 Coal and rock identification method based on Bayesian model fusion geological information
CN118171351A (en) * 2024-03-07 2024-06-11 山东大学 A tunnel twin virtual body modeling method and system based on multi-source data drive
CN118397209A (en) * 2024-06-27 2024-07-26 河北华勘地质勘查有限公司 Visualization method and system for mine goaf measurement data

Also Published As

Publication number Publication date
CN115753643B (en) 2024-12-27

Similar Documents

Publication Publication Date Title
CN115753643A (en) Intelligent recognition method and system for rock mass fissures combining 3D scanning and image spectrum
CN106055820B (en) III type track plates machining deviation detection method of CRTS
CN104932001B (en) A kind of 3D nuclear radiation environments in real time rebuild monitoring system
JP5891560B2 (en) Identification-only optronic system and method for forming three-dimensional images
CN105115560B (en) A kind of non-contact measurement method of cabin volume of compartment
WO2022078442A1 (en) Method for 3d information acquisition based on fusion of optical scanning and smart vision
CN104502990A (en) Geological survey method of tunnel face based on digital image
CN107747910A (en) The tunnel mark point coordinates laser measurement system and method for a kind of vision guide
CN108107462A (en) The traffic sign bar gesture monitoring device and method that RTK is combined with high speed camera
WO2022078439A1 (en) Apparatus and method for acquisition and matching of 3d information of space and object
WO2022078440A1 (en) Device and method for acquiring and determining space occupancy comprising moving object
CN112288848A (en) Method for calculating engineering quantity through three-dimensional modeling of unmanned aerial vehicle aerial photography
CN104933223A (en) Power transmission line channel digital surveying method
CN115564717A (en) Mining area ground surface crack parameter extraction method based on unmanned aerial vehicle image
CN112254680B (en) Multi freedom's intelligent vision 3D information acquisition equipment
Bistacchi et al. Digital outcrop model reconstruction and interpretation
He et al. Construction of 3D Model of Tunnel Based on 3D Laser and Tilt Photography.
WO2022078433A1 (en) Multi-location combined 3d image acquisition system and method
CN116030208A (en) Method and system for building scene of virtual simulation power transmission line of real unmanned aerial vehicle
CN114943890A (en) Substation site leveling identification method using unmanned aerial vehicle laser point cloud
Nguyen et al. 3D object model reconstruction based on laser scanning point cloud data
CN112254638B (en) Intelligent visual 3D information acquisition equipment that every single move was adjusted
CN117630002A (en) Full-process quality detection method and system for drilling and blasting tunnel
WO2022078437A1 (en) Three-dimensional processing apparatus and method between moving objects
CN115601517A (en) Rock mass structural plane information acquisition method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant