CN115901640A - Unfavorable geology advanced prediction method and system integrating spectral imaging and space-time distribution - Google Patents

Unfavorable geology advanced prediction method and system integrating spectral imaging and space-time distribution Download PDF

Info

Publication number
CN115901640A
CN115901640A CN202211281361.9A CN202211281361A CN115901640A CN 115901640 A CN115901640 A CN 115901640A CN 202211281361 A CN202211281361 A CN 202211281361A CN 115901640 A CN115901640 A CN 115901640A
Authority
CN
China
Prior art keywords
tunnel face
content
minerals
image
marker
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202211281361.9A
Other languages
Chinese (zh)
Other versions
CN115901640B (en
Inventor
许振浩
韩涛
余腾飞
许广璐
刘福民
李轶惠
林鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong University
Original Assignee
Shandong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong University filed Critical Shandong University
Priority to CN202211281361.9A priority Critical patent/CN115901640B/en
Publication of CN115901640A publication Critical patent/CN115901640A/en
Application granted granted Critical
Publication of CN115901640B publication Critical patent/CN115901640B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/30Assessment of water resources

Landscapes

  • Geophysics And Detection Of Objects (AREA)

Abstract

The invention discloses a method and a system for forecasting unfavorable geology in advance by fusing spectral imaging and space-time distribution, wherein the method comprises the following steps: carrying out mesh division on the tunnel face, and selecting control points; selecting a marker mineral of a poor geologic body according to the tunnel face image spectral data of the excavated segment; determining the content of the marker minerals at the control points according to the image spectrum data of the tunnel face at the excavation position, and predicting the content of the marker minerals at the control points in front of the tunnel face; according to the content of the marker minerals of the control points in front of the tunnel face, carrying out spatial interpolation processing on the content of the marker minerals between the control points to obtain the content of the marker minerals in front of the tunnel face; and (4) delineating the mineral abnormal area according to the content of the marked minerals in front of the tunnel face to obtain the position, scale and type of the poor geologic body in front of the tunnel face. The unfavorable geology is subjected to advanced prediction by combining an image spectrum technology with a time sequence and a spatial interpolation method, and the shape and the character of the front unfavorable geologic body are judged and predicted.

Description

Unfavorable geology advanced prediction method and system integrating spectral imaging and space-time distribution
Technical Field
The invention relates to the technical field of advance forecasting of unfavorable geologic bodies, in particular to an advance forecasting method and system for unfavorable geologic bodies, which integrate spectral imaging and space-time distribution.
Background
The statements in this section merely provide background information related to the present disclosure and may not constitute prior art.
In the tunnel construction process, adverse geology such as faults, karsts, altered zones and the like is frequently encountered, and if corresponding prevention and control measures are not taken timely, geological disasters such as surrounding rock deformation, vault collapse, large-scale water and mud inrush and the like are easily induced, so that the situations of casualties, construction period delay, equipment damage and the like are caused.
When the traditional methods such as a geological survey method, a geophysical prospecting method and the like are used for advanced geological prediction, the shape (position, shape and scale) of front unfavorable geology is mainly recognized, the character (type and property) of the unfavorable geology is difficult to judge, the operation flow is complex, the requirement on professional geological knowledge of field technicians is high, and misjudgment and missed judgment on the unfavorable geology are easily caused; however, in the conventional method for quantitatively identifying a defective geologic body based on mineral information, information on the shape such as the position and scale of the defective geologic body is not combined.
Disclosure of Invention
In order to solve the problems, the invention provides an advance forecasting method and system for unfavorable geology integrating spectral imaging and space-time distribution, which are used for carrying out advance forecasting on the unfavorable geology by combining an image-spectrum technology with a time sequence and spatial interpolation method, realizing the combined identification and forecasting of the shape and the property of the front unfavorable geologic body, realizing the automation and the intellectualization of the integral operation of the system, reducing the subjectivity of the unfavorable geology forecasting, saving manpower and material resources, and having the advantages of high speed, no damage in situ, strong intuition, real-time forecasting and the like.
In order to achieve the purpose, the invention adopts the following technical scheme:
in a first aspect, the present invention provides a method for forecasting unfavorable geology by integrating spectral imaging and spatial-temporal distribution, including:
carrying out mesh division on the tunnel face, and selecting a limited number of mesh points covering the tunnel face as control points;
selecting a marker mineral of a poor geologic body according to the tunnel face image spectral data of the excavated segment;
determining the content of the marker minerals at the control points according to the image spectrum data of the tunnel face at the excavation position, and predicting the content of the marker minerals at the control points in front of the tunnel face;
according to the content of the marker minerals of the control points in front of the tunnel face, carrying out spatial interpolation processing on the content of the marker minerals between the control points to obtain the content of the marker minerals in front of the tunnel face;
and (4) delineating the mineral abnormal area according to the content of the marked minerals in front of the tunnel face to obtain the position, scale and type of the poor geologic body in front of the tunnel face.
As an alternative implementation mode, the contents of various minerals are obtained according to the image spectrum data of the tunnel face of the excavated segment, and the minerals with the mineral content change exceeding a set threshold value in the adverse geological affected area and the normal surrounding rock area are selected as the marker minerals.
As an alternative embodiment, the mesh pitch is set, and the tunnel face is relatively equidistantly meshed according to the mesh pitch.
In an alternative embodiment, the image spectrum data is collected by an image spectrometer, and the optimal relative position between the image spectrometer and the palm surface is required to satisfy the condition that the shot image is distributed in the core area of the palm surface.
As an alternative embodiment, the parameters of the image spectrometer scan include frequency increment, gaze time, and camera focal length; acquiring image spectrum data of different wave bands by adjusting the tuning wavelength of the frequency increment; by adjusting the gaze time, the spectral resolution is improved; the position and the size of the tunnel face in the camera vision field can be adjusted by adjusting the focal length of the camera.
As an alternative embodiment, a time series method is adopted for learning, and the content of the marker minerals at the control point in front of the tunnel face is predicted; and outputting the spatial point-like discontinuous mineral content of the control point into spatial body-like continuous mineral content by adopting a spatial interpolation method, and displaying the difference of the mineral content by the filling and color developing effects of the spatial body.
In an alternative embodiment, the boundary value of the mineral abnormity is determined, the filling and color developing effects of the space body are adjusted, and the range of the mineral abnormity area is defined.
As an alternative embodiment, the image spectrum data of the tunnel face at the excavation is preprocessed, and the preprocessing comprises radiometric calibration, reflectivity reconstruction and noise weakening;
performing end member extraction on the preprocessed image spectrum data to obtain a pixel spectrum curve, and determining a final mineral end member spectrum by contrasting the pixel spectrum curve with a standard mineral spectrum library so as to perform mineral identification;
and calculating the mineral content by stages by using an image pixel classification statistical method.
In a second aspect, the present invention provides a system for forecasting unfavorable geology by integrating spectral imaging and spatial-temporal distribution, comprising:
the control point selection module is configured to perform grid division on the tunnel face and select a limited number of grid points covering the tunnel face as control points;
the mark mineral selecting module is configured to select mark minerals of the poor geologic body according to the tunnel face image spectral data of the excavated segment;
the mineral content prediction module is configured to determine the content of the marker minerals at the control points according to the image spectrum data of the tunnel face at the excavation position, and predict the content of the marker minerals at the control points in front of the tunnel face;
the spatial interpolation module is configured to perform spatial interpolation processing on the marker mineral content between the control points according to the marker mineral content of the control points in front of the tunnel face to obtain the marker mineral content in front of the tunnel face;
and the advanced forecasting module is configured to define the mineral abnormal area according to the content of the marked minerals in the front of the tunnel face, so as to obtain the position, the scale and the type of the unfavorable geologic body in the front of the tunnel face.
In a third aspect, the present invention provides a system for forecasting unfavorable geology by integrating spectral imaging and spatial-temporal distribution, including:
the device comprises a mobile platform, a main control module, a data acquisition module, a device adjusting unit and a bad geologic body advanced forecasting module, wherein the main control module, the data acquisition module, the device adjusting unit and the bad geologic body advanced forecasting module are carried on the mobile platform;
the main control module is configured to control the starting and stopping of the data acquisition module, the device adjusting unit and the unfavorable geologic body advanced forecasting module;
the data acquisition module is used for acquiring image spectrum data of the tunnel face;
the device adjusting unit is used for adjusting the position of the data acquisition module so as to enable the data acquisition module to move to the optimal relative position with the tunnel face;
the poor geologic body advanced forecasting module receives image spectrum data of a tunnel face and is configured to perform the delineation of mineral abnormal areas by adopting the method of the first aspect according to the image spectrum data so as to obtain the position, scale and type of the poor geologic body in front of the tunnel face.
As an alternative embodiment, the data acquisition module comprises a protection device and an image spectrometer arranged in the protection device; the parameters scanned by the image spectrometer comprise frequency increment, staring time and camera focal length; acquiring image spectrum data of different wave bands by adjusting the tuning wavelength of the frequency increment; by adjusting the gaze time, the spectral resolution is improved; the position and the size of the tunnel face in the camera vision field can be adjusted by adjusting the focal length of the camera.
As an alternative embodiment, the device adjustment unit comprises a laser rangefinder; the laser range finder is used for measuring the distance between the mobile platform and the face of the tunnel and controlling the mobile platform to move to the optimal relative position of the data acquisition module and the face of the tunnel.
As an alternative embodiment, the determination of the optimal relative position between the data acquisition module and the palm surface is performed in such a way that the captured image covers the core area of the palm surface.
As an optional implementation mode, the device adjusting unit further comprises a telescopic support, a sliding rail and a holder;
the telescopic bracket is used for adjusting the height of the data acquisition module so as to adjust the visual field range of the camera;
the sliding rail is arranged on the moving platform, and the telescopic bracket is arranged on the sliding rail so as to move on the sliding rail;
the holder is used for bearing the laser range finder and the data acquisition module.
In a fourth aspect, the present invention provides an electronic device comprising a memory and a processor, and computer instructions stored on the memory and executed on the processor, wherein when the computer instructions are executed by the processor, the method of the first aspect is performed.
In a fifth aspect, the present invention provides a computer readable storage medium for storing computer instructions which, when executed by a processor, perform the method of the first aspect.
Compared with the prior art, the invention has the following beneficial effects:
the invention provides a method and a system for forecasting unfavorable geology in advance by fusing spectral imaging and space-time distribution, wherein the shape of a bad geologic body is predicted by spatial interpolation delineation, the property of the bad geologic body is predicted by quantitative mineral inversion of rock spectral information, the combined identification and forecasting of the shape and the property of the front bad geologic body are realized, the automatic and intelligent advanced forecasting of the bad geology in a tunnel is realized, the influence of subjective factors on a forecasting result is eliminated, manpower and material resources are saved, the real-time forecasting of the bad geology in the continuous tunnel excavation process is realized, and the method and the system have timeliness.
The invention provides an advance forecasting method and system for unfavorable geology by fusing spectral imaging and space-time distribution, which deeply fuses an image spectral technology, a time sequence and a spatial interpolation method, fully utilizes the advantages of the methods and realizes advance forecasting of the unfavorable geology in a tunnel. The tunnel face in-situ, lossless, rapid and large-scale image spectrum information acquisition is realized through an image spectrometer; the mineral content prediction at the control point in front of the tunnel face is realized by using a time sequence method, and a foundation is laid for delineation of mineral abnormity and prediction of bad geological bodies; the mineral distribution space is three-dimensionally and visually displayed by using a space interpolation method, the mineral distribution change condition in front of the tunnel face of the tunnel is visually displayed, the delineation of abnormal positions, scales and types of minerals is realized, and the purpose of predicting the shape and the property of unfavorable geology is achieved; the whole flow is smooth in logic, the loops are buckled, and the advanced prediction of unfavorable geology in the tunnel is completed under the combined action.
The method and the system for forecasting the unfavorable geology in advance by fusing the spectral imaging and the space-time distribution can acquire image spectral data in real time along with tunnel excavation, dynamically select the marker minerals of the unfavorable geologic body, have strong engineering adaptability, continuously feed the image spectral data back to the data set, increase time sequence learning samples, continuously optimize the model for forecasting the unfavorable geologic body in advance based on a time sequence method, improve the accuracy of model forecasting and reduce the contingency caused by data deviation.
Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the invention and together with the description serve to explain the invention and not to limit the invention.
Fig. 1 is a flowchart of a method for forecasting unfavorable geology in advance by fusing spectral imaging and spatial-temporal distribution according to embodiment 1 of the present invention;
fig. 2 is a schematic diagram of grid division and control point selection provided in embodiment 1 of the present invention;
fig. 3 is a schematic structural diagram of an unfavorable geological advanced prediction system integrating spectral imaging and spatial-temporal distribution according to embodiment 3 of the present invention;
the system comprises a main control module 1, a laser range finder 2, a wireless signal transmitter 3, an image spectrometer 4, a protection device 5, a telescopic support 6, a sliding rail 7, a sliding rail 8 and a cloud deck.
Detailed Description
The invention is further described with reference to the following figures and examples.
It should be noted that the following detailed description is exemplary and is intended to provide further explanation of the invention. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
It is noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the invention. As used herein, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise, and it should be understood that the terms "comprises" and "comprising", and any variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The embodiments and features of the embodiments of the present invention may be combined with each other without conflict.
Example 1
The present embodiment provides a method for forecasting unfavorable geology in advance by fusing spectral imaging and spatial-temporal distribution, as shown in fig. 1, including:
carrying out mesh division on the tunnel face, and selecting a limited number of mesh points covering the tunnel face as control points;
selecting a marker mineral of a poor geologic body according to the tunnel face image spectral data of the excavated segment;
determining the content of the marker minerals at the control points according to the image spectrum data of the tunnel face at the excavation position, and predicting the content of the marker minerals at the control points in front of the tunnel face;
according to the content of the marker minerals of the control points in front of the tunnel face, carrying out spatial interpolation processing on the content of the marker minerals between the control points to obtain the content of the marker minerals in front of the tunnel face;
and (4) delineating the mineral abnormal area according to the content of the marked minerals in front of the tunnel face to obtain the position, scale and type of the poor geologic body in front of the tunnel face.
In the embodiment, an image spectrometer is adopted to continuously obtain image spectrum data of a tunnel face in the tunnel excavation process, and the image spectrometer is adjusted to an optimal position in advance;
the determination of the optimal relative position between the image spectrometer and the face needs to meet the requirement that the shot image is distributed in the core area of the face as much as possible; because the face is the key area of mineral test, the integrality of face in the camera field of vision needs to be guaranteed, promotes its imaging quality, guarantees the integrality, the representativeness of acquireing data and the accuracy of data test.
As an alternative embodiment, the parameters of the image spectrometer scanning include frequency increment, gaze time, camera focal length, and the like; acquiring image spectrum data of different wave bands by adjusting the tuning wavelength of the frequency increment; the fixation time is adjusted to improve the spectral resolution and optimize the imaging quality; the position and the size of the tunnel face in the camera view field are adjusted by adjusting the focal length of the camera, and the integrity of data is guaranteed.
As an alternative implementation, the image spectrometer can select a staring type image spectrometer, relative movement with a palm surface in a three-dimensional space of a mobile platform is realized through a sliding rail and a telescopic support, a proper gaze position is selected through information of the palm surface in a visual field of a camera of the image spectrometer, and after positioning, the image spectrum data of the palm surface is acquired in situ.
As an alternative embodiment, the image spectrometer can also select a push-broom type image spectrometer, a swing-broom type image spectrometer and the like, and realizes the relative movement with the palm surface in the three-dimensional space of the mobile platform through the slide rail and the telescopic bracket, so as to realize the scanning of the palm surface.
In an alternative embodiment, the image spectrometer collects the image spectrum data of the tunnel face, and the wavelength range is selected to be 0.35-25um.
In the embodiment, quantitative identification of mineral content is carried out on image spectrum data of an excavated section, so as to select the marker minerals of the poor geologic body;
as an alternative implementation mode, the content information of various minerals at the face is obtained by carrying out image spectrum test on the excavated segment, and the minerals with obviously changed contents in the adverse geological affected area and the normal surrounding rock area are selected as the marker minerals; such as minerals whose content difference exceeds a threshold value.
As an alternative implementation mode, mineral testing is continuously carried out along with continuous excavation of the tunnel, and a testing result is also continuously fed back, so that the types of the marked minerals are continuously updated and adjusted in the tunneling process to adapt to the geological conditions of different standard sections.
As an alternative implementation mode, selecting a plurality of minerals which are common in tunnel engineering sites, have important influence on the stability and construction safety of surrounding rocks and have obviously changed content as unfavorable geological marker minerals; for example clay minerals (illites, kaolinites, smectites, etc.), altered minerals (chlorite, agalmatolite, zeolites, etc.) and also partly rock-making minerals.
In the embodiment, along with excavation of the tunnel face, a large amount of tunnel face image spectrum data (a normal surrounding rock area and a bad geological influence area) are collected, and after preprocessing is performed on the image spectrum data, quantitative inversion is performed on mineral content to obtain mineral types and content distribution conditions at a tunnel face control point; the process of carrying out the quantitative identification of the mineral content according to the image spectrum data comprises the following steps:
firstly, preprocessing image spectrum data, wherein the preprocessing comprises radiometric calibration, reflectivity reconstruction and noise weakening;
the radiometric calibration utilizes preset calibration parameters to perform radiometric calibration on the acquired palm surface image spectral data, and establishes a relation between a DN value and a real radiance value of an original image according to a radiometric calibration formula to realize conversion from the original image value to the radiometric value;
the reflectivity reconstruction eliminates environmental errors through a standard plate reflectivity calibration method, realizes the conversion from a radiation value to reflectivity, and establishes a tunnel face image reflectivity spectrum;
the noise elimination adopts maximum noise separation transformation, reduces the redundancy of data, reduces the operation dimension and weakens the noise.
And then, performing end member extraction on the palm surface image spectral data with the noise eliminated by using a pure pixel index algorithm (PPI) to obtain a pixel spectral curve, determining a final mineral end member spectrum by comparing the pixel spectral curve with a standard mineral spectrum library and spectrum theory knowledge, and performing mineral identification based on the final mineral end member spectrum.
As an alternative implementation mode, the relative content data of the face minerals are calculated in a segmented mode by using an image pixel classification statistical method, and quantitative identification of the content of the face minerals is achieved.
In the embodiment, the working face is subjected to mesh division according to the acquired image information, and working face control points are selected;
as an alternative, as shown in fig. 2, the selection of the mesh division and control points is performed by selecting mesh intervals according to the size of the actual face, so that the selected control points are representative and the intervals between the control points are proper, the face is divided at relatively equal intervals according to the mesh intervals, and a limited number of mesh points capable of covering the face are selected as the control points for obtaining the mineral content at the face; the representativeness of the selection of the control points of the tunnel face is ensured, the distribution condition of minerals on the tunnel face is fully reflected while the data processing workload is reduced, the minerals are abnormally visualized through a spatial interpolation method based on the mineral content information at the control points, and the accuracy of the visual output of the subsequent spatial interpolation is ensured to a certain extent.
In this embodiment, the time-series method is applied to one point of the face, a plurality of faces are connected to form a line, the time-series method is used for predicting the content change of a certain mineral on the line, and if the countless points of the face are predicted by the time-series method, the workload is too large, the speed is not high, the efficiency is high, therefore, the selected control point position can cover the whole face, the number is limited, the accuracy and the representativeness are achieved, and the workload is reduced.
In the embodiment, with the excavation of the tunnel face, image spectrum data of the tunnel face is continuously obtained, the content of the marker minerals at the control points is determined through quantitative mineral inversion, and the obtained content of the marker minerals at the control points is constructed into a mineral information data set to be used as a learning sample for time series prediction;
learning by a time series method based on a mineral information data set to obtain a mineral content prediction model, and predicting the content of the marker minerals at a control point in a certain mileage section in front of the tunnel face according to the mineral content prediction model;
as an alternative implementation, the time series method comprises an algorithm adapted to the fluctuation degree of the difference values of different data types, and an optimal algorithm is selected according to the actual test data result of the engineering field; examples include, but are not limited to, a differential integration moving average autoregressive model (ARIMA), a long short term memory artificial neural network (LSTM), a generative countermeasure network (GAN), and the like;
taking ARIMA as an example, the content of the marker minerals at the control point of the front tunnel face is predicted, and the expression of an ARIMA prediction model is as follows:
(1-φ 1 B-φ 2 B 2 -…-φ p B p )(1-B) d y t =(1+θ 1 B+θ 2 B 2 +…+θ p B p
in this embodiment, according to the content of the marker minerals of the control points in front of the face, spatial interpolation is performed on the content of the marker minerals between the control points to obtain the content of the minerals of the surrounding rock in front of the face, which reflects the change of the content of the minerals of a section of mileage in front of the face.
As an alternative embodiment, the spatial point-like discontinuous mineral content of the control point is output as a spatial body-like continuous mineral content by adopting a spatial interpolation method, the difference of mineral content information is shown through the filling display effect of the spatial body, and the macro-solid shows the content change condition of various mark minerals in a certain spatial range of the un-excavated segment of the tunnel.
In this embodiment, the mineral abnormal region is defined according to the filling display effect of the spatial volume, and the location, scale and type of the poor geologic body are determined according to the abnormal characteristics of the mineral, so as to realize the prediction of the poor geologic body in front of the tunnel face.
As an alternative implementation mode, the definition of the mineral abnormal area is mainly implemented by determining the threshold value of mineral abnormality through an EDA (electronic design automation) technology, adjusting the color development effect of a space output model, and automatically defining the range of the mineral abnormal area; since the formation rock material composition is relatively stable, the occurrence of the poor geologic body is usually accompanied by the occurrence of mineral abnormalities, and the mineral composition and the mineral content are different from surrounding rocks in spatial distribution, so that the identification and forecast of the poor geologic body can be realized based on the delineation of the mineral abnormalities.
As an alternative implementation mode, the poor geologic body is judged mainly through the type combination and content information of the mineral anomaly, the professional geological knowledge and the early geological survey data, the type property of the poor geologic body is judged, and the scale and the position of the poor geologic body are judged through the range defined by the mineral anomaly.
As an optional implementation mode, the mineral information of the tunnel face at the excavation position can be fed back to the data set in time through excavation verification, the data set is supplemented, the learning sample of the time series model is added, and the accuracy of model prediction is improved.
Example 2
The embodiment provides a system for forecasting unfavorable geology in advance by fusing spectral imaging and space-time distribution, which comprises:
the control point selection module is configured to perform grid division on the tunnel face and select a limited number of grid points covering the tunnel face as control points;
the marker mineral selecting module is configured to select the marker minerals of the poor geologic body according to the tunnel face image spectral data of the excavated segment;
the mineral content prediction module is configured to determine the content of the marker minerals at the control points according to the image spectrum data of the tunnel face at the excavation position, and predict the content of the marker minerals at the control points in front of the tunnel face;
the spatial interpolation module is configured to perform spatial interpolation processing on the marker mineral content between the control points according to the marker mineral content of the control points in front of the tunnel face to obtain the marker mineral content in front of the tunnel face;
and the advanced forecasting module is configured to define the mineral abnormal area according to the content of the marked minerals in front of the tunnel face, so as to obtain the position, scale and type of the poor geologic body in front of the tunnel face.
In this embodiment, the control point selecting module further includes:
setting the grid spacing, and carrying out relatively equidistant grid division on the tunnel face according to the grid spacing.
In this embodiment, the marked mineral selecting module further includes:
and acquiring the content of various minerals according to the spectral data of the tunnel face image of the excavated segment, and selecting the minerals with the mineral content change exceeding a set threshold value in the adverse geological affected area and the normal surrounding rock area as the marker minerals.
In this embodiment, the system further includes a data acquisition module, specifically, an image spectrometer acquires image spectrum data, and an optimal relative position between the image spectrometer and the face needs to satisfy that a shot image is distributed in a face core area;
the parameters scanned by the image spectrometer comprise frequency increment, staring time and camera focal length; acquiring image spectrum data of different wave bands by adjusting the tuning wavelength of the frequency increment; by adjusting the gaze time, the spectral resolution is improved; the position and the size of the palm surface in the visual field of the camera can be adjusted by adjusting the focal length of the camera.
In this embodiment, the mineral content prediction module further includes:
and learning by adopting a time sequence method, and predicting the content of the marker minerals at the control point in front of the tunnel face.
In this embodiment, the mineral content prediction module further includes:
preprocessing image spectrum data of a tunnel face at an excavation position, wherein the preprocessing comprises radiometric calibration, reflectivity reconstruction and noise weakening;
performing end member extraction on the preprocessed image spectrum data to obtain a pixel spectrum curve, and determining a final mineral end member spectrum by contrasting the pixel spectrum curve with a standard mineral spectrum library so as to perform mineral identification;
and calculating the mineral content by stages by using an image pixel classification statistical method.
In this embodiment, the spatial interpolation module further includes:
and outputting the spatial point-shaped discontinuous mineral content of the control point into spatial body-shaped continuous mineral content by adopting a spatial interpolation method, and displaying the difference of the mineral content through the filling and color development effects of the spatial body.
In this embodiment, the look-ahead module further includes:
and determining the limit value of mineral abnormity, adjusting the filling and color developing effects of the space body, and performing range delineation on the mineral abnormity area.
It should be noted that the modules correspond to the steps described in embodiment 1, and the modules are the same as the corresponding steps in the implementation examples and application scenarios, but are not limited to the disclosure in embodiment 1. It should be noted that the modules described above as part of a system may be implemented in a computer system such as a set of computer-executable instructions.
Example 3
The embodiment provides a system for forecasting unfavorable geology in advance by fusing spectral imaging and space-time distribution, which comprises: the device comprises a main control module, a data acquisition module, a device adjusting unit and a bad geologic body advanced forecasting module;
the main control module is configured to control the starting and stopping of the data acquisition module, the device adjusting unit and the unfavorable geologic body advanced forecasting module;
the data acquisition module is used for acquiring image spectrum data of the tunnel face;
the device adjusting unit is used for adjusting the position of the data acquisition module so as to enable the data acquisition module to move to the optimal relative position with the tunnel face;
the poor geologic body advanced forecasting module receives image spectrum data of a tunnel face and is configured to perform delineation of mineral abnormal areas according to the image spectrum data by adopting the method in embodiment 1 so as to obtain the position, scale and type of the poor geologic body in front of the tunnel face.
In this embodiment, the main control module 1 is connected to the modules through a wireless signal transmitter 3, and is configured to control start and stop of the modules.
In this embodiment, the system further includes a mobile platform, and the above modules such as the main control module 1 are all mounted on the mobile platform.
In this embodiment, the data acquisition module is configured to continuously obtain image spectrum data of a tunnel face during a tunnel excavation process, and transmit the image spectrum data through the wireless signal transmitter 3.
As shown in fig. 3, the data acquisition module includes an image spectrometer 4 and a protection device 5;
the image spectrometer 4 is carried on the mobile platform and is used for acquiring image spectrum data of the tunnel face;
the protection device 5 is installed outside the image spectrometer 4 and used for protecting the image spectrometer 4 from the influence of water vapor, dust and falling stones in the tunnel.
As an alternative implementation, the image spectrometer 4 may be a staring type image spectrometer, the relative movement with the tunnel face in the three-dimensional space of the mobile platform is realized through a sliding rail and a telescopic bracket, a proper gaze position is selected through information of the tunnel face in the visual field of the camera of the image spectrometer, and the spectral data of the image of the tunnel face is acquired in situ after positioning.
As an alternative embodiment, the image spectrometer 4 may also be a push-broom type image spectrometer, a swing-broom type image spectrometer, or the like, and the slide rail and the telescopic bracket are used to realize the relative movement with the tunnel face in the three-dimensional space of the mobile platform, so as to scan the tunnel face.
As an alternative embodiment, the parameters of the image spectrometer scanning include frequency increment, gaze time, camera focal length, and the like; acquiring image spectrum data of different wave bands by adjusting the tuning wavelength of the frequency increment; the fixation time is adjusted to improve the spectral resolution and optimize the imaging quality; the position and the size of the tunnel face in the camera view field are adjusted by adjusting the focal length of the camera, and the integrity of data is guaranteed.
In an alternative embodiment, the image spectrometer collects the image spectrum data of the palm surface, and the wave band range is selected to be 0.35-25um.
As an optional implementation mode, the protection device 5 is installed outside the image spectrometer 4, and is used for performing all-around protection, and because the image spectrometer is precise in instrument and the environment in the tunnel is severe, the protection device 5 can reduce the influence of water vapor and dust in the tunnel on the work of the image spectrometer 4, and prevent surrounding rocks from dropping stones to damage the image spectrometer 4, thereby being beneficial to maintaining the continuity and stability of the operation of the instrument and improving the accuracy of the acquired image spectral data.
In this embodiment, the system further comprises a device adjusting unit, wherein the device adjusting unit comprises a laser range finder 2, a telescopic bracket 6, a sliding rail 7 and a cloud deck 8;
the laser range finder 2 is used for measuring the distance between the mobile platform and the tunnel face, and according to the feedback data of the laser range finder 2, the mobile platform is controlled to move, the telescopic support 6 is controlled to move, the scanning parameters of the image spectrometer 4 are set, the mobile platform is controlled to move to the optimal relative position of the image spectrometer and the tunnel face, and the quality of the acquired image spectrum data is improved.
As an alternative embodiment, the determination of the optimal relative position between the image spectrometer and the face is required to satisfy the condition that the captured image is distributed in the core area of the face as much as possible; because the tunnel face is the key area of mineral testing, the integrity of the tunnel face in the camera vision field needs to be ensured, the imaging quality is improved, and the integrity, the representativeness and the accuracy of data testing of the acquired data are ensured.
As an alternative implementation, the palm surface is made to cover the core of the camera view by adjusting the mobile platform, the telescopic bracket, the scanning parameters of the image spectrometer and the like in multiple aspects, and the final position of the whole system is determined at the optimal relative position between the image spectrometer and the palm surface according to the distance data acquired by the laser range finder 2.
In the present embodiment, as shown in fig. 3, six laser range finders 2 are provided, two of which are installed in front of the mobile platform and near to the left, two of which are installed in front of the mobile platform and near to the right, and the other two of which are installed in the center of the top of the protection device;
the method comprises the following steps that with the movement of a mobile platform, six laser range finders continuously acquire the distance between the mobile platform and a tunnel face, distance information is transmitted to a main control module through a wireless signal transmitter to perform subsequent operation, the distance data acquired by two laser range finders at each part are averaged, the measurement error of each laser range finder is reduced, three groups of distance data are finally acquired, and the acquisition of image spectrum data can be performed when the relative error of each two groups of data is not more than 5%; because continuously excavate along with the tunnel, relative position and angle between moving platform and the face change, utilize the several laser range finders that carry on, with the position standardization after the moving platform removes at every turn, the image spectrum appearance is with the uniformity of face position around guaranteeing to excavate, promotes follow-up data processing's accuracy and continuity.
In this embodiment, the telescopic bracket 6 is used to adjust the height of the image spectrometer 4, so as to adjust the field range of the camera, and improve the quality of image spectrum data.
In this embodiment, the sliding rail 7 is installed on the plane of the mobile platform, so that the telescopic bracket 6 can move on the sliding rail 7 in all directions to find the position with the best imaging quality.
In this embodiment, cloud platform 8 is as shock attenuation dimension steady device, bears laser range finder 2 and image spectrum appearance 4, maintains the stability of instrument adverse circumstances operation in the tunnel, is favorable to improving the accuracy of 2 measured data of laser range finder and 4 imaging quality and the data analysis effect of image spectrum appearance.
In this embodiment, the wireless signal transmitter 3 is installed on the laser range finder 2 and the image spectrometer 4, and transmits the distance information and the imaging effect to the main control module and other modules.
In this embodiment, the image spectrometer 4 is directly mounted on the pan tilt 8 and the telescopic bracket 6, and the image spectrometer 4 continuously acquires the image spectrum data of the tunnel face by positioning through the movement of the laser range finder 2, the telescopic bracket 6, the slide rail 7, the pan tilt 8 and the mobile platform; meanwhile, the protection device 5 is connected with the bottom of the image spectrometer 4 and is jointly carried to the holder 8, so that the protection device 5 is kept stable when moving along with the mobile platform in a severe tunnel environment.
In further embodiments, there is also provided:
an electronic device comprising a memory and a processor and computer instructions stored on the memory and executed on the processor, the computer instructions when executed by the processor performing the method of embodiment 1. For brevity, further description is omitted herein.
It should be understood that in this embodiment, the processor may be a central processing unit CPU, and the processor may also be other general purpose processors, digital signal processors DSP, application specific integrated circuits ASIC, off-the-shelf programmable gate arrays FPGA or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and so on. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory may include both read-only memory and random access memory, and may provide instructions and data to the processor, and a portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information.
A computer readable storage medium storing computer instructions which, when executed by a processor, perform the method of embodiment 1.
The method in embodiment 1 may be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor. The software modules may be located in ram, flash, rom, prom, or eprom, registers, etc. as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor. To avoid repetition, it is not described in detail here.
Those of ordinary skill in the art will appreciate that the various illustrative elements, i.e., algorithm steps, described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the technical solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
Although the embodiments of the present invention have been described with reference to the accompanying drawings, it is not intended to limit the scope of the present invention, and it should be understood by those skilled in the art that various modifications and variations can be made without inventive efforts by those skilled in the art based on the technical solution of the present invention.

Claims (10)

1. The unfavorable geology advanced prediction method integrating spectral imaging and space-time distribution is characterized by comprising the following steps:
carrying out mesh division on the face, and selecting a limited number of mesh points covering the face as control points;
selecting a marker mineral of a poor geologic body according to the tunnel face image spectral data of the excavated segment;
determining the content of the marker minerals at the control points according to the image spectrum data of the tunnel face at the excavation position, and predicting the content of the marker minerals at the control points in front of the tunnel face;
according to the content of the marker minerals of the control points in front of the tunnel face, carrying out spatial interpolation processing on the content of the marker minerals between the control points to obtain the content of the marker minerals in front of the tunnel face;
and (4) delineating the mineral abnormal area according to the content of the marked minerals in front of the tunnel face to obtain the position, scale and type of the poor geologic body in front of the tunnel face.
2. The method for forecasting unfavorable geology with integration of spectral imaging and spatiotemporal distribution according to claim 1, characterized in that a time series method is adopted for learning, and the content of the marker minerals at the control point in front of the tunnel face is predicted; and outputting the spatial point-like discontinuous mineral content of the control point into spatial body-like continuous mineral content by adopting a spatial interpolation method, and displaying the difference of the mineral content by the filling and color developing effects of the spatial body.
3. The method for forecasting the unfavorable geology in advance by fusing the spectral imaging and the space-time distribution as claimed in claim 1, wherein the contents of various minerals are obtained according to the spectral data of the tunnel face image of the excavated segment, and the minerals with the content change exceeding a set threshold value in the unfavorable geological affected area and the normal surrounding rock area are selected as the marker minerals;
or setting a grid interval, and carrying out relatively equidistant grid division on the tunnel face according to the grid interval;
or determining the threshold value of mineral abnormity, adjusting the filling and color developing effects of the space body, and performing range delineation on the mineral abnormal region;
or preprocessing image spectrum data of the tunnel face at the excavation position, wherein the preprocessing comprises radiometric calibration, reflectivity reconstruction and noise weakening;
performing end member extraction on the preprocessed image spectrum data to obtain a pixel spectrum curve, and determining a final mineral end member spectrum by contrasting the pixel spectrum curve with a standard mineral spectrum library so as to perform mineral identification;
and calculating the mineral content by stages by using an image pixel classification statistical method.
4. The method for integrated spectral imaging and spatiotemporal distribution unfavorable geological prediction of claim 1 wherein the image spectral data is collected by an image spectrometer and the optimal relative position between the image spectrometer and the face is such that the captured image covers the core area of the face.
5. The method for unfavorable geological look-ahead fused spectral imaging and spatiotemporal distribution according to claim 4, wherein the parameters of the image spectrometer scans include frequency increment, gaze time and camera focal length; the tuning wavelength of the frequency increment is adjusted to obtain image spectrum data of different wave bands; by adjusting the gaze time, the spectral resolution is improved; the position and the size of the palm surface in the visual field of the camera can be adjusted by adjusting the focal length of the camera.
6. Unfavorable geology advanced forecasting system fusing spectral imaging and space-time distribution is characterized by comprising:
the control point selection module is configured to perform grid division on the tunnel face and select a limited number of grid points covering the tunnel face as control points;
the marker mineral selecting module is configured to select the marker minerals of the poor geologic body according to the tunnel face image spectral data of the excavated segment;
the mineral content prediction module is configured to determine the content of the marker minerals at the control points according to the image spectrum data of the tunnel face at the excavation position, and predict the content of the marker minerals of the control points in front of the tunnel face;
the spatial interpolation module is configured to perform spatial interpolation processing on the marker mineral content between the control points according to the marker mineral content of the control points in front of the tunnel face to obtain the marker mineral content in front of the tunnel face;
and the advanced forecasting module is configured to define the mineral abnormal area according to the content of the marked minerals in front of the tunnel face, so as to obtain the position, scale and type of the poor geologic body in front of the tunnel face.
7. The unfavorable geology advanced prediction system fusing spectral imaging and space-time distribution is characterized by comprising: the device comprises a mobile platform, a main control module, a data acquisition module, a device adjusting unit and a bad geologic body advanced forecasting module, wherein the main control module, the data acquisition module, the device adjusting unit and the bad geologic body advanced forecasting module are carried on the mobile platform;
the main control module is configured to control the starting and stopping of the data acquisition module, the device adjusting unit and the unfavorable geologic body advanced forecasting module;
the data acquisition module is used for acquiring image spectrum data of the tunnel face;
the device adjusting unit is used for adjusting the position of the data acquisition module so as to enable the data acquisition module to move to the optimal relative position with the tunnel face;
the poor geologic body advanced forecasting module receives image spectrum data of a tunnel face and is configured to perform the delineation of mineral abnormal areas by adopting the method of any one of claims 1 to 5 according to the image spectrum data so as to obtain the position, the scale and the type of the poor geologic body in front of the tunnel face.
8. The fused spectral imaging and spatiotemporal distribution unfavorable geological look-ahead system of claim 7,
the data acquisition module comprises a protection device and an image spectrometer arranged in the protection device; the parameters scanned by the image spectrometer comprise frequency increment, staring time and camera focal length; acquiring image spectrum data of different wave bands by adjusting the tuning wavelength of the frequency increment; the fixation time is adjusted to improve the spectral resolution; adjusting the position and size of the tunnel face in the camera view field by adjusting the focal length of the camera;
the device adjusting unit comprises a laser range finder, a telescopic bracket, a slide rail and a holder;
the laser range finder is used for measuring the distance between the mobile platform and the face and controlling the mobile platform to move to the optimal relative position between the data acquisition module and the face, and the optimal relative position needs to be determined to meet the requirement that the shot image is fully distributed in the core area of the face;
the telescopic bracket is used for adjusting the height of the data acquisition module so as to adjust the visual field range of the camera;
the sliding rail is arranged on the moving platform, and the telescopic bracket is arranged on the sliding rail so as to move on the sliding rail;
the cloud platform is used for bearing a laser range finder and a data acquisition module.
9. An electronic device comprising a memory and a processor and computer instructions stored on the memory and executed on the processor, the computer instructions when executed by the processor performing the method of any of claims 1-5.
10. A computer-readable storage medium storing computer instructions which, when executed by a processor, perform the method of any one of claims 1 to 5.
CN202211281361.9A 2022-10-19 2022-10-19 Poor geology advanced forecasting method and system integrating spectrum imaging and space-time distribution Active CN115901640B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211281361.9A CN115901640B (en) 2022-10-19 2022-10-19 Poor geology advanced forecasting method and system integrating spectrum imaging and space-time distribution

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211281361.9A CN115901640B (en) 2022-10-19 2022-10-19 Poor geology advanced forecasting method and system integrating spectrum imaging and space-time distribution

Publications (2)

Publication Number Publication Date
CN115901640A true CN115901640A (en) 2023-04-04
CN115901640B CN115901640B (en) 2024-03-15

Family

ID=86475325

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211281361.9A Active CN115901640B (en) 2022-10-19 2022-10-19 Poor geology advanced forecasting method and system integrating spectrum imaging and space-time distribution

Country Status (1)

Country Link
CN (1) CN115901640B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116719082A (en) * 2023-04-25 2023-09-08 中国地质大学(北京) Deep unfavorable geology multisource information fusion and in-situ stereoscopic perspective system and method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102540165A (en) * 2011-12-19 2012-07-04 北京师范大学 Method and system for preprocessing MODIS (Moderate-Resolution Imaging Spectroradiometer) surface albedo data
CN110174359A (en) * 2019-05-27 2019-08-27 生态环境部南京环境科学研究所 A kind of Airborne Hyperspectral image heavy metal-polluted soil concentration evaluation method returned based on Gaussian process
CN110530901A (en) * 2019-09-11 2019-12-03 中国科学院南京土壤研究所 Merge the Small and Medium Sized soil water monitoring system and method for cosmic ray NEUTRON METHOD and unmanned aerial vehicle remote sensing
CN112017135A (en) * 2020-07-13 2020-12-01 香港理工大学深圳研究院 Method, system and equipment for spatial-temporal fusion of remote sensing image data
CN113008806A (en) * 2021-03-02 2021-06-22 农业农村部环境保护科研监测所 Agricultural product production area heavy metal spatial distribution determination method
US20210293770A1 (en) * 2017-06-19 2021-09-23 Nanjing Institute Of Geography & Limnology. Chinese Academy Of Sciences Stereoscopic monitoring and data mining system and method for harmful lake cyanobacteria bloom
CN114565843A (en) * 2022-02-22 2022-05-31 中国电子科技集团公司第五十四研究所 Time series remote sensing image fusion method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102540165A (en) * 2011-12-19 2012-07-04 北京师范大学 Method and system for preprocessing MODIS (Moderate-Resolution Imaging Spectroradiometer) surface albedo data
US20210293770A1 (en) * 2017-06-19 2021-09-23 Nanjing Institute Of Geography & Limnology. Chinese Academy Of Sciences Stereoscopic monitoring and data mining system and method for harmful lake cyanobacteria bloom
CN110174359A (en) * 2019-05-27 2019-08-27 生态环境部南京环境科学研究所 A kind of Airborne Hyperspectral image heavy metal-polluted soil concentration evaluation method returned based on Gaussian process
CN110530901A (en) * 2019-09-11 2019-12-03 中国科学院南京土壤研究所 Merge the Small and Medium Sized soil water monitoring system and method for cosmic ray NEUTRON METHOD and unmanned aerial vehicle remote sensing
CN112017135A (en) * 2020-07-13 2020-12-01 香港理工大学深圳研究院 Method, system and equipment for spatial-temporal fusion of remote sensing image data
CN113008806A (en) * 2021-03-02 2021-06-22 农业农村部环境保护科研监测所 Agricultural product production area heavy metal spatial distribution determination method
CN114565843A (en) * 2022-02-22 2022-05-31 中国电子科技集团公司第五十四研究所 Time series remote sensing image fusion method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
施雪松: "基于元素和矿物异常分析的隧道不良地质识别方法", 中国优秀硕士论文硕士工程科技Ⅱ辑, 15 February 2021 (2021-02-15) *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116719082A (en) * 2023-04-25 2023-09-08 中国地质大学(北京) Deep unfavorable geology multisource information fusion and in-situ stereoscopic perspective system and method

Also Published As

Publication number Publication date
CN115901640B (en) 2024-03-15

Similar Documents

Publication Publication Date Title
CN111623722B (en) Multi-sensor-based slope deformation three-dimensional monitoring system and method
CN113108764B (en) Dam break process safety monitoring, early warning and influence assessment method
CN106194184B (en) Mining machine and control method thereof, application of ore bed and cutting model and storage medium
CN111895911B (en) Method for monitoring hidden danger of ground collapse of shallow sand layer
CN105115442A (en) Tunnel internal surface form detecting method, apparatus and system
CN115901640A (en) Unfavorable geology advanced prediction method and system integrating spectral imaging and space-time distribution
CN117216641A (en) Intelligent identification method for high-level collapse geological disasters
CN117433440B (en) Roadway deformation real-time detection method and device based on laser point cloud and storage medium
CN117437559A (en) Unmanned aerial vehicle-based method and device for detecting ground surface rock movement deformation of coal mining area
CN116796643A (en) Surface subsidence monitoring method and device, electronic equipment and storage medium
CN109598310B (en) Multi-factor sensitive facility identification method
CN113723531B (en) Mining area earth surface deformation real-time/quasi-real-time monitoring method oriented to full operation period
Samieinejad et al. A field investigation of application of digital terrestrial photogrammetry to characterize geometric properties of discontinuities in open-pit slopes
Schröder et al. i2MON: Development of an integrated monitoring system for the detection of ground and surface displacements caused by coal mining
Liu et al. The role of terrestrial 3D LiDAR scan in bridge health monitoring
Masood et al. Slope monitoring and failure prediction techniques in mines: a review
KR100324091B1 (en) A method for detecting fault of pavement on a bridge using infrred-picture capturing and a system thereof
García-Luna et al. Characterization of joint roughness using long-range terrestrial photogrammetry
bin Shahrin et al. Measuring Sloping Floor of Heritage Building Using Point Cloud Data from LiDAR Survey
JP7198430B2 (en) Obstacle check method for radio wave transmission path
CN118244296B (en) Automatic monitoring and early warning platform for expressway underlying goaf
Barkley et al. Utilizing Unmanned Aircraft Systems for Geological Structure Mapping
CN118362058B (en) Tunnel deformation detection method, device, equipment, storage medium and vehicle
Kipp et al. Early detection, permanent monitoring and documentation of critical locations at the surface in mining areas
Türk et al. Comparison of Autonomous and Manual UAV Flights in Determining Forest Road Surface Deformations

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant