CN112307803A - Digital geological outcrop crack extraction method and device - Google Patents
Digital geological outcrop crack extraction method and device Download PDFInfo
- Publication number
- CN112307803A CN112307803A CN201910674862.5A CN201910674862A CN112307803A CN 112307803 A CN112307803 A CN 112307803A CN 201910674862 A CN201910674862 A CN 201910674862A CN 112307803 A CN112307803 A CN 112307803A
- Authority
- CN
- China
- Prior art keywords
- image
- fracture
- crack
- outcrop
- geological outcrop
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000605 extraction Methods 0.000 title claims abstract description 72
- 238000012545 processing Methods 0.000 claims abstract description 77
- 238000000034 method Methods 0.000 claims abstract description 53
- 238000011426 transformation method Methods 0.000 claims abstract description 16
- 230000009466 transformation Effects 0.000 claims abstract description 12
- 238000012216 screening Methods 0.000 claims description 35
- 238000004422 calculation algorithm Methods 0.000 claims description 19
- 230000015654 memory Effects 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 12
- 230000011218 segmentation Effects 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 230000015572 biosynthetic process Effects 0.000 claims description 7
- 238000004364 calculation method Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 17
- 230000006870 function Effects 0.000 description 11
- 230000008569 process Effects 0.000 description 8
- 230000003044 adaptive effect Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 229930195733 hydrocarbon Natural products 0.000 description 4
- 150000002430 hydrocarbons Chemical class 0.000 description 4
- 238000007781 pre-processing Methods 0.000 description 4
- 239000004215 Carbon black (E152) Substances 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000010191 image analysis Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 239000011435 rock Substances 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000000354 decomposition reaction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000005325 percolation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
-
- G06T5/90—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/187—Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
Abstract
The embodiment of the invention discloses a method and a device for extracting a digital geological outcrop crack, wherein the method comprises the following steps: carrying out image processing on the collected geological outcrop image, wherein the image processing comprises the following steps: at least one of gray scale transformation, image enhancement and image binarization; performing linear feature extraction on the geological outcrop image after image processing by adopting a Beamlet transformation method, and extracting a crack line segment; and connecting the fracture line segments according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture. The invention solves the technical problems of low efficiency and poor reliability of the digital outcrop crack extraction method through manual drawing in the prior art.
Description
Technical Field
The invention belongs to the field of application of a remote sensing technology in oil and gas fine geology, and particularly relates to a method and a device for extracting a digital geological outcrop crack.
Background
Reservoir fractures in hydrocarbon reservoirs not only improve the percolation of the reservoir but also control the formation and distribution of hydrocarbons, and fractured hydrocarbon reservoirs are widely distributed in various continental basins as one of the most important hydrocarbon reservoir types in the world. Outcrop research is an important way to obtain fracture parameters.
Traditional digital outcrop crack extraction mainly relies on artifical the delineation, and working strength is big to be subject to the difference that the researcher realized, crack extraction efficiency and reliability are difficult to guarantee. The automatic crack extraction of the computer is difficult to accurately identify and predict cracks of various scales due to the fact that the automatic crack extraction of the computer is interfered by geological phenomena and complexity of crack causes, including noise such as rock lithology, rock core roughness, illumination shadow and the like.
Disclosure of Invention
The invention mainly aims to provide a method and a device for extracting a digital geological outcrop crack, and aims to solve the technical problems of low efficiency and poor reliability of the method for extracting the digital outcrop crack through manual drawing in the prior art.
In order to achieve the above object, according to one aspect of the present invention, there is provided a digital geological outcrop fracture extraction method, comprising:
carrying out image processing on the collected geological outcrop image, wherein the image processing comprises the following steps: at least one of gray scale transformation, image enhancement and image binarization;
performing linear feature extraction on the geological outcrop image after image processing by adopting a Beamlet transformation method, and extracting a crack line segment;
and connecting the fracture line segments according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture.
Further, the method further comprises:
and screening the geological outcrop cracks according to the trend of the stratum, and screening out the geological outcrop cracks corresponding to the target stratum.
Further, the method further comprises:
screening the fracture line segments according to the trend of the stratum, and screening out the fracture line segments corresponding to the target stratum;
connect formation geology outcrop crack according to distance and the angle difference between the crack line segment, include:
and connecting the fracture line segments corresponding to the target stratum according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture corresponding to the target stratum.
Further, carry out image processing to the geology outcrop image of gathering, specifically include:
converting the collected geological outcrop image into a gray image;
performing image enhancement processing on the geological outcrop image converted into the gray level image by adopting a multi-scale self-adaptive enhancement algorithm;
and (4) carrying out binarization processing on the enhanced geological outcrop image by adopting an Otsu threshold segmentation algorithm.
Further, the fracture line segments are connected according to the distance and the angle difference between the fracture line segments to form a geological outcrop fracture, and the method specifically comprises the following steps:
calculating the angle of each crack line segment;
judging whether the angle difference between the two crack line segments is smaller than a preset angle threshold value or not and whether the distance between the two crack line segments is smaller than a preset distance threshold value or not;
and when the angle difference between the two crack line segments is smaller than a preset angle threshold value and the distance between the two crack line segments is smaller than a preset distance threshold value, connecting the two crack line segments.
Further, the method further comprises: and after removing isolated noise from the geological outcrop image subjected to binarization processing, determining the area of the crack by counting pixel points with pixel values not being 0.
Further, the method further comprises: and determining the length of the crack by counting pixel points with pixel values not being 0 aiming at the linear characteristic image obtained by the geological outcrop image after binarization processing through a Beamlet transformation method.
In order to achieve the above object, according to another aspect of the present invention, there is provided a digital geological outcrop fracture extraction apparatus, comprising:
the image processing unit is used for carrying out image processing on the collected geological outcrop image, wherein the image processing comprises the following steps: at least one of gray scale transformation, image enhancement and image binarization;
the crack extraction unit is used for extracting linear characteristics of the geological outcrop image after the image processing by adopting a Beamlet transformation method and extracting a crack line segment;
and the fracture connecting unit is used for connecting the fracture line segments according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture.
Further, the apparatus further comprises:
and the fracture screening unit is used for screening the geological outcrop fractures according to the trend of the stratum and screening out the geological outcrop fractures corresponding to the target stratum.
Further, the apparatus further comprises:
the line segment screening unit is used for screening the fracture line segments according to the trend of the stratum and screening out the fracture line segments corresponding to the target stratum;
and the fracture connecting unit is also used for connecting the fracture line segments corresponding to the target stratum according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture corresponding to the target stratum.
Further, the image processing unit includes:
the gray level conversion module is used for converting the collected geological outcrop image into a gray level image;
the image enhancement module is used for carrying out image enhancement processing on the geological outcrop image converted into the gray level image by adopting a multi-scale self-adaptive enhancement algorithm;
and the binarization processing module is used for performing binarization processing on the enhanced geological outcrop image by adopting an Otsu threshold segmentation algorithm.
Further, the fracture connection unit includes:
the line segment angle calculation module is used for calculating the angle of each crack line segment;
the judging module is used for judging whether the angle difference between the two crack line segments is smaller than a preset angle threshold value or not and whether the distance between the two crack line segments is smaller than a preset distance threshold value or not;
and the connecting module is used for connecting the two crack line segments when the angle difference between the two crack line segments is smaller than a preset angle threshold value and the distance between the two crack line segments is smaller than a preset distance threshold value.
Further, the apparatus further comprises: and the crack area determining unit is used for determining the area of the crack by counting the pixel points with the pixel value not being 0 after the isolated noise of the geological outcrop image after the binarization processing is removed.
Further, the apparatus further comprises: and the crack length determining unit is used for determining the length of the crack by counting the pixel points with the pixel value not being 0 according to the linear characteristic image obtained by the geological outcrop image after binarization processing through a Beamlet transformation method.
To achieve the above object, according to another aspect of the present invention, there is also provided a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps in the above digital geological outcrop fracture extraction method when executing the computer program.
To achieve the above object, according to another aspect of the present invention, there is also provided a computer readable storage medium storing a computer program which, when executed in a computer processor, implements the steps in the above digital geological outcrop fracture extraction method.
The invention has the beneficial effects that: the embodiment of the invention performs gray level conversion and image enhancement on the digital outcrop image shot by the high-definition digital camera. And (2) binarization preprocessing, namely extracting crack line segments based on the preprocessed image by utilizing a Beamlet multi-scale linear feature extraction algorithm, and performing crack linear feature connection on the extracted crack line segments, so that the technical effect of accurately extracting geological outcrop cracks in the digital outcrop image is realized, and the technical problems of low efficiency and poor reliability of the digital outcrop crack extraction method by manual drawing in the prior art are solved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts. In the drawings:
FIG. 1 is a flow chart of a digital geological outcrop fracture extraction method according to an embodiment of the invention;
FIG. 2 is a schematic flow chart of a digital geological outcrop fracture extraction method according to an embodiment of the invention;
FIG. 3 is a flow chart of screening geological outcrop fractures according to an embodiment of the present invention;
FIG. 4 is a flow diagram of image processing according to an embodiment of the present invention;
FIG. 5 is a first flowchart of a method of joining fracture segments in accordance with an embodiment of the present invention;
FIG. 6 is a second flowchart of a method of joining fracture segments in accordance with an embodiment of the present invention;
FIG. 7 is a flowchart of a method for calculating crack area and crack length according to an embodiment of the invention;
FIG. 8 is a first block diagram of a digital geological outcrop fracture extraction apparatus according to an embodiment of the present invention;
FIG. 9 is a second block diagram of the digital geological outcrop crack extraction apparatus according to the embodiment of the present invention;
FIG. 10 is a third block diagram of a digital geological outcrop fracture extraction apparatus according to an embodiment of the present invention;
FIG. 11 is a block diagram of the image processing unit according to the embodiment of the present invention;
FIG. 12 is a block diagram of the structure of a crack connecting unit according to an embodiment of the present invention;
FIG. 13 is a fourth block diagram of a digital geological outcrop fracture extraction apparatus according to an embodiment of the present invention;
FIG. 14 is a schematic view of an original geological outcrop image according to an embodiment of the present invention;
FIG. 15 is a schematic view of an enhanced geological outcrop image according to an embodiment of the present invention;
FIG. 16 is a schematic diagram of a geological outcrop image after binarization processing according to the embodiment of the invention;
FIG. 17 is a schematic diagram illustrating a Beamlet crack extraction result according to an embodiment of the present invention;
FIG. 18 is a schematic representation of a fracture line segment after joining according to an embodiment of the present invention;
FIG. 19 is a schematic diagram of a computer apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the description and claims of the present invention and the above-described drawings, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings.
The invention provides a computer automatic extraction method of digital geological outcrop cracks based on digital outcrop high-definition digital images and combined with a computer digital image processing technology, which can accurately extract cracks on complex geological images, obtain accurate geological crack geometric parameters and greatly improve the working efficiency and the research precision.
Fig. 1 is a first flowchart of a digital geological outcrop fracture extraction method according to an embodiment of the present invention, and as shown in fig. 1, the digital geological outcrop fracture extraction method according to the embodiment includes steps S101 to S103.
Step S101, image processing is carried out on the collected geological outcrop image, wherein the image processing comprises the following steps: at least one of grayscale transformation, image enhancement, and image binarization.
In the embodiment of the invention, the collected geological outcrop image can be a geological outcrop digital high-definition image shot by a high-definition digital camera. The processing of the geological outcrop image comprises color transformation, image enhancement, image binarization and other processing.
And S102, extracting linear features of the geological outcrop image after image processing by adopting a Beamlet transformation method, and extracting a crack line segment.
In the embodiment of the invention, the geological outcrop image after image processing is utilized to extract the crack characteristics. The extraction technology is mainly based on a multi-scale image analysis technology, i.e. a Beamlet transformation method. The transformation method comprises five parts, namely a Beamlet dictionary, a Beamlet transformation, a Beamlet pyramid, a Beamlet graph and a Beamlet algorithm. The Beamlet base is a multi-scale directed line segment set with binary characteristics, and performs multi-scale segmentation on the image, the Beamlet base is a connecting line of any two marking points of a small block after segmentation, and a set formed by the Beamlet bases under all scales is called a Beamlet dictionary. In an embodiment of the invention, the Beamlet basis is an extracted fracture line segment. Suppose f (x)1,x2) Is [0,1 ]]2Above, the continuous Beamlet transform of the function f can be understood as a set of line integrals.
Tf(b)＝∫bf(x,y)dlBnp (6)
In equation (6): b isnpFor an n × n image, when the resolution is rho, the set of all beamlets under different scales is pointed; f (x, y) is an image function on b; t isf(b) Is the Beamlet transform coefficient corresponding to b.
For a real n x n digital image, the image is composed of n2Discrete function of pixel composition, if image function is
Then
The Beamlet transform must first get pairs by interpolationThe corresponding continuous function f (x, y) is obtained by using the above formula. The solution formula for the continuous function f (x, y) is shown in equation (7).
In equation (7):
representing a continuous interpolation function. There are many options for the continuous interpolation function, and the method of average interpolation is used in the method. Namely, it is
Which can be seen as an average of the pixel values over a continuous function f (x, y), then equation (7) can be rewritten to the form of equation (8).
In this sense, a Beamlet based Beamlet transform is actually a weighted sum of gray values of all pixels contained in the Beamlet base, and thus equation (8) can be written again in the form of equation (9).
In equation (9):
is the length of the line segment contained in the image by the Beamlet base b.
And S103, connecting the fracture line segments according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture.
In the embodiment of the present invention, in this step, based on the linear fracture characteristics (fracture line segments) extracted in step S102, the discrete line segments are connected according to the distance and angle between adjacent discrete line segments, so as to form a continuous long line segment, i.e., a geological outcrop fracture.
As can be seen from the above description, the embodiment of the present invention performs gray scale conversion and image enhancement on a digital outcrop image captured by a high-definition digital camera. And (2) binarization preprocessing, namely extracting crack line segments based on the preprocessed image by utilizing a Beamlet multi-scale linear feature extraction algorithm, and performing crack linear feature connection on the extracted crack line segments, so that the technical effect of accurately extracting geological outcrop cracks in the digital outcrop image is realized, and the technical problems of low efficiency and poor reliability of the digital outcrop crack extraction method by manual drawing in the prior art are solved.
Fig. 2 is a schematic flow chart of the digital geological outcrop fracture extraction method according to the embodiment of the present invention, and as shown in fig. 2, the flow chart of the digital geological outcrop fracture extraction method according to the embodiment of the present invention includes: and the original image enters a post-processing stage through image preprocessing, a Beamlet dictionary, Beamlet transformation, a Beamlet pyramid, a Beamlet image and a Beamlet algorithm in sequence, and then an extraction result is obtained. Wherein the image preprocessing comprises: gray scale transformation, gray scale inversion, image enhancement and image binarization. The Beamlet dictionary includes: recursive binary decomposition, labeled fixes, and connected fixes. Post-processing includes joining discrete fracture segments, etc.
In the embodiment of the invention, the geological outcrop cracks are screened based on the ground stress constraint, so that effective geological outcrop cracks are screened. In the present invention, the geostress constraint may be expressed in terms of the orientation of the formation. In the embodiment of the invention, the geological outcrop cracks formed by connection can be screened according to the trend of each stratum in the geological outcrop image, and the geological outcrop cracks corresponding to the target stratum are screened out to be used as effective geological outcrop cracks.
In an embodiment of the invention, the geological outcrop fractures are screened based on the geostress constraint, and the screening can be performed in a fracture line segment extraction stage. Fig. 3 is a flowchart illustrating a process of screening a geologic outcrop fracture according to an embodiment of the present invention, and as shown in fig. 3, the process of screening a geologic outcrop fracture includes step S201 and step S202.
And step S201, screening the fracture line segments according to the trend of the stratum, and screening out the fracture line segments corresponding to the target stratum.
And S202, connecting the fracture line segments corresponding to the target stratum according to the distance and the angle difference between the fracture line segments to form a geological outcrop fracture corresponding to the target stratum.
Fig. 4 is a flowchart of image processing according to an embodiment of the present invention, and as shown in fig. 4, in the embodiment of the present invention, the image processing flow of step S101 may specifically include step S301 to step S303.
Step S301, converting the collected geological outcrop image into a gray image.
In the embodiment of the invention, the acquired geological outcrop image is usually colorful, and other operations are often required after the colorful image is converted into the gray image. Converting the digital image by using a weighted average method, wherein the calculation formula can be as follows:
Gray＝0.229R+0.587G+0.114B (1)
and S302, performing image enhancement on the geological outcrop image converted into the gray level image by adopting a multi-scale self-adaptive enhancement algorithm.
In the embodiment of the invention, after the image is grayed, a multi-scale adaptive enhancement algorithm can be adopted to enhance the image. The process mainly comprises the following five steps: 1. dividing the digital image into a plurality of small rectangular frames on a certain scale; 2. respectively calculating the average value (Gmean), the minimum value (Gmin) and the maximum value (Gmax) of the pixel gray scale for each small rectangular window; 3. for each small rectangular window divided in the previous step, an upper threshold (rh) and a lower threshold (rl) are set, and when the gray value of a point is out of the threshold, the point is considered as noise, and the range of the threshold [ rh rl ] is determined as the following formula:
rh＝Gmean+(Gmax-Gmean)f (2)
rl＝Gmean–(Gmean-Gmin)f (3)
in formula (2) and formula (3): f is a limiting factor, and the value of f depends on different images, and in the embodiment of the invention, the value of f is 50%; 4. after the noise points are eliminated, the average value G' mean of the pixel gray scale of each small rectangular window is recalculated to replace Gmean. 5. The correction coefficient factor is calculated as
f’＝B/Gmean (4)
In formula (4), B is the average value of the gray levels of the original crack images, and then the gray level of each point of the image is modified by multiplying the gray levels by a factor,
I’＝I×f’ (5)
in equation (5): i' is the enhanced image; f' is a correction coefficient.
And step S303, performing binarization processing on the enhanced geological outcrop image by adopting an Otsu threshold segmentation algorithm.
In the embodiment of the invention, after the digital image is subjected to enhancement processing, a Otsu threshold segmentation algorithm (also called an OTSU method between maximum classes) is used for separating cracks and background noise to obtain a binary image.
Fig. 5 is a first flowchart of a method for connecting a fracture line segment according to an embodiment of the present invention, as shown in fig. 5, in an embodiment of the present invention, the method for connecting a fracture line segment in step S103 may specifically include steps S401 to S403.
Step S401 calculates the angle of each fracture line segment.
Step S402, determining whether the angle difference between the two crack line segments is smaller than a preset angle threshold and whether the distance between the two crack line segments is smaller than a preset distance threshold.
In step S403, when the angle difference between the two crack line segments is smaller than a preset angle threshold and the distance between the two crack line segments is smaller than a preset distance threshold, the two crack line segments are connected.
In the embodiment of the present invention, the angle of each crack line segment may be an inclination angle based on the same reference for each crack line segment, for example, an inclination angle in the X-axis direction or an inclination angle in the Y-axis direction is set.
In an embodiment of the present invention, the determining step in step S402 may first perform the angle difference determination, and then perform the distance determination after determining that the angle difference is smaller than the preset angle threshold. Of course, the distance determination may also be performed first, and when the determined distance is smaller than the preset distance threshold, the angle difference determination is performed.
According to the invention, the angle threshold and the distance threshold are set, and the fracture line segments are connected according to the angle difference and the distance between the fracture line segments to form the geological outcrop fracture.
Fig. 6 is a second flowchart of a method for connecting a fracture line segment according to an embodiment of the present invention, as shown in fig. 6, in another embodiment of the present invention, the method for connecting a fracture line segment in step S103 may specifically include:
and 6, connecting the two Beamlet bases.
And then all the 8 connected regions and all the small rectangles are considered, and all the Beamlet-based connections are completed. In the embodiment of the invention, the Beamlet base is the extracted crack line segment.
Fig. 7 is a flowchart of a method for calculating a crack area and a crack length according to an embodiment of the present invention, and as shown in fig. 7, the method for calculating a crack area and a crack length according to an embodiment of the present invention includes step S501 and step S502.
Step S501, after isolated noise is removed from the geological outcrop image after binarization processing, the area of the crack is determined by counting pixel points with pixel values not being 0.
Step S502, aiming at the linear characteristic image obtained by the binary processed geological outcrop image through a Beamlet transformation method, determining the length of the crack by counting the pixel points with the pixel value not being 0.
In the embodiment of the invention, in the process of processing the outcrop crack image, the calculation of information such as the length, the width, the area and the like of the crack is particularly important. Because the resolution of the image is a unit pixel, after isolated noise of the geological outcrop image after binarization processing is removed, the area of the crack can be calculated by accumulating pixel point values which are not 0 through statistics. And (3) obtaining a linear characteristic image after the geological outcrop image after binarization processing is subjected to Beamlet transformation, and counting pixel points which are not zero by adopting the same method, wherein the accumulated pixel points are the length of the crack. In addition, the invention can also calculate the area seam rate through the total area of the seam and the total area of the image pixel.
The invention also discloses a specific embodiment for extracting the crack by adopting the digital geological outcrop crack extraction method of the embodiment of the invention. In the embodiment, the geological outcrop crack is extracted by using the method in the embodiment on the basis of the geological outcrop digital high-definition image. In this embodiment, a high-definition digital geological outcrop image is selected for geological outcrop crack extraction.
In this embodiment, the processing of the geological outcrop image includes gray level conversion, image enhancement, and image binarization. The image in this embodiment is a color image taken by a high-definition digital camera, as shown in fig. 14. In the method, the crack extraction needs to be processed by using a gray image, and the conversion from a color image to the gray image can be performed by using a formula (1).
In this embodiment, the image enhancement adopts multi-scale adaptive enhancement, so as to eliminate the influence of noise and illumination nonuniformity. And (3) carrying out regular space segmentation on the grayed image to obtain a series of small rectangular spaces, calculating the mean value, the minimum value and the maximum value of the pixel gray level in each small rectangular space, and setting a threshold to remove noise, wherein the threshold is determined by adopting a formula (2) and a formula (3). After noise is removed, the average value of the pixel gray levels in each rectangular space is recalculated, the gray level compensation factor is calculated according to the formula (4), and each pixel point of the image is processed according to the formula (5) so as to eliminate the illumination influence. Fig. 15 is the result of adaptive image enhancement using the 8 x 8 scale. And (3) carrying out binarization processing on the enhanced image to obtain a binary image of the crack, wherein as shown in fig. 16, the binary segmentation adopts an Otsu threshold segmentation algorithm (OTSU).
Fig. 17 shows the result of linear feature extraction on a binary image at a J-16 scale using the Beamlet transform scale. The extracted lines are complete and accurate, and most of noise is eliminated. Although the linear feature extracted by processing the outcrop fracture image through the Beamlet transform has a good effect, the outcrop fracture image has discontinuous features, so discrete line segments need to be merged, and fig. 18 is a schematic diagram of a result after the discrete fracture line segments are connected.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
Based on the same inventive concept, the embodiment of the present invention further provides a digital geological outcrop fracture extraction apparatus, which can be used for implementing the digital geological outcrop fracture extraction method described in the above embodiments, as described in the following embodiments. Because the principle of the digital geological outcrop crack extraction device for solving the problems is similar to the digital geological outcrop crack extraction method, the embodiment of the digital geological outcrop crack extraction device can be referred to the embodiment of the digital geological outcrop crack extraction method, and repeated parts are not described again. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 8 is a first structural block diagram of a digital geological outcrop fracture extraction apparatus according to an embodiment of the present invention, and as shown in fig. 8, the digital geological outcrop fracture extraction apparatus according to the embodiment of the present invention includes: an image processing unit 1, a crack extraction unit 2, and a crack connection unit 3.
The image processing unit 1 is configured to perform image processing on the collected geological outcrop image, where the image processing includes: at least one of grayscale transformation, image enhancement, and image binarization.
And the crack extraction unit 2 is used for extracting linear features of the geological outcrop image after the image processing by adopting a Beamlet transformation method and extracting crack line segments.
And the fracture connecting unit 3 is used for connecting the fracture line segments according to the distance and the angle difference between the fracture line segments to form a geological outcrop fracture.
Fig. 9 is a second structural block diagram of the digital geological outcrop fracture extraction apparatus according to the embodiment of the present invention, and as shown in fig. 9, the digital geological outcrop fracture extraction apparatus according to the embodiment of the present invention further includes: crack screening unit 4, crack screening unit 4 are connected with crack connecting element 3, obtain from crack connecting element 3 and connect formation geology outcrop crack.
And the fracture screening unit 4 is used for screening the geological outcrop fractures according to the trend of the stratum and screening out the geological outcrop fractures corresponding to the target stratum.
Fig. 10 is a block diagram of a third structure of the digital geological outcrop fracture extraction apparatus according to the embodiment of the present invention, and as shown in fig. 10, the digital geological outcrop fracture extraction apparatus according to the embodiment of the present invention further includes: the line segment screening unit 5 is connected with the crack extraction unit 2 and the crack connection unit 3 respectively, acquires the extracted crack line segment from the crack extraction unit 2, and sends the screened crack line segment to the crack connection unit 3.
And the line segment screening unit 5 is used for screening the fracture line segments according to the trend of the stratum and screening out the fracture line segments corresponding to the target stratum. The fracture connection unit 3 is further configured to connect the fracture line segments corresponding to the target formation according to the distance and the angle difference between the fracture line segments to form a geological outcrop fracture corresponding to the target formation.
Fig. 11 is a block diagram showing a configuration of an image processing unit according to an embodiment of the present invention, and as shown in fig. 11, an image processing unit 1 according to an embodiment of the present invention includes: a gray scale conversion module 101, an image enhancement module 102 and a binarization processing module 103.
And the gray level conversion module 101 is used for converting the collected geological outcrop image into a gray level image.
And the image enhancement module 102 is configured to perform image enhancement processing on the geological outcrop image converted into the grayscale image by using a multi-scale adaptive enhancement algorithm.
And the binarization processing module 103 is used for performing binarization processing on the enhanced geological outcrop image by adopting an Otsu threshold segmentation algorithm.
Fig. 12 is a block diagram of a composition structure of a crack connecting unit according to an embodiment of the present invention, and as shown in fig. 12, a crack connecting unit 3 according to an embodiment of the present invention includes: a line segment angle calculation module 301, a judgment module 302 and a connection module 303.
And the line segment angle calculating module 301 is used for calculating the angle of each fracture line segment.
The determining module 302 is configured to determine whether an angle difference between two crack line segments is smaller than a preset angle threshold and whether a distance between the two crack line segments is smaller than a preset distance threshold.
The connecting module 303 is configured to connect the two crack segments when the angle difference between the two crack segments is smaller than a preset angle threshold and the distance between the two crack segments is smaller than a preset distance threshold.
Fig. 13 is a fourth structural block diagram of the digital geological outcrop fracture extraction apparatus according to the embodiment of the present invention, and as shown in fig. 13, the digital geological outcrop fracture extraction apparatus according to the embodiment of the present invention further includes: a crack area determination unit 6 and a crack length determination unit 7. The crack area determining unit 6 and the image processing unit 1 acquire the geological outcrop image after the binarization processing from the image processing unit 1. The crack length determination unit 7 is connected to the crack extraction unit 2, and acquires a linear feature image obtained by a Beamlet transform method from the crack extraction unit 2.
And the crack area determining unit 6 is used for removing isolated noise from the geological outcrop image after binarization processing, and determining the area of the crack by counting pixel points with pixel values not being 0.
And the crack length determining unit 7 is used for determining the length of the crack by counting the pixel points with the pixel value not being 0 according to the linear characteristic image obtained by the binary processed geological outcrop image through the Beamlet transformation method.
To achieve the above object, according to another aspect of the present application, there is also provided a computer apparatus. As shown in fig. 19, the computer device includes a memory, a processor, a communication interface, and a communication bus, where a computer program operable on the processor is stored on the memory, and the processor executes the computer program to implement the steps of the digital geological outcrop fracture extraction method.
The processor may be a Central Processing Unit (CPU). The Processor may also be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, or a combination thereof.
The memory, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and units, such as the corresponding program units in the above-described method embodiments of the present invention. The processor executes various functional applications of the processor and the processing of the work data by executing the non-transitory software programs, instructions and modules stored in the memory, that is, the method in the above method embodiment is realized.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created by the processor, and the like. Further, the memory may include high speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory optionally includes memory located remotely from the processor, and such remote memory may be coupled to the processor via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more units are stored in the memory and when executed by the processor perform the method of the above embodiments.
The specific details of the computer device may be understood by referring to the corresponding related descriptions and effects in the above embodiments, and are not described herein again.
To achieve the above object, according to another aspect of the present application, there is also provided a computer readable storage medium storing a computer program which, when executed in a computer processor, implements the steps in the above digital geological outcrop fracture extraction method. It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and they may alternatively be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, or fabricated separately as individual integrated circuit modules, or fabricated as a single integrated circuit module from multiple modules or steps. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (16)
1. A method for extracting a digital geological outcrop crack is characterized by comprising the following steps:
carrying out image processing on the collected geological outcrop image, wherein the image processing comprises the following steps: at least one of gray scale transformation, image enhancement and image binarization;
performing linear feature extraction on the geological outcrop image after image processing by adopting a Beamlet transformation method, and extracting a crack line segment;
and connecting the fracture line segments according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture.
2. The method of digital geological outcrop fracture extraction of claim 1, further comprising:
and screening the geological outcrop cracks according to the trend of the stratum, and screening out the geological outcrop cracks corresponding to the target stratum.
3. The method of digital geological outcrop fracture extraction of claim 1, further comprising:
screening the fracture line segments according to the trend of the stratum, and screening out the fracture line segments corresponding to the target stratum;
connect formation geology outcrop crack according to distance and the angle difference between the crack line segment, include:
and connecting the fracture line segments corresponding to the target stratum according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture corresponding to the target stratum.
4. The method for extracting the digital geological outcrop crack according to claim 1, wherein the image processing of the collected geological outcrop image specifically comprises:
converting the collected geological outcrop image into a gray image;
performing image enhancement processing on the geological outcrop image converted into the gray level image by adopting a multi-scale self-adaptive enhancement algorithm;
and (4) carrying out binarization processing on the enhanced geological outcrop image by adopting an Otsu threshold segmentation algorithm.
5. The method for extracting the geological outcrop fracture according to claim 1, wherein the connecting the fracture line segments according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture specifically comprises:
calculating the angle of each crack line segment;
judging whether the angle difference between the two crack line segments is smaller than a preset angle threshold value or not and whether the distance between the two crack line segments is smaller than a preset distance threshold value or not;
and when the angle difference between the two crack line segments is smaller than a preset angle threshold value and the distance between the two crack line segments is smaller than a preset distance threshold value, connecting the two crack line segments.
6. The method of digital geological outcrop fracture extraction as claimed in claim 1 or claim 4, further comprising:
and after removing isolated noise from the geological outcrop image subjected to binarization processing, determining the area of the crack by counting pixel points with pixel values not being 0.
7. The method of digital geological outcrop fracture extraction as claimed in claim 1 or claim 4, further comprising:
and determining the length of the crack by counting pixel points with pixel values not being 0 aiming at the linear characteristic image obtained by the geological outcrop image after binarization processing through a Beamlet transformation method.
8. The utility model provides a digit geology outcrop crack extraction element which characterized in that includes:
the image processing unit is used for carrying out image processing on the collected geological outcrop image, wherein the image processing comprises the following steps: at least one of gray scale transformation, image enhancement and image binarization;
the crack extraction unit is used for extracting linear characteristics of the geological outcrop image after the image processing by adopting a Beamlet transformation method and extracting a crack line segment;
and the fracture connecting unit is used for connecting the fracture line segments according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture.
9. The digital geological outcrop fracture extraction device of claim 8, further comprising:
and the fracture screening unit is used for screening the geological outcrop fractures according to the trend of the stratum and screening out the geological outcrop fractures corresponding to the target stratum.
10. The digital geological outcrop fracture extraction device of claim 8, further comprising:
the line segment screening unit is used for screening the fracture line segments according to the trend of the stratum and screening out the fracture line segments corresponding to the target stratum;
and the fracture connecting unit is also used for connecting the fracture line segments corresponding to the target stratum according to the distance and the angle difference between the fracture line segments to form the geological outcrop fracture corresponding to the target stratum.
11. The digital geological outcrop fracture extraction device of claim 8, wherein the image processing unit comprises:
the gray level conversion module is used for converting the collected geological outcrop image into a gray level image;
the image enhancement module is used for carrying out image enhancement processing on the geological outcrop image converted into the gray level image by adopting a multi-scale self-adaptive enhancement algorithm;
and the binarization processing module is used for performing binarization processing on the enhanced geological outcrop image by adopting an Otsu threshold segmentation algorithm.
12. The digital geological outcrop fracture extraction device of claim 8, wherein the fracture connection unit comprises:
the line segment angle calculation module is used for calculating the angle of each crack line segment;
the judging module is used for judging whether the angle difference between the two crack line segments is smaller than a preset angle threshold value or not and whether the distance between the two crack line segments is smaller than a preset distance threshold value or not;
and the connecting module is used for connecting the two crack line segments when the angle difference between the two crack line segments is smaller than a preset angle threshold value and the distance between the two crack line segments is smaller than a preset distance threshold value.
13. The digital geological outcrop fracture extraction apparatus of claim 8 or 11, further comprising:
and the crack area determining unit is used for determining the area of the crack by counting the pixel points with the pixel value not being 0 after the isolated noise of the geological outcrop image after the binarization processing is removed.
14. The digital geological outcrop fracture extraction apparatus of claim 8 or 11, further comprising:
and the crack length determining unit is used for determining the length of the crack by counting the pixel points with the pixel value not being 0 according to the linear characteristic image obtained by the geological outcrop image after binarization processing through a Beamlet transformation method.
15. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 7 are implemented when the computer program is executed by the processor.
16. A computer-readable storage medium, in which a computer program is stored which, when being executed in a computer processor, carries out the steps of the method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910674862.5A CN112307803A (en) | 2019-07-25 | 2019-07-25 | Digital geological outcrop crack extraction method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910674862.5A CN112307803A (en) | 2019-07-25 | 2019-07-25 | Digital geological outcrop crack extraction method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112307803A true CN112307803A (en) | 2021-02-02 |
Family
ID=74329304
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910674862.5A Pending CN112307803A (en) | 2019-07-25 | 2019-07-25 | Digital geological outcrop crack extraction method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112307803A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113188975A (en) * | 2021-05-07 | 2021-07-30 | 中南大学 | Rock mass fracture and flying rock motion analysis system and method based on image processing technology |
| CN114998350A (en) * | 2022-08-04 | 2022-09-02 | 山东泗水泰和石材有限公司 | Stone defect detection method based on image processing |
| CN115131295A (en) * | 2022-06-06 | 2022-09-30 | 清华大学 | Construction method, system and device of engineering rock mass fracture network |
| CN117079144A (en) * | 2023-10-17 | 2023-11-17 | 深圳市城市交通规划设计研究中心股份有限公司 | Linear crack extraction method for asphalt pavement detection image under non-uniform illumination |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101915764A (en) * | 2010-08-10 | 2010-12-15 | 武汉武大卓越科技有限责任公司 | Road surface crack detection method based on dynamic programming |
| CN102867302A (en) * | 2012-08-30 | 2013-01-09 | 四川大学 | Core fracture identification method based on three-dimensional image information processing |
| CN104063869A (en) * | 2014-06-27 | 2014-09-24 | 南京通用电器有限公司 | Lane line detection method based on Beamlet transform |
| CN104700395A (en) * | 2014-11-11 | 2015-06-10 | 长安大学 | Method and system for detecting appearance crack of structure |
| CN104769457A (en) * | 2014-07-25 | 2015-07-08 | 杨顺伟 | Device and method for determining fracture strike of strata fracture based on travel time method |
| CN106803253A (en) * | 2017-01-17 | 2017-06-06 | 四川大学 | Rock 3-D view crack extract method |
| CN109145910A (en) * | 2017-06-28 | 2019-01-04 | 上海盟云移软网络科技股份有限公司 | The image line feature extracting method of the reconstruction of hologram |
| CN109596095A (en) * | 2018-12-05 | 2019-04-09 | 中国地质大学（北京） | A kind of true formation thickness of outcrop actual measurement determines method |
| CN109872318A (en) * | 2019-02-22 | 2019-06-11 | 中国石油大学(华东) | A kind of geology for deep learning is appeared crack data set production method |
-
2019
- 2019-07-25 CN CN201910674862.5A patent/CN112307803A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101915764A (en) * | 2010-08-10 | 2010-12-15 | 武汉武大卓越科技有限责任公司 | Road surface crack detection method based on dynamic programming |
| CN102867302A (en) * | 2012-08-30 | 2013-01-09 | 四川大学 | Core fracture identification method based on three-dimensional image information processing |
| CN104063869A (en) * | 2014-06-27 | 2014-09-24 | 南京通用电器有限公司 | Lane line detection method based on Beamlet transform |
| CN104769457A (en) * | 2014-07-25 | 2015-07-08 | 杨顺伟 | Device and method for determining fracture strike of strata fracture based on travel time method |
| CN104700395A (en) * | 2014-11-11 | 2015-06-10 | 长安大学 | Method and system for detecting appearance crack of structure |
| CN106803253A (en) * | 2017-01-17 | 2017-06-06 | 四川大学 | Rock 3-D view crack extract method |
| CN109145910A (en) * | 2017-06-28 | 2019-01-04 | 上海盟云移软网络科技股份有限公司 | The image line feature extracting method of the reconstruction of hologram |
| CN109596095A (en) * | 2018-12-05 | 2019-04-09 | 中国地质大学（北京） | A kind of true formation thickness of outcrop actual measurement determines method |
| CN109872318A (en) * | 2019-02-22 | 2019-06-11 | 中国石油大学(华东) | A kind of geology for deep learning is appeared crack data set production method |
Non-Patent Citations (1)
| Title |
|---|
| 高超 等: "基于Beamlet的岩心裂缝提取算法", 信息与电子工程, vol. 8, no. 2, pages 186 - 189 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113188975A (en) * | 2021-05-07 | 2021-07-30 | 中南大学 | Rock mass fracture and flying rock motion analysis system and method based on image processing technology |
| CN113188975B (en) * | 2021-05-07 | 2022-07-15 | 中南大学 | Rock mass fracture and flying rock motion analysis system and method based on image processing technology |
| CN115131295A (en) * | 2022-06-06 | 2022-09-30 | 清华大学 | Construction method, system and device of engineering rock mass fracture network |
| CN115131295B (en) * | 2022-06-06 | 2023-08-29 | 清华大学 | Construction method, system and device of engineering rock mass fracture network |
| CN114998350A (en) * | 2022-08-04 | 2022-09-02 | 山东泗水泰和石材有限公司 | Stone defect detection method based on image processing |
| CN114998350B (en) * | 2022-08-04 | 2022-10-25 | 山东泗水泰和石材有限公司 | Stone defect detection method based on image processing |
| CN117079144A (en) * | 2023-10-17 | 2023-11-17 | 深圳市城市交通规划设计研究中心股份有限公司 | Linear crack extraction method for asphalt pavement detection image under non-uniform illumination |
| CN117079144B (en) * | 2023-10-17 | 2023-12-26 | 深圳市城市交通规划设计研究中心股份有限公司 | Linear crack extraction method for asphalt pavement detection image under non-uniform illumination |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112307803A (en) | Digital geological outcrop crack extraction method and device | |
| CN108986119B (en) | Image segmentation method and device, computer equipment and readable storage medium | |
| CN110516208B (en) | System and method for extracting PDF document form | |
| CN107154040B (en) | Tunnel lining surface image crack detection method | |
| CN110163219B (en) | Target detection method based on image edge recognition | |
| Sun et al. | Automated pavement distress detection using advanced image processing techniques | |
| CN114418957A (en) | Global and local binary pattern image crack segmentation method based on robot vision | |
| CN108445009B (en) | Crack detection method for solar cell panel | |
| CN108241859B (en) | License plate correction method and device | |
| CN109558908B (en) | Method for determining optimal edge of given area | |
| WO2023070593A1 (en) | Line width measurement method and apparatus, computing processing device, computer program, and computer readable medium | |
| CN109859187B (en) | Explosive-pile ore rock particle image segmentation method | |
| CN108446702B (en) | Image character segmentation method, device, equipment and storage medium | |
| CN107578438A (en) | Circle recognition methods, device and electronic equipment | |
| CN114463286A (en) | Road surface point cloud smoothing and crack information processing method based on moving window | |
| CN113610024B (en) | Multi-strategy deep learning remote sensing image small target detection method | |
| CN116071272A (en) | Image correction method and device, electronic equipment and storage medium thereof | |
| CN111091071A (en) | Underground target detection method and system based on ground penetrating radar hyperbolic wave fitting | |
| CN110335322A (en) | Roads recognition method and road Identification device based on image | |
| CN111445446B (en) | Concrete surface crack detection method based on improved U-net | |
| CN116385268A (en) | Remote sensing image enhancement method | |
| CN108181665B (en) | Crack determination method and device | |
| CN108986079B (en) | Crack extraction and optimization method for complex fracture network | |
| CN110751150A (en) | FPGA-based binary neural network license plate recognition method and system | |
| CN107993193B (en) | Tunnel lining image splicing method based on illumination equalization and surf algorithm improvement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |