WO2021159211A1 - System and method for underground mining environment positioning of a moving entity - Google Patents
System and method for underground mining environment positioning of a moving entity Download PDFInfo
- Publication number
- WO2021159211A1 WO2021159211A1 PCT/CA2021/050152 CA2021050152W WO2021159211A1 WO 2021159211 A1 WO2021159211 A1 WO 2021159211A1 CA 2021050152 W CA2021050152 W CA 2021050152W WO 2021159211 A1 WO2021159211 A1 WO 2021159211A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- bolt
- rock
- bolts
- moving entity
- signature
- Prior art date
Links
Classifications
-
- E—FIXED CONSTRUCTIONS
- E21—EARTH DRILLING; MINING
- E21D—SHAFTS; TUNNELS; GALLERIES; LARGE UNDERGROUND CHAMBERS
- E21D20/00—Setting anchoring-bolts
-
- E—FIXED CONSTRUCTIONS
- E21—EARTH DRILLING; MINING
- E21F—SAFETY DEVICES, TRANSPORT, FILLING-UP, RESCUE, VENTILATION, OR DRAINING IN OR OF MINES OR TUNNELS
- E21F17/00—Methods or devices for use in mines or tunnels, not covered elsewhere
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/10—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
- G01C21/12—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
- G01C21/16—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation
- G01C21/165—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation combined with non-inertial navigation instruments
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
Definitions
- the present invention relates to the field of navigation in underground mining environments. More particularly, it relates to a position determination system and a corresponding method which leverages the unique patterns created by the numerous rock bolts used for rock support in underground mining environments, to precisely identify a feature of the mine with a know geospatial position and determine a position of a moving entity in the underground mining environment, for example to facilitate navigation therein.
- a plurality of positioning terminals can be positioned inside an underground mine, in order to communicate with positioning equipment associated with the moving entity and help determining the exact position of the moving entity circulating inside the underground mine.
- positioning terminals usually necessitate electrical power for functioning and are commonly battery powered, therefore resulting in costly recurrent battery changes to maintain the plurality of positioning terminals operative.
- IMU Inertial Measurement Units
- local measurements e.g. acceleration and angular velocity
- specialized algorithms to estimate the position of the moving entity, from an initial known position.
- IMU loose accuracy due to the accumulation of unbounded errors occurring with each local measurement from the on-board sensors, thereby leading to bias in the position determined using such systems.
- a method for underground mining environment positioning of a moving entity comprises the steps of repeatedly: receiving acceleration data relative to movements of the moving entity inside the underground mining environment from an inertial measurement unit (IMU); estimating a current position of the moving entity using the acceleration data from the IMU and a last confirmed position of the moving entity.
- IMU inertial measurement unit
- the method further comprises: generating unique bolt signatures for at least a subset of rock bolts installed on rock walls surrounding the moving entity; searching a bolt map including a tridimensional (3D) position and a unique signature for at least a subset of the rock bolts of the underground mining environment, to detect matches between the generated unique bolt signatures for the rock bolts surrounding the moving entity and the unique signatures of rock bolts of the bolt map; and updating the current position of the moving entity according to the 3D position of a corresponding one of the rock bolts of the bolt map, upon detecting a match between the unique signature of the corresponding one of the rock bolts in the bolt map and a generated unique bolt signature of one of the rock bolts surrounding the moving entity.
- 3D tridimensional
- the step of updating the current position of the moving entity according to the 3D position of the corresponding one of the rock bolts of the bolt map includes updating the estimated current position to match the position of the moving entity with regard to the known 3D of the position of the corresponding one of the rock bolts of the bolt map having the unique signature matching the generated unique bolt signature of the one of the rock bolts surrounding the moving entity.
- the step of estimating the current position of the moving entity includes determining a distance and a direction of travel of the last confirmed position of the moving entity and updating the last confirmed position of the moving entity using the determined distance and direction of travel of the moving entity.
- the method further comprises an initial step of initializing the mine and generating the bolt map where at least the subset of the rock bolts installed on the rock walls of the underground mining environment is identified with the 3D position and the unique signature thereof.
- the step of initializing the mine includes the steps of: recording data relative to the underground mining environment using a data acquisition apparatus recording data while being moved within the underground mining environment, the data relative to the underground mining environment including images of the rock walls of the underground mining environment; processing the recorded data relative to the underground mining environment and generating a point cloud representing the underground mining environment therefrom; performing image processing of the images from the data relative to the underground mining environment and detecting therefrom the rock bolts installed on the rock walls; positioning each one of the detected rock bolts on the point cloud to determine a 3D position thereof; for each one of the detected rock bolts, generating a unique signature using relative positions of the corresponding bolt and a plurality of surrounding rock bolts thereof; and generating the bolt map including the 3D position and the unique signature of each rock bolt.
- the step of recording data relative to the underground mining environment includes simultaneously recording scanner data of the rock walls surrounding the data acquisition apparatus, capturing images of the rock walls surrounding the data acquisition apparatus, and recording IMU data relative to the position of the data acquisition apparatus.
- the step of processing the recorded data relative to the underground mining environment and generating a point cloud representing the underground mining environment therefrom includes creating a SLAM point cloud; registering the point cloud; and creating combined image/robot trajectory.
- the step of performing image processing of the images from the data relative to the underground mining environment and detecting therefrom the rock bolts installed on the rock walls is performed using a machine learning tool trained to detect bolts in images.
- the machine learning tool is trained using a data set of previously gathered images of rock walls having rock bolts mounted thereon.
- the unique bolt signature of each one of the rock bolts is generated using a combination of at least one of distances and angles between axes respectively defined between a bolt of interest and a plurality of surrounding bolts and at least one of distances and angles between axes respectively defined between at least a subset of the surrounding bolts.
- the unique bolt signature of each one of the rock bolts is generated using the function: function wherein d1/dtotal, d2/dtotal, d3/dtotal and d4/dtotal each correspond to a relative distance between the bolt of interest and a corresponding one of the surrounding bolts thereof, 11 -2/ltotal, 12-3/ltotal, 13-4/ltotal and 14-1/dtotal each correspond to a relative distance between corresponding surrounding bolts of the bolt of interest and a1-2, a1-2, a2-3, a3-2, a4-3, a3-4, a3-2 and a1-4 correspond to angles between axes respectively defined between the corresponding surrounding bolts and between the bolt of interest the corresponding one of the surrounding bolts.
- the step of generating unique bolt signatures for at least a subset of rock bolts installed on rock walls surrounding the moving entity comprises the steps of: capturing images of the rock walls surrounding the moving entity during the displacement thereof; performing image processing of the captured images to detect the rock bolts within the images; generating a 3D representation of the detected rock bolts; and generating bolt signatures for at least a subset of the detected rock bolts.
- a computer readable memory having recorded thereon statements and instructions for execution by a computer, said statements and instructions comprising code means for performing the steps of the method as described above.
- a system for underground mining environment positioning of a moving entity comprises a data acquisition apparatus and a computing device.
- the data acquisition apparatus includes a plurality of cameras disposed to capture photographs of rock walls of the underground mining environment as the data acquisition apparatus is moved therein and an inertial measurement unit (IMU) measuring the acceleration of the data acquisition apparatus and generating acceleration data.
- IMU inertial measurement unit
- the computing device has a processor and a memory and further comprises: a position estimation unit receiving the acceleration data from the IMU and estimating a current position of the moving entity based on the acceleration data and a previous known position of the moving entity; a bolt signature detection unit receiving images of the rock walls surrounding the moving entity from the data acquisition apparatus and generating bolt signatures for at least a subset of the rock bolts shown in the images; a signature matching unit accessing a previously generated bolt map where at least a subset of the rock bolt of the underground mining environment is identified with a tridimensional (3D) position and a unique signature and being in data communication with the bolt signature detection unit, the signature matching unit performing search within the bolt map to identify rock bolts of the bolt maps having the unique signature matching a corresponding one of the bolt signatures of a rock bolt generated by the bolt signature detection unit; and a position determination unit configured to determine the position of the moving entity upon identification of a corresponding rock bolt of the bolt map with the unique signature thereof matching the bolt signature of one of the bolts generated by the bolt signature detection unit
- the signature matching unit is in data communication with a database having the previously generated bolt map stored thereon.
- the position determination unit updates the estimated position of the position estimation unit to match the position of the moving entity with regard to the known 3D position of the corresponding rock bolt of the bolt map with the unique signature thereof matching the bolt signature of one of the bolts generated by the bolt signature detection unit.
- the bolt signature detection unit is further configured to perform image processing of the images to detect the rock bolts within the images, to generate a 3D representation of the detected rock bolts and to generate the unique bolt signatures for at least a subset of the detected rock bolts.
- the bolt signature detection unit includes a machine learning tool trained to detect bolts in images.
- the machine learning tool is trained using a data set of previously gathered images of rock walls having rock bolts mounted thereon.
- the unique bolt signature of each one of the rock bolts is generated using a combination of at least one of distances and angles between axes respectively defined between a bolt of interest and a plurality of surrounding bolts and at least one of distances and angles between axes respectively defined between at least a subset of the surrounding bolts.
- each one of the unique bolt signature is created using the function: function wherein d1 /dtotal, d2/dtotal, d3/dtotal and d4/dtotal each corresponds to a relative distance between a bolt on interest and a surrounding bolt thereof, 11 -2/ltotal, I2- 3/ltotal, 13-4/ltotal and 14-1 /dtotal each correspond to a relative distance between corresponding surrounding bolts of the bolt on interest and a1-2, a1-2, a2-3, a3-2, a4-3, a3-4, a3-2 and a1-4 correspond to angles between axes respectively defined between the corresponding surrounding bolts and between the bolt of interest the corresponding one of the surrounding bolts.
- the data acquisition apparatus includes a wall scanner scanning the rock walls of the underground mining environment as the data acquisition apparatus is moved therein.
- the wall scanner is a LiDAR scanner.
- the data acquisition apparatus is mounted onto a moveable platform attachable to the moving entity.
- Figures 1a to 1c show respectively an isometric view, a longitudinal cross- sectional view and a plan view of a schematic section of a mine showing rock bolts extending inside the rock walls.
- Figure 2 is a partial view of a rock wall of a mine showing the rock bolts inserted therein.
- Figure 3 is a partial view of a rock wall with indication of rock bolts detected thereon, for example using a machine learning tool.
- Figure 4 is a schematic representation of a bolt signature, showing a bolt of interest and four closest surrounding bolts used in defining the bolt signature for the bolt of interest.
- Figure 5 is a schematic representation of distances used in defining a bolt signature, showing a bolt of interest and four closest surrounding bolts used in defining the bolt signature for the bolt of interest, with corresponding distances.
- Figure 6 is a schematic representation of angles used in defining a bolt signature, showing a bolt of interest and four closest surrounding bolts used in defining the bolt signature for the bolt of interest, with corresponding angles therebetween.
- Figure 7 is a flowchart showing the steps for initialization/update of a mine and creation of a corresponding bolt map, in accordance with an embodiment.
- Figure 8 is a flowchart showing the steps for positioning of the moving entity in the underground mining environment, in accordance with an embodiment.
- Figure 9 is a schematic representation of a system for underground mining environment positioning of a moving entity, in accordance with an embodiment.
- steps of the proposed method are implemented as software instructions and algorithms, stored in computer memory and executed by processors. It should be understood that servers and computers are therefore required to implement to proposed system, and to execute the proposed method. In other words, the skilled reader will readily recognize that steps of various above- described methods can be performed by programmed computers.
- program storage devices e.g., digital data storage media, which are machine or computer readable and encode machine-executable or computer-executable programs of instructions, wherein said instructions perform some or all of the steps of said above-described methods.
- the embodiments are also intended to cover computers programmed to perform said steps of the above-described methods.
- Computers are used to encompass computers, servers and/or specialized electronic devices which receive, process and/or transmit data.
- “Computing devices” are generally part of “systems” and include processing means, such as microcontrollers and/or microprocessors, CPUs or are implemented on FPGAs, as examples only.
- the processing means are used in combination with storage medium, also referred to as “memory” or “storage means”.
- Storage medium can store instructions, algorithms, rules and/or data to be processed.
- Storage medium encompasses volatile or non-volatile/persistent memory, such as registers, cache, RAM, flash memory, ROM, as examples only.
- the type of memory is, of course, chosen according to the desired use, whether it should retain instructions, or temporarily store, retain or update data.
- each such computing device typically includes a processor (or multiple processors) that executes program instructions stored in the memory or other non-transitory computer-readable storage medium or device (e.g., solid state storage devices, disk drives, etc.).
- the various functions, modules, services, units or the like disclosed hereinbelow can be embodied in such program instructions, and/or can be implemented in application- specific circuitry (e.g., ASICs or FPGAs) of the computing devices.
- ASICs application-specific integrated circuitry
- FPGAs field-programmable gate arrays
- any block diagrams herein represent conceptual views of illustrative circuitry embodying the principles disclosed herein.
- any flow charts and transmission diagrams, and the like represent various processes which may be substantially represented in computer readable medium and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.
- rock bolts 20 are commonly used for rock mechanics purposes, during the drilling process required for forming a path inside the mine 12.
- the rock bolts 20 are inserted into drill holes which are drilled into the rock walls 14 of the mine 12 and secured therein.
- the drill holes are positioned according to a drill map designed by an engineer and the bolts installed inside the corresponding drill holes thereby define a corresponding bolt pattern.
- Figures 1a to 1c show respectively an isometric view, a longitudinal cross-sectional view and a plan view of a schematic representation of a section of a mine 12, where rock bolts 20 extend inwardly from an inner surface 14a of the rock wall 14, to provide support to the rock wall 14.
- Figure 2 shows an image of a section of a rock wall 14, where rock bolts 20 have been installed and can be seen with a rod section protruding from the inner surface 14a of the rock wall 14.
- each rock bolt 20 is visually identifiable on the inner surface 14a of the rock wall 14.
- each one of the rock bolts 20 includes a protruding rod section having a nut threaded thereon and a metal plate secured against the inner surface 14a of the wall 14 by the nut.
- the rock bolts can be used to maintain a mesh 13 against the inner surface 14a of the wall 14.
- a mapping of the rock bolts 20 can be performed.
- the mapping of the rock bolts 20 can be performed by georeferenced imaging or vision of the walls 14 of the mine 12 (i.e. by gathering images or data of the inner surface 14a of the rock wall 14 using an imaging or vision system and a geospatial positioning system determining the position thereof, as the images or data are acquired, therefore allowing the determination of the specific geospatial position of each rock bolt 20 detected from the images or data acquired.
- FIG. 3 shows an example of a portion of an image of the inner surface 14a of a section of a rock wall 14 with indication of rock bolts 20 detected thereon (shown herein as rectangles), by a machine learning tool.
- each bolt 10 has a unique signature defined by the relative position (i.e. the relative distances and/or angles) of the bolt of interest 20a (i.e. the specific bolt being analyzed and to which the unique signature corresponds) and a subset of surrounding bolts 20b proximate to the bolt of interest 20a (which can include a varying number of rock bolts 20 in the vicinity of the bolt of interest 20a).
- the term “unique signature” is used to define a unique identifier defined by the relative positioning of a bolt of interest 20a and a plurality of surrounding bolts 20b (i.e. an identifier which is unique to the pattern of the bolt of interest 20a), such that it can be distinguished from another identifier of other bolt of interests 20a of the underground mining environment.
- Figure 4 shows an exemplary embodiment of a bolt of interest 20a and a subset of surrounding bolts 20b which can be used to define the unique signature of the bolt of interest 20a.
- the unique signature of the bolt of interest 20a is defined by the relative positions of the bolt of interest 20a and at least a subset of the surrounding bolts 20b, in 3D.
- the unique signature of the bolt of interest 20a is shown and described herein in 2D.
- the bolt of interest 20a is shown with four surrounding bolts 20b cooperating with the bolt of interest 20a to define the unique signature thereof.
- surrounding bolts 20b can be used to define the unique signature of the bolt of interest 20a.
- the amount of surrounding bolts 20b used to define the unique signature of the bolt of interest 20a is selected to provide an advantageous balance between uniqueness of the signature when compared with signatures of other bolts of interests 20a of the underground mining environment, the processing power required to define the unique signatures and subsequently identify the unique signatures and the size of a resulting map including the positions and the unique signatures of bolts 20 of an underground mining environment.
- a set of between about three and ten surrounding bolts 20b can be used to define the unique signature of the bolt of interest 20a.
- the distances include distances d1 , d2, d3 and d4, which each represent a distance between the specific bolt of interest 20a and a corresponding one of the surrounding bolts 20b (i.e. the distance between the specific bolt of interest 20a and each one of corresponding boltl , bolt2, bolt3 and bolt4 in Figure 5).
- the distances also include distances 11-2, I2-3, I3-4 and 14-1 , which each represent a distance between a corresponding one of the surrounding bolts 20b and another surrounding bolt 20b adjacent therewith (i.e. the distance between boltl and bolt2, the distance between bolt2 and bolt3, the distance between bolt3 and bolt4, and the distance between bolt4 and boltl , in Figure 5).
- distances 11-2, I2-3, I3-4 and 14-1 each represent a distance between a corresponding one of the surrounding bolts 20b and another surrounding bolt 20b adjacent therewith (i.e. the distance between boltl and bolt2, the distance between bolt2 and bolt3, the distance between bolt3 and bolt4, and the distance between bolt4 and boltl , in Figure 5).
- other distances i.e. different or additional distances
- the distances used to define the unique signature can be relative distances rather than absolute lengths. Indeed, the use of relative distances allows minimization of the processing required in the photogrammetry 3D process for determining the distances from the acquired images and/or additional data, as the calculations required to perform photogrammetry 3D are faster when using relative distances rather than using absolute lengths.
- the angles include angles a1- 2, a1-2, a2-3, a3-2, a4-3, a3-4, a3-2, a1-4, which each represents an angle between two axes respectively defined between the corresponding one of the surrounding bolts 20b and the bolt of interest 20a and between the corresponding one of the surrounding bolts 20b and another surrounding bolt 20b adjacent therewith.
- the unique signature can be generated through a combination of specific characteristics stemming from the geospatial relations of the bolt of interest 20a and N closest surrounding bolts 20b, to create a unique identifier that can specifically identify a particular bolt 20 in a map of the plurality of bolts 20.
- the unique signature can be generated by a function such as, for example and without being limitative the function below, which returns a unique ID.
- a function such as, for example and without being limitative the function below, which returns a unique ID.
- the reference identifiers d1 , d2, d3, d4, 11-2, I2-3, I3- 4, 14-1 , a1-2, a1-2, a2-3, a3-2, a4-3, a3-4, a3-2 and a1-4 correspond to the equivalent distances or angles as defined in Figures 5 and 6 and discussed above.
- the identifiers dtotal and Itotal correspond respectively to the total of d1 , d2, d3 and d4 and the total of 11-2, I2-3, I3-4, 14-1 , such that the function uses relative distances rather than lengths.
- the function defined above returns a unique signature for a bolt of interest 20a.
- the distances and angles used as input for the function defining the unique signature can be rounded using a magnitude within the range of error of the data acquisition apparatus, to compensate for possible recording errors of the data acquisition apparatus.
- the function used to define the unique signature could have more or fewer parameters, or different parameters corresponding to the distances and angles used for defining the unique signature.
- other featured of the bolt of interest 20a could also be used in defining the unique signature thereof.
- the type of rock bolt could be used as a parameter in the unique signature of the rock bolt.
- the orientation of the rock bolt could also be used as a parameter in the unique signature of the rock bolt.
- each rock bolt 20 (as defined by the relative position of the bolt of interest 20a and a subset of surrounding bolts 20b) can therefore be used in a 3-dimensional environment, to define the exact positioning of a moving entity inside the mine.
- Figure 7 shows the steps for initializing the mine and generating a bolt map where the rock bolts 20 of the mine are identified with a 3D position (in X, Y, Z) and a unique signature.
- the steps shown in Figure 7 for initializing the mine can also be repeatedly performed after the first initialization, to update the bolt map where each rock bolt 20 of the mine is identified with a 3D position (in C,U,Z) and a unique signature, in order to ensure that the bolt map always corresponds to the current condition of the mine.
- only a subset of the rock bolts 20 of the mine can be identified with a 3D position (in C,U,Z) and a unique signature in the bolt map.
- Figure 7 shows the general starting step 100 for initializing/updating the mine and the sequence of sub steps to be performed for performing the initialization/update of the mine and generating the bolt map, in accordance with an embodiment.
- the sub steps include the recording step 102 of recording data relative to the underground mining environment.
- the step 102 of recording data relative to the underground mining environment can include simultaneously recording scanner data, and capturing images of the rock walls, along with inertial motion unit (IMU) data, which together allow defining the underground mining environment and the corresponding geospatial position simultaneously.
- IMU inertial motion unit
- a LiDAR is described as the scanner being used, but one skilled in the art will understand that, in alternative embodiment, other types of scanner capable of generating point clouds could be used.
- this step is performed using a data acquisition apparatus having the necessary equipment for recording data and capturing images while being moved within the underground mining environment.
- this step can be performed, for example by moving a data acquisition apparatus along the path of the mine, with the data acquisition apparatus including simultaneously operating LiDAR, cameras and IMU all operating as the data acquisition apparatus is moved inside the mine.
- the combination of a LiDAR, cameras and an IMU can generate data relative to the geographic position of the data acquisition apparatus, while simultaneously performing 3D laser scanning of the environment of the data acquisition apparatus, and image capture of the environment of the data acquisition apparatus. Operational details of a data acquisition apparatus in accordance with an embodiment, will be described in more details below.
- the recording data relative to the underground mining environment gathered by the data acquisition apparatus can be processed to analyze and map the visible features of the rock walls 14 of the mine 12.
- the method can include the subsequent steps of generating a point cloud representing the underground mining environment 104 and detecting the bolts on the images gathered by the data acquisition apparatus 106.
- the step of generating a point cloud representing the underground mining environment 104 includes creating a SLAM point cloud 104a, registering the point cloud 104b and creating combined image/robot trajectory 104c, but one skilled in the art will understand that, in an alternative embodiment (not shown), other alternative steps could be provided to generate an accurate point cloud.
- the step of detecting the bolts on the images gathered by the data acquisition apparatus 106 can be performed, for example and without being limitative, using a machine learning tool trained to detect bolts in images.
- the machine learning tool could be trained using a data set of previously gathered images of rock walls having rock bolts mounted thereon.
- a further step of positioning each bolt on the point cloud 108 can be performed.
- the step of positioning each bolt on the point cloud 108 therefore allows to determine the 3D position (i.e. the X, Y and Z position) of each bolt within the underground mining environment.
- the unique signature of the bolt of interest can be determined and generated 110, for example using the function described above, and the unique signature can be associated with the bolt.
- This step can be performed specifically for each one of the rock bolts 20 (i.e. using each one of the rock bolts 20 as the bolt of interest 20a to generate its unique signature) to associate a unique signature to each bolt.
- this step can be performed only for a subset of the rock bolts 20 of the mine 12.
- the generated bolt map therefore includes the sum of the combined position and unique signature of each rock bolt 20 of the underground mining environment.
- the combined position and unique signature of each bolt can be compiled and stored in a bolt map stored in a dynamic database of a data server.
- Figure 8 therefore shows the general starting step 200 for positioning and/or navigation of a moving entity inside the mine and the sequence of sub steps to be performed for performing the positioning and/or navigation of the moving entity inside the mine 12, in accordance with an embodiment.
- the method includes the steps of recording acceleration data from an IMU 204. From the acquired data of the IMU, the method includes the step 205 of performing estimation of the position of the moving entity, using the combination of the acceleration data of the IMU and a last confirmed position of the moving entity.
- an approximative position is continuously or repeatedly updated based on a distance covered from the last known position, as defined by the acceleration data gathered from the IMU moving along with the moving entity, which is transmitted to a computing device and is processed to determine a distance travelled from the last known position and a direction of travel.
- this step includes determining a distance and a direction of travel from the last confirmed position of the moving entity and updating the last confirmed position of the moving entity using the determined distance and direction of travel of the moving entity.
- the method for positioning and/or navigation of a moving entity inside the mine further includes detecting bolt signatures for bolts surrounding the moving entity 202.
- the step of detecting bolt signatures for bolts surrounding the moving entity 202 is performed simultaneously with the estimation of the position using the acceleration data of the IMU and the last confirmed position of the moving entity 205.
- the general step of detecting bolt signatures for bolts surrounding the moving entity 202 includes the steps of capturing images of the rock walls surrounding the moving entity during the displacement thereof 202a, performing analysis of the images to detect the rock bolts within the images 202b, generating a 3D representation of the detected rock bolts 202c and finally generating bolt signatures for at least a subset of the detected rock bolts 202d.
- the images when recording images of the rock walls surrounding the moving entity during the displacement thereof 202a, the images can be recorded using the cameras of the above- mentioned data acquisition apparatus mounted to or being pulled/pushed/carried by the moving entity.
- the images can be captured with overlap therebetween in order to allow usage of photogrammetric parallax in subsequent image analysis for the determination of the position of the rock bolts 20 surrounding the moving entity (when the images were captured) and to determine the unique signatures of the rock bolts 20, in real time (or near-real time).
- the analysis of the images to detect the rock bolts 20 within the images 202b can be performed, for example and without being limitative using a machine learning tool trained to detect rock bolts 20 in images.
- the machine learning tool could be trained using a data set of previously gathered images of rock walls 14 having rock bolts 20 mounted thereon.
- the sub step of generating a 3D representation of the detected rock bolts 202c can be performed using photogrammetry (i.e. by determining the position of the rock bolts 20 in 3D using measuring and interpretation of the photographic images gathered at step 202a).
- the 3D representation of the detected rock bolts 20 can be generated by representing the bolts 20 according to their 3D position.
- specialized software and/or machine learning tools can be used to perform the photogrammetry of the gathered images and the generation of the 3D representation of the detected rock bolts 20.
- the generation of the bolt signature for at least a subset of the detected rock bolts 202d is once again performed as described above, using the 3D position of each bolt of interest and the position of N closest surrounding bolts, to determine the unique signature of each bolt of interest, for example using the function described above.
- the estimated position can also be used to reduce the search of a signature of the rock bolts 20 surrounding the moving entity to a specific sector of the bolt map corresponding to the sector associated with the estimated position of the moving entity, therefore minimizing the computing time required to find a match between the bolt signature of a rock bolt 20 surrounding the moving entity and a rock bolt 20 of the bolt map.
- the method for positioning and/or navigation of a moving entity inside the mine includes the further step of searching bolt signatures corresponding to the generated bolt signatures for at least a subset of the detected rock bolts 20 in the previously generated bolt map 206.
- searching bolt signatures corresponding to the generated bolt signatures for at least a subset of the detected rock bolts can be restricted to a section of the bolt map corresponding to the estimated position of the moving entity 206a, 206b (i.e. limiting the search in the bolt maps to rock bolts located within a predetermined perimeter around the estimated position of the moving entity).
- searching bolt signatures corresponding to the generated bolt signatures for at least a subset of the detected rock bolts can be performed without being restricted to a section of the bolt map corresponding to the estimated position of the moving entity (i.e. be performed on the entire bolt map) 206b.
- specialized software and/or machine learning tools can be used to perform the search of bolt signatures corresponding to the generated bolt signatures for at least a subset of the detected rock bolts on the bolt map at step 206b.
- the estimated position of the moving entity and the actual position of the moving entity can be updated 208 to match the position of the moving entity with regard to the known position of the bolt of interest for which the unique signature has been identified 208. Once the position of the moving entity has been determined, a new iteration can be performed.
- this process is iterative and can be continuously or repeatedly performed during the displacement of the moving entity inside the mine to provide continuous or repeated estimated or validated position of the moving entity.
- the position of the moving entity can be displayed on a display device to a user of the moving entity or can be transmitted to a control center which can operate to use the positioning data of the moving entity, for example to coordinate the movement of moving entities inside the mine, to control the movement of the entities inside the mine, or the like.
- the system 10 includes a data acquisition apparatus 30 including a plurality of cameras 32 disposed to capture images of the rock walls 20 of the underground mining environment as the data acquisition apparatus 30 is moved therein.
- the cameras 32 are disposed to capture images of the rock walls of the underground mining environment over about 270 degrees, from a lateral surface of the data acquisition apparatus 30, as the data acquisition apparatus 30 is moved along a path of the underground mining environment.
- the data acquisition apparatus 30 also includes an IMU 34 including the required components such as, for example and without being limitative, accelerometers, gyroscopes and the like, to measure the acceleration of the data acquisition apparatus 30 in 3D and to generate acceleration data representative of the acceleration thereof.
- the data acquisition apparatus 30 can also include a wall scanner 36, such as, for example and without being limitative, a LiDAR, scanning the rock walls of the underground mining environment as the data acquisition apparatus 30 is moved therein.
- the data acquisition apparatus 30 can be mounted onto a moveable platform attachable to the moving entity.
- the moveable platform can be a trailer being attached behind the moving entity and being pulled by the moving entity as it moves within the mine.
- the system 10 further comprises a computing device 40 having a processor 42 for processing instructions and data and a memory 44 storing instructions and/or data acquired by the data acquisition apparatus 30.
- the computing device 40 includes a position estimation unit 50 receiving the acceleration data from the IMU 34 of the data acquisition apparatus 30, processing the acceleration data from the IMU 34 and estimating the position of the moving entity based on the acceleration data and a previous known position.
- the position estimation unit 50 estimates the position of the moving entity by determining a distance travelled from a known position by the moving entity from the acceleration data received from the IMU 34 and adjusting the position from the last known position using the distance travelled therefrom.
- the computing device 40 also includes a bolt signature detection unit 52 configured to receive images of the rock walls surrounding the moving entity from the data acquisition apparatus 30, to perform image processing of the received images to detect the rock bolts and to generate bolt signatures for at least a subset of the bolts shown in the images.
- the bolt signature detection unit 52 is configured to perform image processing of the received images to detect the rock bolts within the images, to generate a 3D representation of the detected rock bolts and to generate unique bolt signatures for at least a subset of the detected rock bolts, for example using the above described function:
- the computing device 40 further includes a signature matching unit 54 in data communication with the bolt signature detection unit 52 and with a database comprising a previously generated bolt map 60 where the rock bolts of the mine are identified with a 3D position (in X, Y, Z) and a unique signature.
- the signature matching unit 54 is configured to query the database and search the database to perform signature matching between bolt signatures of the bolt map stored in the database 60 and the bolt signatures generated by the signature detection unit 52, to identify bolts of the bolt maps having a unique signature matching a signature of a rock bolt 20 generated by the bolt signature detection unit 52.
- the bolt map could be stored in a memory of the computing device 40, such that signature matching can be performed directly from the bold map stored in the memory of the computing device 40 and the signatures of the rock bolts 20 generated by the bolt signature detection unit 52.
- the computing device 40 further includes a position determination unit 56 configured to determine the position of the moving entity upon identification of a match between at least one rock bolt of the bolt maps having a unique signature and a signature of a rock bolt generated by the bolt signature detection unit 52 and updating the estimated position of the moving entity generated by the position estimation unit, to match the position of the moving entity with regard to the known position of the bolt of interest for which the unique signature has been identified as a match with the signature of the rock bolt generated by the bolt signature detection unit 52 .
- a position determination unit 56 configured to determine the position of the moving entity upon identification of a match between at least one rock bolt of the bolt maps having a unique signature and a signature of a rock bolt generated by the bolt signature detection unit 52 and updating the estimated position of the moving entity generated by the position estimation unit, to match the position of the moving entity with regard to the known position of the bolt of interest for which the unique signature has been identified as a match with the signature of the rock bolt generated by the bolt signature detection unit 52 .
- the position of the moving entity is determined by the position determination unit 56, based on the position of the specific identified rock bolt 20 in the bolt map (each rock bolt having a tridimensional position associated therewith in the bolt map) and the position of the data acquisition apparatus 30 respective to the specific rock bolt when capturing the images showing the specific bolt.
- the images can be captured with overlap therebetween in order to allow usage of photogrammetric parallax in subsequent image analysis for the determination of the position of the entity with regard to a specific rock bolt surrounding the moving entity when the images were captured.
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA3167960A CA3167960A1 (en) | 2020-02-14 | 2021-02-12 | System and method for underground mining environment positioning of a moving entity |
AU2021219857A AU2021219857A1 (en) | 2020-02-14 | 2021-02-12 | System and method for underground mining environment positioning of a moving entity |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202062976876P | 2020-02-14 | 2020-02-14 | |
US62/976,876 | 2020-02-14 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021159211A1 true WO2021159211A1 (en) | 2021-08-19 |
Family
ID=77291294
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CA2021/050152 WO2021159211A1 (en) | 2020-02-14 | 2021-02-12 | System and method for underground mining environment positioning of a moving entity |
Country Status (3)
Country | Link |
---|---|
AU (1) | AU2021219857A1 (en) |
CA (1) | CA3167960A1 (en) |
WO (1) | WO2021159211A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113701754A (en) * | 2021-09-06 | 2021-11-26 | 中国矿业大学(北京) | Underground three-dimensional accurate positioning system |
CN114894167A (en) * | 2022-04-06 | 2022-08-12 | 西北工业大学 | Cave automatic surveying and mapping system and method based on multi-sensor technology |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6349249B1 (en) * | 1998-04-24 | 2002-02-19 | Inco Limited | Automated guided apparatus suitable for toping applications |
US6608913B1 (en) * | 2000-07-17 | 2003-08-19 | Inco Limited | Self-contained mapping and positioning system utilizing point cloud data |
US20100183422A1 (en) * | 2003-07-03 | 2010-07-22 | Sandvik Mining And Construction Oy | Arrangement for monitoring the location of a mining vehicle in a mine |
-
2021
- 2021-02-12 CA CA3167960A patent/CA3167960A1/en active Pending
- 2021-02-12 WO PCT/CA2021/050152 patent/WO2021159211A1/en active Application Filing
- 2021-02-12 AU AU2021219857A patent/AU2021219857A1/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6349249B1 (en) * | 1998-04-24 | 2002-02-19 | Inco Limited | Automated guided apparatus suitable for toping applications |
US6608913B1 (en) * | 2000-07-17 | 2003-08-19 | Inco Limited | Self-contained mapping and positioning system utilizing point cloud data |
US20100183422A1 (en) * | 2003-07-03 | 2010-07-22 | Sandvik Mining And Construction Oy | Arrangement for monitoring the location of a mining vehicle in a mine |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113701754A (en) * | 2021-09-06 | 2021-11-26 | 中国矿业大学(北京) | Underground three-dimensional accurate positioning system |
CN113701754B (en) * | 2021-09-06 | 2023-05-12 | 中国矿业大学(北京) | Underground three-dimensional accurate positioning system |
CN114894167A (en) * | 2022-04-06 | 2022-08-12 | 西北工业大学 | Cave automatic surveying and mapping system and method based on multi-sensor technology |
CN114894167B (en) * | 2022-04-06 | 2024-01-30 | 西北工业大学 | Automatic cave mapping system and method based on multi-sensor technology |
Also Published As
Publication number | Publication date |
---|---|
CA3167960A1 (en) | 2021-08-19 |
AU2021219857A1 (en) | 2022-10-06 |
AU2021219857A8 (en) | 2022-10-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111108342B (en) | Visual range method and pair alignment for high definition map creation | |
US9892491B2 (en) | Systems and methods for processing mapping and modeling data | |
US10767990B2 (en) | Device, method, and system for processing survey data, and program therefor | |
EP2434256B1 (en) | Camera and inertial measurement unit integration with navigation data feedback for feature tracking | |
US9121713B2 (en) | Unified framework for precise vision-aided navigation | |
CN110487267B (en) | Unmanned aerial vehicle navigation system and method based on VIO & UWB loose combination | |
US9142063B2 (en) | Positioning system utilizing enhanced perception-based localization | |
CN106066645A (en) | While operation bull-dozer, measure and draw method and the control system of landform | |
US9721158B2 (en) | 3D terrain mapping system and method | |
US11237005B2 (en) | Method and arrangement for sourcing of location information, generating and updating maps representing the location | |
US10970924B2 (en) | Reconstruction of a scene from a moving camera | |
JP6532412B2 (en) | Self-position estimation system, self-position estimation method, mobile terminal, server and self-position estimation program | |
US20180372493A1 (en) | Method and system for aerial image processing | |
AU2021219857A1 (en) | System and method for underground mining environment positioning of a moving entity | |
JP4436632B2 (en) | Survey system with position error correction function | |
CN109596121A (en) | A kind of motor-driven station Automatic Targets and space-location method | |
JP2023530884A (en) | Generation of geomagnetic maps | |
Azhari et al. | A comparison of sensors for underground void mapping by unmanned aerial vehicles | |
US20220057517A1 (en) | Method for constructing point cloud map, computer device, and storage medium | |
JP6698430B2 (en) | Measuring device, measuring method and program | |
KR102050995B1 (en) | Apparatus and method for reliability evaluation of spatial coordinates | |
CN111623821B (en) | Method for detecting tunnel drilling direction, detecting deviation and determining drilling position | |
Lee et al. | Autonomous Airborne Video‐Aided Navigation | |
CN112414407A (en) | Positioning method, positioning device, computer equipment and storage medium | |
JP6727032B2 (en) | Mobile terminal, self-position estimation system using the same, server and self-position estimation method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21753220 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 3167960 Country of ref document: CA |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021219857 Country of ref document: AU Date of ref document: 20210212 Kind code of ref document: A |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 21/11/2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21753220 Country of ref document: EP Kind code of ref document: A1 |