EP4403743A1 - Controlling mesh installation - Google Patents
Controlling mesh installation Download PDFInfo
- Publication number
- EP4403743A1 EP4403743A1 EP23152074.3A EP23152074A EP4403743A1 EP 4403743 A1 EP4403743 A1 EP 4403743A1 EP 23152074 A EP23152074 A EP 23152074A EP 4403743 A1 EP4403743 A1 EP 4403743A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- mesh
- rock surface
- installation
- rig
- controller
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000009434 installation Methods 0.000 title claims abstract description 213
- 239000011435 rock Substances 0.000 claims abstract description 217
- 238000000034 method Methods 0.000 claims description 74
- 238000004590 computer program Methods 0.000 claims description 52
- 230000033001 locomotion Effects 0.000 claims description 29
- 230000015654 memory Effects 0.000 claims description 24
- 238000001514 detection method Methods 0.000 claims description 18
- 230000004044 response Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000005065 mining Methods 0.000 description 7
- 230000008901 benefit Effects 0.000 description 4
- 230000001419 dependent effect Effects 0.000 description 3
- 238000005452 bending Methods 0.000 description 2
- 238000011960 computer-aided design Methods 0.000 description 2
- 238000013523 data management Methods 0.000 description 2
- 238000011900 installation process Methods 0.000 description 2
- AWFYPPSBLUWMFQ-UHFFFAOYSA-N 2-[5-[2-(2,3-dihydro-1H-inden-2-ylamino)pyrimidin-5-yl]-1,3,4-oxadiazol-2-yl]-1-(1,4,6,7-tetrahydropyrazolo[4,3-c]pyridin-5-yl)ethanone Chemical compound C1C(CC2=CC=CC=C12)NC1=NC=C(C=N1)C1=NN=C(O1)CC(=O)N1CC2=C(CC1)NN=C2 AWFYPPSBLUWMFQ-UHFFFAOYSA-N 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000002592 echocardiography Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003019 stabilising effect Effects 0.000 description 1
- 239000003381 stabilizer Substances 0.000 description 1
- 230000008685 targeting Effects 0.000 description 1
Images
Classifications
-
- E—FIXED CONSTRUCTIONS
- E21—EARTH OR ROCK DRILLING; MINING
- E21D—SHAFTS; TUNNELS; GALLERIES; LARGE UNDERGROUND CHAMBERS
- E21D19/00—Provisional protective covers for working space
-
- E—FIXED CONSTRUCTIONS
- E21—EARTH OR ROCK DRILLING; MINING
- E21D—SHAFTS; TUNNELS; GALLERIES; LARGE UNDERGROUND CHAMBERS
- E21D11/00—Lining tunnels, galleries or other underground cavities, e.g. large underground chambers; Linings therefor; Making such linings in situ, e.g. by assembling
- E21D11/006—Lining anchored in the rock
-
- E—FIXED CONSTRUCTIONS
- E21—EARTH OR ROCK DRILLING; MINING
- E21D—SHAFTS; TUNNELS; GALLERIES; LARGE UNDERGROUND CHAMBERS
- E21D11/00—Lining tunnels, galleries or other underground cavities, e.g. large underground chambers; Linings therefor; Making such linings in situ, e.g. by assembling
- E21D11/14—Lining predominantly with metal
- E21D11/15—Plate linings; Laggings, i.e. linings designed for holding back formation material or for transmitting the load to main supporting members
- E21D11/152—Laggings made of grids or nettings
Definitions
- Various example embodiments generally relate to the field of mesh installation on a rock surface. Some example embodiments relate to determining a position for installing a mesh based on position of at least one previously installed mesh.
- a mesh installation rig may comprise one or more booms with appropriate tools for installing meshes to the rock surface. Positions of the meshes may be determined on-site by a human operator sitting in the cabin of the mesh installation rig.
- an apparatus for controlling mesh installation may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determine, based on the scanning data, a first position of the at least one first mesh; determine, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; and control installation of the second mesh on the rock surface at the second position.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: control at least one boom to place the second mesh at the second position and to mount the second mesh to the rock surface at the second position.
- mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: determine, based on the first position of the at least one first mesh and a kinematic model of a mesh installation rig, an installation position for the mesh installation rig for installing the second mesh on the rock surface at the second position; control movement of the mesh installation rig to the installation position; update the first position of the at least one first mesh and the second position of the second mesh in a coordinate system of the mesh installation rig based on the movement to the installation position.
- the apparatus comprises the mesh installation rig.
- the apparatus is configured to obtain the scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- At least two openings of the at least one first mesh and the second mesh are configured to overlap in a direction perpendicular to the edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position.
- the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- a method for controlling mesh installation may comprise: obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determining, based on the scanning data, a first position of the at least one first mesh; determining, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; and controlling installation of the second mesh on the rock surface at the second position.
- the method comprises: controlling at least one boom to place the second mesh at the second position and to mount the second mesh to the rock surface at the second position.
- the method comprises: controlling a first boom to place the second mesh at the second position; and controlling a second boom to mount the second mesh to the rock surface at the second position.
- mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- the method comprises: determining, based on the first position of the at least one first mesh and a kinematic model of a mesh installation rig, an installation position for the mesh installation rig for installing the second mesh on the rock surface at the second position; controlling movement of the mesh installation rig to the installation position; updating the first position of the at least one first mesh and the second position of the second mesh in a coordinate system of the mesh installation rig based on the movement to the installation position.
- the method is performed by the mesh installation rig.
- the method comprises: obtaining the scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- At least two openings of the at least one first mesh and the second mesh are configured to overlap in a direction perpendicular to the edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position.
- the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- an apparatus may comprise means for performing a method according to the second aspect, or any example embodiment thereof.
- a computer program or a computer program product may comprise instructions, which when executed by an apparatus, cause the apparatus perform a method according to the second aspect, or any example embodiment thereof.
- an apparatus for controlling mesh installation may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface and a second mesh positioned for being installed on the rock surface; determine, based on the scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: control adjustment of a position of the second mesh, in response to determining not to find a predetermined number of overlapping openings of the at least one first mesh and the second mesh.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: obtain re-scanning data of the rock surface to detect the overlapping openings of the at least one first mesh and the second mesh, in response to the adjustment the position of the second mesh.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: control at least one boom to position the second mesh for installing the second mesh to the rock surface and to mount the second mesh to the rock surface.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: determine the at least one position where the openings of the at least one first mesh and the second mesh overlap based on searching for the overlapping openings of the at least one first mesh and the second mesh in proximity of at least one gripping position of a first boom configured to position the second mesh for installing the second mesh to the rock surface.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: determine a plurality of positions where the openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the plurality of positions via the overlapping openings of the at least one first mesh and the second mesh in an order of increasing distance from the at least one gripping position of the first boom configured to position the second mesh for being installed to the rock surface.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: control a second boom to mount the second mesh to the rock surface.
- mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- the apparatus comprises a mesh installation rig.
- the apparatus is configured to obtain the scanning data or the re-scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser of the mesh installation rig.
- the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- a method for controlling mesh installation may comprise: obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface and a second mesh positioned for being installed on the rock surface; determining, based on the scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and controlling mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- the method comprises: controlling adjustment of a position of the second mesh, in response to determining not to find a predetermined number of overlapping openings of the at least one first mesh and the second mesh.
- the method comprises: obtaining re-scanning data of the rock surface to detect the overlapping openings of the at least one first mesh and the second mesh, in response to the adjustment the position of the second mesh.
- the method comprises: controlling at least one boom to position the second mesh for installing the second mesh to the rock surface and to mount the second mesh to the rock surface.
- the method comprises: determining the at least one position where the openings of the at least one first mesh and the second mesh overlap based on searching for the overlapping openings of the at least one first mesh and the second mesh in proximity of at least one gripping position of a first boom configured to position the second mesh for installing the second mesh to the rock surface.
- the method comprises: determining a plurality of positions where the openings of the at least one first mesh and the second mesh overlap; and controlling mounting of the second mesh to the rock surface at the plurality of positions via the overlapping openings of the at least one first mesh and the second mesh in an order of increasing distance from the at least one gripping position of the first boom configured to position the second mesh for being installed to the rock surface.
- the method comprises: controlling a second boom to mount the second mesh to the rock surface.
- mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- the method is performed by a mesh installation rig.
- the method comprises: obtaining the scanning data or the re-scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- an apparatus is disclosed.
- the apparatus may comprise means for performing a method according to the sixth aspect, or any example embodiment thereof.
- a computer program or a computer program product may comprise instructions, which when executed by an apparatus, cause the apparatus perform a method according to the sixth aspect, or any example embodiment thereof.
- an apparatus for controlling mesh installation may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determine, based on the scanning data, a first position of the at least one first mesh; determine, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the tunnel rock surface at the second position; obtain further scanning data of the rock surface to detect the at least one first mesh and the second mesh, when the second mesh is positioned for being installed on the rock surface; determine, based on the further scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the at least one position via the overlapping openings
- the computer program code is configured to, with the at least one processor, cause the apparatus to perform any example embodiment of the method of the second aspect or the sixth aspect.
- a method for controlling mesh installation may comprise: obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determining, based on the scanning data, a first position of the at least one first mesh; determining, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the tunnel rock surface at the second position; obtaining further scanning data of the rock surface to detect the at least one first mesh and the second mesh, when the second mesh is positioned for being installed on the rock surface; determining, based on the further scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and controlling mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- the method may comprise features of any example embodiment of the method of the second aspect or the sixth aspect.
- an apparatus may comprise means for performing a method according to the ninth aspect, or any example embodiment thereof.
- a computer program or a computer program product may comprise instructions, which when executed by an apparatus, cause the apparatus perform a method according to the ninth aspect, or any example embodiment thereof.
- a (non-transitory) computer readable medium may comprise program code that, when executed by an apparatus, cause the apparatus to perform a method according to the second, sixth, or ninth aspect, or any example thereof.
- FIG. 1 illustrates an example of mesh installation rig. Even though mesh installation rig 100 is illustrated as an underground mesh installation rig, example embodiments of the present disclosure may be applied also to other type of mesh installation machines, for example rigs configured for installing meshes on rock cuttings along roads or railways.
- Mesh installation rig 100 may be an automated mesh installation rig, for example an automated mining vehicle equipped with tools configured for mesh installation.
- An automated mining vehicle for example an automated mesh installation rig, operating in an automatic mode may be configured to, for example, receive a task to be performed, perceive the environment of the automated mining vehicle, and autonomously perform the task while taking the environment into account.
- An automated mining vehicle operating in an automatic mode may be configured to operate independently but may be taken under external control at certain operation areas or conditions, such as during states of emergencies. Example embodiments may be however applied also in non-autonomous or semi-autonomous mining vehicles, for example remote-controlled mining vehicles.
- axis x represents the forward driving direction of mesh installation rig 100.
- Axis z represents the vertical direction, in this example towards the roof of the tunnel.
- Mesh installation rig 100 may comprise a movable carrier 110 and at least one boom 120 connected to movable carrier 110.
- Movable carrier 110 may comprise equipment for moving or stabilising mesh installation rig 100, such as for example a motor, wheels, or stabilizer jacks.
- Movable carrier 110 may be configured to move autonomously or it may be controlled by a human operator, either remotely or locally at mesh installation rig 100.
- mesh installation rig 100 may generally comprise one or a plurality (e.g., two, three, four,...) of booms 120.
- Boom 120-1 may be referred to as a first boom.
- Boom 120-2 may be referred to as a second boom.
- a gripper 124 may be coupled to a distal end portion of boom 120-1.
- Gripper 124 may be configured to grab and hold mesh 402, for example to enable boom 120-1 to position mesh 402 at rock surface 140.
- Rock surface 140 may comprise the roof of the tunnel or at least some of the walls of the tunnel.
- a bolter 126 may be coupled to a distal end portion of boom 120-2.
- Bolter 126 may be configured to mount mesh 402 at rock surface 140. Bolting is provided as one example of mounting mesh 402 to rock surface 140, but other means for mounting, such as for example riveting, may be also used.
- Mesh installation rig 100 may comprise at least one sensor 112 for scanning environment of mesh installation rig 100, for example, rock surface 140 and any meshes already installed thereon or positioned for being installed.
- Sensor 112 may include for example one or more of the following: a camera, a radio detection and ranging (radar) sensor, or a light detection and ranging (lidar) sensor. Sensor 112 may therefore comprise a group of two or more sensors.
- Sensor 112 may be configured to scan rock surface 140, for example to detect particular features, such as edge(s), of meshes.
- Scanning rock surface 140 may comprise scanning with sensor 112 such that its sensing direction is towards rock surface 140.
- Scanning rock surface 140 does not necessarily include detecting features of rock surface 140.
- scanning rock surface 140 may comprise pointing sensor 112 towards rock surface 140 and detecting meshes installed on rock surface 140 or positioned close rock surface 140.
- a camera may be used to extract depth information of objects such as for example a mesh, for example by comparing two images taken at slightly different positions (e.g., by two camera units).
- sensor 112 may comprise a time-of-flight (ToF) camera, which may be configured to determine a distance between the camera and points of the mesh by measuring a round-trip time of an artificial light signal provided by a laser or a light-emitting diode (LED).
- a lidar sensor may be configured to determine a distance to different points of the mesh by targeting the mesh with a laser and measuring the time for the reflected light to return to a receiver of the lidar sensor.
- a radar sensor may be configured to transmit electromagnetic energy towards rock face and to observe the echoes returned from the mesh to determine distances to different points of the mesh.
- mesh installation rig 100 may obtain point cloud data that represents the scanned environment.
- the point cloud data may for example comprise three-dimensional (3D) model of a detected mesh, or at least certain features such as edge(s) of the mesh.
- a position of the mesh, or certain points such as corners or edges of the mesh may be determined based on the scanning data.
- the position of the mesh may be therefore fixed to, or known in relation to, a coordinate system of mesh installation rig 100.
- the coordinate system of mesh installation rig 100 may be stationary with respect to mesh installation rig 100.
- Mesh installation rig 100 may be configured to scan rock surface 140 during movement or while being stationary. Scanning rock surface 140 during movement may speed up the mesh installation process, because mesh installation may be initiated soon after mesh installation rig has reached the planned position (installation position) for installing the next mesh, as will be further described below. Scanning of rock surface 140 may be implemented for example with a simultaneous localization and mapping (SLAM) system, which may be configured to scan environment of mesh installation rig 100 to obtain the point cloud data of surrounding surfaces or objects. The obtained point cloud data may be used for object detection, but also for determining position of mesh installation rig 100 based on comparing the scanning data to reference data, such as for example a 3D model of a tunnel.
- SLAM simultaneous localization and mapping
- Mesh installation rig 100 may comprise a mesh controller (MC) 114.
- Mesh controller 114 may be communicatively coupled to sensor 112, for example to receive scanned sensor data from sensor 112, or, to request sensor 112 to initiate scanning of rock surface 140.
- Mesh controller 114 may be for example provided as a software application residing on a memory and being executable by a processor.
- An example of an apparatus suitable for implementing mesh controller 114 is provided in FIG. 8 .
- Mesh controller 114 may comprise, or be communicatively coupled to, various functions, blocks, or applications for implementing functionality of mesh controller 114.
- mesh controller 114 may comprise or be communicatively coupled to a data management server, which may be configured to store information on a digital meshing plan, tunnel lines, point cloud or mesh presentations of tunnel lines or profiles, a mine map point cloud, or the like.
- the digital meshing plan may comprise planned mesh positions and optionally also planned mounting positions.
- a mounting position may comprise a position at which a mesh is mounted on rock surface 140 by mounting means such as for example a bolt or a rivet.
- a planned mounting position may comprise a planned position for the mounting means at rock surface 140.
- Mesh controller 114 may comprise a navigation application configured to control, or enable a human operator to control, navigation of mesh installation rig 100, for example to move it to the planned installation position and/or to determine positions of planned mounting points of the digital meshing plan relative to a current position of mesh installation rig 100.
- Position of mesh installation rig 100 may be referred to as a navigation position.
- An installation position may be therefore a navigation position, which has been planned or determined for mesh installation rig 100 to install a mesh at rock surface 140.
- Mesh controller 114 may be configured to determine and/or maintain the digital meshing plan, a 3D model of at least one component of mesh installation rig 100 (e.g., a 3D model of boom(s) 120, gripper 124 or bolter 126), and/or a kinematic model of mesh installation rig 100, or component(s) thereof.
- a 3D model of a component of mesh installation rig 100 may comprise 3D geometry data of the component, obtained for example from a computer aided design (CAD) model of the respective physical component.
- CAD computer aided design
- a kinematic model of mesh installation rig 100, or component(s) thereof, may comprise a mathematical description of at least a part of mesh installation rig 100.
- a kinematic model may describe motion of mesh installation rig 100 or component(s) of mesh installation rig 100 without taking into account the forces that cause the motion.
- the kinematic model may be used for estimating a position of mesh installation rig 100 or component(s) of mesh installation rig 100, for example based on measurement data from one or more sensors associated with mesh installation rig 100 or motion of mesh installation rig 100 caused by given control inputs.
- the kinematic model of mesh installation rig 100 may comprise at least dimensions of mesh installation rig 100 and/or reach of mesh installation rig 100 such as a movement range of at least one boom 120 of mesh installation rig 100.
- the kinematic model may comprise information on dimensions of boom(s) 120, or parts thereof, for example gripper 124 or bolter 126, characteristics of joint(s) 122 (e.g. their degrees of freedom), constraints between moving parts of mesh installation rig 100, or the like.
- the kinematic model may thus enable modelling movement of the component(s) of mesh installation rig 100, for example to determine possible positions for installing mesh 402 from a particular installation position.
- the kinematic model may for example enable determining a maximum distance reachable by gripper 124 or bolter 126.
- the 3D model(s) of the component(s) may be provided as point cloud data indicative of the surface of the component(s).
- Point cloud data may comprise a plurality of data points representing, for example, distances between mesh installation rig 100 and its component(s) or other objects in the environment of mesh installation rig 100, for example at a particular time instance.
- An individual point included in a point cloud may be presented by, for example, x and y coordinates, or x , y, and z coordinates with respect to a particular coordinate frame.
- Mesh installation rig 100 may be controlled by a remote mesh control device 200, which may be external to mesh installation rig 100, as illustrated in FIG. 2 .
- Remote mesh control device 200 may be for example a server located remote from mesh installation rig 100, for example outside the tunnel.
- Functionality of mesh controller 114 may be distributed between mesh installation rig 100, for example a local mesh controller of mesh installation rig 100, and remote mesh control device 200.
- Information may be exchanged between remote mesh control device 200 and mesh installation rig 100 over a communication interface including any suitable wireless or wired connection. Examples of suitable communication interfaces are described with reference to FIG. 8 .
- Mesh controller 114 may be configured to determine and/or maintain the digital meshing plan.
- the 3D and kinematic model(s) of mesh installation rig 100 may be stored at mesh controller 114, for example based on pre-configuration of the models.
- mesh controller 114 may be configured to receive one or more of the models from mesh installation rig 100 or the data management server.
- Mesh controller 114 may also be configured to receive, for example from mesh installation rig 100, the scanned sensor data of sensor 112, which mesh controller 114 may be configured to use for detecting mesh(es) installed on rock surface 140 or located near rock surface 140.
- Example embodiments of the present disclosure may be thus implemented locally at mesh installation rig 100 and/or at remote mesh control device 200.
- FIG. 3 illustrates an example of a flow chart for controlling mesh installation.
- mesh controller 114 may be configured to control scanning of rock surface 140.
- Mesh controller 114 may be configured to cause scanning of rock surface 140, for example by requesting sensor 112 to initiate scanning.
- Sensor(s) 112 may be positioned such that their sensor signal(s) are configured to be directed to rock surface 140, when mesh installation rig 100 is operated near rock surface 140.
- Scanning data may comprise data captured by sensor 112 during scanning of rock surface 140.
- Mesh controller 114 may be configured to obtain the scanning data of rock surface 140, for example by receiving the scanning data from sensor 112.
- Mesh controller 114 may be however configured to process, for example select or filter, raw sensor data provided by sensor 112 to obtain the scanning data.
- mesh controller 114 may be configured to cause scanning of rock surface 140 when mesh installation rig 100 is not located at the installation position for installing the next mesh.
- mesh controller 114 may be configured to cause scanning of rock surface 140 before mesh installation rig 100 arrives at the installation position for installing the next mesh.
- Mesh controller 114 may be configured to determine the installation position based on the scanning data, which may be obtained for example while mesh installation rig is moving away from a previous installation location.
- mesh controller 114 may be configured to detect a mesh installed on rock surface 140. This mesh may be referred to as a first mesh. More than one first mesh may be detected. Mesh controller 114 may be therefore configured to detect one or a plurality of first meshes already installed on rock surface 140. Detecting the first mesh may comprise detecting distinctive features of the first mesh, such as for example edge(s) and/or corner(s) of the first mesh. Mesh controller 114 may be configured to detect the first mesh, or features thereof, for example based on applying computer vision or pattern recognition algorithms on the scanning data, for example sensor data received from sensor 112.
- mesh controller 114 may be configured to determine a position of the first mesh based on the scanning data. This position may be referred to as a first position.
- Mesh controller 114 may be configured to indicate the position of the first mesh by position(s) of distinctive feature(s) of the first mesh, for example edge(s) and/or corner(s) of the first mesh.
- mesh controller 114 may be configured to determine data (e.g., point could data) indicative of a position of an edge, for example an outer edge, or corner(s) of the first mesh.
- An outer edge may refer to an edge that is not yet located next to other meshes installed on rock surface 140. It may for example comprise an edge towards the forward driving direction (x) of mesh installation rig 100.
- Mesh controller 114 may be configured to initially provide information on the position of the first mesh with respect to the coordinate frame of mesh installation rig 100.
- Mesh controller 114 may be therefore configured to provide information on the position of the first mesh with respect to the location of mesh installation rig 100 during the scanning by sensor 112. Subsequently, after movement of mesh installation rig 100, the position of the first mesh may be updated at the coordinate frame of mesh installation rig 100 such that its position with respect to rock surface 140 remains stationary (cf. operation 306). It is also possible to perform the scanning at multiple positions. Movement of mesh installation rig 100 during the scanning may be compensated, if necessary.
- mesh installation rig 110 may be configured to provide the information on the position of the first mesh with respect to a stationary reference coordinate frame, such as for example a coordinate frame stationary with respect to rock surface 140.
- mesh controller 114 may be configured to determine an installation position for mesh installation rig 100, in order to install a next mesh.
- the next mesh subject to installation may be referred to as a second mesh.
- Installation position may refer to a position of mesh installation rig 100 and not to position of any mesh.
- Mesh controller 114 may be configured to determine the installation position at any time between installing the first mesh and stopping mesh installation rig 100 for installation of the second mesh, for example during movement of mesh installation rig.
- Mesh controller 114 may be configured to determine the installation position based on the first position of the first mesh, determined based on the scanning data, and the kinematic model of mesh installation rig 100. Based on the position of the first mesh and the kinematic model, mesh controller 114 may be configured to determine a position from which mesh installation rig 100 is able to reach the edge of the first mesh, for example such that desired overlapping of the first and second meshes may be achieved. When the first and second mesh overlap, they may occupy or cover the same area of rock surface 140.
- Mesh controller 114 may be for example configured to determine the installation position based on dimension(s) of boom 120-1, and optionally a position for gripping mesh 402 by gripper 124.
- Mesh controller 114 may be configured to determine the installation position such that mesh installation rig 100 is enabled to place mesh 402 (cf. second mesh) with a desired overlap with already installed mesh(es) (cf. first mesh).
- Mesh controller 114 may be configured to determine the installation position based on dimension(s) of boom 120-2 (e.g., including bolter 126) such that mounting mesh 402 at the desired position by bolter 126 is enabled.
- mesh controller 114 may be configured to control movement of mesh installation rig 100 to the installation position. Controlling movement of mesh installation rig 100 may comprise controlling driving direction, speed, and/or orientation of mesh installation rig 100. Controlling movement of mesh installation rig may comprise determining a position of mesh installation rig 100. For example, mesh controller 114 may be configured to determine that mesh installation rig 100 has reached the installation position. Mesh controller 114 may be configured to control movement of mesh installation rig 100 autonomously or based on instructions received from a human operator, either locally or remotely.
- mesh controller 114 may be configured to update coordinates for installing the second mesh. Since mesh installation rig 100 may have moved from the position(s) at which the first mesh was detected by scanning, mesh controller 114 may be configured to update the position of the first mesh (first position), in the coordinate system of mesh installation rig 100 based on the movement from the scanning position(s) to the installation position.
- mesh controller 114 may be configured to determine a position for installing the second mesh on rock surface 140. This position may be referred to as a second position and it may refer to a position of the second mesh on rock surface 140.
- Mesh controller 114 may be configured to determine the second position such that the first mesh and the second mesh overlap, for example at an edge of the first mesh, subsequent to installation of the second mesh on rock surface 140 at the second position. This enables to prevent rocks falling from rock surface 140 and thereby increases safety and reduces the risk of damage to mesh installation rig 100.
- Mesh controller 114 may be configured to determine the second position based on the first position of the first mesh.
- FIG. 4 illustrates an example of overlapping meshes.
- mesh controller 114 may determine position of mesh 401 (as the second mesh) such that meshes 404 and 401 overlap in direction x after installation of mesh 401. Meshes 404 and 401 may overlap at an edge of mesh 404.
- mesh controller 114 may determine position of mesh 402 (as the second mesh) such that meshes 401 and 402 overlap in direction y after installation of mesh 402. Meshes 401 and 402 may overlap at an edge of mesh 401.
- the overlap between the meshes is slightly more than one mesh opening (mesh eye).
- the amount of overlapping may be however larger, for example more than two (e.g. 2-4) mesh openings. Overlap of 2-4 mesh openings sufficiently prevents rocks from falling from rock surface 140, while not causing excessive extra cost.
- the amount of overlapping may be defined with respect to a direction perpendicular to the edge of the already installed mesh, for example direction x when installing mesh 401 such that it overlaps with mesh 404 and direction y when installing mesh 402 such that it overlaps with mesh 401.
- FIG. 5 illustrates an example of meshes installed on a tunnel surface based on a digital meshing plan.
- FIG. 5 illustrates a cross-sectional view of a tunnel along the yz -plane (left) and also an example of a digital meshing plan (right) for the tunnel surface viewed from above roof 140-1 and from outside of right wall 140-3 of the tunnel.
- rock surface 140 comprises a tunnel surface, for example roof 140-1 and/or wall(s) 140-2, 140-3 of the tunnel.
- Mesh controller 114 may be configured to determine positions for the meshes based on the digital meshing plan, which may comprise planned mesh positions. Planned positions for meshes 401 to 406 are illustrated on the right.
- the digital meshing plan may comprise planned mounting positions 501 represented by the black dots.
- mesh controller 114 may be configured to initially use the respective position included in the digital meshing plan.
- the planned position might not provide sufficient overlap in practise.
- mounting the mesh at the planned mounting positions is not possible, for example due to mesh wire(s) being located at the planned mounting positions. Based on scanning of rock surface 140 and detecting the already installed mesh(es), it is possible to provide sufficient overlap and to find suitable mounting position.
- the meshes may be installed starting from the roof, for example from the highest point of roof 140-1, and moving down along the tunnel surface such that meshes located on wall 104-2, for example mesh 403, are installed after meshes located on roof 140-1, for example mesh 401 and mesh 402.
- This enables to keep rocks falling from roof 140-1 behind the meshes.
- the first mesh e.g., mesh 402
- the second mesh e.g., mesh 403
- a wall 140-2, 140-3 of the tunnel may comprise a portion of the tunnel surface for which the inclination angle ⁇ from axis y is below a threshold, for example less than 45°.
- Roof 140-1 of the tunnel may comprise a portion of the tunnel surface for which the inclination angle ⁇ from axis y is above the threshold, for example greater than 45°.
- mesh controller 114 may be configured to control installation of the second mesh to rock surface 140.
- mesh controller 114 may be configured to control movement of at least one boom, for example booms 120-1, 120-2 and their respective tools, to cause placement of the second mesh at the determined second position and to mount the second mesh at rock surface 140 at this position.
- An example of a method for controlling installation of the second mesh is provided in FIG. 6 .
- mesh controller 114 may be configured to cause movement of mesh installation rig 100 at a planned installation position before scanning rock surface 140 to detect the first mesh.
- Mesh controller 114 may be for example configured to control movement of mesh installation rig for example based on the digital mesh plan. In this case, it might not be necessary to update coordinate(s) (cf. operation 306) of the first mesh before determining the position of the second mesh (cf. operation 307), if mesh installation rig 100 does not move between scanning the first mesh and installation of the second mesh.
- mesh controller 114 may be configured to determine the position for the second mesh (cf. operation 307) before mesh installation rig 100 moves to the installation position. In this case, mesh controller 114 may be configured to update both coordinates of the first mesh and the second mesh based on the movement of mesh installation rig 100 to its installation position.
- FIG. 6 illustrates an example of a flow chart for controlling mesh installation via overlapping openings of first and second meshes.
- the flow chart of FIG. 6 may be used for implementing operation 308 of FIG. 3 . Based on this flow chart it is however possible to implement a stand-alone method for controlling mounting of the second mesh at or near a predetermined location.
- mesh controller 114 may be configured to control positioning of the second mesh for installation at rock surface 140.
- mesh controller 114 may be configured to control at least one boom, for example boom 120-1 comprising gripper 124, to position the second mesh for being installed on rock surface 140.
- Mesh controller 114 may be configured to determine the position of the second mesh based on the digital meshing plan and/or scanning of the rock surface, for example as described with reference to FIG. 3 .
- mesh controller 114 may be configured to control scanning of rock surface 140, similar to operation 301. However, mesh controller 114 may be configured to cause rock surface 140 to be scanned when the second mesh has been positioned for installation. Mesh controller 114 may therefore configured to obtain scanning data of rock surface 140, in order to detect the first mesh(es) installed on rock surface 140 and the second mesh positioned for being installed on rock surface 140. When combined with operations of FIG. 3 , this scanning data may comprise further scanning data in addition to the scanning data obtained at operation 301.
- mesh controller 114 may be configured to determine whether overlapping opening(s) of the first mesh and the second mesh are detected.
- Mesh controller 114 may be configured to use any suitable method for this, including, but not limited to, machine-vision-based algorithm(s).
- Mesh controller 114 may be configured to determine whether a predetermined number of overlapping opening(s) exist. The predetermined number may comprise a positive integer, for example one, two, three, five, ten, or any integer within the range of 1 to 10.
- Mesh controller 114 may be configured to determine, in response to detecting overlapping opening(s), or the predetermined number of openings, one or more overlapping openings for mounting the second mesh to rock surface 140.
- Mesh controller 114 may be configured to determine the overlapping opening(s) for mounting the second mesh based on selecting particular overlapping openings from the detected overlapping openings, for example based on their distance(s) to the planned mounting positions 501 of the digital meshing plan. Determining the overlapping opening(s) may therefore comprise selecting a subset of the detected openings for mounting the second mesh on rock surface 140.
- Mesh controller 114 may be for example configured to select, for mounting the second mesh, overlapping opening(s) that are closest to the mounting position(s) of the digital meshing plan.
- Mesh controller 114 may be configured to determine, based on the scanning data of rock surface 114, position(s) where openings of the first and second meshes overlap. Mesh controller 114 may be configured to determine the position(s) with respect to the coordinate frame of mesh installation rig 100.
- Determining the overlapping openings by mesh controller 114 may be based on searching for the overlapping openings of the first and the second meshes in proximity of gripping position(s) of boom 120-1, which may be configured to position the second mesh for installing the second mesh to rock surface 140. This improves detection of the overlapping openings, because the distance between the first and second meshes along an axis perpendicular to rock surface 140 is generally smaller close the gripping position(s) due to bending of the second mesh.
- Mesh controller 114 may be for example configured to search for the overlapping openings within a threshold distance from the gripping position(s) or a threshold number of mesh openings.
- the threshold distance may be dependent on thickness of the mesh wires and size (e.g., width or diameter) of the mesh openings.
- the threshold number of mesh openings may be dependent on the thickness of the mesh wire.
- the thickness of the mesh wires may be for example 10 mm.
- the threshold distance may be for example 50 cm or 1 m.
- the width of the mesh opening may be for example 10 cm or 15 cm.
- the threshold number of mesh openings may be for example 6-10 openings.
- Mesh controller 114 may be configured to move to execution of operation 604 in response to detecting overlapping openings, or the predetermined number thereof.
- Mesh controller 114 may be configured to move to execution of operation 605 in response to not detecting overlapping openings, or the predetermined number thereof.
- Detecting overlapping openings may be subject to detecting overlapping openings at suitable positions, for example with respect to the digital meshing plan or kinematic model of mesh installation rig 100, for example boom 120-2 and/or bolter 126. Detecting overlapping openings may be subject to determining that the openings overlap at least to a predetermined extent, for example such that mounting to rock surface 140 is enabled via the overlapping portions of the openings.
- FIG. 7 illustrates an example of first and second meshes with overlapping openings.
- mesh 401 has been installed previously and mesh installation rig 100 has positioned mesh 404 with gripper 124 for mounting on rock surface 140.
- gripper 124 has been illustrated by the black dots.
- Mesh controller 114 may be configured to determine positions of a plurality of overlapping openings 701, 702, 703, for example by first searching in proximity of the gripping positions, for example within distance d to find position 701 and thereafter extending the search range to find positions 702 and 703.
- Distance d may be predetermined, for example preconfigured at mesh controller 114, or determined by mesh controller 114 by other means, for example based on properties of the first and/or second mesh (e.g., size of mesh openings).
- the positions of the overlapping openings may be determined such that they are located close to, e.g., within another threshold distance, the planned mounting positions 501 of the digital meshing plan.
- mesh controller 114 may be configured to control mounting of the second mesh to rock surface 140. Controlling the mounting of the second mesh may comprise causing mesh installation rig 100 to mount the second mesh at rock surface 140. Controlling the mounting of the second mesh may comprise determining an order of mounting positions or a mounting rate (e.g., in bolts/min). Controlling the mounting of the second mesh may comprise causing mesh installation rig 100 to mount the second mesh to rock surface 140 according to the determined order of mounting positions or the mounting rate.
- Mesh controller 114 may be configured to control mesh installation rig 100 based on the determined positions and detected overlapping openings such that the second mesh is mounted to rock surface 140 at the determined positions(s) via the overlapping openings of the first and second meshes.
- mesh controller 114 may be configured to cause boom 120-2 to mount (e.g., by bolting) the second mesh at rock surface 140. Mounting the second mesh may cause also the first mesh to be mounted at the determined positions, in addition to positions at which the first mesh was mounted earlier.
- Mesh controller 114 may be configured to control mounting of the second mesh to rock surface 140 via the overlapping openings such that the second mesh is mounted to rock surface 140 in an order of increasing distance from the gripping position(s) of boom 120-1. This makes the mounting easier, because the distance between the first and second meshes is generally smaller in proximity of the gripping position(s).
- mesh controller 114 may be configured to control boom 120-2 to first cause mesh 404 to be mounted at position 701, which is closest to the gripping positions of gripper 124.
- Mesh controller 114 may be configured to next control boom 120-2 to cause mesh 404 to be mounted at position 702. Mounting the second mesh at position 702 decreases the distance between meshes 401 and 404 at position 703, which makes it easier to subsequently mount mesh 404 at position 703.
- mesh controller 114 may be configured to control adjustment of the position of the second mesh. Mesh controller 114 may perform this in response to determining (cf. operation 603) not to find overlapping openings, for example the predetermined number of them, of first and second meshes. For example, mesh controller 114 may be configured to control boom 120-1 and/or gripper 124 to adjust the position of the second mesh. The adjustment may be preconfigured, for example a preconfigured distance to a preconfigured direction, or determined by mesh controller 114 based on the scanning data. Adjusting the position of the second mesh increases the probability of finding suitable overlapping openings for mounting the second mesh to rock surface 140.
- mesh controller 114 may be configured to move back to execution of operation 602, where mesh controller 114 may be configured to control re-scanning of rock surface 140 in order to obtain re-scanning data. Based on the re-scanning data, mesh controller 114 may be configured to determine whether there are overlapping openings (operation 603), control mounting of the second mesh (operation 604), and/or control a further adjustment of the position of the second mesh (operation 605).
- the potentially iterative approach enables to find suitable positions for mounting the second mesh at rock surface 140. This enables to speed up the installation process and to save energy because suitable mounting positions may be determined in advance, without actually trying to mount the second mesh at unsuitable positions, for example with bolter 126.
- FIG. 8 illustrates an example of an apparatus configured to practise one or more example embodiments.
- Apparatus 800 may be or comprise a mesh control apparatus, such as for example a server, communicatively coupled to mesh installation rig 100, a mesh control apparatus located at mesh installation rig 100, mesh controller 114, mesh installation rig 100 itself, or in general any device or system configured to implement the functionality described herein.
- apparatus 800 is illustrated as a single device, it is appreciated that, wherever applicable, functions of apparatus 800 may be distributed to a plurality of devices.
- Apparatus 800 may comprise at least one processor 802.
- the at least one processor 802 may comprise, for example, one or more of various processing devices, such as for example a co-processor, a microprocessor, a controller, a digital signal processor (DSP), a processing circuitry with or without an accompanying DSP, or various other processing devices including integrated circuits such as, for example, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a microcontroller unit (MCU), a hardware accelerator, a special-purpose computer chip, or the like.
- various processing devices such as for example, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a microcontroller unit (MCU), a hardware accelerator, a special-purpose computer chip, or the like.
- ASIC application specific integrated circuit
- FPGA field programmable gate array
- MCU microcontroller unit
- hardware accelerator a special-purpose computer chip, or the like.
- Apparatus 800 may further comprise at least one memory 804.
- the at least one memory 804 may be configured to store, for example, computer program code or the like, for example operating system software and application software.
- the at least one memory 804 may comprise one or more volatile memory devices, one or more non-volatile memory devices, and/or a combination thereof.
- the memory may be embodied as magnetic storage devices (such as hard disk drives, etc.), optical magnetic storage devices, or semiconductor memories (such as mask ROM, PROM (programmable ROM), EPROM (erasable PROM), flash ROM, RAM (random access memory), etc.).
- Memory 804 is provided as an example of a (non-transitory) computer readable medium.
- non-transitory is a limitation of the medium itself (i.e., tangible, not a signal ) as opposed to a limitation on data storage persistency (e.g., RAM vs. ROM).
- the at least one memory 804 may be also embodied separate from apparatus 800, for example as a computer readable (storage) medium, examples of which include memory sticks, compact discs (CD), or the like.
- apparatus 800 When apparatus 800 is configured to implement some functionality, some component and/or components of apparatus 800, such as for example the at least one processor 802 and/or the at least one memory 804, may be configured to implement this functionality. Furthermore, when the at least one processor 802 is configured to implement some functionality, this functionality may be implemented using program code 806 comprised, for example, in the at least one memory 804.
- apparatus 800 comprises a processor or processor circuitry, such as for example a microcontroller, configured by the program code 806, when executed, to execute the embodiments of the operations and functionality described herein.
- Program code 806 is provided as an example of instructions which, when executed by the at least one processor 802, cause performance of apparatus 800.
- mesh controller 114 may be at least partially implemented as program code configured to cause apparatus 800 to perform functionality of mesh controller 114.
- transmission or reception of data e.g. sensor data, kinematic model(s), or the digital meshing plan
- data e.g. sensor data, kinematic model(s), or the digital meshing plan
- the functionality described herein can be performed, at least in part, by one or more hardware logic components.
- illustrative types of hardware logic components include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip systems (SOCs), complex programmable logic devices (CPLDs), graphics processing units (GPUs), neural processing unit (NPU), tensor processing unit (TPU), or the like.
- Apparatus 800 may comprise a communication interface 808 configured to enable apparatus 800 to transmit and/or receive information.
- Communication interface 808 may comprise an internal or external communication interface, such as for example a radio interface between mesh installation rig 100 and remote mesh control device 200.
- Apparatus 800 may further comprise other components and/or functions such as for example a user interface (not shown) comprising at least one input device and/or at least one output device.
- the input device may take various forms such as a keyboard, a touch screen, or one or more embedded control buttons.
- the output device may for example comprise a display, a speaker, or the like.
- the user interface may enable a human operator to monitor various functions and data, such as for example the digital meshing plan, or the like.
- Apparatus 800 may be configured to perform or cause performance of any aspect of the method(s) described herein.
- a computer program or a computer program product may comprise instructions for causing, when executed by apparatus 800, apparatus 800 to perform any aspect of the method(s) described herein.
- apparatus 800 may comprise means for performing any aspect of the method(s) described herein.
- the means comprises the at least one processor 802, the at least one memory 804 including program code 806 (instructions) configured to, when executed by the at least one processor 802, cause apparatus 800 to perform the method(s).
- computer program instructions may be executed on means providing generic processing functions. Such means may be embedded for example in a computer, a server, or the like.
- Apparatus 800 may comprise means for transmitting or receiving information, for example one or more wired of wireless (e.g. radio) transmitters or receivers, which may be coupled or be configured to be coupled to one or more antennas, or transmitter(s) or receiver(s) of a wired communication interface.
- wireless e.g. radio
- apparatus 800 may be configured for controlling mesh installation.
- the apparatus may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determine, based on the scanning data, a first position of the at least one first mesh; determine, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; and control installation of the second mesh on the rock surface at the second position.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: control at least one boom to place the second mesh at the second position and to mount the second mesh to the rock surface at the second position.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: control a first boom to place the second mesh at the second position; and control a second boom to mount the second mesh to the rock surface at the second position.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: determine, based on the first position of the at least one first mesh and a kinematic model of a mesh installation rig, an installation position for the mesh installation rig for installing the second mesh on the rock surface at the second position; control movement of the mesh installation rig to the installation position; update the first position of the at least one first mesh and the second position of the second mesh in a coordinate system of the mesh installation rig based on the movement to the installation position.
- the apparatus comprises the mesh installation rig.
- the apparatus is configured to obtain the scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- At least two openings of the at least one first mesh and the second mesh are configured to overlap in a direction perpendicular to the edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position.
- the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- apparatus 800 may be configured for controlling mesh installation.
- the apparatus may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface and a second mesh positioned for being installed on the rock surface; determine, based on the scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: control adjustment of a position of the second mesh, in response to determining not to find a predetermined number of overlapping openings of the at least one first mesh and the second mesh.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: obtain re-scanning data of the rock surface to detect the overlapping openings of the at least one first mesh and the second mesh, in response to the adjustment the position of the second mesh.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: control at least one boom to position the second mesh for installing the second mesh to the rock surface and to mount the second mesh to the rock surface.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: determine a plurality of positions where the openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the plurality of positions via the overlapping openings of the at least one first mesh and the second mesh in an order of increasing distance from the at least one gripping position of the first boom configured to position the second mesh for being installed to the rock surface.
- the computer program code is configured to, with the at least one processor, cause the apparatus to: control a second boom to mount the second mesh to the rock surface.
- mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- the apparatus is configured to obtain the scanning data or the re-scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- FIG. 9 illustrates an example of a method for controlling mesh installation.
- the method may comprise a computer-implemented method performed by, for example, apparatus 800 such as mesh controller 114.
- the method may comprise obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface.
- the method may comprise determining, based on the scanning data, a first position of the at least one first mesh.
- the method may comprise determining, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position.
- the method may comprise controlling installation of the second mesh on the rock surface at the second position
- FIG. 10 illustrates another example of another a method for controlling mesh installation.
- the method may comprise a computer-implemented method performed by, for example, apparatus 800 such as mesh controller 114.
- the method may comprise obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface and a second mesh positioned for being installed on the rock surface.
- the method may comprise determining, based on the scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap.
- the method may comprise controlling mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- FIG. 11 illustrates yet another example of a method for controlling mesh installation.
- the method may comprise a computer-implemented method performed by, for example, apparatus 800 such as mesh controller 114.
- the method may comprise obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface.
- the method may comprise determining, based on the scanning data, a first position of the at least one first mesh.
- the method may comprise determining, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the tunnel rock surface at the second position.
- the method may comprise obtaining further scanning data of the rock surface to detect the at least one first mesh and the second mesh, when the second mesh is positioned for being installed on the rock surface.
- the method may comprise determining, based on the further scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap.
- the method may comprise controlling mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- the method(s) may be performed by mesh controller 114, mesh installation rig 100, or remote mesh control device 200, for example based on program code 806, when executed by processor 802.
- Various examples of the methods are explained above with regard to functionalities of mesh controller 114, mesh installation rig 100, and/or remote mesh control device 200, and are therefore not repeated here. It should be understood that example embodiments described may be combined in different ways unless explicitly disallowed.
Landscapes
- Engineering & Computer Science (AREA)
- Mining & Mineral Resources (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Life Sciences & Earth Sciences (AREA)
- Geochemistry & Mineralogy (AREA)
- Geology (AREA)
- Architecture (AREA)
- Civil Engineering (AREA)
- Structural Engineering (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Example embodiments generally relate to the field of mesh installation on a rock surface (140). An apparatus (100) may obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determine, based on the scanning data, a first position of the at least one first mesh (404); determine, a second position for installing a second mesh (401, 402) on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; and control installation of the second mesh on the rock surface at the second position.
Description
- Various example embodiments generally relate to the field of mesh installation on a rock surface. Some example embodiments relate to determining a position for installing a mesh based on position of at least one previously installed mesh.
- In various applications, such as for example underground mining, it may be desired to protect equipment or people from rocks falling from a rock surface. This may be done for example by installing protective meshes on the rock surface. A mesh installation rig may comprise one or more booms with appropriate tools for installing meshes to the rock surface. Positions of the meshes may be determined on-site by a human operator sitting in the cabin of the mesh installation rig.
- This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
- According to a first aspect, an apparatus for controlling mesh installation is disclosed. The apparatus may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determine, based on the scanning data, a first position of the at least one first mesh; determine, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; and control installation of the second mesh on the rock surface at the second position.
- According to an example embodiment of the first aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control at least one boom to place the second mesh at the second position and to mount the second mesh to the rock surface at the second position.
- According to an example embodiment of the first aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control a first boom to place the second mesh at the second position; and control a second boom to mount the second mesh to the rock surface at the second position.
- According to an example embodiment of the first aspect, mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- According to an example embodiment of the first aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: determine, based on the first position of the at least one first mesh and a kinematic model of a mesh installation rig, an installation position for the mesh installation rig for installing the second mesh on the rock surface at the second position; control movement of the mesh installation rig to the installation position; update the first position of the at least one first mesh and the second position of the second mesh in a coordinate system of the mesh installation rig based on the movement to the installation position.
- According to an example embodiment of the first aspect, the apparatus comprises the mesh installation rig.
- According to an example embodiment of the first aspect, the apparatus is configured to obtain the scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- According to an example embodiment of the first aspect, at least two openings of the at least one first mesh and the second mesh are configured to overlap in a direction perpendicular to the edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position.
- According to an example embodiment of the first aspect, the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- According to a second aspect, a method for controlling mesh installation is disclosed. The method may comprise: obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determining, based on the scanning data, a first position of the at least one first mesh; determining, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; and controlling installation of the second mesh on the rock surface at the second position.
- According to an example embodiment of the second aspect, the method comprises: controlling at least one boom to place the second mesh at the second position and to mount the second mesh to the rock surface at the second position.
- According to an example embodiment of the second aspect, the method comprises: controlling a first boom to place the second mesh at the second position; and controlling a second boom to mount the second mesh to the rock surface at the second position.
- According to an example embodiment of the second aspect, mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- According to an example embodiment of the second aspect, the method comprises: determining, based on the first position of the at least one first mesh and a kinematic model of a mesh installation rig, an installation position for the mesh installation rig for installing the second mesh on the rock surface at the second position; controlling movement of the mesh installation rig to the installation position; updating the first position of the at least one first mesh and the second position of the second mesh in a coordinate system of the mesh installation rig based on the movement to the installation position.
- According to an example embodiment of the second aspect, the method is performed by the mesh installation rig.
- According to an example embodiment of the second aspect, the method comprises: obtaining the scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- According to an example embodiment of the second aspect, at least two openings of the at least one first mesh and the second mesh are configured to overlap in a direction perpendicular to the edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position.
- According to an example embodiment of the second aspect, the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- According to a third aspect, an apparatus is disclosed. The apparatus may comprise means for performing a method according to the second aspect, or any example embodiment thereof.
- According to a fourth aspect, a computer program or a computer program product is disclosed. The computer program or computer program product may comprise instructions, which when executed by an apparatus, cause the apparatus perform a method according to the second aspect, or any example embodiment thereof.
- According to a fifth aspect, an apparatus for controlling mesh installation is disclosed. The apparatus may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface and a second mesh positioned for being installed on the rock surface; determine, based on the scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control adjustment of a position of the second mesh, in response to determining not to find a predetermined number of overlapping openings of the at least one first mesh and the second mesh.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: obtain re-scanning data of the rock surface to detect the overlapping openings of the at least one first mesh and the second mesh, in response to the adjustment the position of the second mesh.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control at least one boom to position the second mesh for installing the second mesh to the rock surface and to mount the second mesh to the rock surface.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: determine the at least one position where the openings of the at least one first mesh and the second mesh overlap based on searching for the overlapping openings of the at least one first mesh and the second mesh in proximity of at least one gripping position of a first boom configured to position the second mesh for installing the second mesh to the rock surface.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: determine a plurality of positions where the openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the plurality of positions via the overlapping openings of the at least one first mesh and the second mesh in an order of increasing distance from the at least one gripping position of the first boom configured to position the second mesh for being installed to the rock surface.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control a second boom to mount the second mesh to the rock surface.
- According to an example embodiment of the fifth aspect, mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- According to an example embodiment of the fifth aspect, the apparatus comprises a mesh installation rig.
- According to an example embodiment of the fifth aspect, the apparatus is configured to obtain the scanning data or the re-scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser of the mesh installation rig.
- According to an example embodiment of the fifth aspect, the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- According to a sixth aspect, a method for controlling mesh installation is disclosed. The method may comprise: obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface and a second mesh positioned for being installed on the rock surface; determining, based on the scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and controlling mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- According to an example embodiment of the sixth aspect, the method comprises: controlling adjustment of a position of the second mesh, in response to determining not to find a predetermined number of overlapping openings of the at least one first mesh and the second mesh.
- According to an example embodiment of the sixth aspect, the method comprises: obtaining re-scanning data of the rock surface to detect the overlapping openings of the at least one first mesh and the second mesh, in response to the adjustment the position of the second mesh.
- According to an example embodiment of the sixth aspect, the method comprises: controlling at least one boom to position the second mesh for installing the second mesh to the rock surface and to mount the second mesh to the rock surface.
- According to an example embodiment of the sixth aspect, the method comprises: determining the at least one position where the openings of the at least one first mesh and the second mesh overlap based on searching for the overlapping openings of the at least one first mesh and the second mesh in proximity of at least one gripping position of a first boom configured to position the second mesh for installing the second mesh to the rock surface.
- According to an example embodiment of the sixth aspect, the method comprises: determining a plurality of positions where the openings of the at least one first mesh and the second mesh overlap; and controlling mounting of the second mesh to the rock surface at the plurality of positions via the overlapping openings of the at least one first mesh and the second mesh in an order of increasing distance from the at least one gripping position of the first boom configured to position the second mesh for being installed to the rock surface.
- According to an example embodiment of the sixth aspect, the method comprises: controlling a second boom to mount the second mesh to the rock surface.
- According to an example embodiment of the sixth aspect, mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- According to an example embodiment of the sixth aspect, the method is performed by a mesh installation rig.
- According to an example embodiment of the sixth aspect, the method comprises: obtaining the scanning data or the re-scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- According to an example embodiment of the sixth aspect, the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- According to a seventh aspect, an apparatus is disclosed. The apparatus may comprise means for performing a method according to the sixth aspect, or any example embodiment thereof.
- According to an eighth aspect, a computer program or a computer program product is disclosed. The computer program or computer program product may comprise instructions, which when executed by an apparatus, cause the apparatus perform a method according to the sixth aspect, or any example embodiment thereof.
- According to a ninth aspect, an apparatus for controlling mesh installation is disclosed. The apparatus may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determine, based on the scanning data, a first position of the at least one first mesh; determine, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the tunnel rock surface at the second position; obtain further scanning data of the rock surface to detect the at least one first mesh and the second mesh, when the second mesh is positioned for being installed on the rock surface; determine, based on the further scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- According to an example embodiment of the ninth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to perform any example embodiment of the method of the second aspect or the sixth aspect.
- According to a tenth aspect, a method for controlling mesh installation is disclosed. The method may comprise: obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determining, based on the scanning data, a first position of the at least one first mesh; determining, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the tunnel rock surface at the second position; obtaining further scanning data of the rock surface to detect the at least one first mesh and the second mesh, when the second mesh is positioned for being installed on the rock surface; determining, based on the further scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and controlling mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- According to an example embodiment of the tenth aspect, the method may comprise features of any example embodiment of the method of the second aspect or the sixth aspect.
- According to an eleventh aspect, an apparatus is disclosed. The apparatus may comprise means for performing a method according to the ninth aspect, or any example embodiment thereof.
- According to a twelfth aspect, a computer program or a computer program product is disclosed. The computer program or computer program product may comprise instructions, which when executed by an apparatus, cause the apparatus perform a method according to the ninth aspect, or any example embodiment thereof.
- According to a thirteenth aspect, a (non-transitory) computer readable medium is disclosed. The (non-transitory) computer readable medium may comprise program code that, when executed by an apparatus, cause the apparatus to perform a method according to the second, sixth, or ninth aspect, or any example thereof.
- According to some aspects, there is provided the subject matter of the independent claims. Some further aspects are defined in the dependent claims. Many of the attendant features will be more readily appreciated as they become better understood by reference to the following description considered in connection with the accompanying drawings.
- The accompanying drawings, which are included to provide a further understanding of the example embodiments and constitute a part of this specification, illustrate example embodiments and, together with the description, help to explain the example embodiments. In the drawings:
-
FIG. 1 illustrates an example of a mesh installation rig; -
FIG. 2 illustrates an example of a mesh installation rig communicatively coupled to a remote mesh control device; -
FIG. 3 illustrates an example of a flow chart for controlling mesh installation; -
FIG. 4 illustrates an example of overlapping meshes; -
FIG. 5 illustrates an example of meshes installed on a tunnel surface based on a digital meshing plan; -
FIG. 6 illustrates an example of a flow chart for controlling mesh installation via overlapping openings of first and second meshes; -
FIG. 7 illustrates an example of first and second meshes with overlapping openings; -
FIG. 8 illustrates an example of an apparatus configured to practise one or more example embodiments; -
FIG. 9 illustrates an example of a method for controlling mesh installation; -
FIG. 10 illustrates another example of a method for controlling mesh installation; and -
FIG. 11 illustrates yet another example of a method for controlling mesh installation. - Like references are used to designate like parts in the accompanying drawings.
- Reference will now be made to embodiments, examples of which are illustrated in the accompanying drawings. The description provided below in connection with the appended drawings is intended as a description of the present examples and is not intended to represent the only forms in which the present example may be constructed or utilized. The description sets forth the functions of the example and the sequence of steps for constructing and operating the example. However, the same or equivalent functions and sequences may be accomplished by different examples.
-
FIG. 1 illustrates an example of mesh installation rig. Even thoughmesh installation rig 100 is illustrated as an underground mesh installation rig, example embodiments of the present disclosure may be applied also to other type of mesh installation machines, for example rigs configured for installing meshes on rock cuttings along roads or railways. -
Mesh installation rig 100 may be an automated mesh installation rig, for example an automated mining vehicle equipped with tools configured for mesh installation. An automated mining vehicle, for example an automated mesh installation rig, operating in an automatic mode may be configured to, for example, receive a task to be performed, perceive the environment of the automated mining vehicle, and autonomously perform the task while taking the environment into account. An automated mining vehicle operating in an automatic mode may be configured to operate independently but may be taken under external control at certain operation areas or conditions, such as during states of emergencies. Example embodiments may be however applied also in non-autonomous or semi-autonomous mining vehicles, for example remote-controlled mining vehicles. - In the example of
FIG. 1 , axis x represents the forward driving direction ofmesh installation rig 100. Axis z represents the vertical direction, in this example towards the roof of the tunnel.Mesh installation rig 100 may comprise amovable carrier 110 and at least one boom 120 connected tomovable carrier 110.Movable carrier 110 may comprise equipment for moving or stabilisingmesh installation rig 100, such as for example a motor, wheels, or stabilizer jacks.Movable carrier 110 may be configured to move autonomously or it may be controlled by a human operator, either remotely or locally atmesh installation rig 100. Even though two booms 120-1, 120-2 have been illustrated inFIG. 1 ,mesh installation rig 100 may generally comprise one or a plurality (e.g., two, three, four,...) of booms 120. Boom 120-1 may be referred to as a first boom. Boom 120-2 may be referred to as a second boom. - A
gripper 124 may be coupled to a distal end portion of boom 120-1.Gripper 124 may be configured to grab and holdmesh 402, for example to enable boom 120-1 to positionmesh 402 atrock surface 140.Rock surface 140 may comprise the roof of the tunnel or at least some of the walls of the tunnel. Abolter 126 may be coupled to a distal end portion of boom 120-2.Bolter 126 may be configured to mountmesh 402 atrock surface 140. Bolting is provided as one example of mountingmesh 402 torock surface 140, but other means for mounting, such as for example riveting, may be also used. -
Mesh installation rig 100 may comprise at least onesensor 112 for scanning environment ofmesh installation rig 100, for example,rock surface 140 and any meshes already installed thereon or positioned for being installed.Sensor 112 may include for example one or more of the following: a camera, a radio detection and ranging (radar) sensor, or a light detection and ranging (lidar) sensor.Sensor 112 may therefore comprise a group of two or more sensors.Sensor 112 may be configured to scanrock surface 140, for example to detect particular features, such as edge(s), of meshes. Scanningrock surface 140 may comprise scanning withsensor 112 such that its sensing direction is towardsrock surface 140. Scanningrock surface 140 does not necessarily include detecting features ofrock surface 140. For example, scanningrock surface 140 may comprise pointingsensor 112 towardsrock surface 140 and detecting meshes installed onrock surface 140 or positionedclose rock surface 140. - A camera may be used to extract depth information of objects such as for example a mesh, for example by comparing two images taken at slightly different positions (e.g., by two camera units). Alternatively,
sensor 112 may comprise a time-of-flight (ToF) camera, which may be configured to determine a distance between the camera and points of the mesh by measuring a round-trip time of an artificial light signal provided by a laser or a light-emitting diode (LED). A lidar sensor may be configured to determine a distance to different points of the mesh by targeting the mesh with a laser and measuring the time for the reflected light to return to a receiver of the lidar sensor. A radar sensor may be configured to transmit electromagnetic energy towards rock face and to observe the echoes returned from the mesh to determine distances to different points of the mesh. Based on scanning,mesh installation rig 100 may obtain point cloud data that represents the scanned environment. The point cloud data may for example comprise three-dimensional (3D) model of a detected mesh, or at least certain features such as edge(s) of the mesh. A position of the mesh, or certain points such as corners or edges of the mesh, may be determined based on the scanning data. The position of the mesh may be therefore fixed to, or known in relation to, a coordinate system ofmesh installation rig 100. The coordinate system ofmesh installation rig 100 may be stationary with respect to meshinstallation rig 100. -
Mesh installation rig 100 may be configured to scanrock surface 140 during movement or while being stationary. Scanningrock surface 140 during movement may speed up the mesh installation process, because mesh installation may be initiated soon after mesh installation rig has reached the planned position (installation position) for installing the next mesh, as will be further described below. Scanning ofrock surface 140 may be implemented for example with a simultaneous localization and mapping (SLAM) system, which may be configured to scan environment ofmesh installation rig 100 to obtain the point cloud data of surrounding surfaces or objects. The obtained point cloud data may be used for object detection, but also for determining position ofmesh installation rig 100 based on comparing the scanning data to reference data, such as for example a 3D model of a tunnel. -
Mesh installation rig 100 may comprise a mesh controller (MC) 114.Mesh controller 114 may be communicatively coupled tosensor 112, for example to receive scanned sensor data fromsensor 112, or, to requestsensor 112 to initiate scanning ofrock surface 140.Mesh controller 114 may be for example provided as a software application residing on a memory and being executable by a processor. An example of an apparatus suitable for implementingmesh controller 114 is provided inFIG. 8 .Mesh controller 114 may comprise, or be communicatively coupled to, various functions, blocks, or applications for implementing functionality ofmesh controller 114. For example,mesh controller 114 may comprise or be communicatively coupled to a data management server, which may be configured to store information on a digital meshing plan, tunnel lines, point cloud or mesh presentations of tunnel lines or profiles, a mine map point cloud, or the like. The digital meshing plan may comprise planned mesh positions and optionally also planned mounting positions. A mounting position may comprise a position at which a mesh is mounted onrock surface 140 by mounting means such as for example a bolt or a rivet. A planned mounting position may comprise a planned position for the mounting means atrock surface 140.Mesh controller 114 may comprise a navigation application configured to control, or enable a human operator to control, navigation ofmesh installation rig 100, for example to move it to the planned installation position and/or to determine positions of planned mounting points of the digital meshing plan relative to a current position ofmesh installation rig 100. Position ofmesh installation rig 100 may be referred to as a navigation position. An installation position may be therefore a navigation position, which has been planned or determined formesh installation rig 100 to install a mesh atrock surface 140. -
Mesh controller 114 may be configured to determine and/or maintain the digital meshing plan, a 3D model of at least one component of mesh installation rig 100 (e.g., a 3D model of boom(s) 120,gripper 124 or bolter 126), and/or a kinematic model ofmesh installation rig 100, or component(s) thereof. A 3D model of a component ofmesh installation rig 100 may comprise 3D geometry data of the component, obtained for example from a computer aided design (CAD) model of the respective physical component. - A kinematic model of
mesh installation rig 100, or component(s) thereof, may comprise a mathematical description of at least a part ofmesh installation rig 100. A kinematic model may describe motion ofmesh installation rig 100 or component(s) ofmesh installation rig 100 without taking into account the forces that cause the motion. The kinematic model may be used for estimating a position ofmesh installation rig 100 or component(s) ofmesh installation rig 100, for example based on measurement data from one or more sensors associated withmesh installation rig 100 or motion ofmesh installation rig 100 caused by given control inputs. The kinematic model ofmesh installation rig 100 may comprise at least dimensions ofmesh installation rig 100 and/or reach ofmesh installation rig 100 such as a movement range of at least one boom 120 ofmesh installation rig 100. The kinematic model may comprise information on dimensions of boom(s) 120, or parts thereof, forexample gripper 124 orbolter 126, characteristics of joint(s) 122 (e.g. their degrees of freedom), constraints between moving parts ofmesh installation rig 100, or the like. The kinematic model may thus enable modelling movement of the component(s) ofmesh installation rig 100, for example to determine possible positions for installingmesh 402 from a particular installation position. The kinematic model may for example enable determining a maximum distance reachable bygripper 124 orbolter 126. The 3D model(s) of the component(s) may be provided as point cloud data indicative of the surface of the component(s). Point cloud data may comprise a plurality of data points representing, for example, distances betweenmesh installation rig 100 and its component(s) or other objects in the environment ofmesh installation rig 100, for example at a particular time instance. An individual point included in a point cloud may be presented by, for example, x and y coordinates, or x, y, and z coordinates with respect to a particular coordinate frame. -
Mesh installation rig 100 may be controlled by a remotemesh control device 200, which may be external to meshinstallation rig 100, as illustrated inFIG. 2 . Remotemesh control device 200 may be for example a server located remote frommesh installation rig 100, for example outside the tunnel. Functionality ofmesh controller 114 may be distributed betweenmesh installation rig 100, for example a local mesh controller ofmesh installation rig 100, and remotemesh control device 200. Information may be exchanged between remotemesh control device 200 andmesh installation rig 100 over a communication interface including any suitable wireless or wired connection. Examples of suitable communication interfaces are described with reference toFIG. 8 . -
Mesh controller 114 may be configured to determine and/or maintain the digital meshing plan. The 3D and kinematic model(s) ofmesh installation rig 100 may be stored atmesh controller 114, for example based on pre-configuration of the models. Alternatively,mesh controller 114 may be configured to receive one or more of the models frommesh installation rig 100 or the data management server.Mesh controller 114 may also be configured to receive, for example frommesh installation rig 100, the scanned sensor data ofsensor 112, which meshcontroller 114 may be configured to use for detecting mesh(es) installed onrock surface 140 or located nearrock surface 140. Example embodiments of the present disclosure may be thus implemented locally atmesh installation rig 100 and/or at remotemesh control device 200. -
FIG. 3 illustrates an example of a flow chart for controlling mesh installation. - At
operation 301,mesh controller 114 may be configured to control scanning ofrock surface 140.Mesh controller 114 may be configured to cause scanning ofrock surface 140, for example by requestingsensor 112 to initiate scanning. Sensor(s) 112 may be positioned such that their sensor signal(s) are configured to be directed torock surface 140, whenmesh installation rig 100 is operated nearrock surface 140. Scanning data may comprise data captured bysensor 112 during scanning ofrock surface 140.Mesh controller 114 may be configured to obtain the scanning data ofrock surface 140, for example by receiving the scanning data fromsensor 112.Mesh controller 114 may be however configured to process, for example select or filter, raw sensor data provided bysensor 112 to obtain the scanning data. It is noted thatmesh controller 114 may be configured to cause scanning ofrock surface 140 whenmesh installation rig 100 is not located at the installation position for installing the next mesh. For example,mesh controller 114 may be configured to cause scanning ofrock surface 140 beforemesh installation rig 100 arrives at the installation position for installing the next mesh.Mesh controller 114 may be configured to determine the installation position based on the scanning data, which may be obtained for example while mesh installation rig is moving away from a previous installation location. - At
operation 302,mesh controller 114 may be configured to detect a mesh installed onrock surface 140. This mesh may be referred to as a first mesh. More than one first mesh may be detected.Mesh controller 114 may be therefore configured to detect one or a plurality of first meshes already installed onrock surface 140. Detecting the first mesh may comprise detecting distinctive features of the first mesh, such as for example edge(s) and/or corner(s) of the first mesh.Mesh controller 114 may be configured to detect the first mesh, or features thereof, for example based on applying computer vision or pattern recognition algorithms on the scanning data, for example sensor data received fromsensor 112. - At
operation 303,mesh controller 114 may be configured to determine a position of the first mesh based on the scanning data. This position may be referred to as a first position.Mesh controller 114 may be configured to indicate the position of the first mesh by position(s) of distinctive feature(s) of the first mesh, for example edge(s) and/or corner(s) of the first mesh. For example,mesh controller 114 may be configured to determine data (e.g., point could data) indicative of a position of an edge, for example an outer edge, or corner(s) of the first mesh. An outer edge may refer to an edge that is not yet located next to other meshes installed onrock surface 140. It may for example comprise an edge towards the forward driving direction (x) ofmesh installation rig 100. -
Mesh controller 114 may be configured to initially provide information on the position of the first mesh with respect to the coordinate frame ofmesh installation rig 100.Mesh controller 114 may be therefore configured to provide information on the position of the first mesh with respect to the location ofmesh installation rig 100 during the scanning bysensor 112. Subsequently, after movement ofmesh installation rig 100, the position of the first mesh may be updated at the coordinate frame ofmesh installation rig 100 such that its position with respect torock surface 140 remains stationary (cf. operation 306). It is also possible to perform the scanning at multiple positions. Movement ofmesh installation rig 100 during the scanning may be compensated, if necessary. Alternatively,mesh installation rig 110 may be configured to provide the information on the position of the first mesh with respect to a stationary reference coordinate frame, such as for example a coordinate frame stationary with respect torock surface 140. - At
operation 304mesh controller 114 may be configured to determine an installation position formesh installation rig 100, in order to install a next mesh. The next mesh subject to installation may be referred to as a second mesh. Installation position may refer to a position ofmesh installation rig 100 and not to position of any mesh.Mesh controller 114 may be configured to determine the installation position at any time between installing the first mesh and stoppingmesh installation rig 100 for installation of the second mesh, for example during movement of mesh installation rig. -
Mesh controller 114 may be configured to determine the installation position based on the first position of the first mesh, determined based on the scanning data, and the kinematic model ofmesh installation rig 100. Based on the position of the first mesh and the kinematic model,mesh controller 114 may be configured to determine a position from which meshinstallation rig 100 is able to reach the edge of the first mesh, for example such that desired overlapping of the first and second meshes may be achieved. When the first and second mesh overlap, they may occupy or cover the same area ofrock surface 140.Mesh controller 114 may be for example configured to determine the installation position based on dimension(s) of boom 120-1, and optionally a position forgripping mesh 402 bygripper 124.Mesh controller 114 may be configured to determine the installation position such thatmesh installation rig 100 is enabled to place mesh 402 (cf. second mesh) with a desired overlap with already installed mesh(es) (cf. first mesh).Mesh controller 114 may be configured to determine the installation position based on dimension(s) of boom 120-2 (e.g., including bolter 126) such that mountingmesh 402 at the desired position bybolter 126 is enabled. - At operation 305,
mesh controller 114 may be configured to control movement ofmesh installation rig 100 to the installation position. Controlling movement ofmesh installation rig 100 may comprise controlling driving direction, speed, and/or orientation ofmesh installation rig 100. Controlling movement of mesh installation rig may comprise determining a position ofmesh installation rig 100. For example,mesh controller 114 may be configured to determine thatmesh installation rig 100 has reached the installation position.Mesh controller 114 may be configured to control movement ofmesh installation rig 100 autonomously or based on instructions received from a human operator, either locally or remotely. - At
operation 306,mesh controller 114 may be configured to update coordinates for installing the second mesh. Sincemesh installation rig 100 may have moved from the position(s) at which the first mesh was detected by scanning,mesh controller 114 may be configured to update the position of the first mesh (first position), in the coordinate system ofmesh installation rig 100 based on the movement from the scanning position(s) to the installation position. - At operation 307,
mesh controller 114 may be configured to determine a position for installing the second mesh onrock surface 140. This position may be referred to as a second position and it may refer to a position of the second mesh onrock surface 140.Mesh controller 114 may be configured to determine the second position such that the first mesh and the second mesh overlap, for example at an edge of the first mesh, subsequent to installation of the second mesh onrock surface 140 at the second position. This enables to prevent rocks falling fromrock surface 140 and thereby increases safety and reduces the risk of damage to meshinstallation rig 100.Mesh controller 114 may be configured to determine the second position based on the first position of the first mesh. -
FIG. 4 illustrates an example of overlapping meshes. Considering an example scenario, where mesh 404 (as the first mesh) has been previously installed onrock surface 140,mesh controller 114 may determine position of mesh 401 (as the second mesh) such that meshes 404 and 401 overlap in direction x after installation ofmesh 401.Meshes mesh 404. Similarly, when mesh 401 (as the first mesh) has been already installed,mesh controller 114 may determine position of mesh 402 (as the second mesh) such that meshes 401 and 402 overlap in direction y after installation ofmesh 402.Meshes mesh 401. In this example, the overlap between the meshes is slightly more than one mesh opening (mesh eye). The amount of overlapping may be however larger, for example more than two (e.g. 2-4) mesh openings. Overlap of 2-4 mesh openings sufficiently prevents rocks from falling fromrock surface 140, while not causing excessive extra cost. The amount of overlapping may be defined with respect to a direction perpendicular to the edge of the already installed mesh, for example direction x when installingmesh 401 such that it overlaps withmesh 404 and direction y when installingmesh 402 such that it overlaps withmesh 401. -
FIG. 5 illustrates an example of meshes installed on a tunnel surface based on a digital meshing plan.FIG. 5 illustrates a cross-sectional view of a tunnel along the yz-plane (left) and also an example of a digital meshing plan (right) for the tunnel surface viewed from above roof 140-1 and from outside of right wall 140-3 of the tunnel. In this example,rock surface 140 comprises a tunnel surface, for example roof 140-1 and/or wall(s) 140-2, 140-3 of the tunnel.Mesh controller 114 may be configured to determine positions for the meshes based on the digital meshing plan, which may comprise planned mesh positions. Planned positions formeshes 401 to 406 are illustrated on the right. The digital meshing plan may comprise planned mountingpositions 501 represented by the black dots. When determining a position for installing a mesh,mesh controller 114 may be configured to initially use the respective position included in the digital meshing plan. However, due to various imperfections, such as for example bending or inaccurate placement of previous meshes, the planned position might not provide sufficient overlap in practise. It is also possible that mounting the mesh at the planned mounting positions is not possible, for example due to mesh wire(s) being located at the planned mounting positions. Based on scanning ofrock surface 140 and detecting the already installed mesh(es), it is possible to provide sufficient overlap and to find suitable mounting position. - Considering mesh installation at a particular point of axis x, the meshes may be installed starting from the roof, for example from the highest point of roof 140-1, and moving down along the tunnel surface such that meshes located on wall 104-2, for
example mesh 403, are installed after meshes located on roof 140-1, forexample mesh 401 andmesh 402. This enables to keep rocks falling from roof 140-1 behind the meshes. In general, the first mesh (e.g., mesh 402) may have been installed on roof 140-1 of the tunnel and the second mesh (e.g., mesh 403) may be configured to be installed on a wall 140-3 of the tunnel. A wall 140-2, 140-3 of the tunnel may comprise a portion of the tunnel surface for which the inclination angle α from axis y is below a threshold, for example less than 45°. Roof 140-1 of the tunnel may comprise a portion of the tunnel surface for which the inclination angle α from axis y is above the threshold, for example greater than 45°. - Referring back to
FIG. 3 , atoperation 308mesh controller 114 may be configured to control installation of the second mesh torock surface 140. For example,mesh controller 114 may be configured to control movement of at least one boom, for example booms 120-1, 120-2 and their respective tools, to cause placement of the second mesh at the determined second position and to mount the second mesh atrock surface 140 at this position. An example of a method for controlling installation of the second mesh is provided inFIG. 6 . - Some operations of
FIG. 3 may be optional and operations may be also performed in different order. For example,mesh controller 114 may be configured to cause movement ofmesh installation rig 100 at a planned installation position before scanningrock surface 140 to detect the first mesh.Mesh controller 114 may be for example configured to control movement of mesh installation rig for example based on the digital mesh plan. In this case, it might not be necessary to update coordinate(s) (cf. operation 306) of the first mesh before determining the position of the second mesh (cf. operation 307), ifmesh installation rig 100 does not move between scanning the first mesh and installation of the second mesh. Further,mesh controller 114 may be configured to determine the position for the second mesh (cf. operation 307) beforemesh installation rig 100 moves to the installation position. In this case,mesh controller 114 may be configured to update both coordinates of the first mesh and the second mesh based on the movement ofmesh installation rig 100 to its installation position. -
FIG. 6 illustrates an example of a flow chart for controlling mesh installation via overlapping openings of first and second meshes. The flow chart ofFIG. 6 may be used for implementingoperation 308 ofFIG. 3 . Based on this flow chart it is however possible to implement a stand-alone method for controlling mounting of the second mesh at or near a predetermined location. - At
operation 601,mesh controller 114 may be configured to control positioning of the second mesh for installation atrock surface 140. For example,mesh controller 114 may be configured to control at least one boom, for example boom 120-1 comprisinggripper 124, to position the second mesh for being installed onrock surface 140.Mesh controller 114 may be configured to determine the position of the second mesh based on the digital meshing plan and/or scanning of the rock surface, for example as described with reference toFIG. 3 . - At
operation 602,mesh controller 114 may be configured to control scanning ofrock surface 140, similar tooperation 301. However,mesh controller 114 may be configured to causerock surface 140 to be scanned when the second mesh has been positioned for installation.Mesh controller 114 may therefore configured to obtain scanning data ofrock surface 140, in order to detect the first mesh(es) installed onrock surface 140 and the second mesh positioned for being installed onrock surface 140. When combined with operations ofFIG. 3 , this scanning data may comprise further scanning data in addition to the scanning data obtained atoperation 301. - At
operation 603,mesh controller 114 may be configured to determine whether overlapping opening(s) of the first mesh and the second mesh are detected.Mesh controller 114 may be configured to use any suitable method for this, including, but not limited to, machine-vision-based algorithm(s).Mesh controller 114 may be configured to determine whether a predetermined number of overlapping opening(s) exist. The predetermined number may comprise a positive integer, for example one, two, three, five, ten, or any integer within the range of 1 to 10.Mesh controller 114 may be configured to determine, in response to detecting overlapping opening(s), or the predetermined number of openings, one or more overlapping openings for mounting the second mesh torock surface 140.Mesh controller 114 may be configured to determine the overlapping opening(s) for mounting the second mesh based on selecting particular overlapping openings from the detected overlapping openings, for example based on their distance(s) to the planned mountingpositions 501 of the digital meshing plan. Determining the overlapping opening(s) may therefore comprise selecting a subset of the detected openings for mounting the second mesh onrock surface 140.Mesh controller 114 may be for example configured to select, for mounting the second mesh, overlapping opening(s) that are closest to the mounting position(s) of the digital meshing plan.Mesh controller 114 may be configured to determine, based on the scanning data ofrock surface 114, position(s) where openings of the first and second meshes overlap.Mesh controller 114 may be configured to determine the position(s) with respect to the coordinate frame ofmesh installation rig 100. - Determining the overlapping openings by
mesh controller 114 may be based on searching for the overlapping openings of the first and the second meshes in proximity of gripping position(s) of boom 120-1, which may be configured to position the second mesh for installing the second mesh torock surface 140. This improves detection of the overlapping openings, because the distance between the first and second meshes along an axis perpendicular torock surface 140 is generally smaller close the gripping position(s) due to bending of the second mesh.Mesh controller 114 may be for example configured to search for the overlapping openings within a threshold distance from the gripping position(s) or a threshold number of mesh openings. The threshold distance may be dependent on thickness of the mesh wires and size (e.g., width or diameter) of the mesh openings. The threshold number of mesh openings may be dependent on the thickness of the mesh wire. The thickness of the mesh wires may be for example 10 mm. The threshold distance may be for example 50 cm or 1 m. In case of square mesh openings, the width of the mesh opening may be for example 10 cm or 15 cm. The threshold number of mesh openings may be for example 6-10 openings.Mesh controller 114 may be configured to move to execution ofoperation 604 in response to detecting overlapping openings, or the predetermined number thereof.Mesh controller 114 may be configured to move to execution ofoperation 605 in response to not detecting overlapping openings, or the predetermined number thereof. Detecting overlapping openings may be subject to detecting overlapping openings at suitable positions, for example with respect to the digital meshing plan or kinematic model ofmesh installation rig 100, for example boom 120-2 and/orbolter 126. Detecting overlapping openings may be subject to determining that the openings overlap at least to a predetermined extent, for example such that mounting torock surface 140 is enabled via the overlapping portions of the openings. -
FIG. 7 illustrates an example of first and second meshes with overlapping openings. In this example,mesh 401 has been installed previously andmesh installation rig 100 has positionedmesh 404 withgripper 124 for mounting onrock surface 140. Four gripping positions ofgripper 124 have been illustrated by the black dots.Mesh controller 114 may be configured to determine positions of a plurality of overlappingopenings position 701 and thereafter extending the search range to findpositions mesh controller 114, or determined bymesh controller 114 by other means, for example based on properties of the first and/or second mesh (e.g., size of mesh openings). The positions of the overlapping openings may be determined such that they are located close to, e.g., within another threshold distance, the planned mountingpositions 501 of the digital meshing plan. - Referring back to
FIG. 6 , atoperation 604mesh controller 114 may be configured to control mounting of the second mesh torock surface 140. Controlling the mounting of the second mesh may comprise causingmesh installation rig 100 to mount the second mesh atrock surface 140. Controlling the mounting of the second mesh may comprise determining an order of mounting positions or a mounting rate (e.g., in bolts/min). Controlling the mounting of the second mesh may comprise causingmesh installation rig 100 to mount the second mesh torock surface 140 according to the determined order of mounting positions or the mounting rate.Mesh controller 114 may be configured to controlmesh installation rig 100 based on the determined positions and detected overlapping openings such that the second mesh is mounted torock surface 140 at the determined positions(s) via the overlapping openings of the first and second meshes. For example,mesh controller 114 may be configured to cause boom 120-2 to mount (e.g., by bolting) the second mesh atrock surface 140. Mounting the second mesh may cause also the first mesh to be mounted at the determined positions, in addition to positions at which the first mesh was mounted earlier. -
Mesh controller 114 may be configured to control mounting of the second mesh torock surface 140 via the overlapping openings such that the second mesh is mounted torock surface 140 in an order of increasing distance from the gripping position(s) of boom 120-1. This makes the mounting easier, because the distance between the first and second meshes is generally smaller in proximity of the gripping position(s). For example,mesh controller 114 may be configured to control boom 120-2 tofirst cause mesh 404 to be mounted atposition 701, which is closest to the gripping positions ofgripper 124.Mesh controller 114 may be configured to next control boom 120-2 to causemesh 404 to be mounted atposition 702. Mounting the second mesh atposition 702 decreases the distance betweenmeshes position 703, which makes it easier to subsequently mountmesh 404 atposition 703. - At
operation 605,mesh controller 114 may be configured to control adjustment of the position of the second mesh.Mesh controller 114 may perform this in response to determining (cf. operation 603) not to find overlapping openings, for example the predetermined number of them, of first and second meshes. For example,mesh controller 114 may be configured to control boom 120-1 and/orgripper 124 to adjust the position of the second mesh. The adjustment may be preconfigured, for example a preconfigured distance to a preconfigured direction, or determined bymesh controller 114 based on the scanning data. Adjusting the position of the second mesh increases the probability of finding suitable overlapping openings for mounting the second mesh torock surface 140. In response to the adjustment,mesh controller 114 may be configured to move back to execution ofoperation 602, wheremesh controller 114 may be configured to control re-scanning ofrock surface 140 in order to obtain re-scanning data. Based on the re-scanning data,mesh controller 114 may be configured to determine whether there are overlapping openings (operation 603), control mounting of the second mesh (operation 604), and/or control a further adjustment of the position of the second mesh (operation 605). The potentially iterative approach enables to find suitable positions for mounting the second mesh atrock surface 140. This enables to speed up the installation process and to save energy because suitable mounting positions may be determined in advance, without actually trying to mount the second mesh at unsuitable positions, for example withbolter 126. -
FIG. 8 illustrates an example of an apparatus configured to practise one or more example embodiments.Apparatus 800 may be or comprise a mesh control apparatus, such as for example a server, communicatively coupled to meshinstallation rig 100, a mesh control apparatus located atmesh installation rig 100,mesh controller 114,mesh installation rig 100 itself, or in general any device or system configured to implement the functionality described herein. Althoughapparatus 800 is illustrated as a single device, it is appreciated that, wherever applicable, functions ofapparatus 800 may be distributed to a plurality of devices. -
Apparatus 800 may comprise at least oneprocessor 802. The at least oneprocessor 802 may comprise, for example, one or more of various processing devices, such as for example a co-processor, a microprocessor, a controller, a digital signal processor (DSP), a processing circuitry with or without an accompanying DSP, or various other processing devices including integrated circuits such as, for example, an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a microcontroller unit (MCU), a hardware accelerator, a special-purpose computer chip, or the like. -
Apparatus 800 may further comprise at least onememory 804. The at least onememory 804 may be configured to store, for example, computer program code or the like, for example operating system software and application software. The at least onememory 804 may comprise one or more volatile memory devices, one or more non-volatile memory devices, and/or a combination thereof. For example, the memory may be embodied as magnetic storage devices (such as hard disk drives, etc.), optical magnetic storage devices, or semiconductor memories (such as mask ROM, PROM (programmable ROM), EPROM (erasable PROM), flash ROM, RAM (random access memory), etc.).Memory 804 is provided as an example of a (non-transitory) computer readable medium. The term "non-transitory," as used herein, is a limitation of the medium itself (i.e., tangible, not a signal ) as opposed to a limitation on data storage persistency (e.g., RAM vs. ROM). The at least onememory 804 may be also embodied separate fromapparatus 800, for example as a computer readable (storage) medium, examples of which include memory sticks, compact discs (CD), or the like. - When
apparatus 800 is configured to implement some functionality, some component and/or components ofapparatus 800, such as for example the at least oneprocessor 802 and/or the at least onememory 804, may be configured to implement this functionality. Furthermore, when the at least oneprocessor 802 is configured to implement some functionality, this functionality may be implemented usingprogram code 806 comprised, for example, in the at least onememory 804. - The functionality described herein may be performed, at least in part, by one or more computer program product components such as software components. According to an example embodiment,
apparatus 800 comprises a processor or processor circuitry, such as for example a microcontroller, configured by theprogram code 806, when executed, to execute the embodiments of the operations and functionality described herein.Program code 806 is provided as an example of instructions which, when executed by the at least oneprocessor 802, cause performance ofapparatus 800. - For example,
mesh controller 114 may be at least partially implemented as program code configured to causeapparatus 800 to perform functionality ofmesh controller 114. Similarly, transmission or reception of data (e.g. sensor data, kinematic model(s), or the digital meshing plan) over an internal or external communication interface ofmesh installation rig 100 may be controlled by software. - Alternatively, or in addition, the functionality described herein can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip systems (SOCs), complex programmable logic devices (CPLDs), graphics processing units (GPUs), neural processing unit (NPU), tensor processing unit (TPU), or the like.
-
Apparatus 800 may comprise acommunication interface 808 configured to enableapparatus 800 to transmit and/or receive information.Communication interface 808 may comprise an internal or external communication interface, such as for example a radio interface betweenmesh installation rig 100 and remotemesh control device 200.Apparatus 800 may further comprise other components and/or functions such as for example a user interface (not shown) comprising at least one input device and/or at least one output device. The input device may take various forms such as a keyboard, a touch screen, or one or more embedded control buttons. The output device may for example comprise a display, a speaker, or the like. The user interface may enable a human operator to monitor various functions and data, such as for example the digital meshing plan, or the like. -
Apparatus 800 may be configured to perform or cause performance of any aspect of the method(s) described herein. Further, a computer program or a computer program product may comprise instructions for causing, when executed byapparatus 800,apparatus 800 to perform any aspect of the method(s) described herein. Further,apparatus 800 may comprise means for performing any aspect of the method(s) described herein. In one example, the means comprises the at least oneprocessor 802, the at least onememory 804 including program code 806 (instructions) configured to, when executed by the at least oneprocessor 802,cause apparatus 800 to perform the method(s). In general, computer program instructions may be executed on means providing generic processing functions. Such means may be embedded for example in a computer, a server, or the like. The method(s) may be thus computer-implemented, for example based algorithm(s) executable by the generic processing functions, an example of which is the at least oneprocessor 802.Apparatus 800 may comprise means for transmitting or receiving information, for example one or more wired of wireless (e.g. radio) transmitters or receivers, which may be coupled or be configured to be coupled to one or more antennas, or transmitter(s) or receiver(s) of a wired communication interface. - According to a first aspect,
apparatus 800 may be configured for controlling mesh installation. The apparatus may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface; determine, based on the scanning data, a first position of the at least one first mesh; determine, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; and control installation of the second mesh on the rock surface at the second position. - According to an example embodiment of the first aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control at least one boom to place the second mesh at the second position and to mount the second mesh to the rock surface at the second position.
- According to an example embodiment of the first aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control a first boom to place the second mesh at the second position; and control a second boom to mount the second mesh to the rock surface at the second position.
- According to an example embodiment of the first aspect, mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- According to an example embodiment of the first aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: determine, based on the first position of the at least one first mesh and a kinematic model of a mesh installation rig, an installation position for the mesh installation rig for installing the second mesh on the rock surface at the second position; control movement of the mesh installation rig to the installation position; update the first position of the at least one first mesh and the second position of the second mesh in a coordinate system of the mesh installation rig based on the movement to the installation position.
- According to an example embodiment of the first aspect, the apparatus comprises the mesh installation rig.
- According to an example embodiment of the first aspect, the apparatus is configured to obtain the scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- According to an example embodiment of the first aspect, at least two openings of the at least one first mesh and the second mesh are configured to overlap in a direction perpendicular to the edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position.
- According to an example embodiment of the first aspect, the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- According to a fifth aspect,
apparatus 800 may be configured for controlling mesh installation. The apparatus may comprise: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to: obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface and a second mesh positioned for being installed on the rock surface; determine, based on the scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh. - According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control adjustment of a position of the second mesh, in response to determining not to find a predetermined number of overlapping openings of the at least one first mesh and the second mesh.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: obtain re-scanning data of the rock surface to detect the overlapping openings of the at least one first mesh and the second mesh, in response to the adjustment the position of the second mesh.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control at least one boom to position the second mesh for installing the second mesh to the rock surface and to mount the second mesh to the rock surface.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: determine the at least one position where the openings of the at least one first mesh and the second mesh overlap based on searching for the overlapping openings of the at least one first mesh and the second mesh in proximity of at least one gripping position of a first boom configured to position the second mesh for installing the second mesh to the rock surface.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: determine a plurality of positions where the openings of the at least one first mesh and the second mesh overlap; and control mounting of the second mesh to the rock surface at the plurality of positions via the overlapping openings of the at least one first mesh and the second mesh in an order of increasing distance from the at least one gripping position of the first boom configured to position the second mesh for being installed to the rock surface.
- According to an example embodiment of the fifth aspect, the computer program code is configured to, with the at least one processor, cause the apparatus to: control a second boom to mount the second mesh to the rock surface.
- According to an example embodiment of the fifth aspect, mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- According to an example embodiment of the fifth aspect, the apparatus comprises a mesh installation rig.
- According to an example embodiment of the fifth aspect, the apparatus is configured to obtain the scanning data or the re-scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- According to an example embodiment of the fifth aspect, the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
-
FIG. 9 illustrates an example of a method for controlling mesh installation. The method may comprise a computer-implemented method performed by, for example,apparatus 800 such asmesh controller 114. - At 901, the method may comprise obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface.
- At 902, the method may comprise determining, based on the scanning data, a first position of the at least one first mesh.
- At 903, the method may comprise determining, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position.
- At 904, the method may comprise controlling installation of the second mesh on the rock surface at the second position
-
FIG. 10 illustrates another example of another a method for controlling mesh installation. The method may comprise a computer-implemented method performed by, for example,apparatus 800 such asmesh controller 114. - At 1001, the method may comprise obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface and a second mesh positioned for being installed on the rock surface.
- At 1002, the method may comprise determining, based on the scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap.
- At 1003, the method may comprise controlling mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
-
FIG. 11 illustrates yet another example of a method for controlling mesh installation. The method may comprise a computer-implemented method performed by, for example,apparatus 800 such asmesh controller 114. - At 1101, the method may comprise obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface.
- At 1102, the method may comprise determining, based on the scanning data, a first position of the at least one first mesh.
- At 1103, the method may comprise determining, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the tunnel rock surface at the second position.
- At 1104, the method may comprise obtaining further scanning data of the rock surface to detect the at least one first mesh and the second mesh, when the second mesh is positioned for being installed on the rock surface.
- At 1105, the method may comprise determining, based on the further scanning data, at least one position where openings of the at least one first mesh and the second mesh overlap.
- At 1106, the method may comprise controlling mounting of the second mesh to the rock surface at the at least one position via the overlapping openings of the at least one first mesh and the second mesh.
- The method(s) may be performed by
mesh controller 114,mesh installation rig 100, or remotemesh control device 200, for example based onprogram code 806, when executed byprocessor 802. Various examples of the methods are explained above with regard to functionalities ofmesh controller 114,mesh installation rig 100, and/or remotemesh control device 200, and are therefore not repeated here. It should be understood that example embodiments described may be combined in different ways unless explicitly disallowed. - Although the subject matter has been described in language specific to structural features and/or acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as examples of implementing the claims and other equivalent features and acts are intended to be within the scope of the claims.
- It will be understood that the benefits and advantages described above may relate to one embodiment or may relate to several embodiments. The embodiments are not limited to those that solve any or all of the stated problems or those that have any or all of the stated benefits and advantages. It will further be understood that reference to 'an' item may refer to one or more of those items.
- The steps or operations of the methods described herein may be carried out in any suitable order, or simultaneously where appropriate. Additionally, individual blocks may be deleted from any of the methods without departing from the scope of the subject matter described herein. Aspects of any of the example embodiments described above may be combined with aspects of any of the other example embodiments described to form further example embodiments without losing the effect sought.
- The term 'comprising' is used herein to mean including the method, blocks, or elements identified, but that such blocks or elements do not comprise an exclusive list and a method or apparatus may contain additional blocks or elements.
- As used herein, "at least one of the following: <a list of two or more elements>" and "at least one of <a list of two or more elements>" and similar wording, where the list of two or more elements are joined by "and" or "or", mean at least any one of the elements, or at least any two or more of the elements, or at least all the elements. Term "or" may be understood to cover also a case where both of the items separated by "or" are included. Hence, "or" may be understood as an inclusive "or" rather than an exclusive "or".
- Although subjects may be referred to as 'first' or 'second' subjects, this does not necessarily indicate any order or importance of the subjects. Instead, such attributes may be used solely for the purpose of making a difference between subjects.
- It will be understood that the above description is given by way of example only and that various modifications may be made by those skilled in the art. The above specification, examples and data provide a complete description of the structure and use of exemplary embodiments. Although various embodiments have been described above with a certain degree of particularity, or with reference to one or more individual embodiments, those skilled in the art could make numerous alterations to the disclosed embodiments without departing from scope of this specification.
Claims (15)
- An apparatus for controlling mesh installation, the apparatus comprising:at least one processor;and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:obtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface;determine, based on the scanning data, a first position of the at least one first mesh;determine a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; andcontrol installation of the second mesh on the rock surface at the second position.
- The apparatus according to claim 1, wherein the computer program code is further configured to, with the at least one processor, cause the apparatus to:
control at least one boom to place the second mesh at the second position and to mount the second mesh to the rock surface at the second position. - The apparatus according to claim 1, wherein the computer program code is further configured to, with the at least one processor, cause the apparatus to:control a first boom to place the second mesh at the second position; andcontrol a second boom to mount the second mesh to the rock surface at the second position.
- The apparatus according to claim 2 or 3, wherein mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- The apparatus according to any preceding claim, wherein the computer program code is further configured to, with the at least one processor, cause the apparatus to:determine, based on the first position of the at least one first mesh and a kinematic model of a mesh installation rig, an installation position for the mesh installation rig for installing the second mesh on the rock surface at the second position;control movement of the mesh installation rig to the installation position;update the first position of the at least one first mesh and the second position of the second mesh in a coordinate system of the mesh installation rig based on the movement to the installation position.
- The apparatus according to claim 5, wherein the apparatus comprises the mesh installation rig.
- The apparatus according to any preceding claim, wherein the apparatus is configured to obtain the scanning data from at least one of the following: a camera, a radio detection and ranging sensor, or a light detection and ranging sensor laser.
- The apparatus according to any preceding claim, wherein at least two openings of the at least one first mesh and the second mesh are configured to overlap in a direction perpendicular to the edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position.
- The apparatus according to any preceding claim, wherein the first position comprises a position on a roof of a tunnel and the second position comprises a position on a wall on the tunnel.
- A method, comprising:obtaining scanning data of a rock surface to detect at least one first mesh installed on the rock surface;determining, based on the scanning data, a first position of the at least one first mesh;determining, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; andcontrolling installation of the second mesh on the rock surface at the second position.
- The method according to claim 10, further comprising:
controlling at least one boom to place the second mesh at the second position and to mount the second mesh to the rock surface at the second position. - The method according to claim 10, further comprising:controlling a first boom to place the second mesh at the second position; andcontrolling a second boom to mount the second mesh to the rock surface at the second position.
- The method according to claim 11 or 12, wherein mounting of the second mesh to the rock surface comprises bolting the second mesh to the rock surface.
- The method according to any of claims 10 to 13, further comprising:determining, based on the first position of the at least one first mesh and a kinematic model of a mesh installation rig, an installation position for the mesh installation rig for installing the second mesh on the rock surface at the second position;controlling movement of the mesh installation rig to the installation position;updating the first position of the at least one first mesh and the second position of the second mesh in a coordinate system of the mesh installation rig based on the movement to the installation position.
- A computer program comprising instructions which, when executed by an apparatus, cause the apparatus at least toobtain scanning data of a rock surface to detect at least one first mesh installed on the rock surface;determine, based on the scanning data, a first position of the at least one first mesh;determine, a second position for installing a second mesh on the rock surface, wherein the at least one first mesh and the second mesh are configured to overlap at an edge of the at least one first mesh, when the second mesh has been installed on the rock surface at the second position; andcontrol installation of the second mesh on the rock surface at the second position.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP23152074.3A EP4403743A1 (en) | 2023-01-17 | 2023-01-17 | Controlling mesh installation |
PCT/EP2024/051031 WO2024153693A1 (en) | 2023-01-17 | 2024-01-17 | Controlling mesh installation |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP23152074.3A EP4403743A1 (en) | 2023-01-17 | 2023-01-17 | Controlling mesh installation |
Publications (1)
Publication Number | Publication Date |
---|---|
EP4403743A1 true EP4403743A1 (en) | 2024-07-24 |
Family
ID=84982127
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP23152074.3A Pending EP4403743A1 (en) | 2023-01-17 | 2023-01-17 | Controlling mesh installation |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP4403743A1 (en) |
WO (1) | WO2024153693A1 (en) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109595014A (en) * | 2018-11-06 | 2019-04-09 | 首钢集团有限公司 | A kind of bolting with wire mesh method |
CN112360525A (en) * | 2020-11-09 | 2021-02-12 | 中国煤炭科工集团太原研究院有限公司 | Bolting machine net laying control method and control system |
-
2023
- 2023-01-17 EP EP23152074.3A patent/EP4403743A1/en active Pending
-
2024
- 2024-01-17 WO PCT/EP2024/051031 patent/WO2024153693A1/en unknown
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109595014A (en) * | 2018-11-06 | 2019-04-09 | 首钢集团有限公司 | A kind of bolting with wire mesh method |
CN112360525A (en) * | 2020-11-09 | 2021-02-12 | 中国煤炭科工集团太原研究院有限公司 | Bolting machine net laying control method and control system |
Also Published As
Publication number | Publication date |
---|---|
WO2024153693A1 (en) | 2024-07-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11142891B2 (en) | Working machine | |
US20160312432A1 (en) | Computer Vision Assisted Work Tool Recognition and Installation | |
JP6273041B2 (en) | Mining mine vehicle and method of starting mining mine task | |
US9142063B2 (en) | Positioning system utilizing enhanced perception-based localization | |
EP3094806B1 (en) | Mine vehicle and method of initiating mine work task | |
US9305364B2 (en) | Motion estimation systems and methods | |
EP3839203A1 (en) | Mine vehicle safety control | |
AU2022247649A1 (en) | Construction management system, data processing device, and construction management method | |
EP3757299B1 (en) | Apparatus for generating environment data around construction equipment and construction equipment including the same | |
EP4403743A1 (en) | Controlling mesh installation | |
EP4403744A1 (en) | Controlling mesh installation | |
JP5968178B2 (en) | Image processing apparatus for remote control, remote control system, and image processing method for remote control | |
CN114391060A (en) | Positioning of mobile equipment in an underground worksite | |
EP4403745A1 (en) | Meshing plan for controlling mesh installation | |
JP2023072823A (en) | Structure shape confirmation system | |
EP3754450B1 (en) | Autonomous vehicle monitoring | |
EP4407140A1 (en) | Controlling replacement of a mining tool of a mining vehicle | |
NL2030831B1 (en) | Computer implementation method based on using unmanned aerial vehicle to scann underground goaf | |
EP4343105A1 (en) | Determination of an updated drilling plan | |
US20240135469A1 (en) | Construction management system, data processing device, and construction management method | |
CN118547740A (en) | Mining vehicle calibration | |
CN118547741A (en) | Mining vehicle calibration |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |