WO2022135138A1 - Robot task deployment method and system, device, and storage medium - Google Patents

Robot task deployment method and system, device, and storage medium Download PDF

Info

Publication number
WO2022135138A1
WO2022135138A1 PCT/CN2021/136043 CN2021136043W WO2022135138A1 WO 2022135138 A1 WO2022135138 A1 WO 2022135138A1 CN 2021136043 W CN2021136043 W CN 2021136043W WO 2022135138 A1 WO2022135138 A1 WO 2022135138A1
Authority
WO
WIPO (PCT)
Prior art keywords
robot
inspection
task
point cloud
scene
Prior art date
Application number
PCT/CN2021/136043
Other languages
French (fr)
Chinese (zh)
Inventor
苏启奖
黄炎
王柯
吴昊
麦晓明
Original Assignee
南方电网电力科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 南方电网电力科技股份有限公司 filed Critical 南方电网电力科技股份有限公司
Publication of WO2022135138A1 publication Critical patent/WO2022135138A1/en

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1656Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1664Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1602Programme controls characterised by the control system, structure, architecture
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1602Programme controls characterised by the control system, structure, architecture
    • B25J9/1605Simulation of manipulator lay-out, design, modelling of manipulator
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1679Programme controls characterised by the tasks executed

Abstract

A robot task deployment method and system, a device, and a storage medium. The robot task deployment method comprises: forming a walkable path network of a robot in a three-dimensional point cloud model of a scene, controlling, according to an inspection task, a pre-established three-dimensional model of the robot to walk in the walkable path network, so as to obtain deployment information corresponding to the inspection task, and completing task deployment of the robot according to the inspection task and the corresponding deployment information, controlling an actual robot to perform automatic inspection according to the inspection task, so as to obtain an inspection result, and establishing an association relationship between the inspection result and the pre-established three-dimensional point cloud model of the scene. In this way, the inspection result is viewed in the three-dimensional point cloud model of the scene.

Description

一种机器人任务部署方法、系统、设备和存储介质A robot task deployment method, system, device and storage medium
本申请要求于2020年12月21日提交中国专利局、申请号为202011519589.8、发明名称为“一种机器人任务部署方法、系统、设备和存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed on December 21, 2020 with the application number 202011519589.8 and the invention titled "A Robot Task Deployment Method, System, Equipment and Storage Medium", the entire contents of which are approved by Reference is incorporated in this application.
技术领域technical field
本申请涉及巡检机器人技术领域,尤其涉及一种机器人任务部署方法、系统、设备和存储介质。The present application relates to the technical field of inspection robots, and in particular, to a method, system, device and storage medium for deploying robot tasks.
背景技术Background technique
在变电站的巡检机器人巡检之前,需要根据巡检的需要在特定的位置点部署对应的巡检任务。从而可以控制巡检机器人在巡检过程中,到达特定的位置点执行对应位置点的巡检任务,随后,将依据部署的任务,完成既定任务的巡检动作,如表计或红外探测等。Before the inspection robot of the substation inspects, it is necessary to deploy corresponding inspection tasks at specific locations according to the needs of inspection. In this way, the inspection robot can be controlled to arrive at a specific position point to perform the inspection task of the corresponding position point during the inspection process, and then, according to the deployed task, it will complete the inspection action of the predetermined task, such as metering or infrared detection, etc.
当前,巡检机器人在部署任务时,需要将机器人开至巡检场地中对应的位置点,记录下位置点的相关信息(如坐标和位姿等),控制巡检机器人的执行终端完成巡检任务对应的动作(如调整云台相应的角度或焦距等),从而完成单个任务的全部部署工作。依次完成所有部署任务后,即可完成全部巡检动作。At present, when an inspection robot deploys a task, it needs to drive the robot to the corresponding position point in the inspection site, record the relevant information of the position point (such as coordinates and pose, etc.), and control the execution terminal of the inspection robot to complete the inspection. Actions corresponding to tasks (such as adjusting the corresponding angle or focal length of the gimbal, etc.), so as to complete all the deployment work of a single task. After completing all deployment tasks in sequence, all inspection actions can be completed.
但是,上述的部署任务方法工作量极大,而且通常需要人现场控制,导致效率极低且部署不准确,这对后续的任务巡检造成了不良影响。同时,巡检结果无法直观地与巡检任务相关联且不易查看,导致用户与巡检任务及相应设备的信息交互性较差。However, the above-mentioned deployment task method has a huge workload, and usually requires on-site control by humans, resulting in extremely low efficiency and inaccurate deployment, which has a negative impact on subsequent task inspections. At the same time, the inspection results cannot be intuitively associated with the inspection tasks and are not easy to view, resulting in poor information interaction between the user and the inspection tasks and corresponding equipment.
发明内容SUMMARY OF THE INVENTION
本申请提供了一种机器人任务部署方法、系统、设备和存储介质,用于解决任务部署工作量极大、效率极低且部署不准确,同时,用户与巡检任务及相应设备的信息交互性较差的技术问题。The present application provides a robot task deployment method, system, device and storage medium, which are used to solve the problem that the task deployment workload is extremely large, the efficiency is extremely low, and the deployment is inaccurate. At the same time, the information interaction between users and inspection tasks and corresponding equipment Poor technical issues.
有鉴于此,本申请第一方面提供了一种机器人任务部署方法,包括以下步骤:In view of this, a first aspect of the present application provides a method for deploying a robot task, including the following steps:
基于预先建立的场景三维点云模型确定机器人的所有可行走路径,从而形成可行走路径网;Determine all walkable paths of the robot based on the pre-established 3D point cloud model of the scene, thereby forming a walkable path network;
通过预先建立的机器人三维模型根据下发的巡检任务在所述可行走路径网中行走,从而获得与所述巡检任务对应的部署信息;The pre-established three-dimensional model of the robot walks in the walkable path network according to the assigned inspection task, thereby obtaining deployment information corresponding to the inspection task;
根据所述巡检任务及对应的所述部署信息完成所述机器人的任务部署;Complete the task deployment of the robot according to the inspection task and the corresponding deployment information;
根据所述巡检任务控制所述机器人进行自动巡检从而获得巡检结果,将所述巡检结果与所述预先建立的场景三维点云模型建立关联关系,从而在所述预先建立的场景三维点云模型中查看所述巡检结果。Control the robot to perform automatic inspection according to the inspection task to obtain inspection results, and establish an association relationship between the inspection results and the pre-established 3D point cloud model of the scene, so that the pre-established 3D scene View the inspection results in the point cloud model.
优选地,所述基于预先建立的场景三维点云模型确定机器人的所有可行走路径之前包括:Preferably, before the determination of all walkable paths of the robot based on the pre-established three-dimensional point cloud model of the scene includes:
采集所述机器人的实际巡检场景的全场景点云数据和图像数据;Collect full-scene point cloud data and image data of the actual inspection scene of the robot;
基于所述全场景点云数据和所述图像数据建立场景三维点云模型;Create a scene 3D point cloud model based on the full scene point cloud data and the image data;
在所述场景三维点云模型中,以实际场景设备的部件为基准,对所述全场景点云数据进行聚类和划分,从而获得部件三维点云模型,进而实现所述全场景点云数据分别与所述场景三维点云模型和所述部件三维点云模型一一对应。In the scene 3D point cloud model, based on the components of the actual scene equipment, the whole scene point cloud data is clustered and divided, so as to obtain the component 3D point cloud model, and then realize the whole scene point cloud data. There is a one-to-one correspondence with the three-dimensional point cloud model of the scene and the three-dimensional point cloud model of the component.
优选地,在所述获得部件三维点云模型,进而实现所述全场景点云数据分别与所述场景三维点云模型和所述部件三维点云模型一一对应之后包括:Preferably, after obtaining the three-dimensional point cloud model of the component, and further realizing that the point cloud data of the whole scene is in a one-to-one correspondence with the three-dimensional point cloud model of the scene and the three-dimensional point cloud model of the component, it includes:
向所述部件三维点云模型中的模型部件导入相应的预设部件属性信息,所述预设部件属性信息包括部件铭牌信息和相应的巡检历史数据;importing corresponding preset component attribute information into the model component in the three-dimensional point cloud model of the component, where the preset component attribute information includes component nameplate information and corresponding inspection history data;
在所述部件三维点云模型中,建立所述模型部件与相应的所述预设部件属性信息的关联关系,从而通过所述模型部件查看关联的所述预设部件属性信息。In the three-dimensional point cloud model of the component, an association relationship between the model component and the corresponding preset component attribute information is established, so that the associated preset component attribute information can be viewed through the model component.
优选地,所述部件铭牌信息包括实际部件名称、实际部件材料属性和实际部件设置参数。Preferably, the component nameplate information includes the actual component name, the actual component material properties, and the actual component setting parameters.
优选地,所述通过预先建立的机器人三维模型根据下发的巡检任务在所述可行走路径网中行走之前包括:Preferably, the pre-established three-dimensional model of the robot before walking in the walkable path network according to the issued inspection task includes:
基于所述机器人以及与所述机器人对应的执行终端建立机器人三维模型;Building a three-dimensional model of the robot based on the robot and the execution terminal corresponding to the robot;
向所述机器人三维模型导入所述机器人和所述执行终端的预设机器人属性信息,所述预设机器人属性信息包括实际机器人材料属性和执行终端材料属性。Importing preset robot attribute information of the robot and the execution terminal into the three-dimensional model of the robot, where the preset robot attribute information includes actual robot material attributes and execution terminal material attributes.
优选地,所述通过预先建立的机器人三维模型根据下发的巡检任务在所述可行走路径网中行走,从而获得与所述巡检任务对应的部署信息具体包括:Preferably, the pre-established three-dimensional model of the robot walks in the walkable path network according to the issued inspection task, so as to obtain deployment information corresponding to the inspection task, specifically:
在所述预先建立的场景三维点云模型建立三维坐标系;Establishing a three-dimensional coordinate system on the pre-established three-dimensional point cloud model of the scene;
根据所述巡检任务控制所述预先建立的机器人三维模型在所述可行走路径网沿预设的巡检路线行走,从而确定所述巡检任务对应的巡检点位及所述模型部件;According to the inspection task, control the pre-established three-dimensional robot model to walk along the preset inspection route on the walkable path network, so as to determine the inspection point corresponding to the inspection task and the model component;
根据三维坐标系获得所述机器人对应的所述巡检点位的部署信息,所述部署信息包括所述巡检点位的坐标值、所述机器人的位姿以及所述机器人的执行终端的执行角度和执行焦距。The deployment information of the inspection point corresponding to the robot is obtained according to the three-dimensional coordinate system, and the deployment information includes the coordinate value of the inspection point, the pose of the robot, and the execution of the execution terminal of the robot. angle and execution focal length.
优选地,所述根据三维坐标系获得所述机器人对应的所述巡检点位的部署信息具体包括:Preferably, the obtaining the deployment information of the inspection point corresponding to the robot according to the three-dimensional coordinate system specifically includes:
基于三维坐标系计算所述巡检点位和所述模型部件的坐标值;Calculate the coordinate value of the inspection point and the model component based on the three-dimensional coordinate system;
根据相邻的所述巡检点位的坐标值计算对应的相邻的所述巡检点位的点位距离;Calculate the point distance of the corresponding adjacent inspection points according to the coordinate values of the adjacent inspection points;
将所述点位距离与预设点位距离对比,当所述点位距离小于所述预设点位距离时,则将对应的相邻的所述巡检点位作为同一巡检点位,从而将同一巡检点位的部署信息作为对应的相邻的所述巡检点位的部署信息。Comparing the point distance with the preset point distance, when the point distance is less than the preset point distance, the corresponding adjacent inspection points are regarded as the same inspection point, Therefore, the deployment information of the same inspection point is used as the deployment information of the corresponding adjacent inspection point.
第二方面,本申请提供了一种机器人任务部署系统,包括:In a second aspect, the present application provides a robot task deployment system, including:
路径确定模块,用于基于预先建立的场景三维点云模型确定机器人的所有可行走路径,从而形成可行走路径网;The path determination module is used to determine all the walkable paths of the robot based on the pre-established 3D point cloud model of the scene, thereby forming a walkable path network;
获取模块,用于通过预先建立的机器人三维模型根据下发的巡检任务 在所述可行走路径网中行走,从而获得与所述巡检任务对应的部署信息;an acquisition module, used for walking in the walkable path network through the pre-established three-dimensional model of the robot according to the issued inspection task, so as to obtain deployment information corresponding to the inspection task;
部署模块,用于根据所述巡检任务及对应的所述部署信息完成所述机器人的任务部署;a deployment module, configured to complete the task deployment of the robot according to the inspection task and the corresponding deployment information;
第一关联模块,用于根据所述巡检任务控制所述机器人进行自动巡检从而获得巡检结果,将所述巡检结果与所述预先建立的场景三维点云模型建立关联关系,从而在所述预先建立的场景三维点云模型中查看所述巡检结果。The first association module is used to control the robot to perform automatic inspection according to the inspection task to obtain inspection results, and establish an association relationship between the inspection results and the pre-established three-dimensional point cloud model of the scene, so as to obtain the inspection results. Check the inspection result in the pre-established three-dimensional point cloud model of the scene.
第三方面,本申请提供了一种电子设备,包括:处理器和存储器,所述存储器用于存储程序指令,所述处理器用于执行所述存储器中存储的计算机程序时实现如上述的机器人任务部署方法的步骤。In a third aspect, the present application provides an electronic device, comprising: a processor and a memory, where the memory is used to store program instructions, and the processor is used to implement the above-mentioned robot task when executing a computer program stored in the memory The steps of the deployment method.
第四方面,本申请提供了一种存储介质,其存储有计算机程序,所述计算机程序被处理器执行时实现如上述的机器人任务部署方法的步骤。In a fourth aspect, the present application provides a storage medium, which stores a computer program, and when the computer program is executed by a processor, implements the steps of the above-mentioned method for deploying a robot task.
从以上技术方案可以看出,本申请实施例具有以下优点:As can be seen from the above technical solutions, the embodiments of the present application have the following advantages:
本申请实施例提供的一种机器人任务部署方法、系统、设备和存储介质,通过在场景三维点云模型中形成机器人的可行走路径网,依据巡检任务控制预先建立的机器人三维模型在可行走路径网中行走,根据巡检任务可以获得部署信息,从而无需将机器人开至巡检场地中对应的位置点即可获得部署信息,解决了任务部署工作量极大和效率极低且部署不准确的问题。同时,任务部署后,根据巡检任务控制实际的机器人进行自动巡检时可以获得巡检结果,将巡检结果与预先建立的场景三维点云模型建立关联关系,可以通过在场景三维点云模型中查看巡检结果,从而便于用户与巡检任务及相应设备进行信息交互,提高信息交互性。A robot task deployment method, system, device, and storage medium provided by the embodiments of the present application, by forming a walkable path network of a robot in a three-dimensional point cloud model of a scene, and controlling a pre-established three-dimensional model of a robot to walk in a walkable manner according to an inspection task. Walking in the path network, the deployment information can be obtained according to the inspection task, so that the robot can obtain the deployment information without driving the robot to the corresponding position in the inspection site, which solves the problem that the task deployment workload is extremely large, the efficiency is extremely low, and the deployment is inaccurate. question. At the same time, after the task is deployed, the inspection results can be obtained when the actual robot is controlled according to the inspection task to perform automatic inspection, and the inspection results are associated with the pre-established 3D point cloud model of the scene. It is convenient for users to exchange information with the inspection tasks and corresponding equipment, and improve the information interactivity.
附图说明Description of drawings
图1为本申请第一个实施例提供的一种机器人任务部署方法的流程图;1 is a flowchart of a method for deploying a robot task provided by a first embodiment of the present application;
图2为本申请第二个实施例提供的一种机器人任务部署方法的流程图;2 is a flowchart of a method for deploying a robot task provided by a second embodiment of the present application;
图3为本申请第三个实施例提供的一种机器人任务部署方法的流程 图;3 is a flowchart of a method for deploying a robot task provided by a third embodiment of the present application;
图4为本申请实施例提供的一种机器人任务部署系统的结构示意图。FIG. 4 is a schematic structural diagram of a robot task deployment system according to an embodiment of the present application.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make those skilled in the art better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
为了便于理解,请参阅图1,本申请提供的一种机器人任务部署方法,包括以下步骤:For ease of understanding, please refer to FIG. 1 , a method for deploying a robot task provided by this application includes the following steps:
S1:基于预先建立的场景三维点云模型确定机器人的所有可行走路径,从而形成可行走路径网;S1: Determine all walkable paths of the robot based on the pre-established 3D point cloud model of the scene, thereby forming a walkable path network;
S2:通过预先建立的机器人三维模型根据下发的巡检任务在可行走路径网中行走,从而获得与巡检任务对应的部署信息;S2: The pre-established three-dimensional model of the robot walks in the traversable path network according to the issued inspection task, so as to obtain deployment information corresponding to the inspection task;
S3:根据巡检任务及对应的部署信息完成机器人的任务部署;S3: Complete the task deployment of the robot according to the inspection task and the corresponding deployment information;
S4:根据巡检任务控制机器人进行自动巡检从而获得巡检结果,将巡检结果与预先建立的场景三维点云模型建立关联关系,从而在预先建立的场景三维点云模型中查看巡检结果。S4: Control the robot to perform automatic inspection according to the inspection task to obtain inspection results, and establish an association relationship between the inspection results and the pre-established 3D point cloud model of the scene, so as to view the inspection results in the pre-established 3D point cloud model of the scene .
本实施例中,通过在场景三维点云模型中形成机器人的可行走路径网,依据巡检任务控制预先建立的机器人三维模型在可行走路径网中行走,由于巡检任务是具有巡检指令的,因此,预先建立的机器人三维模型根据巡检任务可以获得部署信息,从而无需将机器人开至巡检场地中对应的位置点即可获得部署信息,解决了任务部署工作量极大和效率极低且部署不准确的问题。In this embodiment, the walkable path network of the robot is formed in the three-dimensional point cloud model of the scene, and the pre-established three-dimensional model of the robot is controlled to walk in the walkable path network according to the inspection task. Since the inspection task has inspection instructions , therefore, the pre-established 3D model of the robot can obtain deployment information according to the inspection task, so that the deployment information can be obtained without driving the robot to the corresponding position in the inspection site, which solves the problem that the task deployment workload is extremely large and the efficiency is extremely low. Deployment inaccurate issues.
同时,任务部署后,根据巡检任务控制实际的机器人进行自动巡检时可以获得巡检结果,将巡检结果与预先建立的场景三维点云模型建立关联关系,可以通过在场景三维点云模型中查看巡检结果,其查看方式不限于点击等方式,从而便于用户与巡检任务及相应设备进行信息交互,提高信 息交互性。At the same time, after the task is deployed, the inspection results can be obtained when the actual robot is controlled according to the inspection task to perform automatic inspection, and the inspection results are associated with the pre-established 3D point cloud model of the scene. The inspection results are viewed in the browser, and the viewing methods are not limited to clicks, etc., so as to facilitate the user to interact with the inspection tasks and the corresponding equipment, and improve the information interactivity.
以上为本发明提供的一种机器人任务部署方法的第一个实施例的详细描述,以下为本发明提供的一种机器人任务部署方法的第二个实施例的详细描述。The above is a detailed description of the first embodiment of a robot task deployment method provided by the present invention, and the following is a detailed description of the second embodiment of a robot task deployment method provided by the present invention.
为了方便理解,请参阅图2,本申请提供的一种机器人任务部署方法,包括以下步骤:For easy understanding, please refer to FIG. 2 , a method for deploying a robot task provided by the present application includes the following steps:
S101:采集机器人的实际巡检场景的全场景点云数据和图像数据;S101: Collect full-scene point cloud data and image data of the actual inspection scene of the robot;
需要说明的是,可以通过激光雷达和摄像头分别获取实际巡检场景的全场景点云数据和图像数据。It should be noted that the full-scene point cloud data and image data of the actual inspection scene can be obtained through the lidar and the camera respectively.
S102:基于全场景点云数据和图像数据建立场景三维点云模型;S102: Establish a three-dimensional point cloud model of the scene based on the point cloud data and image data of the whole scene;
需要说明的是,全场景点云数据与图像数据相融合,融合过程中,通过激光帧匹配、姿态误差估计和视觉图像检测完成场景的全局优化,建立场景三维点云模型。It should be noted that the point cloud data of the whole scene is fused with the image data. During the fusion process, the global optimization of the scene is completed through laser frame matching, attitude error estimation and visual image detection, and a 3D point cloud model of the scene is established.
S103:在场景三维点云模型中,以实际场景设备的部件为基准,对全场景点云数据进行聚类和划分,从而获得部件三维点云模型,进而实现全场景点云数据分别与场景三维点云模型和部件三维点云模型一一对应。S103: In the 3D point cloud model of the scene, based on the components of the actual scene equipment, cluster and divide the point cloud data of the whole scene, so as to obtain the 3D point cloud model of the component, and then realize that the point cloud data of the whole scene and the 3D scene are respectively There is a one-to-one correspondence between the point cloud model and the 3D point cloud model of the component.
需要说明的是,场景三维点云模型中包含设备和场地,因此,需要对设备和场地进行划分,在本实施例中,以实际场景设备(如套管、瓷瓶等)的部件为基准,对全场景点云数据进行聚类和划分,从而获得在场景三维点云模型基础上的部件级别的三维模型,进而使全场景点云数据分别与场景三维点云模型和部件三维点云模型一一对应,使得模拟实际巡检环境更加真实。It should be noted that the 3D point cloud model of the scene includes equipment and sites. Therefore, the equipment and sites need to be divided. The point cloud data of the whole scene is clustered and divided, so as to obtain the 3D model of the component level based on the 3D point cloud model of the scene, so that the point cloud data of the whole scene can be divided with the 3D point cloud model of the scene and the 3D point cloud model of the component one by one. Correspondingly, the simulation of the actual inspection environment is more realistic.
S104:向部件三维点云模型中的模型部件导入相应的预设部件属性信息,预设部件属性信息包括部件铭牌信息和相应的巡检历史数据;S104: Import corresponding preset component attribute information into the model component in the three-dimensional point cloud model of the component, where the preset component attribute information includes component nameplate information and corresponding inspection history data;
可以理解的是,部件铭牌信息包括实际部件名称、实际部件材料属性和实际部件设置参数;巡检历史数据为以前的巡检数据,其数据呈现形式不限于曲线、表格等。It can be understood that the component nameplate information includes the actual component name, the actual component material properties and the actual component setting parameters; the inspection history data is the previous inspection data, and the data presentation form is not limited to curves, tables, etc.
S105:在部件三维点云模型中,建立模型部件与相应的预设部件属性信息的关联关系,从而通过模型部件查看关联的预设部件属性信息。S105: In the three-dimensional point cloud model of the component, establish an association relationship between the model component and the corresponding preset component attribute information, so as to view the associated preset component attribute information through the model component.
可以理解的是,将模型部件与相应的预设部件属性信息建立关联关系,从而可以通过模型部件查看关联的预设部件属性信息,在一般示例中,点击模型部件,即可显示相关联的预设部件属性信息,从而便于查看,提高信息交互性。It can be understood that, by establishing an association relationship between a model part and the corresponding preset part attribute information, the associated preset part attribute information can be viewed through the model part. In a general example, click a model part to display the associated preset part attribute information. Set component attribute information to facilitate viewing and improve information interactivity.
S106:基于场景三维点云模型确定机器人的所有可行走路径,从而形成可行走路径网;S106: Determine all walkable paths of the robot based on the three-dimensional point cloud model of the scene, thereby forming a walkable path network;
S107:基于机器人以及与机器人对应的执行终端建立机器人三维模型;S107: Establish a three-dimensional model of the robot based on the robot and the execution terminal corresponding to the robot;
可以理解的是,执行终端为机器人进行巡检任务的装置,如摄像头,云台等。It can be understood that the execution terminal is a device that performs inspection tasks for the robot, such as a camera, a PTZ, and the like.
S108:向机器人三维模型导入机器人和执行终端的预设机器人属性信息,预设机器人属性信息包括实际机器人材料属性和执行终端材料属性;S108: Import the preset robot attribute information of the robot and the execution terminal into the three-dimensional model of the robot, where the preset robot attribute information includes the actual robot material attribute and the execution terminal material attribute;
可以理解的是,机器人以及与机器人对应的执行终端建立机器人三维模型后,导入预设机器人属性信息可以使得建立的机器人三维模型更贴近真实情况。It can be understood that, after the robot and the execution terminal corresponding to the robot establish the 3D model of the robot, importing the preset robot attribute information can make the established 3D model of the robot closer to the real situation.
S109:通过机器人三维模型根据下发的巡检任务在可行走路径网中行走,从而获得与巡检任务对应的部署信息;S109: The three-dimensional model of the robot walks in the traversable path network according to the issued inspection task, so as to obtain deployment information corresponding to the inspection task;
S110:根据巡检任务及对应的部署信息完成机器人的任务部署;S110: Complete the task deployment of the robot according to the inspection task and the corresponding deployment information;
可以理解的是,将巡检任务及对应的部署信息导入机器人设置的后台管理系统中,即可完成巡检点位的快速自动部署,无需经过机器人开到实际位置,手动控制检测末端这样的繁琐部署流程。It is understandable that by importing the inspection tasks and the corresponding deployment information into the background management system set by the robot, the rapid and automatic deployment of inspection points can be completed, without the need for the robot to drive to the actual position and manually control the detection end. Deployment process.
S111:根据巡检任务控制机器人进行自动巡检从而获得巡检结果,将巡检结果与场景三维点云模型建立关联关系,从而在场景三维点云模型中查看巡检结果。S111: Control the robot to perform automatic inspection according to the inspection task to obtain inspection results, and establish an association relationship between the inspection results and the three-dimensional point cloud model of the scene, so as to view the inspection results in the three-dimensional point cloud model of the scene.
需要说明的是,用户查看巡检结果后,根据机器人实际的执行情况,可对部署信息进行适当微调,从而完成任务的准确部署。It should be noted that after viewing the inspection results, the user can make appropriate adjustments to the deployment information according to the actual execution of the robot, so as to complete the accurate deployment of the task.
本实施例中,通过仿真实际巡检场景构建场景三维点云模型后,在场景三维点云模型中形成机器人的可行走路径网,又以实际机器人和对应的执行终端建立机器人三维模型,从而提高任务部署准确性。In this embodiment, after constructing a three-dimensional point cloud model of the scene by simulating the actual inspection scene, a walkable path network of the robot is formed in the three-dimensional point cloud model of the scene, and a three-dimensional model of the robot is built with the actual robot and the corresponding execution terminal, thereby improving the performance of the robot. Task deployment accuracy.
依据巡检任务控制机器人三维模型在可行走路径网中行走,由于巡检 任务是具有巡检指令的,因此,机器人三维模型根据巡检任务可以获得部署信息,从而无需将机器人开至巡检场地中对应的位置点即可获得部署信息,解决了任务部署工作量极大和效率极低且部署不准确的问题。The 3D model of the robot is controlled to walk in the walkable path network according to the inspection task. Since the inspection task has inspection instructions, the 3D model of the robot can obtain deployment information according to the inspection task, so that the robot does not need to be driven to the inspection site. The deployment information can be obtained from the corresponding location points in the system, which solves the problems of huge task deployment workload, extremely low efficiency and inaccurate deployment.
同时,任务部署后,根据巡检任务控制实际的机器人进行自动巡检时可以获得巡检结果,将巡检结果与场景三维点云模型建立关联关系,可以通过在场景三维点云模型中查看巡检结果,其查看方式不限于点击等方式,从而便于用户与巡检任务及相应设备进行信息交互,提高信息交互性。At the same time, after the task is deployed, the inspection result can be obtained when the actual robot is controlled according to the inspection task to perform automatic inspection, and the inspection result can be associated with the 3D point cloud model of the scene. The viewing method of inspection results is not limited to clicking and other methods, which facilitates information interaction between users and inspection tasks and corresponding equipment, and improves information interactivity.
以上为本发明提供的一种机器人任务部署方法的第二个实施例的详细描述,以下为本发明提供的一种机器人任务部署方法的第三个实施例的详细描述。The above is a detailed description of the second embodiment of a robot task deployment method provided by the present invention, and the following is a detailed description of the third embodiment of a robot task deployment method provided by the present invention.
为了方便理解,请参阅图3,本申请提供的一种机器人任务部署方法,包括以下步骤:For ease of understanding, please refer to FIG. 3 , a method for deploying a robot task provided by this application includes the following steps:
S201:采集机器人的实际巡检场景的全场景点云数据和图像数据;S201: Collect full-scene point cloud data and image data of the actual inspection scene of the robot;
需要说明的是,可以通过激光雷达和摄像头分别获取实际巡检场景的全场景点云数据和图像数据。It should be noted that the full-scene point cloud data and image data of the actual inspection scene can be obtained through the lidar and the camera respectively.
S202:基于全场景点云数据和图像数据建立场景三维点云模型;S202: Establish a three-dimensional point cloud model of the scene based on the point cloud data and image data of the whole scene;
需要说明的是,全场景点云数据与图像数据相融合,融合过程中,通过激光帧匹配、姿态误差估计和视觉图像检测完成场景的全局优化,建立场景三维点云模型。It should be noted that the point cloud data of the whole scene is fused with the image data. During the fusion process, the global optimization of the scene is completed through laser frame matching, attitude error estimation and visual image detection, and a 3D point cloud model of the scene is established.
S203:在场景三维点云模型中,以实际场景设备的部件为基准,对全场景点云数据进行聚类和划分,从而获得部件三维点云模型,进而实现全场景点云数据分别与场景三维点云模型和部件三维点云模型一一对应。S203: In the scene 3D point cloud model, based on the components of the actual scene equipment, cluster and divide the whole scene point cloud data, so as to obtain the component 3D point cloud model, and then realize that the whole scene point cloud data and the scene 3D point cloud data are respectively There is a one-to-one correspondence between the point cloud model and the 3D point cloud model of the component.
需要说明的是,场景三维点云模型中包含设备和场地,因此,需要对设备和场地进行划分,在本实施例中,以实际场景设备(如套管、瓷瓶等)的部件为基准,对全场景点云数据进行聚类和划分,从而获得在场景三维点云模型基础上的部件级别的三维模型,进而使全场景点云数据分别与场景三维点云模型和部件三维点云模型一一对应,使得模拟实际巡检环境更加真实。It should be noted that the 3D point cloud model of the scene includes equipment and sites. Therefore, the equipment and sites need to be divided. The point cloud data of the whole scene is clustered and divided, so as to obtain the 3D model of the component level based on the 3D point cloud model of the scene, so that the point cloud data of the whole scene can be divided with the 3D point cloud model of the scene and the 3D point cloud model of the component one by one. Correspondingly, the simulation of the actual inspection environment is more realistic.
S204:向部件三维点云模型中的模型部件导入相应的预设部件属性信 息,预设部件属性信息包括部件铭牌信息和相应的巡检历史数据;S204: import corresponding preset component attribute information to the model component in the component three-dimensional point cloud model, and the preset component attribute information includes component nameplate information and corresponding inspection history data;
可以理解的是,部件铭牌信息包括实际部件名称、实际部件材料属性和实际部件设置参数;巡检历史数据为以前的巡检数据,其数据呈现形式不限于曲线、表格等。It can be understood that the component nameplate information includes the actual component name, the actual component material properties and the actual component setting parameters; the inspection history data is the previous inspection data, and the data presentation form is not limited to curves, tables, etc.
S205:在部件三维点云模型中,建立模型部件与相应的预设部件属性信息的关联关系,从而通过模型部件查看关联的预设部件属性信息。S205: In the three-dimensional point cloud model of the component, establish an association relationship between the model component and the corresponding preset component attribute information, so as to view the associated preset component attribute information through the model component.
可以理解的是,将模型部件与相应的预设部件属性信息建立关联关系,从而可以通过模型部件查看关联的预设部件属性信息,在一般示例中,点击模型部件,即可显示相关联的预设部件属性信息,从而便于查看,提高信息交互性。It can be understood that the model component is associated with the corresponding preset component attribute information, so that the associated preset component attribute information can be viewed through the model component. In a general example, click on the model component to display the associated preset component attribute information. Set component attribute information to facilitate viewing and improve information interactivity.
S206:基于机器人以及与机器人对应的执行终端建立机器人三维模型;S206: Establish a three-dimensional model of the robot based on the robot and the execution terminal corresponding to the robot;
可以理解的是,执行终端为机器人进行巡检任务的装置,如摄像头,云台等。It can be understood that the execution terminal is a device that performs inspection tasks for the robot, such as a camera, a PTZ, and the like.
S207:向机器人三维模型导入机器人和执行终端的预设机器人属性信息,预设机器人属性信息包括实际机器人材料属性和执行终端材料属性;S207: Import the preset robot attribute information of the robot and the execution terminal into the three-dimensional model of the robot, where the preset robot attribute information includes the actual robot material attribute and the execution terminal material attribute;
可以理解的是,机器人以及与机器人对应的执行终端建立机器人三维模型后,导入预设机器人属性信息可以使得建立的机器人三维模型更贴近真实情况。It can be understood that, after the robot and the execution terminal corresponding to the robot establish the 3D model of the robot, importing the preset robot attribute information can make the established 3D model of the robot closer to the real situation.
S208:在场景三维点云模型建立三维坐标系;S208: Establish a three-dimensional coordinate system in the three-dimensional point cloud model of the scene;
S209:根据巡检任务控制机器人三维模型在可行走路径网沿预设的巡检路线行走,从而确定巡检任务对应的巡检点位及模型部件;S209: control the three-dimensional model of the robot to walk along the preset inspection route on the traversable path network according to the inspection task, so as to determine the inspection points and model components corresponding to the inspection task;
可以理解的是,巡检任务是具有指令信息的,其包含预设的巡检路线,而机器人三维模型根据巡检任务沿着巡检路线进行巡检工作,在需要巡检的位置点位进行定位对模型部件进行检测,从而确定对应的巡检点位及模型部件。It can be understood that the inspection task has instruction information, which includes a preset inspection route, and the three-dimensional model of the robot performs inspection work along the inspection route according to the inspection task, and performs inspection at the positions that need to be inspected. The positioning detects the model parts, so as to determine the corresponding inspection points and model parts.
S210:根据三维坐标系获得机器人对应的巡检点位的部署信息,部署信息包括巡检点位的坐标值、机器人的位姿以及机器人的执行终端的执行角度和执行焦距。S210: Obtain deployment information of the inspection point corresponding to the robot according to the three-dimensional coordinate system, where the deployment information includes the coordinate value of the inspection point, the pose of the robot, and the execution angle and execution focal length of the execution terminal of the robot.
需要说明的是,在确定巡检任务对应的巡检点位及模型部件后,由于 巡检点位和模型部件均在三维坐标系中,可以通过已知的三维坐标系的坐标可以确定巡检点位的坐标值和模型部件的坐标。It should be noted that after determining the inspection points and model parts corresponding to the inspection tasks, since the inspection points and model parts are both in the three-dimensional coordinate system, the inspection can be determined by the coordinates of the known three-dimensional coordinate system. The coordinate value of the point and the coordinate of the model part.
根据机器人三维模型相对三维坐标系的X轴和Y轴的坐标偏差,可以确定机器人的位姿(朝向)。According to the coordinate deviation of the three-dimensional model of the robot relative to the X-axis and the Y-axis of the three-dimensional coordinate system, the pose (orientation) of the robot can be determined.
根据执行终端(如云台)相对三维坐标系的X轴、Y轴和Z轴的坐标偏差,可以确定执行角度。The execution angle can be determined according to the coordinate deviation of the execution terminal (such as the PTZ) relative to the X-axis, Y-axis and Z-axis of the three-dimensional coordinate system.
根据执行终端(如摄像头)内的内部参数以及执行终端相对模型部件的距离可以得到执行终端的执行焦距。The execution focal length of the execution terminal can be obtained according to the internal parameters in the execution terminal (such as a camera) and the distance of the execution terminal relative to the model component.
S211:根据巡检任务及对应的部署信息完成机器人的任务部署;S211: Complete the task deployment of the robot according to the inspection task and the corresponding deployment information;
S212:根据巡检任务控制机器人进行自动巡检从而获得巡检结果,将巡检结果与场景三维点云模型建立关联关系,从而在场景三维点云模型中查看巡检结果。S212: Control the robot to perform automatic inspection according to the inspection task to obtain inspection results, and establish an association relationship between the inspection results and the three-dimensional point cloud model of the scene, so as to view the inspection results in the three-dimensional point cloud model of the scene.
进一步地,步骤S210中的根据三维坐标系获得机器人对应的巡检点位的部署信息具体包括:Further, obtaining the deployment information of the inspection point corresponding to the robot according to the three-dimensional coordinate system in step S210 specifically includes:
S2101:基于三维坐标系计算巡检点位和模型部件的坐标值;S2101: Calculate the coordinate values of the inspection points and model components based on the three-dimensional coordinate system;
S2102:根据相邻的巡检点位的坐标值计算对应的相邻的巡检点位的点位距离;S2102: Calculate the point distance of the corresponding adjacent inspection points according to the coordinate values of the adjacent inspection points;
S2103:将点位距离与预设点位距离对比,当点位距离小于预设点位距离时,则将对应的相邻的巡检点位作为同一巡检点位,从而将同一巡检点位的部署信息作为对应的相邻的巡检点位的部署信息。S2103: Compare the point distance with the preset point distance, and when the point distance is less than the preset point distance, take the corresponding adjacent inspection points as the same inspection point, so that the same inspection point The deployment information of the bit is used as the deployment information of the corresponding adjacent inspection point.
可以理解的是,当相邻的巡检点位较为密集,且小于预设点位距离时,则可以视为一个巡检点位,从而将执行终端的可视范围也可以视为在同一范围内,从而简化任务部署工作,提高任务部署效率。It can be understood that when the adjacent inspection points are dense and less than the preset distance, it can be regarded as one inspection point, so that the visible range of the execution terminal can also be regarded as within the same range. In this way, the task deployment work is simplified and the task deployment efficiency is improved.
以上为本发明提供的一种机器人任务部署方法的第三个实施例的详细描述,以上为本发明提供的一种机器人任务部署系统的一个实施例的详细描述。The above is a detailed description of the third embodiment of a robot task deployment method provided by the present invention, and the above is a detailed description of an embodiment of a robot task deployment system provided by the present invention.
为了方便理解,请参阅图4,本申请提供的一种机器人任务部署系统,包括:For easy understanding, please refer to FIG. 4 , a robot task deployment system provided by this application includes:
路径确定模块100,用于基于预先建立的场景三维点云模型确定机器 人的所有可行走路径,从而形成可行走路径网;The path determination module 100 is used to determine all the walkable paths of the robot based on the pre-established three-dimensional point cloud model of the scene, thereby forming a walkable path network;
获取模块101,用于通过预先建立的机器人三维模型根据下发的巡检任务在可行走路径网中行走,从而获得与巡检任务对应的部署信息;The obtaining module 101 is used for walking in the walkable path network according to the issued inspection task through the pre-established three-dimensional model of the robot, so as to obtain the deployment information corresponding to the inspection task;
部署模块102,用于根据巡检任务及对应的部署信息完成机器人的任务部署;The deployment module 102 is used to complete the task deployment of the robot according to the inspection task and the corresponding deployment information;
第一关联模块103,用于根据巡检任务控制机器人进行自动巡检从而获得巡检结果,将巡检结果与预先建立的场景三维点云模型建立关联关系,从而在预先建立的场景三维点云模型中查看巡检结果。The first association module 103 is used to control the robot to perform automatic inspection according to the inspection task to obtain inspection results, and establish an association relationship between the inspection results and the pre-established scene 3D point cloud model, so that the pre-established scene 3D point cloud View inspection results in the model.
进一步地,该系统还包括:Further, the system also includes:
采集模块,用于采集机器人的实际巡检场景的全场景点云数据和图像数据;The acquisition module is used to collect the full scene point cloud data and image data of the actual inspection scene of the robot;
第一建立模块,用于基于全场景点云数据和图像数据建立场景三维点云模型;The first establishment module is used to establish a three-dimensional point cloud model of the scene based on the point cloud data and the image data of the whole scene;
第二建立模块,用于在场景三维点云模型中,以实际场景设备的部件为基准,对全场景点云数据进行聚类和划分,从而获得部件三维点云模型,进而实现全场景点云数据分别与场景三维点云模型和部件三维点云模型一一对应。The second establishment module is used to cluster and divide the point cloud data of the whole scene based on the components of the actual scene equipment in the 3D point cloud model of the scene, so as to obtain the 3D point cloud model of the component, and then realize the point cloud of the whole scene. The data is in one-to-one correspondence with the scene 3D point cloud model and the component 3D point cloud model.
进一步地,该系统还包括:Further, the system also includes:
第一导入模块,用于向部件三维点云模型中的模型部件导入相应的预设部件属性信息,预设部件属性信息包括部件铭牌信息和相应的巡检历史数据;a first import module, used for importing corresponding preset part attribute information to the model parts in the three-dimensional point cloud model of the part, where the preset part attribute information includes part nameplate information and corresponding inspection history data;
在本实施例中,部件铭牌信息包括实际部件名称、实际部件材料属性和实际部件设置参数。In this embodiment, the component nameplate information includes the actual component name, the actual component material properties, and the actual component setting parameters.
第二关联模块,用于在部件三维点云模型中,建立模型部件与相应的预设部件属性信息的关联关系,从而通过模型部件查看关联的预设部件属性信息。The second association module is used for establishing an association relationship between the model part and the corresponding preset part attribute information in the part three-dimensional point cloud model, so as to view the associated preset part attribute information through the model part.
进一步地,该系统还包括:Further, the system also includes:
第三建立模块,用于基于机器人以及与机器人对应的执行终端建立机器人三维模型;The third establishment module is used to establish a three-dimensional model of the robot based on the robot and the execution terminal corresponding to the robot;
第二导入模块,用于向机器人三维模型导入机器人和执行终端的预设机器人属性信息,预设机器人属性信息包括实际机器人材料属性和执行终端材料属性。The second import module is used to import the preset robot attribute information of the robot and the execution terminal into the three-dimensional model of the robot, where the preset robot attribute information includes the actual robot material attribute and the execution terminal material attribute.
进一步地,该系统还包括:Further, the system also includes:
第四建立模块,用于在预先建立的场景三维点云模型建立三维坐标系;The fourth establishment module is used to establish a 3D coordinate system in the pre-established 3D point cloud model of the scene;
确定模块,用于根据巡检任务控制预先建立的机器人三维模型在可行走路径网沿预设的巡检路线行走,从而确定巡检任务对应的巡检点位及模型部件;The determination module is used to control the pre-established three-dimensional model of the robot to walk along the preset inspection route on the traversable path network according to the inspection task, so as to determine the inspection point and model components corresponding to the inspection task;
获取模块101,还用于根据三维坐标系获得机器人对应的巡检点位的部署信息,部署信息包括巡检点位的坐标值、机器人的位姿以及机器人的执行终端的执行角度和执行焦距。The obtaining module 101 is further configured to obtain deployment information of the inspection point corresponding to the robot according to the three-dimensional coordinate system. The deployment information includes the coordinate value of the inspection point, the pose of the robot, and the execution angle and execution focal length of the execution terminal of the robot.
进一步地,该系统还包括:Further, the system also includes:
第一计算模块,用于基于三维坐标系计算巡检点位和模型部件的坐标值;The first calculation module is used to calculate the coordinate value of the inspection point and the model component based on the three-dimensional coordinate system;
第二计算模块,用根据相邻的巡检点位的坐标值计算对应的相邻的巡检点位的点位距离;The second calculation module calculates the point distance of the corresponding adjacent inspection points according to the coordinate values of the adjacent inspection points;
对比模块,用于将点位距离与预设点位距离对比,当点位距离小于预设点位距离时,则将对应的相邻的巡检点位作为同一巡检点位,从而将同一巡检点位的部署信息作为对应的相邻的巡检点位的部署信息。The comparison module is used to compare the point distance with the preset point distance. When the point distance is less than the preset point distance, the corresponding adjacent inspection points will be regarded as the same inspection point, so that the same inspection point will be compared. The deployment information of the inspection point is used as the deployment information of the corresponding adjacent inspection point.
本发明还提供了一种电子设备,包括:处理器和存储器,存储器用于存储程序指令,处理器用于执行存储器中存储的计算机程序时实现如上述实施例中的机器人任务部署方法的步骤。The present invention also provides an electronic device, comprising: a processor and a memory, the memory is used to store program instructions, and the processor is used to implement the steps of the robot task deployment method in the above embodiment when executing the computer program stored in the memory.
本发明还提供了一种存储介质,其存储有计算机程序,计算机程序被处理器执行时实现如上述实施例中的机器人任务部署方法的步骤。The present invention also provides a storage medium, which stores a computer program, and when the computer program is executed by a processor, implements the steps of the robot task deployment method in the above embodiment.
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之 间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以通过一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(英文全称:Read-Only Memory,英文缩写:ROM)、随机存取存储器(英文全称:Random Access Memory,英文缩写:RAM)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for executing all or part of the steps of the methods described in the various embodiments of the present application through a computer device (which may be a personal computer, a server, or a network device, etc.). The aforementioned storage media include: U disk, mobile hard disk, read-only memory (full English name: Read-Only Memory, English abbreviation: ROM), random access memory (English full name: Random Access Memory, English abbreviation: RAM), magnetic Various media that can store program codes, such as discs or optical discs.
以上所述,以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: The technical solutions recorded in the embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions in the embodiments of the present application.

Claims (10)

  1. 一种机器人任务部署方法,其特征在于,包括以下步骤:A method for deploying a robot task, comprising the following steps:
    基于预先建立的场景三维点云模型确定机器人的所有可行走路径,从而形成可行走路径网;Determine all walkable paths of the robot based on the pre-established 3D point cloud model of the scene, thereby forming a walkable path network;
    通过预先建立的机器人三维模型根据下发的巡检任务在所述可行走路径网中行走,从而获得与所述巡检任务对应的部署信息;The pre-established three-dimensional model of the robot walks in the walkable path network according to the assigned inspection task, thereby obtaining deployment information corresponding to the inspection task;
    根据所述巡检任务及对应的所述部署信息完成所述机器人的任务部署;Complete the task deployment of the robot according to the inspection task and the corresponding deployment information;
    根据所述巡检任务控制所述机器人进行自动巡检从而获得巡检结果,将所述巡检结果与所述预先建立的场景三维点云模型建立关联关系,从而在所述预先建立的场景三维点云模型中查看所述巡检结果。Control the robot to perform automatic inspection according to the inspection task to obtain inspection results, and establish an association relationship between the inspection results and the pre-established 3D point cloud model of the scene, so that the pre-established 3D scene View the inspection results in the point cloud model.
  2. 根据权利要求1所述的机器人任务部署方法,其特征在于,所述基于预先建立的场景三维点云模型确定机器人的所有可行走路径之前包括:The method for deploying a robot task according to claim 1, wherein before the determination of all walkable paths of the robot based on the pre-established three-dimensional point cloud model of the scene comprises:
    采集所述机器人的实际巡检场景的全场景点云数据和图像数据;Collect full-scene point cloud data and image data of the actual inspection scene of the robot;
    基于所述全场景点云数据和所述图像数据建立场景三维点云模型;Create a scene 3D point cloud model based on the full scene point cloud data and the image data;
    在所述场景三维点云模型中,以实际场景设备的部件为基准,对所述全场景点云数据进行聚类和划分,从而获得部件三维点云模型,进而实现所述全场景点云数据分别与所述场景三维点云模型和所述部件三维点云模型一一对应。In the scene 3D point cloud model, based on the components of the actual scene equipment, the whole scene point cloud data is clustered and divided, so as to obtain the component 3D point cloud model, and then realize the whole scene point cloud data. There is a one-to-one correspondence with the three-dimensional point cloud model of the scene and the three-dimensional point cloud model of the component.
  3. 根据权利要求2所述的机器人任务部署方法,其特征在于,在所述获得部件三维点云模型,进而实现所述全场景点云数据分别与所述场景三维点云模型和所述部件三维点云模型一一对应之后包括:The robot task deployment method according to claim 2, characterized in that, in the obtaining of the three-dimensional point cloud model of the component, the point cloud data of the whole scene are further combined with the three-dimensional point cloud model of the scene and the three-dimensional point cloud of the component, respectively. After one-to-one correspondence, the cloud models include:
    向所述部件三维点云模型中的模型部件导入相应的预设部件属性信息,所述预设部件属性信息包括部件铭牌信息和相应的巡检历史数据;importing corresponding preset component attribute information into the model component in the three-dimensional point cloud model of the component, where the preset component attribute information includes component nameplate information and corresponding inspection history data;
    在所述部件三维点云模型中,建立所述模型部件与相应的所述预设部件属性信息的关联关系,从而通过所述模型部件查看关联的所述预设部件属性信息。In the three-dimensional point cloud model of the component, an association relationship between the model component and the corresponding preset component attribute information is established, so that the associated preset component attribute information can be viewed through the model component.
  4. 根据权利要求3所述的机器人任务部署方法,其特征在于,所述部件铭牌信息包括实际部件名称、实际部件材料属性和实际部件设置参数。The robot task deployment method according to claim 3, wherein the part nameplate information includes an actual part name, an actual part material property, and an actual part setting parameter.
  5. 根据权利要求1所述的机器人任务部署方法,其特征在于,所述通过预先建立的机器人三维模型根据下发的巡检任务在所述可行走路径网中行走之前包括:The method for deploying a robot task according to claim 1, wherein the step of using a pre-established three-dimensional model of the robot to walk in the walkable path network according to the issued inspection task includes:
    基于所述机器人以及与所述机器人对应的执行终端建立机器人三维模型;Building a three-dimensional model of the robot based on the robot and the execution terminal corresponding to the robot;
    向所述机器人三维模型导入所述机器人和所述执行终端的预设机器人属性信息,所述预设机器人属性信息包括实际机器人材料属性和执行终端材料属性。Importing preset robot attribute information of the robot and the execution terminal into the three-dimensional model of the robot, where the preset robot attribute information includes actual robot material attributes and execution terminal material attributes.
  6. 根据权利要求3所述的机器人任务部署方法,其特征在于,所述通过预先建立的机器人三维模型根据下发的巡检任务在所述可行走路径网中行走,从而获得与所述巡检任务对应的部署信息具体包括:The method for deploying a robot task according to claim 3, wherein the robot walks in the traversable path network according to the inspection task issued by the pre-established three-dimensional model of the robot, so as to obtain the inspection task corresponding to the inspection task. The corresponding deployment information specifically includes:
    在所述预先建立的场景三维点云模型建立三维坐标系;Establishing a three-dimensional coordinate system on the pre-established three-dimensional point cloud model of the scene;
    根据所述巡检任务控制所述预先建立的机器人三维模型在所述可行走路径网沿预设的巡检路线行走,从而确定所述巡检任务对应的巡检点位及所述模型部件;According to the inspection task, control the pre-established three-dimensional robot model to walk along the preset inspection route on the walkable path network, so as to determine the inspection point corresponding to the inspection task and the model component;
    根据三维坐标系获得所述机器人对应的所述巡检点位的部署信息,所述部署信息包括所述巡检点位的坐标值、所述机器人的位姿以及所述机器人的执行终端的执行角度和执行焦距。The deployment information of the inspection point corresponding to the robot is obtained according to the three-dimensional coordinate system, and the deployment information includes the coordinate value of the inspection point, the pose of the robot, and the execution of the execution terminal of the robot. angle and execution focal length.
  7. 根据权利要求6所述的机器人任务部署方法,其特征在于,所述根据三维坐标系获得所述机器人对应的所述巡检点位的部署信息具体包括:The robot task deployment method according to claim 6, wherein the obtaining the deployment information of the inspection point corresponding to the robot according to the three-dimensional coordinate system specifically includes:
    基于三维坐标系计算所述巡检点位和所述模型部件的坐标值;Calculate the coordinate value of the inspection point and the model component based on the three-dimensional coordinate system;
    根据相邻的所述巡检点位的坐标值计算对应的相邻的所述巡检点位的点位距离;Calculate the point distance of the corresponding adjacent inspection points according to the coordinate values of the adjacent inspection points;
    将所述点位距离与预设点位距离对比,当所述点位距离小于所述预设点位距离时,则将对应的相邻的所述巡检点位作为同一巡检点位,从而将同一巡检点位的部署信息作为对应的相邻的所述巡检点位的部署信息。Comparing the point distance with the preset point distance, when the point distance is less than the preset point distance, the corresponding adjacent inspection points are regarded as the same inspection point, Therefore, the deployment information of the same inspection point is used as the deployment information of the corresponding adjacent inspection point.
  8. 一种机器人任务部署系统,其特征在于,包括:A robot task deployment system, comprising:
    路径确定模块,用于基于预先建立的场景三维点云模型确定机器人的所有可行走路径,从而形成可行走路径网;The path determination module is used to determine all walkable paths of the robot based on the pre-established 3D point cloud model of the scene, thereby forming a walkable path network;
    获取模块,用于通过预先建立的机器人三维模型根据下发的巡检任务在所述可行走路径网中行走,从而获得与所述巡检任务对应的部署信息;an acquisition module, configured to walk in the walkable path network according to the issued inspection task through a pre-established three-dimensional model of the robot, so as to obtain deployment information corresponding to the inspection task;
    部署模块,用于根据所述巡检任务及对应的所述部署信息完成所述机器人的任务部署;a deployment module, configured to complete the task deployment of the robot according to the inspection task and the corresponding deployment information;
    第一关联模块,用于根据所述巡检任务控制所述机器人进行自动巡检从而获得巡检结果,将所述巡检结果与所述预先建立的场景三维点云模型建立关联关系,从而在所述预先建立的场景三维点云模型中查看所述巡检结果。The first association module is used to control the robot to perform automatic inspection according to the inspection task to obtain inspection results, and establish an association relationship between the inspection results and the pre-established three-dimensional point cloud model of the scene, so as to obtain the inspection results. Check the inspection result in the pre-established three-dimensional point cloud model of the scene.
  9. 一种电子设备,其特征在于,包括:处理器和存储器,所述存储器用于存储程序指令,所述处理器用于执行所述存储器中存储的计算机程序时实现如权利要求1~7中任一项所述的机器人任务部署方法的步骤。An electronic device, comprising: a processor and a memory, the memory is used for storing program instructions, and the processor is used for implementing any one of claims 1-7 when executing the computer program stored in the memory The steps of the robot task deployment method described in item.
  10. 一种存储介质,其特征在于,其存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1~7中任一项所述的机器人任务部署方法的步骤。A storage medium, characterized in that it stores a computer program, and when the computer program is executed by a processor, implements the steps of the method for deploying a robot task according to any one of claims 1 to 7 .
PCT/CN2021/136043 2020-12-21 2021-12-07 Robot task deployment method and system, device, and storage medium WO2022135138A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011519589.8 2020-12-21
CN202011519589.8A CN112549034B (en) 2020-12-21 2020-12-21 Robot task deployment method, system, equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2022135138A1 true WO2022135138A1 (en) 2022-06-30

Family

ID=75031636

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/136043 WO2022135138A1 (en) 2020-12-21 2021-12-07 Robot task deployment method and system, device, and storage medium

Country Status (2)

Country Link
CN (1) CN112549034B (en)
WO (1) WO2022135138A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115755954A (en) * 2022-10-28 2023-03-07 佳源科技股份有限公司 Routing inspection path planning method and system, computer equipment and storage medium

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112549034B (en) * 2020-12-21 2021-09-03 南方电网电力科技股份有限公司 Robot task deployment method, system, equipment and storage medium
CN113190019B (en) * 2021-05-26 2023-05-16 立得空间信息技术股份有限公司 Virtual simulation-based routing inspection robot task point arrangement method and system
CN113500605B (en) * 2021-09-13 2022-01-25 中科开创(广州)智能科技发展有限公司 Inspection task visualization method and device, computer equipment and storage medium
CN114089770B (en) * 2021-11-23 2024-04-12 广东电网有限责任公司 Inspection point position generation method and related device for substation inspection robot

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100779510B1 (en) * 2007-05-23 2007-11-27 문용선 Patrol robot and control system therefor
CN105182792A (en) * 2015-08-10 2015-12-23 西南科技大学 Robot working simulation system under nuclear radiation environment and method thereof
CN106710001A (en) * 2016-12-29 2017-05-24 山东鲁能智能技术有限公司 Substation inspection robot based centralized monitoring and simulation system and method thereof
CN108422435A (en) * 2018-03-21 2018-08-21 青岛理工大学 A kind of long-range monitoring and control system based on augmented reality
CN110544298A (en) * 2019-08-29 2019-12-06 中国南方电网有限责任公司 transformer substation modeling method and device, computer equipment and storage medium
CN110908370A (en) * 2019-10-31 2020-03-24 华能国际电力股份有限公司海门电厂 Unmanned inspection task planning method and system for thermal power plant
CN111552306A (en) * 2020-04-10 2020-08-18 安徽继远软件有限公司 Unmanned aerial vehicle path generation method and device supporting pole tower key component inspection
CN111897332A (en) * 2020-07-30 2020-11-06 国网智能科技股份有限公司 Semantic intelligent substation robot humanoid inspection operation method and system
CN112549034A (en) * 2020-12-21 2021-03-26 南方电网电力科技股份有限公司 Robot task deployment method, system, equipment and storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108805327B (en) * 2018-04-23 2022-04-26 西安科技大学 Method and system for robot path planning and environment reconstruction based on virtual reality
CN108839016B (en) * 2018-06-11 2021-04-20 深圳市百创网络科技有限公司 Robot inspection method, storage medium, computer equipment and inspection robot
CN109240311B (en) * 2018-11-19 2021-06-25 国网四川省电力公司电力科学研究院 Outdoor electric power field construction operation supervision method based on intelligent robot
CN110648420A (en) * 2019-09-20 2020-01-03 云南恒协科技有限公司 Intelligent inspection system for scheduling master station system equipment
CN110722559A (en) * 2019-10-25 2020-01-24 国网山东省电力公司信息通信公司 Auxiliary inspection positioning method for intelligent inspection robot
CN111968262B (en) * 2020-07-30 2022-05-20 国网智能科技股份有限公司 Semantic intelligent substation inspection operation robot navigation system and method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100779510B1 (en) * 2007-05-23 2007-11-27 문용선 Patrol robot and control system therefor
CN105182792A (en) * 2015-08-10 2015-12-23 西南科技大学 Robot working simulation system under nuclear radiation environment and method thereof
CN106710001A (en) * 2016-12-29 2017-05-24 山东鲁能智能技术有限公司 Substation inspection robot based centralized monitoring and simulation system and method thereof
CN108422435A (en) * 2018-03-21 2018-08-21 青岛理工大学 A kind of long-range monitoring and control system based on augmented reality
CN110544298A (en) * 2019-08-29 2019-12-06 中国南方电网有限责任公司 transformer substation modeling method and device, computer equipment and storage medium
CN110908370A (en) * 2019-10-31 2020-03-24 华能国际电力股份有限公司海门电厂 Unmanned inspection task planning method and system for thermal power plant
CN111552306A (en) * 2020-04-10 2020-08-18 安徽继远软件有限公司 Unmanned aerial vehicle path generation method and device supporting pole tower key component inspection
CN111897332A (en) * 2020-07-30 2020-11-06 国网智能科技股份有限公司 Semantic intelligent substation robot humanoid inspection operation method and system
CN112549034A (en) * 2020-12-21 2021-03-26 南方电网电力科技股份有限公司 Robot task deployment method, system, equipment and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115755954A (en) * 2022-10-28 2023-03-07 佳源科技股份有限公司 Routing inspection path planning method and system, computer equipment and storage medium
CN115755954B (en) * 2022-10-28 2023-07-25 佳源科技股份有限公司 Routing inspection path planning method, system, computer equipment and storage medium

Also Published As

Publication number Publication date
CN112549034A (en) 2021-03-26
CN112549034B (en) 2021-09-03

Similar Documents

Publication Publication Date Title
WO2022135138A1 (en) Robot task deployment method and system, device, and storage medium
Rebolj et al. Point cloud quality requirements for Scan-vs-BIM based automated construction progress monitoring
CN110689585B (en) Multi-phase external parameter combined calibration method, device, equipment and medium
CN111627114A (en) Indoor visual navigation method, device and system and electronic equipment
CN107223269A (en) Three-dimensional scene positioning method and device
US20160300389A1 (en) Correlated immersive virtual simulation for indoor navigation
US11074755B2 (en) Method, device, terminal device and storage medium for realizing augmented reality image
TW202113759A (en) Three-dimensional scene engineering simulation and real scene fusion system and method
WO2023093217A1 (en) Data labeling method and apparatus, and computer device, storage medium and program
CN109325978A (en) The determination method and device of method, posture information that augmented reality is shown
US10726614B2 (en) Methods and systems for changing virtual models with elevation information from real world image processing
CN112929602B (en) Data monitoring method and device based on image processing and related equipment
Gomez-Jauregui et al. Quantitative evaluation of overlaying discrepancies in mobile augmented reality applications for AEC/FM
CN111612852A (en) Method and apparatus for verifying camera parameters
CN111708033A (en) Coordinate system calibration method and device, electronic equipment and storage medium
US20240078701A1 (en) Location determination and mapping with 3d line junctions
CN114782646A (en) House model modeling method and device, electronic equipment and readable storage medium
CN114998433A (en) Pose calculation method and device, storage medium and electronic equipment
CN104501797A (en) Navigation method based on augmented reality IP map
KR20010055957A (en) Image Registration Method Using 3D Tracker And Computer Vision For Augmented Reality
CN111127661B (en) Data processing method and device and electronic equipment
CN111207672B (en) AR (augmented reality) measuring method
CN103903253A (en) Mobile terminal positioning method and system
WO2023088127A1 (en) Indoor navigation method, server, apparatus and terminal
Nguyen et al. Interactive syntactic modeling with a single-point laser range finder and camera

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21909135

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21909135

Country of ref document: EP

Kind code of ref document: A1