CN113110482B - Indoor environment robot exploration method and system based on priori information heuristic method - Google Patents

Indoor environment robot exploration method and system based on priori information heuristic method Download PDF

Info

Publication number
CN113110482B
CN113110482B CN202110475488.3A CN202110475488A CN113110482B CN 113110482 B CN113110482 B CN 113110482B CN 202110475488 A CN202110475488 A CN 202110475488A CN 113110482 B CN113110482 B CN 113110482B
Authority
CN
China
Prior art keywords
point
heuristic
area
boundary
robot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110475488.3A
Other languages
Chinese (zh)
Other versions
CN113110482A (en
Inventor
迟文政
刘杰
袁媛
丁智宇
陈国栋
孙立宁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou University
Original Assignee
Suzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou University filed Critical Suzhou University
Priority to CN202110475488.3A priority Critical patent/CN113110482B/en
Publication of CN113110482A publication Critical patent/CN113110482A/en
Application granted granted Critical
Publication of CN113110482B publication Critical patent/CN113110482B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G05D1/0251Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0221Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving a learning process
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0223Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving speed control of the vehicle
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0276Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Manipulator (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

The invention relates to a heuristic indoor environment robot exploration method and system based on prior information, which comprises the following steps: the robot acquires data of surrounding environment information through a sensor carried by the robot; updating a part of map into a known area based on data of the surrounding environment information to obtain an updated map; performing boundary extraction on the updated map by using two fast search random trees to obtain RRT boundary points; identifying a heuristic object and carrying out position estimation on the heuristic object, constructing a prior area by taking the position of the heuristic object as a reference, and extracting boundary points in the prior area to obtain room boundary points; based on the RRT boundary points and the room boundary points, the robot performs indoor environment exploration. The robot preferentially explores the environment in the prior area, can preferentially explore one room area and then turn to other areas, effectively reduces backtracking in the exploration process, and improves exploration efficiency.

Description

基于先验信息启发式的室内环境机器人探索方法及系统Indoor environment robot exploration method and system based on prior information heuristic

技术领域technical field

本发明涉及机器人探索技术领域,尤其是指一种基于先验信息启发式的室内环境机器人探索方法及系统。The invention relates to the technical field of robot exploration, in particular to an indoor environment robot exploration method and system based on a priori information heuristic.

背景技术Background technique

人工智能技术的突破给移动型服务机器人研究带来了巨大的机遇,智能公共服务机器人应用场景和服务模式不断拓展,带动我国服务机器人市场规模高速增长。移动型机器人自主探索是指机器人在没有任何先验知识的情况下,在一个新的环境中通过移动而建立完整环境地图的过程。目前,主要的自主探索方法可以大致分为两类:基于栅格地图的探索方法、基于特征地图的探索方法。其中,基于栅格地图的方法表征信息丰富、分辨率高,有利于对边界点信息增益模型的构建,因此我们也采用基于栅格地图的方法展开机器人自主探索的研究。基于栅格地图的研究方法中主流的是基于边界点的探索方法,该方法将探测空间划分为已知区域和未知区域,并引导机器人收集信息更新地图。为了更有效地探测环境,这种探测方法的重点主要是如何探测和选择边界。边界的选择直接影响探索效率。目前,已有的机器人探索策略大多集中在如何设计边界点信息增益模型以选择收益值较大的边界点。但是这种信息增益模型仅仅考量的是当前时刻的探索路径成本和更新该边界点周围小部分地图带来的的信息收益,而忽略了环境中障碍物的几何连续性。比如,在室内环境下,机器人在进入一个房间探索后,一般会有两种动作:①将房间区域探索完成再转向房间外探索;②房间区域还未探索完成就转向了房间外,之后再次进入房间探索。显然,第二种动作更浪费时间,效率更低;第一种继续向下探索的行动的期望收益值更大。但是,目前的机器人探索策略都是独立地评估候选边界点,而忽略环境结构的潜在收益,所以像第二种动作这种探索策略的回溯现象时常发生。The breakthrough of artificial intelligence technology has brought huge opportunities to the research of mobile service robots. The application scenarios and service models of intelligent public service robots continue to expand, driving the rapid growth of my country's service robot market. Autonomous exploration of mobile robots refers to the process that robots build a complete environment map by moving in a new environment without any prior knowledge. At present, the main autonomous exploration methods can be roughly divided into two categories: grid map-based exploration methods and feature map-based exploration methods. Among them, the method based on the grid map has rich representation information and high resolution, which is conducive to the construction of the information gain model of the boundary point. Therefore, we also use the method based on the grid map to carry out research on the autonomous exploration of robots. The mainstream research method based on grid map is the exploration method based on boundary points, which divides the detection space into known areas and unknown areas, and guides the robot to collect information to update the map. In order to detect the environment more effectively, this detection method mainly focuses on how to detect and select boundaries. The choice of boundaries directly affects the exploration efficiency. At present, most of the existing robot exploration strategies focus on how to design a boundary point information gain model to select a boundary point with a larger profit value. However, this information gain model only considers the cost of the exploration path at the current moment and the information gain brought by updating a small part of the map around the boundary point, while ignoring the geometric continuity of obstacles in the environment. For example, in an indoor environment, after a robot enters a room to explore, it generally has two actions: ① After completing the exploration of the room area, it turns to the outside of the room to explore; ② The room area has not been explored and turns to the outside of the room, and then enters again. Room exploration. Obviously, the second action is more time-consuming and less efficient; the expected benefit of the first action that continues to explore downwards is greater. However, current robot exploration strategies evaluate candidate boundary points independently, ignoring the potential benefits of environmental structure, so the backtracking phenomenon of exploration strategies like the second action often occurs.

发明内容SUMMARY OF THE INVENTION

为此,本发明所要解决的技术问题在于克服现有技术中机器人探索过程中,忽略环境结构的潜在收益,出现回溯现象的技术缺陷。Therefore, the technical problem to be solved by the present invention is to overcome the technical defect of the backtracking phenomenon in the process of robot exploration in the prior art, ignoring the potential benefits of the environmental structure.

为解决上述技术问题,本发明提供了一种基于先验信息启发式的室内环境机器人探索方法,包括以下步骤:In order to solve the above technical problems, the present invention provides an indoor environment robot exploration method based on a priori information heuristic, including the following steps:

S1、机器人通过自身携带的传感器采集周围环境信息的数据;S1. The robot collects the data of the surrounding environment information through the sensor carried by itself;

S2、基于周围环境信息的数据更新一部分地图为已知区域,获得更新后的地图;S2. Update a part of the map to a known area based on the data of the surrounding environment information, and obtain the updated map;

S3、使用两棵快速搜索随机树对更新后的地图进行边界提取,获得RRT边界点;S3. Use two fast search random trees to extract the boundary of the updated map to obtain the RRT boundary point;

S4、识别启发式物体并对其进行位置估计,以启发式物体的位置为基准构建先验区域,在先验区域内提取边界点,获得房间边界点;其中,启发式物体为门;S4. Identify the heuristic object and perform position estimation on it, construct a priori region based on the position of the heuristic object, extract boundary points in the priori region, and obtain room boundary points; wherein, the heuristic object is a door;

S5、基于RRT边界点和房间边界点,机器人进行室内环境探索。S5. Based on the RRT boundary point and the room boundary point, the robot explores the indoor environment.

作为优选的,所述S5包括:Preferably, the S5 includes:

S51、当房间边界点存在时,选择收益值最大的房间边界点作为目标点,当没有房间边界点存在时,则选取收益值最大的RRT边界点作为目标点;S51. When the room boundary point exists, select the room boundary point with the largest income value as the target point, and when there is no room boundary point, select the RRT boundary point with the largest income value as the target point;

S52、引导机器人向目标点导航。S52, guide the robot to navigate to the target point.

作为优选的,边界点的收益值R1f=w1*If-w2*NfPreferably, the profit value of the boundary point R1 f =w 1 *I f -w 2 *N f ,

其中,If为信息增益,信息增益指在质心点的信息增益半径r=1内未知的栅格的个数,Among them, If is the information gain, the information gain refers to the number of unknown grids within the information gain radius r =1 of the centroid point,

Nf为路径成本,路径成本指机器人当前位置与质心点位置的欧式距离;N f is the path cost, and the path cost refers to the Euclidean distance between the robot's current position and the position of the center of mass;

w1和w2为自定义权重,为一个常量。w 1 and w 2 are custom weights, which are constants.

作为优选的,所述S5之后还包括:Preferably, after the S5, it also includes:

S6、当先验区域内检测不到边界点时,表示该区域已经探索完成,则销毁先验区域的模型以便下一个启发式区域的形成;S6. When no boundary point is detected in the a priori area, it means that the area has been explored, and the model of the prior area is destroyed to form the next heuristic area;

S7、循环S1-S6,直至机器人探索完整个环境,获得栅格地图。S7, loop S1-S6 until the robot explores the entire environment and obtains a grid map.

作为优选的,所述S3包括:Preferably, the S3 includes:

S31、在初始化阶段,将起点添加到树结构中作为根节点,其中,两棵树的起点都是人为在地图的空闲区域内设定的;S31, in the initialization phase, add the starting point to the tree structure as the root node, wherein the starting points of the two trees are artificially set in the free area of the map;

S32、在地图区域内随机撒点作为候选点;S32, randomly sprinkle points in the map area as candidate points;

S33、若候选点在已知区域内,遍历树结构上的所有已有的节点,选取距离候选点最近的节点作为最邻近点,最邻近点到候选节点的连线作为生长方向,若最邻近点与候选节点的距离超过预先设定的步长,则由最邻近点沿着生长方向生长一个步长,到达的点作为生长点,若距离不超过步长,则该候选点作为生长点;S33. If the candidate point is in the known area, traverse all existing nodes on the tree structure, select the node closest to the candidate point as the nearest neighbor point, and use the connection line from the nearest neighbor point to the candidate node as the growth direction. If the distance between the point and the candidate node exceeds the preset step size, the nearest point grows one step size along the growth direction, and the reached point is used as the growth point. If the distance does not exceed the step size, the candidate point is used as the growth point;

若候选点在未知区域内,则先找到该候选点的最邻近树节点,最邻近点到候选点的连线作为生长方向,由最邻近点沿着生长方向向前生长,到达边界的地方作为边界点。If the candidate point is in the unknown area, first find the nearest tree node of the candidate point, and the connection line from the nearest point to the candidate point is used as the growth direction, and the nearest point grows forward along the growth direction, and the place where it reaches the boundary is used as the growth direction. boundary point.

作为优选的,所述S33之后还包括:Preferably, the S33 further includes:

S34、将生长点和候选节点的连线在地图上做碰撞检测,具体包括:S34. Perform collision detection on the map for the connection between the growth point and the candidate node, specifically including:

遍历生长点和候选节点的连线上所有的栅格点,判断栅格点的栅格状态;Traverse all grid points on the connection between the growth point and the candidate node, and judge the grid state of the grid point;

若栅格点的状态是被占据的,则碰撞检测不通过,返回S32重新进行采点;If the state of the grid point is occupied, the collision detection fails, and returns to S32 to collect points again;

若生长点和候选节点的连线没有碰到障碍物,将候选点、生长点和候选节点的连线添加到树结构中。If the connection between the growing point and the candidate node does not encounter obstacles, add the connection between the candidate point, the growing point and the candidate node to the tree structure.

作为优选的,所述S4中,识别启发式物体并对其进行位置估计,包括:Preferably, in said S4, identifying heuristic objects and performing position estimation on them, including:

构建轻量级网络,基于深度学习的方法完成启发式物体的识别,获取启发式物体的坐标信息;其中,所述轻量级网络包括卷积层、逆残差块、池化层和SSP层。Construct a lightweight network, complete the recognition of heuristic objects based on the deep learning method, and obtain the coordinate information of the heuristic objects; wherein, the lightweight network includes a convolution layer, an inverse residual block, a pooling layer and an SSP layer .

作为优选的,所述S4中,以启发式物体的位置为基准构建先验区域,包括:Preferably, in the S4, a priori region is constructed based on the position of the heuristic object, including:

在机器人识别到启发式物体时,若机器人位置在启发式物体的下方,则预估的房间区域在启发式物体的位置的上方,若机器人位置在启发式物体的上方时,预估的房间区域在启发式物体的位置的下方;When the robot recognizes the heuristic object, if the robot's position is below the heuristic object, the estimated room area is above the heuristic object. If the robot's position is above the heuristic object, the estimated room area below the position of the heuristic object;

其中,所述预估的房间区域的长度为启发式物体的位置向两侧延伸长度a,预估区域的宽度为启发式物体的位置向后延伸长度2b。其中,参数a,b由经验设定。Wherein, the length of the estimated room area is the position of the heuristic object extending to both sides by a length a, and the width of the estimated area is the position of the heuristic object extending backward by a length 2b. Among them, the parameters a and b are set by experience.

作为优选的,所述S4中,在先验区域内提取边界点,获得房间边界点,包括以下步骤:Preferably, in said S4, extracting boundary points in the priori region to obtain room boundary points, including the following steps:

对先验区域的图像做二值化处理,获得二值化图像,其中,二值化图像的障碍物为白色,其余区域为黑色;Perform binarization processing on the image of the prior area to obtain a binarized image, in which the obstacles of the binarized image are white, and the rest of the area is black;

对所述二值化图像进行颜色翻转,获得颜色翻转后的图像,其中,颜色翻转后的图像的障碍物为黑色,其余区域为白色;Perform color flipping on the binarized image to obtain a color flipped image, wherein the obstacles in the color flipped image are black, and the rest of the area is white;

采用Canny算子对二值化图像做边缘检测,检测结果中将图像的边缘设置为白色,其余区域为黑色;The Canny operator is used to detect the edge of the binarized image. In the detection result, the edge of the image is set to white, and the rest of the area is black;

将二值化图像和颜色翻转后的图像进行按位与操作以去除多余的白色边缘,获得最终图像,其中,最终图像中的已知区域与未知区域之间的边界由一条条直线组成;Perform a bitwise AND operation on the binarized image and the color-flipped image to remove excess white edges to obtain a final image, where the boundary between the known area and the unknown area in the final image consists of straight lines;

提取直线的重心,即为房间边界点。Extract the center of gravity of the line, which is the room boundary point.

本发明还公开了一种基于先验信息启发式的室内环境机器人探索系统,其特征在于,包括:The invention also discloses an indoor environment robot exploration system based on a priori information heuristic, which is characterized by comprising:

数据采集模块,所述数据采集模块用于机器人通过自身携带的传感器采集周围环境信息的数据;a data acquisition module, the data acquisition module is used for the robot to collect the data of the surrounding environment information through the sensor carried by the robot;

定位与建图模块,所述定位与建图模块基于周围环境信息的数据更新一部分地图为已知区域,获得更新后的地图;A positioning and mapping module, the positioning and mapping module updates a part of the map as a known area based on the data of the surrounding environment information, and obtains the updated map;

RRT边界点提取模块,所述RRT边界点提取模块使用两棵快速搜索随机树对更新后的地图进行边界提取,获得RRT边界点;RRT boundary point extraction module, the RRT boundary point extraction module uses two fast search random trees to perform boundary extraction on the updated map to obtain RRT boundary points;

房间边界点提取模块,所述房间边界点提取模块用于识别启发式物体并对其进行位置估计,以启发式物体的位置为基准构建先验区域,在先验区域内提取边界点,获得房间边界点;The room boundary point extraction module is used to identify the heuristic object and perform position estimation on it, construct a priori region based on the position of the heuristic object, extract the boundary point in the priori region, and obtain the room border point;

环境探索模块,所述环境探索模块基于RRT边界点和房间边界点,机器人进行室内环境探索。An environment exploration module, the environment exploration module is based on the RRT boundary point and the room boundary point, and the robot performs indoor environment exploration.

本发明的上述技术方案相比现有技术具有以下优点:The above-mentioned technical scheme of the present invention has the following advantages compared with the prior art:

本发明通过引入启发式先验信息探索模块,当机器人识别到启发式物体后,优先探索先验区域内的环境,可以使机器人优先探索完一个房间区域再转向其它区域,有效减少探索过程中的回溯现象,提升探索效率。By introducing a heuristic prior information exploration module, when the robot recognizes the heuristic object, it will first explore the environment in the prior area, so that the robot can first explore a room area and then turn to other areas, effectively reducing the amount of time in the exploration process. Retrospect the phenomenon and improve the efficiency of exploration.

附图说明Description of drawings

图1为本发明中室内环境机器人探索方法的示意图;Fig. 1 is the schematic diagram of the indoor environment robot exploration method in the present invention;

图2为本发明中的机器人探索的流程图;Fig. 2 is the flow chart of robot exploration in the present invention;

图3为快速搜索随机树提取边界点的过程示意图;Fig. 3 is the process schematic diagram of fast search random tree extraction boundary point;

图4为先验区域的构造的结构示意图;Fig. 4 is the structural schematic diagram of the structure of the prior region;

图5为场景一仿真环境结构图;Fig. 5 is a scene-simulation environment structure diagram;

图6为场景二仿真环境结构图;Fig. 6 is the structure diagram of the simulation environment of scene two;

图7为场景三仿真环境结构图。FIG. 7 is a structural diagram of the simulation environment of scene three.

具体实施方式Detailed ways

下面结合附图和具体实施例对本发明作进一步说明,以使本领域的技术人员可以更好地理解本发明并能予以实施,但所举实施例不作为对本发明的限定。The present invention will be further described below with reference to the accompanying drawings and specific embodiments, so that those skilled in the art can better understand the present invention and implement it, but the embodiments are not intended to limit the present invention.

参照图3所示,本发明公开了一种基于先验信息启发式的室内环境机器人探索方法,包括以下步骤:Referring to FIG. 3 , the present invention discloses a method for exploring an indoor environment robot based on a priori information heuristic, including the following steps:

步骤一、机器人通过自身携带的传感器采集周围环境信息的数据。开始时,整张栅格地图都是未知的,机器人处于环境中的某一位置,机器人通过自身携带的传感器获取周围环境信息的数据。Step 1: The robot collects data of surrounding environment information through sensors carried by itself. At the beginning, the entire grid map is unknown, the robot is in a certain position in the environment, and the robot obtains the data of the surrounding environment information through the sensors it carries.

步骤二、基于周围环境信息的数据更新一部分地图为已知区域,获得更新后的地图。Step 2: Update a part of the map to a known area based on the data of the surrounding environment information, and obtain the updated map.

定位与地图构建(SLAM)模块接收传感器数据,更新一部分地图为已知的区域,同时SLAM构建的地图可以反过来修正机器人的位姿。The localization and map construction (SLAM) module receives sensor data, updates a part of the map to a known area, and the map constructed by SLAM can in turn correct the robot's pose.

步骤三、使用两棵快速搜索随机树对更新后的地图进行边界提取,获得RRT边界点,包括以下步骤:Step 3. Use two fast search random trees to extract the boundaries of the updated map to obtain RRT boundary points, including the following steps:

S31、在初始化阶段,将起点添加到树结构中作为根节点,其中,两棵树的起点都是人为在地图的空闲区域内设定的;S31, in the initialization phase, add the starting point to the tree structure as the root node, wherein the starting points of the two trees are artificially set in the free area of the map;

S32、在地图区域内随机撒点作为候选点;S32, randomly sprinkle points in the map area as candidate points;

S33、如图3所示,我们以三个采样点1,2,3为例说明边界点提取过程。若候选点在已知区域内,遍历树结构上的所有已有的节点,选取距离候选点最近的节点作为最邻近点,最邻近点到候选节点的连线作为生长方向。如图3中候选点2所示,候选点2处于已知区域中,图中的带有箭头的虚线是生长方向。若最邻近点与候选节点的距离超过预先设定的步长,则由最邻近点沿着生长方向生长一个步长,到达的点作为生长点,若距离不超过步长,则该候选点作为生长点;S33. As shown in Figure 3, we take three sampling points 1, 2, and 3 as examples to illustrate the boundary point extraction process. If the candidate point is in the known area, traverse all existing nodes on the tree structure, select the node closest to the candidate point as the nearest neighbor point, and the connection line from the nearest neighbor point to the candidate node as the growth direction. As shown in candidate point 2 in FIG. 3 , candidate point 2 is in a known region, and the dotted line with an arrow in the figure is the growth direction. If the distance between the nearest neighbor point and the candidate node exceeds the preset step size, the nearest neighbor point will grow one step size along the growth direction, and the reached point will be used as the growth point. If the distance does not exceed the step size, the candidate point will be used as the growth point. growing point;

若候选点在未知区域内,则先找到该候选点的最邻近树节点,最邻近点到候选点的连线作为生长方向,由最邻近点沿着生长方向向前生长,到达边界的地方作为边界点。If the candidate point is in the unknown area, first find the nearest tree node of the candidate point, and the connection line from the nearest point to the candidate point is used as the growth direction, and the nearest point grows forward along the growth direction, and the place where it reaches the boundary is used as the growth direction. boundary point.

上述方法体现的是从最邻近点沿生长方向开始遍历,栅格状态为未知的作为边界点。如图3中候选点1所示,候选点2处于未知区域中,图中的带有箭头的虚线是生长方向,则沿着生长方向,到达边界的地方作为边界点。The above method embodies the traversal from the nearest point along the growth direction, and the grid state is unknown as the boundary point. As shown in candidate point 1 in Figure 3, candidate point 2 is in an unknown area, and the dotted line with an arrow in the figure is the growth direction, then along the growth direction, the place where it reaches the boundary is used as the boundary point.

S34、将生长点和候选节点的连线在地图上做碰撞检测,具体包括:S34. Perform collision detection on the map for the connection between the growth point and the candidate node, specifically including:

遍历生长点和候选节点的连线上所有的栅格点,判断栅格点的栅格状态;Traverse all grid points on the connection between the growth point and the candidate node, and judge the grid state of the grid point;

若栅格点的状态是被占据的(即障碍物),则碰撞检测不通过,返回S32重新进行采点;If the state of the grid point is occupied (that is, an obstacle), the collision detection fails, and returns to S32 to collect points again;

若生长点和候选节点的连线没有碰到障碍物,将候选点、生长点和候选节点的连线添加到树结构中。如图3中候选点3所示,候选点与最邻近点的连线跨越了障碍物,因此碰撞检测不通过,须重新采点。If the connection between the growing point and the candidate node does not encounter obstacles, add the connection between the candidate point, the growing point and the candidate node to the tree structure. As shown in candidate point 3 in Figure 3, the connection line between the candidate point and the nearest point crosses the obstacle, so the collision detection fails, and the point must be re-collected.

本发明中的算法使用了两个快速搜索随机数,分为全局树和局部树。全局树通过上面的步骤进行边界点的提取,局部树对于边界点的提取原理和生长方式与全局树相同,不同的是当局部树探测到边界点后,局部树会被清除并在机器人当前位置重新生长。The algorithm in the present invention uses two fast search random numbers, divided into a global tree and a local tree. The global tree extracts the boundary points through the above steps. The extraction principle and growth method of the local tree for boundary points are the same as the global tree. grow back.

对于步骤三中,对于RRT边界点,可以过滤和剔除取消RRT边界点,具体的,将探测到的边界点通过mean-shift聚类算法聚类后得到质心点,这样可以过滤掉一部分边界点,减少计算消耗。同时在每一时刻,都检测该边界点的栅格状态以及在costmap(代价地图)中的值(costmap将每一栅格值划分在0~255之间,白色值为255,代表空闲状态;黑色值为0,代表障碍物;之间的值是灰色,代表未知的),若该栅格状态是空闲的(表明该栅格点已被探索)且costmap中值超过某一阈值,则表明该栅格点所在区域已被探索,该栅格点也作为无效点剔除。In step 3, for the RRT boundary points, the RRT boundary points can be filtered and eliminated. Specifically, the detected boundary points are clustered by the mean-shift clustering algorithm to obtain the centroid points, so that some boundary points can be filtered out. Reduce computational cost. At the same time, at each moment, the grid state of the boundary point and the value in the costmap (costmap) are detected (the costmap divides each grid value between 0 and 255, and the white value is 255, which represents the idle state; The black value is 0, representing obstacles; the value between is gray, representing unknown), if the grid state is idle (indicating that the grid point has been explored) and the value in the costmap exceeds a certain threshold, it indicates The area where the grid point is located has been explored, and the grid point is also culled as an invalid point.

步骤四、识别启发式物体并对其进行位置估计,以启发式物体的位置为基准构建先验区域,在先验区域内提取边界点,获得房间边界点;其中,启发式物体为门。Step 4: Identify the heuristic object and perform position estimation on it, construct a priori region based on the position of the heuristic object, extract boundary points in the priori region, and obtain room boundary points; wherein, the heuristic object is a door.

所述步骤四中,识别启发式物体并对其进行位置估计,包括:构建轻量级网络,基于深度学习的方法完成启发式物体的识别,获取启发式物体的坐标信息;其中,所述轻量级网络包括卷积层、逆残差块、池化层和SSP层。本发明中,改进的轻量化网络可以快速完成物体识别并将门的位置坐标发布出去。In the fourth step, identifying the heuristic object and estimating its position includes: constructing a lightweight network, completing the identification of the heuristic object based on a deep learning method, and obtaining the coordinate information of the heuristic object; wherein, the light The magnitude network includes convolutional layers, inverse residual blocks, pooling layers, and SSP layers. In the present invention, the improved lightweight network can quickly complete object recognition and publish the position coordinates of the door.

1、本发明使用一种基于深度学习的目标检测方法进行启发式物体的识别,它是在YOLOv4_tiny的基础上改进的轻量级网络。这个轻量级网络主要由卷积层、逆残差块、池化层和SPP(Spatial Pyramid Pooling)层组成,共42层,输出简化为两层。当输入尺寸为416×416×3时,对应的输出层分别为13×13×255和26×26×255。主干网络中的逆残差块可以有效地提高特征提取的维数,而位于深层的SPP层在空间上融合了局部特征和整体特征。与YOLOv4_tiny相比,这一轻量级网络的检测准确率提高了19.2%,接近YOLOv4,但速度几乎是YOLOv4的4倍。总的来说,这一轻量级网络在速度和精度方面都是非常有效的,它适合于启发式目标识别。1. The present invention uses a deep learning-based target detection method for heuristic object recognition, which is an improved lightweight network based on YOLOv4_tiny. This lightweight network is mainly composed of convolutional layers, inverse residual blocks, pooling layers and SPP (Spatial Pyramid Pooling) layers, with a total of 42 layers, and the output is simplified to two layers. When the input size is 416×416×3, the corresponding output layers are 13×13×255 and 26×26×255, respectively. The inverse residual block in the backbone network can effectively increase the dimension of feature extraction, while the SPP layer located in the deep layer spatially fuses local and global features. Compared with YOLOv4_tiny, the detection accuracy of this lightweight network is improved by 19.2%, which is close to YOLOv4, but almost 4 times faster than YOLOv4. Overall, this lightweight network is very efficient in terms of speed and accuracy, and it is suitable for heuristic object recognition.

2、当使用以上网络检测到启发式物体后,就可以获取到启发式物体的二维图像坐标信息(深度相机坐标系下的位置)。接下来实现二维点到三维点的映射,我们假设输出的启发式物体的中心点P在二维平面上的坐标为(x',y'),其在三维坐标系(即在世界坐标系下的位置)下的坐标为(x,y,z),它们之间存在如下映射关系:2. After the heuristic object is detected using the above network, the two-dimensional image coordinate information of the heuristic object (position in the depth camera coordinate system) can be obtained. Next, the mapping from two-dimensional points to three-dimensional points is realized. We assume that the coordinates of the center point P of the output heuristic object on the two-dimensional plane are (x', y'), which are in the three-dimensional coordinate system (that is, in the world coordinate system). The coordinates under the position below) are (x, y, z), and there is the following mapping relationship between them:

Figure BDA0003046901380000091
Figure BDA0003046901380000091

Figure BDA0003046901380000092
Figure BDA0003046901380000092

Figure BDA0003046901380000093
Figure BDA0003046901380000093

为了方便实际转换计算,我们用齐次坐标表示相机参数,所以二维点到三维点的转换可表示为:In order to facilitate the actual conversion calculation, we use homogeneous coordinates to represent the camera parameters, so the conversion from 2D points to 3D points can be expressed as:

Figure BDA0003046901380000094
Figure BDA0003046901380000094

其中相机内参(fx,fy,cx,cy)可通过订阅深度相机在ROS下发布的话题得到,启发式物体的z坐标对下面步骤中先验区域的构造没有影响,因此这里不加说明。The camera internal parameters (f x , f y , c x , c y ) can be obtained by subscribing to the topic published by the depth camera under ROS. The z-coordinate of the heuristic object has no effect on the construction of the prior area in the following steps, so it is not here. add a description.

所述步骤四中,以启发式物体的位置为基准构建先验区域,包括:如图4所示,在机器人识别到启发式物体时,若机器人位置在启发式物体的下方,则预估的房间区域在启发式物体的位置的上方,若机器人位置在启发式物体的上方时,预估的房间区域在启发式物体的位置的下方;其中,所述预估的房间区域的长度为启发式物体的位置向两侧延伸长度a,预估区域的宽度为启发式物体的位置向后延伸长度2b。其中,参数a,b由经验设定。In the fourth step, a priori area is constructed based on the position of the heuristic object, including: as shown in Figure 4, when the robot recognizes the heuristic object, if the robot position is below the heuristic object, the estimated The room area is above the position of the heuristic object, and if the robot is positioned above the heuristic object, the estimated room area is below the position of the heuristic object; wherein, the estimated length of the room area is the heuristic The position of the object extends to both sides by a length a, and the width of the estimated area is the position of the heuristic object that extends backward by a length of 2b. Among them, the parameters a and b are set by experience.

本发明以启发式物体的位置为基准构造先验区域,此区域是遵从人类的感知习惯,门后所在的区域是一个房间,区域的大小是人为经验设定的,且保证在大多数场合略大于实际区域大小。The present invention constructs a priori area based on the position of the heuristic object. This area follows human perception habits. The area behind the door is a room. larger than the actual area size.

所述步骤四中,在先验区域内提取边界点,获得房间边界点,包括以下步骤:In the fourth step, the boundary points are extracted in the prior area to obtain the room boundary points, including the following steps:

1、由于原图是灰度图(障碍物为黑色,未知区域为灰色,空闲区域为白色),本发明可以直接进行二值化处理,其中阈值采用自适应方法,处理以后将障碍物设置为白色,其余区域为黑色;1. Since the original image is a grayscale image (the obstacle is black, the unknown area is gray, and the free area is white), the present invention can directly perform binarization processing, in which the threshold adopts an adaptive method, and the obstacle is set as White, the rest of the area is black;

2、对所述二值化图像进行颜色翻转,获得颜色翻转后的图像,其中,颜色翻转后的图像的障碍物为黑色,其余区域为白色;2. Perform color inversion on the binarized image to obtain a color-reversed image, wherein the obstacles of the color-reversed image are black, and the remaining areas are white;

3、采用Canny算子对二值化图像做边缘检测,检测结果中将图像的边缘设置为白色,其余区域为黑色;3. The Canny operator is used to detect the edge of the binarized image. In the detection result, the edge of the image is set to white, and the rest of the area is black;

4、将二值化图像和颜色翻转后的图像进行按位与操作以去除多余的白色边缘,获得最终图像,其中,最终图像中的已知区域与未知区域之间的边界由一条条直线组成;4. Perform a bitwise AND operation on the binarized image and the color-flipped image to remove excess white edges to obtain a final image, where the boundary between the known area and the unknown area in the final image consists of a straight line ;

5、提取直线的重心,即为房间边界点。5. Extract the center of gravity of the line, which is the room boundary point.

对于步骤四中的房间边界点,过滤和剔除无效房间边界点,具体的,将探测到的边界点通过mean-shift聚类算法聚类后得到质心点,这样可以过滤掉一部分边界点,减少计算消耗。同时在每一时刻,都检测该边界点的栅格状态以及在costmap(代价地图)中的值(costmap将每一栅格值划分在0~255之间,白色值为255,代表空闲状态;黑色值为0,代表障碍物;之间的值是灰色,代表未知的),若该栅格状态是空闲的(表明该栅格点已被探索)且costmap中值超过某一阈值,则表明该栅格点所在区域已被探索,该栅格点也应该作为无效点剔除。For the room boundary points in step 4, the invalid room boundary points are filtered and eliminated. Specifically, the detected boundary points are clustered by the mean-shift clustering algorithm to obtain the centroid points, which can filter out a part of the boundary points and reduce the computational cost. consume. At the same time, at each moment, the grid state of the boundary point and the value in the costmap (costmap) are detected (the costmap divides each grid value between 0 and 255, and the white value is 255, which represents the idle state; The black value is 0, representing obstacles; the value between is gray, representing unknown), if the grid state is idle (indicating that the grid point has been explored) and the value in the costmap exceeds a certain threshold, it indicates The area where the grid point is located has been explored, and the grid point should also be culled as an invalid point.

步骤五、基于RRT边界点和房间边界点,机器人进行室内环境探索,包括:Step 5. Based on the RRT boundary points and room boundary points, the robot conducts indoor environment exploration, including:

S51、当房间边界点存在时,机器人优先选择房间边界点探索,这样来使机器人在识别到启发式物体后,优先进入先验区域探索。当房间边界点存在时,表示先验区域还未探索完成,然后将房间边界点探索完后才会选择RRT边界点进行探索。这样机器人便能按照我们人为的设想,将一个区域探索完毕再转向别的区域探索。S51. When the room boundary point exists, the robot preferentially selects the room boundary point to explore, so that the robot can enter the priori area to explore preferentially after recognizing the heuristic object. When the room boundary point exists, it means that the prior area has not been explored, and then the RRT boundary point will be selected for exploration after the room boundary point has been explored. In this way, the robot can explore one area and then turn to other areas to explore according to our artificial assumptions.

当房间边界点存在时,选择收益值最大的房间边界点作为目标点,当没有房间边界点存在时,则选取收益值最大的RRT边界点作为目标点;When the room boundary point exists, the room boundary point with the largest revenue value is selected as the target point; when there is no room boundary point, the RRT boundary point with the largest revenue value is selected as the target point;

边界点的收益值R1f=w1*If-w2*NfThe income value of the boundary point R1 f = w 1 *I f -w 2 *N f ,

其中,If为信息增益,信息增益指在质心点的信息增益半径r=1内未知的栅格的个数,Among them, If is the information gain, the information gain refers to the number of unknown grids within the information gain radius r =1 of the centroid point,

Nf为路径成本,路径成本指机器人当前位置与质心点位置的欧式距离;N f is the path cost, and the path cost refers to the Euclidean distance between the robot's current position and the position of the center of mass;

w1和w2为自定义权重,为一个常量。w 1 and w 2 are custom weights, which are constants.

S52、引导机器人向目标点导航。使用A*全局路径规划算法在已知的环境中快速规划出一条由机器人当前位置到目标点的路径,并结合DWA局部路径规划算法使机器人很好的利用局部环境信息完成避障,将两者相结合引导机器人向目标点导航并更新地图。S52, guide the robot to navigate to the target point. Using the A* global path planning algorithm to quickly plan a path from the robot's current position to the target point in a known environment, and combined with the DWA local path planning algorithm, the robot can make good use of the local environment information to complete obstacle avoidance. The combination guides the robot to navigate to the target point and update the map.

步骤六、当先验区域内检测不到边界点时,表示该区域已经探索完成,则销毁先验区域的模型以便下一个启发式区域的形成。Step 6. When no boundary point is detected in the priori region, it means that the region has been explored, and the model of the priori region is destroyed to form the next heuristic region.

步骤七、循环步骤一至步骤六,直至机器人探索完整个环境,获得栅格地图。Step 7: Repeat steps 1 to 6 until the robot explores the entire environment and obtains a grid map.

本发明公开了一种基于先验信息启发式的室内环境机器人探索系统,包括数据采集模块、定位与建图模块、RRT边界点提取模块、房间边界点提取模块和环境探索模块。The invention discloses an indoor environment robot exploration system based on a priori information heuristic, including a data acquisition module, a positioning and mapping module, an RRT boundary point extraction module, a room boundary point extraction module and an environment exploration module.

所述数据采集模块用于机器人通过自身携带的传感器采集周围环境信息的数据。The data collection module is used for the robot to collect the data of the surrounding environment information through the sensor carried by the robot.

所述定位与建图模块基于周围环境信息的数据更新一部分地图为已知区域,获得更新后的地图。The positioning and mapping module updates a part of the map as a known area based on the data of the surrounding environment information, and obtains the updated map.

所述RRT边界点提取模块使用两棵快速搜索随机树对更新后的地图进行边界提取,获得RRT边界点。The RRT boundary point extraction module uses two fast search random trees to perform boundary extraction on the updated map to obtain RRT boundary points.

房间边界点提取模块,所述房间边界点提取模块用于识别启发式物体并对其进行位置估计,以启发式物体的位置为基准构建先验区域,在先验区域内提取边界点,获得房间边界点。The room boundary point extraction module is used to identify the heuristic object and perform position estimation on it, construct a priori region based on the position of the heuristic object, extract the boundary point in the priori region, and obtain the room boundary point.

环境探索模块,所述环境探索模块基于RRT边界点和房间边界点,机器人进行室内环境探索。An environment exploration module, the environment exploration module is based on the RRT boundary point and the room boundary point, and the robot performs indoor environment exploration.

为充分证明本发明的有效性,本发明与基于快速搜索随机树的自主探索算法(以下用“RRTs算法”表示)在两个仿真场景下进行了对比实验。对于每一个实验环境,总共进行了20次实验。包括10次使用RRTs算法,10次我们改进后的算法。实验对比的指标是探索整个环境所使用的时间以及行驶的路径长度。In order to fully prove the effectiveness of the present invention, the present invention and the autonomous exploration algorithm based on fast search random tree (referred to as "RRTs algorithm" below) are compared in two simulation scenarios. For each experimental setting, a total of 20 experiments were performed. Including 10 times using the RRTs algorithm and 10 times our improved algorithm. The metrics for experimental comparison are the time spent exploring the entire environment and the length of the path traveled.

表1为场景一的实验数据,表2为场景二的实验数据,表3为场景三的实验数据。如图5所示,在第一个场景中,本发明的方法相比于RRTs算法,探索时间减少了34.9%,探索路径长度减少了24.5%。如图6所示,在第二个场景中,本发明的方法相比于RRTs算法,探索时间减少了34.04%,探索路径长度减少了35.9%。如图7所示,在第三个场景中,本发明的方法相比于RRTs算法,探索时间减少了12.8%,探索路径长度减少了16.9%。Table 1 is the experimental data of the first scenario, Table 2 is the experimental data of the second scenario, and Table 3 is the experimental data of the third scenario. As shown in Figure 5, in the first scenario, compared with the RRTs algorithm, the method of the present invention reduces the exploration time by 34.9% and the length of the exploration path by 24.5%. As shown in Fig. 6, in the second scenario, the method of the present invention reduces the exploration time by 34.04% and the length of the exploration path by 35.9% compared with the RRTs algorithm. As shown in Figure 7, in the third scenario, the method of the present invention reduces the exploration time by 12.8% and the length of the exploration path by 16.9% compared with the RRTs algorithm.

表1Table 1

Figure BDA0003046901380000131
Figure BDA0003046901380000131

表2Table 2

Figure BDA0003046901380000141
Figure BDA0003046901380000141

表3table 3

Figure BDA0003046901380000142
Figure BDA0003046901380000142

本发明通过引入启发式先验信息探索模块,当机器人识别到启发式物体后,优先探索先验区域内的环境,可以使机器人优先探索完一个房间区域再转向其它区域,有效减少探索过程中的回溯现象,提升探索效率。By introducing a heuristic prior information exploration module, when the robot recognizes the heuristic object, it will first explore the environment in the prior area, so that the robot can first explore a room area and then turn to other areas, effectively reducing the amount of time in the exploration process. Retrospect the phenomenon and improve the efficiency of exploration.

本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。As will be appreciated by those skilled in the art, the embodiments of the present application may be provided as a method, a system, or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.

这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.

这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.

显然,上述实施例仅仅是为清楚地说明所作的举例,并非对实施方式的限定。对于所属领域的普通技术人员来说,在上述说明的基础上还可以做出其它不同形式变化或变动。这里无需也无法对所有的实施方式予以穷举。而由此所引伸出的显而易见的变化或变动仍处于本发明创造的保护范围之中。Obviously, the above-mentioned embodiments are only examples for clear description, and are not intended to limit the implementation manner. For those of ordinary skill in the art, other different forms of changes or modifications can also be made on the basis of the above description. There is no need and cannot be exhaustive of all implementations here. And the obvious changes or changes derived from this are still within the protection scope of the present invention.

Claims (3)

1.一种基于先验信息启发式的室内环境机器人探索方法,其特征在于,包括以下步骤:1. an indoor environment robot exploration method based on a priori information heuristic, is characterized in that, comprises the following steps: S1、机器人通过自身携带的传感器采集周围环境信息的数据;S1. The robot collects the data of the surrounding environment information through the sensor carried by itself; S2、基于周围环境信息的数据更新一部分地图为已知区域,获得更新后的地图;S2. Update a part of the map to a known area based on the data of the surrounding environment information, and obtain the updated map; S3、使用两棵快速搜索随机树对更新后的地图进行边界提取,获得RRT边界点,包括:S3. Use two fast search random trees to perform boundary extraction on the updated map to obtain RRT boundary points, including: S31、在初始化阶段,将起点添加到树结构中作为根节点,其中,两棵树的起点都是人为在地图的空闲区域内设定的;S31, in the initialization phase, add the starting point to the tree structure as the root node, wherein the starting points of the two trees are artificially set in the free area of the map; S32、在地图区域内随机撒点作为候选点;S32, randomly sprinkle points in the map area as candidate points; S33、若候选点在已知区域内,遍历树结构上的所有已有的节点,选取距离候选点最近的节点作为最邻近点,最邻近点到候选节点的连线作为生长方向,若最邻近点与候选节点的距离超过预先设定的步长,则由最邻近点沿着生长方向生长一个步长,到达的点作为生长点,若距离不超过步长,则该候选点作为生长点;S33. If the candidate point is in the known area, traverse all existing nodes on the tree structure, select the node closest to the candidate point as the nearest neighbor point, and use the connection line from the nearest neighbor point to the candidate node as the growth direction. If the distance between the point and the candidate node exceeds the preset step size, the nearest point grows one step size along the growth direction, and the reached point is used as the growth point. If the distance does not exceed the step size, the candidate point is used as the growth point; 若候选点在未知区域内,则先找到该候选点的最邻近树节点,最邻近点到候选点的连线作为生长方向,由最邻近点沿着生长方向向前生长,到达边界的地方作为边界点;If the candidate point is in the unknown area, first find the nearest tree node of the candidate point, and the connection line from the nearest point to the candidate point is used as the growth direction, and the nearest point grows forward along the growth direction, and the place where it reaches the boundary is used as the growth direction. border point; S34、将生长点和候选节点的连线在地图上做碰撞检测,具体包括:S34. Perform collision detection on the map for the connection between the growth point and the candidate node, specifically including: 遍历生长点和候选节点的连线上所有的栅格点,判断栅格点的栅格状态;Traverse all grid points on the connection between the growth point and the candidate node, and judge the grid state of the grid point; 若栅格点的状态是被占据的,则碰撞检测不通过,返回S32重新进行采点;If the state of the grid point is occupied, the collision detection fails, and returns to S32 to collect points again; 若生长点和候选节点的连线没有碰到障碍物,将候选点、生长点和候选节点的连线添加到树结构中;If the connection between the growing point and the candidate node does not encounter obstacles, add the connection between the candidate point, the growing point and the candidate node to the tree structure; S4、识别启发式物体并对其进行位置估计,以启发式物体的位置为基准构建先验区域,在先验区域内提取边界点,获得房间边界点;其中,启发式物体为门;S4. Identify the heuristic object and perform position estimation on it, construct a priori region based on the position of the heuristic object, extract boundary points in the priori region, and obtain room boundary points; wherein, the heuristic object is a door; 其中,识别启发式物体并对其进行位置估计,包括:Among them, heuristic objects are identified and their position estimated, including: 构建轻量级网络,基于深度学习的方法完成启发式物体的识别,获取启发式物体的坐标信息;其中,所述轻量级网络包括卷积层、逆残差块、池化层和SSP层;Construct a lightweight network, complete the recognition of heuristic objects based on the deep learning method, and obtain the coordinate information of the heuristic objects; wherein, the lightweight network includes a convolution layer, an inverse residual block, a pooling layer and an SSP layer ; 其中,以启发式物体的位置为基准构建先验区域,包括:Among them, a priori region is constructed based on the position of the heuristic object, including: 在机器人识别到启发式物体时,若机器人位置在启发式物体的下方,则预估的房间区域在启发式物体的位置的上方,若机器人位置在启发式物体的上方时,预估的房间区域在启发式物体的位置的下方;When the robot recognizes the heuristic object, if the robot's position is below the heuristic object, the estimated room area is above the heuristic object. If the robot's position is above the heuristic object, the estimated room area below the position of the heuristic object; 其中,所述预估的房间区域的长度为启发式物体的位置向两侧延伸长度a,预估区域的宽度为启发式物体的位置向后延伸长度2b;其中,参数a,b由经验设定;Wherein, the length of the estimated room area is the position of the heuristic object extending to both sides by a length a, and the width of the estimated area is the position of the heuristic object extending back the length 2b; wherein, the parameters a and b are set by experience Certainly; 其中,在先验区域内提取边界点,获得房间边界点,包括以下步骤:Among them, the boundary points are extracted in the prior area, and the room boundary points are obtained, including the following steps: 对先验区域的图像做二值化处理,获得二值化图像,其中,二值化图像的障碍物为白色,其余区域为黑色;Perform binarization processing on the image of the prior area to obtain a binarized image, in which the obstacles of the binarized image are white, and the rest of the area is black; 对所述二值化图像进行颜色翻转,获得颜色翻转后的图像,其中,颜色翻转后的图像的障碍物为黑色,其余区域为白色;Perform color flipping on the binarized image to obtain a color flipped image, wherein the obstacles in the color flipped image are black, and the rest of the area is white; 采用Canny算子对二值化图像做边缘检测,检测结果中将图像的边缘设置为白色,其余区域为黑色;The Canny operator is used to detect the edge of the binarized image. In the detection result, the edge of the image is set to white, and the rest of the area is black; 将二值化图像和颜色翻转后的图像进行按位与操作以去除多余的白色边缘,获得最终图像,其中,最终图像中的已知区域与未知区域之间的边界由一条条直线组成;Perform a bitwise AND operation on the binarized image and the color-flipped image to remove excess white edges to obtain a final image, where the boundary between the known area and the unknown area in the final image consists of straight lines; 提取直线的重心,即为房间边界点;Extract the center of gravity of the straight line, which is the room boundary point; S5、基于RRT边界点和房间边界点,机器人进行室内环境探索,包括:S5. Based on RRT boundary points and room boundary points, the robot performs indoor environment exploration, including: S51、当房间边界点存在时,选择收益值最大的房间边界点作为目标点,当没有房间边界点存在时,则选取收益值最大的RRT边界点作为目标点,其中,边界点的收益值R1f=w1*If-w2*NfS51. When the room boundary point exists, select the room boundary point with the largest income value as the target point, and when there is no room boundary point, select the RRT boundary point with the largest income value as the target point, wherein the income value of the boundary point R1 f = w 1 *I f -w 2 *N f , 其中,If为信息增益,信息增益指在质心点的信息增益半径r=1内未知的栅格的个数,Among them, If is the information gain, the information gain refers to the number of unknown grids within the information gain radius r =1 of the centroid point, Nf为路径成本,路径成本指机器人当前位置与质心点位置的欧式距离;N f is the path cost, and the path cost refers to the Euclidean distance between the robot's current position and the position of the center of mass; w1和w2为自定义权重,为一个常量;w 1 and w 2 are custom weights, which are constants; S52、引导机器人向目标点导航。S52, guide the robot to navigate to the target point. 2.根据权利要求1所述的基于先验信息启发式的室内环境机器人探索方法,其特征在于,所述S5之后还包括:2. The indoor environment robot exploration method based on a priori information heuristic according to claim 1, is characterized in that, after described S5 also comprises: S6、当先验区域内检测不到边界点时,表示该区域已经探索完成,则销毁先验区域的模型以便下一个启发式区域的形成;S6. When no boundary point is detected in the a priori area, it means that the area has been explored, and the model of the prior area is destroyed to form the next heuristic area; S7、循环S1-S6,直至机器人探索完整个环境,获得栅格地图。S7, loop S1-S6 until the robot explores the entire environment and obtains a grid map. 3.一种基于先验信息启发式的室内环境机器人探索系统,其特征在于,包括:3. An indoor environment robot exploration system based on a priori information heuristic is characterized in that, comprising: 数据采集模块,所述数据采集模块用于机器人通过自身携带的传感器采集周围环境信息的数据;a data acquisition module, the data acquisition module is used for the robot to collect the data of the surrounding environment information through the sensor carried by itself; 定位与建图模块,所述定位与建图模块基于周围环境信息的数据更新一部分地图为已知区域,获得更新后的地图;A positioning and mapping module, the positioning and mapping module updates a part of the map as a known area based on the data of the surrounding environment information, and obtains the updated map; RRT边界点提取模块,所述RRT边界点提取模块使用两棵快速搜索随机树对更新后的地图进行边界提取,获得RRT边界点,包括:The RRT boundary point extraction module, the RRT boundary point extraction module uses two fast search random trees to perform boundary extraction on the updated map to obtain RRT boundary points, including: S31、在初始化阶段,将起点添加到树结构中作为根节点,其中,两棵树的起点都是人为在地图的空闲区域内设定的;S31. In the initialization phase, the starting point is added to the tree structure as the root node, wherein the starting points of the two trees are artificially set in the free area of the map; S32、在地图区域内随机撒点作为候选点;S32, randomly sprinkle points in the map area as candidate points; S33、若候选点在已知区域内,遍历树结构上的所有已有的节点,选取距离候选点最近的节点作为最邻近点,最邻近点到候选节点的连线作为生长方向,若最邻近点与候选节点的距离超过预先设定的步长,则由最邻近点沿着生长方向生长一个步长,到达的点作为生长点,若距离不超过步长,则该候选点作为生长点;S33. If the candidate point is in the known area, traverse all existing nodes on the tree structure, select the node closest to the candidate point as the nearest neighbor point, and use the connection line from the nearest neighbor point to the candidate node as the growth direction. If the distance between the point and the candidate node exceeds the preset step size, the nearest point grows one step size along the growth direction, and the reached point is used as the growth point. If the distance does not exceed the step size, the candidate point is used as the growth point; 若候选点在未知区域内,则先找到该候选点的最邻近树节点,最邻近点到候选点的连线作为生长方向,由最邻近点沿着生长方向向前生长,到达边界的地方作为边界点;If the candidate point is in the unknown area, first find the nearest tree node of the candidate point, and the connection line from the nearest point to the candidate point is used as the growth direction, and the nearest point grows forward along the growth direction, and the place where it reaches the boundary is used as the growth direction. border point; S34、将生长点和候选节点的连线在地图上做碰撞检测,具体包括:S34. Perform collision detection on the map for the connection between the growth point and the candidate node, specifically including: 遍历生长点和候选节点的连线上所有的栅格点,判断栅格点的栅格状态;Traverse all grid points on the connection line between the growth point and the candidate node, and judge the grid state of the grid point; 若栅格点的状态是被占据的,则碰撞检测不通过,返回S32重新进行采点;If the state of the grid point is occupied, the collision detection fails, and returns to S32 to collect points again; 若生长点和候选节点的连线没有碰到障碍物,将候选点、生长点和候选节点的连线添加到树结构中;If the connection between the growing point and the candidate node does not encounter obstacles, add the connection between the candidate point, the growing point and the candidate node to the tree structure; 房间边界点提取模块,所述房间边界点提取模块用于识别启发式物体并对其进行位置估计,以启发式物体的位置为基准构建先验区域,在先验区域内提取边界点,获得房间边界点;其中,识别启发式物体并对其进行位置估计,包括:构建轻量级网络,基于深度学习的方法完成启发式物体的识别,获取启发式物体的坐标信息;其中,所述轻量级网络包括卷积层、逆残差块、池化层和SSP层;其中,以启发式物体的位置为基准构建先验区域,包括:在机器人识别到启发式物体时,若机器人位置在启发式物体的下方,则预估的房间区域在启发式物体的位置的上方,若机器人位置在启发式物体的上方时,预估的房间区域在启发式物体的位置的下方;其中,所述预估的房间区域的长度为启发式物体的位置向两侧延伸长度a,预估区域的宽度为启发式物体的位置向后延伸长度2b,其中,参数a,b由经验设定;其中,在先验区域内提取边界点,获得房间边界点,包括以下步骤:对先验区域的图像做二值化处理,获得二值化图像,其中,二值化图像的障碍物为白色,其余区域为黑色;对所述二值化图像进行颜色翻转,获得颜色翻转后的图像,其中,颜色翻转后的图像的障碍物为黑色,其余区域为白色;采用Canny算子对二值化图像做边缘检测,检测结果中将图像的边缘设置为白色,其余区域为黑色;将二值化图像和颜色翻转后的图像进行按位与操作以去除多余的白色边缘,获得最终图像,其中,最终图像中的已知区域与未知区域之间的边界由一条条直线组成;提取直线的重心,即为房间边界点;The room boundary point extraction module is used to identify the heuristic object and perform position estimation on it, construct a priori region based on the position of the heuristic object, extract the boundary point in the priori region, and obtain the room Boundary point; wherein, identifying the heuristic object and estimating its position includes: constructing a lightweight network, completing the identification of the heuristic object based on a deep learning method, and obtaining the coordinate information of the heuristic object; wherein, the lightweight The level network includes convolution layer, inverse residual block, pooling layer and SSP layer; among them, the prior region is constructed based on the position of the heuristic object, including: when the robot recognizes the heuristic object, if the robot position is in the heuristic object below the heuristic object, the estimated room area is above the position of the heuristic object, and if the robot is positioned above the heuristic object, the estimated room area is below the position of the heuristic object; The length of the estimated room area is the position of the heuristic object extending to both sides by a length a, and the width of the estimated area is the position of the heuristic object extending back the length 2b, where the parameters a and b are set by experience; Extracting boundary points from the prior area to obtain room boundary points includes the following steps: performing binarization processing on the image in the prior area to obtain a binary image, wherein the obstacles in the binary image are white, and the rest of the area is black; color-flip the binarized image to obtain a color-flipped image, wherein the obstacles in the color-flipped image are black, and the rest of the area is white; the Canny operator is used to detect the edge of the binarized image , in the detection result, the edge of the image is set to white, and the rest of the area is black; the bitwise AND operation is performed on the binarized image and the color-flipped image to remove the excess white edge, and the final image is obtained. The boundary between the known area and the unknown area consists of a straight line; the center of gravity of the extracted line is the room boundary point; 环境探索模块,所述环境探索模块基于RRT边界点和房间边界点,机器人进行室内环境探索:当房间边界点存在时,选择收益值最大的房间边界点作为目标点,当没有房间边界点存在时,则选取收益值最大的RRT边界点作为目标点;引导机器人向目标点导航,其中,边界点的收益值R1f=w1*If-w2*Nf,其中,If为信息增益,信息增益指在质心点的信息增益半径r=1内未知的栅格的个数,Nf为路径成本,路径成本指机器人当前位置与质心点位置的欧式距离;w1和w2为自定义权重,为一个常量。Environment exploration module, the environment exploration module is based on the RRT boundary point and the room boundary point, and the robot performs indoor environment exploration: when the room boundary point exists, the room boundary point with the largest profit value is selected as the target point, when there is no room boundary point. , then select the RRT boundary point with the largest profit value as the target point; guide the robot to navigate to the target point, where the profit value of the boundary point R1 f = w 1 *I f -w 2 *N f , where If is the information gain , the information gain refers to the number of unknown grids within the information gain radius r=1 of the centroid point, N f is the path cost, and the path cost refers to the Euclidean distance between the robot's current position and the centroid point; w 1 and w 2 are the self- Define the weight as a constant.
CN202110475488.3A 2021-04-29 2021-04-29 Indoor environment robot exploration method and system based on priori information heuristic method Active CN113110482B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110475488.3A CN113110482B (en) 2021-04-29 2021-04-29 Indoor environment robot exploration method and system based on priori information heuristic method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110475488.3A CN113110482B (en) 2021-04-29 2021-04-29 Indoor environment robot exploration method and system based on priori information heuristic method

Publications (2)

Publication Number Publication Date
CN113110482A CN113110482A (en) 2021-07-13
CN113110482B true CN113110482B (en) 2022-07-19

Family

ID=76720444

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110475488.3A Active CN113110482B (en) 2021-04-29 2021-04-29 Indoor environment robot exploration method and system based on priori information heuristic method

Country Status (1)

Country Link
CN (1) CN113110482B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113485373B (en) * 2021-08-12 2022-12-06 苏州大学 A Real-time Motion Planning Method for Robot Based on Gaussian Mixture Model
CN113485375B (en) * 2021-08-13 2023-03-24 苏州大学 Indoor environment robot exploration method based on heuristic bias sampling
CN113837029A (en) * 2021-09-06 2021-12-24 苏州大学 Object recognition method, system, terminal device and storage medium
CN113805590A (en) * 2021-09-23 2021-12-17 云南民族大学 Indoor robot autonomous exploration method and system based on boundary driving
CN113848912B (en) * 2021-09-28 2024-11-05 北京理工大学重庆创新中心 Indoor map building method and device based on autonomous exploration
CN114589708B (en) * 2022-02-28 2023-11-07 华南师范大学 Indoor autonomous exploration methods, devices and robots based on environmental information
CN115167433B (en) * 2022-07-22 2024-03-19 华南理工大学 Methods and systems for robots that integrate global vision to autonomously explore environmental information
CN115469662B (en) * 2022-09-13 2023-07-07 苏州大学 Environment exploration method, device and application
CN116679712B (en) * 2023-06-19 2024-07-12 苏州大学 Efficient exploration decision-making method for indoor environment robot based on generalized voronoi diagram
CN117387649B (en) * 2023-10-26 2024-06-14 苏州大学 Self-adaptive navigation method and system for uncertain environment robot with probability self-updating
CN118758304B (en) * 2024-06-06 2025-05-09 安徽大学 Unmanned aerial vehicle self-adaptive centroid point boundary exploration method based on laser slam

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103905319A (en) * 2014-03-24 2014-07-02 中国电子科技集团公司第三十研究所 Multiple-constraint multicast routing algorithm based on iteration coding
CN106406320A (en) * 2016-11-29 2017-02-15 重庆重智机器人研究院有限公司 Robot path planning method and robot planning route
CN106774314A (en) * 2016-12-11 2017-05-31 北京联合大学 A kind of home-services robot paths planning method based on run trace
CN110221614A (en) * 2019-06-14 2019-09-10 福州大学 A kind of multirobot map heuristic approach based on rapid discovery random tree
CN110531760A (en) * 2019-08-16 2019-12-03 广东工业大学 It is explored based on the boundary that curve matching and target vertex neighborhood are planned and independently builds drawing method
CN110908377A (en) * 2019-11-26 2020-03-24 南京大学 Robot navigation space reduction method
CN112327852A (en) * 2020-11-09 2021-02-05 苏州大学 An autonomous exploration method for mobile robots based on the richness of path information

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103905319A (en) * 2014-03-24 2014-07-02 中国电子科技集团公司第三十研究所 Multiple-constraint multicast routing algorithm based on iteration coding
CN106406320A (en) * 2016-11-29 2017-02-15 重庆重智机器人研究院有限公司 Robot path planning method and robot planning route
CN106774314A (en) * 2016-12-11 2017-05-31 北京联合大学 A kind of home-services robot paths planning method based on run trace
CN110221614A (en) * 2019-06-14 2019-09-10 福州大学 A kind of multirobot map heuristic approach based on rapid discovery random tree
CN110531760A (en) * 2019-08-16 2019-12-03 广东工业大学 It is explored based on the boundary that curve matching and target vertex neighborhood are planned and independently builds drawing method
CN110908377A (en) * 2019-11-26 2020-03-24 南京大学 Robot navigation space reduction method
CN112327852A (en) * 2020-11-09 2021-02-05 苏州大学 An autonomous exploration method for mobile robots based on the richness of path information

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
A Heuristic Rapidly-Exploring Random Trees Method for Manipulator Motion Planning;CHENGREN YUAN 等;《IEEE Access》;20200103;第8卷;全文 *
A Reusable Generalized Voronoi Diagram Based Feature Tree for Fast Robot Motion Planning in Trapped Environments;Wenzheng Chi 等;《IEEE Sensors Journal》;20210127;全文 *
An Improved RRT Robot Autonomous Exploration and SLAM Construction Method;Zeyu Tian 等;《IEEE Xplore》;20201231;全文 *
Risk-Informed-RRT*: A Sampling-based Human-friendly Motion Planning Algorithm for Mobile Service Robots in Indoor Environments;Wenzheng Chi 等;《Proceeding of the IEEE International Conference on Information and Automation》;20180831;全文 *

Also Published As

Publication number Publication date
CN113110482A (en) 2021-07-13

Similar Documents

Publication Publication Date Title
CN113110482B (en) Indoor environment robot exploration method and system based on priori information heuristic method
CN113485375B (en) Indoor environment robot exploration method based on heuristic bias sampling
CN107967457B (en) A method and system for location recognition and relative positioning that adapts to changes in visual features
CN108520554B (en) Binocular three-dimensional dense mapping method based on ORB-SLAM2
CN113076871B (en) Fish shoal automatic detection method based on target shielding compensation
CN104732587B (en) A kind of indoor 3D semanteme map constructing method based on depth transducer
CN110992473B (en) Tree branch modeling method and system based on vehicle-mounted laser scanning point cloud
CN111190981A (en) Method and device for constructing three-dimensional semantic map, electronic equipment and storage medium
CN106169188A (en) A kind of method for tracing object based on the search of Monte Carlo tree
CN112802204A (en) Target semantic navigation method and system for three-dimensional space scene prior in unknown environment
CN108805149A (en) A kind of winding detection method and device of visual synchronization positioning and map structuring
CN112884256A (en) Path planning method and device, computer equipment and storage medium
CN111679661A (en) Semantic map construction method based on depth camera and sweeping robot
CN117367404A (en) Visual positioning mapping method and system based on SLAM (sequential localization and mapping) in dynamic scene
CN104881029A (en) Mobile robot navigation method based on one point RANSAC and FAST algorithm
CN114782455B (en) Cotton row center line image extraction method for agricultural machine embedded equipment
CN115586767A (en) A multi-robot path planning method and device
CN116382307A (en) Multi-robot autonomous exploration method and system based on centroid of unknown connected regions
CN112257810A (en) Submarine biological target detection method based on improved FasterR-CNN
CN118411415B (en) Mobile robot relocalization method and device based on whale algorithm and ensemble learning
CN115469662A (en) Environment exploration method, device and application
CN110716547A (en) 3D exploration method based on wavefront algorithm
CN110930519B (en) Semantic ORB-SLAM sensing method and device based on environment understanding
CN112857379A (en) Improved Gmapping-SLAM map updating method and system
CN108921852B (en) Dual-branch Outdoor Unstructured Terrain Segmentation Network Based on Parallax and Plane Fitting

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant