WO2022142744A1 - Loopback detection method, apparatus and device, and computer readable storage medium - Google Patents

Loopback detection method, apparatus and device, and computer readable storage medium Download PDF

Info

Publication number
WO2022142744A1
WO2022142744A1 PCT/CN2021/129493 CN2021129493W WO2022142744A1 WO 2022142744 A1 WO2022142744 A1 WO 2022142744A1 CN 2021129493 W CN2021129493 W CN 2021129493W WO 2022142744 A1 WO2022142744 A1 WO 2022142744A1
Authority
WO
WIPO (PCT)
Prior art keywords
local
constructed
level
local sub
sub
Prior art date
Application number
PCT/CN2021/129493
Other languages
French (fr)
Chinese (zh)
Inventor
宁越
张一凡
邹李兵
王学强
Original Assignee
歌尔股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 歌尔股份有限公司 filed Critical 歌尔股份有限公司
Publication of WO2022142744A1 publication Critical patent/WO2022142744A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases

Definitions

  • the present invention relates to the technical field of image processing, and in particular, to a loop closure detection method, apparatus, device, and computer-readable storage medium.
  • the current main way to reduce the cumulative error is scan to map (matching the laser return data with the map), that is, directly matching the lidar scan data with the map to obtain the actual position coordinates. While calculating the position, the newly scanned data is added to the constructed map in time, but this method may loop back anywhere when the characteristic laser return data is relatively small, resulting in an inaccurate map.
  • Embodiments of the present invention provide a loopback detection method, apparatus, device, and computer-readable storage medium, which aim to improve the accuracy of loopback and the success rate of map construction.
  • an embodiment of the present invention provides a loopback detection method, which includes:
  • the occupancy state matching degree of each level is greater than the preset matching degree, the occupancy state matching is performed between the local subgraph being constructed and the corresponding constructed local subgraph;
  • an embodiment of the present invention further provides a loopback detection device, where the loopback detection device includes:
  • the creation module is used to create a multi-level local sub-map to be compared, and compare the occupancy status of the multi-level local sub-map to be compared with the corresponding constructed local sub-map in turn to obtain the matching degree of occupancy status of each level;
  • the comparison module is used to match the occupancy state of the local sub-graph being constructed and the corresponding constructed local sub-graph if the occupancy state matching degree of each level is greater than the preset matching degree;
  • the determining module is configured to determine that the loopback is successful if the local sub-graph being constructed completely matches the occupancy state of the corresponding constructed local sub-graph at the same position.
  • an embodiment of the present invention also provides a loopback detection device, the loopback detection device includes a processor, a memory, and a loopback detection program stored in the memory.
  • the loopback detection program is run by the processor, the above-mentioned Steps of a loopback detection method.
  • an embodiment of the present invention further provides a computer-readable storage medium storing a loopback detection program on the computer-readable storage medium.
  • the loopback detection program is executed by a processor to implement the steps of the above loopback detection method.
  • a method, device, device and computer-readable storage medium for loop closure detection proposed by the present invention create multi-level partial sub-maps to be compared, and sequentially associate the multi-level partial sub-maps to be compared with corresponding ones according to the level.
  • the occupancy states of the constructed local subgraphs are compared to obtain the occupancy state matching degree of each level; if the occupancy state matching degree of each level is greater than the preset matching degree, the local subgraph being constructed is compared with the corresponding constructed local subgraph.
  • the graph performs occupancy state matching; if the local subgraph being constructed completely matches the occupancy state at the same position of the corresponding constructed local subgraph, it is determined that the loopback is successful. Therefore, after the occupancy state of the multi-level to-be-compared partial subgraph is successfully matched, the state of the local subgraph being constructed is matched with the corresponding constructed local subgraph, which improves the accuracy of loop closure and the success rate of map construction.
  • FIG. 1 is a schematic diagram of a hardware structure of a loopback detection device involved in various embodiments of the present invention
  • FIG. 2 is a schematic flowchart of the first embodiment of the loopback detection method of the present invention.
  • FIG. 3 is a schematic diagram of functional modules of the first embodiment of the loopback detection apparatus of the present invention.
  • the loopback detection device mainly involved in the embodiments of the present invention refers to a network connection device capable of realizing network connection, and the loopback detection device may be a server, a cloud platform, or the like.
  • FIG. 1 is a schematic diagram of a hardware structure of a loopback detection device involved in various embodiments of the present invention.
  • the loopback detection device may include a processor 1001 (for example, a central processing unit, Central Processing Unit, CPU), a communication bus 1002, an input port 1003, an output port 1004, and a memory 1005.
  • the communication bus 1002 is used to realize the connection communication between these components; the input port 1003 is used for data input; the output port 1004 is used for data output, and the memory 1005 can be a high-speed RAM memory or a non-volatile memory (non-volatile memory).
  • the memory 1005 may optionally also be a storage device independent of the aforementioned processor 1001 .
  • the hardware structure shown in FIG. 1 does not constitute a limitation of the present invention, and may include more or less components than those shown in the drawings, or combine some components, or arrange different components.
  • the memory 1005 in FIG. 1 as a readable computer-readable storage medium may include an operating system, a network communication module, an application program module, and a loopback detection program.
  • the network communication module is mainly used to connect to the server and perform data communication with the server; and the processor 1001 can call the loopback detection program stored in the memory 1005 and execute the loopback detection method provided by the embodiment of the present invention.
  • Embodiments of the present invention provide a loopback detection method.
  • FIG. 2 is a schematic flowchart of the first embodiment of the loopback detection method of the present invention.
  • a loopback detection method is applied to a loopback detection device, and the method includes:
  • Step S101 creating a multi-level local subgraph to be compared, and comparing the occupancy state of the multi-level local subgraph to be compared with the corresponding constructed local subgraph in turn according to the level, to obtain the occupancy state matching degree of each level;
  • Loopback detection also known as closed-loop detection, refers to the ability of the robot to recognize that it has reached a certain scene and make the map closed-loop. To put it simply, when the robot turns left and right to build a map, it can realize that a certain place has come before, and then match the map generated at this moment with the previously generated map.
  • This embodiment draws a map based on SLAM (Simultaneous Localization and Mapping).
  • SLAM is mainly used to solve the problems of positioning, navigation and map construction when mobile robots are running in unknown environments.
  • the process of building a local subgraph through SLAM includes:
  • the robot is equipped with a laser sensor, which can emit laser light and receive laser return data to measure the distance from the obstacle to the excitation sensor.
  • the laser sensor can be a 2D laser sensor. After the 2D laser sensor emits a frame of laser light, it receives the return laser return data in all directions, and determines the distance of the obstacle according to the return time. Based on the time difference from the launch of the laser to the receipt of the returned laser data, multiply the speed and divide by two to get the distance from the sensor to the nearest obstacle in the corresponding direction.
  • the robot is constantly moving and can fire lasers at various locations and receive return data.
  • a blank subgraph is created centered on the location where the robot emits laser light and receives returned data.
  • the size of the blank sub-image can be determined based on the actual scene.
  • the coordinate system where the robot and its laser return data are located is marked as the world coordinate system
  • the collected laser return data is marked as scan points in the world coordinate system
  • the location of the robot is marked as origin
  • the robot is marked as origin.
  • the blank submap and the converted partial submap can be a grid map, the size of which can be 5cm ⁇ 5cm, and the center of each partial submap is called a grid point (grid point). , and other points in the local subgraph are called corresponding pixels.
  • the final result is a constructed local map containing many subgraphs.
  • the local submap can be regarded as a grid probability map, but if the local subgraph is regarded as a feature point, then the entire constructed local map can be regarded as a topological map, and the local subgraphs are the feature points, and the relative positions between the local subgraphs
  • the constraint relationship is a line.
  • the relationship between the local subgraph and the local subgraph is maintained through the relative position of the center point, but the relative position error is relatively low between the local subgraphs with similar positions.
  • the error will become larger and larger. For example, assuming that there is an error of 1em in the adjacent local subgraph, when the final constructed map contains 100 local subgraphs, the last local subgraph is the same as the first one.
  • the error between the local subgraphs is as much as 1m, so loopback detection is required to correct these errors.
  • PL-ICP piont line-iterative closest point, point-line iteration closest point
  • PL-ICP piont line-iterative closest point, point-line iteration closest point
  • the multi-level local sub-images to be compared refer to local sub-images to be compared with different resolutions.
  • the preset resolutions include a first preset resolution, a second preset resolution, and a third preset resolution.
  • Resolution the corresponding hierarchical compression local sub-images are the first-level compressed local sub-image, the second-level compressed local sub-image and the third-level compressed local sub-image; the laser signal data received by the robot are respectively converted to the hierarchical compression local sub-image.
  • Subgraph obtain the local subgraph to be compared. In this embodiment, based on the SLAM algorithm, the laser signal data are respectively converted into hierarchically compressed local sub-maps.
  • the resolution of the compressed hierarchically compressed local sub-map is lower than the corresponding constructed local sub-map.
  • the resolution is reduced and the number of pixels is reduced. For example, if the area of the constructed local sub-image A is 1 square meter, when the resolution is 5cm per pixel, there are 400 pixels; if the compression is 50cm per pixel, there are 4 pixels.
  • the constructed local sub-images of the same size the number of pixels is reduced, and the amount of computation required for matching is greatly reduced.
  • three layers can be set, and each layer corresponds to the first preset resolution, the second preset resolution, and the third preset resolution.
  • the first preset resolution is 5cm per pixel
  • the second preset resolution is The rate is 10cm per pixel and the third preset resolution is 50cm.
  • the first occupancy state of each position in the first-level compressed local submap is compared with the occupancy state to be compared at each corresponding position in the corresponding constructed local submap to obtain the first occupancy state matching degree; this embodiment
  • the resolution of the first-level compressed local sub-image is the first resolution.
  • the first occupancy status of the corresponding positions of each pixel point in the first-level compressed local sub-map is acquired, and at the same time, the to-be-compared occupancy status corresponding to each pixel point position in the constructed local sub-map is acquired.
  • the first occupancy state of each position is compared with the occupancy state to be compared to obtain the matching degree of the first occupancy state.
  • the resolution of the first-level compressed local sub-image is low, the pixel points are relatively small, there are not many positions to be compared, and the amount of calculation is small, so that the local sub-images with obvious differences can be screened.
  • the second occupancy state of each position in the second-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared.
  • a second occupancy state matching degree is obtained, and the second preset resolution is higher than the first preset resolution; the preset first matching degree can be specifically set as required, for example, the preset first matching degree is set to 80%, 85% or 90%. Since the resolution of the second-level compressed local sub-image is higher than that of the first-level compressed local sub-image, it has more pixels and can perform more accurate matching.
  • the third occupancy state of each position in the third-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared.
  • a third occupancy state matching degree is obtained, and the third preset resolution is higher than the second preset resolution.
  • the preset second matching degree can be specifically set as required, for example, the preset second matching degree is set to 85% or 90%.
  • the robot performs error correction and updating on the constructed local sub-map based on the laser signal data received by the robot;
  • the matching degree of the first occupancy state and/or the degree of matching of the second occupancy state is low, it indicates that there may be errors in the constructed local sub-images, and therefore it is necessary to perform error correction and update in time to ensure the accuracy of the composition.
  • Step S102 if the occupancy state matching degree of each level is greater than the preset matching degree, the occupancy state matching is performed between the local subgraph being constructed and the corresponding constructed local subgraph;
  • the first occupancy state matching degree, the second occupancy state matching degree and the third occupancy state matching degree are all greater than the corresponding preset matching degrees, it means that the similarity between the local subgraph being constructed and the corresponding constructed local subgraph is relatively high. If the value is high, it means that the correctness of the constructed local subgraph is relatively high, that is, the laser return signal is successfully matched, and further loopback judgment is performed.
  • the current occupancy status of each position in the local submap being constructed is matched with the occupancy status to be compared at each corresponding position in the corresponding constructed local submap.
  • Step S103 if the local subgraph being constructed completely matches the occupancy state of the corresponding constructed local subgraph at the same position, it is determined that the loopback is successful.
  • loopback detection If the loopback detection is successful, the accumulated error can be significantly reduced, helping the robot to perform obstacle avoidance and navigation more accurately and quickly. And wrong detection results can make the map bad. Therefore, loop closure detection is very necessary in the construction of large-area and large-scene maps.
  • the loop closure detection method in this application is actually a map_to_map (map to map) method.
  • the map_to_map loopback detection method is to use not only a single frame of laser but also an unfinished local submap submap for each loopback detection. It is very easy to mismatch in the environment of , but the local submap contains map information for a period of time, and describes more environmental features, so it can greatly reduce the possibility of mismatch.
  • the local subgraph is compared with the constructed subgraph, and a second judgment is made. If the matching is still determined, the loopback matching is considered successful. This will not only not affect the real-time performance of the algorithm, but also improve the reliability of the algorithm output.
  • the front-end and back-end of the algorithm are generally operated by two processes at the same time. This solution can ensure the overall real-time performance of the algorithm.
  • the method further includes: optimizing the constructed local subgraphs to reduce the accumulated error of the constructed local subgraphs.
  • optimization may be performed based on the error of the adjacent subgraphs in the constructed local subgraph to minimize the final error, and the constructed local subgraph with the smallest error is saved as the final constructed local subgraph.
  • a multi-level local sub-map to be compared is created, and the multi-level local sub-map to be compared is sequentially compared with the corresponding constructed local sub-map according to the occupancy status, so as to obtain the matching degree of occupancy status of each level. ; If the matching degree of occupancy status of each level is greater than the preset matching degree, the occupancy status of the local subgraph being constructed is matched with the corresponding constructed local subgraph; if the local subgraph being constructed matches the corresponding constructed local subgraph If the occupancy states of the subgraphs at the same position completely match, it is determined that the loopback is successful. Therefore, after the occupancy state of the multi-level to-be-compared partial subgraph is successfully matched, the state of the local subgraph being constructed is matched with the corresponding constructed local subgraph, which improves the accuracy of loop closure and the success rate of map construction.
  • FIG. 3 is a schematic diagram of functional modules of the first embodiment of the loopback detection apparatus of the present invention.
  • the loopback detection device is a virtual device, which is stored in the memory 1005 of the loopback detection device shown in Compare the occupancy states of the multi-level local sub-maps to be compared with the corresponding constructed local sub-maps in turn to obtain the occupancy state matching degree of each level; it is used if the occupancy state matching degree of each level is greater than the preset matching degree, then Match the occupancy state of the local subgraph under construction with the corresponding constructed local subgraph; it is used to determine that the loopback is successful if the local subgraph being constructed completely matches the occupancy state of the corresponding constructed local subgraph at the same position .
  • the loopback detection device includes:
  • the creation module 10 is used to create a multi-level local sub-graph to be compared, and the multi-level local sub-graph to be compared is successively compared with the corresponding constructed local sub-graph by level, and the occupancy state matching degree of each level is obtained;
  • the comparison module 20 is used for matching the occupancy state of the local sub-graph being constructed and the corresponding constructed local sub-graph if the occupancy state matching degree of each level is greater than the preset matching degree;
  • the determination module 30 is configured to determine that the loopback is successful if the occupancy state of the local sub-graph being constructed and the corresponding constructed local sub-graph at the same position are completely matched.
  • creating modules is also used to:
  • the preset resolutions include a first preset resolution, a second preset resolution, and a third preset resolution.
  • Resolution, the corresponding hierarchical compressed local sub-images are the first-level compressed local sub-image, the second-level compressed local sub-image and the third-level compressed local sub-image;
  • the laser signal data received by the robot are respectively converted into hierarchical compressed local sub-images to obtain the local sub-images to be compared.
  • creating modules is also used to:
  • the matching degree of the first occupancy state is greater than the preset first matching degree
  • the second occupancy state of each position in the second-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared.
  • a second occupancy state matching degree is obtained, and the second preset resolution is higher than the first preset resolution
  • the third occupancy state of each position in the third-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared.
  • a third occupancy state matching degree is obtained, and the third preset resolution is higher than the second preset resolution.
  • creating modules is also used to:
  • first occupancy state matching degree is less than or equal to the preset first matching degree, error correction and updating of the constructed local sub-map is performed based on the laser signal data received by the robot.
  • creating modules is also used to:
  • comparison module is also used to:
  • the current occupancy status of each position in the local sub-map being constructed is matched with the to-be-compared occupancy status of each corresponding position in the corresponding constructed local sub-map.
  • comparison module is also used to:
  • the constructed local subgraph is optimized to reduce the accumulated error of the constructed local subgraph.
  • an embodiment of the present invention further provides a computer-readable storage medium, where a loopback detection program is stored on the computer-readable storage medium, and when the loopback detection program is run by a processor, the steps of the above loopback detection method are implemented.
  • a method, device, device and computer-readable storage medium for loop closure detection proposed by the present invention create multi-level partial sub-maps to be compared, and sequentially associate the multi-level partial sub-maps to be compared with corresponding ones according to the level.
  • the occupancy states of the constructed local subgraphs are compared to obtain the occupancy state matching degree of each level; if the occupancy state matching degree of each level is greater than the preset matching degree, the local subgraph being constructed is compared with the corresponding constructed local subgraph.
  • the graph performs occupancy state matching; if the local subgraph being constructed completely matches the occupancy state at the same position of the corresponding constructed local subgraph, it is determined that the loopback is successful. Therefore, after the occupancy state of the multi-level to-be-compared partial subgraph is successfully matched, the state of the local subgraph being constructed is matched with the corresponding constructed local subgraph, which improves the accuracy of loop closure and the success rate of map construction.

Abstract

Disclosed in the present invention are a loopback detection method, apparatus and device, and a computer readable storage medium. The method comprises: creating a multi-level to-be-compared local sub-graph, sequentially performing occupancy state comparison on the multi-level to-be-compared local sub-graph and a corresponding constructed local sub-graph according to levels, and obtaining the occupancy state matching degree of each level; if the occupancy state matching degree of each level is greater than the preset matching degree, performing occupancy state matching on a local sub-graph which is being constructed and the corresponding constructed local sub-graph; and if the occupancy states of the local sub-graph which is being constructed and the corresponding constructed local sub-graph at the same position are completely matched, determining that loopback succeeds. Therefore, after the occupancy states of the multi-level to-be-compared local sub-graphs are successfully matched, the local sub-graph which is being constructed and the corresponding constructed local sub-graph are subjected to state matching, and the loopback accuracy and the map construction success rate are improved.

Description

回环检测方法、装置、设备及计算机可读存储介质Loop closure detection method, apparatus, device, and computer-readable storage medium 技术领域technical field
本发明涉及图像处理技术领域,尤其涉及一种回环检测方法、装置、设备及计算机可读存储介质。The present invention relates to the technical field of image processing, and in particular, to a loop closure detection method, apparatus, device, and computer-readable storage medium.
发明背景Background of the Invention
在利用2D(two-dimensional,二维)激光基于SLAM(Simultaneous Localization and Mapping,同步定位绘图)算法绘制地图时,地图误差会逐步累积、传递,对于大型地图则会产生较大的累积误差。When a 2D (two-dimensional, two-dimensional) laser is used to draw a map based on the SLAM (Simultaneous Localization and Mapping) algorithm, the map error will gradually accumulate and transmit, and a large cumulative error will occur for large maps.
当前减小累积误差的主要方式是scan to map(激光返回数据与地图匹配),也即将激光雷达扫描数据直接与地图进行匹配,得到实际位置坐标。一边计算位置,一边把新扫描到的数据及时加入到已构建的地图中,但是这种方式在特征激光返回数据比较少的情况下可能会在任何一处进行回环,导致地图不准确。The current main way to reduce the cumulative error is scan to map (matching the laser return data with the map), that is, directly matching the lidar scan data with the map to obtain the actual position coordinates. While calculating the position, the newly scanned data is added to the constructed map in time, but this method may loop back anywhere when the characteristic laser return data is relatively small, resulting in an inaccurate map.
发明内容SUMMARY OF THE INVENTION
本发明实施例提供一种回环检测方法、装置、设备及计算机可读存储介质,旨在提高回环的准确性和地图构建的成功率。Embodiments of the present invention provide a loopback detection method, apparatus, device, and computer-readable storage medium, which aim to improve the accuracy of loopback and the success rate of map construction.
为实现上述目的,本发明实施例提供一种回环检测方法,该方法包括:To achieve the above purpose, an embodiment of the present invention provides a loopback detection method, which includes:
创建多层级待比对局部子图,按层级将多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;Create multi-level local sub-maps to be compared, and compare the occupancy states of the multi-level local sub-maps to be compared with the corresponding constructed local sub-maps in sequence to obtain the occupancy state matching degree of each level;
若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;If the occupancy state matching degree of each level is greater than the preset matching degree, the occupancy state matching is performed between the local subgraph being constructed and the corresponding constructed local subgraph;
若正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。If the local subgraph being constructed completely matches the occupancy state of the corresponding constructed local subgraph at the same position, it is determined that the loopback is successful.
此外,为实现上述目的,本发明实施例还提供一种回环检测装置,该回环检测装置包括:In addition, in order to achieve the above purpose, an embodiment of the present invention further provides a loopback detection device, where the loopback detection device includes:
创建模块,用于创建多层级待比对局部子图,按层级将多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;The creation module is used to create a multi-level local sub-map to be compared, and compare the occupancy status of the multi-level local sub-map to be compared with the corresponding constructed local sub-map in turn to obtain the matching degree of occupancy status of each level;
对比模块,用于若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;The comparison module is used to match the occupancy state of the local sub-graph being constructed and the corresponding constructed local sub-graph if the occupancy state matching degree of each level is greater than the preset matching degree;
判定模块,用于若正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。The determining module is configured to determine that the loopback is successful if the local sub-graph being constructed completely matches the occupancy state of the corresponding constructed local sub-graph at the same position.
此外,为实现上述目的,本发明实施例还提供一种回环检测设备,该回环检测设备包括处理器,存储器以及存储在存储器中的回环检测程序,回环检测程序被处理器运行时,实现如上的回环检测方法的步骤。In addition, in order to achieve the above object, an embodiment of the present invention also provides a loopback detection device, the loopback detection device includes a processor, a memory, and a loopback detection program stored in the memory. When the loopback detection program is run by the processor, the above-mentioned Steps of a loopback detection method.
此外,为实现上述目的,本发明实施例还提供一种计算机可读存储介质,该计算机可读存储介质上存储有回环检测程序,回环检测程序被处理器运行时实现如上回环检测方法的步骤。In addition, in order to achieve the above object, an embodiment of the present invention further provides a computer-readable storage medium storing a loopback detection program on the computer-readable storage medium. The loopback detection program is executed by a processor to implement the steps of the above loopback detection method.
相比现有技术,本发明提出的一种回环检测方法、装置、设备及计算机可读存储介质,创建多层级待比对局部子图,按层级将多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;若正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。由此在多层级待比对局部子图的占用状态匹配成功后,再将正在构建的局部子图与对应的已构建局部子图进行状态匹配,提高回环的准确性和地图构建的成功率。Compared with the prior art, a method, device, device and computer-readable storage medium for loop closure detection proposed by the present invention create multi-level partial sub-maps to be compared, and sequentially associate the multi-level partial sub-maps to be compared with corresponding ones according to the level. The occupancy states of the constructed local subgraphs are compared to obtain the occupancy state matching degree of each level; if the occupancy state matching degree of each level is greater than the preset matching degree, the local subgraph being constructed is compared with the corresponding constructed local subgraph. The graph performs occupancy state matching; if the local subgraph being constructed completely matches the occupancy state at the same position of the corresponding constructed local subgraph, it is determined that the loopback is successful. Therefore, after the occupancy state of the multi-level to-be-compared partial subgraph is successfully matched, the state of the local subgraph being constructed is matched with the corresponding constructed local subgraph, which improves the accuracy of loop closure and the success rate of map construction.
附图简要说明Brief Description of Drawings
图1是本发明各实施例涉及的回环检测设备的硬件结构示意图;1 is a schematic diagram of a hardware structure of a loopback detection device involved in various embodiments of the present invention;
图2是本发明回环检测方法第一实施例的流程示意图;FIG. 2 is a schematic flowchart of the first embodiment of the loopback detection method of the present invention;
图3是本发明回环检测装置第一实施例的功能模块示意图。FIG. 3 is a schematic diagram of functional modules of the first embodiment of the loopback detection apparatus of the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization, functional characteristics and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments.
具体实施方式Detailed ways
应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
本发明实施例主要涉及的回环检测设备是指能够实现网络连接的网络连接设备,回环检测设备可以是服务器、云平台等。The loopback detection device mainly involved in the embodiments of the present invention refers to a network connection device capable of realizing network connection, and the loopback detection device may be a server, a cloud platform, or the like.
参照图1,图1是本发明各实施例涉及的回环检测设备的硬件结构示意图。本发明实施例中,回环检测设备可以包括处理器1001(例如中央处理器Central Processing Unit、CPU),通信总线1002,输入端口1003,输出端口1004,存储器1005。其中,通信总线1002用于实现这些组件之间的连接通信;输入端口1003用于数据输入;输出端口1004用于数据输出,存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器,存储器1005可选的还可以是独立于前述处理器1001的存储装置。本领域技术人员可以理解,图1中示出的硬件结构并不构成对本发明的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Referring to FIG. 1 , FIG. 1 is a schematic diagram of a hardware structure of a loopback detection device involved in various embodiments of the present invention. In this embodiment of the present invention, the loopback detection device may include a processor 1001 (for example, a central processing unit, Central Processing Unit, CPU), a communication bus 1002, an input port 1003, an output port 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection communication between these components; the input port 1003 is used for data input; the output port 1004 is used for data output, and the memory 1005 can be a high-speed RAM memory or a non-volatile memory (non-volatile memory). memory), such as a disk memory, the memory 1005 may optionally also be a storage device independent of the aforementioned processor 1001 . Those skilled in the art can understand that the hardware structure shown in FIG. 1 does not constitute a limitation of the present invention, and may include more or less components than those shown in the drawings, or combine some components, or arrange different components.
继续参照图1,图1中作为一种可读计算机可读存储介质的存储器1005可以包括操作系统、网络通信模块、应用程序模块以及回环检测程序。在图1中,网络通信模块主要用于连接服务器,与服务器进行数据通信;而处理器1001可以调用存储器1005中存储的回环检测程序,并执行本发明实施例提供的回环检测方法。Continuing to refer to FIG. 1 , the memory 1005 in FIG. 1 as a readable computer-readable storage medium may include an operating system, a network communication module, an application program module, and a loopback detection program. In FIG. 1 , the network communication module is mainly used to connect to the server and perform data communication with the server; and the processor 1001 can call the loopback detection program stored in the memory 1005 and execute the loopback detection method provided by the embodiment of the present invention.
本发明实施例提供了一种回环检测方法。Embodiments of the present invention provide a loopback detection method.
参照图2,图2是本发明回环检测方法第一实施例的流程示意图。Referring to FIG. 2, FIG. 2 is a schematic flowchart of the first embodiment of the loopback detection method of the present invention.
本实施例中,回环检测方法应用于回环检测设备,方法包括:In this embodiment, a loopback detection method is applied to a loopback detection device, and the method includes:
步骤S101,创建多层级待比对局部子图,按层级将多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;Step S101, creating a multi-level local subgraph to be compared, and comparing the occupancy state of the multi-level local subgraph to be compared with the corresponding constructed local subgraph in turn according to the level, to obtain the occupancy state matching degree of each level;
回环检测,又称闭环检测,是指机器人识别曾到达某场景,使得地图闭环的能力。说的简单点,就是机器人在左转一下,右转一下建图的时候能意识到某个地方是曾经来过的,然后把此刻生成的地图与先前生成的地图做匹配。Loopback detection, also known as closed-loop detection, refers to the ability of the robot to recognize that it has reached a certain scene and make the map closed-loop. To put it simply, when the robot turns left and right to build a map, it can realize that a certain place has come before, and then match the map generated at this moment with the previously generated map.
本实施例基于SLAM(Simultaneous Localization and Mapping,同步定位绘图)绘制地图。SLAM主要用于解决移动机器人在未知环境中运行时定位导航与地图构建的问题。通过SLAM构建局部子图的流程包括::This embodiment draws a map based on SLAM (Simultaneous Localization and Mapping). SLAM is mainly used to solve the problems of positioning, navigation and map construction when mobile robots are running in unknown environments. The process of building a local subgraph through SLAM includes:
以机器人所在位置为中心创建空白子图;Create a blank subgraph centered on the robot's location;
机器人配置有激光传感器,激光传感器可以发射激光并接收激光返回数据,用于测量障碍物到激发传感器的距离。例如,该激光传感器可以是2D激光传感器,2D激光传感器发射一帧激光后,接收各个方向的返回激光返回数据,并根据返回的时间确定障碍物的距离。基于激光从发射到收到返回激光返回数据的 时间差,乘以速度再除以二就得到了传感器到对应方向上最近障碍物的距离。The robot is equipped with a laser sensor, which can emit laser light and receive laser return data to measure the distance from the obstacle to the excitation sensor. For example, the laser sensor can be a 2D laser sensor. After the 2D laser sensor emits a frame of laser light, it receives the return laser return data in all directions, and determines the distance of the obstacle according to the return time. Based on the time difference from the launch of the laser to the receipt of the returned laser data, multiply the speed and divide by two to get the distance from the sensor to the nearest obstacle in the corresponding direction.
在构建地图的过程中,机器人会不断地移动,并且可以在各个位置发射激光并接收返回数据。本实施例中,以机器人发射激光并接收返回数据的所在位置为中心,创建空白子图。空白子图的尺寸大小可以基于实际场景确定。During the process of building the map, the robot is constantly moving and can fire lasers at various locations and receive return data. In this embodiment, a blank subgraph is created centered on the location where the robot emits laser light and receives returned data. The size of the blank sub-image can be determined based on the actual scene.
将机器人收集到的激光返回数据转换至预先构建的空白子图中,在空白子图中标记各个位置的占用状态,获得局部子图;将多个连续的局部子图拼接成已构建局部子图。Convert the laser return data collected by the robot to a pre-built blank sub-map, mark the occupancy status of each position in the blank sub-map, and obtain a partial sub-map; splicing multiple continuous partial sub-maps into a constructed partial sub-map .
本实施例中,将机器人及其激光返回数据所在的坐标系标记为世界坐标系,在世界坐标系中将收集到的激光返回数据标记为scan points,将机器人所在的位置标记为origin,将机器人所在的位置以及激光返回数据表示为H={origin,scan points}。在空白子图中创建地图坐标系,将世界坐标系与地图坐标系的转换矩阵表示为Tξ,如此通过Tξ即可将机器人所在的位置以及激光返回数据H转换至空白子图中。在空白子图中将有障碍物的坐标对应位置处的占用状态标记为占用。In this embodiment, the coordinate system where the robot and its laser return data are located is marked as the world coordinate system, the collected laser return data is marked as scan points in the world coordinate system, the location of the robot is marked as origin, and the robot is marked as origin. The location and laser return data are expressed as H={origin, scan points}. Create a map coordinate system in the blank subgraph, and denote the transformation matrix between the world coordinate system and the map coordinate system as Tξ, so that the position of the robot and the laser return data H can be converted to the blank subgraph through Tξ. The occupancy state at the position corresponding to the coordinates of the obstacle is marked as occupied in the blank subgraph.
本实施例中,空白子图及转换后获得的局部子图(submap)可以是栅格地图,其大小可以是5cm×5cm,将每个局部子图的中心称为grid point(网格点),局部子图中的其他点称为corresponding pixel(相关像素点)。将将多个连续的局部子图基于SLAM算法进行拼接最终获得的就是一个包含很多子图的已构建局部地图。In this embodiment, the blank submap and the converted partial submap (submap) can be a grid map, the size of which can be 5cm×5cm, and the center of each partial submap is called a grid point (grid point). , and other points in the local subgraph are called corresponding pixels. By splicing multiple consecutive local subgraphs based on the SLAM algorithm, the final result is a constructed local map containing many subgraphs.
局部子图可以看做栅格概率地图,但是如果把局部子图看成特征点,那么整个已构建局部地图可以看成拓扑地图,局部子图为特征点,局部子图之间的相对位置的约束关系为线。局部子图跟局部子图之间通过中心点相对位置保持关系,但是这个相对位置误差在位置相近的局部子图之间比较低,随着局部子图数量的增加、机器人运动距离的变大、各种随机因素等等,误差会越来越大,举个例子,假设临近局部子图有1em的误差,当最终构建的地图中包含100张局部子图时,最后一个局部子图跟第一张局部子图之间的误差就达到1m之多,所以要进行回环检测来纠正这些误。The local submap can be regarded as a grid probability map, but if the local subgraph is regarded as a feature point, then the entire constructed local map can be regarded as a topological map, and the local subgraphs are the feature points, and the relative positions between the local subgraphs The constraint relationship is a line. The relationship between the local subgraph and the local subgraph is maintained through the relative position of the center point, but the relative position error is relatively low between the local subgraphs with similar positions. Various random factors, etc., the error will become larger and larger. For example, assuming that there is an error of 1em in the adjacent local subgraph, when the final constructed map contains 100 local subgraphs, the last local subgraph is the same as the first one. The error between the local subgraphs is as much as 1m, so loopback detection is required to correct these errors.
此外,在拼接已构建局部地图时,通过PL-ICP(piont line-iterative closest point,点线迭代最近点)来纠正机器人在小范围运动过程中造成的累积误差,然后根据纠正好的机器人位姿,将基于新的机器人位姿及其激光返回数据转换至局部子图中。当局部子图中存储的激光返回数据达到预设数量时,即可完成 局部子图的构建。In addition, when splicing the constructed local map, PL-ICP (piont line-iterative closest point, point-line iteration closest point) is used to correct the accumulated error caused by the robot in the process of small-scale motion, and then according to the corrected robot pose , which converts the data based on the new robot pose and its laser return into a local subgraph. When the laser return data stored in the local sub-map reaches the preset number, the construction of the local sub-map can be completed.
本实施例中,多层级待比对局部子图是指分辨率不同的待对比局部子图。In this embodiment, the multi-level local sub-images to be compared refer to local sub-images to be compared with different resolutions.
创建多层级待比对局部子图,包括:Create multi-level partial subgraphs to be compared, including:
将已构建局部子图按预设分辨率进行压缩,获得多个不同分辨率的层级压缩局部子图,预设分辨率包括第一预设分辨率、第二预设分辨率、第三预设分辨率,对应的层级压缩局部子图分别是第一层级压缩局部子图,第二层级压缩局部子图和第三层级压缩局部子图;将机器人接收到的激光信号数据分别转换至层级压缩局部子图,获得待比对局部子图。本实施例中基于SLAM算法将激光信号数据分别转换至层级压缩局部子图。Compress the constructed local sub-images at a preset resolution to obtain multiple hierarchically compressed local sub-images of different resolutions. The preset resolutions include a first preset resolution, a second preset resolution, and a third preset resolution. Resolution, the corresponding hierarchical compression local sub-images are the first-level compressed local sub-image, the second-level compressed local sub-image and the third-level compressed local sub-image; the laser signal data received by the robot are respectively converted to the hierarchical compression local sub-image. Subgraph, obtain the local subgraph to be compared. In this embodiment, based on the SLAM algorithm, the laser signal data are respectively converted into hierarchically compressed local sub-maps.
一般地,压缩后的层级压缩局部子图的分辨率低于对应的已构建局部子图。高分辨率的已构建局部子图经过压缩后,分辨率降低,像素点减少。例如若已构建局部子图A的面积为1平方米,当分辨率为5cm每像素时,对应有400个像素点;若压缩为50cm每像素,则对应有4个像素点。对于同样大小的已构建局部子图,像素点减少,进行匹配时所需要的计算量就大大减少了。例如可以设置3层,每一层分别对应于第一预设分辨率、第二预设分辨率、第三预设分辨率,例如第一预设分辨率为5cm每像素、第二预设分辨率为10cm每像素、第三预设分辨率为50cm。Generally, the resolution of the compressed hierarchically compressed local sub-map is lower than the corresponding constructed local sub-map. After the high-resolution constructed local sub-image is compressed, the resolution is reduced and the number of pixels is reduced. For example, if the area of the constructed local sub-image A is 1 square meter, when the resolution is 5cm per pixel, there are 400 pixels; if the compression is 50cm per pixel, there are 4 pixels. For the constructed local sub-images of the same size, the number of pixels is reduced, and the amount of computation required for matching is greatly reduced. For example, three layers can be set, and each layer corresponds to the first preset resolution, the second preset resolution, and the third preset resolution. For example, the first preset resolution is 5cm per pixel, and the second preset resolution is The rate is 10cm per pixel and the third preset resolution is 50cm.
具体地,将第一层级压缩局部子图中各个位置的第一占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第一占用状态匹配度;本实施例中述第一层级压缩局部子图的分辨率为第一分辨率。获取第一层级压缩局部子图中各个像素点对应位置的第一占用状态,同时获取已构建局部子图中对应于各个像素点位置的待对比占用状态。并将各个位置的第一占用状态与待对比占用状态进行对比,获得第一占用状态匹配度。第一层级压缩局部子图的分辨率较低,像素点比较少,需要对比的位置不多,计算量小,如此可以筛选有明显区别的局部子图。Specifically, the first occupancy state of each position in the first-level compressed local submap is compared with the occupancy state to be compared at each corresponding position in the corresponding constructed local submap to obtain the first occupancy state matching degree; this embodiment The resolution of the first-level compressed local sub-image is the first resolution. The first occupancy status of the corresponding positions of each pixel point in the first-level compressed local sub-map is acquired, and at the same time, the to-be-compared occupancy status corresponding to each pixel point position in the constructed local sub-map is acquired. The first occupancy state of each position is compared with the occupancy state to be compared to obtain the matching degree of the first occupancy state. The resolution of the first-level compressed local sub-image is low, the pixel points are relatively small, there are not many positions to be compared, and the amount of calculation is small, so that the local sub-images with obvious differences can be screened.
若第一占用状态匹配度大于预设第一匹配度,则将第二层级压缩局部子图中各个位置的第二占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第二占用状态匹配度,第二预设分辨率高于第一预设分辨率;预设第一匹配度可以根据需要具体设置,例如将预设第一匹配度设置为80%、85%或90%。由于第二层级压缩局部子图的分辨率高于第一层级压缩局部子图,具有更多的像素点,可以进行更精准的匹配。If the matching degree of the first occupancy state is greater than the preset first matching degree, the second occupancy state of each position in the second-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared. By comparison, a second occupancy state matching degree is obtained, and the second preset resolution is higher than the first preset resolution; the preset first matching degree can be specifically set as required, for example, the preset first matching degree is set to 80%, 85% or 90%. Since the resolution of the second-level compressed local sub-image is higher than that of the first-level compressed local sub-image, it has more pixels and can perform more accurate matching.
若第二占用状态匹配度大于预设第二匹配度,则将第三层级压缩局部子图中各个位置的第三占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第三占用状态匹配度,第三预设分辨率高于第二预设分辨率。预设第二匹配度可以根据需要具体设置,例如将预设第二匹配度设置为85%或90%。If the matching degree of the second occupancy state is greater than the preset second matching degree, the third occupancy state of each position in the third-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared. By comparison, a third occupancy state matching degree is obtained, and the third preset resolution is higher than the second preset resolution. The preset second matching degree can be specifically set as required, for example, the preset second matching degree is set to 85% or 90%.
此外,若第一占用状态匹配度小于或等于预设第一匹配度,则基于机器人接收到的激光信号数据对已构建局部子图进行纠错更新;In addition, if the first occupancy state matching degree is less than or equal to the preset first matching degree, performing error correction and updating on the constructed local sub-map based on the laser signal data received by the robot;
若第二占用状态匹配度小于或等预设第二匹配度,则基于机器人接收到的激光信号数据对已构建局部子图进行纠错更新。If the matching degree of the second occupancy state is less than or equal to the preset second matching degree, error correction and updating of the constructed local sub-map is performed based on the laser signal data received by the robot.
若第一占用状态匹配度和/或第二占用状态匹配度较低,则说明已构建局部子图可能存在差错,因此需要及时进行纠错更新,以保证构图的准确性。If the matching degree of the first occupancy state and/or the degree of matching of the second occupancy state is low, it indicates that there may be errors in the constructed local sub-images, and therefore it is necessary to perform error correction and update in time to ensure the accuracy of the composition.
步骤S102,若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;Step S102, if the occupancy state matching degree of each level is greater than the preset matching degree, the occupancy state matching is performed between the local subgraph being constructed and the corresponding constructed local subgraph;
若第一占用状态匹配度、第二占用状态匹配度和第三占用状态匹配度均大于对应的预设匹配度,则说明正在构建的局部子图与对应的已构建局部子图的相似度较高,则说明已构建局部子图的正确性比较高,也即激光返回信号匹配成功,并进一步进行回环判定。If the first occupancy state matching degree, the second occupancy state matching degree and the third occupancy state matching degree are all greater than the corresponding preset matching degrees, it means that the similarity between the local subgraph being constructed and the corresponding constructed local subgraph is relatively high. If the value is high, it means that the correctness of the constructed local subgraph is relatively high, that is, the laser return signal is successfully matched, and further loopback judgment is performed.
具体地,将正在构建的局部子图中各个位置的当前占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行匹配。Specifically, the current occupancy status of each position in the local submap being constructed is matched with the occupancy status to be compared at each corresponding position in the corresponding constructed local submap.
步骤S103,若正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。Step S103, if the local subgraph being constructed completely matches the occupancy state of the corresponding constructed local subgraph at the same position, it is determined that the loopback is successful.
将正在构建的局部子图放到之前激光匹配成功的位置,经过坐标转换,如果正在构建的局部子图和这次匹配上的已构建局部子图,在相同坐标上,占用状态都相同,则认为回环成功。Place the local sub-image being constructed to the position where the laser matching was successful before, and after coordinate transformation, if the local sub-image being constructed and the local sub-image already constructed on this match have the same occupancy status at the same coordinates, then The loopback is considered successful.
如果回环检测成功,可以显著地减小累积误差,帮助机器人更精准、快速的进行避障导航工作。而错误的检测结果可能使地图变得很糟糕。因此,回环检测在大面积、大场景地图构建上是非常有必要的。If the loopback detection is successful, the accumulated error can be significantly reduced, helping the robot to perform obstacle avoidance and navigation more accurately and quickly. And wrong detection results can make the map bad. Therefore, loop closure detection is very necessary in the construction of large-area and large-scene maps.
当激光匹配成功后,将正在构建的局部子图与对应的已构建局部子图,因此本申请中的回环检测方法实际是一种map_to_map(地图到地图)的方法。map_to_map回环检测方法就是在每次进行回环检测时不仅使用单帧激光,还要使用尚未完成的局部子图submap,之所以采用这种方法就是因为单帧激光所包 含的信息太少,在缺乏特征的环境下非常容易误匹配,但是局部子图包含了一段时间的地图信息,所描述的环境特征也更多,所以能大大降低误匹配的可能。激光匹配成功以后,然后进行局部子图和已构建子图比对,进行第二次判定,如果依然判定匹配,才认为回环匹配成功。这样做不仅不会影响算法的实时性,还可以提高算法输出的可靠性。算法的前端和后端一般是两个进程同时运算,本方案可以保证算法整体保持实时性。After the laser matching is successful, the local submap being constructed is compared with the corresponding constructed local submap, so the loop closure detection method in this application is actually a map_to_map (map to map) method. The map_to_map loopback detection method is to use not only a single frame of laser but also an unfinished local submap submap for each loopback detection. It is very easy to mismatch in the environment of , but the local submap contains map information for a period of time, and describes more environmental features, so it can greatly reduce the possibility of mismatch. After the laser matching is successful, the local subgraph is compared with the constructed subgraph, and a second judgment is made. If the matching is still determined, the loopback matching is considered successful. This will not only not affect the real-time performance of the algorithm, but also improve the reliability of the algorithm output. The front-end and back-end of the algorithm are generally operated by two processes at the same time. This solution can ensure the overall real-time performance of the algorithm.
进一步地,步骤S103之后还包括:将已构建局部子图进行优化,以降低已构建局部子图的累积误差。Further, after step S103, the method further includes: optimizing the constructed local subgraphs to reduce the accumulated error of the constructed local subgraphs.
本实施例中,可以基于已构建局部子图中相邻子图的误差进行优化,使最终的误差最小,并将误差最小的已构建局部子图保存为最终的已构建局部子图。In this embodiment, optimization may be performed based on the error of the adjacent subgraphs in the constructed local subgraph to minimize the final error, and the constructed local subgraph with the smallest error is saved as the final constructed local subgraph.
本实施例通过上述方案,创建多层级待比对局部子图,按层级将多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;若正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。由此在多层级待比对局部子图的占用状态匹配成功后,再将正在构建的局部子图与对应的已构建局部子图进行状态匹配,提高回环的准确性和地图构建的成功率。In this embodiment, through the above solution, a multi-level local sub-map to be compared is created, and the multi-level local sub-map to be compared is sequentially compared with the corresponding constructed local sub-map according to the occupancy status, so as to obtain the matching degree of occupancy status of each level. ; If the matching degree of occupancy status of each level is greater than the preset matching degree, the occupancy status of the local subgraph being constructed is matched with the corresponding constructed local subgraph; if the local subgraph being constructed matches the corresponding constructed local subgraph If the occupancy states of the subgraphs at the same position completely match, it is determined that the loopback is successful. Therefore, after the occupancy state of the multi-level to-be-compared partial subgraph is successfully matched, the state of the local subgraph being constructed is matched with the corresponding constructed local subgraph, which improves the accuracy of loop closure and the success rate of map construction.
此外,本实施例还提供一种回环检测装置。参照图3,图3为本发明回环检测装置第一实施例的功能模块示意图。In addition, this embodiment also provides a loopback detection device. Referring to FIG. 3 , FIG. 3 is a schematic diagram of functional modules of the first embodiment of the loopback detection apparatus of the present invention.
本实施例中,回环检测装置为虚拟装置,存储于图1所示的回环检测设备的存储器1005中,以实现回环检测程序的所有功能:用于创建多层级待比对局部子图,按层级将多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;用于若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;用于若正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。In this embodiment, the loopback detection device is a virtual device, which is stored in the memory 1005 of the loopback detection device shown in Compare the occupancy states of the multi-level local sub-maps to be compared with the corresponding constructed local sub-maps in turn to obtain the occupancy state matching degree of each level; it is used if the occupancy state matching degree of each level is greater than the preset matching degree, then Match the occupancy state of the local subgraph under construction with the corresponding constructed local subgraph; it is used to determine that the loopback is successful if the local subgraph being constructed completely matches the occupancy state of the corresponding constructed local subgraph at the same position .
具体地,回环检测装置包括:Specifically, the loopback detection device includes:
创建模块10,用于创建多层级待比对局部子图,按层级将多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用 状态匹配度;The creation module 10 is used to create a multi-level local sub-graph to be compared, and the multi-level local sub-graph to be compared is successively compared with the corresponding constructed local sub-graph by level, and the occupancy state matching degree of each level is obtained;
对比模块20,用于若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;The comparison module 20 is used for matching the occupancy state of the local sub-graph being constructed and the corresponding constructed local sub-graph if the occupancy state matching degree of each level is greater than the preset matching degree;
判定模块30,用于若正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。The determination module 30 is configured to determine that the loopback is successful if the occupancy state of the local sub-graph being constructed and the corresponding constructed local sub-graph at the same position are completely matched.
进一步地,创建模块还用于:Further, creating modules is also used to:
将已构建局部子图按预设分辨率进行压缩,获得多个不同分辨率的层级压缩局部子图,预设分辨率包括第一预设分辨率、第二预设分辨率、第三预设分辨率,对应的层级压缩局部子图分别是第一层级压缩局部子图,第二层级压缩局部子图和第三层级压缩局部子图;Compress the constructed local sub-images at a preset resolution to obtain multiple hierarchically compressed local sub-images of different resolutions. The preset resolutions include a first preset resolution, a second preset resolution, and a third preset resolution. Resolution, the corresponding hierarchical compressed local sub-images are the first-level compressed local sub-image, the second-level compressed local sub-image and the third-level compressed local sub-image;
将机器人接收到的激光信号数据分别转换至层级压缩局部子图,获得待比对局部子图。The laser signal data received by the robot are respectively converted into hierarchical compressed local sub-images to obtain the local sub-images to be compared.
进一步地,创建模块还用于:Further, creating modules is also used to:
将第一层级压缩局部子图中各个位置的第一占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第一占用状态匹配度;Comparing the first occupancy status of each position in the first-level compressed local submap with the to-be-compared occupancy status of each corresponding position in the corresponding constructed local submap to obtain the first occupancy status matching degree;
若第一占用状态匹配度大于预设第一匹配度,则将第二层级压缩局部子图中各个位置的第二占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第二占用状态匹配度,第二预设分辨率高于第一预设分辨率;If the matching degree of the first occupancy state is greater than the preset first matching degree, the second occupancy state of each position in the second-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared. By comparison, a second occupancy state matching degree is obtained, and the second preset resolution is higher than the first preset resolution;
若第二占用状态匹配度大于预设第二匹配度,则将第三层级压缩局部子图中各个位置的第三占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第三占用状态匹配度,第三预设分辨率高于第二预设分辨率。If the matching degree of the second occupancy state is greater than the preset second matching degree, the third occupancy state of each position in the third-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared. By comparison, a third occupancy state matching degree is obtained, and the third preset resolution is higher than the second preset resolution.
进一步地,创建模块还用于:Further, creating modules is also used to:
若第一占用状态匹配度小于或等于预设第一匹配度,则基于机器人接收到的激光信号数据对已构建局部子图进行纠错更新。If the first occupancy state matching degree is less than or equal to the preset first matching degree, error correction and updating of the constructed local sub-map is performed based on the laser signal data received by the robot.
进一步地,创建模块还用于:Further, creating modules is also used to:
以机器人所在位置为中心创建空白子图;Create a blank subgraph centered on the robot's location;
将机器人收集到的激光返回数据转换至预先构建的空白子图中,在空白子图中标记各个位置的占用状态,获得局部子图;Convert the laser return data collected by the robot to a pre-built blank sub-map, mark the occupancy status of each position in the blank sub-map, and obtain a local sub-map;
将多个连续的局部子图拼接成已构建局部子图。Concatenates multiple consecutive local subgraphs into a constructed local subgraph.
进一步地,对比模块还用于:Further, the comparison module is also used to:
将正在构建的局部子图中各个位置的当前占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行匹配。The current occupancy status of each position in the local sub-map being constructed is matched with the to-be-compared occupancy status of each corresponding position in the corresponding constructed local sub-map.
进一步地,对比模块还用于:Further, the comparison module is also used to:
将已构建局部子图进行优化,以降低已构建局部子图的累积误差。The constructed local subgraph is optimized to reduce the accumulated error of the constructed local subgraph.
此外,本发明实施例还提供一种计算机可读存储介质,计算机可读存储介质上存储有回环检测程序,回环检测程序被处理器运行时实现如上回环检测方法的步骤。In addition, an embodiment of the present invention further provides a computer-readable storage medium, where a loopback detection program is stored on the computer-readable storage medium, and when the loopback detection program is run by a processor, the steps of the above loopback detection method are implemented.
相比现有技术,本发明提出的一种回环检测方法、装置、设备及计算机可读存储介质,创建多层级待比对局部子图,按层级将多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;若正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。由此在多层级待比对局部子图的占用状态匹配成功后,再将正在构建的局部子图与对应的已构建局部子图进行状态匹配,提高回环的准确性和地图构建的成功率。Compared with the prior art, a method, device, device and computer-readable storage medium for loop closure detection proposed by the present invention create multi-level partial sub-maps to be compared, and sequentially associate the multi-level partial sub-maps to be compared with corresponding ones according to the level. The occupancy states of the constructed local subgraphs are compared to obtain the occupancy state matching degree of each level; if the occupancy state matching degree of each level is greater than the preset matching degree, the local subgraph being constructed is compared with the corresponding constructed local subgraph. The graph performs occupancy state matching; if the local subgraph being constructed completely matches the occupancy state at the same position of the corresponding constructed local subgraph, it is determined that the loopback is successful. Therefore, after the occupancy state of the multi-level to-be-compared partial subgraph is successfully matched, the state of the local subgraph being constructed is matched with the corresponding constructed local subgraph, which improves the accuracy of loop closure and the success rate of map construction.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or system comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or system. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article or system that includes the element.
上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个计算机可读存储介质(如ROM/RAM、 磁碟、光盘)中,包括若干指令用以使得一台终端设备执行本发明各个实施例所述的方法。From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on such understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that contribute to the prior art, and the computer software products are stored in the above-mentioned computer-readable storage medium (such as ROM/RAM, magnetic disk, optical disk), including several instructions to make a terminal device execute the methods described in the various embodiments of the present invention.
以上所述仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或流程变换,或直接或间接运用在其它相关的技术领域,均同理包括在本发明的专利保护范围内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the scope of the present invention. Any equivalent structure or process transformation made by using the contents of the description and drawings of the present invention, or directly or indirectly applied in other related technical fields , are similarly included in the scope of patent protection of the present invention.

Claims (13)

  1. 一种回环检测方法,其中,所述方法包括:A loop closure detection method, wherein the method comprises:
    创建多层级待比对局部子图,按层级将所述多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;Create a multi-level local sub-map to be compared, and compare the occupancy status of the multi-level local sub-map to be compared with the corresponding constructed local sub-map in turn according to the level, so as to obtain the occupancy status matching degree of each level;
    若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;If the occupancy state matching degree of each level is greater than the preset matching degree, the occupancy state matching is performed between the local subgraph being constructed and the corresponding constructed local subgraph;
    若所述正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。The loopback is determined to be successful if the occupancy status of the local sub-graph being constructed and the corresponding constructed local sub-graph at the same position completely match.
  2. 根据权利要求1所述的方法,其中,所述创建多层级待比对局部子图,包括:The method according to claim 1, wherein the creating a multi-level partial subgraph to be compared comprises:
    将已构建局部子图按预设分辨率进行压缩,获得多个不同分辨率的层级压缩局部子图,所述预设分辨率包括第一预设分辨率、第二预设分辨率、第三预设分辨率,对应的层级压缩局部子图分别是第一层级压缩局部子图,第二层级压缩局部子图和第三层级压缩局部子图;Compress the constructed local sub-images at a preset resolution to obtain multiple hierarchically compressed local sub-images of different resolutions, where the preset resolutions include a first preset resolution, a second preset resolution, and a third preset resolution. At the preset resolution, the corresponding hierarchical compressed local sub-images are respectively the first-level compressed local sub-image, the second-level compressed local sub-image, and the third-level compressed local sub-image;
    将机器人接收到的激光信号数据分别转换至所述层级压缩局部子图,获得待比对局部子图。The laser signal data received by the robot are respectively converted into the hierarchical compressed local sub-maps to obtain the local sub-maps to be compared.
  3. 根据权利要求2所述的方法,其中,所述按层级将所述多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度,包括:The method according to claim 2, wherein the multi-level local sub-graphs to be compared are sequentially compared with the corresponding constructed local sub-graphs according to the occupancy state to obtain the occupancy state matching degree of each level, comprising: :
    将所述第一层级压缩局部子图中各个位置的第一占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第一占用状态匹配度;Comparing the first occupancy state of each position in the first-level compressed local submap with the to-be-compared occupancy state of each corresponding position in the corresponding constructed local submap, to obtain the first occupancy state matching degree;
    若所述第一占用状态匹配度大于预设第一匹配度,则将所述第二层级压缩局部子图中各个位置的第二占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第二占用状态匹配度,所述第二预设分辨率高于所述第一预设分辨率;If the matching degree of the first occupancy state is greater than the preset first matching degree, the second occupancy state of each position in the second-level compressed local sub-map and the corresponding position in the corresponding constructed local sub-map to be comparing the occupancy states to obtain a second occupancy state matching degree, where the second preset resolution is higher than the first preset resolution;
    若所述第二占用状态匹配度大于预设第二匹配度,则将所述第三层级压缩局部子图中各个位置的第三占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第三占用状态匹配度,所述第三预设分辨率 高于所述第二预设分辨率。If the matching degree of the second occupancy state is greater than the preset second matching degree, the third occupancy state of each position in the third-level compressed local sub-map and the corresponding position in the corresponding constructed local sub-map to be The occupancy states are compared to obtain a third occupancy state matching degree, where the third preset resolution is higher than the second preset resolution.
  4. 根据权利要求3所述的方法,其中,所述将所述第一层级压缩局部子图中各个位置的第一占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第一占用状态匹配度,之后还包括:The method according to claim 3, wherein the comparing the first occupancy status of each position in the first-level compressed local sub-map with the to-be-compared occupancy status of each corresponding position in the corresponding constructed local sub-map , obtain the first occupancy state matching degree, and then include:
    若所述第一占用状态匹配度小于或等于所述预设第一匹配度,则基于所述机器人接收到的激光信号数据对所述已构建局部子图进行纠错更新。If the first occupancy state matching degree is less than or equal to the preset first matching degree, performing error correction and updating on the constructed local sub-map based on the laser signal data received by the robot.
  5. 根据权利要求1所述的方法,其中,所述创建多层级待比对局部子图,按层级将所述多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度,之前还包括:The method according to claim 1, wherein, creating a multi-level partial sub-map to be compared, and comparing the occupancy status of the multi-level partial sub-map to be compared with the corresponding constructed local sub-map in sequence, Obtain the occupancy status match of each level, which previously included:
    以机器人所在位置为中心创建空白子图;Create a blank subgraph centered on the robot's location;
    将机器人收集到的激光返回数据转换至预先构建的空白子图中,在所述空白子图中标记各个位置的占用状态,获得局部子图;Convert the laser return data collected by the robot into a pre-built blank sub-map, mark the occupancy status of each position in the blank sub-map, and obtain a local sub-map;
    将多个连续的局部子图拼接成所述已构建局部子图。A plurality of consecutive local subgraphs are stitched into the constructed local subgraph.
  6. 根据权利要求1所述的方法,其中,所述将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配,包括:The method according to claim 1, wherein the matching of the occupancy state between the local sub-graph being constructed and the corresponding constructed local sub-graph comprises:
    将所述正在构建的局部子图中各个位置的当前占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行匹配。Matching the current occupancy status of each position in the local submap under construction with the occupancy status to be compared at each corresponding position in the corresponding constructed local submap.
  7. 根据权利要求1-6中任一项所述的方法,其中,所述若所述正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功,之后还包括:The method according to any one of claims 1-6, wherein, if the local sub-graph being constructed completely matches the occupancy state at the same position of the corresponding constructed local sub-graph, it is determined that the loopback is successful, After that it also includes:
    将已构建局部子图进行优化,以降低所述已构建局部子图的累积误差。The constructed local subgraphs are optimized to reduce the accumulated error of the constructed local subgraphs.
  8. 一种回环检测装置,其中,所述回环检测装置包括:A loopback detection device, wherein the loopback detection device comprises:
    创建模块,用于创建多层级待比对局部子图,按层级将所述多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;The creation module is used to create a multi-level local sub-map to be compared, and compare the occupancy status of the multi-level local sub-map to be compared with the corresponding constructed local sub-maps in turn to obtain the occupancy status matching degree of each level. ;
    对比模块,用于若各个层级的占用状态匹配度均大于预设匹配度,则将正 在构建的局部子图与对应的已构建局部子图进行占用状态匹配;The comparison module is used to match the occupancy state of the local subgraph being constructed and the corresponding constructed local subgraph if the occupancy state matching degree of each level is greater than the preset matching degree;
    判定模块,用于若所述正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。A determination module, configured to determine that the loopback is successful if the occupancy state of the local sub-graph being constructed and the corresponding constructed local sub-graph at the same position are completely matched.
  9. 一种回环检测设备,其中,所述回环检测设备包括处理器,存储器以及存储在所述存储器中的回环检测程序,所述回环检测程序被所述处理器运行时,实现如下的回环检测方法:A loopback detection device, wherein the loopback detection device includes a processor, a memory, and a loopback detection program stored in the memory. When the loopback detection program is run by the processor, the following loopback detection method is implemented:
    创建多层级待比对局部子图,按层级将所述多层级待比对局部子图依次与对应的已构建局部子图进行占用状态对比,获得各个层级的占用状态匹配度;Create a multi-level local sub-map to be compared, and compare the occupancy status of the multi-level local sub-map to be compared with the corresponding constructed local sub-map in turn according to the level, so as to obtain the occupancy status matching degree of each level;
    若各个层级的占用状态匹配度均大于预设匹配度,则将正在构建的局部子图与对应的已构建局部子图进行占用状态匹配;If the occupancy state matching degree of each level is greater than the preset matching degree, the occupancy state matching is performed between the local subgraph being constructed and the corresponding constructed local subgraph;
    若所述正在构建的局部子图与对应的已构建局部子图的在相同位置的占用状态完全匹配则判定回环成功。The loopback is determined to be successful if the occupancy status of the local sub-graph being constructed and the corresponding constructed local sub-graph at the same position completely match.
  10. 一种计算机可读存储介质,其中,所述计算机可读存储介质上存储有回环检测程序,所述回环检测程序被处理器运行时实现如权利要求1-7中任一项所述回环检测方法的步骤。A computer-readable storage medium, wherein a loopback detection program is stored on the computer-readable storage medium, and when the loopback detection program is run by a processor, the loopback detection method according to any one of claims 1-7 is implemented A step of.
  11. 根据权利要求8所述的装置,其中,所述创建模块还用于:The apparatus of claim 8, wherein the creation module is further configured to:
    将已构建局部子图按预设分辨率进行压缩,获得多个不同分辨率的层级压缩局部子图,预设分辨率包括第一预设分辨率、第二预设分辨率、第三预设分辨率,对应的层级压缩局部子图分别是第一层级压缩局部子图,第二层级压缩局部子图和第三层级压缩局部子图;Compress the constructed local sub-images at a preset resolution to obtain multiple hierarchically compressed local sub-images of different resolutions. The preset resolutions include a first preset resolution, a second preset resolution, and a third preset resolution. Resolution, the corresponding hierarchical compressed local sub-images are the first-level compressed local sub-image, the second-level compressed local sub-image and the third-level compressed local sub-image;
    将机器人接收到的激光信号数据分别转换至层级压缩局部子图,获得待比对局部子图。The laser signal data received by the robot are respectively converted into hierarchical compressed local sub-images to obtain the local sub-images to be compared.
  12. 根据权利要求11所述的装置,其中,所述创建模块还用于:The apparatus of claim 11, wherein the creation module is further configured to:
    将第一层级压缩局部子图中各个位置的第一占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第一占用状态匹配度;Comparing the first occupancy status of each position in the first-level compressed local submap with the to-be-compared occupancy status of each corresponding position in the corresponding constructed local submap to obtain the first occupancy status matching degree;
    若第一占用状态匹配度大于预设第一匹配度,则将第二层级压缩局部子图 中各个位置的第二占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第二占用状态匹配度,第二预设分辨率高于第一预设分辨率;If the matching degree of the first occupancy state is greater than the preset first matching degree, the second occupancy state of each position in the second-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared. By comparison, a second occupancy state matching degree is obtained, and the second preset resolution is higher than the first preset resolution;
    若第二占用状态匹配度大于预设第二匹配度,则将第三层级压缩局部子图中各个位置的第三占用状态与对应的已构建局部子图中各个对应位置的待对比占用状态进行对比,获得第三占用状态匹配度,第三预设分辨率高于第二预设分辨率。If the matching degree of the second occupancy state is greater than the preset second matching degree, the third occupancy state of each position in the third-level compressed local submap is compared with the occupancy state of each corresponding position in the corresponding constructed local submap to be compared. By comparison, a third occupancy state matching degree is obtained, and the third preset resolution is higher than the second preset resolution.
  13. 根据权利要求8所述的装置,其中,所述创建模块还用于:The apparatus of claim 8, wherein the creation module is further configured to:
    以机器人所在位置为中心创建空白子图;Create a blank subgraph centered on the robot's location;
    将机器人收集到的激光返回数据转换至预先构建的空白子图中,在空白子图中标记各个位置的占用状态,获得局部子图;Convert the laser return data collected by the robot to a pre-built blank sub-map, mark the occupancy status of each position in the blank sub-map, and obtain a local sub-map;
    将多个连续的局部子图拼接成已构建局部子图。Concatenates multiple consecutive local subgraphs into a constructed local subgraph.
PCT/CN2021/129493 2021-01-04 2021-11-09 Loopback detection method, apparatus and device, and computer readable storage medium WO2022142744A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110010343.6 2021-01-04
CN202110010343.6A CN112700497B (en) 2021-01-04 2021-01-04 Loop detection method, device, equipment and computer readable storage medium

Publications (1)

Publication Number Publication Date
WO2022142744A1 true WO2022142744A1 (en) 2022-07-07

Family

ID=75514786

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/129493 WO2022142744A1 (en) 2021-01-04 2021-11-09 Loopback detection method, apparatus and device, and computer readable storage medium

Country Status (2)

Country Link
CN (1) CN112700497B (en)
WO (1) WO2022142744A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116105721A (en) * 2023-04-11 2023-05-12 深圳市其域创新科技有限公司 Loop optimization method, device and equipment for map construction and storage medium
CN117173247A (en) * 2023-11-02 2023-12-05 中国海洋大学 Outdoor positioning and composition method and system based on 2D laser radar and LightGBM

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112700497B (en) * 2021-01-04 2023-06-09 歌尔股份有限公司 Loop detection method, device, equipment and computer readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110531766A (en) * 2019-08-27 2019-12-03 熵智科技(深圳)有限公司 Based on the known continuous laser SLAM composition localization method for occupying grating map
CN111680747A (en) * 2020-06-08 2020-09-18 北京百度网讯科技有限公司 Method and apparatus for closed loop detection of occupancy grid subgraph
US20200309529A1 (en) * 2019-03-29 2020-10-01 Trimble Inc. Slam assisted ins
CN111795687A (en) * 2020-06-29 2020-10-20 深圳市优必选科技股份有限公司 Robot map updating method and device, readable storage medium and robot
CN111932600A (en) * 2020-07-31 2020-11-13 杭州电子科技大学 Real-time loop detection method based on local subgraph
CN112700497A (en) * 2021-01-04 2021-04-23 歌尔股份有限公司 Loop detection method, device, equipment and computer readable storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9125019B1 (en) * 2014-05-01 2015-09-01 Glopos Fzc Positioning arrangement, method, mobile device and computer program
CN109978925B (en) * 2017-12-27 2021-04-20 深圳市优必选科技有限公司 Robot pose recognition method and robot thereof
CN111060113B (en) * 2019-12-31 2022-04-08 歌尔股份有限公司 Map updating method and device
CN111192364A (en) * 2020-01-09 2020-05-22 北京科技大学 Low-cost mobile multi-robot vision simultaneous positioning and map creating method
CN111209978B (en) * 2020-04-20 2020-07-10 浙江欣奕华智能科技有限公司 Three-dimensional visual repositioning method and device, computing equipment and storage medium
CN111540027B (en) * 2020-04-23 2022-01-18 上海高仙自动化科技发展有限公司 Detection method, detection device, electronic equipment and storage medium
CN111402413B (en) * 2020-06-04 2020-12-22 浙江欣奕华智能科技有限公司 Three-dimensional visual positioning method and device, computing equipment and storage medium
CN112068154B (en) * 2020-09-14 2022-12-13 中科院软件研究所南京软件技术研究院 Laser mapping positioning method and device, storage medium and electronic equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200309529A1 (en) * 2019-03-29 2020-10-01 Trimble Inc. Slam assisted ins
CN110531766A (en) * 2019-08-27 2019-12-03 熵智科技(深圳)有限公司 Based on the known continuous laser SLAM composition localization method for occupying grating map
CN111680747A (en) * 2020-06-08 2020-09-18 北京百度网讯科技有限公司 Method and apparatus for closed loop detection of occupancy grid subgraph
CN111795687A (en) * 2020-06-29 2020-10-20 深圳市优必选科技股份有限公司 Robot map updating method and device, readable storage medium and robot
CN111932600A (en) * 2020-07-31 2020-11-13 杭州电子科技大学 Real-time loop detection method based on local subgraph
CN112700497A (en) * 2021-01-04 2021-04-23 歌尔股份有限公司 Loop detection method, device, equipment and computer readable storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
WEN GUOCHENG, BI ZENG, YUNHUA CHEN: "Loop closure detection method for large scale map of laser SLAM", APPLICATION RESEARCH OF COMPUTERS, CHENGDU, CN, vol. 35, no. 6, 30 June 2018 (2018-06-30), CN , XP055948693, ISSN: 1001-3695, DOI: 10.3969/j.issn.1001-3695.2018.06.027 *
XIONG HUI: "Research on the Simultaneous Localization and Mapping Methods for Mobile Robot Based on Hierarchical Optimization", CHINESE DOCTORAL DISSERTATIONS FULL-TEXT DATABASE, UNIVERSITY OF CHINESE ACADEMY OF SCIENCES, CN, no. 3, 15 March 2020 (2020-03-15), CN , XP055948688, ISSN: 1674-022X *
ZHANG HE, ET AL.: "Submap and Adaptive Covariance Based Method for 2D Localization", COMPUTER SCIENCE, KEXUE JISHU WENXIAN CHUBANSHE CHONGQING FENSHE, CN, vol. 41, no. 10, 31 October 2014 (2014-10-31), CN , XP055948696, ISSN: 1002-137X, DOI: 10.11896/j.issn.1002-137X.2014.10.005 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116105721A (en) * 2023-04-11 2023-05-12 深圳市其域创新科技有限公司 Loop optimization method, device and equipment for map construction and storage medium
CN116105721B (en) * 2023-04-11 2023-06-09 深圳市其域创新科技有限公司 Loop optimization method, device and equipment for map construction and storage medium
CN117173247A (en) * 2023-11-02 2023-12-05 中国海洋大学 Outdoor positioning and composition method and system based on 2D laser radar and LightGBM
CN117173247B (en) * 2023-11-02 2024-02-02 中国海洋大学 Outdoor positioning and composition method and system based on 2D laser radar and LightGBM

Also Published As

Publication number Publication date
CN112700497B (en) 2023-06-09
CN112700497A (en) 2021-04-23

Similar Documents

Publication Publication Date Title
WO2022142744A1 (en) Loopback detection method, apparatus and device, and computer readable storage medium
CN111536964B (en) Robot positioning method and device, and storage medium
CN112068154B (en) Laser mapping positioning method and device, storage medium and electronic equipment
US20190206122A1 (en) Method and apparatus for generating raster map
Grisetti et al. Nonlinear constraint network optimization for efficient map learning
CN110174894B (en) Robot and repositioning method thereof
US20200134866A1 (en) Position estimation system and position estimation method
WO2021208143A1 (en) Method and system for planning and sampling mobile robot path in human-machine integration environment
JP7300550B2 (en) METHOD AND APPARATUS FOR CONSTRUCTING SIGNS MAP BASED ON VISUAL SIGNS
CN113376650A (en) Mobile robot positioning method and device, electronic equipment and storage medium
CN111680747B (en) Method and apparatus for closed loop detection of occupancy grid subgraphs
CN113587933B (en) Indoor mobile robot positioning method based on branch-and-bound algorithm
US11263774B2 (en) Three-dimensional position estimation device and program
WO2023273169A1 (en) Vision and laser-fused 2.5d map construction method
CN112700479B (en) Registration method based on CNN point cloud target detection
CN112651997B (en) Map construction method, electronic device and storage medium
CN113409459A (en) Method, device and equipment for producing high-precision map and computer storage medium
CN113325389A (en) Unmanned vehicle laser radar positioning method, system and storage medium
CN115326051A (en) Positioning method and device based on dynamic scene, robot and medium
CN114299386A (en) Laser SLAM method integrating laser odometer and loop detection
CN111964665B (en) Intelligent vehicle positioning method and system based on vehicle-mounted all-around image and storage medium
CN112697158A (en) Man-made loop-back instant positioning and picture building method and system for indoor and outdoor scenes
CN111113405B (en) Method for robot to obtain position service and robot
CN116563352A (en) Single-line laser radar loop detection method and system integrating depth visual information
CN116642490A (en) Visual positioning navigation method based on hybrid map, robot and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21913487

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21913487

Country of ref document: EP

Kind code of ref document: A1