WO2019104732A1 - Vision cleaning robot and obstacle detection method - Google Patents

Vision cleaning robot and obstacle detection method Download PDF

Info

Publication number
WO2019104732A1
WO2019104732A1 PCT/CN2017/114323 CN2017114323W WO2019104732A1 WO 2019104732 A1 WO2019104732 A1 WO 2019104732A1 CN 2017114323 W CN2017114323 W CN 2017114323W WO 2019104732 A1 WO2019104732 A1 WO 2019104732A1
Authority
WO
WIPO (PCT)
Prior art keywords
points
spatial
obstacle
feature
feature points
Prior art date
Application number
PCT/CN2017/114323
Other languages
French (fr)
Chinese (zh)
Inventor
王声平
张立新
Original Assignee
深圳市沃特沃德股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市沃特沃德股份有限公司 filed Critical 深圳市沃特沃德股份有限公司
Priority to PCT/CN2017/114323 priority Critical patent/WO2019104732A1/en
Publication of WO2019104732A1 publication Critical patent/WO2019104732A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L11/00Machines for cleaning floors, carpets, furniture, walls, or wall coverings
    • A47L11/24Floor-sweeping machines, motor-driven
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L11/00Machines for cleaning floors, carpets, furniture, walls, or wall coverings
    • A47L11/40Parts or details of machines not provided for in groups A47L11/02 - A47L11/38, or not restricted to one of these groups, e.g. handles, arrangements of switches, skirts, buffers, levers

Definitions

  • the present invention relates to the field of visual sweeping robots, and more particularly to a visual sweeping robot and an obstacle detecting method.
  • methods for detecting an obstacle include a method using infrared reflection, a method using ultrasonic detection, a method of physical collision, and the like.
  • the current methods all have corresponding defects.
  • the method of infrared reflection is not sensitive to black obstacles; in the ultrasonic detection method, it is difficult to install ultrasonic waves, and the obstacle distance cannot be measured due to insufficient reflection of the surface of the narrow-shaped obstacle;
  • the method of physical collision has a large jitter of the visual sweeping robot during the collision, which affects the stability of the visual sweeping robot.
  • a primary object of the present invention is to provide a visual cleaning robot and an obstacle detecting method for detecting a coordinate position of an obstacle to assist in predicting an obstacle.
  • the present invention provides an obstacle detection method, which includes the following steps:
  • the present invention also provides a cleaning robot, comprising: ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • an extracting unit configured to extract a feature point in the image information, where the feature point includes a necessary feature point
  • a building unit configured to construct a spatial three-dimensional coordinate of the feature point to form a spatial feature point
  • a feature unit configured to extract necessary feature points according to the specified condition according to the set of spatial feature points to form a set of spatial obstacle points;
  • a projection unit configured to project the set of spatial obstacle points onto a two-dimensional plane to obtain coordinate points of the spatial obstacle point set on a two-dimensional plane.
  • the visual cleaning robot and the obstacle detecting method provided by the present invention have the following beneficial effects:
  • the visual cleaning robot and the obstacle detecting method provided by the present invention, by acquiring image information; extracting feature points in the image information, the feature points include necessary feature points; constructing a spatial three-dimensional space in which the feature points are located Coordinates to form a set of spatial feature points; according to the set of spatial feature points, extract necessary feature points according to specified conditions to form a set of spatial obstacle points; project the set of spatial obstacle points onto a two-dimensional plane to obtain the The coordinate points of the space obstacle points on the two-dimensional plane; thereby detecting the coordinate position of the obstacle to assist in predicting the obstacle.
  • FIG. 1 is a schematic diagram showing the steps of an obstacle detecting method according to an embodiment of the present invention.
  • step 32 is a schematic diagram showing specific steps of step 32 in an embodiment of the present invention.
  • FIG. 3 is a schematic diagram showing steps of an obstacle detecting method according to another embodiment of the present invention.
  • FIG. 4 is a schematic diagram showing the steps of an obstacle detecting method according to another embodiment of the present invention.
  • step 39 is a schematic diagram showing the specific steps of step 39 in an embodiment of the present invention.
  • step 39 is a schematic diagram showing the specific steps of step 39 in another embodiment of the present invention.
  • step 34 is a schematic diagram showing the specific steps of step 34 in another embodiment of the present invention.
  • FIG. 8 is a block diagram showing the structure of a visual sweeping robot according to an embodiment of the present invention.
  • FIG. 9 is a block diagram showing the structure of an extracting unit in an embodiment of the present invention.
  • FIG. 10 is a block diagram showing the structure of a visual sweeping robot according to another embodiment of the present invention. ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • FIG. 11 is a block diagram showing the structure of a processing unit in another embodiment of the present invention.
  • FIG. 12 is a block diagram showing the structure of a processing unit in still another embodiment of the present invention.
  • FIG. 13 is a block diagram showing the structure of a processing unit in still another embodiment of the present invention.
  • FIG. 14 is a block diagram showing the structure of a visual sweeping robot according to still another embodiment of the present invention.
  • FIG. 15 is a block diagram showing the structure of a feature unit in an embodiment of the present invention.
  • FIG. 1 is a schematic diagram of steps of an obstacle detection method according to an embodiment of the present invention.
  • An embodiment of the present invention provides an obstacle detection method for a visual sweeping robot, the method comprising the following steps:
  • Step 31 acquiring image information
  • Step 32 Extract feature points in the image information, where the feature points include necessary feature points;
  • Step 33 Construct a spatial three-dimensional coordinate of the feature point to form a spatial feature point set
  • Step 34 Extract, according to the set of spatial feature points, the necessary feature points according to the specified conditions to form a set of spatial obstacle points;
  • Step 35 projecting the set of spatial obstacle points onto a two-dimensional plane to obtain the spatial obstacle point ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • the image information in the visual range is continuously collected by the built-in camera, and the image information is an image including a ceiling, a ground, and a wall surface.
  • Information; feature points are pixels, which can be pixels with higher brightness or darker colors; or pixels with larger changes.
  • the step of extracting feature points in the image information includes:
  • this step it may be analyzed whether the size of the same direction or the same route pixel point change in the image information in the adjacent two pictures or two frames of video is greater than a preset value, and the preset value may be 3111111, for example, comparing the latter Whether the diameter of the pixel in the picture differs from the diameter of the pixel in the previous picture is greater than 3111111, and if it is greater, step 804 is performed.
  • the obstacle detection method in this embodiment has the advantages of high applicability, high detection accuracy, low cost, and low computational complexity.
  • the step of projecting the set of spatial obstacle points onto a two-dimensional plane to obtain coordinate points of the spatial obstacle point set on a two-dimensional plane is performed. After that, including:
  • Step 36 Mark the coordinate point according to the coordinate point of the spatial obstacle point set on the two-dimensional plane ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • the coordinate origin of the two-dimensional plane is the same as the origin of the two-dimensional map, and the coordinate point is conveniently marked in the corresponding position of the two-dimensional map.
  • the solution in this embodiment is convenient for the sweeping robot to press the cleaning area.
  • the coordinate point can be controlled to bypass when walking on the map.
  • the map of the cleaning area may be pre-established and stored in the visual sweeping robot, or may be a map created by the visual sweeping robot when cleaning.
  • the step of projecting the set of spatial obstacle points onto a two-dimensional plane to obtain coordinate points of the spatial obstacle point set on a two-dimensional plane is performed. After that, include:
  • Step 37 Acquire current positioning coordinates
  • Step 38 analyzing a positional relationship between the current positioning coordinate and the coordinate point
  • Step 39 Select a corresponding preset manner to perform processing according to the location relationship.
  • the visual sweeping robot After acquiring the coordinate points of the spatial obstacle point set on the two-dimensional plane, the visual sweeping robot acquires the current positioning from time to time, and marks the current positioning on the two-dimensional plane to obtain the current positioning on the two-dimensional plane. Coordinates, the visual sweeping robot can perform processing according to the positional relationship between its current positioning coordinates and the coordinate points of the space obstacle point set, for example, avoid obstacles, and explore all obstacles in the cleaning area.
  • the step 39 of selecting a corresponding preset manner according to the location relationship includes:
  • Step 391 determining whether the location relationship is less than a preset value
  • Step 392 if yes, controlling the deceleration operation.
  • the positional relationship is the distance between the current positioning coordinate and the coordinate point of the spatial obstacle point set on the two-dimensional plane, and the preset value is 0.5 m.
  • the method includes:
  • Step 393 analyzing feature attributes of the set of spatial obstacle points
  • the feature attribute is the size of the length, width, and height of the set of spatial obstacle points.
  • Step 394 Analyze whether the feature attribute is greater than a preset attribute; and the preset attribute is a preset size of a length, a width, and a height.
  • Step 395 if it is greater, controlling to avoid the space obstacle point set.
  • the space obstacle point set may also be marked by the feature attribute in the cleaning area. ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • the plurality of spatial obstacle points are set, and correspondingly, the position relationship is multiple, and the position relationship is a position distance, according to the Step 39 of processing the preset relationship corresponding to the location relationship, including:
  • Step 3901 Select a shortest position distance from a plurality of the location distances
  • Step 3902 Control a spatial obstacle point set motion corresponding to the shortest position distance.
  • step 3902 the method includes:
  • Step 3903 analyzing whether the shortest position distance is less than a predetermined value
  • Step 3904 if less than, starting the ultrasonic sensor to emit an ultrasonic signal
  • Step 3905 receiving a feedback signal that is fed back when the ultrasonic signal encounters an obstacle
  • Step 3906 analyzing location information and feature attributes of the obstacle according to the feedback signal
  • Step 3907 analyzing whether the feature attribute is greater than a preset attribute
  • Step 3908 if greater than, clear the mark corresponding to the coordinate point of the space obstacle point set on the two-dimensional map, and mark the position information of the obstacle in the corresponding position of the two-dimensional map of the cleaning area;
  • Step 3910 Store a two-dimensional map marked with the location information of the obstacle, so as to avoid the obstacle when designing the cleaning route.
  • the method includes:
  • the cleaning area is divided into regions.
  • the cleaning area may be divided according to the position of the coordinate points of all the spatial obstacle points in the cleaning area.
  • the sub-area after the area division may also be subjected to map coverage.
  • the feature points further include non-essential feature points
  • the step 34 of extracting the necessary feature points according to the specified set of spatial feature points to form a set of spatial obstacle points according to the set of spatial feature points includes:
  • Step 341 analyzing a positional relationship of the feature points in the set of spatial feature points
  • Step 342 distinguishing the non-essential feature points and the necessary feature points according to the positional relationship
  • Step 343 cull the non-essential feature points according to the specified condition
  • Step 344 forming the necessary feature points into a set of spatial obstacle points. ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • the condition specified in this embodiment is to retain the necessary feature points, since the ceiling or the like cannot be an obstacle to the visual sweeping robot. Therefore, the visual sweeping robot of the present embodiment analyzes the position of the ceiling by using a plane fitting method, and removes all unnecessary feature points of the ceiling and its preset range (such as the distance of 1111) to obtain necessary feature points.
  • the necessary feature points form a set of spatial obstacle points in the three-dimensional coordinates of the space.
  • the method for detecting an obstacle by acquiring image information; extracting feature points in the image information, the feature points include non-essential feature points and necessary feature points; Constructing a spatial three-dimensional coordinate of the feature point to form a spatial feature point set; according to the spatial feature point set, removing the necessary feature point according to a specified condition, and obtaining a necessary feature point to form a spatial obstacle point set;
  • the obstacle point set is projected onto the two-dimensional plane to obtain coordinate points of the spatial obstacle point set on the two-dimensional plane; thereby detecting the coordinate position of the obstacle to assist in predicting the obstacle. It can also detect unknown environments and divide the cleaning area.
  • an embodiment of the present invention further provides a visual cleaning robot, including:
  • the collecting unit 10 is configured to collect image information in a visual range
  • the extracting unit 20 is configured to extract feature points in the image information, where the feature points include necessary feature points
  • a building unit 30, configured to construct a spatial three-dimensional coordinate of the feature point to form a spatial feature point set
  • a feature unit 40 configured to extract, according to the set of spatial feature points, necessary feature points according to a specified condition to form a set of spatial obstacle points;
  • the projection unit 50 is configured to project the set of spatial obstacle points onto a two-dimensional plane to obtain coordinate points of the spatial obstacle point set on a two-dimensional plane.
  • the collecting unit 10 continuously collects image information in the visual range through the built-in camera, and the image information includes the ceiling, the ground, and the wall surface.
  • the feature points are pixels, which can be pixels with higher brightness or darker colors.
  • the extracting unit 20 of the present invention includes:
  • Arrangement unit 201 used to sequentially arrange multiple captured pictures or multiple frames of video in chronological order ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • the first analyzing unit 202 is configured to analyze whether there is a pixel point change in the same direction or the same route in the image information in the plurality of pictures or the multi-frame video arranged in chronological order;
  • the second analyzing unit 203 is configured to analyze whether the change of the pixel point is greater than a preset value
  • the second analyzing unit 203 may analyze whether the size of the same direction or the same route pixel point change in the image information in the adjacent two pictures or two frames of video is greater than a preset value, and the preset value may be 3 mm, for example, The second analyzing unit 203 compares whether the diameter of the pixel in the next picture differs from the diameter of the pixel in the previous picture by more than 3 mm.
  • the extracting unit 204 extract the pixel point if the change of the pixel point is greater than a preset value.
  • the constructing unit 30 After extracting the feature points of the image information in the visual range, the constructing unit 30 reconstructs the spatial point information of the cleaning environment by using a method of visual SLAM (real-time positioning and map construction to realize autonomous positioning and navigation of the robot) to construct the The three-dimensional coordinates of the space where the feature points are located.
  • the above feature points necessarily include non-essential feature points of the ceiling plate, and it is impossible to become an obstacle of the visual sweeping robot because the ceiling or the like.
  • the feature unit 40 uses the method of plane fitting to analyze and estimate the position of the ceiling, and eliminates all unnecessary feature points such as the ceiling and its vicinity (such as within the range of lm distance) to obtain necessary feature points, and the necessary feature points are A set of spatial obstacle points is formed in the three-dimensional coordinates of the space.
  • the projection unit 50 projects the three-dimensional coordinates of the necessary feature points in the above-mentioned spatial obstacle points on the two-dimensional plane, and obtains the coordinate points of the obstacle on the two-dimensional plane.
  • the visual sweeping robot in this embodiment has the advantages of high applicability, high detection accuracy, low cost, and low computational complexity.
  • the visual cleaning robot further includes:
  • the marking unit 51 is configured to mark the coordinate point at a position corresponding to the two-dimensional map of the cleaning area according to the coordinate point of the spatial obstacle point set on the two-dimensional plane.
  • the coordinate origin of the two-dimensional plane is the same as the origin of the two-dimensional map, and the convenient marking unit 51 quickly marks the coordinate point at a position corresponding to the two-dimensional map, and the map of the cleaning area may be pre-established and stored.
  • the visual sweeping robot it is also a map created when the visual sweeping robot is cleaned.
  • the visual cleaning robot further includes:
  • an obtaining unit 60 configured to acquire current positioning coordinates
  • the analyzing unit 70 is configured to analyze a positional relationship between the current positioning coordinate and the coordinate point;
  • the processing unit 80 is configured to perform processing according to the location relationship to select a corresponding preset manner. ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • the acquiring unit 60 acquires the current positioning from time to time, and marks the current positioning on the two-dimensional plane to obtain the current positioning coordinates on the two-dimensional plane, and the analyzing unit 70 analyzes the current positioning coordinate and the coordinate on the two-dimensional plane.
  • the positional relationship of the points, the processing unit 80 can perform corresponding processing according to the positional relationship between the current positioning coordinates of the visual cleaning robot itself and the coordinate points of the spatial obstacle point set, for example, avoid obstacles, and explore all obstacles in the cleaning area. Things and so on.
  • the processing unit 80 includes:
  • a determining subunit 801 configured to determine whether the location relationship is less than a preset value
  • the deceleration subunit 802 is configured to control the deceleration operation when the positional relationship is less than a preset value.
  • the positional relationship is the distance between the current positioning coordinate and the coordinate point of the spatial obstacle point set on the two-dimensional plane, and the preset value is 0.5 m.
  • the processing unit 80 further includes:
  • a first analysis subunit 803 configured to analyze feature attributes of the set of spatial obstacle points
  • the feature attribute is the size of the length, width, and height of the set of spatial obstacle points.
  • the second analysis sub-unit 804 is configured to analyze whether the feature attribute is greater than a preset attribute; and the preset attribute is a preset size of a length, a width, and a height.
  • the avoidance sub-unit 805 is configured to control to avoid the spatial obstacle object point set if the feature attribute is greater than a preset attribute.
  • the feature attribute of the spatial obstacle point set may also be marked on the map of the cleaning area.
  • the plurality of spatial obstacle points are set, and correspondingly, the position relationship is multiple, and the position relationship is a position distance, and the processing unit 80 Includes:
  • a selection subunit 810 configured to select a shortest position distance from a plurality of the location distances
  • the control subunit 820 is configured to control the space obstacle point set motion corresponding to the shortest position distance.
  • the processing unit 80 further includes:
  • the distance analyzing unit 821 is configured to analyze whether the shortest position distance is less than a predetermined value
  • the starting unit 822 is configured to: when the shortest position distance is less than a predetermined value, start the ultrasonic sensor to emit an ultrasonic signal; ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • the signal receiving unit 823 is configured to receive a feedback signal that is fed back when the ultrasonic signal encounters an obstacle;
  • the information analysis unit 824 is configured to analyze location information and feature attributes of the obstacle according to the feedback signal.
  • an attribute analysis unit 825 configured to analyze whether the feature attribute is greater than a preset attribute;
  • the obstacle marking unit 826 is configured to: if the feature attribute is greater than the preset attribute, clear the mark corresponding to the coordinate point of the space obstacle point set on the two-dimensional map, and mark the position information of the obstacle in the two-dimensional map of the cleaning area. Corresponding location
  • the location storage unit 827 is configured to store a two-dimensional map of the location information marked with the obstacle so as to avoid the obstacle when planning the cleaning route.
  • the visual cleaning robot further includes:
  • a dividing unit 61 configured to divide the cleaning area according to the marking of the plurality of coordinate points on the map
  • the cleaning area may be divided according to the position of the coordinate point corresponding to all the spatial obstacle points in the cleaning area.
  • the sub-area after the area division can also be covered by the map.
  • the feature points further include non-essential feature points.
  • the feature unit 40 includes:
  • a third analysis subunit 401 configured to analyze a positional relationship of the feature points in the set of spatial feature points
  • a region numerator unit 402 configured to distinguish the non-essential feature point and the necessary feature point according to the positional relationship
  • a culling sub-unit 403 configured to cull the non-essential feature points according to the specified condition
  • the condition specified in the present embodiment is to retain the necessary feature points, since the ceiling or the like is unlikely to be an obstacle to the visual sweeping robot. Therefore, the region molecular unit 402 analyzes the non-denot feature points such as the position of the ceiling from the feature points by using a plane fitting method, and the culling sub-unit 403 sets the non-essential feature points of the ceiling and its preset range (eg, within the distance of 1111). All are eliminated, and the necessary feature points are obtained.
  • the forming sub-unit 404 forms the set of spatial obstacle points in the three-dimensional coordinates of the space.
  • the method for detecting a visual sweeping robot and an obstacle detected by the embodiment of the present invention is ⁇ 0 2019/104732 ⁇ (:17 ⁇ 2017/114323
  • the feature points include necessary feature points; constructing spatial three-dimensional coordinates of the feature points to form a spatial feature point set; according to the spatial feature point set, according to Specifying conditions to remove the necessary feature points, obtaining necessary feature points to form a spatial obstacle point set; projecting the spatial obstacle point set onto the two-dimensional plane to obtain the spatial obstacle point set on the two-dimensional plane Coordinate point; thereby detecting the coordinate position of the obstacle to assist in predicting the obstacle; and detecting the unknown environment and dividing the cleaning area.

Landscapes

  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

An obstacle detection method comprises: constructing a spatial three-dimensional coordinate system, in which the feature points are located, so as to form a spatial feature point set; extracting, according to the spatial feature point set, necessary feature points in accordance with specified conditions, so as to form a spatial obstacle point set; and projecting the spatial obstacle point set onto a two-dimensional plane, so as to obtain the coordinate points of the spatial obstacle point set on the two-dimensional plane, and detect the coordinate position of an obstacle in accordance to said coordinate points, thereby assisting in prediction of the obstacle.

Description

\¥0 2019/104732 卩(:17 \2017/114323  \¥0 2019/104732 卩(:17 \2017/114323
1 视觉扫地机器人及障碍物捡测方法 技术领域  1 Vision sweeping robot and obstacle detection method
[0001] 本发明涉及视觉扫地机器人领域, 特别涉及一种视觉扫地机器人及障碍物检测 方法。  [0001] The present invention relates to the field of visual sweeping robots, and more particularly to a visual sweeping robot and an obstacle detecting method.
背景技术  Background technique
[0002] 视觉扫地机器人在对家庭区域进行清扫时, 由于家庭区域存在沙发、 桌子、 柜 子等无法避免的障碍物, 清扫时, 需要避开这些障碍物。 因此视觉扫地机器人 需要预先检测出视觉范围内的障碍物。  [0002] When the visual sweeping robot cleans the home area, there are unavoidable obstacles such as sofas, tables, and cabinets in the home area. When cleaning, it is necessary to avoid these obstacles. Therefore, the visual sweeping robot needs to detect obstacles in the visual range in advance.
[0003] 目前, 检测障碍物的方法包括利用红外反射的方法、 利用超声波检测的方法、 物理碰撞的方法等。 目前的方法都具有相应的缺陷, 例如红外反射的方法对黑 色障碍物不敏感; 超声波检测的方法中, 安装超声波比较困难, 而且由于细窄 状的障碍物表面反射不足, 不能测量障碍物距离; 物理碰撞的方法在碰撞时视 觉扫地机器人抖动较大, 影响视觉扫地机器人的稳定性。  [0003] Currently, methods for detecting an obstacle include a method using infrared reflection, a method using ultrasonic detection, a method of physical collision, and the like. The current methods all have corresponding defects. For example, the method of infrared reflection is not sensitive to black obstacles; in the ultrasonic detection method, it is difficult to install ultrasonic waves, and the obstacle distance cannot be measured due to insufficient reflection of the surface of the narrow-shaped obstacle; The method of physical collision has a large jitter of the visual sweeping robot during the collision, which affects the stability of the visual sweeping robot.
技术问题  technical problem
[0004] 本发明的主要目的为提供一种视觉扫地机器人及障碍物检测方法, 检测出障碍 物的坐标位置, 以辅助预判障碍物。  [0004] A primary object of the present invention is to provide a visual cleaning robot and an obstacle detecting method for detecting a coordinate position of an obstacle to assist in predicting an obstacle.
问题的解决方案  Problem solution
技术解决方案  Technical solution
[0005] 本发明提出一种障碍物检测方法, 包括以下步骤:  [0005] The present invention provides an obstacle detection method, which includes the following steps:
[0006] 采集图像信息;  [0006] acquiring image information;
[0007] 提取所述图像信息中的特征点, 所述特征点包括必要特征点;  [0007] extracting feature points in the image information, the feature points including necessary feature points;
[0008] 构建所述特征点所在的空间三维坐标以形成空间特征点集;  [0008] constructing a spatial three-dimensional coordinate of the feature point to form a spatial feature point set;
[0009] 根据所述空间特征点集, 按指定条件提取必要特征点以形成空间障碍物点集; [0010] 将所述空间障碍物点集投影至二维平面上, 以得到所述空间障碍物点集在二维 平面上的坐标点。  [0009] extracting necessary feature points according to the specified condition to form a set of spatial obstacle points according to the set of spatial feature points; [0010] projecting the set of spatial obstacle points onto a two-dimensional plane to obtain the spatial barrier The coordinate points of the object points on a two-dimensional plane.
[0011] 本发明还提供了一种扫地机器人, 包括: \¥0 2019/104732 卩(:17 \2017/114323 [0011] The present invention also provides a cleaning robot, comprising: \¥0 2019/104732 卩(:17 \2017/114323
2  2
[0012] 米集单兀, 用于米集图像信息, [0012] Meter set single 兀, used for meter image information,
[0013] 提取单元, 用于提取所述图像信息中的特征点, 所述特征点包括必要特征点; [0014] 构建单元, 用于构建所述特征点所在的空间三维坐标以形成空间特征点集; [0015] 特征单元, 用于根据所述空间特征点集, 按指定条件提取必要特征点以形成空 间障碍物点集;  [0013] an extracting unit, configured to extract a feature point in the image information, where the feature point includes a necessary feature point; [0014] a building unit, configured to construct a spatial three-dimensional coordinate of the feature point to form a spatial feature point [0015] a feature unit, configured to extract necessary feature points according to the specified condition according to the set of spatial feature points to form a set of spatial obstacle points;
[0016] 投影单元, 用于将所述空间障碍物点集投影至二维平面上, 以得到所述空间障 碍物点集在二维平面上的坐标点。  [0016] a projection unit, configured to project the set of spatial obstacle points onto a two-dimensional plane to obtain coordinate points of the spatial obstacle point set on a two-dimensional plane.
发明的有益效果  Advantageous effects of the invention
有益效果  Beneficial effect
[0017] 本发明中提供的视觉扫地机器人及障碍物检测方法, 具有以下有益效果: [0017] The visual cleaning robot and the obstacle detecting method provided by the present invention have the following beneficial effects:
[0018] 本发明中提供的视觉扫地机器人及障碍物检测方法, 通过采集图像信息; 提取 所述图像信息中的特征点, 所述特征点包括必要特征点; 构建所述特征点所在 的空间三维坐标以形成空间特征点集; 根据所述空间特征点集, 按指定条件提 取必要特征点以形成空间障碍物点集; 将所述空间障碍物点集投影至二维平面 上, 以得到所述空间障碍物点集在二维平面上的坐标点; 以此检测出障碍物的 坐标位置, 以辅助预判障碍物。 [0018] The visual cleaning robot and the obstacle detecting method provided by the present invention, by acquiring image information; extracting feature points in the image information, the feature points include necessary feature points; constructing a spatial three-dimensional space in which the feature points are located Coordinates to form a set of spatial feature points; according to the set of spatial feature points, extract necessary feature points according to specified conditions to form a set of spatial obstacle points; project the set of spatial obstacle points onto a two-dimensional plane to obtain the The coordinate points of the space obstacle points on the two-dimensional plane; thereby detecting the coordinate position of the obstacle to assist in predicting the obstacle.
对附图的简要说明  Brief description of the drawing
附图说明  DRAWINGS
[0019] 图 1是本发明一实施例中障碍物检测方法步骤示意图;  1 is a schematic diagram showing the steps of an obstacle detecting method according to an embodiment of the present invention;
[0020] 图 2是本发明一实施例中步骤 32的具体步骤示意图;  2 is a schematic diagram showing specific steps of step 32 in an embodiment of the present invention;
[0021] 图 3是本发明另一实施例中障碍物检测方法步骤示意图;  3 is a schematic diagram showing steps of an obstacle detecting method according to another embodiment of the present invention;
[0022] 图 4是本发明另一实施例中障碍物检测方法步骤示意图;  4 is a schematic diagram showing the steps of an obstacle detecting method according to another embodiment of the present invention;
[0023] 图 5是本发明一实施例中步骤 39具体步骤示意图;  5 is a schematic diagram showing the specific steps of step 39 in an embodiment of the present invention;
[0024] 图 6是本发明另一实施例中步骤 39具体步骤示意图;  6 is a schematic diagram showing the specific steps of step 39 in another embodiment of the present invention;
[0025] 图 7是本发明另一实施例中步骤 34具体步骤示意图;  7 is a schematic diagram showing the specific steps of step 34 in another embodiment of the present invention;
[0026] 图 8是本发明一实施例中视觉扫地机器人结构框图;  8 is a block diagram showing the structure of a visual sweeping robot according to an embodiment of the present invention;
[0027] 图 9是本发明一实施例中提取单元结构框图;  9 is a block diagram showing the structure of an extracting unit in an embodiment of the present invention;
[0028] 图 10是本发明另一实施例中视觉扫地机器人结构框图; \¥0 2019/104732 卩(:17 \2017/114323 10 is a block diagram showing the structure of a visual sweeping robot according to another embodiment of the present invention; \¥0 2019/104732 卩(:17 \2017/114323
3  3
[0029] 图 11是本发明另一实施例中处理单元结构框图; 11 is a block diagram showing the structure of a processing unit in another embodiment of the present invention;
[0030] 图 12是本发明又一实施例中处理单元结构框图;  12 is a block diagram showing the structure of a processing unit in still another embodiment of the present invention;
[0031] 图 13是本发明又一实施例中处理单元结构框图;  13 is a block diagram showing the structure of a processing unit in still another embodiment of the present invention;
[0032] 图 14是本发明又一实施例中视觉扫地机器人结构框图;  14 is a block diagram showing the structure of a visual sweeping robot according to still another embodiment of the present invention;
[0033] 图 15是本发明一实施例中特征单元的结构框图。  [0033] FIG. 15 is a block diagram showing the structure of a feature unit in an embodiment of the present invention.
[0034] 本发明目的的实现、 功能特点及优点将结合实施例, 参照附图做进一步说明。  [0034] The implementation, functional features, and advantages of the present invention will be further described with reference to the accompanying drawings.
实施该发明的最佳实施例  BEST MODE FOR CARRYING OUT THE INVENTION
本发明的最佳实施方式  BEST MODE FOR CARRYING OUT THE INVENTION
[0035] 应当理解, 此处所描述的具体实施例仅仅用以解释本发明, 并不用于限定本发 明。  [0035] It is to be understood that the specific embodiments described herein are merely illustrative of the invention.
[0036] 本技术领域技术人员可以理解, 除非特意声明, 这里使用的单数形式“一”、 “ 一个”、 “所述”“上述”和“该”也可包括复数形式。 应该进一步理解的是, 本发明 的说明书中使用的措辞“包括”是指存在所述特征、 整数、 步骤、 操作、 元件、 单 元、 模块和 /或组件, 但是并不排除存在或添加一个或多个其他特征、 整数、 步 骤、 操作、 元件、 单元、 模块、 组件和 /或它们的组。 应该理解, 当我们称元件 被“连接”或“耦接”到另一元件时, 它可以直接连接或耦接到其他元件, 或者也可 以存在中间元件。 此外, 这里使用的“连接”或“耦接”可以包括无线连接或无线耦 接。 这里使用的措辞“和 /或”包括一个或更多个相关联的列出项的全部或任一单 元和全部组合。  [0036] The singular forms "a," ""," It is to be understood that the phrase "comprises" or "an" Other characteristics, integers, steps, operations, components, units, modules, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element. Further, "connected" or "coupled" as used herein may include either a wireless connection or a wireless coupling. The term "and/or" used herein includes all or any of the elements and all combinations of one or more of the associated listed.
[0037] 参照图 1, 为本发明一实施例中障碍物检测方法步骤示意图。  1 is a schematic diagram of steps of an obstacle detection method according to an embodiment of the present invention.
[0038] 本发明一实施例中提出一种障碍物检测方法, 应用于视觉扫地机器人, 该方法 包括以下步骤:  [0038] An embodiment of the present invention provides an obstacle detection method for a visual sweeping robot, the method comprising the following steps:
[0039] 步骤 31, 采集图像信息;  [0039] Step 31: acquiring image information;
[0040] 步骤 32, 提取所述图像信息中的特征点, 所述特征点包括必要特征点;  [0040] Step 32: Extract feature points in the image information, where the feature points include necessary feature points;
[0041] 步骤 33 , 构建所述特征点所在的空间三维坐标以形成空间特征点集;  [0041] Step 33: Construct a spatial three-dimensional coordinate of the feature point to form a spatial feature point set;
[0042] 步骤 34, 根据所述空间特征点集, 按指定条件提取得到必要特征点以形成空间 障碍物点集;  [0042] Step 34: Extract, according to the set of spatial feature points, the necessary feature points according to the specified conditions to form a set of spatial obstacle points;
[0043] 步骤 35 , 将所述空间障碍物点集投影至二维平面上, 以得到所述空间障碍物点 \¥0 2019/104732 卩(:17 \2017/114323 [0043] Step 35, projecting the set of spatial obstacle points onto a two-dimensional plane to obtain the spatial obstacle point \¥0 2019/104732 卩(:17 \2017/114323
4 集在二维平面上的坐标点。  4 sets the coordinate points on the 2D plane.
[0044] 在本实施例中, 视觉扫地机器人清扫过程中, 进行小范围的移动, 并通过自带 的摄像头不断采集视觉范围内的图像信息, 图像信息为包含有天花板、 地面、 墙面的图像信息; 特征点为像素点, 可以是亮度较高或者颜色较深的像素点; 也可以是变化较大的像素点。  [0044] In the embodiment, during the cleaning process of the visual sweeping robot, a small range of movement is performed, and the image information in the visual range is continuously collected by the built-in camera, and the image information is an image including a ceiling, a ground, and a wall surface. Information; feature points are pixels, which can be pixels with higher brightness or darker colors; or pixels with larger changes.
[0045] 具体地, 参照图 2, 提取所述图像信息中的特征点步骤 32包括:  [0045] Specifically, referring to FIG. 2, the step of extracting feature points in the image information includes:
[0046] 801: 将多个采集的图片或多帧视频中按时间先后顺序依次排列;  [0046] 801: Arranging a plurality of collected pictures or a plurality of frames of video in chronological order;
[0047] 802: 分析按时间先后顺序排列的多个图片或多帧视频中的图像信息里在相同 方向或相同路线的是否有像素点发生变化;  [0047] 802: analyzing whether there is a pixel change in the same direction or the same route in the image information in the plurality of pictures or the multi-frame video arranged in chronological order;
[0048] 803: 分析该像素点的变化是否大于预设值;  [0048] 803: analyzing whether the change of the pixel point is greater than a preset value;
[0049] 本步骤, 可以分析相邻两张图片或两帧视频中的图像信息里相同方向或相同路 线像素点变化的大小是否大于预设值, 预设值可以是 3111111, 例如, 比较后一张 图片中的像素点的直径与前一张图片中的像素点的直径相差是否大于 3111111, 若 大于则执行步骤804。  [0049] In this step, it may be analyzed whether the size of the same direction or the same route pixel point change in the image information in the adjacent two pictures or two frames of video is greater than a preset value, and the preset value may be 3111111, for example, comparing the latter Whether the diameter of the pixel in the picture differs from the diameter of the pixel in the previous picture is greater than 3111111, and if it is greater, step 804 is performed.
[0050] 804: 若大于, 则提取该像素点。  [0050] 804: If it is greater, the pixel is extracted.
[0051] 在提取到视觉范围内图像信息的特征点之后, 利用视觉SLAM (实时定位与地 图构建, 实现机器人的自主定位和导航) 的方法重建清扫环境的空间点信息, 以构建所述特征点所在的空间三维坐标。 上述特征点中必然包括天花板位置的 非必要特征点, 由于天花板等不可能成为视觉扫地机器人的障碍物。 因此, 使 用平面拟合的方法分析出天花板的位置, 并将天花板及其附近 (如 1111距离范围 内) 的非必要特征点全部剔除, 得到必要特征点, 该必要特征点在空间三维坐 标里形成空间障碍物点集。  [0051] after extracting the feature points of the image information in the visual range, reconstructing the spatial point information of the cleaning environment by using a method of visual SLAM (real-time positioning and map construction to realize autonomous positioning and navigation of the robot) to construct the feature points The three-dimensional coordinates of the space in which it is located. The above feature points necessarily include unnecessary feature points of the ceiling position, and it is impossible to become an obstacle of the visual sweeping robot because the ceiling or the like. Therefore, the position of the ceiling is analyzed by the method of plane fitting, and the non-essential feature points of the ceiling and its vicinity (such as the distance of 1111) are all eliminated, and the necessary feature points are obtained, and the necessary feature points are formed in the three-dimensional coordinates of the space. A set of space obstacles.
[0052] 最后, 将空间三维坐标上的必要特征点投影在二维平面上, 便得到空间障碍物 点集在二维平面上的坐标点。 本实施例中的障碍物检测方法, 具有适用性高, 检测准确率高, 低成本, 且运算量少等优点。  [0052] Finally, the necessary feature points on the three-dimensional coordinates of the space are projected on the two-dimensional plane, and the coordinate points of the spatial obstacle point set on the two-dimensional plane are obtained. The obstacle detection method in this embodiment has the advantages of high applicability, high detection accuracy, low cost, and low computational complexity.
[0053] 参照图 3 , 在一实施例中, 所述将所述空间障碍物点集投影至二维平面上, 以 得到所述空间障碍物点集在二维平面上的坐标点的步骤 35之后, 包括:  [0053] Referring to FIG. 3, in an embodiment, the step of projecting the set of spatial obstacle points onto a two-dimensional plane to obtain coordinate points of the spatial obstacle point set on a two-dimensional plane is performed. After that, including:
[0054] 步骤 36 , 根据所述空间障碍物点集在二维平面上的坐标点将所述坐标点标记在 \¥0 2019/104732 卩(:17 \2017/114323 [0054] Step 36: Mark the coordinate point according to the coordinate point of the spatial obstacle point set on the two-dimensional plane \¥0 2019/104732 卩(:17 \2017/114323
5 清扫区域的二维地图对应的位置上。  5 The position corresponding to the 2D map of the cleaning area.
[0055] 本实施例中, 二维平面的坐标原点与二维地图的原点相同, 方便快速将坐标点 标记在二维地图对应的位置, 本实施例中的方案方便扫地机器人在按清扫区域 的地图上行走时可控制绕开该坐标点。 该清扫区域的地图可以是预先建立并存 储在视觉扫地机器人中的, 也可以是视觉扫地机器人清扫时建立的地图。  [0055] In this embodiment, the coordinate origin of the two-dimensional plane is the same as the origin of the two-dimensional map, and the coordinate point is conveniently marked in the corresponding position of the two-dimensional map. The solution in this embodiment is convenient for the sweeping robot to press the cleaning area. The coordinate point can be controlled to bypass when walking on the map. The map of the cleaning area may be pre-established and stored in the visual sweeping robot, or may be a map created by the visual sweeping robot when cleaning.
[0056] 参照图 4, 在一实施例中, 所述将所述空间障碍物点集投影至二维平面上, 以 得到所述空间障碍物点集在二维平面上的坐标点的步骤 35之后, 包括:  [0056] Referring to FIG. 4, in an embodiment, the step of projecting the set of spatial obstacle points onto a two-dimensional plane to obtain coordinate points of the spatial obstacle point set on a two-dimensional plane is performed. After that, include:
[0057] 步骤 37, 获取当前定位坐标;  [0057] Step 37: Acquire current positioning coordinates;
[0058] 步骤 38, 分析当前定位坐标与所述坐标点的位置关系;  [0058] Step 38: analyzing a positional relationship between the current positioning coordinate and the coordinate point;
[0059] 步骤 39 , 根据所述位置关系选择对应的预设方式进行处理。  [0059] Step 39: Select a corresponding preset manner to perform processing according to the location relationship.
[0060] 在获取到空间障碍物点集在二维平面上的坐标点之后, 视觉扫地机器人时时获 取当前定位, 并将该当前定位标记在二维平面上, 以得到在二维平面上当前定 位坐标, 视觉扫地机器人可以根据自身的当前定位坐标与空间障碍物点集的坐 标点之间的位置关系, 对应进行处理, 例如避开障碍物, 探索清扫区域内的所 有障碍物等。  [0060] After acquiring the coordinate points of the spatial obstacle point set on the two-dimensional plane, the visual sweeping robot acquires the current positioning from time to time, and marks the current positioning on the two-dimensional plane to obtain the current positioning on the two-dimensional plane. Coordinates, the visual sweeping robot can perform processing according to the positional relationship between its current positioning coordinates and the coordinate points of the space obstacle point set, for example, avoid obstacles, and explore all obstacles in the cleaning area.
[0061] 具体地, 参照图 5 , 在一实施例中, 所述根据所述位置关系选择对应的预设方 式进行处理的步骤 39 , 包括:  [0061] Specifically, referring to FIG. 5, in an embodiment, the step 39 of selecting a corresponding preset manner according to the location relationship, includes:
[0062] 步骤 391, 判断所述位置关系是否小于预设值;  [0062] Step 391, determining whether the location relationship is less than a preset value;
[0063] 步骤 392, 若是, 则控制减速运行。  [0063] Step 392, if yes, controlling the deceleration operation.
[0064] 位置关系为当前定位坐标与空间障碍物点集的坐标点在二维平面上的距离, 预 设值为 0.5米。  [0064] The positional relationship is the distance between the current positioning coordinate and the coordinate point of the spatial obstacle point set on the two-dimensional plane, and the preset value is 0.5 m.
[0065] 在另一实施例中, 所述控制减速运行的步骤 392之后, 包括:  [0065] In another embodiment, after the step 392 of controlling the deceleration operation, the method includes:
[0066] 步骤 393, 分析所述空间障碍物点集的特征属性;  [0066] Step 393, analyzing feature attributes of the set of spatial obstacle points;
[0067] 特征属性为空间障碍物点集的长宽高的尺寸。  [0067] The feature attribute is the size of the length, width, and height of the set of spatial obstacle points.
[0068] 步骤 394, 分析所述特征属性是否大于预设属性; 预设属性为预设的长宽高的 尺寸。  [0068] Step 394: Analyze whether the feature attribute is greater than a preset attribute; and the preset attribute is a preset size of a length, a width, and a height.
[0069] 步骤 395 , 若大于, 则控制避开所述空间障碍物点集。  [0069] Step 395, if it is greater, controlling to avoid the space obstacle point set.
[0070] 优选地, 本实施例中, 还可以将空间障碍物点集按特征属性标记在清扫区域的 \¥0 2019/104732 卩(:17 \2017/114323 [0070] Preferably, in this embodiment, the space obstacle point set may also be marked by the feature attribute in the cleaning area. \¥0 2019/104732 卩(:17 \2017/114323
6 地图上。  6 on the map.
[0071] 参照图 6, 在又一实施例中, 所述空间障碍物点集为多个, 对应地, 所述位置 关系为多个, 且所述位置关系为位置距离, 所述根据所述位置关系选择对应的 预设方式进行处理的步骤 39 , 包括:  [0071] Referring to FIG. 6 , in another embodiment, the plurality of spatial obstacle points are set, and correspondingly, the position relationship is multiple, and the position relationship is a position distance, according to the Step 39 of processing the preset relationship corresponding to the location relationship, including:
[0072] 步骤 3901, 从多个所述位置距离中选择最短的位置距离;  [0072] Step 3901: Select a shortest position distance from a plurality of the location distances;
[0073] 步骤 3902, 控制朝所述最短的位置距离所对应的空间障碍物点集运动。  [0073] Step 3902: Control a spatial obstacle point set motion corresponding to the shortest position distance.
[0074] 步骤 3902之后包括:  [0074] After step 3902, the method includes:
[0075] 步骤 3903 , 分析最短的位置距离是否小于预定值;  [0075] Step 3903, analyzing whether the shortest position distance is less than a predetermined value;
[0076] 步骤 3904, 若小于, 启动超声波感应器发射超声波信号;  [0076] Step 3904, if less than, starting the ultrasonic sensor to emit an ultrasonic signal;
[0077] 步骤 3905 , 接收超声波信号遇到障碍物时反馈的反馈信号;  [0077] Step 3905, receiving a feedback signal that is fed back when the ultrasonic signal encounters an obstacle;
[0078] 步骤 3906, 根据反馈信号分析障碍物的位置信息以及特征属性;  [0078] Step 3906, analyzing location information and feature attributes of the obstacle according to the feedback signal;
[0079] 步骤 3907 , 分析所述特征属性是否大于预设属性;  [0079] Step 3907, analyzing whether the feature attribute is greater than a preset attribute;
[0080] 步骤 3908 , 若大于, 清除二维地图上空间障碍物点集对应坐标点的标记, 并将 障碍物的位置信息形标记于清扫区域的二维地图相应位置;  [0080] Step 3908, if greater than, clear the mark corresponding to the coordinate point of the space obstacle point set on the two-dimensional map, and mark the position information of the obstacle in the corresponding position of the two-dimensional map of the cleaning area;
[0081] 步骤 3910, 存储标记有障碍物的位置信息的二维地图, 以便设计清扫路径规划 时避开上述障碍物。  [0081] Step 3910: Store a two-dimensional map marked with the location information of the obstacle, so as to avoid the obstacle when designing the cleaning route.
[0082] 进一步地, 根据所述空间障碍物点集在二维平面上的坐标点将所述坐标点标记 在清扫区域的二维地图对应的位置上的步骤36之后, 包括:  [0082] Further, after the step 36 of marking the coordinate point on the position corresponding to the two-dimensional map of the cleaning area according to the coordinate point of the spatial obstacle point set on the two-dimensional plane, the method includes:
[0083] 根据所述坐标点在二维地图上的标记, 将清扫区域进行区域划分。  [0083] According to the mark of the coordinate point on the two-dimensional map, the cleaning area is divided into regions.
[0084] 在检测出清扫区域内的所有空间障碍物点集之后, 则可以按照检测到清扫区域 内的所有空间障碍物点集的坐标点位置, 对清扫区域进行区域划分。 优选地, 还可以对区域划分之后的子区域进行地图覆盖。  [0084] After detecting all the sets of spatial obstacles in the cleaning area, the cleaning area may be divided according to the position of the coordinate points of all the spatial obstacle points in the cleaning area. Preferably, the sub-area after the area division may also be subjected to map coverage.
[0085] 参照图 7 , 特征点还包括非必要特征点, 所述根据所述空间特征点集, 按指定 条件提取必要特征点以形成空间障碍物点集的步骤 34, 包括:  [0085] Referring to FIG. 7, the feature points further include non-essential feature points, and the step 34 of extracting the necessary feature points according to the specified set of spatial feature points to form a set of spatial obstacle points according to the set of spatial feature points includes:
[0086] 步骤 341, 分析所述特征点在所述空间特征点集里的位置关系;  [0086] Step 341, analyzing a positional relationship of the feature points in the set of spatial feature points;
[0087] 步骤 342, 根据所述位置关系区分所述非必要特征点和所述必要特征点; [0087] Step 342, distinguishing the non-essential feature points and the necessary feature points according to the positional relationship;
[0088] 步骤 343 , 按所述指定条件剔除所述非必要特征点; [0088] Step 343: cull the non-essential feature points according to the specified condition;
[0089] 步骤 344, 将所述必要特征点形成空间障碍物点集。 \¥0 2019/104732 卩(:17 \2017/114323 [0089] Step 344, forming the necessary feature points into a set of spatial obstacle points. \¥0 2019/104732 卩(:17 \2017/114323
7  7
[0090] 本实施例中指定条件为保留必要特征点, 由于天花板等不可能成为视觉扫地机 器人的障碍物。 因此, 本实施例的视觉扫地机器人使用平面拟合的方法分析出 天花板的位置, 并将天花板及其预设范围 (如 1111距离范围内) 的非必要特征点 全部剔除, 得到必要特征点, 该必要特征点在空间三维坐标里形成空间障碍物 点集。 [0090] The condition specified in this embodiment is to retain the necessary feature points, since the ceiling or the like cannot be an obstacle to the visual sweeping robot. Therefore, the visual sweeping robot of the present embodiment analyzes the position of the ceiling by using a plane fitting method, and removes all unnecessary feature points of the ceiling and its preset range (such as the distance of 1111) to obtain necessary feature points. The necessary feature points form a set of spatial obstacle points in the three-dimensional coordinates of the space.
[0091] 综上所述, 为本发明实施例中提供的障碍物检测方法, 通过采集图像信息; 提 取所述图像信息中的特征点, 所述特征点包括非必要特征点和必要特征点; 构 建所述特征点所在的空间三维坐标以形成空间特征点集; 根据所述空间特征点 集, 按指定条件剔除非必要特征点, 得到必要特征点以形成空间障碍物点集; 将所述空间障碍物点集投影至二维平面上, 以得到所述空间障碍物点集在二维 平面上的坐标点; 以此检测出障碍物的坐标位置, 以辅助预判障碍物。 且可以 对未知环境进行探测, 以及对清扫区域进行区域划分。  [0091] In summary, the method for detecting an obstacle provided in the embodiment of the present invention, by acquiring image information; extracting feature points in the image information, the feature points include non-essential feature points and necessary feature points; Constructing a spatial three-dimensional coordinate of the feature point to form a spatial feature point set; according to the spatial feature point set, removing the necessary feature point according to a specified condition, and obtaining a necessary feature point to form a spatial obstacle point set; The obstacle point set is projected onto the two-dimensional plane to obtain coordinate points of the spatial obstacle point set on the two-dimensional plane; thereby detecting the coordinate position of the obstacle to assist in predicting the obstacle. It can also detect unknown environments and divide the cleaning area.
[0092] 参照图 8, 本发明一实施例中还提供了一种视觉扫地机器人, 包括:  [0092] Referring to FIG. 8, an embodiment of the present invention further provides a visual cleaning robot, including:
[0093] 采集单元 10, 用于采集视觉范围内的图像信息;  [0093] The collecting unit 10 is configured to collect image information in a visual range;
[0094] 提取单元 20, 用于提取所述图像信息中的特征点, 所述特征点包括必要特征点  [0094] The extracting unit 20 is configured to extract feature points in the image information, where the feature points include necessary feature points
[0095] 构建单元 30, 用于构建所述特征点所在的空间三维坐标以形成空间特征点集;[0095] a building unit 30, configured to construct a spatial three-dimensional coordinate of the feature point to form a spatial feature point set;
[0096] 特征单元 40, 用于根据所述空间特征点集, 按指定条件提取必要特征点以形成 空间障碍物点集; [0096] a feature unit 40, configured to extract, according to the set of spatial feature points, necessary feature points according to a specified condition to form a set of spatial obstacle points;
[0097] 投影单元 50, 用于将所述空间障碍物点集投影至二维平面上, 以得到所述空间 障碍物点集在二维平面上的坐标点。  [0097] The projection unit 50 is configured to project the set of spatial obstacle points onto a two-dimensional plane to obtain coordinate points of the spatial obstacle point set on a two-dimensional plane.
[0098] 在本实施例中, 视觉扫地机器人清扫过程中, 进行小范围的移动, 采集单元 10 通过自带的摄像头不断采集视觉范围内的图像信息, 图像信息为包含有天花板 、 地面、 墙面的图像信息。 特征点为像素点, 可以是亮度较高或者颜色较深的 像素点。  [0098] In the embodiment, during the cleaning process of the visual sweeping robot, a small range of movement is performed, and the collecting unit 10 continuously collects image information in the visual range through the built-in camera, and the image information includes the ceiling, the ground, and the wall surface. Image information. The feature points are pixels, which can be pixels with higher brightness or darker colors.
[0099] 参照图 9, 本发明的提取单元 20包括:  Referring to FIG. 9, the extracting unit 20 of the present invention includes:
[0100] 排列单元 201 : 用于将多个采集的图片或多帧视频中按时间先后顺序依次排列 \¥0 2019/104732 卩(:17 \2017/114323 [0100] Arrangement unit 201: used to sequentially arrange multiple captured pictures or multiple frames of video in chronological order \¥0 2019/104732 卩(:17 \2017/114323
8  8
[0101] 第一分析单元 202: 用于分析按时间先后顺序排列的多个图片或多帧视频中的 图像信息里在相同方向或相同路线的是否有像素点发生变化; [0101] The first analyzing unit 202 is configured to analyze whether there is a pixel point change in the same direction or the same route in the image information in the plurality of pictures or the multi-frame video arranged in chronological order;
[0102] 第二分析单元 203: 用于分析该像素点的变化是否大于预设值;  [0102] The second analyzing unit 203 is configured to analyze whether the change of the pixel point is greater than a preset value;
[0103] 第二分析单元 203可以分析相邻两张图片或两帧视频中的图像信息里相同方向 或相同路线像素点变化的大小是否大于预设值, 预设值可以是 3mm, 例如, 第 二分析单元 203比较后一张图片中的像素点的直径与前一张图片中的像素点的直 径相差是否大于 3mm。  [0103] The second analyzing unit 203 may analyze whether the size of the same direction or the same route pixel point change in the image information in the adjacent two pictures or two frames of video is greater than a preset value, and the preset value may be 3 mm, for example, The second analyzing unit 203 compares whether the diameter of the pixel in the next picture differs from the diameter of the pixel in the previous picture by more than 3 mm.
[0104] 提取单元 204: 若像素点的变化大于预设值, 则提取该像素点。  [0104] The extracting unit 204: extract the pixel point if the change of the pixel point is greater than a preset value.
[0105] 在提取到视觉范围内图像信息的特征点之后, 构建单元 30利用视觉 SLAM (实 时定位与地图构建, 实现机器人的自主定位和导航) 的方法重建清扫环境的空 间点信息, 以构建所述特征点所在的空间三维坐标。 上述特征点中必然包括天 花板的非必要特征点, 由于天花板等不可能成为视觉扫地机器人的障碍物。 因 此, 特征单元 40使用平面拟合的方法分析估算出天花板的位置, 并将天花板及 其附近 (如 lm距离范围内) 的等非必要特征点全部剔除, 得到必要特征点, 该 必要特征点在空间三维坐标里形成空间障碍物点集。  [0105] After extracting the feature points of the image information in the visual range, the constructing unit 30 reconstructs the spatial point information of the cleaning environment by using a method of visual SLAM (real-time positioning and map construction to realize autonomous positioning and navigation of the robot) to construct the The three-dimensional coordinates of the space where the feature points are located. The above feature points necessarily include non-essential feature points of the ceiling plate, and it is impossible to become an obstacle of the visual sweeping robot because the ceiling or the like. Therefore, the feature unit 40 uses the method of plane fitting to analyze and estimate the position of the ceiling, and eliminates all unnecessary feature points such as the ceiling and its vicinity (such as within the range of lm distance) to obtain necessary feature points, and the necessary feature points are A set of spatial obstacle points is formed in the three-dimensional coordinates of the space.
[0106] 最后, 投影单元 50将上述空间障碍物点集中的必要特征点的三维坐标投影在二 维平面上, 便得到障碍物在二维平面上的坐标点。 本实施例中的视觉扫地机器 人, 具有适用性高, 检测准确率高, 低成本, 且运算量少等优点。  [0106] Finally, the projection unit 50 projects the three-dimensional coordinates of the necessary feature points in the above-mentioned spatial obstacle points on the two-dimensional plane, and obtains the coordinate points of the obstacle on the two-dimensional plane. The visual sweeping robot in this embodiment has the advantages of high applicability, high detection accuracy, low cost, and low computational complexity.
[0107] 在一实施例中, 上述视觉扫地机器人还包括:  [0107] In an embodiment, the visual cleaning robot further includes:
[0108] 标记单元 51, 用于根据所述空间障碍物点集在二维平面上的坐标点将所述坐标 点标记在清扫区域的二维地图对应的位置上。  [0108] The marking unit 51 is configured to mark the coordinate point at a position corresponding to the two-dimensional map of the cleaning area according to the coordinate point of the spatial obstacle point set on the two-dimensional plane.
[0109] 本实施例中, 二维平面的坐标原点与二维地图的原点相同, 方便标记单元 51快 速将坐标点标记在二维地图对应的位置, 该清扫区域的地图可以是预先建立并 存储在视觉扫地机器人中的, 也可以是视觉扫地机器人清扫时建立的地图。  [0109] In this embodiment, the coordinate origin of the two-dimensional plane is the same as the origin of the two-dimensional map, and the convenient marking unit 51 quickly marks the coordinate point at a position corresponding to the two-dimensional map, and the map of the cleaning area may be pre-established and stored. In the visual sweeping robot, it is also a map created when the visual sweeping robot is cleaned.
[0110] 参照图 10, 在一实施例中, 上述视觉扫地机器人还包括:  [0110] Referring to FIG. 10, in an embodiment, the visual cleaning robot further includes:
[0111] 获取单元 60, 用于获取当前定位坐标;  [0111] an obtaining unit 60, configured to acquire current positioning coordinates;
[0112] 分析单元 70, 用于分析当前定位坐标与所述坐标点的位置关系;  [0112] The analyzing unit 70 is configured to analyze a positional relationship between the current positioning coordinate and the coordinate point;
[0113] 处理单元 80, 用于根据所述位置关系选择对应的预设方式进行处理。 \¥0 2019/104732 卩(:17 \2017/114323 [0113] The processing unit 80 is configured to perform processing according to the location relationship to select a corresponding preset manner. \¥0 2019/104732 卩(:17 \2017/114323
9  9
[0114] 获取单元 60时时获取当前定位, 并将该当前定位标记在二维平面上, 以得到在 二维平面上当前定位坐标, 分析单元 70在二维平面上分析当前定位坐标与所述 坐标点的位置关系, 处理单元 80可以根据视觉扫地机器人自身的当前定位坐标 与空间障碍物点集的坐标点之间的位置关系, 对应进行处理, 例如避开障碍物 , 探索清扫区域内的所有障碍物等。 [0114] The acquiring unit 60 acquires the current positioning from time to time, and marks the current positioning on the two-dimensional plane to obtain the current positioning coordinates on the two-dimensional plane, and the analyzing unit 70 analyzes the current positioning coordinate and the coordinate on the two-dimensional plane. The positional relationship of the points, the processing unit 80 can perform corresponding processing according to the positional relationship between the current positioning coordinates of the visual cleaning robot itself and the coordinate points of the spatial obstacle point set, for example, avoid obstacles, and explore all obstacles in the cleaning area. Things and so on.
[0115] 具体地, 参照图 11, 在一实施例中, 所述处理单元 80包括:  [0115] Specifically, referring to FIG. 11, in an embodiment, the processing unit 80 includes:
[0116] 判断子单元 801, 用于判断所述位置关系是否小于预设值;  [0116] a determining subunit 801, configured to determine whether the location relationship is less than a preset value;
[0117] 减速子单元 802, 用于所述位置关系小于预设值时, 则控制减速运行。  [0117] The deceleration subunit 802 is configured to control the deceleration operation when the positional relationship is less than a preset value.
[0118] 位置关系为当前定位坐标与空间障碍物点集的坐标点在二维平面上的距离, 预 设值为 0.5米。  [0118] The positional relationship is the distance between the current positioning coordinate and the coordinate point of the spatial obstacle point set on the two-dimensional plane, and the preset value is 0.5 m.
[0119] 在另一实施例中, 参照图 12, 所述处理单元 80还包括:  [0119] In another embodiment, referring to FIG. 12, the processing unit 80 further includes:
[0120] 第一分析子单元 803 , 用于分析所述空间障碍物点集的特征属性;  [0120] a first analysis subunit 803, configured to analyze feature attributes of the set of spatial obstacle points;
[0121] 特征属性为空间障碍物点集的长宽高的尺寸。  [0121] The feature attribute is the size of the length, width, and height of the set of spatial obstacle points.
[0122] 第二分析子单元 804, 用于分析所述特征属性是否大于预设属性; 预设属性为 预设的长宽高的尺寸。  [0122] The second analysis sub-unit 804 is configured to analyze whether the feature attribute is greater than a preset attribute; and the preset attribute is a preset size of a length, a width, and a height.
[0123] 避让子单元 805 , 用于若所述特征属性大于预设属性, 则控制避开所述空间障 碍物点集。  [0123] The avoidance sub-unit 805 is configured to control to avoid the spatial obstacle object point set if the feature attribute is greater than a preset attribute.
[0124] 优选地, 本实施例中, 还可以将空间障碍物点集的按特征属性标记在清扫区域 的地图上。  [0124] Preferably, in this embodiment, the feature attribute of the spatial obstacle point set may also be marked on the map of the cleaning area.
[0125] 参照图 13, 在又一实施例中, 所述空间障碍物点集为多个, 对应地, 所述位置 关系为多个, 且所述位置关系为位置距离, 所述处理单元 80包括:  [0125] Referring to FIG. 13 , in another embodiment, the plurality of spatial obstacle points are set, and correspondingly, the position relationship is multiple, and the position relationship is a position distance, and the processing unit 80 Includes:
[0126] 选择子单元 810, 用于从多个所述位置距离中选择最短的位置距离;  [0126] a selection subunit 810, configured to select a shortest position distance from a plurality of the location distances;
[0127] 控制子单元 820, 用于控制朝所述最短的位置距离所对应的空间障碍物点集运 动。  [0127] The control subunit 820 is configured to control the space obstacle point set motion corresponding to the shortest position distance.
[0128] 所述处理单元 80还包括:  [0128] The processing unit 80 further includes:
[0129] 距离分析单元 821, 用于分析最短的位置距离是否小于预定值;  [0129] The distance analyzing unit 821 is configured to analyze whether the shortest position distance is less than a predetermined value;
[0130] 启动单元 822, 用于若最短的位置距离小于预定值, 启动超声波感应器发射超 声波信号; \¥0 2019/104732 卩(:17 \2017/114323 [0130] The starting unit 822 is configured to: when the shortest position distance is less than a predetermined value, start the ultrasonic sensor to emit an ultrasonic signal; \¥0 2019/104732 卩(:17 \2017/114323
10  10
[0131] 信号接收单元 823 , 用于接收超声波信号遇到障碍物时反馈的反馈信号; [0131] The signal receiving unit 823 is configured to receive a feedback signal that is fed back when the ultrasonic signal encounters an obstacle;
[0132] 信息分析单元 824、 用于根据反馈信号分析障碍物的位置信息以及特征属性; [0133] 属性分析单元 825 , 用于分析所述特征属性是否大于预设属性;  [0132] The information analysis unit 824 is configured to analyze location information and feature attributes of the obstacle according to the feedback signal. [0133] an attribute analysis unit 825, configured to analyze whether the feature attribute is greater than a preset attribute;
[0134] 障碍标记单元 826 , 用于若特征属性大于预设属性, 清除二维地图上空间障碍 物点集对应坐标点的标记, 并将障碍物的位置信息形标记于清扫区域的二维地 图相应位置;  [0134] The obstacle marking unit 826 is configured to: if the feature attribute is greater than the preset attribute, clear the mark corresponding to the coordinate point of the space obstacle point set on the two-dimensional map, and mark the position information of the obstacle in the two-dimensional map of the cleaning area. Corresponding location
[0135] 位置存储单元 827 , 用于存储标记有障碍物的位置信息的二维地图, 以便住以 设计清扫路径规划时避开上述障碍物。  [0135] The location storage unit 827 is configured to store a two-dimensional map of the location information marked with the obstacle so as to avoid the obstacle when planning the cleaning route.
[0136] 进一步地, 参照图 14, 坐标点为多个, 所述视觉扫地机器人还包括:  [0136] Further, referring to FIG. 14, there are a plurality of coordinate points, and the visual cleaning robot further includes:
[0137] 划分单元 61, 用于根据多个坐标点在地图上的标记, 将清扫区域进行区域划分  [0137] a dividing unit 61, configured to divide the cleaning area according to the marking of the plurality of coordinate points on the map
[0138] 在检测出清扫区域内的所有空间障碍物点集之后, 则可以按照检测到清扫区域 内的所有空间障碍物点集对应的坐标点位置, 对清扫区域进行区域划分。 优选 地, 还可以对区域划分之后的子区域进行地图覆盖。 [0138] After all the spatial obstacle points in the cleaning area are detected, the cleaning area may be divided according to the position of the coordinate point corresponding to all the spatial obstacle points in the cleaning area. Preferably, the sub-area after the area division can also be covered by the map.
[0139] 进一步, 特征点还包括非必要特征点。  [0139] Further, the feature points further include non-essential feature points.
[0140] 参照图 15, 所述特征单元 40包括:  [0140] Referring to FIG. 15, the feature unit 40 includes:
[0141] 第三分析子单元 401, 用于分析所述特征点在所述空间特征点集里的位置关系  [0141] a third analysis subunit 401, configured to analyze a positional relationship of the feature points in the set of spatial feature points
[0142] 区分子单元 402, 用于根据所述位置关系区分所述非必要特征点和所述必要特 征点; [0142] a region numerator unit 402, configured to distinguish the non-essential feature point and the necessary feature point according to the positional relationship;
[0143] 剔除子单元 403 , 用于按所述指定条件剔除所述非必要特征点;  [0143] a culling sub-unit 403, configured to cull the non-essential feature points according to the specified condition;
[0144] 形成子单元 404, 用于将所述必要特征点形成空间障碍物点集。  [0144] Forming a subunit 404, configured to form the necessary feature points into a set of spatial obstacle points.
[0145] 本实施例中指定条件为保留必要特征点, 由于天花板等不可能成为视觉扫地机 器人的障碍物。 因此, 区分子单元 402使用平面拟合的方法从特征点中分析出天 花板的位置等非不要特征点, 剔除子单元 403将天花板及其预设范围 (如 1111距离 范围内) 的非必要特征点全部剔除, 得到必要特征点, 形成子单元 404将该必要 特征点在空间三维坐标里形成空间障碍物点集。  [0145] The condition specified in the present embodiment is to retain the necessary feature points, since the ceiling or the like is unlikely to be an obstacle to the visual sweeping robot. Therefore, the region molecular unit 402 analyzes the non-denot feature points such as the position of the ceiling from the feature points by using a plane fitting method, and the culling sub-unit 403 sets the non-essential feature points of the ceiling and its preset range (eg, within the distance of 1111). All are eliminated, and the necessary feature points are obtained. The forming sub-unit 404 forms the set of spatial obstacle points in the three-dimensional coordinates of the space.
[0146] 综上所述, 为本发明实施例中提供的视觉扫地机器人及障碍物检测方法, 通过 \¥0 2019/104732 卩(:17 \2017/114323 [0146] In summary, the method for detecting a visual sweeping robot and an obstacle detected by the embodiment of the present invention is \¥0 2019/104732 卩(:17 \2017/114323
11 采集图像信息; 提取所述图像信息中的特征点, 所述特征点包括必要特征点; 构建所述特征点所在的空间三维坐标以形成空间特征点集; 根据所述空间特征 点集, 按指定条件剔除非必要特征点, 得到必要特征点以形成空间障碍物点集 ; 将所述空间障碍物点集投影至二维平面上, 以得到所述空间障碍物点集在二 维平面上的坐标点; 以此检测出障碍物的坐标位置, 以辅助预判障碍物; 且可 以对未知环境进行探测, 以及对清扫区域进行区域划分。  11 acquiring image information; extracting feature points in the image information, the feature points include necessary feature points; constructing spatial three-dimensional coordinates of the feature points to form a spatial feature point set; according to the spatial feature point set, according to Specifying conditions to remove the necessary feature points, obtaining necessary feature points to form a spatial obstacle point set; projecting the spatial obstacle point set onto the two-dimensional plane to obtain the spatial obstacle point set on the two-dimensional plane Coordinate point; thereby detecting the coordinate position of the obstacle to assist in predicting the obstacle; and detecting the unknown environment and dividing the cleaning area.
[0147] 以上所述仅为本发明的优选实施例, 并非因此限制本发明的专利范围, 凡是利 用本发明说明书及附图内容所作的等效结构或等效流程变换, 或直接或间接运 用在其他相关的技术领域, 均同理包括在本发明的专利保护范围内。  The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the invention and the drawings are used directly or indirectly. Other related technical fields are equally included in the scope of patent protection of the present invention.

Claims

\¥0 2019/104732 卩(:17 \2017/114323 12 权利要求书 \¥0 2019/104732 卩(:17 \2017/114323 12 Claims
[权利要求 1] 一种障碍物检测方法, 其特征在于, 包括以下步骤:  [Claim 1] An obstacle detecting method, comprising the steps of:
采集图像信息;  Collecting image information;
提取所述图像信息中的特征点, 所述特征点包括必要特征点; 构建所述特征点所在的空间三维坐标以形成空间特征点集; 根据所述空间特征点集, 按指定条件提取必要特征点以形成空间障碍 物点集;  Extracting feature points in the image information, the feature points include necessary feature points; constructing spatial three-dimensional coordinates of the feature points to form a spatial feature point set; and extracting necessary features according to the specified conditions according to the spatial feature point set Point to form a set of spatial obstacle points;
将所述空间障碍物点集投影至二维平面上, 以得到所述空间障碍物点 集在二维平面上的坐标点。  The spatial obstacle point set is projected onto a two-dimensional plane to obtain coordinate points of the spatial obstacle point set on a two-dimensional plane.
[权利要求 2] 根据权利要求 1所述的障碍物检测方法, 其特征在于, 所述将所述空 间障碍物点集投影至二维平面上, 以得到所述空间障碍物点集在二维 平面上的坐标点的步骤之后, 包括:  [Claim 2] The obstacle detecting method according to claim 1, wherein the spatial obstacle point set is projected onto a two-dimensional plane to obtain the spatial obstacle point set in two dimensions After the steps of the coordinate points on the plane, include:
根据所述空间障碍物点集在二维平面上的坐标点将所述坐标点标记在 清扫区域的二维地图对应的位置上。  The coordinate points are marked at positions corresponding to the two-dimensional map of the cleaning area according to the coordinate points of the spatial obstacle point set on the two-dimensional plane.
[权利要求 3] 根据权利要求 1所述的障碍物检测方法, 其特征在于, 所述将所述空 间障碍物点集投影至二维平面上, 以得到所述空间障碍物点集在二维 平面上的坐标点的步骤之后, 包括:  [Claim 3] The obstacle detecting method according to claim 1, wherein the spatial obstacle point set is projected onto a two-dimensional plane to obtain the spatial obstacle point set in two dimensions After the steps of the coordinate points on the plane, include:
获取当前定位坐标;  Get the current positioning coordinates;
分析当前定位坐标与所述坐标点的位置关系;  Analyzing a positional relationship between the current positioning coordinate and the coordinate point;
根据所述位置关系选择对应的预设方式进行处理。  The corresponding preset manner is selected according to the positional relationship for processing.
[权利要求 4] 根据权利要求 3所述的障碍物检测方法, 其特征在于, 预设方式包括 减速运行, 所述根据所述位置关系选择对应的预设方式进行处理的步 骤, 包括:  [Claim 4] The obstacle detection method according to claim 3, wherein the preset manner includes a deceleration operation, and the step of selecting a corresponding preset manner to perform processing according to the positional relationship includes:
判断所述位置关系是否小于预设值;  Determining whether the positional relationship is less than a preset value;
若是, 则控制减速运行。  If yes, control the deceleration operation.
[权利要求 5] 根据权利要求 4所述的障碍物检测方法, 其特征在于, 所述控制减速 运行的步骤之后, 包括:  [Claim 5] The obstacle detecting method according to claim 4, wherein the step of controlling the deceleration operation comprises:
分析所述空间障碍物点集的特征属性; \¥0 2019/104732 卩(:17 \2017/114323 Analyzing characteristic attributes of the set of spatial obstacle points; \¥0 2019/104732 卩(:17 \2017/114323
13 分析所述特征属性是否大于预设属性;  13 analyzing whether the feature attribute is greater than a preset attribute;
若大于, 则控制避开所述空间障碍物点集。  If it is greater, the control avoids the set of space obstacle points.
[权利要求 6] 根据权利要求 3所述的障碍物检测方法, 其特征在于, 所述空间障碍 物点集为多个, 对应地, 所述位置关系为多个, 且所述位置关系为位 置距离, 所述根据所述位置关系选择对应的预设方式进行处理的步骤 , 包括:  [Claim 6] The obstacle detecting method according to claim 3, wherein the plurality of spatial obstacle points are plural, and correspondingly, the positional relationship is plural, and the positional relationship is a position. The step of selecting the corresponding preset manner for processing according to the location relationship includes:
从多个所述位置距离中选择最短的位置距离;  Selecting the shortest position distance from a plurality of the position distances;
控制朝所述最短的位置距离所对应的空间障碍物点集运动。  Controlling the movement of the point set of the space obstacle corresponding to the shortest position distance.
[权利要求 7] 根据权利要求 2所述的障碍物检测方法, 其特征在于, 所述特征属性 为长宽高尺寸、 预设属性为预设的长宽高尺寸。  [Claim 7] The obstacle detecting method according to claim 2, wherein the feature attribute is a length, a width, a height, and a preset attribute is a preset length, width, and height.
[权利要求 8] 根据权利要求 1所述的视觉扫地机器人的障碍物检测方法, 其特征在 于, 所述特征点还包括非必要特征点, 所述根据所述空间特征点集, 按指定条件提取必要特征点以形成空间障碍物点集的步骤, 包括: 分析所述特征点在所述空间特征点集里的位置关系; [Claim 8] The obstacle detecting method of the visual cleaning robot according to claim 1, wherein the feature point further includes a non-essential feature point, and the extracting is performed according to the specified condition according to the spatial feature point set The step of forming a feature point to form a set of spatial obstacle points includes: analyzing a positional relationship of the feature points in the set of spatial feature points;
根据所述位置关系区分所述非必要特征点和所述必要特征点; 按所述指定条件剔除所述非必要特征点;  Distinguishing the non-essential feature points and the necessary feature points according to the positional relationship; culling the non-essential feature points according to the specified condition;
将所述必要特征点形成空间障碍物点集。  The necessary feature points are formed into a set of spatial obstacle points.
[权利要求 9] 一种扫地机器人, 其特征在于, 包括:  [Claim 9] A cleaning robot, comprising:
采集单元, 用于采集图像信息,  Acquisition unit for collecting image information,
提取单元, 用于提取所述图像信息中的特征点, 所述特征点包括必要 特征点;  An extracting unit, configured to extract feature points in the image information, where the feature points include necessary feature points;
构建单元, 用于构建所述特征点所在的空间三维坐标以形成空间特征 点集;  a building unit, configured to construct a spatial three-dimensional coordinate of the feature point to form a spatial feature point set;
特征单元, 用于根据所述空间特征点集, 按指定条件提取必要特征点 以形成空间障碍物点集;  a feature unit, configured to extract necessary feature points according to the specified condition according to the set of spatial feature points to form a set of spatial obstacle points;
投影单元, 用于将所述空间障碍物点集投影至二维平面上, 以得到所 述空间障碍物点集在二维平面上的坐标点。  a projection unit, configured to project the set of spatial obstacle points onto a two-dimensional plane to obtain coordinate points of the set of spatial obstacle points on a two-dimensional plane.
[权利要求 10] 根据权利要求 9所述的视觉扫地机器人, 其特征在于, 还包括: \¥0 2019/104732 卩(:17 \2017/114323 The visual cleaning robot according to claim 9, further comprising: \¥0 2019/104732 卩(:17 \2017/114323
14 标记单元, 根据所述空间障碍物点集在二维平面上的坐标点将所述坐 标点标记在清扫区域的二维地图对应的位置上。  The marking unit marks the coordinate point at a position corresponding to the two-dimensional map of the cleaning area according to the coordinate point of the spatial obstacle point set on the two-dimensional plane.
[权利要求 11] 根据权利要求 9所述的视觉扫地机器人, 其特征在于, 还包括:  The visual cleaning robot according to claim 9, further comprising:
获取单元, 用于获取当前定位坐标;  An obtaining unit, configured to acquire a current positioning coordinate;
分析单元, 用于分析当前定位坐标与所述坐标点的位置关系; 处理单元, 用于根据所述位置关系选择对应的预设方式进行处理。  The analyzing unit is configured to analyze a positional relationship between the current positioning coordinate and the coordinate point; and the processing unit is configured to select a corresponding preset manner to perform processing according to the positional relationship.
[权利要求 12] 根据权利要求 11所述的视觉扫地机器人, 其特征在于, 预设方式包括 减速运行, 所述处理单元包括:  [Claim 12] The visual cleaning robot according to claim 11, wherein the preset mode comprises a deceleration operation, and the processing unit comprises:
判断子单元, 用于判断所述位置关系是否小于预设值;  a determining subunit, configured to determine whether the positional relationship is less than a preset value;
减速子单元, 用于所述位置关系小于预设值时, 则控制减速运行。  The deceleration subunit, when the positional relationship is less than a preset value, controls the deceleration operation.
[权利要求 13] 根据权利要求 12所述的视觉扫地机器人, 其特征在于, 所述处理单元 还包括:  [Claim 13] The visual cleaning robot according to claim 12, wherein the processing unit further comprises:
第一分析子单元, 用于分析所述空间障碍物点集的特征属性; 第二分析子单元, 用于分析所述特征属性是否大于预设属性; 避让子单元, 用于若所述特征属性大于预设属性, 则控制避开所述空 间障碍物点集。  a first analysis subunit, configured to analyze feature attributes of the set of spatial obstacle points; a second analysis subunit, configured to analyze whether the feature attribute is greater than a preset attribute; and a avoidance subunit, configured to use the feature attribute If it is greater than the preset attribute, the control avoids the space obstacle point set.
[权利要求 14] 根据权利要求 11所述的视觉扫地机器人, 其特征在于, 所述空间障碍 物点集为多个, 对应地, 所述位置关系为多个, 且所述位置关系为位 置距离, 所述处理单元包括:  The visual cleaning robot according to claim 11, wherein the plurality of spatial obstacle points are plural, and correspondingly, the positional relationship is plural, and the positional relationship is a positional distance. The processing unit includes:
选择子单元, 用于从多个所述位置距离中选择最短的位置距离; 控制子单元, 用于控制朝所述最短的位置距离所对应的空间障碍物点 集运动。  Selecting a subunit for selecting a shortest position distance from a plurality of the position distances; and a control subunit for controlling a movement of the point crap set corresponding to the shortest position distance.
[权利要求 15] 根据权利要求 10所述的视觉扫地机器人, 其特征在于, 特征属性为长 宽高尺寸、 预设属性为预设的长宽高尺寸。  [Claim 15] The visual cleaning robot according to claim 10, wherein the feature attribute is a length, a width, and a height, and the preset attribute is a preset length, width, and height.
[权利要求 16] 根据权利要求 9所述的视觉扫地机器人, 其特征在于, 所述特征点还 包括非必要特征点, 所述特征单元包括:  [Claim 16] The visual cleaning robot according to claim 9, wherein the feature point further includes a non-essential feature point, and the feature unit includes:
第三分析子单元, 用于分析所述特征点在所述空间特征点集里的位置 关系; \¥0 2019/104732 卩(:17 \2017/114323 a third analysis subunit, configured to analyze a positional relationship of the feature points in the set of spatial feature points; \¥0 2019/104732 卩(:17 \2017/114323
15 区分子单元, 用于根据所述位置关系区分所述非必要特征点和所述必 要特征点;  a 15-segment molecular unit for distinguishing the non-essential feature points and the necessary feature points according to the positional relationship;
剔除子单元, 用于按所述指定条件剔除所述非必要特征点; 形成子单元, 用于将所述必要特征点形成空间障碍物点集。  The culling subunit is configured to cull the non-essential feature points according to the specified condition; and form a subunit for forming the necessary feature points into a set of spatial obstacle points.
PCT/CN2017/114323 2017-12-01 2017-12-01 Vision cleaning robot and obstacle detection method WO2019104732A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/114323 WO2019104732A1 (en) 2017-12-01 2017-12-01 Vision cleaning robot and obstacle detection method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/114323 WO2019104732A1 (en) 2017-12-01 2017-12-01 Vision cleaning robot and obstacle detection method

Publications (1)

Publication Number Publication Date
WO2019104732A1 true WO2019104732A1 (en) 2019-06-06

Family

ID=66663688

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/114323 WO2019104732A1 (en) 2017-12-01 2017-12-01 Vision cleaning robot and obstacle detection method

Country Status (1)

Country Link
WO (1) WO2019104732A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102246201A (en) * 2008-12-12 2011-11-16 松下电器产业株式会社 Image processing device and image processing method
CN103901774A (en) * 2012-12-28 2014-07-02 联想(北京)有限公司 Efficient robust SLAM coordinating method and system based on multiple sensors
CN103984037A (en) * 2014-04-30 2014-08-13 深圳市墨克瑞光电子研究院 Obstacle detection method and device for mobile robot based on vision
US20140316636A1 (en) * 2013-04-23 2014-10-23 Samsung Electronics Co., Ltd. Moving robot, user terminal apparatus and control method thereof
CN107153831A (en) * 2017-03-28 2017-09-12 宇龙计算机通信科技(深圳)有限公司 Localization method, system and the intelligent terminal of intelligent terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102246201A (en) * 2008-12-12 2011-11-16 松下电器产业株式会社 Image processing device and image processing method
CN103901774A (en) * 2012-12-28 2014-07-02 联想(北京)有限公司 Efficient robust SLAM coordinating method and system based on multiple sensors
US20140316636A1 (en) * 2013-04-23 2014-10-23 Samsung Electronics Co., Ltd. Moving robot, user terminal apparatus and control method thereof
CN103984037A (en) * 2014-04-30 2014-08-13 深圳市墨克瑞光电子研究院 Obstacle detection method and device for mobile robot based on vision
CN107153831A (en) * 2017-03-28 2017-09-12 宇龙计算机通信科技(深圳)有限公司 Localization method, system and the intelligent terminal of intelligent terminal

Similar Documents

Publication Publication Date Title
US9911226B2 (en) Method for cleaning or processing a room by means of an autonomously mobile device
US10705535B2 (en) Systems and methods for performing simultaneous localization and mapping using machine vision systems
WO2021031427A1 (en) Sweeping robot and automated control method for sweeping robot
EP4193897A1 (en) Method and apparatus for detecting obstacle, self-propelled robot, and storage medium
JP6445995B2 (en) Adaptive mapping using spatial aggregation of sensor data
EP3585571B1 (en) Moving robot and control method thereof
EP3104194B1 (en) Robot positioning system
US7184586B2 (en) Location mark detecting method for robot cleaner and robot cleaner using the method
KR101753361B1 (en) Smart cleaning system and method using a cleaning robot
US20160282107A1 (en) System and Method for Measuring by Laser Sweeps
CN113331743A (en) Method for cleaning floor by cleaning robot and cleaning robot
CN107928566A (en) Vision sweeping robot and obstacle detection method
CN112075879A (en) Information processing method, device and storage medium
US10437251B2 (en) Method for specifying position, terminal device, autonomous device, and program
WO2019001237A1 (en) Mobile electronic device, and method in mobile electronic device
US20220257075A1 (en) Moving robot and method of controlling the same
JP6828708B2 (en) Control device, surveillance system, and surveillance camera control method
KR20120033414A (en) Robot for operating recognition of self-position and operation method thereof
JP2004338889A (en) Image recognition device
WO2019104732A1 (en) Vision cleaning robot and obstacle detection method
CN113662476B (en) Method and system for improving cleaning coverage rate of movable cleaning robot
JP7327596B2 (en) Autonomous mobile device, method and program for detecting dirt on lens of autonomous mobile device
TW201445485A (en) Robot and robot-based parking lot management method thereof
RU2800503C1 (en) Cleaning robot and method of automatic control of cleaning robot
EP2325713B1 (en) Methods and systems for movement of robotic device using video signal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17933708

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17933708

Country of ref document: EP

Kind code of ref document: A1