WO2021253698A1 - Robot walking control method and system, robot, and storage medium - Google Patents

Robot walking control method and system, robot, and storage medium Download PDF

Info

Publication number
WO2021253698A1
WO2021253698A1 PCT/CN2020/123186 CN2020123186W WO2021253698A1 WO 2021253698 A1 WO2021253698 A1 WO 2021253698A1 CN 2020123186 W CN2020123186 W CN 2020123186W WO 2021253698 A1 WO2021253698 A1 WO 2021253698A1
Authority
WO
WIPO (PCT)
Prior art keywords
robot
boundary
outer boundary
planned path
actual
Prior art date
Application number
PCT/CN2020/123186
Other languages
French (fr)
Chinese (zh)
Inventor
朱绍明
任雪
Original Assignee
苏州科瓴精密机械科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 苏州科瓴精密机械科技有限公司 filed Critical 苏州科瓴精密机械科技有限公司
Publication of WO2021253698A1 publication Critical patent/WO2021253698A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0214Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory in accordance with safety or protection criteria, e.g. avoiding hazardous areas
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means

Definitions

  • the invention relates to the field of intelligent control, in particular to a robot walking control method, system, robot and storage medium.
  • Low repetition rate and high coverage rate are the goals pursued by mobile robots such as ergodic robots such as vacuuming, mowing and swimming pool cleaning.
  • the lawn mower robot uses the lawn enclosed by the boundary as the working area to perform mowing operations, and the outside of the lawn is defined as a non-working area.
  • the purpose of the present invention is to provide a robot walking control method, system, robot and storage medium.
  • an embodiment of the present invention provides a robot walking control method.
  • the method includes: preset planning paths for the robot;
  • the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, and the The boundary drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once and work synchronously;
  • the walking and working route of the robot can be selected in combination with the images taken by the robot, and the working efficiency of the robot can be improved.
  • the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started
  • the device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, including:
  • image recognition is used to perform operations on the outer boundary, and the work efficiency of the robot is improved.
  • the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started
  • the device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, and further includes:
  • the robot After the robot returns to the starting position, the robot is driven to walk along other paths and work synchronously.
  • the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started
  • the device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, including:
  • the following steps are performed:
  • the walking and working route of the robot can be selected by combining the images taken by the robot to improve the robot Work efficiency.
  • the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started
  • the device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, including:
  • the camera is started in real time to take environmental images, and the environmental images are analyzed in real time to determine whether the actual boundary is obtained. If so, when the actual boundary is obtained, the robot is driven to plan the path. Walk along the actual boundary in the planned direction and work synchronously; if not, follow the planned path and work synchronously on other paths that do not include the outer boundary in the planned path;
  • the method of image recognition and the traditional fixed-point positioning method are used to find the path, and the above two methods are alternately implemented through specific judgment conditions to perform operations on the outer boundary and the area within the outer boundary.
  • the image selects the walking and working route of the robot to improve the working efficiency of the robot.
  • the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started
  • the device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, including:
  • the robot When reaching each pre-planned coordinate point on the planned path, the robot is driven to rotate in place, and the environment image is captured by the camera device;
  • the robot is driven to walk along the actual boundary and work synchronously.
  • the method further includes:
  • the method of image recognition and the traditional fixed-point positioning method are used to find the path, and the above two methods are alternately implemented through specific judgment conditions to perform operations on the outer boundary and the area within the outer boundary.
  • the image selects the walking and working route of the robot to improve the working efficiency of the robot.
  • an embodiment of the present invention provides a robot walking control system, the system includes: an acquisition module for acquiring a planned path preset for the robot;
  • the processing module is used for when the planned path includes at least a part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, At least once at the outer boundary, the robot is driven to walk along the actual boundary obtained by analyzing the environment image and work synchronously.
  • an embodiment of the present invention provides a robot, including a memory and a processor, the memory stores a computer program, and the processor implements the aforementioned robot walking control method when the computer program is executed. A step of.
  • an embodiment of the present invention provides a readable storage medium on which a computer program is stored, and the computer program is executed by a processor to realize the steps of the robot walking control method as described above.
  • the robot walking control method, system, robot and storage medium of the present invention can select the walking and working route of the robot in combination with the images taken by the robot, thereby improving the working efficiency of the robot.
  • FIG. 1 is a schematic flowchart of a robot walking control method provided by an embodiment of the present invention
  • Fig. 2, Fig. 4, Fig. 5, and Fig. 7 are schematic diagrams of the specific realization process of one of the steps in Fig. 1;
  • FIGS 3, 6, and 8 are respectively schematic diagrams of different examples of the present invention.
  • Fig. 9 is a schematic diagram of modules of the robot walking control system provided by the present invention.
  • the robot system of the present invention can be a mowing robot system, a sweeping robot system, a snow sweeper system, a leaf suction system, a golf course ball picker system, etc. Each system can automatically walk in the work area and perform corresponding tasks.
  • the robot system is taken as an example of a lawn mowing robot system.
  • the working area may be a lawn.
  • a lawn mower robot system usually includes: a lawn mower (RM), a charging station, and a boundary line.
  • the lawn mower robot includes a main body, a walking unit and a control unit arranged on the main body.
  • the walking unit is used to control the walking and turning of the robot;
  • the control unit is used to plan the walking direction and walking route of the robot, store the external parameters obtained by the robot, and process and analyze the obtained parameters, and according to the processing, The analysis result specifically controls the robot;
  • the control unit is for example: MCU or DSP.
  • the lawn mower robot of the present invention further includes: a camera device and a fixed-point positioning device are provided in cooperation with the control unit, and the camera device is used to obtain a scene within a certain range of its viewing angle.
  • the camera device locates the outer boundary by means of image analysis
  • the fixed-point positioning system locates the inner boundary area enclosed by the outer boundary by searching for coordinate points on the working path;
  • the control unit combines the camera device and The fixed-point positioning device controls the robot to traverse the working area; it will be described in detail in the following content.
  • the robot also includes: various sensors, storage modules, such as EPROM, Flash or SD card, etc., and a working mechanism for work, and a power supply; in this embodiment, the working mechanism is a lawn mower blade , Various sensors used to sense the walking state of the walking robot, such as: tipping, ground-off, collision sensors, geomagnetism, gyroscopes, etc., which are not detailed here.
  • the robot walking control method provided in the first implementation of the present invention includes the following steps:
  • the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, and the The outer boundary drives the robot to walk along the actual boundary obtained by analyzing the environment image and work synchronously at least once.
  • step S2 further includes: if the outer boundary is not included in the planned path, driving the robot to walk along the planned path and work synchronously.
  • the traditional path planning method usually drives the robot to walk along the work area before the robot works, and uses the fixed-point positioning method to plan the work path in combination with the robot’s walking route.
  • the planned work path Usually does not include the actual outer boundary of the working area, that is, the outer boundary in the planned path is formed by offsetting the actual outer boundary inward.
  • outer boundary specifically refers to the separation boundary between the working area and the non-working area. In this way, the outer boundary can be accurately identified through image recognition.
  • the camera device of the present invention photographs the scene in front of the robot to form an environment image; the environment is the ground in the direction of the robot's advancement; further, when the main controller receives the environment image, it analyzes the environment image Therefore, it can be judged whether the outer boundary exists within the preset distance range of the robot from the current position of the robot through the environment image; the technology of identifying the outer boundary through the image is already relatively mature in the prior art, and will not be described in detail here.
  • the step S2 specifically includes: judging whether the outer boundary included in the planned path is continuous, and if so, executing the following steps:
  • the continuous means that all road sections are connected end to end in sequence.
  • step S2 further includes: judging whether the planned path includes paths other than the outer boundary, and if so, performing the following steps:
  • the robot After the robot returns to the starting position, the robot is driven to walk along other paths and work synchronously.
  • the method also includes: immediately turning off the camera device, thus saving resources; and preventing the robot from repeating operations on the actual outer boundary.
  • the area described in Figure 3 is the work area as a whole, and the planned path constructed by the traditional method is the path L1 formed by the bow-shaped solid line; and there is actually a path L2 formed by the solid rectangular frame in the work area. ;
  • the path L2 is a continuous outer boundary, and the arrow points to the walking direction of the robot; if the mowing operation is carried out according to the traditional positioning method, due to factors such as UWB and other fixed-point positioning accuracy is not high, the robot cannot be formed on the dotted line Work on the rectangle path L2.
  • the complete work area can be mowed; specifically, starting from the starting position A, the camera device is started, and after the environment image is captured by the camera device, further steps can be taken.
  • the actual boundary is obtained by analyzing the environment image, that is, the rectangular frame path L2 formed by the dashed line in the figure.
  • the robot is driven to move from the starting position A to the starting position B of the actual boundary, and starting from the starting position B .
  • the robot keeps working along the path L2
  • the robot works a circle along the path L2 and returns to the starting position B, confirm the completion of the outer boundary operation, at this time, turn off the camera device, the robot returns from the starting position B To the starting point position A;
  • the robot can only walk along the path L1 and work synchronously; when the robot reaches the position C, the work ends.
  • the image recognition method is first used to work on the outer boundary, and then the traditional fixed-point positioning method is used to work on the area within the outer boundary. In this way, it can be photographed by combining with the robot.
  • the image selects the walking and working route of the robot to improve the working efficiency of the robot.
  • the step S2 specifically includes: if the outer boundary included in the planned path is continuous, and the planned path also includes the outer boundary other than the outer boundary For other paths, perform the following steps:
  • the camera device is started to take environmental images, and the robot is driven to walk to the actual boundary obtained by analyzing the environmental image, walk along the actual boundary obtained by analyzing the environmental image, and work synchronously.
  • This second preferred embodiment is similar to the above-mentioned first preferred embodiment. The difference is that the first embodiment first operates on the outer boundary, and then operates on the area within the outer boundary; while the second embodiment first performs operations on the outer boundary. The area is operated, and then the outer boundary is operated.
  • the complete work area can be mowed; specifically, starting from the starting position A, the camera is not activated, and the robot follows the traditional fixed-point positioning method.
  • Path L1 walks and works synchronously. When the robot reaches position C, the task of path L1 is completed; further, the robot is driven to work on L2.
  • the robot can turn on the camera at the current position C, and After starting, choose to walk to the nearest position on the actual boundary from the position C, and start to walk along the path L1 and work a circle from the nearest position; you can also walk to any point on the outer boundary according to the predetermined rules, and then turn on the camera device At this time, after the robot is still driven to the nearest position on the actual boundary according to the principle of proximity, it will start to walk along the path L1 and perform a circle from the nearest position.
  • the robot is driven to return to position A, and then the camera is started.
  • the actual boundary can be obtained by analyzing the environmental image, which is formed by the dotted line in the figure.
  • the robot moves from position A to the starting point position B of the actual boundary, and starts from the starting point position B, and works along the path L2; when the robot works in a circle along the path L2 And when it returns to the starting position B, the work ends.
  • the traditional fixed-point positioning method is first used to work on the area within the outer boundary, and then the image recognition method is used to work on the outer boundary.
  • the robot can be combined with The captured images select the walking and working route of the robot to improve the working efficiency of the robot.
  • the step S2 specifically includes:
  • the camera is started in real time to take environmental images, and the environmental images are analyzed in real time to determine whether the actual boundary is obtained. If so, when the actual boundary is obtained, the robot is driven to plan the path. Walk along the actual boundary in the planning direction and work synchronously; if not, walk along the planned path and work synchronously on other paths that do not include the outer boundary in the planned path.
  • the planned path constructed by the traditional method is the path L1 formed by the bow-shaped solid line and the offset path connecting L1 and not shown.
  • the actual work area is There is also a path L2 formed by a broken line; in addition, the thick solid line is the connecting path when the robot moves between the path L1 and the path L2, and the path L2 is a discontinuous outer boundary; if the mowing operation is performed according to the traditional positioning method , Due to the low accuracy of fixed-point positioning such as UWB, when the robot walks along the planned path, it will miss the job on path L2.
  • the complete work area can be mowed; specifically, starting from the starting position A, the camera device is started, and after the environment image is captured by the camera device, further steps can be taken.
  • the actual boundary is obtained by analyzing the environment image, that is, the B-B1 section of the path L2 formed by the dashed line in the figure and the B1-B2 section connecting the B-B1 section.
  • the robot reaches the position B2, it walks along the solid line to B3 and follows Continue to work on the B3-C section of the path L1. Since the B3-C section is not the outer boundary, at this time, although the camera on the robot is in the activated state, the corresponding outer boundary cannot be found.
  • the method of image recognition and the traditional fixed-point positioning method are used to find the path, and the above two methods are alternately implemented through specific judgment conditions.
  • the outer boundary and the inner boundary In this way, the walking and working route of the robot can be selected by combining the images taken by the robot, and the working efficiency of the robot can be improved.
  • the step S2 specifically includes: driving the robot to walk according to the planned path and work synchronously, and synchronously starting the camera device;
  • the robot When reaching each pre-planned coordinate point on the planned path, the robot is driven to rotate in place, and the environment image is captured by the camera device;
  • the robot is driven to walk along the actual boundary and work synchronously.
  • the method further includes:
  • the preset threshold is a set distance constant, and its size can be specifically set according to needs.
  • the entire area described in Figure 8 is the working area. Due to the low accuracy of fixed-point positioning such as UWB, the planned path is formed by connecting A1-B1-C1-D1 in turn by solid lines. Rectangular path L1, the path L1 contains a discontinuous outer boundary; however, if the machine only operates according to path L1, then the actual path EA, ABCDE connected by the dotted line will be missed; and the method of the fourth embodiment of the present invention is adopted The mowing operation can completely traverse the outer boundary (that is, the actual path L1).
  • the fourth preferred embodiment of the present invention combines image recognition to perform work mowing on the planned working area; specifically, starting from the starting position A1, the camera device is started, and after the environmental image is captured by the camera device, it can be further passed Analyze the environment image to obtain the actual boundary point E; further, under the coordinated action of the camera device, the robot walks along the path EA to point A. Since the camera device is always on, the robot will continue to walk along the AF direction after rotating at point A. In this process, it can be known through judgment that when the robot is on the AF road section, its shortest distance from the planned path L1 exceeds the preset threshold.
  • the robot returns and walks to the positioning point position E1 of the path L1; further, at the position E1
  • the robot rotates and passes through the environment image analysis, it cannot find the actual path. Therefore, it will continue to walk along the E1-B1 segment; when the robot reaches the position B1, the environment image analysis sequentially and continuously obtains the boundaries BC, CD, DE, and return to position E along the path, the work ends.
  • the method of image recognition and the traditional fixed-point positioning method are used to find the path, and the above two methods are alternately implemented through the outer boundary and the inner boundary through specific judgment conditions. Work is performed in the planned area. In this way, the walking and working route of the robot can be selected by combining the images taken by the robot, and the working efficiency of the robot can be improved.
  • a robot including a memory and a processor, the memory stores a computer program, and the processor implements the robot walking control method according to any one of the above embodiments when the computer program is executed A step of.
  • a readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the robot walking control method described in any of the above embodiments are realized.
  • a robot walking control system As shown in FIG. 9, a robot walking control system is provided.
  • the system includes: an acquisition module 100 and a processing module 200.
  • the obtaining module 100 is used to obtain the planned path preset for the robot
  • the processing module 200 is used for when the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, At least once at the outer boundary, the robot is driven to walk along the actual boundary obtained by analyzing the environment image and work synchronously.
  • the obtaining module 100 is used to implement step S1; the processing module 200 is used to implement step S2; those skilled in the art can clearly understand that for the convenience and conciseness of the description, the specific working process of the system described above can be referred to The corresponding process in the foregoing method implementation will not be repeated here.
  • the robot walking control method, system, robot and storage medium of the present invention can select the walking and working route of the robot in combination with the images taken by the robot, thereby improving the working efficiency of the robot.
  • modules described as separate components may or may not be physically separate, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed to multiple network modules, Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions of this embodiment.
  • the functional modules in the various embodiments of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module.
  • the above-mentioned integrated modules can be implemented in the form of hardware, or in the form of hardware plus software functional modules.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Manipulator (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)

Abstract

A robot walking control method and system, a robot, and a storage medium. The method comprises: presetting a planned path for a robot (S1); and if the planned path includes at least part of an outer boundary, the outer boundary being a separation boundary of a working area and a non-working area, at least when the robot reaches the outer boundary, starting a photographic apparatus to photograph an environment image, and driving the robot to walk along an actual boundary, which is obtained by parsing the environment image, at least once at the outer boundary and synchronously work (S2). By means of the robot walking control method and system, the robot, and the storage medium, walking and working routes of the robot can be selected with reference to an image photographed by the robot, thereby improving the working efficiency of the robot.

Description

机器人行走控制方法、系统,机器人及存储介质Robot walking control method, system, robot and storage medium 技术领域Technical field
本发明涉及智能控制领域,尤其涉及一种机器人行走控制方法、系统,机器人及存储介质。The invention relates to the field of intelligent control, in particular to a robot walking control method, system, robot and storage medium.
背景技术Background technique
低重复率、高覆盖率是遍历式机器人如吸尘、割草及泳池清洗等移动机器人追求的目标。以移动机器人为智能割草机器人为例,割草机器人以边界围住的草坪为工作区域以进行割草作业,草坪之外定义为非工作区域。Low repetition rate and high coverage rate are the goals pursued by mobile robots such as ergodic robots such as vacuuming, mowing and swimming pool cleaning. Taking the mobile robot as an intelligent lawn mower robot as an example, the lawn mower robot uses the lawn enclosed by the boundary as the working area to perform mowing operations, and the outside of the lawn is defined as a non-working area.
现有技术中,通常通过点定位的方式驱动机器人行走,该点定位方式例如UWB定位方式;相应的,因为UWB精度不高、以及安全因素等其他因素,造成工作区域中靠近边界的草坪无法被割除;即机器人工作过程中,规划的边界和实际边界可能会存在一定的误差,如此,往往不能有效割除工作区域边界处的草坪。In the prior art, robots are usually driven to walk through point positioning, such as UWB positioning. Correspondingly, because of the low accuracy of UWB and other factors such as safety factors, the lawn near the boundary in the work area cannot be Cut; that is, during the robot's working process, there may be a certain error between the planned boundary and the actual boundary. Therefore, it is often impossible to effectively cut the lawn at the boundary of the working area.
发明内容Summary of the invention
为解决上述技术问题,本发明的目的在于提供一种机器人行走控制方法、系统,机器人及存储介质。In order to solve the above technical problems, the purpose of the present invention is to provide a robot walking control method, system, robot and storage medium.
为了实现上述发明目的之一,本发明一实施方式提供一种机器人行走控制方法,所述方法包括:为机器人预设规划路径;In order to achieve one of the above-mentioned objects of the invention, an embodiment of the present invention provides a robot walking control method. The method includes: preset planning paths for the robot;
若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作;If the planned path includes at least a part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, and the The boundary drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once and work synchronously;
通过上述方法,可结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。Through the above method, the walking and working route of the robot can be selected in combination with the images taken by the robot, and the working efficiency of the robot can be improved.
作为本发明一实施方式的进一步改进,若所述规划路径中包含至少部分外 边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作,包括:As a further improvement of an embodiment of the present invention, if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started The device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, including:
判断所述规划路径中包括的所述外边界是否连续,若是,则执行以下步骤:Determine whether the outer boundary included in the planned path is continuous, and if so, perform the following steps:
驱动机器人行走至规划路径中所述外边界上的任一点;Drive the robot to walk to any point on the outer boundary of the planned path;
以所述外边界上的任一点作为起点位置启动摄像装置拍摄环境图像;Starting the camera device to take environmental images by taking any point on the outer boundary as a starting point;
驱动机器人沿解析环境图像获得的实际边界行走并同步工作,直至沿所述实际边界行走并同步工作返回至所述起点位置;Drive the robot to walk along the actual boundary obtained by analyzing the environment image and work synchronously until it walks along the actual boundary and synchronously works back to the starting position;
通过上述方法,采用图像识别的方式对外边界进行作业,提高机器人工作效率。Through the above method, image recognition is used to perform operations on the outer boundary, and the work efficiency of the robot is improved.
作为本发明一实施方式的进一步改进,若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作,还包括:As a further improvement of an embodiment of the present invention, if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started The device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, and further includes:
判断所述规划路径中是否包含除所述外边界之外的其他路径,若是,则执行以下步骤:Determine whether the planned path includes paths other than the outer boundary, and if so, perform the following steps:
在机器人返回至所述起点位置之后,驱动机器人按照其他路径行走并同步工作。After the robot returns to the starting position, the robot is driven to walk along other paths and work synchronously.
通过上述方法,采用图像识别的方式对外边界进行作业,之后采用传统的定点定位方式对外边界以内的区域进行作业,如此,可通过结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。Through the above method, image recognition is used to work on the outer boundary, and then the traditional fixed-point positioning method is used to work on the area within the outer boundary. In this way, the walking and working route of the robot can be selected by combining the images taken by the robot to improve the work efficiency of the robot. .
作为本发明一实施方式的进一步改进,若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作,包括:As a further improvement of an embodiment of the present invention, if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started The device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, including:
若所述规划路径中包括的所述外边界连续,且所述规划路径中还包含除所 述外边界之外的其他路径,则执行以下步骤:If the outer boundary included in the planned path is continuous, and the planned path also includes other paths besides the outer boundary, the following steps are performed:
驱动机器人按照所述其他规划路径行走并同步工作;Drive the robot to walk according to the other planned paths and work synchronously;
在驱动机器人沿所述其他路径行走并完成工作后,启动摄像装置拍摄环境图像,驱动机器人行走至解析环境图像获得的实际边界上,沿解析环境图像获得的实际边界行走并同步工作;After driving the robot to walk along the other path and complete the work, start the camera device to take environmental images, drive the robot to walk to the actual boundary obtained by analyzing the environmental image, walk along the actual boundary obtained by analyzing the environmental image, and work synchronously;
通过上述方法,先采用传统的定点定位方式对外边界以内的区域进行作业,之后,采用图像识别的方式对外边界进行作业,如此,可通过结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。Through the above method, first use the traditional fixed-point positioning method to work on the area within the outer boundary, and then use image recognition to work on the outer boundary. In this way, the walking and working route of the robot can be selected by combining the images taken by the robot to improve the robot Work efficiency.
作为本发明一实施方式的进一步改进,若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作,包括:As a further improvement of an embodiment of the present invention, if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started The device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, including:
驱动机器人行走至规划路径上,以规划路径的任一点作为起点位置;Drive the robot to walk on the planned path, taking any point of the planned path as the starting point;
自所述起点位置开始,驱动机器人按照所述规划路径行走并同步工作;Starting from the starting position, drive the robot to walk along the planned path and work synchronously;
在机器人按照所述规划路径行走并同步工作过程中,实时启动摄像装置拍摄环境图像,并实时解析环境图像以判断是否获取到实际边界,若是,在获取到实际边界时,驱动机器人在规划路径的规划方向上沿所述实际边界行走并同步工作;若否,在规划路径未包含所述外边界的其他路径上,按照所述规划路径行走并同步工作;When the robot walks along the planned path and synchronizes its work, the camera is started in real time to take environmental images, and the environmental images are analyzed in real time to determine whether the actual boundary is obtained. If so, when the actual boundary is obtained, the robot is driven to plan the path. Walk along the actual boundary in the planned direction and work synchronously; if not, follow the planned path and work synchronously on other paths that do not include the outer boundary in the planned path;
通过上述方法,结合采用图像识别的方式和传统的定点定位方式查找路径,并通过特定的判断条件交替实行上述两种方式对外边界以及外边界以内的区域进行作业,如此,可通过结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。Through the above method, the method of image recognition and the traditional fixed-point positioning method are used to find the path, and the above two methods are alternately implemented through specific judgment conditions to perform operations on the outer boundary and the area within the outer boundary. The image selects the walking and working route of the robot to improve the working efficiency of the robot.
作为本发明一实施方式的进一步改进,若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机 器人沿解析环境图像获得的实际边界行走并同步工作,包括:As a further improvement of an embodiment of the present invention, if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera is started The device takes an image of the environment, and drives the robot to walk along the actual boundary obtained by analyzing the environment image at least once at the outer boundary and work synchronously, including:
驱动机器人按照所述规划路径行走并同步工作,并同步启动所述摄像装置;Drive the robot to walk and work synchronously according to the planned path, and synchronously start the camera device;
在到达规划路径上每一预规划的坐标点时,驱动机器人原地旋转,通过摄像装置拍摄环境图像;When reaching each pre-planned coordinate point on the planned path, the robot is driven to rotate in place, and the environment image is captured by the camera device;
若解析所述环境图像未获取到实际边界,则驱动机器人沿所述规划路径继续行走并同步工作;If the actual boundary is not obtained by analyzing the environment image, drive the robot to continue walking along the planned path and work synchronously;
若解析所述环境图像获取到实际边界,则驱动机器人行走至实际边界后,驱动机器人沿所述实际边界行走并同步工作。If the actual boundary is obtained by analyzing the environment image, after driving the robot to walk to the actual boundary, the robot is driven to walk along the actual boundary and work synchronously.
作为本发明一实施方式的进一步改进,若解析所述环境图像获取到实际边界,则驱动机器人行走至实际边界后,驱动机器人沿所述实际边界行走并同步工作时,所述方法还包括:As a further improvement of an embodiment of the present invention, if the actual boundary is obtained by analyzing the environment image, after driving the robot to walk to the actual boundary, when driving the robot to walk along the actual boundary and work synchronously, the method further includes:
同步监测当前行走位置距离规划路径最近的点之间的距离是否大于预设阈值,若大于预设阈值,驱动机器人返回至所述规划路径上,若不大于预设阈值,保持机器人处于实际边界上;Synchronously monitor whether the distance between the current walking position and the point closest to the planned path is greater than the preset threshold, if it is greater than the preset threshold, drive the robot back to the planned path, if it is not greater than the preset threshold, keep the robot on the actual boundary ;
通过上述方法,结合采用图像识别的方式和传统的定点定位方式查找路径,并通过特定的判断条件交替实行上述两种方式对外边界以及外边界以内的区域进行作业,如此,可通过结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。Through the above method, the method of image recognition and the traditional fixed-point positioning method are used to find the path, and the above two methods are alternately implemented through specific judgment conditions to perform operations on the outer boundary and the area within the outer boundary. The image selects the walking and working route of the robot to improve the working efficiency of the robot.
为了实现上述发明目的另一,本发明一实施方式提供一种机器人行走控制系统,所述系统包括:获取模块,用于获取为机器人预设的规划路径;In order to achieve another objective of the above invention, an embodiment of the present invention provides a robot walking control system, the system includes: an acquisition module for acquiring a planned path preset for the robot;
处理模块,用于在所述规划路径中包含至少部分外边界时,所述外边界为工作区域和非工作区域的分隔边界;至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作。The processing module is used for when the planned path includes at least a part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, At least once at the outer boundary, the robot is driven to walk along the actual boundary obtained by analyzing the environment image and work synchronously.
为了实现上述发明目的之一,本发明一实施方式提供一种机器人,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程 序时实现如上所述机器人行走控制方法的步骤。In order to achieve one of the above-mentioned objects of the invention, an embodiment of the present invention provides a robot, including a memory and a processor, the memory stores a computer program, and the processor implements the aforementioned robot walking control method when the computer program is executed. A step of.
为了实现上述发明目的之一,本发明一实施方式提供一种可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现如上所述机器人行走控制方法的步骤。In order to achieve one of the above-mentioned objects of the invention, an embodiment of the present invention provides a readable storage medium on which a computer program is stored, and the computer program is executed by a processor to realize the steps of the robot walking control method as described above.
与现有技术相比,本发明的机器人行走控制方法、系统,机器人及存储介质,可结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。Compared with the prior art, the robot walking control method, system, robot and storage medium of the present invention can select the walking and working route of the robot in combination with the images taken by the robot, thereby improving the working efficiency of the robot.
附图说明Description of the drawings
图1是本发明一实施方式提供的机器人行走控制方法的流程示意图;FIG. 1 is a schematic flowchart of a robot walking control method provided by an embodiment of the present invention;
图2、图4、图5、图7分别是图1中其中一个步骤的具体实现过程的流程示意图;Fig. 2, Fig. 4, Fig. 5, and Fig. 7 are schematic diagrams of the specific realization process of one of the steps in Fig. 1;
图3、6、8分别是本发明不同示例的示意图;Figures 3, 6, and 8 are respectively schematic diagrams of different examples of the present invention;
图9是本发明提供的机器人行走控制系统的模块示意图。Fig. 9 is a schematic diagram of modules of the robot walking control system provided by the present invention.
具体实施方式detailed description
以下将结合附图所示的各实施方式对本发明进行详细描述。但这些实施方式并不限制本发明,本领域的普通技术人员根据这些实施方式所做出的结构、方法、或功能上的变换均包含在本发明的保护范围内。Hereinafter, the present invention will be described in detail with reference to the embodiments shown in the drawings. However, these embodiments do not limit the present invention, and the structural, method, or functional changes made by those skilled in the art based on these embodiments are all included in the protection scope of the present invention.
本发明的机器人系统可以是割草机器人系统,扫地机器人系统、扫雪机系统、吸叶机系统,高尔夫球场拾球机系统等,各个系统可以自动行走于工作区域并进行相对应的工作,本发明具体示例中,以机器人系统为割草机器人系统为例做具体说明,相应的,所述工作区域可为草坪。The robot system of the present invention can be a mowing robot system, a sweeping robot system, a snow sweeper system, a leaf suction system, a golf course ball picker system, etc. Each system can automatically walk in the work area and perform corresponding tasks. In the specific example of the invention, the robot system is taken as an example of a lawn mowing robot system. Correspondingly, the working area may be a lawn.
割草机器人系统通常包括:割草机器人(RM)、充电站、边界线。所述割草机器人包括:本体,设置于本体上的行走单元、控制单元。所述行走单元用于控制机器人行走、转向等;所述控制单元用于规划机器人的行走方向、行走路线,储存机器人获得的外部参数,以及对获取的参数进行处理、分析等,并根据处理、分析结果具体控制机器人;所述控制单元例如:MCU或DSP等。A lawn mower robot system usually includes: a lawn mower (RM), a charging station, and a boundary line. The lawn mower robot includes a main body, a walking unit and a control unit arranged on the main body. The walking unit is used to control the walking and turning of the robot; the control unit is used to plan the walking direction and walking route of the robot, store the external parameters obtained by the robot, and process and analyze the obtained parameters, and according to the processing, The analysis result specifically controls the robot; the control unit is for example: MCU or DSP.
需要说明的是,本发明的割草机器人还包括:与控制单元配合设置摄像装置和定点定位装置,所述摄像装置用于在一定范围内获取其视角范围内的场景,在本发明具体示例中,所述摄像装置采用图片解析的方式定位外边界,所述定点定位系统通过查找工作路径上坐标点的方式定位所述外边界围合的边界内区域;进一步的,通过控制单元结合摄像装置和定点定位装置控制机器人遍历工作区域;以下内容中将会详细描述。It should be noted that the lawn mower robot of the present invention further includes: a camera device and a fixed-point positioning device are provided in cooperation with the control unit, and the camera device is used to obtain a scene within a certain range of its viewing angle. In a specific example of the present invention, , The camera device locates the outer boundary by means of image analysis, and the fixed-point positioning system locates the inner boundary area enclosed by the outer boundary by searching for coordinate points on the working path; further, the control unit combines the camera device and The fixed-point positioning device controls the robot to traverse the working area; it will be described in detail in the following content.
另外,所述机器人还包括:各种传感器,存储模块,例如:EPROM、Flash或SD卡等,以及用于工作的工作机构,及供电电源;在本实施例中,工作机构为割草刀盘,用于感应行走机器人的行走状态的各种传感器,例如:倾倒、离地、碰撞传感器、地磁、陀螺仪等,在此未一一具体赘述。In addition, the robot also includes: various sensors, storage modules, such as EPROM, Flash or SD card, etc., and a working mechanism for work, and a power supply; in this embodiment, the working mechanism is a lawn mower blade , Various sensors used to sense the walking state of the walking robot, such as: tipping, ground-off, collision sensors, geomagnetism, gyroscopes, etc., which are not detailed here.
如图1所示,本发明第一实施提供的机器人行走控制方法,所述方法包括以下步骤:As shown in Figure 1, the robot walking control method provided in the first implementation of the present invention includes the following steps:
S1、为机器人预设规划路径;S1, preset planning path for the robot;
S2、若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作。S2. If the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, and the The outer boundary drives the robot to walk along the actual boundary obtained by analyzing the environment image and work synchronously at least once.
进一步的,所述步骤S2还包括:若所述规划路径中未包含所述外边界,则驱动机器人按照所述规划路径行走并同步工作。Further, the step S2 further includes: if the outer boundary is not included in the planned path, driving the robot to walk along the planned path and work synchronously.
本发明具体实施方式中,当工作区域确定后,为机器人规划路径、以及判断规划路径上是否包含外边界具有多种获得方式,该技术已经在现有技术中已经较为成熟,在此不做详细赘述。另外,需要说明的是,传统的规划路径方法,通常是在机器人工作之前,驱动机器人沿着工作区域行走,并结合机器人的行走路线采用定点定位的方式规划工作路径,如此,规划的工作路径中,通常不包含工作区域的实际外边界,即规划路径中的外边界以实际外边界向内偏移形成。In the specific embodiment of the present invention, when the working area is determined, there are multiple ways to obtain the robot planning path and judging whether the planned path includes the outer boundary. This technology is already relatively mature in the prior art, and will not be detailed here. Go into details. In addition, it should be noted that the traditional path planning method usually drives the robot to walk along the work area before the robot works, and uses the fixed-point positioning method to plan the work path in combination with the robot’s walking route. In this way, in the planned work path , Usually does not include the actual outer boundary of the working area, that is, the outer boundary in the planned path is formed by offsetting the actual outer boundary inward.
需要说明的是,上述所述外边界特定指代工作区域和非工作区域的分隔边界,如此,通过图像识别的方式可准确识别该所述外边界。It should be noted that the above-mentioned outer boundary specifically refers to the separation boundary between the working area and the non-working area. In this way, the outer boundary can be accurately identified through image recognition.
具体的,本发明的摄像装置拍摄机器人前方的场景,形成环境图像;所述环境即为机器人前进方向上的地面;进一步的,当所述主控制器接收到环境图像后,对环境图像进行解析;从而可通过环境图像判断机器人距离机器人当前位置的预设距离范围内是否存在所述外边界;通过图像识别外边界的技术在现有技术中已经较为成熟,在此不做详细赘述。Specifically, the camera device of the present invention photographs the scene in front of the robot to form an environment image; the environment is the ground in the direction of the robot's advancement; further, when the main controller receives the environment image, it analyzes the environment image Therefore, it can be judged whether the outer boundary exists within the preset distance range of the robot from the current position of the robot through the environment image; the technology of identifying the outer boundary through the image is already relatively mature in the prior art, and will not be described in detail here.
本发明第一较佳实施方式中,结合图2所示,所述步骤S2具体包括:判断所述规划路径中包括的所述外边界是否连续,若是,则执行以下步骤:In the first preferred embodiment of the present invention, as shown in FIG. 2, the step S2 specifically includes: judging whether the outer boundary included in the planned path is continuous, and if so, executing the following steps:
驱动机器人行走至规划路径中所述外边界上的任一点;以所述外边界上的任一点作为起点位置启动摄像装置拍摄环境图像;驱动机器人沿解析环境图像获得的实际边界行走并同步工作,直至沿所述实际边界行走并同步工作返回至所述起点位置。Drive the robot to walk to any point on the outer boundary of the planned path; use any point on the outer boundary as the starting point to start the camera to take environmental images; drive the robot to walk along the actual boundary obtained by analyzing the environmental image and work synchronously, Until walking along the actual boundary and working synchronously to return to the starting position.
在这里,所述连续指所有路段依次首尾连接。Here, the continuous means that all road sections are connected end to end in sequence.
进一步的,所述步骤S2还包括:判断所述规划路径中是否包含除所述外边界之外的其他路径,若是,则执行以下步骤:Further, the step S2 further includes: judging whether the planned path includes paths other than the outer boundary, and if so, performing the following steps:
在机器人返回至所述起点位置之后,驱动机器人按照其他路径行走并同步工作。After the robot returns to the starting position, the robot is driven to walk along other paths and work synchronously.
较佳的,所述“直至沿所述实际边界行走并同步工作返回至所述起点位置”后,并在所述“在机器人返回至所述起点位置之后,驱动机器人按照其他路径行走并同步工作”之前,所述方法还包括:即时关闭摄像装置,如此,节约资源;并可以防止机器人对实际外边界重复作业。Preferably, after the “until it walks along the actual boundary and works synchronously to return to the starting position”, and after the “after the robot returns to the starting position, drive the robot to walk along other paths and work synchronously "Before, the method also includes: immediately turning off the camera device, thus saving resources; and preventing the robot from repeating operations on the actual outer boundary.
为了便于理解,本发明针对上述第一较佳实施方式描述一具体示例供参考:For ease of understanding, the present invention describes a specific example for the above-mentioned first preferred embodiment for reference:
结合图3所示,图3所述区域整体为工作区域,通过传统方式构造的规划路径为弓字形实线形成的路径L1;而在该工作区域中实际还存在实线矩形框形成的路径L2;其中,路径L2为连续的外边界,箭头指向为机器人的行走方向; 若按照传统的定位方式进行割草作业时,由于UWB等定点定位精度不高的因素,造成机器人无法在该虚线形成的矩形框路径L2上工作作业。As shown in Figure 3, the area described in Figure 3 is the work area as a whole, and the planned path constructed by the traditional method is the path L1 formed by the bow-shaped solid line; and there is actually a path L2 formed by the solid rectangular frame in the work area. ; Among them, the path L2 is a continuous outer boundary, and the arrow points to the walking direction of the robot; if the mowing operation is carried out according to the traditional positioning method, due to factors such as UWB and other fixed-point positioning accuracy is not high, the robot cannot be formed on the dotted line Work on the rectangle path L2.
本发明上述第一较佳实施方式则在结合图像识别后,可以对完整的工作区域进行作业割草;具体的,自起点位置A开始,启动摄像装置,通过摄像装置拍摄环境图像后,可进一步通过解析环境图像获得实际边界,即图示中虚线形成的矩形框路径L2,相应的,通过图像识别的方式,驱动机器人自起点位置A移动至实际边界的起点位置B,并自起点位置B开始,结合图像识别,机器人沿所述路径L2一直作业,当机器人沿路径L2作业一圈并返回至起点位置B时,确认外边界作业完成,此时,关闭摄像装置,则机器人自起点位置B回到起点位置A;进一步的,按照传统的定点定位方式,在摄像装置关闭的情况下,机器人只能沿路径L1行走并同步工作;当机器人达到位置C时,工作结束。In the first preferred embodiment of the present invention, after combining image recognition, the complete work area can be mowed; specifically, starting from the starting position A, the camera device is started, and after the environment image is captured by the camera device, further steps can be taken. The actual boundary is obtained by analyzing the environment image, that is, the rectangular frame path L2 formed by the dashed line in the figure. Correspondingly, through image recognition, the robot is driven to move from the starting position A to the starting position B of the actual boundary, and starting from the starting position B , Combined with image recognition, the robot keeps working along the path L2, when the robot works a circle along the path L2 and returns to the starting position B, confirm the completion of the outer boundary operation, at this time, turn off the camera device, the robot returns from the starting position B To the starting point position A; further, according to the traditional fixed-point positioning method, when the camera is turned off, the robot can only walk along the path L1 and work synchronously; when the robot reaches the position C, the work ends.
如此,对于上述第一较佳实施方式中,机器人工作过程中,先采用图像识别的方式对外边界进行作业,之后采用传统的定点定位方式对外边界以内的区域进行作业,如此,可通过结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。In this way, for the first preferred embodiment described above, during the robot's work process, the image recognition method is first used to work on the outer boundary, and then the traditional fixed-point positioning method is used to work on the area within the outer boundary. In this way, it can be photographed by combining with the robot. The image selects the walking and working route of the robot to improve the working efficiency of the robot.
本发明第二较佳实施方式中,结合图4所示,所述步骤S2具体包括:若所述规划路径中包括的所述外边界连续,且所述规划路径中还包含除所述外边界之外的其他路径,则执行以下步骤:In the second preferred embodiment of the present invention, as shown in FIG. 4, the step S2 specifically includes: if the outer boundary included in the planned path is continuous, and the planned path also includes the outer boundary other than the outer boundary For other paths, perform the following steps:
驱动机器人按照所述其他规划路径行走并同步工作;Drive the robot to walk according to the other planned paths and work synchronously;
在驱动机器人沿所述其他路径行走并完成工作后,启动摄像装置拍摄环境图像,驱动机器人行走至解析环境图像获得的实际边界上,沿解析环境图像获得的实际边界行走并同步工作。After the robot is driven to walk along the other path and finish the work, the camera device is started to take environmental images, and the robot is driven to walk to the actual boundary obtained by analyzing the environmental image, walk along the actual boundary obtained by analyzing the environmental image, and work synchronously.
进一步的,当机器人沿着实际边界行走并同步工作一圈时,工作结束。Further, when the robot walks along the actual boundary and synchronously works for one circle, the work ends.
该第二较佳实施方式与上述第一较佳实施方式相类似,其区别在于,第一实施方式先对外边界作业,之后对外边界内的区域进行作业;而第二实施方式先对外边界内的区域进行作业,之后对外边界作业。This second preferred embodiment is similar to the above-mentioned first preferred embodiment. The difference is that the first embodiment first operates on the outer boundary, and then operates on the area within the outer boundary; while the second embodiment first performs operations on the outer boundary. The area is operated, and then the outer boundary is operated.
为了便于理解,继续以图3所示示例做具体介绍。For ease of understanding, continue to use the example shown in Figure 3 for specific introduction.
本发明上述第二较佳实施方式则在结合图像识别后,可以对完整的工作区域进行作业割草;具体的,自起点位置A开始,未启动摄像装置,机器人按照传统的定点定位方式,沿路径L1行走并同步工作,当机器人到达位置C时,路径L1作业完成;进一步的,驱动机器人在L2上作业,在本发明具体实施方式中,机器人可以在当前位置C开启摄像装置,在摄像装置启动后,就近选择走到实际边界上距离位置C的最近位置,并自该最近位置开始沿路径L1行走并作业一圈;也可以按照预定规则走到外边界上的任一点后,开启摄像装置,此时,依然按照就近原则驱动机器人走到实际边界上的最近位置后,自该最近位置开始沿路径L1行走并作业一圈。本发明具体示例中,当对路径L2完成作业后,驱动机器人返回至位置A后,启动摄像装置,通过摄像装置拍摄环境图像后,可进一步通过解析环境图像获得实际边界,即图示中虚线形成的矩形框路径L2,相应的,通过图像识别的方式,机器人自位置A移动至实际边界的起点位置B,并自起点位置B开始,沿所述路径L2作业;当机器人沿路径L2作业一圈并返回至起点位置B时,工作结束。In the second preferred embodiment of the present invention, combined with image recognition, the complete work area can be mowed; specifically, starting from the starting position A, the camera is not activated, and the robot follows the traditional fixed-point positioning method. Path L1 walks and works synchronously. When the robot reaches position C, the task of path L1 is completed; further, the robot is driven to work on L2. In the specific embodiment of the present invention, the robot can turn on the camera at the current position C, and After starting, choose to walk to the nearest position on the actual boundary from the position C, and start to walk along the path L1 and work a circle from the nearest position; you can also walk to any point on the outer boundary according to the predetermined rules, and then turn on the camera device At this time, after the robot is still driven to the nearest position on the actual boundary according to the principle of proximity, it will start to walk along the path L1 and perform a circle from the nearest position. In a specific example of the present invention, when the work on path L2 is completed, the robot is driven to return to position A, and then the camera is started. After the environmental image is captured by the camera, the actual boundary can be obtained by analyzing the environmental image, which is formed by the dotted line in the figure. Correspondingly, by means of image recognition, the robot moves from position A to the starting point position B of the actual boundary, and starts from the starting point position B, and works along the path L2; when the robot works in a circle along the path L2 And when it returns to the starting position B, the work ends.
如此,对于上述第二较佳实施方式中,机器人工作过程中,先采用传统的定点定位方式对外边界以内的区域进行作业,之后,采用图像识别的方式对外边界进行作业,如此,可通过结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。In this way, in the above second preferred embodiment, in the robot working process, the traditional fixed-point positioning method is first used to work on the area within the outer boundary, and then the image recognition method is used to work on the outer boundary. In this way, the robot can be combined with The captured images select the walking and working route of the robot to improve the working efficiency of the robot.
本发明第三较佳实施方式中,结合图5所示,所述步骤S2具体包括:In the third preferred embodiment of the present invention, as shown in FIG. 5, the step S2 specifically includes:
驱动机器人行走至规划路径上,以规划路径的任一点作为起点位置;Drive the robot to walk on the planned path, taking any point of the planned path as the starting point;
自所述起点位置开始,驱动机器人按照所述规划路径行走并同步工作;Starting from the starting position, drive the robot to walk along the planned path and work synchronously;
在机器人按照所述规划路径行走并同步工作过程中,实时启动摄像装置拍摄环境图像,并实时解析环境图像以判断是否获取到实际边界,若是,在获取到实际边界时,驱动机器人在规划路径的规划方向上沿所述实际边界行走并同步工作;若否,在规划路径未包含所述外边界的其他路径上,按照所述规划路 径行走并同步工作。When the robot walks along the planned path and synchronizes its work, the camera is started in real time to take environmental images, and the environmental images are analyzed in real time to determine whether the actual boundary is obtained. If so, when the actual boundary is obtained, the robot is driven to plan the path. Walk along the actual boundary in the planning direction and work synchronously; if not, walk along the planned path and work synchronously on other paths that do not include the outer boundary in the planned path.
为了便于理解,本发明针对上述第三较佳实施方式描述一具体示例供参考:For ease of understanding, the present invention describes a specific example for the above-mentioned third preferred embodiment for reference:
结合图6所示,图6所述区域整体为工作区域,通过传统方式构造的规划路径为弓字形实线形成的路径L1和连接L1且未示出的偏移路径而在该工作区域中实际还存在虚线形成的路径L2;另外,粗实线为机器人在路径L1和路径L2之间移动时的连接路径,且路径L2为不连续的外边界;若按照传统的定位方式进行割草作业时,由于UWB等定点定位精度不高的因素,当机器人沿该规划路径行走时,会漏掉对路径L2作业。As shown in Figure 6, the entire area described in Figure 6 is the work area. The planned path constructed by the traditional method is the path L1 formed by the bow-shaped solid line and the offset path connecting L1 and not shown. The actual work area is There is also a path L2 formed by a broken line; in addition, the thick solid line is the connecting path when the robot moves between the path L1 and the path L2, and the path L2 is a discontinuous outer boundary; if the mowing operation is performed according to the traditional positioning method , Due to the low accuracy of fixed-point positioning such as UWB, when the robot walks along the planned path, it will miss the job on path L2.
本发明上述第三较佳实施方式则在结合图像识别后,可以对完整的工作区域进行作业割草;具体的,自起点位置A开始,启动摄像装置,通过摄像装置拍摄环境图像后,可进一步通过解析环境图像获得实际边界,即图示中虚线形成的路径L2的B-B1段和连接B-B1段的B1-B2段,当机器人到达位置B2后,沿着实线走到B3,并沿着路径L1的B3-C段继续作业,由于B3-C段不是外边界,此时,机器人上的摄像装置虽然处于启动状态,但是查找不到对应的外边界,如此,依据B3-C段的延伸方向继续作业至位置C;当机器人到达位置C后,通过摄像装置拍摄的环境图像,获取到路径L2的C1-C2段,如此,自位置C1沿实线到达C2后,沿C2-D段继续作业,如此继续,直至到达终点E,工作结束。In the third preferred embodiment of the present invention, after combining image recognition, the complete work area can be mowed; specifically, starting from the starting position A, the camera device is started, and after the environment image is captured by the camera device, further steps can be taken. The actual boundary is obtained by analyzing the environment image, that is, the B-B1 section of the path L2 formed by the dashed line in the figure and the B1-B2 section connecting the B-B1 section. When the robot reaches the position B2, it walks along the solid line to B3 and follows Continue to work on the B3-C section of the path L1. Since the B3-C section is not the outer boundary, at this time, although the camera on the robot is in the activated state, the corresponding outer boundary cannot be found. Therefore, according to the B3-C section Continue to work in the extension direction to position C; when the robot reaches position C, the C1-C2 section of path L2 is obtained through the environmental image taken by the camera device. In this way, after reaching C2 from position C1 along the solid line, follow section C2-D Continue to work, continue like this, until reaching the end point E, the end of the work.
如此,对于上述第三较佳实施方式中,机器人工作过程中,结合采用图像识别的方式和传统的定点定位方式查找路径,并通过特定的判断条件交替实行上述两种方式对外边界以及外边界以内的区域进行作业,如此,可通过结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。In this way, in the third preferred embodiment described above, during the robot's working process, the method of image recognition and the traditional fixed-point positioning method are used to find the path, and the above two methods are alternately implemented through specific judgment conditions. The outer boundary and the inner boundary In this way, the walking and working route of the robot can be selected by combining the images taken by the robot, and the working efficiency of the robot can be improved.
结合图7所示,本发明第四较佳实施方式中,所述步骤S2具体包括:驱动机器人按照所述规划路径行走并同步工作,并同步启动所述摄像装置;As shown in FIG. 7, in the fourth preferred embodiment of the present invention, the step S2 specifically includes: driving the robot to walk according to the planned path and work synchronously, and synchronously starting the camera device;
在到达规划路径上每一预规划的坐标点时,驱动机器人原地旋转,通过摄像装置拍摄环境图像;When reaching each pre-planned coordinate point on the planned path, the robot is driven to rotate in place, and the environment image is captured by the camera device;
若解析所述环境图像未获取到实际边界,则驱动机器人沿所述规划路径继续行走并同步工作;If the actual boundary is not obtained by analyzing the environment image, drive the robot to continue walking along the planned path and work synchronously;
若解析所述环境图像获取到实际边界,则驱动机器人行走至实际边界后,驱动机器人沿所述实际边界行走并同步工作。If the actual boundary is obtained by analyzing the environment image, after driving the robot to walk to the actual boundary, the robot is driven to walk along the actual boundary and work synchronously.
进一步的,若解析所述环境图像获取到实际边界,则驱动机器人行走至实际边界后,驱动机器人沿所述实际边界行走并同步工作时,所述方法还包括:Further, if the actual boundary is obtained by analyzing the environment image, after driving the robot to walk to the actual boundary, when driving the robot to walk along the actual boundary and work synchronously, the method further includes:
同步监测当前行走位置距离规划路径最近的点之间的距离是否大于预设阈值,若大于预设阈值,驱动机器人返回至所述规划路径上,若不大于预设阈值,保持机器人处于实际边界上。Synchronously monitor whether the distance between the current walking position and the point closest to the planned path is greater than the preset threshold, if it is greater than the preset threshold, drive the robot back to the planned path, if it is not greater than the preset threshold, keep the robot on the actual boundary .
所述预设阈值为一设定的距离常数,其大小可以根据需要具体设定。The preset threshold is a set distance constant, and its size can be specifically set according to needs.
为了便于理解,本发明针对上述第三较佳实施方式描述一具体示例供参考:For ease of understanding, the present invention describes a specific example for the above-mentioned third preferred embodiment for reference:
结合图8所示,图8所述区域整体为工作区域,其中,由于UWB等定点定位精度不高的因素,其规划路径为由A1-B1-C1-D1依次由实线连接围合形成的矩形路径L1,该路径L1包含未连续的外边界;然而,若机器仅按照路径L1作业,那么虚线连接的实际路径E-A、A-B-C-D-E段将会被漏割;而采用本发明第四实施方式的方法进行割草作业,则可以完全遍历外边界(即实际路径L1)。As shown in Figure 8, the entire area described in Figure 8 is the working area. Due to the low accuracy of fixed-point positioning such as UWB, the planned path is formed by connecting A1-B1-C1-D1 in turn by solid lines. Rectangular path L1, the path L1 contains a discontinuous outer boundary; however, if the machine only operates according to path L1, then the actual path EA, ABCDE connected by the dotted line will be missed; and the method of the fourth embodiment of the present invention is adopted The mowing operation can completely traverse the outer boundary (that is, the actual path L1).
本发明上述第四较佳实施方式在结合图像识别后,可以对规划的工作区域进行作业割草;具体的,自起点位置A1开始,启动摄像装置,通过摄像装置拍摄环境图像后,可进一步通过解析环境图像获得实际边界点E;进一步的,在摄像装置协同作用下,机器人沿路径E-A行走至A点,由于摄像装置始终开启,机器人处于A点旋转后,会沿着A-F方向继续行走,在此过程中,通过判断可知:当机器人处于A-F路段时,其距离规划路径L1的最短距离超出预设阈值,此时,机器人返回并行走至路径L1的定位点位置E1;进一步的,在位置E1时,机器人旋转并经过环境图像解析后,未能查找到实际路径,如此,会沿着E1-B1段继续行走;当机器人到达位置B1时,通过环境图像解析依次并连续获得边界B-C、C-D、D-E,并沿着该路径返回到位置E,工作结束。The fourth preferred embodiment of the present invention combines image recognition to perform work mowing on the planned working area; specifically, starting from the starting position A1, the camera device is started, and after the environmental image is captured by the camera device, it can be further passed Analyze the environment image to obtain the actual boundary point E; further, under the coordinated action of the camera device, the robot walks along the path EA to point A. Since the camera device is always on, the robot will continue to walk along the AF direction after rotating at point A. In this process, it can be known through judgment that when the robot is on the AF road section, its shortest distance from the planned path L1 exceeds the preset threshold. At this time, the robot returns and walks to the positioning point position E1 of the path L1; further, at the position E1 When the robot rotates and passes through the environment image analysis, it cannot find the actual path. Therefore, it will continue to walk along the E1-B1 segment; when the robot reaches the position B1, the environment image analysis sequentially and continuously obtains the boundaries BC, CD, DE, and return to position E along the path, the work ends.
如此,对于上述第四较佳实施方式中,机器人工作过程中,结合采用图像识别的方式和传统的定点定位方式查找路径,并通过特定的判断条件交替实行上述两种方式对外边界以及外边界以内规划的区域进行作业,如此,可通过结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。In this way, in the fourth preferred embodiment described above, in the robot working process, the method of image recognition and the traditional fixed-point positioning method are used to find the path, and the above two methods are alternately implemented through the outer boundary and the inner boundary through specific judgment conditions. Work is performed in the planned area. In this way, the walking and working route of the robot can be selected by combining the images taken by the robot, and the working efficiency of the robot can be improved.
本发明一实施方式中,还提供一种机器人,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现上述任一实施方式所述的机器人行走控制方法的步骤。In an embodiment of the present invention, there is also provided a robot, including a memory and a processor, the memory stores a computer program, and the processor implements the robot walking control method according to any one of the above embodiments when the computer program is executed A step of.
本发明一实施方式中,还提供一种可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现上述任一实施方式所述的机器人行走控制方法的步骤。In an embodiment of the present invention, there is also provided a readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps of the robot walking control method described in any of the above embodiments are realized.
结合图9所示,提供一种机器人行走控制系统,所述系统包括:获取模块100和处理模块200。As shown in FIG. 9, a robot walking control system is provided. The system includes: an acquisition module 100 and a processing module 200.
获取模块100用于获取为机器人预设的规划路径;The obtaining module 100 is used to obtain the planned path preset for the robot;
处理模块200用于在所述规划路径中包含至少部分外边界时,所述外边界为工作区域和非工作区域的分隔边界;至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作。The processing module 200 is used for when the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, At least once at the outer boundary, the robot is driven to walk along the actual boundary obtained by analyzing the environment image and work synchronously.
进一步的,获取模块100用于实现步骤S1;处理模块200用于实现步骤S2;所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统的具体工作过程,可以参考前述方法实施方式中的对应过程,在此不再赘述。Further, the obtaining module 100 is used to implement step S1; the processing module 200 is used to implement step S2; those skilled in the art can clearly understand that for the convenience and conciseness of the description, the specific working process of the system described above can be referred to The corresponding process in the foregoing method implementation will not be repeated here.
综上所述,本发明的机器人行走控制方法、系统,机器人及存储介质,可结合机器人拍摄的图像选择机器人的行走及工作路线,提高机器人工作效率。In summary, the robot walking control method, system, robot and storage medium of the present invention can select the walking and working route of the robot in combination with the images taken by the robot, thereby improving the working efficiency of the robot.
在本申请所提供的几个实施方式中,应该理解到,所揭露的模块,系统和方法,均可以通过其它的方式实现。以上所描述的系统实施方式仅仅是示意性的,所述模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块或组件可以结合或者可以集成到另一个系统,或一些特 征可以忽略,或不执行。In the several implementation manners provided in this application, it should be understood that the disclosed modules, systems, and methods can all be implemented in other ways. The system implementation described above is merely illustrative. The division of the modules is only a logical function division. In actual implementation, there may be other divisions. For example, multiple modules or components can be combined or integrated into another. A system or some features can be ignored or not implemented.
所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个网络模块上,可以根据实际的需要选择其中的部分或者全部模块来实现本实施方式方案的目的。The modules described as separate components may or may not be physically separate, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed to multiple network modules, Some or all of the modules may be selected according to actual needs to achieve the objectives of the solutions of this embodiment.
另外,在本申请各个实施方式中的各功能模块可以集成在一个处理模块中,也可以是各个模块单独物理存在,也可以2个或2个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用硬件加软件功能模块的形式实现。In addition, the functional modules in the various embodiments of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, or in the form of hardware plus software functional modules.
最后应说明的是:以上实施方式仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施方式对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施方式所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施方式技术方案的精神和范围。Finally, it should be noted that the above implementations are only used to illustrate the technical solutions of the application, not to limit it; although the application has been described in detail with reference to the foregoing implementations, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (10)

  1. 一种机器人行走控制方法,其特征在于,所述方法包括:A robot walking control method, characterized in that the method includes:
    为机器人预设规划路径;Preset planning path for the robot;
    若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作。If the planned path includes at least a part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, and the The boundary drives the robot to walk along the actual boundary obtained by analyzing the environment image and work synchronously at least once.
  2. 根据权利要求1所述的机器人行走控制方法,其特征在于,若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作,包括:The robot walking control method according to claim 1, wherein if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; then at least when the robot reaches the At the outer boundary, the camera device is activated to take environmental images, and the robot is driven at least once at the outer boundary to walk along the actual boundary obtained by analyzing the environmental image and work synchronously, including:
    判断所述规划路径中包括的所述外边界是否连续,若是,则执行以下步骤:Determine whether the outer boundary included in the planned path is continuous, and if so, perform the following steps:
    驱动机器人行走至规划路径中所述外边界上的任一点;Drive the robot to walk to any point on the outer boundary of the planned path;
    以所述外边界上的任一点作为起点位置启动摄像装置拍摄环境图像;Starting the camera device to take environmental images by taking any point on the outer boundary as a starting point;
    驱动机器人沿解析环境图像获得的实际边界行走并同步工作,直至沿所述实际边界行走并同步工作返回至所述起点位置。The robot is driven to walk along the actual boundary obtained by analyzing the environment image and work synchronously until it walks along the actual boundary and synchronously works back to the starting position.
  3. 根据权利要求2所述的机器人行走控制方法,其特征在于,若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作,还包括:The robot walking control method according to claim 2, wherein if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; then at least when the robot reaches the At the outer boundary, starting the camera device to take environmental images, and driving the robot to walk along the actual boundary obtained by analyzing the environmental image at the outer boundary at least once and work synchronously, which also includes:
    判断所述规划路径中是否包含除所述外边界之外的其他路径,若是,则执行以下步骤:Determine whether the planned path includes paths other than the outer boundary, and if so, perform the following steps:
    在机器人返回至所述起点位置之后,驱动机器人按照其他路径行走并同步工作。After the robot returns to the starting position, the robot is driven to walk along other paths and work synchronously.
  4. 根据权利要求1所述的机器人行走控制方法,其特征在于,若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作,包括:The robot walking control method according to claim 1, wherein if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; then at least when the robot reaches the At the outer boundary, the camera device is activated to take environmental images, and the robot is driven at least once at the outer boundary to walk along the actual boundary obtained by analyzing the environmental image and work synchronously, including:
    若所述规划路径中包括的所述外边界连续,且所述规划路径中还包含除所述外边界之外的其他路径,则执行以下步骤:If the outer boundary included in the planned path is continuous, and the planned path also includes other paths besides the outer boundary, the following steps are performed:
    驱动机器人按照所述其他规划路径行走并同步工作;Drive the robot to walk according to the other planned paths and work synchronously;
    在驱动机器人沿所述其他路径行走并完成工作后,启动摄像装置拍摄环境图像,驱动机器人行走至解析环境图像获得的实际边界上,沿解析环境图像获得的实际边界行走并同步工作。After the robot is driven to walk along the other path and finish the work, the camera device is started to take environmental images, and the robot is driven to walk to the actual boundary obtained by analyzing the environmental image, walk along the actual boundary obtained by analyzing the environmental image, and work synchronously.
  5. 根据权利要求1所述的机器人行走控制方法,其特征在于,若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作,包括:The robot walking control method according to claim 1, wherein if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; then at least when the robot reaches the At the outer boundary, the camera device is activated to take environmental images, and the robot is driven at least once at the outer boundary to walk along the actual boundary obtained by analyzing the environmental image and work synchronously, including:
    驱动机器人行走至规划路径上,以规划路径的任一点作为起点位置;Drive the robot to walk on the planned path, taking any point of the planned path as the starting point;
    自所述起点位置开始,驱动机器人按照所述规划路径行走并同步工作;Starting from the starting position, drive the robot to walk along the planned path and work synchronously;
    在机器人按照所述规划路径行走并同步工作过程中,实时启动摄像装置拍摄环境图像,并实时解析环境图像以判断是否获取到实际边界,若是,在获取到实际边界时,驱动机器人在规划路径的规划方向上沿所述实际边界行走并同步工作;若否,在规划路径未包含所述外边界的其他路径上,按照所述规划路径行走并同步工作。When the robot walks along the planned path and synchronizes its work, the camera device is started in real time to take environmental images, and the environmental images are analyzed in real time to determine whether the actual boundary is obtained. If so, when the actual boundary is obtained, the robot is driven to plan the path. Walk along the actual boundary in the planning direction and work synchronously; if not, walk along the planned path and work synchronously on other paths that do not include the outer boundary in the planned path.
  6. 根据权利要求1所述的机器人行走控制方法,其特征在于,若所述规划路径中包含至少部分外边界,所述外边界为工作区域和非工作区域的分隔边界;则至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外 边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作,包括:The robot walking control method according to claim 1, wherein if the planned path includes at least part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; then at least when the robot reaches the At the outer boundary, the camera device is activated to take environmental images, and the robot is driven at least once at the outer boundary to walk along the actual boundary obtained by analyzing the environmental image and work synchronously, including:
    驱动机器人按照所述规划路径行走并同步工作,并同步启动所述摄像装置;Driving the robot to walk and work synchronously according to the planned path, and synchronously start the camera device;
    在到达规划路径上每一预规划的坐标点时,驱动机器人原地旋转,通过摄像装置拍摄环境图像;When reaching each pre-planned coordinate point on the planned path, drive the robot to rotate in situ, and take environmental images through the camera device;
    若解析所述环境图像未获取到实际边界,则驱动机器人沿所述规划路径继续行走并同步工作;If the actual boundary is not obtained by analyzing the environment image, drive the robot to continue walking along the planned path and work synchronously;
    若解析所述环境图像获取到实际边界,则驱动机器人行走至实际边界后,驱动机器人沿所述实际边界行走并同步工作。If the actual boundary is obtained by analyzing the environment image, after driving the robot to walk to the actual boundary, the robot is driven to walk along the actual boundary and work synchronously.
  7. 根据权利要求6所述的机器人行走控制方法,其特征在于,若解析所述环境图像获取到实际边界,则驱动机器人行走至实际边界后,驱动机器人沿所述实际边界行走并同步工作时,所述方法还包括:The robot walking control method according to claim 6, wherein if the actual boundary is obtained by analyzing the environment image, after driving the robot to walk to the actual boundary, when the robot is driven to walk along the actual boundary and work synchronously, The method also includes:
    同步监测当前行走位置距离规划路径最近的点之间的距离是否大于预设阈值,若大于预设阈值,驱动机器人返回至所述规划路径上,若不大于预设阈值,保持机器人处于实际边界上。Synchronously monitor whether the distance between the current walking position and the point closest to the planned path is greater than the preset threshold, if it is greater than the preset threshold, drive the robot back to the planned path, if it is not greater than the preset threshold, keep the robot on the actual boundary .
  8. 一种机器人行走控制系统,其特征在于,所述系统包括:A robot walking control system, characterized in that the system includes:
    获取模块,用于获取为机器人预设的规划路径;The acquisition module is used to acquire the planned path preset for the robot;
    处理模块,用于在所述规划路径中包含至少部分外边界时,所述外边界为工作区域和非工作区域的分隔边界;至少在机器人到达所述外边界时,启动摄像装置拍摄环境图像,并在所述外边界至少一次驱动机器人沿解析环境图像获得的实际边界行走并同步工作。The processing module is used for when the planned path includes at least a part of the outer boundary, the outer boundary is the separation boundary between the working area and the non-working area; at least when the robot reaches the outer boundary, the camera device is activated to take environmental images, At least once at the outer boundary, the robot is driven to walk along the actual boundary obtained by analyzing the environment image and work synchronously.
  9. 一种机器人,包括存储器和处理器,所述存储器存储有计算机程序,其特征在于,所述处理器执行所述计算机程序时实现权利要求1-7中任一项所述机器人行走控制方法的步骤。A robot comprising a memory and a processor, the memory storing a computer program, wherein the processor executes the computer program to implement the steps of the robot walking control method according to any one of claims 1-7 .
  10. 一种可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现权利要求1-7中任一项所述机器人行走控制方法的步 骤。A readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the robot walking control method according to any one of claims 1-7 when the computer program is executed by a processor.
PCT/CN2020/123186 2020-06-17 2020-10-23 Robot walking control method and system, robot, and storage medium WO2021253698A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010554973.5 2020-06-17
CN202010554973.5A CN113885485B (en) 2020-06-17 2020-06-17 Robot walking control method, system, robot and storage medium

Publications (1)

Publication Number Publication Date
WO2021253698A1 true WO2021253698A1 (en) 2021-12-23

Family

ID=79011867

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/123186 WO2021253698A1 (en) 2020-06-17 2020-10-23 Robot walking control method and system, robot, and storage medium

Country Status (2)

Country Link
CN (1) CN113885485B (en)
WO (1) WO2021253698A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115136781A (en) * 2022-06-21 2022-10-04 松灵机器人(深圳)有限公司 Mowing method, mowing device, mowing robot and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103901890A (en) * 2014-04-09 2014-07-02 中国科学院深圳先进技术研究院 Outdoor automatic walking device based on family courtyard and system and method for controlling outdoor automatic walking device based on family courtyard
CN106998984A (en) * 2014-12-16 2017-08-01 伊莱克斯公司 Clean method for robotic cleaning device
US10037029B1 (en) * 2016-08-08 2018-07-31 X Development Llc Roadmap segmentation for robotic device coordination
CN108873880A (en) * 2017-12-11 2018-11-23 北京石头世纪科技有限公司 Intelligent mobile equipment and its paths planning method, computer readable storage medium
CN109984685A (en) * 2019-04-11 2019-07-09 云鲸智能科技(东莞)有限公司 Cleaning control method, device, clean robot and storage medium
US10613541B1 (en) * 2016-02-16 2020-04-07 AI Incorporated Surface coverage optimization method for autonomous mobile machines

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007316966A (en) * 2006-05-26 2007-12-06 Fujitsu Ltd Mobile robot, control method thereof and program
CN107402573B (en) * 2016-05-19 2021-05-14 苏州宝时得电动工具有限公司 Automatic working system, automatic moving equipment and control method thereof
CN111185899B (en) * 2018-11-14 2022-05-13 苏州科瓴精密机械科技有限公司 Robot control method and robot system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103901890A (en) * 2014-04-09 2014-07-02 中国科学院深圳先进技术研究院 Outdoor automatic walking device based on family courtyard and system and method for controlling outdoor automatic walking device based on family courtyard
CN106998984A (en) * 2014-12-16 2017-08-01 伊莱克斯公司 Clean method for robotic cleaning device
US10613541B1 (en) * 2016-02-16 2020-04-07 AI Incorporated Surface coverage optimization method for autonomous mobile machines
US10037029B1 (en) * 2016-08-08 2018-07-31 X Development Llc Roadmap segmentation for robotic device coordination
CN108873880A (en) * 2017-12-11 2018-11-23 北京石头世纪科技有限公司 Intelligent mobile equipment and its paths planning method, computer readable storage medium
CN109984685A (en) * 2019-04-11 2019-07-09 云鲸智能科技(东莞)有限公司 Cleaning control method, device, clean robot and storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115136781A (en) * 2022-06-21 2022-10-04 松灵机器人(深圳)有限公司 Mowing method, mowing device, mowing robot and storage medium

Also Published As

Publication number Publication date
CN113885485A (en) 2022-01-04
CN113885485B (en) 2023-12-22

Similar Documents

Publication Publication Date Title
US11845189B2 (en) Domestic robotic system and method
JP6915209B2 (en) How to create a map of a mobile robot and how to plan a route based on the map
WO2021169188A1 (en) Path tracking method and system, robot, and readable storage medium
CN110245599A (en) A kind of intelligent three-dimensional weld seam Auto-searching track method
US20220342426A1 (en) Map building method, self-moving device, and automatic working system
JP4665857B2 (en) Mobile body capable of guiding arm and method for guiding arm
US20150163993A1 (en) Autonomous gardening vehicle with camera
CN113296495B (en) Path forming method and device of self-mobile equipment and automatic working system
CN111328017B (en) Map transmission method and device
WO2021253698A1 (en) Robot walking control method and system, robot, and storage medium
CN108490932A (en) A kind of control method of grass-removing robot and automatically control mowing system
CN113031616B (en) Cleaning robot return path planning method and system and cleaning robot
CN114721385A (en) Virtual boundary establishing method and device, intelligent terminal and computer storage medium
CN114937258A (en) Control method for mowing robot, and computer storage medium
CN111700553A (en) Obstacle avoidance method, device, robot and storage medium
WO2023050545A1 (en) Outdoor automatic operation control system and method based on machine vision, and device
WO2021208352A1 (en) Traversal method and system, robot and readable storage medium
CN109213154A (en) One kind being based on Slam localization method, device, electronic equipment and computer storage medium
CN109782771A (en) A kind of orchard mobile robot and edge of a field forward method
CN114610035A (en) Pile returning method and device and mowing robot
WO2022088313A1 (en) Method and system for robot automatic charging, robot, and storage medium
EP4328698A1 (en) Self-moving device, moving trajectory adjusting method, and computer-readable storage medium
WO2019109228A1 (en) Visual relocation-based method and apparatus for sweeper to continue sweeping after power-off, and sweeper
CN113126613B (en) Intelligent mowing system and autonomous image building method thereof
CN110411452A (en) A kind of farmland spray machine device people's navigation path identification method based on binocular vision

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20941315

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20941315

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 20941315

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28/06/2023)