WO2020147159A1

WO2020147159A1 - Mowing robot and mowing region division method thereof, control device, and storage medium

Info

Publication number: WO2020147159A1
Application number: PCT/CN2019/075140
Authority: WO
Inventors: 杜莅兴; 杜波
Original assignee: 傲基科技股份有限公司
Priority date: 2019-01-14
Filing date: 2019-02-15
Publication date: 2020-07-23
Also published as: CN109491397B; CN109491397A

Abstract

Disclosed is a mowing region division method, comprising: acquiring a location feature parameter of a mowing robot; acquiring, according to the location feature parameter, an actual image of a lawn within a region in which the mowing robot is located; displaying the actual image, and acquiring user feedback information returned on the basis of the actual image; and determining, according to the user feedback information, a target region to be mowed by the mowing robot. Also disclosed are a mowing robot, a control device, and a readable storage medium. The present invention aims to improve region division efficiency of a mowing robot, such that various lawn patterns can be provided within a certain region according to different cutting requirements of a user, satisfying various lawn mowing requirements.

Description

Lawn mowing robot and method for delimiting mowing area, control device and storage medium The

Technical field

This application relates to the field of automation equipment, in particular to a method for delimiting a mowing area, a mowing robot, a control device and a readable storage medium

Background technique

With the development of science and technology, automation equipment has penetrated into human life and production. In areas such as parks, golf courses, residential quarters, or villas, there are usually large lawns for aesthetics. In order to improve the efficiency of lawn mowing, there are currently lawn mowers that do not require human control.

At present, the mowing area of the lawn mower robot is determined, generally by manually burying the boundary line, and the area surrounded by the boundary line is used as the mowing area where the lawn mower robot runs. However, this method is inefficient and restricts the flexible use of the lawn mower robot according to different cutting and shearing needs.

Application content

The present application provides a method for delimiting a mowing area, which can improve the area delineation efficiency of a lawn mower robot, and customize the delineation of the mowing area according to the different cutting needs of users, so as to meet the diversified cutting needs.

In order to achieve the above objective, the present application provides a method for delimiting a mowing area. The method for delimiting a mowing area includes the following steps: acquiring position characteristic parameters of a lawn mower robot; acquiring the lawn mower robot according to the position characteristic parameters A field image of the lawn in the area; display the field image, and obtain user feedback information returned based on the field image; determine the target area of the lawn mower robot to mow according to the user feedback information.

Optionally, the location feature parameter includes satellite positioning information, and the step of obtaining a field image of the lawn in the area where the lawn mower robot is located according to the location feature parameter includes: obtaining a satellite map corresponding to the satellite positioning information; As a field image of the lawn in the area where the lawn mower robot is located.

Optionally, the step of determining the target area for mowing by the lawn mower robot according to the user feedback information includes: determining the initial target area for mowing by the lawn mower robot according to the user feedback information, as the first area Acquire the first control instruction input by the user; control the motion of the lawn mower robot according to the first control instruction, and acquire the first motion trajectory of the lawn mower robot; generate a second area according to the first motion trajectory; Compare the area characteristic parameters of the first area and the second area; when the area characteristic parameters meet a preset condition, use the first area as the target area.

Optionally, the regional feature parameters may specifically include regional location feature points, region area, and region shape, and the step of comparing the regional feature parameters of the first region and the second region includes: determining the value of the first region The area difference between the area area and the area area of the second area, determine the similarity between the area shape of the first area and the area shape of the second area, and determine the location feature points of the first area and the The first distance between the location feature points of the second area; and, when the area feature parameters meet a preset condition, the step of using the first area as the target area includes: when the area is different Is less than or equal to the preset area difference threshold, and the similarity is greater than or equal to the preset similarity threshold, and the first distance is less than or equal to the first preset distance threshold, it is determined that the regional feature parameters meet the preset A condition is set, and the first area is used as the target area.

Optionally, the step of determining the initial target area for mowing by the lawn mower robot according to the user feedback information includes: extracting area boundary identification information in the user feedback information; and generating the area boundary identification information according to the area boundary identification information. The initial target area.

Optionally, the area boundary identification information includes cutting area boundary identification information and obstacle area boundary identification information, and the step of generating the initial target area according to the area boundary identification information includes: according to the cutting area boundary The identification information generates a user-selected mowing area, and an obstacle marked area is generated based on the obstacle area boundary identification information; the initial target area is determined according to the user-selected mowing area and the obstacle marked area.

Optionally, when the border identification information of the mowing area is a graph, the step of generating a user-selected mowing area according to the border identification information of the mowing area includes: determining whether the graph is enclosed to form a closed area Area; if the graph is not enclosed to form a closed area, when the graph is a line, determine the second distance between the two end points of the graph; when the second distance is less than or equal to the first 2. When the distance threshold is preset, a line segment is used to connect the two end points, and a closed area enclosed by the line segment and the graph line is used as the user-selected mowing area.

Optionally, before the step of displaying the field image and obtaining user feedback information returned based on the field image, the method further includes: judging whether the image quality of the field image meets a preset requirement; if so, executing The step of displaying the field image and obtaining user feedback information returned based on the field image; if not satisfied, obtaining a second control instruction input by the user; controlling the lawn mower robot according to the second control instruction Move, and obtain a second motion trajectory of the lawn mower robot; determine the target area according to the second motion trajectory.

Optionally, the step of controlling the motion of the lawn mower robot according to the second control instruction and acquiring the second motion track of the lawn mower robot includes: controlling the lawn mower robot to move in the lawn according to the second control instruction , Simultaneously controlling the image acquisition device on the lawn mower robot to obtain environmental image information; and the step of determining the target area according to the second motion track includes: constructing the lawn mower robot according to the environmental image information Fitting the second movement trajectory to the movement map; Use the closed area enclosed by the second movement trajectory in the movement map as the target area.

Optionally, after the step of displaying the field image and obtaining user feedback information returned based on the field image, the method further includes: obtaining the current trajectory generation mode of the lawn mower robot; when the lawn mower robot is currently When the trajectory generation mode is in the first mode, extract the user-specified path in the user feedback information; determine the driving path of the lawn mower robot according to the user-specified path; when the current trajectory generation mode of the lawn mower is In the second mode, the step of determining the target area of the lawn mower robot for mowing according to the user feedback information is executed; and the driving path of the lawn mower robot is generated in the target area according to a preset rule.

In addition, in order to achieve the above object, the present application also provides a lawn mower robot, the lawn mower robot includes: a control device, the control device includes: a memory, a processor, and stored in the memory and can be used in the processing A program for delimiting a mowing area running on the processor, which implements the steps of the method for delimiting a mowing area as described above when the program is executed by the processor; The mowing operation is performed in the target area determined by the control device.

In addition, the present application also provides a control device. The control device includes a memory, a processor, and a mowing area delimiting program stored on the memory and running on the processor, and the mowing area When the delimiting program is executed by the processor, the steps of the method for delimiting the mowing area as described above are realized.

In addition, the present application also provides a readable storage medium, the readable storage medium stores a mowing area delimiting program, and when the mowing area delimiting program is executed by a processor, the mowing area as described above is realized Delimit the steps of the method.

The method for delimiting the mowing area proposed by the embodiment of the application obtains the field image of the lawn in the area through the position feature parameters of the mowing robot, and displays the field image. After the user sees the field image, the user can follow the cutting The cutting demand input command specifies the mowing area and/or the non-mowing area in the lawn, and obtains the user's instructions based on the field image input to form user feedback information. According to the user feedback information, the target area of the lawn mower robot is determined. This process does not require Manually laying the boundary can make the determined target area of mowing meet the user's cutting and shearing needs, improve the area delineation efficiency of the lawn mower robot, and users can customize the virtual mowing area according to different cutting needs. Maximize the user's creative space, so that the lawn mower robot can flexibly adapt to diverse cutting needs and create lawn images with different patterns.

BRIEF DESCRIPTION

FIG. 1 is a schematic diagram of the hardware structure of the mowing robot according to an embodiment of the present application;

2 is a schematic diagram of the hardware structure of the control device in an embodiment of the application;

3 is a schematic diagram of the first process of an embodiment of a method for delimiting a mowing area according to this application;

4 is a schematic diagram of a second process of an embodiment of a method for delimiting a mowing area according to this application;

5 is a schematic diagram of the third process of an embodiment of a method for delimiting a mowing area according to this application;

6 is a schematic diagram of a fourth process of an embodiment of a method for delimiting a mowing area according to this application;

FIG. 7 is a schematic diagram of a fifth process of an embodiment of a method for delimiting a mowing area according to this application;

FIG. 8 is a schematic diagram of the sixth process of an embodiment of a method for delimiting a mowing area according to this application.

detailed description

It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application. Without further restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, or system that includes the element. The serial numbers of the embodiments of this application are for description only, and do not represent the superiority of the embodiments.

The main solution of the embodiment of the present application is: obtain the position feature parameters of the lawn mower robot; obtain the field image of the lawn in the area where the lawn mower robot is located according to the position feature parameters; display the field image, and obtain user feedback information returned based on the field image; Determine the target area of the lawn mower robot according to the user feedback information. Due to the prior art, the cutting boundary of the lawn mower robot is defined by manually burying the boundary line. This method is inefficient, has a high failure rate, is easy to damage, is difficult to repair and find the fault point, and restricts the lawn mower robot according to different The cutting shears require flexible use. This application provides a solution. In this process, there is no need to manually lay the boundary. The required boundary graphics and working lines in the domain are made through the mobile phone APP or computer table, and sent to the robot, so that the determined target area for mowing can satisfy the user The cutting and shearing needs of the lawn mower, improve the efficiency of the area delineation of the lawn mower robot, reduce many hardware facilities (such as embedding, location marking points, etc.), reduce the probability of failure, save the user’s initial installation trouble and worry, and the user can be based on different The cutting and shearing requirements are customized to delineate the virtual cutting area to maximize the user's creative space, so that the lawn mower robot can flexibly adapt to the diverse cutting and cutting needs.

This application proposes a lawn mower robot. The mowing robot is an automated device that automatically cuts the grass in the target area in the lawn without manual control. In the embodiment of the present application, referring to FIG. 1, the mowing robot may specifically include: a mowing device 100, a control device 200, a positioning device 300, an image acquisition device 400, a driving device 500, and the like. Wherein, the mowing device 100 is connected to the control device 200, and is used for cutting grass in the target area determined by the control device 200 when it is turned on.

The positioning device 300 can be connected to the control device 200, the global positioning system (GPS) or the Beidou satellite navigation system (BDS), and the positioning module in the charging pile, respectively. The control device 200 can obtain the position characteristic parameters of the position of the lawn mower robot from the positioning device 300, and the control device 200 can determine the target area of the lawn mower robot to cut the grass according to the obtained position characteristic parameters. Charging piles are generally located on the border of the lawn or in the vicinity of the lawn, and the positioning module can also be connected to the global positioning system or Beidou satellite navigation system. The position characteristic parameter of the positioning module in the charging pile is used as the zero point to establish a reference coordinate system, and the current position of the lawn mower robot can be determined by comparing the position characteristic parameter of the positioning device 300 with the position characteristic parameter of the positioning module. The boundary of the target area determined in the control device 200 can determine the corresponding coordinates in the reference coordinate system, and limit the operation of the lawn mower robot according to the determined coordinates, so that the current position of the lawn mower robot when mowing does not exceed the boundary of the target area . The driving device 500 is connected with the control device 200 and is used to realize the movement and stop of the lawn mower robot. The image acquisition device 400 is connected to the control device 200 and is used to capture images of the surrounding scene when the lawnmower robot moves.

2, the control device 200 may include: a processor 2001 (such as a CPU), a memory 2002 and the like. The processor 2001 is connected to the memory 2002. The memory 2002 is either a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage. Optionally, the memory 2002 may also be a storage device independent of the aforementioned processor 2001. The control device 200 can be connected to the mowing device 100, the positioning device 300, the image acquisition device 400, the driving device 500, etc., respectively. The control device 200 can obtain required information from the positioning device 300 and the image acquisition device 400, and control the operation of the mowing device 100 and the driving device 500 according to the determined target area. In addition, the control device 200 is also connected to human-computer interaction equipment (such as computers, mobile phones, etc.). The control device 200 can transmit the field image of the lawn in the area where the lawn mower robot is located to the human-computer interaction equipment, and obtain the human-computer interaction equipment based on the field User feedback information returned by the image.

Those skilled in the art can understand that the device structure shown in FIG. 2 does not constitute a limitation on the device, and may include more or fewer components than shown in the figure, or a combination of certain components, or different component arrangements. The control device 200 may be a functional module built into the lawnmower robot; it may also be a remote control device set independently of the lawnmower robot, and is connected to the lawnmower robot through a wireless communication module. As a computer storage medium, the memory 2002 may include a mowing area delimiting program. In the control device 200, the processor 2001 can be used to call the mowing area delineation program stored in the memory 2002, and execute the following steps of the mowing area delineation method.

The embodiment of the present application also provides a method for delimiting the mowing area. 3, in an embodiment of the method for delimiting the mowing area of the present application, the method for delimiting the mowing area includes: The

Step S10: Obtain the position characteristic parameters of the lawn mower robot. The location feature parameter is a parameter that characterizes the location of the lawn mower robot, which may specifically include satellite positioning information, and may also include coordinate information of the lawn mower robot in a reference coordinate system. Among them, the reference coordinate system can be set in a coordinate system pre-established by the origin of the charging pile located near the lawn or lawn. Wherein, before step S10, the user can place the lawn mower robot in or near the lawn to be cut. When the target area of the lawnmower robot needs to be customized, the user can log in to the preset application associated with the lawnmower robot through a terminal such as a mobile phone or computer, and send instructions through the preset application to make the lawnmower robot enter the delineation mode of the lawnmower area. When the control device 200 detects that the current mode of the mowing robot is the mowing area delineation mode, step S10 is executed.

Step S20: Obtain a field image of the lawn in the area where the lawn mower robot is located according to the position feature parameters. Specifically, when the location feature parameter may include satellite positioning information, step S20 may include: step S21, acquiring a satellite map corresponding to the satellite positioning information as a field image of the lawn in the area where the lawnmower robot is located. The satellite positioning information may specifically be the longitude information and latitude information of the location of the lawn mower robot. The satellite positioning information of the lawn mower robot can be sent to the satellite map supply terminal (such as Google Earth, etc.) to obtain the satellite map corresponding to the satellite positioning information. The obtained satellite map includes the lawn image in the area where the lawn mower robot is located, and It can include an image of the environment around the lawn. It is directly used as a field image of the lawn in the area where the lawn mower robot is located. In addition, the field image of the lawn in the area where the lawn mower robot is located can also be captured by other image capture devices 400 (such as an aircraft with image capture function) independent of the lawn mower robot. Among them, the position of the lawn mower robot and the shooting range of the image acquisition device 400 can be fitted to a pre-established reference coordinate system. After the coordinates of the lawn mower robot in the reference coordinate system are obtained, the shooting of the image acquisition device 400 can be adjusted. The range is such that the coordinates of the lawn mower robot are located in the area corresponding to the reference coordinate system, and the image collected by the image acquisition device 400 is used as the field image of the lawn in the area where the lawn mower robot is located.

Step S30, displaying a real image, and obtaining user feedback information based on the real image. Send field images to human-computer interaction devices (such as computers, mobile phones, etc.) installed with preset applications, and control the preset applications to display field images. After viewing the field image in the preset application of the human-computer interaction device, the user judges whether the field image includes the image area corresponding to the specified mowing range, if not, or the image area of the specified mowing range specified by the user Only part of it is located in the field image. In order to better meet the user's customization needs, the user can input the position correction parameters in the preset application, determine the target position parameters according to the position feature parameters and the position correction parameters, and retrieve the location of the lawn mower according to the target position parameters The field image of the lawn in the area is displayed. If the displayed field image includes the image area corresponding to the mowing range that the user needs to specify, the user can select a part of the lawn image in the field image and specify the characteristics of the selected area through the preset application input command. It is assumed that the application can generate user feedback information according to the user's input instruction and send it to the control device 200 after receiving the user's input instruction. Specifically, the characteristics of the selected area may include a user-selected mowing area or a user-selected non-mowing area. When the user needs to cut a certain area of the lawn, he can input different instructions according to the area characteristics of the mowing area and the non-mowing area in the cutting requirements, such as when the lawn in the field image needs to be cut When the area is relatively concentrated or the shape is smaller than the area that does not need to be cut, the user can select the image area corresponding to this part of the field image as the user selected mowing area through the preset application input instruction; When there is only a small part of the lawn in the image that does not need to be cut, the user can also input instructions through the preset application to select other image areas other than the image area corresponding to this part of the field image as the user-selected non-mowing area ; In addition, when a certain part of the lawn in the field image needs to be cut and there are obstacles in this part of the area, the user can select the image area corresponding to the part of the field in the field image as the user's selection through the preset application input instructions In the mowing area, at the same time, the image area corresponding to the obstacle in the mowing area selected by the user can be formed by the preset application input instruction to form an obstacle marking area as the user-selected non-mowing area.

Step S40: Determine the target area of the lawn mower robot for mowing according to the user feedback information. Extract the user-selected mowing area and/or the user-selected non-mowing area in the user feedback information, and determine the mowing robot based on the user-selected mowing area and/or the user-selected non-mowing area in the extracted field image The target area for mowing. Specifically, the mowing area selected by the user can be used as the target area, or the lawn area in the field image other than the non-mowing area selected by the user can be used as the target area. When the non-mowing areas overlap, the area other than the non-mowing area selected by the user is taken as the target area. After determining the target area, you can determine the boundary of the target area in the reference coordinate system according to the distance between the points on the boundary of the target area and the lawn mower robot and the coordinates of the lawn mower robot in the reference coordinate system. Series boundary coordinate points. In the area enclosed by the boundary coordinate points, the running trajectory of the lawnmower robot can be generated according to preset rules, and the lawnmower robot can be controlled to mow the grass according to the generated running trajectory. In addition, the boundary coordinate points can also be directly restricted to the operating range of the lawn mower robot during the mowing process to ensure that the current coordinates in the reference coordinate system during the operation of the lawn mower robot do not exceed the area enclosed by the boundary coordinate points. The user can also specify the mowing height of the target area through the preset application. Different target areas can correspond to different mowing heights. Analyze the mowing height corresponding to the target area in the user feedback information, and after determining the target area, control the mowing robot to perform mowing operations along the running track generated in the target area according to the corresponding mowing height.

In the method for delimiting the mowing area proposed in this embodiment, the field image of the lawn in the area where the mowing robot is located is obtained through the position feature parameters of the mowing robot, and the field image is displayed. After the user sees the field image, The cutting demand input command specifies the mowing area and/or the non-mowing area in the lawn, and obtains the user's instructions based on the field image input to form user feedback information. According to the user feedback information, determines the target area of the lawn mower robot to cut the grass. This process Without manual laying of boundaries, the determined mowing target area can meet the user's cutting and shearing needs, improve the area delineation efficiency of the lawn mower robot, and users can customize the virtual mowing area according to different cutting needs , To maximize the user's creative space, so that the lawn mower robot can flexibly adapt to diverse cutting needs. Among them, the location feature parameter may preferably be satellite positioning information, so that the field image of the lawn in the area where the lawn mower robot is located can be obtained without additional configuration of other image acquisition equipment.

Further, step S40 may include:

Step S41: Determine the initial target area for mowing by the lawn mower robot according to the user feedback information, as the first area; extract the user-selected mowing area and/or the user-selected non-mowing area in the user feedback information, according to the extracted In the field image, the user-selected mowing area and/or the user-selected non-mowing area determines the first area where the lawnmower robot cuts the grass. Specifically, the mowing area selected by the user can be used as the first area, or the lawn area in the field image other than the non-mowing area selected by the user can be used as the first area. When the selected non-mowing areas overlap, the area of the user-selected cutting grass area excluding the user-selected non-mowing area is taken as the first area.

After the first area is obtained, the preset application mowing robot can be controlled to enter the area verification mode. In the area verification mode, the first area will be used as the mowing target area of the lawn mower robot only when the first area is verified. If the first region fails the verification, a prompt message can be sent to the user through a preset application to ensure the accuracy of the determined target region.

Step S42: Obtain the first control instruction input by the user; in the area verification mode, the user can input the first control instruction through the preset application to control the movement of the lawn mower robot along the boundary of the mowing area required by the user. The first control instruction may specifically include instructions such as forward, backward, turn left, turn right, stop, etc. It should be noted that in the area verification mode, the mowing device 100 of the mowing robot is in a closed state and will not mowing.

Step S43: Control the motion of the lawn mower robot according to the first control instruction, and obtain the first motion track of the lawn mower robot; the control device 200 controls the lawn mower robot to move in the lawn according to the first control instruction. During the process of the lawn mower robot running according to the first control instruction, the position characteristic parameters of the lawn mower robot are continuously acquired to obtain the first motion trajectory of the lawn mower robot.

Step S44: Generate a second area according to the first motion trajectory; the first motion trajectory of the lawn mower robot is based on the area enclosed by the coordinate system of the global positioning system or the first motion trajectory of the lawn mower robot is fitted to the reference coordinate system The area enclosed by the middle can be used as the second area.

Step S45: Compare the area feature parameters of the first area and the second area; it should be noted that the area feature parameters of the first area and the second area should be fitted in the same reference system for comparison, just like comparing in a reference coordinate system Or compare the area characteristic parameters of the first area and the second area in the coordinate system corresponding to the global positioning system. The regional feature parameters may specifically include regional location feature points, regional area, and/or regional shape. The step of comparing the area characteristic parameters of the first area and the second area may specifically include: determining the area difference between the area of the first area and the area of the second area, and/or determining the area shape of the first area and the second area. The similarity of the area shape of the area, and/or the first distance between the location feature point of the first area and the location feature point of the second area, etc. are determined.

Among them, the location feature points can be selected according to actual needs. For example, the midpoints of the first area and the second area can be identified respectively as the location feature points, and the two points that are adjacent and farthest from each other on the same straight line as the boundary of the first area and the second area Location feature points.

Step S46: When the area characteristic parameters meet the preset condition, the first area is taken as the target area. Specifically, when the area difference is less than or equal to the preset area difference threshold, and/or, when the similarity is greater than or equal to the preset similarity threshold, and/or, when the first distance is less than or equal to the first preset distance threshold When it is determined that the area characteristic parameters meet the preset conditions, the first area is taken as the target area.

In this embodiment, after determining the initial target area to obtain the first area according to the user feedback information, the user can issue the first control instruction to form the second area according to the boundary of the target area that he needs to cut and cut, and compare the first area Verifies whether the first area matches the user’s actual mowing needs with the area feature parameters of the second area. When the area feature parameters meet the preset conditions, it indicates that the first area matches the user’s actual mowing needs. An area is used as the target area of the lawn mower robot to cut grass, so as to ensure the accuracy of the delineated target area. Among them, the regional feature parameters may preferably include regional location feature points, regional area, and regional shape. Only when the regional location feature points, regional area, and regional shape of the first region and the second region meet corresponding preset conditions, the The first area serves as the target area; when at least one of the location feature points, area area, and area shape of the first area and the second area does not meet the corresponding preset conditions, a prompt message is issued to the user to remind the user to re-based The image area is selected, thereby further improving the accuracy of the delineated target area.

Specifically, step S41 includes: step S411, extracting the area boundary identification information in the user feedback information. When the user selects a region based on the displayed image, the user can input control instructions through a preset application to form region boundary identification information. The area boundary identification information may specifically include the types of points, lines or borders marked by the user based on the real image along the selected area boundary interval. Therefore, user feedback information may include area boundary identification information. Selected areas with different area characteristics correspond to different area boundary identification information. For example, the user-selected mowing area corresponds to the first area boundary identification information, and the user-selected non-mowing area corresponds to the second area boundary identification information. Therefore, the user feedback information may also include area boundary identification information of different area characteristics. Step S412, generating an initial target area according to the area boundary identification information. When the area identification information is the area boundary identification information corresponding to the mowing area selected by the user, a closed area is generated according to the area boundary identification information as the initial target area; when the area identification information is the area boundary corresponding to the non-mowing area selected by the user When identifying information, a closed area is generated by fitting the area boundary identification information, and the area outside the closed area in the real image is taken as the initial target area. If the user feedback information includes the area boundary identification information of different area characteristics (for example, it includes the area boundary identification information corresponding to the user-selected mowing area and the user-selected non-mowing area at the same time), the area boundary identification can be corresponding to the different area characteristics. The enclosed area corresponding to the information generation, and the initial target area is determined according to the generated enclosed area. Through the above method, the user can directly define the required mowing range in the field image to generate the corresponding area boundary identification information, and extract the area boundary identification information in the user feedback information to determine the initial target area. The realization of the target area can be based on user needs Flexible delineation.

Specifically, referring to FIG. 5, the area boundary identification information includes mowing area boundary identification information and obstacle area boundary identification information, and the step of generating an initial target area according to the area boundary identification information includes:

In step S4121, the user-selected mowing area is generated according to the edge identification information of the mowing area, and the obstacle marking area is generated according to the edge identification information of the obstacle area. Generate a corresponding closed area according to the information on the boundary of the mowing area, smooth the boundary of the generated closed area to form a user-selected mowing area; generate the corresponding closed area according to the boundary identification information of the obstacle area, and convert the generated closed area Perform processing such as smoothing the border to form an obstacle marking area. The boundary identification information of the mowing area and the boundary identification information of the obstacle area may be points, lines or borders marked at intervals along the boundary of the area. In addition, the border identification information of the mowing area and the border identification information of the obstacle area can be set to different types according to actual conditions. For example, the border identification information of the mowing area can be a marking point, and the border identification information of the obstacle area can be a graph.

Step S4122: Determine the initial target area according to the mowing area selected by the user and the obstacle marking area. Among them, the overlap area between the obstacle mark area and the mowing area selected by the user may be determined, and the area other than the overlap area selected by the user may be used as the initial target area.

Through the above method, the user can intuitively judge and mark the obstacles in the lawn through the field images. On the one hand, it can ensure the accuracy of the determined initial target area, thereby improving the accuracy of the subsequent path planning of the lawn mower robot; In terms of improving the accuracy of the obstacle recognition of the lawnmower robot, it ensures the stable operation of the lawnmower robot.

Specifically, referring to FIG. 6, when the border identification information of the mowing area is a graph line, step S4121 includes: step S401, judging whether the graph line is enclosed to form a closed area; if the closed area is not enclosed, step S402 and step S403 are executed ; If the enclosed area is enclosed, step S404 is executed. Step S402, when the graph is a line, determine the second distance between the two end points of the graph; when the graph is a line, the two end points of the graph can be identified and the first distance between the two end points can be calculated. Two distance. Step S403: When the second distance is less than or equal to the second preset distance threshold, a line segment is used to connect the two endpoints, and the closed area enclosed by the line segment and the graph line is used as the user-selected mowing area. In step S404, the closed area enclosed by the graph line is used as the mowing area selected by the user.

The second preset threshold can be set according to actual needs. When the graph line is a line but does not enclose a closed area, it indicates that when the user delineates the area on the field image, it may be due to operational deviation or other influences that the input information of the boundary identification of the mowing area cannot be formed to completely conform to the cutting requirements Enclosed area. Therefore, it is necessary to determine whether the second distance is less than or equal to the second preset distance threshold. If the second distance is less than or equal to the second preset distance threshold, it can be considered that the area shape of the closed area formed by connecting the two end points by a line segment can satisfy According to the user’s cutting requirements, the enclosed area enclosed by the line segment and the graph line can be used as the user’s selected mowing area; if the second distance is greater than the second preset distance threshold, it can be considered that even if a line segment is used to connect the two lines of the graph line At the end point, the shape of the obtained closed area is quite different from the shape of the mowing area required by the user. At this time, a prompt message can be issued to prompt the user to re-enter the instruction to define the area. Through the above method, the accuracy of the final target area is guaranteed. If the graph is multiple lines, a prompt message can be issued to prompt the user to re-enter the instruction to delimit the area, and the third distance between the end points of two adjacent lines can also be determined. If all the third distances in the multiple lines are less than Or equal to the second preset distance threshold, a line segment can be used to connect the end points of two adjacent lines end to end, and the enclosed area formed by the enclosed area is used as the user-selected mowing area. In addition, when the type of the boundary identification information of the obstacle area is a graph, the obstacle marking area can be determined by analogy with reference to S401 to step S404, which is not repeated here.

Referring to FIG. 7, before step S30, it also includes: step S01, judging whether the image quality of the field image meets the preset requirements; if it meets, then execute step S30, step S40; if not, execute step S02, step S03, step S04 . Specifically, it can be judged whether the sharpness of the field image meets the preset sharpness requirement, if it is satisfied, then step S30 and step S40 are executed; if not, step S02, step S03, and step S04 are executed.

Step S02: Obtain the second control instruction input by the user; when the image quality of the field image does not meet the preset requirements, the lawnmower robot can be controlled to enter the manual debugging area mode, in which the second control instruction and cutting input by the user The information collected by the grass robot generates the target area. Specifically, the user can input the second control instruction through the preset application to control the movement of the lawn mower robot along the boundary of the mowing area required by the user. The second control instruction may specifically include instructions such as forward, backward, turn left, turn right, stop, etc. It should be noted that in the manual debugging area mode, the mowing device 100 of the mowing robot is in the closed state and will not mowing.

Step S03: Control the movement of the lawn mower robot according to the second control instruction, and obtain the second movement track of the lawn mower robot; the control device 200 controls the movement of the lawn mower robot in the lawn according to the second control instruction, and the control device 200 can control image acquisition The device 400 acquires environmental image information. The environmental image information may specifically include the image of the object in the environment where the lawn mower robot is located and the depth information of each object. During the process of the lawn mower robot running according to the second control instruction, the position characteristic parameters of the lawn mower robot are continuously acquired to obtain the second motion trajectory of the lawn mower robot. The

Step S04: Determine the target area according to the second motion track. The second motion trajectory of the lawn mower robot is based on the area enclosed by the coordinate system of the global positioning system or the second motion trajectory of the lawn mower robot fits to the enclosed area in the reference coordinate system, which can be used as the target area. Construct a running map of the lawn mower robot according to the environmental image information, fit the second motion trajectory of the lawn mower robot to the constructed running map, and the closed area enclosed by the second motion trajectory in the running map is used as the target area. After the target area is determined, the running map and the second motion track in the running map will be displayed for the user to confirm.

Through the above method, when the image quality of the field image is not good, the target area that meets the user's mowing demand can also be delineated, and the accuracy of the delineation of the target area can be ensured.

Referring to Fig. 8, after step S30, the method further includes:

Step S60: Obtain the current trajectory generation mode of the lawn mower robot. The trajectory generation mode may specifically include a first mode and a second mode. When the lawn mower robot is in the first mode, the user can customize the travel path of the lawn mower robot; when the lawn mower robot is in the second mode, the control device 200 plans the travel path of the lawn mower robot in the target area according to preset rules. The user can switch the current trajectory generation mode of the lawn mower robot by inputting instructions through the preset application, and in the trajectory generation mode, input instructions that match the cutting and shearing requirements to generate user feedback information.

When the current trajectory generation mode of the lawn mower robot is in the first mode, steps S70 and S80 are executed: step S70, extract the user-specified path in the user feedback information; step S80, determine the travel path of the lawn mower robot according to the user-specified path. The user can generate a user-specified path in the real scene image by means of sliding operations in the human-computer interaction device, and the generated user-specified path forms user feedback information. Therefore, the control device 200 can extract the user-specified path from the user feedback information in the first mode. The path specified by the user is used as the driving path of the lawn mower robot. Specifically, the coordinate parameters of each point in the path specified by the user can be determined based on the reference coordinate system, and the driving of the lawn mower robot can be controlled according to the determined coordinate parameters, so that the lawn mower robot can run according to the path specified by the user. When the current trajectory generation mode of the lawn mower robot is in the second mode, step S40 and step S50 are executed. Step S50: Generate a driving path of the lawn mower robot in the target area according to preset rules. The preset rules can be set according to actual needs, such as generating multiple parallel paths that are set at intervals and connected end to end in the target area along the preset direction.

Through the above method, it is beneficial for users to pattern the lawn according to their needs, and further improves the flexibility of using the lawn mower robot to meet the diverse needs of users.

In addition, an embodiment of the present application also proposes a readable storage medium. The readable storage medium stores a mowing area delimitation program. When the mowing area delimitation program is executed by a processor, the mowing area delimitation in the above embodiment is realized. The relevant steps of the method.

Claims

A method for delimiting a mowing area, wherein the method for delimiting a mowing area includes the following steps:

Obtain the position characteristic parameters of the lawn mower robot;

Acquiring a field image of the lawn in the area where the lawn mower robot is located according to the position characteristic parameter;

Display the real image, and obtain user feedback information returned based on the real image; and

Determine a target area for mowing by the lawn mower robot according to the user feedback information.
The method for delimiting a mowing area according to claim 1, wherein the location feature parameter includes satellite positioning information, and the step of acquiring a field image of the lawn in the area where the mowing robot is located according to the location feature parameter includes :

Obtain a satellite map corresponding to the satellite positioning information as a field image of the lawn in the area where the lawn mower robot is located.
The method for delimiting a mowing area according to claim 1, wherein the method for delimiting a mowing area further comprises:

Obtain user instructions on the terminal where the preset application is installed;

Enter the mowing area delineation mode according to the user instruction; and

When the current mode of the lawn mower robot is the lawn mower area delineation mode, the step of acquiring the position characteristic parameters of the lawn mower robot is performed.
The method for delimiting a mowing area according to claim 3, wherein the step of displaying the field image and obtaining user feedback information returned based on the field image comprises:

Displaying the field image in the preset application;

When receiving the position correction parameter input in the preset application, determine the target position parameter according to the position characteristic parameter and the position correction parameter;

Reacquire and display the field image of the lawn in the area where the lawn mower robot is located according to the target position parameter; and

Obtain user feedback based on the redisplayed field image.
The method for delimiting a mowing area according to claim 1, wherein the step of determining a target area for mowing by the mowing robot according to the user feedback information comprises:

Determining an initial target area for mowing by the lawn mower robot according to the user feedback information, as the first area;

Acquiring the first control instruction input by the user;

Controlling the motion of the lawn mower robot according to the first control instruction, and acquiring a first motion track of the lawn mower robot;

Generating a second area according to the first motion track;

Comparing the area characteristic parameters of the first area and the second area; and

When the region characteristic parameter satisfies a preset condition, the first region is used as the target region.
The method for delimiting a mowing area according to claim 5, wherein the area feature parameters include area location feature points, and the step of comparing the area feature parameters of the first area and the second area includes:

Determining the first distance between the location feature point of the first area and the location feature point of the second area; and

The step of using the first area as the target area when the area characteristic parameters meet a preset condition includes:

When the first distance is less than or equal to a first preset distance threshold, it is determined that the region characteristic parameter meets a preset condition, and the first region is used as the target region.
The method for delimiting a mowing area according to claim 5, wherein the area characteristic parameters include area area, and the step of comparing the area characteristic parameters of the first area and the second area comprises:

Determine the area difference between the area area of the first area and the area area of the second area; and

The step of using the first area as the target area when the area characteristic parameters meet a preset condition includes:

When the area difference is less than or equal to a preset area difference threshold, it is determined that the region characteristic parameter satisfies a preset condition, and the first region is taken as the target region.
The method for delimiting a mowing area according to claim 5, wherein the area characteristic parameter includes an area shape, and the step of comparing the area characteristic parameters of the first area and the second area includes:

Determining the similarity between the area shape of the first area and the area shape of the second area; and

The step of using the first area as the target area when the area characteristic parameters meet a preset condition includes:

When the similarity is greater than or equal to a preset similarity threshold, it is determined that the region feature parameter satisfies a preset condition, and the first region is taken as the target region.
The method for delimiting a mowing area according to claim 5, wherein the area feature parameters include area location feature points, area area and area shape, and the comparison of the area feature parameters of the first area and the second area The steps include:

Determine the area difference between the area area of the first area and the area area of the second area, determine the similarity between the area shape of the first area and the area shape of the second area, and determine the first area The first distance between the location feature point of and the location feature point of the second region; and

The step of using the first area as the target area when the area characteristic parameters meet a preset condition includes:

When the area difference is less than or equal to the preset area difference threshold, and the similarity is greater than or equal to the preset similarity threshold, and the first distance is less than or equal to the first preset distance threshold, it is determined that the The region characteristic parameter meets a preset condition, and the first region is used as the target region.
5. The method for delimiting a mowing area according to claim 5, wherein the step of determining the initial target area for mowing by the mowing robot according to the user feedback information comprises:

Extracting the area boundary identification information in the user feedback information; and

The initial target area is generated according to the area boundary identification information.
The method for delimiting a mowing area according to claim 10, wherein the area boundary identification information includes mowing area boundary identification information and obstacle area boundary identification information, and the initial target is generated according to the area boundary identification information The regional steps include:

Generating a user-selected mowing area according to the border identification information of the mowing area, and generating an obstacle marking area according to the border identification information of the obstacle area; and

The initial target area is determined according to the mowing area selected by the user and the obstacle marking area.
The method for delimiting a mowing area according to claim 11, wherein the step of determining the initial target area according to the mowing area selected by the user and the obstacle marking area comprises:

Determining the overlapping area of the obstacle marking area and the user-selected mowing area; and

Taking the user-selected mowing area other than the overlapping area as the initial target area.
The method for delimiting a mowing area according to claim 11, wherein when the mowing area boundary identification information is a graph, the step of generating a user-selected mowing area according to the mowing area boundary identification information include:

Judge whether the graph line is enclosed to form a closed area;

If the graph line does not enclose to form a closed area, when the graph line is a line, determine the second distance between the two end points of the graph line; and

When the second distance is less than or equal to the second preset distance threshold, a line segment is used to connect the two end points, and the closed area enclosed by the line segment and the graph line is used as the user-selected mowing area .
The method for delimiting a mowing area according to claim 1, wherein before the step of displaying the field image and obtaining user feedback information returned based on the field image, the method further comprises:

Determine whether the image quality of the field image meets the preset requirements;

If it is satisfied, execute the step of displaying the real image and obtaining user feedback information returned based on the real image;

If it is not satisfied, acquire the second control instruction input by the user;

Control the motion of the lawn mower robot according to the second control instruction, and obtain a second motion trajectory of the lawn mower robot; and

The target area is determined according to the second movement track.
The method for delimiting a mowing area according to claim 14, wherein the step of controlling the motion of the mowing robot according to the second control instruction and obtaining the second motion trajectory of the mowing robot comprises:

Controlling the lawn mower robot to move in the lawn according to the second control instruction, and at the same time controlling the image acquisition device on the lawn mower robot to obtain environmental image information;

The step of determining the target area according to the second motion track includes:

Constructing an operation map of the lawn mower robot according to the environmental image information;

Fitting the second motion trajectory to the operating map; and

The closed area enclosed by the second motion track in the operating map is taken as the target area.
The method for delimiting a mowing area according to claim 1, wherein after the step of displaying the field image and obtaining user feedback information returned based on the field image, the method further comprises:

Acquiring the current trajectory generation mode of the lawn mower robot;

When the current trajectory generation mode of the lawn mower robot is in the first mode, extract the user-specified path in the user feedback information;

Determining the driving path of the lawn mower robot according to the user-specified path;

When the current trajectory generation mode of the lawn mower robot is in the second mode, performing the step of determining the target area of the lawn mower robot for mowing according to the user feedback information; and

The driving path of the lawn mower robot is generated in the target area according to a preset rule.
The method for delimiting a mowing area according to claim 16, wherein the method for delimiting a mowing area further comprises:

Determining the mowing height of the target area according to the user feedback information; and

The mowing robot is controlled to perform mowing operations along the travel path according to the mowing height.
A lawn mower robot, wherein the lawn mower robot includes:

A control device, the control device comprising: a memory, a processor, and a mowing area delimiting program stored on the memory and running on the processor, and the mowing area delimiting program is controlled by the processor The steps of the method for delimiting the mowing area as described below are realized during execution:

Obtain the position characteristic parameters of the lawn mower robot;

Acquiring a field image of the lawn in the area where the lawn mower robot is located according to the position characteristic parameter;

Displaying the real image, and obtaining user feedback information returned based on the real image;

Determining the target area of the lawn mower robot for mowing according to the user feedback information; and

The mowing device is used for mowing operations in the target area determined by the control device.
A control device, wherein the control device includes a memory, a processor, and a mowing area delimiting program stored on the memory and running on the processor, and the mowing area delimiting program is When the processor is executed, the steps of the method for delimiting the mowing area are implemented as follows:

Obtain the position characteristic parameters of the lawn mower robot;

Acquiring a field image of the lawn in the area where the lawn mower robot is located according to the position characteristic parameter;

Display the real image, and obtain user feedback information returned based on the real image; and

Determine a target area for mowing by the lawn mower robot according to the user feedback information.
A readable storage medium, wherein a program for delimiting a mowing area is stored on the readable storage medium, and when the program for delimiting a mowing area is executed by a processor, the method for delimiting a mowing area as described below is implemented step:

Obtain the position characteristic parameters of the lawn mower robot;

Acquiring a field image of the lawn in the area where the lawn mower robot is located according to the position characteristic parameter;

Display the real image, and obtain user feedback information returned based on the real image; and

Determine a target area for mowing by the lawn mower robot according to the user feedback information.