WO2019007038A1 - Floor sweeping robot, floor sweeping robot system and working method thereof - Google Patents

Floor sweeping robot, floor sweeping robot system and working method thereof Download PDF

Info

Publication number
WO2019007038A1
WO2019007038A1 PCT/CN2018/073868 CN2018073868W WO2019007038A1 WO 2019007038 A1 WO2019007038 A1 WO 2019007038A1 CN 2018073868 W CN2018073868 W CN 2018073868W WO 2019007038 A1 WO2019007038 A1 WO 2019007038A1
Authority
WO
WIPO (PCT)
Prior art keywords
obstacle
cleaning
information
cleaning robot
control system
Prior art date
Application number
PCT/CN2018/073868
Other languages
French (fr)
Chinese (zh)
Inventor
杨锴
丁璜
郑卓斌
Original Assignee
广东宝乐机器人股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广东宝乐机器人股份有限公司 filed Critical 广东宝乐机器人股份有限公司
Publication of WO2019007038A1 publication Critical patent/WO2019007038A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • G05D1/0251Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision
    • AHUMAN NECESSITIES
    • A47FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47LDOMESTIC WASHING OR CLEANING; SUCTION CLEANERS IN GENERAL
    • A47L11/00Machines for cleaning floors, carpets, furniture, walls, or wall coverings
    • A47L11/24Floor-sweeping machines, motor-driven
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0276Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle

Definitions

  • the invention relates to the field of indoor sweeping robots, in particular to a sweeping robot with obstacle recognition and a working method thereof.
  • the present invention provides a cleaning robot, and the specific technical solutions are as follows:
  • a sweeping robot comprising a control system, a binocular camera and an image processing system
  • the binocular camera is configured to acquire two picture information of different angles of the same obstacle at the same time;
  • the image processing system is configured to process two picture information acquired by the binocular camera and obtain obstacle information;
  • the control system performs different actions based on the obstacle information.
  • the obstacle information includes an obstacle size, an obstacle shape, and a distance between the obstacle and the cleaning robot.
  • a drive system is further included;
  • the driving system is configured to drive the cleaning robot to move in a work area
  • the control system controls the driving system to increase the driving force, so that the sweeping robot crosses the obstacle;
  • the control system controls the drive system to cause the sweeping robot to bypass the obstacle along the obstacle contour.
  • the cleaning system is used to clean the garbage and store it to the dust box;
  • the control system controls the driving system to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system to increase the cleaning power;
  • the control system controls the driving system to move the cleaning robot to the garbage; and controls the cleaning system to perform cleaning.
  • the binocular camera is an image sensor.
  • the binocular camera is relatively fixedly mounted on the front end surface of the cleaning robot and the two cameras of the binocular camera are installed at the same horizontal position.
  • the present invention also provides a cleaning robot, and the specific technical solutions are as follows:
  • a sweeping robot including a binocular camera, a wireless communication system, and a control system;
  • the binocular camera is configured to acquire two picture information of different angles of the same obstacle at the same time;
  • the wireless communication system is configured to transmit two pieces of the picture information to the outside, and is further configured to receive externally transmitted obstacle information;
  • the control system performs different actions based on the obstacle information.
  • the obstacle information includes an obstacle size, an obstacle shape, and a distance between the obstacle and the cleaning robot.
  • a drive system is further included;
  • the driving system is configured to drive the cleaning robot to move in a work area
  • the control system controls the driving system to increase the driving force, so that the sweeping robot crosses the obstacle;
  • the control system controls the drive system to cause the sweeping robot to bypass the obstacle along the obstacle contour.
  • the cleaning system is used to clean the garbage and store it to the dust box;
  • the control system controls the driving system to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system to increase the cleaning power;
  • the control system controls the driving system to move the cleaning robot to the garbage; and controls the cleaning system to perform cleaning.
  • the binocular camera is an image sensor.
  • the binocular camera is relatively fixedly mounted on the front end surface of the cleaning robot and the two cameras of the binocular camera are installed at the same horizontal position.
  • the present invention also provides an image processing terminal, and the specific technical solutions are as follows:
  • An image processing terminal comprising an image processing system and a wireless communication system
  • the wireless communication system is configured to receive two picture information transmitted externally;
  • the image processing system is configured to process two pieces of the picture information and obtain obstacle information
  • the wireless communication system is further configured to transmit the obstacle information to the outside.
  • the image processing terminal is a cloud server.
  • the present invention also provides a sweeping robot system, and the specific technical solutions are as follows:
  • a cleaning robot system comprising any of the above-described cleaning robots having a wireless communication system and the image processing terminal of any of the above.
  • the cleaning robot includes a binocular camera, a wireless communication system, and a control system;
  • the binocular camera is configured to acquire two picture information of different angles of the same obstacle at the same time;
  • the wireless communication system is configured to transmit two pieces of the picture information to the outside, and is further configured to receive externally transmitted obstacle information;
  • the control system performs different actions based on the obstacle information.
  • the cleaning robot further includes a driving system
  • the driving system is configured to drive the cleaning robot to move in a work area
  • the control system controls the driving system to increase the driving force, so that the sweeping robot crosses the obstacle;
  • control system (150) controls the drive system to cause the sweeping robot to bypass the obstacle along the obstacle contour.
  • the cleaning robot further includes a cleaning system
  • the cleaning system is used to clean the garbage and store it to the dust box;
  • the control system controls the driving system to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system to increase the cleaning power;
  • the control system controls the driving system to move the cleaning robot to the garbage; and controls the cleaning system to perform cleaning.
  • the binocular camera is relatively fixedly mounted on the front end surface of the cleaning robot and the two cameras of the binocular camera are installed at the same horizontal position.
  • the image processing terminal includes: an image processing system and a wireless communication system;
  • the wireless communication system is configured to receive two picture information transmitted externally;
  • the image processing system is configured to process two pieces of the picture information and obtain obstacle information
  • the wireless communication system is further configured to transmit the obstacle information to the outside.
  • the present invention also provides a working method of a cleaning robot, and the specific technical solutions are as follows:
  • a working method of a sweeping robot comprising:
  • Different working modes are selected based on the obstacle information.
  • the obstacle information includes an obstacle size, an obstacle shape, and a distance between the obstacle and the cleaning robot.
  • the step of acquiring two pieces of picture information of different angles of the same obstacle at the same time further includes:
  • the invention obtains obstacle information of the working environment of the sweeping robot through the binocular camera, and can acquire information such as the size of the obstacle, the shape of the obstacle, and the distance between the obstacle and the sweeping robot, so that the sweeping robot automatically judges whether it can be cleaned, whether it can be crossed, Whether it can be drilled, greatly improved the trapped situation of the sweeping robot, and improved the intelligent level and user experience of the sweeping robot.
  • FIG. 1 is a schematic structural diagram of a cleaning robot according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of a module of the cleaning robot of FIG. 1;
  • FIG. 3 is a schematic diagram of another module of a cleaning robot according to an embodiment of the present invention.
  • FIG. 4 is a schematic block diagram of an image processing terminal according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a module of a cleaning robot system according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a system for sweeping a robot according to an embodiment of the present invention.
  • FIG. 7 is a flowchart of a working method of a cleaning robot according to an embodiment of the present invention.
  • Reference numerals: 1 is a sweeping robot, 110 is a binocular camera, 120 is a driving system, 130 is a cleaning system, 140, 210 are image processing systems, 150 is a control system, 160 is a sensor system, 170 is a power system, 180, 220 is a wireless communication module, 2 is an image processing terminal, and 11, 12 are CCD cameras.
  • FIG. 1 is a schematic structural diagram of a cleaning robot according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a module of the cleaning robot in FIG.
  • the cleaning robot 1 in this embodiment includes a control system 150, a driving system 120, a cleaning system 130, a sensor system 160, a power supply system 170, and a binocular camera 110 (the binocular camera 110 is an image sensor, which includes a left CCD in this embodiment). Camera 11, right CCD camera 12) and image processing system 140.
  • the CCD charge coupled device
  • CMOS Complementary Metal Oxide Semiconductor
  • the control system 150 includes an MCU or a single chip microcomputer (in this embodiment, an MCU with a memory) storing a working program of the cleaning robot 1, the control system 150 performing different actions according to the obstacle information; that is, according to the sensor system 160 or image processing
  • the obstacle information returned by the system 140 controls the driving system 120 and the cleaning system 130 to operate;
  • the binocular camera 110 is used to acquire two picture information of different angles of the same obstacle at the same time;
  • the image processing system 140 is used for the binocular camera 110
  • the acquired two pieces of picture information are processed to obtain obstacle information;
  • the driving system 120 includes left and right driving wheels for driving the cleaning robot 1 to move in the working area;
  • the cleaning system 130 includes a middle sweeping, vacuuming device, side sweeping and dust box For cleaning the ground garbage and storing it to the dust box;
  • the sensor system 160 includes a ground inspection and a wall inspection for respectively detecting a surface area difference and surrounding obstacles (including walls);
  • the power system 170 is used for each of the cleaning
  • the obstacle information includes the size of the obstacle, the shape of the obstacle, and the distance between the obstacle and the cleaning robot 1
  • the binocular camera 110 includes a left CCD camera 11 and a right CCD camera 12, and the left and right cameras are relatively fixedly mounted on the front side of the main body of the cleaning robot 1, and the left CCD camera 11 and the right CCD camera 12 are substantially on the same horizontal plane (with the calibration model algorithm)
  • the Opencv needs to ensure that the optical axes of the dual cameras are parallel in the physical structure.
  • the cameras respectively acquire the horizontal range of the forward direction from 150° to 180° and the vertical direction from 90° to 120°. Two pictures of different angles of the obstacle.
  • the left CCD camera 11 and the right CCD camera 12 of the binocular camera 110 perform stereo calibration before the cleaning robot 1 is shipped from the factory, and the rotation matrix R and the translation matrix t between the left CCD camera 11 and the right CCD camera 12 can be obtained by Zhang Zhengyou calibration method. Got it.
  • the binocular camera 110 can be an image sensor.
  • the process of identifying the distance and size of the obstacle is as follows:
  • This embodiment is based on the Opencv platform and uses the SGBM algorithm provided by Opencv for matching calculation.
  • the left and right CCD cameras are stereo-matched at the same time, then the original image is binarized, Gaussian blur, canny operator contour detection, the obstacle contour is found, and the obstacle is completely framed by the minimum quadrilateral.
  • the coordinates of the four vertices of the quadrilateral obtain the pixel size of the obstacle; the pixel coordinates of the center point of the object are obtained by calculating the coordinates of the four vertices of the quadrilateral, and the distance between the center point of the obstacle and the camera is obtained by the binocular ranging principle.
  • the width and height of the obstacle are calculated to measure the size of the obstacle.
  • the program stored by the controller is associated with common static objects (such as furniture, home appliances or thresholds) and dynamic objects (such as people or pets) in the indoor environment, that is, each of the indoor environments.
  • Objects are associated with corresponding work patterns and perform different actions when different obstacles are identified, such as when identifying objects with lower heights such as thresholds, slippers, or cables (by setting a height threshold, such as
  • the current climbing height of the sweeping robot 1 is about 2 cm. When the obstacle height is greater than 2 cm, the obstacle is marked as non-cross-domain. When the sweeping robot 1 moves to the vicinity of the obstacle, the obstacle is no longer carried out.
  • the driving force of the driving system 120 is increased and the crossing action is performed; when the obstacle is recognized as the felt, the crossing operation is performed while increasing the cleaning system 130
  • the driving force of the suction and driving system 120 when the obstacle is identified as garbage, the cleaning robot 1 drives to the garbage and cleans; the obstacle is recognized as the height of the person or the refrigerator Higher object, the cleaning robot 1 performs avoidance operation or the like. This setting makes the cleaning robot 1 work smarter and improves the user experience.
  • FIG. 3 is a schematic diagram of another module of a cleaning robot according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of a module of an image processing terminal according to an embodiment of the present invention
  • a schematic diagram of a module of a cleaning robot system is provided.
  • FIG. 6 is a schematic structural diagram of a system for sweeping a robot according to an embodiment of the present invention.
  • the cleaning robot 1 in this embodiment includes a control system 150, a driving system 120, a cleaning system 130, a sensor system 160, a power supply system 170, and a binocular camera 110.
  • the binocular camera 110 is an image sensor.
  • the example includes a left CCD camera 11, a right CCD camera 12), and a wireless communication system.
  • the CCD charcode coupled device, ie, charge coupled device
  • CMOS Complementary Metal Oxide Semiconductor
  • the cleaning robot 1 in this embodiment is basically the same as that in the first embodiment, and the difference is that: A, the cleaning robot 1 in this embodiment does not have the image processing system 140; B, the cleaning robot 1 in this embodiment will double
  • the two picture information acquired by the camera 110 are sent to the image processing terminal 2 through the wireless communication module 180 (such as a WIFI module or a Zigbee module) to process the two pieces of image information.
  • the wireless communication module 180 such as a WIFI module or a Zigbee module
  • the functions and functions of the cleaning robot 1 in the present embodiment are the same as those of the control system 150, the drive system 120, the cleaning system 130, the sensor system 160, the power supply system 170, and the binocular camera 110 of the cleaning robot 1 in the first embodiment.
  • the examples are not described in detail, and refer to Example 1 for details.
  • the wireless communication module 180 is configured to transmit the two pieces of the picture information to the outside, and is further configured to receive the externally transmitted obstacle information, and transmit the obstacle information to the control system 150, so that the control system 150 performs different actions according to the obstacle information. That is, the drive system 120 and the cleaning system 130 are controlled to operate based on the obstacle information returned by the sensor system 160 or the image processing system 210.
  • the image processing terminal 2 in this embodiment is a cloud server (other PC platform or embedded platform capable of image processing capability of the binocular camera 110), and includes an image processing system 210 and a wireless communication module 220.
  • the wireless connection network between the cloud server and the cleaning robot 1 includes a 4G, a WIFI network, and the like, and the networking mode includes an AP mode (wireless access point) or an STA mode (STA site).
  • the obstacle recognition process in this embodiment is as follows: the binocular camera 110 of the cleaning robot 1 acquires two picture information of different angles of the same obstacle at the same time, and wireless communication by the cleaning robot 1
  • the module 180 transmits the two picture information to the wireless communication module 220 of the image processing terminal 2, and the image processing system 210 of the image processing terminal 2 processes the two picture information to obtain obstacle information, and passes through the wireless communication module of the image processing terminal 2.
  • the obstacle information is transmitted to the wireless communication module 180 of the cleaning robot 1, and the control system 150 of the cleaning robot 1 controls the driving system 120 and the cleaning system 130 to operate based on the obstacle information.
  • Two of the picture information and obstacle information can be transmitted via the internet.
  • the image processing terminal is preferably a cloud server.
  • FIG. 7 is a flowchart of a working method of a cleaning robot according to an embodiment of the present invention.
  • the working method of a cleaning robot in this embodiment includes the following steps S100 to S400:
  • Step S100 Associate all obstacle information with a corresponding working mode.
  • the feature information such as the shape and color of the obstacles commonly found in the indoor environment where the cleaning robot is located is associated with the corresponding working mode, and the controller of the cleaning robot selects different working modes according to the feedback obstacle information. For example, when the garbage feature is met, the sweeping robot drives toward the obstacle and increases the suction or rolling speed of the cleaning system; when the carpet features are met, the driving force of the driving system is increased while increasing the suction or rolling speed of the cleaning system. If the water lag feature is met, the avoidance action is performed.
  • Step S200 Acquire two picture information of different angles of the same obstacle at the same time.
  • the front side of the forward direction of the sweeping robot is mounted at substantially the same height to mount the binocular camera (the left CCD camera 11 and the right CCD camera 12), and the camera captures the horizontal direction of the forward direction by 150° to 180° at the same time. Two pictures of different angles of obstacles in the vertical direction from 90° to 120°.
  • Step S300 Obtain obstacle information based on the two pieces of the picture information.
  • the image processing system may be mounted on a cleaning robot or on a cloud server.
  • Step S400 Select different working modes based on the obstacle information.
  • the control system controls the driving system to increase the driving force, so that the sweeping robot crosses the obstacle; when the obstacle information size of the obstacle information is greater than the preset In value, the control system controls the drive system to cause the sweeping robot to bypass the obstacle along the obstacle profile.
  • the sweeping robot It is also possible to judge whether or not the obstacle has a space through which the sweeping robot can pass, and if so, the sweeping robot continues to move in the original direction, otherwise the sweeping robot performs the avoidance action after moving to the vicinity of the obstacle. Specifically, it is determined whether there is a space for the cleaning robot to pass through the shape of the obstacle, and then it is judged whether the height and the width of the cover space are larger than the height and width of the cleaning robot, and the space is considered to be available under the condition that both the height and the width are satisfied at the same time. The sweeping robot passes through.
  • the control system controls the driving system to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system to increase the cleaning power;
  • the control system controls the driving system to move the cleaning robot to the garbage; and controls the cleaning system to perform cleaning.
  • the obstacle information includes the size of the obstacle, the shape of the obstacle, and the distance between the obstacle and the sweeping robot.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Remote Sensing (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
  • Manipulator (AREA)
  • Electric Vacuum Cleaner (AREA)

Abstract

A floor sweeping robot (1), comprising a control system (150), a binocular camera (110), and an image processing system (140). The binocular camera (110) is used for acquiring two pieces of picture information at different angles of a same obstacle at the same moment; the image processing system (140) is used for processing the two pieces of picture information acquired by the binocular camera (110) to obtain obstacle information; the control system (150) executes different actions according to the obstacle information, wherein the obstacle information comprises the size and shape of the obstacle, and the distance between the obstacle and the floor sweeping robot (1). In addition, also disclosed are a floor sweeping robot system and a working method of the floor sweeping robot (1).

Description

扫地机器人、扫地机器人系统及其工作方法Sweeping robot, sweeping robot system and working method thereof 技术领域Technical field
本发明涉及室内扫地机器人领域,特别是一种具备障碍物识别的扫地机器人及其工作方法。The invention relates to the field of indoor sweeping robots, in particular to a sweeping robot with obstacle recognition and a working method thereof.
背景技术Background technique
市面上的扫地机产品的障碍检测大多使用超声波、红外、机械碰撞开关(行业用语简称前档或前撞)及激光雷达等方式,或上述方式的组合;其中,机械碰撞开关只能检测障碍物的有无,而超声波、红外、激光雷达(TOF测距)的本质都是计算主动发射信号和接收回波信号之间的时间差来实现距离测量,这种方式实现的障碍物检测的探测范围有限,目标障碍物信息不完整,系统扩展性较弱,具体表现为只能测量二维工作平面到扫地机自身的距离,无法对障碍物的三维尺寸进行测量,容易出现推拉障碍物、爬上障碍物或卡在障碍物下面的情况。Most of the obstacle detection in the market for sweeping machines uses ultrasonic, infrared, mechanical collision switches (industrial terms referred to as front or front collision) and laser radar, or a combination of the above; among them, mechanical collision switches can only detect obstacles. The presence or absence of ultrasound, infrared, and laser radar (TOF ranging) is to calculate the time difference between the active transmitted signal and the received echo signal to achieve distance measurement. This method has limited detection range for obstacle detection. The target obstacle information is incomplete and the system expandability is weak. The specific performance is that only the distance from the two-dimensional work plane to the sweeper itself can be measured. It is impossible to measure the three-dimensional size of the obstacle, and it is easy to push and pull obstacles and climb obstacles. The condition of the object or stuck under the obstacle.
随着计算机硬件水平的发展和图像处理技术的进步,使得在扫地机上使用双目摄像头来识别工作区域内的障碍物成为可能。With the development of computer hardware and advances in image processing technology, it has become possible to use binocular cameras on the sweeper to identify obstacles in the work area.
发明内容Summary of the invention
为解决背景技术中的技术问题,本发明提供了一种扫地机器人,具体技术方案如下:In order to solve the technical problem in the background art, the present invention provides a cleaning robot, and the specific technical solutions are as follows:
一种扫地机器人,包括控制系统、双目摄像头和图像处理系统;A sweeping robot comprising a control system, a binocular camera and an image processing system;
所述双目摄像头用于在同一时刻获取同一障碍物的不同角度的两幅图片信息;The binocular camera is configured to acquire two picture information of different angles of the same obstacle at the same time;
所述图像处理系统用于对双目摄像头获取的两幅图片信息进行处理并得到障碍物信息;The image processing system is configured to process two picture information acquired by the binocular camera and obtain obstacle information;
所述控制系统根据障碍物信息执行不同的动作。The control system performs different actions based on the obstacle information.
进一步地,所述障碍物信息包括障碍物大小、障碍物形状以及障碍物与扫地机器人的距离。Further, the obstacle information includes an obstacle size, an obstacle shape, and a distance between the obstacle and the cleaning robot.
进一步地,还包括驱动系统;Further, a drive system is further included;
所述驱动系统用于驱动扫地机器人在工作区域运动;The driving system is configured to drive the cleaning robot to move in a work area;
当所述障碍物信息的障碍物大小不大于预设值时,所述控制系统控制驱动系统增大驱动力,使扫地机器人越过障碍物;When the obstacle size of the obstacle information is not greater than a preset value, the control system controls the driving system to increase the driving force, so that the sweeping robot crosses the obstacle;
当所述障碍物信息的障碍物大小大于预设值时,所述控制系统控制驱动系统,使扫地机器人沿障碍物轮廓绕过障碍物。When the obstacle size of the obstacle information is greater than a preset value, the control system controls the drive system to cause the sweeping robot to bypass the obstacle along the obstacle contour.
进一步地,还包括清洁系统;Further, a cleaning system is also included;
所述清洁系统用于清洁垃圾并存储至尘盒;The cleaning system is used to clean the garbage and store it to the dust box;
当基于所述障碍物信息判断当前障碍物为毛毯时,所述控制系统控制驱动系统增大驱动力,使扫地机器人越过毛毯;并控制所述清洁系统增大清洁功率;When judging that the current obstacle is a blanket based on the obstacle information, the control system controls the driving system to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system to increase the cleaning power;
当基于所述障碍物信息判断当前障碍物为垃圾时,所述所述控制系统控制驱动系统,使扫地机器人向垃圾运动;并控制所述清洁系统进行清洁。When it is determined that the current obstacle is garbage based on the obstacle information, the control system controls the driving system to move the cleaning robot to the garbage; and controls the cleaning system to perform cleaning.
进一步地,所述双目摄像头为图像传感器。Further, the binocular camera is an image sensor.
进一步地,所述双目摄像头相对固定安装在扫地机器人的前端面且双目摄像头的两个摄像头安装在同一水平位置。Further, the binocular camera is relatively fixedly mounted on the front end surface of the cleaning robot and the two cameras of the binocular camera are installed at the same horizontal position.
为解决背景技术中的技术问题,本发明还提供了一种扫地机器人,具体技术方案如下:In order to solve the technical problem in the background art, the present invention also provides a cleaning robot, and the specific technical solutions are as follows:
一种扫地机器人,包括双目摄像头、无线通信系统和控制系统;A sweeping robot, including a binocular camera, a wireless communication system, and a control system;
所述双目摄像头用于在同一时刻获取同一障碍物的不同角度的两幅图片信息;The binocular camera is configured to acquire two picture information of different angles of the same obstacle at the same time;
所述无线通信系统用于将两幅所述图片信息向外部传输,还用于接收外部传输的障碍物信息;The wireless communication system is configured to transmit two pieces of the picture information to the outside, and is further configured to receive externally transmitted obstacle information;
所述控制系统根据障碍物信息执行不同的动作。The control system performs different actions based on the obstacle information.
进一步地,所述障碍物信息包括障碍物大小、障碍物形状以及障碍物与扫地机器人的距离。Further, the obstacle information includes an obstacle size, an obstacle shape, and a distance between the obstacle and the cleaning robot.
进一步地,还包括驱动系统;Further, a drive system is further included;
所述驱动系统用于驱动扫地机器人在工作区域运动;The driving system is configured to drive the cleaning robot to move in a work area;
当所述障碍物信息的障碍物大小不大于预设值时,所述控制系统控制驱动系统增大驱动力,使扫地机器人越过障碍物;When the obstacle size of the obstacle information is not greater than a preset value, the control system controls the driving system to increase the driving force, so that the sweeping robot crosses the obstacle;
当所述障碍物信息的障碍物大小大于预设值时,所述控制系统控制驱动系统,使扫地机器人沿障碍物轮廓绕过障碍物。When the obstacle size of the obstacle information is greater than a preset value, the control system controls the drive system to cause the sweeping robot to bypass the obstacle along the obstacle contour.
进一步地,还包括清洁系统;Further, a cleaning system is also included;
所述清洁系统用于清洁垃圾并存储至尘盒;The cleaning system is used to clean the garbage and store it to the dust box;
当基于所述障碍物信息判断当前障碍物为毛毯时,所述控制系统控制驱动系统增大驱动力,使扫地机器人越过毛毯;并控制所述清洁系统增大清洁功率;When judging that the current obstacle is a blanket based on the obstacle information, the control system controls the driving system to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system to increase the cleaning power;
当基于所述障碍物信息判断当前障碍物为垃圾时,所述所述控制系统控制驱动系统,使扫地机器人向垃圾运动;并控制所述清洁系统进行清洁。When it is determined that the current obstacle is garbage based on the obstacle information, the control system controls the driving system to move the cleaning robot to the garbage; and controls the cleaning system to perform cleaning.
进一步地,所述双目摄像头为图像传感器。Further, the binocular camera is an image sensor.
进一步地,所述双目摄像头相对固定安装在扫地机器人的前端面且双目摄像头的两个摄像头安装在同一水平位置。Further, the binocular camera is relatively fixedly mounted on the front end surface of the cleaning robot and the two cameras of the binocular camera are installed at the same horizontal position.
为解决背景技术中的技术问题,本发明还提供了一种图像处理终端,具体技术方案如下:To solve the technical problem in the background art, the present invention also provides an image processing terminal, and the specific technical solutions are as follows:
一种图像处理终端,包括图像处理系统和无线通信系统;An image processing terminal comprising an image processing system and a wireless communication system;
所述无线通信系统用于接收外部传输的两幅图片信息;The wireless communication system is configured to receive two picture information transmitted externally;
所述图像处理系统用于对两幅所述图片信息进行处理并得到障碍物信息;The image processing system is configured to process two pieces of the picture information and obtain obstacle information;
所述无线通信系统还用于将所述障碍物信息向外部传输。The wireless communication system is further configured to transmit the obstacle information to the outside.
进一步地,所述图像处理终端为云服务器。Further, the image processing terminal is a cloud server.
为解决背景技术中的技术问题,本发明还提供了一种扫地机器人系统,具体技术方案如下:In order to solve the technical problem in the background art, the present invention also provides a sweeping robot system, and the specific technical solutions are as follows:
一种扫地机器人系统,包括上述任一种具有无线通信系统的扫地机器人以及上述任一种所述的图像处理终端。A cleaning robot system comprising any of the above-described cleaning robots having a wireless communication system and the image processing terminal of any of the above.
进一步地,所述扫地机器人包括双目摄像头、无线通信系统和控制系统;Further, the cleaning robot includes a binocular camera, a wireless communication system, and a control system;
所述双目摄像头用于在同一时刻获取同一障碍物的不同角度的两幅图片信息;The binocular camera is configured to acquire two picture information of different angles of the same obstacle at the same time;
所述无线通信系统用于将两幅所述图片信息向外部传输,还用于接收外部传输的障碍物信息;The wireless communication system is configured to transmit two pieces of the picture information to the outside, and is further configured to receive externally transmitted obstacle information;
所述控制系统根据障碍物信息执行不同的动作。The control system performs different actions based on the obstacle information.
进一步地,所述扫地机器人还包括驱动系统;Further, the cleaning robot further includes a driving system;
所述驱动系统用于驱动扫地机器人在工作区域运动;The driving system is configured to drive the cleaning robot to move in a work area;
当所述障碍物信息的障碍物大小不大于预设值时,所述控制系统控制驱动系统增大驱动力,使扫地机器人越过障碍物;When the obstacle size of the obstacle information is not greater than a preset value, the control system controls the driving system to increase the driving force, so that the sweeping robot crosses the obstacle;
当所述障碍物信息的障碍物大小大于预设值时,所述控制系统(150)控制驱动系统,使扫地机器人沿障碍物轮廓绕过障碍物。When the obstacle size of the obstacle information is greater than a preset value, the control system (150) controls the drive system to cause the sweeping robot to bypass the obstacle along the obstacle contour.
进一步地,所述扫地机器人还包括清洁系统;Further, the cleaning robot further includes a cleaning system;
所述清洁系统用于清洁垃圾并存储至尘盒;The cleaning system is used to clean the garbage and store it to the dust box;
当基于所述障碍物信息判断当前障碍物为毛毯时,所述控制系统控制驱动系统增大驱动力,使扫地机器人越过毛毯;并控制所述清洁系统增大清洁功率;When judging that the current obstacle is a blanket based on the obstacle information, the control system controls the driving system to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system to increase the cleaning power;
当基于所述障碍物信息判断当前障碍物为垃圾时,所述所述控制系统控制驱动系统,使扫地机器人向垃圾运动;并控制所述清洁系统进行清洁。When it is determined that the current obstacle is garbage based on the obstacle information, the control system controls the driving system to move the cleaning robot to the garbage; and controls the cleaning system to perform cleaning.
进一步地,所述双目摄像头相对固定安装在扫地机器人的前端面且双目摄像头的两个摄像头安装在同一水平位置。Further, the binocular camera is relatively fixedly mounted on the front end surface of the cleaning robot and the two cameras of the binocular camera are installed at the same horizontal position.
进一步地,所述图像处理终端包括:图像处理系统和无线通信系统;Further, the image processing terminal includes: an image processing system and a wireless communication system;
所述无线通信系统用于接收外部传输的两幅图片信息;The wireless communication system is configured to receive two picture information transmitted externally;
所述图像处理系统用于对两幅所述图片信息进行处理并得到障碍物信息;The image processing system is configured to process two pieces of the picture information and obtain obstacle information;
所述无线通信系统还用于将所述障碍物信息向外部传输。The wireless communication system is further configured to transmit the obstacle information to the outside.
为解决背景技术中的技术问题,本发明还提供了一种扫地机器人的工作方法,具体技术方案如下:In order to solve the technical problem in the background art, the present invention also provides a working method of a cleaning robot, and the specific technical solutions are as follows:
一种扫地机器人的工作方法,包括:A working method of a sweeping robot, comprising:
在同一时刻获取同一障碍物的不同角度的两幅图片信息;Obtaining two picture information of different angles of the same obstacle at the same time;
基于两幅所述图片信息得到障碍物信息;Obtaining obstacle information based on two pieces of the picture information;
基于所述障碍物信息选择不同的工作模式。Different working modes are selected based on the obstacle information.
进一步地,所述障碍物信息包括障碍物大小、障碍物形状以及障碍物与扫地机器人的距离。Further, the obstacle information includes an obstacle size, an obstacle shape, and a distance between the obstacle and the cleaning robot.
进一步地,所述在同一时刻获取同一障碍物的不同角度的两幅图片信息的步骤之前还包括:Further, the step of acquiring two pieces of picture information of different angles of the same obstacle at the same time further includes:
将所有障碍物信息与对应的工作模式相关联。Associate all obstacle information with the corresponding work mode.
与现有技术相比,本发明的有益效果在于:Compared with the prior art, the beneficial effects of the present invention are:
本发明通过双目摄像头获取扫地机器人工作环境的障碍物信息,能获取障碍物大小、障碍物形状以及障碍物与扫地机器人的距离等信息,使扫地机器人自动判断是否可以被清扫、是否可以越过、是否可以钻入,大大改善了扫地机器人的被困情况,提升了扫地机器人智能化水平及用户体验。The invention obtains obstacle information of the working environment of the sweeping robot through the binocular camera, and can acquire information such as the size of the obstacle, the shape of the obstacle, and the distance between the obstacle and the sweeping robot, so that the sweeping robot automatically judges whether it can be cleaned, whether it can be crossed, Whether it can be drilled, greatly improved the trapped situation of the sweeping robot, and improved the intelligent level and user experience of the sweeping robot.
附图说明DRAWINGS
为了更清楚地说明本发明实施例的技术方案,下面将对实施例中所需要使用的附图作简单的介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are some embodiments of the present invention. For the ordinary technicians, other drawings can be obtained based on these drawings without any creative work.
图1为本发明实施例提供的一种扫地机器人的结构示意图;1 is a schematic structural diagram of a cleaning robot according to an embodiment of the present invention;
图2为图1中的一种扫地机器人的模块示意图;2 is a schematic diagram of a module of the cleaning robot of FIG. 1;
图3为本发明实施例提供的另一种扫地机器人的模块示意图;FIG. 3 is a schematic diagram of another module of a cleaning robot according to an embodiment of the present invention; FIG.
图4为本发明实施例提供的一种图像处理终端的模块示意图;4 is a schematic block diagram of an image processing terminal according to an embodiment of the present invention;
图5为本发明实施例提供的一种扫地机器人系统的模块示意图;FIG. 5 is a schematic diagram of a module of a cleaning robot system according to an embodiment of the present invention; FIG.
图6为本发明实施例提供的一种扫地机器人系统的结构示意图;FIG. 6 is a schematic structural diagram of a system for sweeping a robot according to an embodiment of the present invention; FIG.
图7为本发明实施例提供的一种扫地机器人的工作方法的流程图。FIG. 7 is a flowchart of a working method of a cleaning robot according to an embodiment of the present invention.
附图标记:1为扫地机器人,110为双目摄像头,120为驱动系统,130为清洁系统,140、210为图像处理系统,150为控制系统,160为传感器系统,170为电源系统,180、220为无线通信模块,2为图像处理终端,11、12为CCD摄像头。Reference numerals: 1 is a sweeping robot, 110 is a binocular camera, 120 is a driving system, 130 is a cleaning system, 140, 210 are image processing systems, 150 is a control system, 160 is a sensor system, 170 is a power system, 180, 220 is a wireless communication module, 2 is an image processing terminal, and 11, 12 are CCD cameras.
具体实施方式Detailed ways
下面将结合附图和具体实施例对本发明技术方案进行清楚、完整地描述,显然,这里所描述的实施例仅仅是发明的一部分实施例,而不是全部的实施例。基于本发明描述的具体实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明权利要求所限定的保护范围内。The technical solutions of the present invention will be clearly and completely described in the following with reference to the accompanying drawings and specific embodiments. It is obvious that the embodiments described herein are only a part of the embodiments of the invention, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the specific embodiments described herein are intended to be within the scope of the invention as defined by the appended claims.
实施例1Example 1
请参阅图1-2,图1为本发明实施例提供的一种扫地机器人的结构示意图;图2为图1中的一种扫地机器人的模块示意图。1-2, FIG. 1 is a schematic structural diagram of a cleaning robot according to an embodiment of the present invention; and FIG. 2 is a schematic diagram of a module of the cleaning robot in FIG.
本实施例中的扫地机器人1包括控制系统150、驱动系统120、清洁系统130、传感器系统160、电源系统170、双目摄像头110(双目摄像头110为图像传感器,在本实施例中包括左CCD摄像头11、右CCD摄像头12)和图像处理系统140。在对环境较为简单的情况下,出于成本和速度考虑,也可以将CCD(英文单词为Charge coupled Device,即电荷耦合元件)用CMOS(Compementary Metal Oxide Semiconductor,即互补金属氧化物半导体)代替。The cleaning robot 1 in this embodiment includes a control system 150, a driving system 120, a cleaning system 130, a sensor system 160, a power supply system 170, and a binocular camera 110 (the binocular camera 110 is an image sensor, which includes a left CCD in this embodiment). Camera 11, right CCD camera 12) and image processing system 140. In the case where the environment is relatively simple, for the sake of cost and speed, the CCD (charcode coupled device, ie, charge coupled device) may be replaced by CMOS (Complementary Metal Oxide Semiconductor).
控制系统150包括存储有扫地机器人1工作程序的MCU或单片机(本实 施例中为带有存储器的MCU),所述控制系统150根据障碍物信息执行不同的动作;即根据传感器系统160或图像处理系统140返回的障碍物信息控制驱动系统120及清洁系统130工作;双目摄像头110用于在同一时刻获取同一障碍物的不同角度的两幅图片信息;图像处理系统140用于对双目摄像头110获取的两幅图片信息进行处理并得到障碍物信息;驱动系统120包括左右驱动轮,用于驱动扫地机器人1在工作区域运动;清洁系统130包括中扫、真空吸尘装置、边扫及尘盒,用于清扫地面垃圾并存储至尘盒;传感器系统160包括地检和墙检,分别用于检测工作区域表面落差及周围障碍物(包括墙);电源系统170用于为扫地机器人1的各系统提供电能,一般为可充电电池(如锂电池)。The control system 150 includes an MCU or a single chip microcomputer (in this embodiment, an MCU with a memory) storing a working program of the cleaning robot 1, the control system 150 performing different actions according to the obstacle information; that is, according to the sensor system 160 or image processing The obstacle information returned by the system 140 controls the driving system 120 and the cleaning system 130 to operate; the binocular camera 110 is used to acquire two picture information of different angles of the same obstacle at the same time; the image processing system 140 is used for the binocular camera 110 The acquired two pieces of picture information are processed to obtain obstacle information; the driving system 120 includes left and right driving wheels for driving the cleaning robot 1 to move in the working area; the cleaning system 130 includes a middle sweeping, vacuuming device, side sweeping and dust box For cleaning the ground garbage and storing it to the dust box; the sensor system 160 includes a ground inspection and a wall inspection for respectively detecting a surface area difference and surrounding obstacles (including walls); the power system 170 is used for each of the cleaning robots 1 The system provides electrical energy, typically a rechargeable battery (such as a lithium battery).
障碍物信息包括障碍物大小、障碍物形状以及障碍物与扫地机器人1的距离The obstacle information includes the size of the obstacle, the shape of the obstacle, and the distance between the obstacle and the cleaning robot 1
双目摄像头110包括左CCD摄像头11和右CCD摄像头12,左右摄像头相对固定安装,位于扫地机器人1主体的前侧方,左CCD摄像头11和右CCD摄像头12大致位于同一水平面上(与标定模型算法有关,本实施例为Opencv,需要在物理结构上保证双摄像头的光轴平行),在同一时刻左右摄像头分别获取其前进方向水平范围150°至180°、竖直方向90°至120°范围内的障碍物的不同角度的两幅图片。双目摄像头110的左CCD摄像头11和右CCD摄像头12在扫地机器人1出厂前进行立体标定,左CCD摄像头11和右CCD摄像头12之间的的旋转矩阵R和平移矩阵t可以由张正友标定法求得。其中双目摄像头110可以为图像传感器。The binocular camera 110 includes a left CCD camera 11 and a right CCD camera 12, and the left and right cameras are relatively fixedly mounted on the front side of the main body of the cleaning robot 1, and the left CCD camera 11 and the right CCD camera 12 are substantially on the same horizontal plane (with the calibration model algorithm) In this embodiment, the Opencv needs to ensure that the optical axes of the dual cameras are parallel in the physical structure. At the same time, the cameras respectively acquire the horizontal range of the forward direction from 150° to 180° and the vertical direction from 90° to 120°. Two pictures of different angles of the obstacle. The left CCD camera 11 and the right CCD camera 12 of the binocular camera 110 perform stereo calibration before the cleaning robot 1 is shipped from the factory, and the rotation matrix R and the translation matrix t between the left CCD camera 11 and the right CCD camera 12 can be obtained by Zhang Zhengyou calibration method. Got it. The binocular camera 110 can be an image sensor.
本实施例中,障碍物的距离及大小的识别过程如下:In this embodiment, the process of identifying the distance and size of the obstacle is as follows:
本实施例基于Opencv平台,使用Opencv提供的SGBM算法进行匹配计算。 首先对左右CCD摄像头在同一时刻拍摄的图片进行立体匹配,然后对原始图片进行二值化处理、高斯模糊、canny算子轮廓检测,寻找障碍物轮廓并用最小四边形将障碍物完整框出,通过计算四边形的四个顶点坐标得到障碍物的像素大小;通过计算四边形四个顶点的坐标得到物体中心点的像素坐标,通过双目测距原理得到障碍物中心点距离摄像头的距离,根据三角形原理,可以计算出障碍物的宽度和高度,实现对障碍物大小的测量。This embodiment is based on the Opencv platform and uses the SGBM algorithm provided by Opencv for matching calculation. Firstly, the left and right CCD cameras are stereo-matched at the same time, then the original image is binarized, Gaussian blur, canny operator contour detection, the obstacle contour is found, and the obstacle is completely framed by the minimum quadrilateral. The coordinates of the four vertices of the quadrilateral obtain the pixel size of the obstacle; the pixel coordinates of the center point of the object are obtained by calculating the coordinates of the four vertices of the quadrilateral, and the distance between the center point of the obstacle and the camera is obtained by the binocular ranging principle. According to the triangle principle, The width and height of the obstacle are calculated to measure the size of the obstacle.
具体地,首先使用reprojectImageTo3D生成三维点云,使用findContours获得障碍物轮廓,遍历删除最大及最小轮廓,使用minAreaRect获得轮廓的最小举证并得到矩形四个顶点的坐标,然后通过三角函数计算出障碍物的大小(长宽高等数据)。Specifically, first use reprojectImageTo3D to generate a 3D point cloud, use findContours to obtain the obstacle contour, traverse to delete the maximum and minimum contours, use minAreaRect to obtain the minimum proof of the contour and get the coordinates of the four vertices of the rectangle, and then calculate the obstacle by trigonometric function. Size (length, width, height, etc.).
在本实施例中,控制器(带有存储器的MCU)存储的程序与室内环境的常见静态物体(如家具、家电或门槛等)及动态物体(如人或宠物)相关,即将室内环境的各物体(障碍物)与对应的工作模式关联起来,在识别到不同障碍物时执行不同动作,比如:识别到门槛、拖鞋或线缆等高度较低的物体时(可通过设定高度阈值,如扫地机器人1目前的爬坡高度为2cm左右,在障碍物高度大于2cm时,将障碍物标认为是不可跨域的,在扫地机器人1移动至该障碍物附近时,不再对该障碍物进行跨越尝试,而直接执行回避动作),扫地机器人1移动至障碍物附近时增大驱动系统120的驱动力并执行跨越动作;识别到障碍物为毛毯时,执行跨越动作的同时增加清洁系统130的吸力及驱动系统120的驱动力;识别到障碍物为垃圾时,扫地机器人1驶向垃圾并清扫;识别到障碍物为人或冰箱等高度较高的物体时,扫地机器人1执行回避该动作等。该设置可以使扫地机器人1工作更为智能化,同时提升了用户体验。In this embodiment, the program stored by the controller (MCU with memory) is associated with common static objects (such as furniture, home appliances or thresholds) and dynamic objects (such as people or pets) in the indoor environment, that is, each of the indoor environments. Objects (obstacle) are associated with corresponding work patterns and perform different actions when different obstacles are identified, such as when identifying objects with lower heights such as thresholds, slippers, or cables (by setting a height threshold, such as The current climbing height of the sweeping robot 1 is about 2 cm. When the obstacle height is greater than 2 cm, the obstacle is marked as non-cross-domain. When the sweeping robot 1 moves to the vicinity of the obstacle, the obstacle is no longer carried out. When the sweeping robot 1 moves to the vicinity of the obstacle, the driving force of the driving system 120 is increased and the crossing action is performed; when the obstacle is recognized as the felt, the crossing operation is performed while increasing the cleaning system 130 The driving force of the suction and driving system 120; when the obstacle is identified as garbage, the cleaning robot 1 drives to the garbage and cleans; the obstacle is recognized as the height of the person or the refrigerator Higher object, the cleaning robot 1 performs avoidance operation or the like. This setting makes the cleaning robot 1 work smarter and improves the user experience.
实施例2Example 2
请参阅图3-6,图3为本发明实施例提供的另一种扫地机器人的模块示意图;图4为本发明实施例提供的一种图像处理终端的模块示意图;图5为本发明实施例提供的一种扫地机器人系统的模块示意图;图6为本发明实施例提供的一种扫地机器人系统的结构示意图。Referring to FIG. 3-6, FIG. 3 is a schematic diagram of another module of a cleaning robot according to an embodiment of the present invention; FIG. 4 is a schematic diagram of a module of an image processing terminal according to an embodiment of the present invention; A schematic diagram of a module of a cleaning robot system is provided. FIG. 6 is a schematic structural diagram of a system for sweeping a robot according to an embodiment of the present invention.
如图3所示,本实施中的扫地机器人1包括控制系统150、驱动系统120、清洁系统130、传感器系统160、电源系统170、双目摄像头110(双目摄像头110为图像传感器,在本实施例中包括左CCD摄像头11、右CCD摄像头12)和无线通信系统。在对环境较为简单的情况下,出于成本和速度考虑,也可以将CCD(英文单词为Charge coupled Device,即电荷耦合元件)用CMOS(Compementary Metal Oxide Semiconductor,即互补金属氧化物半导体)代替。As shown in FIG. 3, the cleaning robot 1 in this embodiment includes a control system 150, a driving system 120, a cleaning system 130, a sensor system 160, a power supply system 170, and a binocular camera 110. The binocular camera 110 is an image sensor. The example includes a left CCD camera 11, a right CCD camera 12), and a wireless communication system. In the case where the environment is relatively simple, for the sake of cost and speed, the CCD (charcode coupled device, ie, charge coupled device) may be replaced by CMOS (Complementary Metal Oxide Semiconductor).
本实施例中的扫地机器人1与实施例1中的基本相同,不同的地方在于:A、本实施例中的扫地机器人1没有图像处理系统140;B、本实施例中的扫地机器人1将双目摄像头110获取的两幅图片信息通过无线通信模块180(如WIFI模块或Zigbee模块)发送至图像处理终端2进行对两幅图像信息的处理。The cleaning robot 1 in this embodiment is basically the same as that in the first embodiment, and the difference is that: A, the cleaning robot 1 in this embodiment does not have the image processing system 140; B, the cleaning robot 1 in this embodiment will double The two picture information acquired by the camera 110 are sent to the image processing terminal 2 through the wireless communication module 180 (such as a WIFI module or a Zigbee module) to process the two pieces of image information.
本实施例中的扫地机器人1与第一实施例中的扫地机器人1的控制系统150、驱动系统120、清洁系统130、传感器系统160、电源系统170、双目摄像头110的功能以及作用相同,本实施例不在赘述,详细参见实施例1。The functions and functions of the cleaning robot 1 in the present embodiment are the same as those of the control system 150, the drive system 120, the cleaning system 130, the sensor system 160, the power supply system 170, and the binocular camera 110 of the cleaning robot 1 in the first embodiment. The examples are not described in detail, and refer to Example 1 for details.
无线通信模块180用于将两幅所述图片信息向外部传输,还用于接收外部传输的障碍物信息,将障碍物信息传输至控制系统150,以便控制系统150根据障碍物信息执行不同的动作;即根据传感器系统160或图像处理系统210 返回的障碍物信息控制驱动系统120及清洁系统130工作。The wireless communication module 180 is configured to transmit the two pieces of the picture information to the outside, and is further configured to receive the externally transmitted obstacle information, and transmit the obstacle information to the control system 150, so that the control system 150 performs different actions according to the obstacle information. That is, the drive system 120 and the cleaning system 130 are controlled to operate based on the obstacle information returned by the sensor system 160 or the image processing system 210.
如图4所示,本实施例中的图像处理终端2为云服务器(也可为其他具备双目摄像头110图像处理能力的PC平台或嵌入式平台),包括图像处理系统210和无线通信模块220;云服务器与扫地机器人1之间的无线连接网络包括4G、WIFI网络等,组网的方式包括AP模式(无线接入点)或STA模式(STA站点)。As shown in FIG. 4, the image processing terminal 2 in this embodiment is a cloud server (other PC platform or embedded platform capable of image processing capability of the binocular camera 110), and includes an image processing system 210 and a wireless communication module 220. The wireless connection network between the cloud server and the cleaning robot 1 includes a 4G, a WIFI network, and the like, and the networking mode includes an AP mode (wireless access point) or an STA mode (STA site).
本实施例中的障碍物的距离及大小的识别过程与实施例1中相同,本实施例不在赘述,详细参见实施例1。The process of identifying the distance and the size of the obstacle in this embodiment is the same as that in the first embodiment. This embodiment is not described in detail. For details, refer to the embodiment 1.
如图5-6所示,本实施例中的障碍物识别过程如下:扫地机器人1的双目摄像头110同一时刻获取同一障碍物的不同角度的两幅图片信息,并通过扫地机器人1的无线通信模块180将两幅图片信息传输至图像处理终端2的无线通信模块220,图像处理终端2的图像处理系统210对两幅图片信息进行处理得到障碍物信息,并通过图像处理终端2的无线通信模块220将障碍物信息传输至扫地机器人1的无线通信模块180,扫地机器人1的控制系统150基于障碍物信息控制驱动系统120及清洁系统130工作。其中两幅图片信息以及障碍物信息可通过英特网(internet)进行传输。图像处理终端优选的为云服务器。As shown in FIG. 5-6, the obstacle recognition process in this embodiment is as follows: the binocular camera 110 of the cleaning robot 1 acquires two picture information of different angles of the same obstacle at the same time, and wireless communication by the cleaning robot 1 The module 180 transmits the two picture information to the wireless communication module 220 of the image processing terminal 2, and the image processing system 210 of the image processing terminal 2 processes the two picture information to obtain obstacle information, and passes through the wireless communication module of the image processing terminal 2. The obstacle information is transmitted to the wireless communication module 180 of the cleaning robot 1, and the control system 150 of the cleaning robot 1 controls the driving system 120 and the cleaning system 130 to operate based on the obstacle information. Two of the picture information and obstacle information can be transmitted via the internet. The image processing terminal is preferably a cloud server.
实施例3Example 3
请参阅图7,图7为本发明实施例提供的一种扫地机器人的工作方法的流程图。Please refer to FIG. 7. FIG. 7 is a flowchart of a working method of a cleaning robot according to an embodiment of the present invention.
如图7所示,本实施例中一种扫地机器人的工作方法包括以下步骤S100至S400:As shown in FIG. 7, the working method of a cleaning robot in this embodiment includes the following steps S100 to S400:
步骤S100:将所有障碍物信息与对应的工作模式相关联。Step S100: Associate all obstacle information with a corresponding working mode.
具体的,指将扫地机器人所在的室内环境常见的障碍物的形状、颜色等特征信息与对应的工作模式关联起来,扫地机器人的控制器根据反馈的障碍物信息选择不同的工作模式。比如,符合垃圾特征时,扫地机器人驶向障碍物,同时增大清洁系统的吸力或滚刷转速;符合地毯特征时,增大驱动系统的驱动力的同时增大清洁系统的吸力或滚刷转速;如符合水滞特征时,执行回避动作。Specifically, the feature information such as the shape and color of the obstacles commonly found in the indoor environment where the cleaning robot is located is associated with the corresponding working mode, and the controller of the cleaning robot selects different working modes according to the feedback obstacle information. For example, when the garbage feature is met, the sweeping robot drives toward the obstacle and increases the suction or rolling speed of the cleaning system; when the carpet features are met, the driving force of the driving system is increased while increasing the suction or rolling speed of the cleaning system. If the water lag feature is met, the avoidance action is performed.
步骤S200:在同一时刻获取同一障碍物的不同角度的两幅图片信息。Step S200: Acquire two picture information of different angles of the same obstacle at the same time.
具体的,扫地机器人的前进方向的前侧面的大致位于同一高度安装双目摄像头(左CCD摄像头11和右CCD摄像头12),在同一时刻左右摄像头分别获取其前进方向水平范围150°至180°、竖直方向90°至120°范围内的障碍物的不同角度的两幅图片。Specifically, the front side of the forward direction of the sweeping robot is mounted at substantially the same height to mount the binocular camera (the left CCD camera 11 and the right CCD camera 12), and the camera captures the horizontal direction of the forward direction by 150° to 180° at the same time. Two pictures of different angles of obstacles in the vertical direction from 90° to 120°.
步骤S300:基于两幅所述图片信息得到障碍物信息。Step S300: Obtain obstacle information based on the two pieces of the picture information.
具体的,将获取的两幅图片发送至图像处理系统进行处理后(处理过程参考实施例1中的描述),得到包括障碍物大小、障碍物形状、与扫地机器人的距离等障碍物信息,然后将该障碍物信息发送至扫地机器人的控制系统。如实施例1、实施例2中所描述,图像处理系统可为安装在扫地机器人上或云服务器上。Specifically, after the acquired two pictures are sent to the image processing system for processing (the process is described with reference to Embodiment 1), obstacle information including an obstacle size, an obstacle shape, and a distance from the cleaning robot is obtained, and then The obstacle information is sent to the control system of the cleaning robot. As described in Embodiment 1, Embodiment 2, the image processing system may be mounted on a cleaning robot or on a cloud server.
步骤S400:基于所述障碍物信息选择不同的工作模式。Step S400: Select different working modes based on the obstacle information.
具体的,可以判断障碍物的高度是否大于预设值时,如果是则扫地机器人在移动至该障碍物附近时执行回避动作,如果否则扫地机器人继续沿原方向运动。即当所述障碍物信息的障碍物大小不大于预设值时,所述控制系统控制驱动系统增大驱动力,使扫地机器人越过障碍物;当所述障碍物信息的障碍物大小大于预设值时,所述控制系统控制驱动系统,使扫地机器人沿障 碍物轮廓绕过障碍物。还可以判断障碍物是否存在可供扫地机器人穿过的空间,如果是则扫地机器人继续沿原方向运动,如果否则扫地机器人在移动至该障碍物附近后执行回避动作。具体地,通过障碍物形状判断其是否有供扫地机器人穿过的空间,再判断盖空间的高度和宽度是否大于扫地机器人的高度和宽度,在高度和宽度同时满足的条件下认为该空间可供扫地机器人穿过。还可以当基于所述障碍物信息判断当前障碍物为毛毯时,所述控制系统控制驱动系统增大驱动力,使扫地机器人越过毛毯;并控制所述清洁系统增大清洁功率;当基于所述障碍物信息判断当前障碍物为垃圾时,所述所述控制系统控制驱动系统,使扫地机器人向垃圾运动;并控制所述清洁系统进行清洁。障碍物信息包括障碍物大小、障碍物形状以及障碍物与扫地机器人的距离。Specifically, when it is determined whether the height of the obstacle is greater than a preset value, if yes, the sweeping robot performs an avoidance action when moving to the vicinity of the obstacle, and if otherwise, the sweeping robot continues to move in the original direction. That is, when the obstacle size of the obstacle information is not greater than a preset value, the control system controls the driving system to increase the driving force, so that the sweeping robot crosses the obstacle; when the obstacle information size of the obstacle information is greater than the preset In value, the control system controls the drive system to cause the sweeping robot to bypass the obstacle along the obstacle profile. It is also possible to judge whether or not the obstacle has a space through which the sweeping robot can pass, and if so, the sweeping robot continues to move in the original direction, otherwise the sweeping robot performs the avoidance action after moving to the vicinity of the obstacle. Specifically, it is determined whether there is a space for the cleaning robot to pass through the shape of the obstacle, and then it is judged whether the height and the width of the cover space are larger than the height and width of the cleaning robot, and the space is considered to be available under the condition that both the height and the width are satisfied at the same time. The sweeping robot passes through. When the current obstacle is determined to be a blanket based on the obstacle information, the control system controls the driving system to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system to increase the cleaning power; When the obstacle information determines that the current obstacle is garbage, the control system controls the driving system to move the cleaning robot to the garbage; and controls the cleaning system to perform cleaning. The obstacle information includes the size of the obstacle, the shape of the obstacle, and the distance between the obstacle and the sweeping robot.
以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above-described embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be considered as the scope of this manual.
以上所述实施例仅表达了本发明的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对发明专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进,这些都属于本发明的保护范围。因此,本发明专利的保护范围应以所附权利要求为准。The above-described embodiments are merely illustrative of several embodiments of the present invention, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims (23)

  1. 一种扫地机器人,包括控制系统(150),其特征在于:A sweeping robot, comprising a control system (150), characterized in that:
    还包括双目摄像头(110)和图像处理系统(140);Also included is a binocular camera (110) and an image processing system (140);
    所述双目摄像头(110)用于在同一时刻获取同一障碍物的不同角度的两幅图片信息;The binocular camera (110) is configured to acquire two picture information of different angles of the same obstacle at the same time;
    所述图像处理系统(140)用于对双目摄像头获取的两幅图片信息进行处理并得到障碍物信息;The image processing system (140) is configured to process two picture information acquired by the binocular camera and obtain obstacle information;
    所述控制系统根据障碍物信息执行不同的动作。The control system performs different actions based on the obstacle information.
  2. 根据权利要求1所述的扫地机器人,其特征在于:The cleaning robot according to claim 1, wherein:
    所述障碍物信息包括障碍物大小、障碍物形状以及障碍物与扫地机器人的距离。The obstacle information includes an obstacle size, an obstacle shape, and a distance between the obstacle and the sweeping robot.
  3. 根据权利要求2所述的扫地机器人,其特征在于:还包括驱动系统(120);The cleaning robot according to claim 2, further comprising a driving system (120);
    所述驱动系统(120)用于驱动扫地机器人在工作区域运动;The driving system (120) is configured to drive the cleaning robot to move in a working area;
    当所述障碍物信息的障碍物大小不大于预设值时,所述控制系统(150)控制驱动系统(120)增大驱动力,使扫地机器人越过障碍物;When the obstacle size of the obstacle information is not greater than a preset value, the control system (150) controls the driving system (120) to increase the driving force, so that the cleaning robot crosses the obstacle;
    当所述障碍物信息的障碍物大小大于预设值时,所述控制系统(150)控制驱动系统(120),使扫地机器人沿障碍物轮廓绕过障碍物。When the obstacle size of the obstacle information is greater than a preset value, the control system (150) controls the drive system (120) to cause the sweeping robot to bypass the obstacle along the obstacle contour.
  4. 根据权利要求3所述的扫地机器人,其特征在于:还包括清洁系统(130);The cleaning robot according to claim 3, further comprising a cleaning system (130);
    所述清洁系统(130)用于清洁垃圾并存储至尘盒;The cleaning system (130) is used to clean the garbage and store it to the dust box;
    当基于所述障碍物信息判断当前障碍物为毛毯时,所述控制系统(150)控制驱动系统(120)增大驱动力,使扫地机器人越过毛毯;并控制所述清洁 系统(130)增大清洁功率;When determining that the current obstacle is a blanket based on the obstacle information, the control system (150) controls the driving system (120) to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system (130) to increase. Clean power
    当基于所述障碍物信息判断当前障碍物为垃圾时,所述所述控制系统(150)控制驱动系统(120),使扫地机器人向垃圾运动;并控制所述清洁系统(130)进行清洁。When it is determined that the current obstacle is garbage based on the obstacle information, the control system (150) controls the driving system (120) to move the cleaning robot to the garbage; and controls the cleaning system (130) to perform cleaning.
  5. 根据权利要求1所述的扫地机器人,其特征在于:The cleaning robot according to claim 1, wherein:
    所述双目摄像头(110)为图像传感器。The binocular camera (110) is an image sensor.
  6. 根据权利要求1所述的扫地机器人,其特征在于:The cleaning robot according to claim 1, wherein:
    所述双目摄像头(110)相对固定安装在扫地机器人的前端面且双目摄像头的两个摄像头安装在同一水平位置。The binocular camera (110) is relatively fixedly mounted on the front end surface of the cleaning robot and the two cameras of the binocular camera are installed at the same horizontal position.
  7. 一种扫地机器人,其特征在于:包括双目摄像头(110)、无线通信系统(180)和控制系统(150);A sweeping robot characterized by comprising a binocular camera (110), a wireless communication system (180) and a control system (150);
    所述双目摄像头(110)用于在同一时刻获取同一障碍物的不同角度的两幅图片信息;The binocular camera (110) is configured to acquire two picture information of different angles of the same obstacle at the same time;
    所述无线通信系统(180)用于将两幅所述图片信息向外部传输,还用于接收外部传输的障碍物信息;The wireless communication system (180) is configured to transmit two pieces of the picture information to the outside, and is further configured to receive externally transmitted obstacle information;
    所述控制系统(150)根据障碍物信息执行不同的动作。The control system (150) performs different actions based on the obstacle information.
  8. 根据权利要求7所述的扫地机器人,其特征在于:A cleaning robot according to claim 7, wherein:
    所述障碍物信息包括障碍物大小、障碍物形状以及障碍物与扫地机器人的距离。The obstacle information includes an obstacle size, an obstacle shape, and a distance between the obstacle and the sweeping robot.
  9. 根据权利要求8所述的扫地机器人,其特征在于:还包括驱动系统(120);The sweeping robot according to claim 8, further comprising a drive system (120);
    所述驱动系统(120)用于驱动扫地机器人在工作区域运动;The driving system (120) is configured to drive the cleaning robot to move in a working area;
    当所述障碍物信息的障碍物大小不大于预设值时,所述控制系统控(150) 制驱动系统(120)增大驱动力,使扫地机器人越过障碍物;When the obstacle size of the obstacle information is not greater than a preset value, the control system controls (150) the driving system (120) to increase the driving force, so that the sweeping robot crosses the obstacle;
    当所述障碍物信息的障碍物大小大于预设值时,所述控制系统(150)控制驱动系统(120),使扫地机器人沿障碍物轮廓绕过障碍物。When the obstacle size of the obstacle information is greater than a preset value, the control system (150) controls the drive system (120) to cause the sweeping robot to bypass the obstacle along the obstacle contour.
  10. 根据权利要求9所述的扫地机器人,其特征在于:还包括清洁系统(130);The cleaning robot according to claim 9, further comprising a cleaning system (130);
    所述清洁系统(130)用于清洁垃圾并存储至尘盒;The cleaning system (130) is used to clean the garbage and store it to the dust box;
    当基于所述障碍物信息判断当前障碍物为毛毯时,所述控制系统(150)控制驱动系统(120)增大驱动力,使扫地机器人越过毛毯;并控制所述清洁系统(130)增大清洁功率;When determining that the current obstacle is a blanket based on the obstacle information, the control system (150) controls the driving system (120) to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system (130) to increase. Clean power
    当基于所述障碍物信息判断当前障碍物为垃圾时,所述所述控制系统(150)控制驱动系统(120),使扫地机器人向垃圾运动;并控制所述清洁系统(130)进行清洁。When it is determined that the current obstacle is garbage based on the obstacle information, the control system (150) controls the driving system (120) to move the cleaning robot to the garbage; and controls the cleaning system (130) to perform cleaning.
  11. 根据权利要求7所述的扫地机器人,其特征在于:A cleaning robot according to claim 7, wherein:
    所述双目摄像头(110)为图像传感器。The binocular camera (110) is an image sensor.
  12. 根据权利要求7所述的扫地机器人,其特征在于:A cleaning robot according to claim 7, wherein:
    所述双目摄像头(110)相对固定安装在扫地机器人的前端面且双目摄像头的两个摄像头安装在同一水平位置。The binocular camera (110) is relatively fixedly mounted on the front end surface of the cleaning robot and the two cameras of the binocular camera are installed at the same horizontal position.
  13. 一种图像处理终端,其特征在于,包括图像处理系统(210)和无线通信系统(220);An image processing terminal, comprising: an image processing system (210) and a wireless communication system (220);
    所述无线通信系统(220)用于接收外部传输的两幅图片信息;The wireless communication system (220) is configured to receive two picture information transmitted externally;
    所述图像处理系统(210)用于对两幅所述图片信息进行处理并得到障碍物信息;The image processing system (210) is configured to process two pieces of the picture information and obtain obstacle information;
    所述无线通信系统(220)还用于将所述障碍物信息向外部传输。The wireless communication system (220) is further configured to transmit the obstacle information to the outside.
  14. 根据权利要求13所述的终端,其特征在于:The terminal of claim 13 wherein:
    所述图像处理终端为云服务器。The image processing terminal is a cloud server.
  15. 一种扫地机器人系统,其特征在于,包括扫地机器人(1)以及图像处理终端(2)。A sweeping robot system characterized by comprising a cleaning robot (1) and an image processing terminal (2).
  16. 根据权利要求13所述的系统,其特征在于:The system of claim 13 wherein:
    所述扫地机器人包括双目摄像头(110)、无线通信系统(180)和控制系统(150);The cleaning robot includes a binocular camera (110), a wireless communication system (180), and a control system (150);
    所述双目摄像头(110)用于在同一时刻获取同一障碍物的不同角度的两幅图片信息;The binocular camera (110) is configured to acquire two picture information of different angles of the same obstacle at the same time;
    所述无线通信系统(180)用于将两幅所述图片信息向外部传输,还用于接收外部传输的障碍物信息;The wireless communication system (180) is configured to transmit two pieces of the picture information to the outside, and is further configured to receive externally transmitted obstacle information;
    所述控制系统(150)根据障碍物信息执行不同的动作。The control system (150) performs different actions based on the obstacle information.
  17. 根据权利要求16所述的系统,其特征在于:所述扫地机器人还包括驱动系统(120);The system according to claim 16, wherein said cleaning robot further comprises a drive system (120);
    所述驱动系统(120)用于驱动扫地机器人在工作区域运动;The driving system (120) is configured to drive the cleaning robot to move in a working area;
    当所述障碍物信息的障碍物大小不大于预设值时,所述控制系统控(150)制驱动系统(120)增大驱动力,使扫地机器人越过障碍物;When the obstacle size of the obstacle information is not greater than a preset value, the control system controls (150) the driving system (120) to increase the driving force, so that the sweeping robot crosses the obstacle;
    当所述障碍物信息的障碍物大小大于预设值时,所述控制系统(150)控制驱动系统(120),使扫地机器人沿障碍物轮廓绕过障碍物。When the obstacle size of the obstacle information is greater than a preset value, the control system (150) controls the drive system (120) to cause the sweeping robot to bypass the obstacle along the obstacle contour.
  18. 根据权利要求16所述的系统,其特征在于:所述扫地机器人还包括清洁系统(130);The system of claim 16 wherein said cleaning robot further comprises a cleaning system (130);
    所述清洁系统(130)用于清洁垃圾并存储至尘盒;The cleaning system (130) is used to clean the garbage and store it to the dust box;
    当基于所述障碍物信息判断当前障碍物为毛毯时,所述控制系统(150) 控制驱动系统(120)增大驱动力,使扫地机器人越过毛毯;并控制所述清洁系统(130)增大清洁功率;When judging that the current obstacle is a blanket based on the obstacle information, the control system (150) controls the driving system (120) to increase the driving force, causing the cleaning robot to cross the blanket; and controlling the cleaning system (130) to increase Clean power
    当基于所述障碍物信息判断当前障碍物为垃圾时,所述所述控制系统(150)控制驱动系统(120),使扫地机器人向垃圾运动;并控制所述清洁系统(130)进行清洁。When it is determined that the current obstacle is garbage based on the obstacle information, the control system (150) controls the driving system (120) to move the cleaning robot to the garbage; and controls the cleaning system (130) to perform cleaning.
  19. 根据权利要求16所述的系统,其特征在于:The system of claim 16 wherein:
    所述双目摄像头(110)相对固定安装在扫地机器人的前端面且双目摄像头的两个摄像头安装在同一水平位置。The binocular camera (110) is relatively fixedly mounted on the front end surface of the cleaning robot and the two cameras of the binocular camera are installed at the same horizontal position.
  20. 根据权利要求15所述的系统,其特征在于:The system of claim 15 wherein:
    所述图像处理终端包括:图像处理系统(210)和无线通信系统(220);The image processing terminal includes: an image processing system (210) and a wireless communication system (220);
    所述无线通信系统(220)用于接收外部传输的两幅图片信息;The wireless communication system (220) is configured to receive two picture information transmitted externally;
    所述图像处理系统(210)用于对两幅所述图片信息进行处理并得到障碍物信息;The image processing system (210) is configured to process two pieces of the picture information and obtain obstacle information;
    所述无线通信系统(220)还用于将所述障碍物信息向外部传输。The wireless communication system (220) is further configured to transmit the obstacle information to the outside.
  21. 一种扫地机器人的工作方法,其特征在于,包括:A working method of a sweeping robot, characterized in that it comprises:
    在同一时刻获取同一障碍物的不同角度的两幅图片信息;Obtaining two picture information of different angles of the same obstacle at the same time;
    基于两幅所述图片信息得到障碍物信息;Obtaining obstacle information based on two pieces of the picture information;
    基于所述障碍物信息选择不同的工作模式。Different working modes are selected based on the obstacle information.
  22. 根据权利要求21所述的扫地机器人的工作方法,其特征在于:A method of operating a cleaning robot according to claim 21, wherein:
    所述障碍物信息包括障碍物大小、障碍物形状以及障碍物与扫地机器人的距离。The obstacle information includes an obstacle size, an obstacle shape, and a distance between the obstacle and the sweeping robot.
  23. 根据权利要求21所述的扫地机器人的工作方法,其特征在于:所述在同一时刻获取同一障碍物的不同角度的两幅图片信息的步骤之前还包括: 将所有障碍物信息与对应的工作模式相关联。The working method of the cleaning robot according to claim 21, wherein the step of acquiring two pieces of picture information of different angles of the same obstacle at the same time further comprises: all obstacle information and corresponding working mode Associated.
PCT/CN2018/073868 2017-07-05 2018-01-23 Floor sweeping robot, floor sweeping robot system and working method thereof WO2019007038A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710542320.3A CN109213137A (en) 2017-07-05 2017-07-05 sweeping robot, sweeping robot system and its working method
CN201710542320.3 2017-07-05

Publications (1)

Publication Number Publication Date
WO2019007038A1 true WO2019007038A1 (en) 2019-01-10

Family

ID=64949670

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/073868 WO2019007038A1 (en) 2017-07-05 2018-01-23 Floor sweeping robot, floor sweeping robot system and working method thereof

Country Status (2)

Country Link
CN (1) CN109213137A (en)
WO (1) WO2019007038A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2740229C1 (en) * 2020-03-19 2021-01-12 Автономная некоммерческая образовательная организация высшего образования "Сколковский институт науки и технологий" Method of localizing and constructing navigation maps of mobile service robot
EP3821780A1 (en) * 2019-11-12 2021-05-19 Nextvpu (Shanghai) Co., Ltd. Mobile robot
US11054838B2 (en) 2019-11-12 2021-07-06 NextVPU (Shanghai) Co., Ltd. Mobile robot
CN114442615A (en) * 2021-12-31 2022-05-06 重庆特斯联智慧科技股份有限公司 Robot traveling strategy determination method and system based on barrier attributes

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111609854A (en) * 2019-02-25 2020-09-01 北京奇虎科技有限公司 Three-dimensional map construction method based on multiple depth cameras and sweeping robot
CN109730594A (en) * 2019-03-27 2019-05-10 南京英维尔科技服务有限公司 A kind of sweeping robot
CN109998428B (en) * 2019-04-30 2021-10-08 深圳拓邦股份有限公司 Cleaning method, system and device for sweeping robot
CN112205925B (en) * 2019-07-11 2022-06-28 尚科宁家(中国)科技有限公司 Sweeping method of intelligent sweeping robot and sweeping robot
CN110502014A (en) * 2019-08-22 2019-11-26 深圳乐动机器人有限公司 A kind of method and robot of robot obstacle-avoiding
KR20190106874A (en) * 2019-08-27 2019-09-18 엘지전자 주식회사 Robot cleaner for recognizing stuck situation through artificial intelligence and operating method thereof
CN110619298A (en) * 2019-09-12 2019-12-27 炬佑智能科技(苏州)有限公司 Mobile robot, specific object detection method and device thereof and electronic equipment
CN214231240U (en) * 2019-11-18 2021-09-21 北京石头世纪科技股份有限公司 Cleaning robot
AU2022204218B2 (en) * 2019-11-18 2023-12-07 Beijing Roborock Technology Co., Ltd Camera Apparatus and Cleaning Robot
CN110974088B (en) * 2019-11-29 2021-09-24 深圳市杉川机器人有限公司 Sweeping robot control method, sweeping robot and storage medium
CN110897557A (en) * 2019-12-05 2020-03-24 西安广源机电技术有限公司 Floor sweeping robot system
CN111407192A (en) * 2020-03-20 2020-07-14 珠海市一微半导体有限公司 Work control method and system of cleaning robot
CN111538342B (en) * 2020-06-04 2023-05-23 中国工商银行股份有限公司 Robot route adjustment method, device, robot and storage medium
CN111862182B (en) * 2020-07-15 2022-04-29 上海炬佑智能科技有限公司 ToF camera, ground obstacle detection method thereof and ground navigation equipment
CN114055457A (en) * 2020-07-31 2022-02-18 深圳乐动机器人有限公司 Method and device for controlling edge brush, robot and storage medium
CN112450807A (en) * 2020-11-06 2021-03-09 苏宁智能终端有限公司 Obstacle removing control method, device and system for sweeping robot
CN113397437A (en) * 2021-07-12 2021-09-17 丁杨 Sweeping robot and obstacle avoidance method thereof
CN114509061A (en) * 2021-12-30 2022-05-17 重庆特斯联智慧科技股份有限公司 Method and system for determining robot traveling path based on barrier attributes
CN114831540A (en) * 2022-04-19 2022-08-02 珠海格力电器股份有限公司 Robot and method for using same

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1381339A (en) * 2001-04-18 2002-11-27 三星光州电子株式会社 Robot cleaning system using mobile communication network
KR20140042494A (en) * 2012-09-28 2014-04-07 엘지전자 주식회사 Robot cleaner and control method of the same
CN104236468A (en) * 2014-09-26 2014-12-24 上海未来伙伴机器人有限公司 Method and system for calculating coordinates of target space and mobile robot
CN105286729A (en) * 2015-09-25 2016-02-03 江苏美的清洁电器股份有限公司 Sweeping robot
CN106527444A (en) * 2016-11-29 2017-03-22 深圳市元征科技股份有限公司 Control method of cleaning robot and the cleaning robot
CN106821157A (en) * 2017-04-14 2017-06-13 小狗电器互联网科技(北京)股份有限公司 The cleaning method that a kind of sweeping robot is swept the floor

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101966127B1 (en) * 2013-09-05 2019-04-05 엘지전자 주식회사 robot cleaner system and a control method of the same
CN105725932B (en) * 2016-01-29 2018-12-28 江西智能无限物联科技有限公司 intelligent sweeping robot
CN105511477A (en) * 2016-02-16 2016-04-20 江苏美的清洁电器股份有限公司 Cleaning robot system and cleaning robot
CN105511478B (en) * 2016-02-23 2019-11-26 百度在线网络技术(北京)有限公司 Applied to the control method of sweeping robot, sweeping robot and terminal
CN205905026U (en) * 2016-08-26 2017-01-25 沈阳工学院 Robot system based on two mesh stereovisions

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1381339A (en) * 2001-04-18 2002-11-27 三星光州电子株式会社 Robot cleaning system using mobile communication network
KR20140042494A (en) * 2012-09-28 2014-04-07 엘지전자 주식회사 Robot cleaner and control method of the same
CN104236468A (en) * 2014-09-26 2014-12-24 上海未来伙伴机器人有限公司 Method and system for calculating coordinates of target space and mobile robot
CN105286729A (en) * 2015-09-25 2016-02-03 江苏美的清洁电器股份有限公司 Sweeping robot
CN106527444A (en) * 2016-11-29 2017-03-22 深圳市元征科技股份有限公司 Control method of cleaning robot and the cleaning robot
CN106821157A (en) * 2017-04-14 2017-06-13 小狗电器互联网科技(北京)股份有限公司 The cleaning method that a kind of sweeping robot is swept the floor

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3821780A1 (en) * 2019-11-12 2021-05-19 Nextvpu (Shanghai) Co., Ltd. Mobile robot
US11054838B2 (en) 2019-11-12 2021-07-06 NextVPU (Shanghai) Co., Ltd. Mobile robot
RU2740229C1 (en) * 2020-03-19 2021-01-12 Автономная некоммерческая образовательная организация высшего образования "Сколковский институт науки и технологий" Method of localizing and constructing navigation maps of mobile service robot
CN114442615A (en) * 2021-12-31 2022-05-06 重庆特斯联智慧科技股份有限公司 Robot traveling strategy determination method and system based on barrier attributes

Also Published As

Publication number Publication date
CN109213137A (en) 2019-01-15

Similar Documents

Publication Publication Date Title
WO2019007038A1 (en) Floor sweeping robot, floor sweeping robot system and working method thereof
WO2021031427A1 (en) Sweeping robot and automated control method for sweeping robot
KR102203439B1 (en) a Moving robot and Controlling method for the moving robot
TWI757570B (en) Robot cleaners and controlling method thereof
TWI653022B (en) Autonomous mobile body
JP6290943B2 (en) Robot cleaner and control method of robot cleaner
US9408515B2 (en) Autonomous coverage robot
US11119484B2 (en) Vacuum cleaner and travel control method thereof
US20190254490A1 (en) Vacuum cleaner and travel control method thereof
WO2017141536A1 (en) Autonomous travelling body
CN110325938B (en) Electric vacuum cleaner
TWI726031B (en) Electric sweeper
TWI731555B (en) Mobile robot and method of controlling plurality of mobile robots
TW201818175A (en) Autonomous traveling body
CN112654472A (en) Multiple autonomous mobile robots and control method thereof
US20190227566A1 (en) Self-propelled vacuum cleaner
KR102082757B1 (en) Cleaning robot and method for controlling the same
TW201824794A (en) Method for operating an automatically moving robot
TWI677314B (en) Moving devices and controlling methods, remote controlling systems and computer products thereof
KR102203438B1 (en) a Moving robot and Controlling method for the moving robot
KR20210089461A (en) A robot cleaner using artificial intelligence and control method thereof
RU2800503C1 (en) Cleaning robot and method of automatic control of cleaning robot
TWI649057B (en) Cleaning system of environmental scanning inmidiately
CN117837987A (en) Control method, cleaning robot and storage medium
AU2013338354B9 (en) Autonomous coverage robot

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18828612

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18828612

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 18828612

Country of ref document: EP

Kind code of ref document: A1