WO2020077850A1 - Method and apparatus for dividing and identifying indoor region, and terminal device - Google Patents

Method and apparatus for dividing and identifying indoor region, and terminal device Download PDF

Info

Publication number
WO2020077850A1
WO2020077850A1 PCT/CN2018/123779 CN2018123779W WO2020077850A1 WO 2020077850 A1 WO2020077850 A1 WO 2020077850A1 CN 2018123779 W CN2018123779 W CN 2018123779W WO 2020077850 A1 WO2020077850 A1 WO 2020077850A1
Authority
WO
WIPO (PCT)
Prior art keywords
area
room
indoor
image
initial map
Prior art date
Application number
PCT/CN2018/123779
Other languages
French (fr)
Chinese (zh)
Inventor
谭欢
郭盖华
谌鎏
Original Assignee
深圳乐动机器人有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳乐动机器人有限公司 filed Critical 深圳乐动机器人有限公司
Publication of WO2020077850A1 publication Critical patent/WO2020077850A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/26Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
    • G06V10/267Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds

Definitions

  • the invention belongs to the technical field of robots, and in particular relates to an indoor area division and identification method, device and terminal equipment.
  • the cleaning robot is a typical application of the mobile robot. After the initial construction of the map through the sensor, the cleaning robot divides the map into several areas and plans the cleaning path of each area to clean the room.
  • the cleaning robot always divides the area according to a fixed shape and a fixed size when planning the operation area.
  • a room with an irregular shape or a room with a large area is always divided into several small areas, so that when the robot When the divided areas are cleaned, many unnecessary transition paths will be formed.
  • This planning method makes the entire cleaning path appear chaotic on the map, resulting in low efficiency of the robot in the actual cleaning work.
  • embodiments of the present invention provide an indoor area division and identification method, device, and terminal device, to solve the problem of low work efficiency caused by a cleaning robot in the prior art due to a fixed work area and fixed path.
  • a first aspect of an embodiment of the present invention provides an indoor area division and identification method, including:
  • Morphological image processing technology is used to divide the initial map into regions to obtain at least one room region of the indoor region image
  • the area identification result corresponding to each room area is determined.
  • a second aspect of an embodiment of the present invention provides an indoor area division and identification device, including:
  • the initial map acquisition module is used to acquire the initial map
  • a room area acquisition module configured to use morphological image processing technology to partition the initial map to obtain at least one room area of the indoor area image
  • the area recognition result acquisition module is used to determine the area recognition result corresponding to each room area according to the graphic information and preset identification information of each room area.
  • a third aspect of the embodiments of the present invention provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, when the processor executes the computer program
  • a terminal device including a memory, a processor, and a computer program stored in the memory and executable on the processor, when the processor executes the computer program
  • a fourth aspect of the embodiments of the present invention provides a computer-readable storage medium that stores a computer program, which when executed by a processor implements the indoor area division and recognition method described above step.
  • an initial map is first obtained; the initial map is divided into regions using morphological image processing technology to obtain at least one room area of the indoor area image; and determined according to the graphic information and preset identification information of each room area
  • the area recognition results corresponding to each room area The embodiment of the present invention obtains the area recognition result of each room area by performing area recognition on the room area divided according to the initial map, and the area recognition result of each room area can provide more accurate cleaning data for the work of the robot, so that the robot The type of function is targeted for cleaning, making the cleaning path more clear and improving the efficiency of the robot.
  • FIG. 1 is a schematic diagram of an implementation process of an indoor area division and recognition method provided by an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of a specific implementation of S102 in FIG. 1 provided by an embodiment of the present invention
  • FIG. 3 is a schematic diagram of an implementation process of an indoor area division and recognition method provided by an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of an indoor area division and identification device provided by an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a room area acquisition module provided by an embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a terminal device provided by an embodiment of the present invention.
  • FIG. 7 is an example diagram of a binary image provided by an embodiment of the present invention.
  • FIG 8 is an example diagram of an indoor area image subjected to an expansion process provided by an embodiment of the present invention.
  • FIG. 1 shows an implementation process of an indoor area division and identification method provided by an embodiment of the present invention. The detailed process is as follows:
  • the main body of the process in this embodiment may be a robot or other computer equipment including a positioning sensor.
  • the following uses a cleaning robot as an example to further explain the indoor area division and recognition method provided by this embodiment.
  • the method for acquiring the initial map may be: scanning the indoor area, and generating the initial map according to the indoor area information obtained by the scan.
  • the cleaning robot starts to move from an unknown position.
  • the indoor area is instantly located and constructed based on the sensor data obtained by the pose estimation and the sensors installed by the cleaning robot itself to obtain the indoor area Initial map.
  • the method for obtaining the initial map may also be: calling the indoor area map stored inside the robot as the initial map, and the indoor area map stored inside the robot may be a map input by the user.
  • the indoor area may be an indoor area of an ordinary family house, an indoor area of an office building, or other indoor areas.
  • an ordinary family house is taken as an example.
  • the indoor area of an ordinary family house usually includes a living room, a bedroom, a kitchen, and Indoor areas for toilets and other areas.
  • the initial map is divided into regions using morphological image processing technology to obtain at least one room region of the indoor region image.
  • the cleaning robot after acquiring the initial map, applies image corrosion expansion processing to the initial map to distinguish the map area corresponding to each area in the indoor area so that the map is displayed as at least one room area. For example, if The indoor area is an ordinary two-bedroom room.
  • the obtained room area may include a living room area, a bedroom area, a kitchen area, and a toilet area.
  • the area recognition result corresponding to each room area is determined according to the graphic information and preset identification information of each room area.
  • the graphic information may include the area, shape, and topology of the room area
  • the preset identification information may include area threshold, topology, and shape information corresponding to each area of various sample images.
  • the room area is a bedroom.
  • the embodiment of the present invention first obtains an initial map; uses morphological image processing technology to divide the initial map into regions to obtain at least one room area of the indoor area image; Preset identification information to determine the area identification result corresponding to each room area.
  • the embodiment of the present invention by performing area recognition on the room areas divided according to the initial map, the area recognition results of each room area are obtained, which can provide more accurate cleaning data for the work of the robot, so that the robot can be targeted according to the function type of each area The cleaning work makes the cleaning path clearer and improves the working efficiency of the robot.
  • the positioning information of the robot in the indoor area is obtained.
  • the cleaning robot acquires its positioning information in the indoor area through a sensor mounted on the robot.
  • the sensor of the cleaning robot may include a laser ranging sensor and an ultrasonic sensor.
  • the indoor area is constructed according to the real-time positioning and map construction algorithm and the positioning information to generate the initial map.
  • the real-time positioning and map construction algorithm is SLAM ((simultaneous localization and mapping) algorithm, based on the positioning information obtained by the sensor, the SLAM algorithm is used to build an incremental map to achieve the autonomous positioning and map construction of the cleaning robot.
  • SLAM (simultaneous localization and mapping) algorithm
  • the map construction of the entire indoor area can be completed in real time when the robot first works, thereby improving the accuracy of the initial map and providing map data support for subsequent precise cleaning.
  • FIG. 2 shows the specific implementation process of S102 in FIG. 1, and the detailed process is as follows:
  • FIG. 7 shows an example diagram of a binarized image.
  • the initial map is first binarized to obtain a foreground area with a pixel value of 1 and a background area with a pixel value of 0, where the foreground area is an indoor area scanned by the robot.
  • image erosion processing is performed on the binarized image to obtain the indoor area image, and the connected domain in the indoor area image is detected.
  • the area scanned by the robot includes the bedroom and the living room, because the bedroom and the living room are connected, when creating the initial map, there are fewer pixel connections between the area corresponding to the bedroom and the area corresponding to the living room. If the two areas are connected, the robot It is impossible to accurately determine the function type of each area based on the connected areas. Therefore, the binary image needs to be eroded to delete pixels between two larger connected areas to divide the two areas.
  • This process specifically includes: first performing a predetermined number of image erosion processes on the binarized image.
  • the image erosion process can delete the pixels on the edge of the binarized image to separate the connection parts of each area to obtain the indoor area image, and then scan the entire indoor In the area image, the connected area is detected on the indoor area image according to the pixel value of each pixel of the indoor area image, and at least one connected area in the indoor area image is acquired.
  • each connected domain in the indoor area image is subjected to an expansion process, and the region within the smallest circumscribed polygon of each connected domain after the expansion process is taken as the room region corresponding to the connected domain.
  • FIG. 8 shows an example diagram of an indoor area image subjected to an expansion process.
  • the smallest circumscribed polygon of the single connected domain is selected so that the smallest circumscribed polygon surrounds the connected domain, and the area within the smallest circumscribed polygon is taken as the room area corresponding to the connected domain, Repeat the above process to get the room area corresponding to each connected domain.
  • the smallest circumscribed polygon may be the smallest circumscribed rectangle.
  • the graphic information includes area area, area shape, and area connection topological relationship.
  • S103 in FIG. 1 specifically includes:
  • the function type of each room area is obtained.
  • the robot before the robot works, first obtain a large number of indoor structure diagrams of ordinary family houses as sample images, and count the area size, topological relationship and area shape of each area in the sample image to form preset identification information. Obtain the graphic information of the indoor area where the robot is located, and compare with the preset identification information to obtain the function type of each room area.
  • the topological relationship of the area connection of the living room in an ordinary family house is to communicate with the dining room, bedroom and kitchen, respectively.
  • the shape of the kitchen area is a large rectangular channel.
  • Determine the function type of the room area For example, when it is detected that the area of the room area to be determined is within the area of the living room and it is connected to a plurality of other room areas, it can be determined that the function type of the room area to be determined is the living room.
  • the indoor area division and recognition method provided by this embodiment further includes:
  • the area recognition result is sent to a user terminal, so that the user terminal displays the area recognition result.
  • the area identification result correction information is a user acquired by the user terminal Correction information input when it is checked that there is an error in the area recognition result.
  • the cleaning robot can automatically perform area recognition based on the initial map generated by itself, and work in a corresponding working mode in each room area according to the area recognition result.
  • the cleaning robot may send the area recognition result to the user terminal, which may be a mobile phone or a computer.
  • the user terminal displays the area recognition result.
  • the user views the area recognition result through the user terminal and corrects the area recognition result when the area recognition result is found to be incorrect.
  • the user terminal obtains the correction information input by the user and generates the area recognition based on the correction information entered by the user Result correction information, and send the area recognition result correction information to the cleaning robot, the cleaning robot replaces the area recognition result with the area recognition result correction information, so that the cleaning robot will switch according to the corrected area recognition result in subsequent cleaning work Operating mode.
  • the user terminal may also generate an area identification sample according to the corrected area identification result, where the area identification sample includes the graphic information of each room area in the indoor area and the corresponding area identification result.
  • the user terminal sends the area identification sample to the server, and the server adds the area identification sample to the preset identification information, thereby updating the preset identification information, and the server can periodically send the updated preset identification information to all the cleaners that communicate with the server Robot, so that the cleaning robot can more accurately identify the function of each area, and improve the accuracy of the area recognition results.
  • the area recognition method provided by the embodiment of the present invention further includes:
  • the working mode corresponding to each room area is determined.
  • the floor cleaning conditions are also different. Setting different working modes for the cleaning robot according to the rooms with different functions can make the cleaning robot more targeted Carry out cleaning work to improve the cleaning level and efficiency of the robot.
  • the area recognition result includes a kitchen, a living room, and a bedroom.
  • the area recognition method provided in the embodiment of the present invention further specifically includes:
  • the working mode is adjusted to a regular cleaning mode.
  • different working modes may include different cleaning powers and cleaning frequencies. Therefore, different cleaning powers and cleaning frequencies are adopted for areas with different functions. For example, the cleaning frequency of the living room and kitchen may be greater than the cleaning frequency of the bedroom. In this way, the cleaning robot can not only keep the entire indoor space clean, but also shorten the time of cleaning work and prolong the service life of the cleaning robot.
  • the kitchen needs to process ingredients, and the ground is usually dirty and accompanied by oil stains. Therefore, the working mode of the robot in the kitchen can adopt a super-cleaning mode, so that the cleaning robot can Remove ground rubbish and oil stains; because there are frequent people in and out of the living room, the ground is dirty, so a powerful cleaning mode can be used for the living room, so that the cleaning robot can remove the dust and garbage in the living room; because there are fewer people in and out of the bedroom, you can choose regular Clean mode.
  • the area recognition method provided by the embodiment of the present invention further includes:
  • the user can set a certain room area in the recognized area recognition result as a prohibited area, which includes multiple edges.
  • a prohibited area which includes multiple edges.
  • the robot In the prohibited cleaning mode, when the robot reaches the outer edge of the prohibited area , Then stop advancing and turn to continue to work in other areas outside the prohibited area. For example, if the prohibited area is a kitchen, the robot does not enter the kitchen and turns when it reaches the edge of the kitchen, and only cleans the room area that is not set as a no-entry area.
  • an indoor area dividing and identifying device 100 provided by an embodiment of the present invention is used to execute the method steps in the embodiment corresponding to FIG. 1, which includes:
  • the initial map acquisition module 110 is used to acquire an initial map
  • the room area acquisition module 120 is configured to use morphological image processing technology to perform area division on the initial map to obtain at least one room area of the indoor area image;
  • the area recognition result obtaining module 130 is used to determine the area recognition result corresponding to each room area according to the graphic information and preset identification information of each room area.
  • the embodiment of the present invention first obtains an initial map; uses morphological image processing technology to divide the initial map into regions to obtain at least one room area of the indoor area image; according to the graphic information of each room area and Preset identification information to determine the area identification result corresponding to each room area.
  • the embodiment of the present invention by performing area recognition on the room areas divided according to the initial map, the area recognition results of each room area are obtained, which can provide more accurate cleaning data for the work of the robot, so that the robot can be targeted according to the function type of each area The cleaning work makes the cleaning path clearer and improves the working efficiency of the robot.
  • the initial map acquisition module 110 in the embodiment corresponding to FIG. 4 specifically includes:
  • the positioning information acquiring unit is used to acquire positioning information of the robot in the indoor area.
  • An initial map acquisition unit is used to construct a map of the indoor area according to the real-time positioning and map construction algorithm and the positioning information to generate the initial map.
  • the map construction of the entire indoor area can be completed in real time when the cleaning robot first works, thereby improving the accuracy of the initial map and providing map data support for subsequent accurate cleaning.
  • the room area acquisition module 120 in FIG. 4 further includes a structure for executing the method steps in the embodiment corresponding to FIG. 2, which includes:
  • a binarized image acquisition unit 121 configured to perform binarization processing on the initial map to obtain a binarized image corresponding to the initial map;
  • the indoor area image acquisition unit 122 is configured to perform image erosion processing on the binarized image to obtain the indoor area image, and detect the connected domain in the indoor area image.
  • the room area acquisition unit 123 is configured to perform expansion processing on each connected domain in the indoor area image, and use the area within the smallest circumscribed polygon of each connected domain after the expansion processing as the room area corresponding to the connected domain.
  • the graphic information includes area area, area shape, and area connection topology relationship.
  • the area recognition result acquisition module in FIG. 4 specifically includes:
  • the function type of each room area is obtained.
  • the indoor area division and recognition device 100 further includes a structure for executing the method steps in the embodiment corresponding to FIG. 3, which includes:
  • An area recognition result sending module configured to send the area recognition result to a user terminal, so that the user terminal displays the area recognition result
  • An area recognition result correction module configured to receive area recognition result correction information sent by the preset terminal, and correct the area recognition result according to the area recognition result correction information, and the area recognition result correction information is the user terminal The obtained correction information that the user inputs when checking that the area recognition result has an error.
  • the user corrects the area recognition result automatically recognized by the robot through the user terminal, which can further improve the accuracy of the area recognition result, so that the cleaning robot can perform the switching work according to the corrected area recognition result in the subsequent cleaning work mode.
  • the indoor area division and identification device further includes:
  • the working mode confirmation module is used to determine the working mode corresponding to each room area according to the area recognition result corresponding to each room area.
  • the working mode confirmation module specifically includes:
  • a super strong pollution purification mode confirmation unit used to adjust the working module to a super strong pollution purification mode if the area recognition result is a kitchen;
  • a powerful cleaning mode confirmation unit configured to adjust the working mode to a powerful cleaning mode if the area recognition result is a living room
  • the normal cleaning mode confirmation unit is used to adjust the working mode to the normal cleaning mode if the area recognition result is a bedroom.
  • the working mode confirmation module further includes:
  • a forbidden area acquisition unit configured to acquire a forbidden area input by a user, and compare the area identification result with the forbidden area
  • the forbidden working module confirmation unit is configured to adjust the working mode to a forbidden cleaning mode if the area recognition result is consistent with the forbidden area.
  • the ground cleanliness is also different. Setting different working modes for the cleaning robot according to the rooms with different functions can make the cleaning robot more targeted for cleaning Work, thereby improving the cleaning level and working efficiency of the robot.
  • the indoor area division and identification device 100 further includes other functional modules / units for implementing the method steps in each of the embodiments.
  • An embodiment of the present invention further provides a terminal device 6, including a memory 61, a processor 60, and a computer program 62 stored in the memory 61 and executable on the processor 60, and the processor 60 executes the computer program 62
  • the steps in each of the embodiments described in Embodiment 1 are implemented, for example, steps S101 to S103 shown in FIG. 1.
  • the processor 60 executes the computer program 62
  • the functions of each module in each device embodiment described in Embodiment 2 are realized, for example, the functions of the modules 110 to 130 shown in FIG. 4.
  • the terminal device 6 may be a computing device such as a desktop computer, a notebook, a palmtop computer and a cloud server.
  • the terminal device 6 may include, but is not limited to, a processor 60 and a memory 61.
  • the terminal device 6 may further include input and output devices, network access devices, buses, and the like.
  • the so-called processor 60 may be a central processing unit (Central Processing Unit (CPU), can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (Application Specific Integrated Circuit (ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • the general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
  • the memory 61 may be an internal storage unit of the terminal device 6, such as a hard disk or a memory of the terminal device 6.
  • the memory 61 may also be an external storage device of the terminal device 6, such as a plug-in hard disk equipped on the terminal device 6, a smart memory card (Smart Media Card, SMC), and secure digital (SD) Flash card Card) etc. Further, the memory 61 may also include both an internal storage unit of the terminal device 6 and an external storage device.
  • the memory 61 is used to store the computer program 62 and other programs and data required by the terminal device 6.
  • the memory 61 can also be used to temporarily store data that has been or will be output.
  • An embodiment of the present invention also provides a computer-readable storage medium that stores a computer program 62, and when the computer program 62 is executed by the processor 60, the steps in the embodiments described in Embodiment 1 are implemented. , For example, steps S101 to S103 shown in FIG. 1.
  • the functions of the modules in the device embodiments described in Embodiment 2 are implemented, for example, the functions of the modules 110 to 130 shown in FIG.
  • the computer program 62 can be stored in a computer-readable storage medium. When the computer program 62 is executed by the processor 60, the steps of the foregoing method embodiments can be implemented.
  • the computer program 62 includes computer program code, and the computer program code may be in a source code form, an object code form, an executable file, or some intermediate form, etc.
  • the computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a mobile hard disk, a magnetic disk, an optical disc, a computer memory, a read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signals, telecommunication signals, and software distribution media.
  • computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in jurisdictions.
  • computer-readable media Excluded are electrical carrier signals and telecommunications signals.
  • modules or units in the system of the embodiment of the present invention may be combined, divided, and deleted according to actual needs.

Abstract

The solution is applicable to the technical field of robots. Provided are a method and apparatus for dividing and identifying an indoor region, and a terminal device. The method comprises: obtaining an initial map; performing region division on the initial map by using a morphological image processing technology to obtain at least one room region of the indoor region image; and determining the region identification result corresponding to room regions according to graphic information of the room regions and preset identification information. According to the solution, the initial map is performed room division and the divided room regions are performed region identification to obtain the region identification result corresponding to room regions, which can provide more accurate cleaning data for a robot so that the robot can particularly clean according to the function type of the regions, the cleaning path is more clear, and the operation efficiency of the robot is improved.

Description

一种室内区域划分和识别方法、装置及终端设备Indoor area division and recognition method, device and terminal equipment 技术领域Technical field
本发明属于机器人技术领域,尤其涉及一种室内区域划分和识别方法、装置及终端设备。The invention belongs to the technical field of robots, and in particular relates to an indoor area division and identification method, device and terminal equipment.
背景技术Background technique
随着技术的发展进步,移动机器人被广泛地使用以辅助或替代人类完成一些基础重复的工作。其中,清洁机器人是移动机器人的典型应用,清洁机器人在通过传感器进行初始建图后,将地图分为若干区域并规划各区域的清扫路径对房间进行清洁。With the development of technology, mobile robots are widely used to assist or replace humans to complete some basic repetitive work. Among them, the cleaning robot is a typical application of the mobile robot. After the initial construction of the map through the sensor, the cleaning robot divides the map into several areas and plans the cleaning path of each area to clean the room.
目前,清洁机器人在规划作业区域时总是按照固定形状、固定大小去划分区域,通常一个形状不规则的房间或面积较大的房间总会被划分为若干个小区域,这样当机器人对每个划分的区域进行清洁时,会形成很多不必要的转场路径,这种规划方式让整个清洁路径在地图上显示混乱,导致机器人在实际清洁工作中工作效率低下。At present, the cleaning robot always divides the area according to a fixed shape and a fixed size when planning the operation area. Usually, a room with an irregular shape or a room with a large area is always divided into several small areas, so that when the robot When the divided areas are cleaned, many unnecessary transition paths will be formed. This planning method makes the entire cleaning path appear chaotic on the map, resulting in low efficiency of the robot in the actual cleaning work.
技术问题technical problem
有鉴于此,本发明实施例提供了一种室内区域划分和识别方法、装置及终端设备,以解决现有技术中清洁机器人因工作区域及路径固定而导致的工作效率低下的问题。In view of this, embodiments of the present invention provide an indoor area division and identification method, device, and terminal device, to solve the problem of low work efficiency caused by a cleaning robot in the prior art due to a fixed work area and fixed path.
技术解决方案Technical solution
本发明实施例的第一方面提供了一种室内区域划分和识别方法,包括:A first aspect of an embodiment of the present invention provides an indoor area division and identification method, including:
获取初始地图;Get the initial map;
采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域;Morphological image processing technology is used to divide the initial map into regions to obtain at least one room region of the indoor region image;
根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果。According to the graphic information and preset identification information of each room area, the area identification result corresponding to each room area is determined.
本发明实施例的第二方面提供了一种室内区域划分和识别装置,包括:A second aspect of an embodiment of the present invention provides an indoor area division and identification device, including:
初始地图获取模块,用于获取初始地图;The initial map acquisition module is used to acquire the initial map;
房间区域获取模块,用于采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域;A room area acquisition module, configured to use morphological image processing technology to partition the initial map to obtain at least one room area of the indoor area image;
区域识别结果获取模块,用于根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果。The area recognition result acquisition module is used to determine the area recognition result corresponding to each room area according to the graphic information and preset identification information of each room area.
本发明实施例的第三方面提供了一种终端设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如上所述室内区域划分和识别方法的步骤。A third aspect of the embodiments of the present invention provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, when the processor executes the computer program The steps of the indoor area division and recognition method as described above are implemented.
本发明实施例的第四方面提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时实现如上所述室内区域划分和识别方法的步骤。A fourth aspect of the embodiments of the present invention provides a computer-readable storage medium that stores a computer program, which when executed by a processor implements the indoor area division and recognition method described above step.
有益效果Beneficial effect
本发明实施例首先获取初始地图;采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域;根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果。本发明实施例通过对根据初始地图划分的房间区域进行区域识别,得到各个房间区域的区域识别结果,各个房间区域的区域识别结果能够为机器人的工作提供更加准确地清扫数据,使机器人根据各个区域的功能类型针对性的进行清洁工作,使清洁路径更加明确,提高机器人的工作效率。In the embodiment of the present invention, an initial map is first obtained; the initial map is divided into regions using morphological image processing technology to obtain at least one room area of the indoor area image; and determined according to the graphic information and preset identification information of each room area The area recognition results corresponding to each room area. The embodiment of the present invention obtains the area recognition result of each room area by performing area recognition on the room area divided according to the initial map, and the area recognition result of each room area can provide more accurate cleaning data for the work of the robot, so that the robot The type of function is targeted for cleaning, making the cleaning path more clear and improving the efficiency of the robot.
附图说明BRIEF DESCRIPTION
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly explain the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only for the application In some embodiments, for those of ordinary skill in the art, without paying creative labor, other drawings may be obtained based on these drawings.
图1是本发明实施例提供的室内区域划分和识别方法的实现流程示意图;1 is a schematic diagram of an implementation process of an indoor area division and recognition method provided by an embodiment of the present invention;
图2是本发明实施例提供的图1中S102的具体实现流程示意图;2 is a schematic flowchart of a specific implementation of S102 in FIG. 1 provided by an embodiment of the present invention;
图3是本发明实施例提供的室内区域划分和识别方法的实现流程示意图;3 is a schematic diagram of an implementation process of an indoor area division and recognition method provided by an embodiment of the present invention;
图4是本发明实施例提供的室内区域划分和识别装置的结构示意图;4 is a schematic structural diagram of an indoor area division and identification device provided by an embodiment of the present invention;
图5是本发明实施例提供的房间区域获取模块的结构示意图;5 is a schematic structural diagram of a room area acquisition module provided by an embodiment of the present invention;
图6是本发明实施例提供的终端设备的示意图;6 is a schematic diagram of a terminal device provided by an embodiment of the present invention;
图7是本发明实施例提供的二值化图像的示例图;7 is an example diagram of a binary image provided by an embodiment of the present invention;
图8是本发明实施例提供的经过膨胀处理的室内区域图像的示例图。8 is an example diagram of an indoor area image subjected to an expansion process provided by an embodiment of the present invention.
本发明的实施方式Embodiments of the invention
以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、技术之类的具体细节,以便透彻理解本申请实施例。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本申请。在其它情况中,省略对众所周知的系统、装置、电路以及方法的详细说明,以免不必要的细节妨碍本申请的描述。In the following description, for the purpose of illustration rather than limitation, specific details such as specific system structure and technology are proposed to thoroughly understand the embodiments of the present application. However, those skilled in the art should understand that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary details.
为了说明本申请所述的技术方案,下面通过具体实施例来进行说明。In order to explain the technical solutions described in the present application, the following will be described with specific embodiments.
实施例Examples 11
图1示出了本发明的一个实施例提供的一种室内区域划分和识别方法的实现流程,其过程详述如下:FIG. 1 shows an implementation process of an indoor area division and identification method provided by an embodiment of the present invention. The detailed process is as follows:
在S101中,获取初始地图。In S101, an initial map is acquired.
在本实施例中,本实施例的流程主体可以为机器人,也可以为其他包括定位传感器的计算机设备。以下以清洁机器人为例,对本实施例提供的室内区域划分和识别方法做进一步解释。In this embodiment, the main body of the process in this embodiment may be a robot or other computer equipment including a positioning sensor. The following uses a cleaning robot as an example to further explain the indoor area division and recognition method provided by this embodiment.
在本实施例中,获取初始地图的方法可以为:对室内区域进行扫描,并根据扫描得到的室内区域信息生成初始地图。In this embodiment, the method for acquiring the initial map may be: scanning the indoor area, and generating the initial map according to the indoor area information obtained by the scan.
具体地,在第一次清扫室内区域时,清洁机器人从未知位置开始移动,在移动的过程中根据位姿估计和清洁机器人自身安装的传感器获取的传感器数据进行即时定位和建图,得到室内区域的初始地图。Specifically, when the indoor area is cleaned for the first time, the cleaning robot starts to move from an unknown position. During the movement, the indoor area is instantly located and constructed based on the sensor data obtained by the pose estimation and the sensors installed by the cleaning robot itself to obtain the indoor area Initial map.
在本实施例中,获取初始地图的方法还可以为:调用机器人内部存储的室内区域地图为初始地图,机器人内部存储的室内区域地图可以为用户输入的地图。In this embodiment, the method for obtaining the initial map may also be: calling the indoor area map stored inside the robot as the initial map, and the indoor area map stored inside the robot may be a map input by the user.
在本实施例中,室内区域可以为普通家庭住宅室内区域、办公楼室内区域或其他室内区域,本实施例以普通家庭住宅为例,普通家庭住宅的室内区域通常为包括客厅、卧室、厨房和卫生间等区域的室内区域。In this embodiment, the indoor area may be an indoor area of an ordinary family house, an indoor area of an office building, or other indoor areas. In this embodiment, an ordinary family house is taken as an example. The indoor area of an ordinary family house usually includes a living room, a bedroom, a kitchen, and Indoor areas for toilets and other areas.
在S102中,采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域。In S102, the initial map is divided into regions using morphological image processing technology to obtain at least one room region of the indoor region image.
在本实施例中,清洁机器人在获取到初始地图后,对初始地图采用图像腐蚀膨胀处理,将室内区域中的各个区域对应的地图区域区分开,使地图显示为至少一个房间区域,例如,若室内区域为普通二居室,则初始地图经过图像处理后,得到的房间区域可以包括客厅区域、卧室区域、厨房区域和卫生间区域。In this embodiment, after acquiring the initial map, the cleaning robot applies image corrosion expansion processing to the initial map to distinguish the map area corresponding to each area in the indoor area so that the map is displayed as at least one room area. For example, if The indoor area is an ordinary two-bedroom room. After the initial map is image-processed, the obtained room area may include a living room area, a bedroom area, a kitchen area, and a toilet area.
在S103中,根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果。In S103, the area recognition result corresponding to each room area is determined according to the graphic information and preset identification information of each room area.
在本实施例中,图形信息可以包括房间区域的面积、形状及拓扑结构,预设识别信息可以包括各种样本图像的各个区域对应的面积阈值、拓扑结构及形状信息。通过分别比对各个房间区域的图形信息与样本图像的预设识别信息,可将识别出各个房间区域的功能类型作为区域识别结果。In this embodiment, the graphic information may include the area, shape, and topology of the room area, and the preset identification information may include area threshold, topology, and shape information corresponding to each area of various sample images. By comparing the graphic information of each room area with the preset identification information of the sample image, the function type that identifies each room area can be used as the area recognition result.
例如,当本实施例中室内区域的某个房间区域的面积满足样本图像中卧室的面积阈值条件,且为与客厅通过一扇门相连的拓扑结构时,可判定该房间区域为卧室。For example, when the area of a certain room area in the indoor area in this embodiment satisfies the area threshold condition of the bedroom in the sample image and is a topology structure connected to the living room through a door, it can be determined that the room area is a bedroom.
从上述实施例可知,本发明实施例首先获取初始地图;采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域;根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果。本发明实施例通过对根据初始地图划分的房间区域进行区域识别,得到各个房间区域的区域识别结果,能够为机器人的工作提供更加准确地清扫数据,使机器人根据各个区域的功能类型针对性的进行清洁工作,使清洁路径更加明确,提高机器人的工作效率。It can be known from the above embodiments that the embodiment of the present invention first obtains an initial map; uses morphological image processing technology to divide the initial map into regions to obtain at least one room area of the indoor area image; Preset identification information to determine the area identification result corresponding to each room area. In the embodiment of the present invention, by performing area recognition on the room areas divided according to the initial map, the area recognition results of each room area are obtained, which can provide more accurate cleaning data for the work of the robot, so that the robot can be targeted according to the function type of each area The cleaning work makes the cleaning path clearer and improves the working efficiency of the robot.
在本发明的一个实施例中,图1中S101的具体实现流程如下:In an embodiment of the present invention, the specific implementation process of S101 in FIG. 1 is as follows:
在一个实施例中,获取机器人在所述室内区域的定位信息。In one embodiment, the positioning information of the robot in the indoor area is obtained.
在本实施例中,清洁机器人通过自身搭载的传感器获取自身在室内区域内的定位信息,其中,清洁机器人的传感器可以包括激光测距传感器和超声波传感器。In this embodiment, the cleaning robot acquires its positioning information in the indoor area through a sensor mounted on the robot. The sensor of the cleaning robot may include a laser ranging sensor and an ultrasonic sensor.
在一个实施例中,根据即时定位与地图构建算法及所述定位信息对所述室内区域进行地图构建,生成所述初始地图。In one embodiment, the indoor area is constructed according to the real-time positioning and map construction algorithm and the positioning information to generate the initial map.
在本实施例中,即时定位与地图构建算法即SLAM((simultaneous localization and mapping)算法,根据传感器获取的定位信息,通过SLAM算法建造增量式地图,实现清洁机器人的自主定位及地图构建。In this embodiment, the real-time positioning and map construction algorithm is SLAM ((simultaneous localization and mapping) algorithm, based on the positioning information obtained by the sensor, the SLAM algorithm is used to build an incremental map to achieve the autonomous positioning and map construction of the cleaning robot.
从上述实施例可知,通过SLAM算法,可在机器人第一次工作时实时的完成整个室内区域的地图构建,从而提高初始地图的准确性,并为后续的精准清洁提供地图数据支持。It can be seen from the above embodiments that, through the SLAM algorithm, the map construction of the entire indoor area can be completed in real time when the robot first works, thereby improving the accuracy of the initial map and providing map data support for subsequent precise cleaning.
如图2所示,在本发明的一个实施例中,图2示出了图1中S102的具体实现流程,其过程详述如下:As shown in FIG. 2, in one embodiment of the present invention, FIG. 2 shows the specific implementation process of S102 in FIG. 1, and the detailed process is as follows:
在S201中,对所述初始地图进行二值化处理,得到所述初始地图对应的二值化图像。In S201, binarization processing is performed on the initial map to obtain a binarized image corresponding to the initial map.
如图7所示,在本实施例中,图7示出了二值化图像的示例图。As shown in FIG. 7, in this embodiment, FIG. 7 shows an example diagram of a binarized image.
在本实施例中,首先对初始地图进行二值化处理,得到像素值为1的前景区域和像素值为0的背景区域,其中前景区域为机器人扫描的室内区域。In this embodiment, the initial map is first binarized to obtain a foreground area with a pixel value of 1 and a background area with a pixel value of 0, where the foreground area is an indoor area scanned by the robot.
在S202中,对所述二值化图像进行图像腐蚀处理,得到所述室内区域图像,并检测所述室内区域图像中的连通域。In S202, image erosion processing is performed on the binarized image to obtain the indoor area image, and the connected domain in the indoor area image is detected.
当机器人扫描的区域包括卧室和客厅时,由于卧室和客厅是相连的,因此在创建初始地图时,卧室对应的区域和客厅对应的区域存在较少的像素点连接,若两个区域连接,机器人则无法根据相连通的区域准确的判断各个区域的功能类型,因此,需要对二值化图像进行腐蚀处理,删除两个较大的连通域之间的像素点,从而分割两个区域。When the area scanned by the robot includes the bedroom and the living room, because the bedroom and the living room are connected, when creating the initial map, there are fewer pixel connections between the area corresponding to the bedroom and the area corresponding to the living room. If the two areas are connected, the robot It is impossible to accurately determine the function type of each area based on the connected areas. Therefore, the binary image needs to be eroded to delete pixels between two larger connected areas to divide the two areas.
此过程具体包括:首先对二值化图像进行预设次数的图像腐蚀处理,图像腐蚀处理可以删除二值化图像边缘的像素点,使各个区域连接部分分离,得到室内区域图像,然后扫描整个室内区域图像,根据室内区域图像各个像素点的像素值对室内区域图像进行连通域检测,获取室内区域图像中的至少一个连通域。This process specifically includes: first performing a predetermined number of image erosion processes on the binarized image. The image erosion process can delete the pixels on the edge of the binarized image to separate the connection parts of each area to obtain the indoor area image, and then scan the entire indoor In the area image, the connected area is detected on the indoor area image according to the pixel value of each pixel of the indoor area image, and at least one connected area in the indoor area image is acquired.
在S203中,对所述室内区域图像中的各个连通域分别进行膨胀处理,并将经过膨胀处理后的各个连通域的最小外接多边形内的区域作为对应连通域的房间区域。In S203, each connected domain in the indoor area image is subjected to an expansion process, and the region within the smallest circumscribed polygon of each connected domain after the expansion process is taken as the room region corresponding to the connected domain.
如图8所示,在本实施例中,图8示出了经过膨胀处理的室内区域图像的实例图。As shown in FIG. 8, in this embodiment, FIG. 8 shows an example diagram of an indoor area image subjected to an expansion process.
在本实施例中,由于室内区域图像经过腐蚀,各个房间对应的区域面积会减小,因此,在分割出各个连通域后,需要单独的对各个连通域进行预设次数的膨胀处理,使各个房间对应的连通域恢复到初始地图中对应的面积,如图8中的1至7为室内区域图像中的各个经过膨胀后的连通域。In this embodiment, since the image of the indoor area is corroded, the area of the area corresponding to each room will be reduced. Therefore, after each connected domain is segmented, it is necessary to separately perform a predetermined number of expansion processes on each connected domain to make each The connected domain corresponding to the room is restored to the corresponding area in the initial map, as shown in Figures 1 to 7 are the expanded connected domains in the indoor area image.
在本实施例中,针对膨胀处理后的单个连通域,选取单个连通域的最小外接多边形,使最小外接多边形包围该连通域,并将最小外接多边形内的区域作为该连通域对应的房间区域,重复上述过程,得到各个连通域对应的房间区域。In this embodiment, for the single connected domain after expansion processing, the smallest circumscribed polygon of the single connected domain is selected so that the smallest circumscribed polygon surrounds the connected domain, and the area within the smallest circumscribed polygon is taken as the room area corresponding to the connected domain, Repeat the above process to get the room area corresponding to each connected domain.
在本实施例中,最小外接多边形可以为最小外接矩形。In this embodiment, the smallest circumscribed polygon may be the smallest circumscribed rectangle.
在本发明的一个实施例中,图形信息包括区域面积、区域形状和区域连接拓扑关系,图1中S103具体包括:In one embodiment of the present invention, the graphic information includes area area, area shape, and area connection topological relationship. S103 in FIG. 1 specifically includes:
根据各个房间区域对应的区域面积、区域形状、区域连接拓扑关系及预设识别信息,得到各个房间区域的功能类型。According to the area area, area shape, area connection topology relationship and preset identification information corresponding to each room area, the function type of each room area is obtained.
在本实施例中,在机器人工作之前,首先获取大量的普通家庭住宅室内结构图作为样本图像,统计样本图像中各个区域的面积大小、区域连接拓扑关系及区域形状,形成预设识别信息,通过获取机器人所处的室内区域的图形信息,与预设识别信息进行对比,可以得到各个房间区域的功能类型。In this embodiment, before the robot works, first obtain a large number of indoor structure diagrams of ordinary family houses as sample images, and count the area size, topological relationship and area shape of each area in the sample image to form preset identification information. Obtain the graphic information of the indoor area where the robot is located, and compare with the preset identification information to obtain the function type of each room area.
以一个具体的应用场景为例,普通家庭住宅中客厅的区域连接拓扑关系为分别与餐厅、卧室和厨房互通,厨房的区域形状为存在较大的长方形通道,根据这样的图形信息,可以判断待确定的房间区域的功能类型。例如,当检测到待确定的房间区域的面积处于客厅的面积范围,且其与多个其他的房间区域连接,则可以判定该待确定的房间区域的功能类型为客厅。Taking a specific application scenario as an example, the topological relationship of the area connection of the living room in an ordinary family house is to communicate with the dining room, bedroom and kitchen, respectively. The shape of the kitchen area is a large rectangular channel. Determine the function type of the room area. For example, when it is detected that the area of the room area to be determined is within the area of the living room and it is connected to a plurality of other room areas, it can be determined that the function type of the room area to be determined is the living room.
如图3所示,在本发明的一个实施例中,在图1中S103之后,本实施例提供的室内区域划分和识别方法还包括:As shown in FIG. 3, in an embodiment of the present invention, after S103 in FIG. 1, the indoor area division and recognition method provided by this embodiment further includes:
在S301中,将所述区域识别结果发送至用户终端,以使所述用户终端显示所述区域识别结果。In S301, the area recognition result is sent to a user terminal, so that the user terminal displays the area recognition result.
在S302中,接收所述预设终端发送的区域识别结果修正信息,并根据所述区域识别结果修正信息修正所述区域识别结果,所述区域识别结果修正信息为所述用户终端获取到的用户在检查出所述区域识别结果存在错误时输入的修正信息。In S302, receiving area identification result correction information sent by the preset terminal, and modifying the area identification result according to the area identification result correction information, the area identification result correction information is a user acquired by the user terminal Correction information input when it is checked that there is an error in the area recognition result.
在本实施例中,清洁机器人可根据自身生成的初始地图自动的进行区域识别,并根据区域识别结果在各个房间区域中采用对应的工作模式工作。同时,在获取到区域识别结果后,清洁机器人可以将区域识别结果发送至用户终端,用户终端可以为手机或者计算机电脑。In this embodiment, the cleaning robot can automatically perform area recognition based on the initial map generated by itself, and work in a corresponding working mode in each room area according to the area recognition result. At the same time, after obtaining the area recognition result, the cleaning robot may send the area recognition result to the user terminal, which may be a mobile phone or a computer.
用户终端显示区域识别结果,用户通过用户终端查看区域识别结果,并在发现区域识别结果出现错误时对区域识别结果进行修正,用户终端获取用户输入的修正信息,根据用户输入的修正信息生成区域识别结果修正信息,并将区域识别结果修正信息发送至清洁机器人,清洁机器人将区域识别结果替换为区域识别结果修正信息,从而使清洁机器人在后续的清洁工作中根据修正后的区域识别结果对应的切换工作模式。The user terminal displays the area recognition result. The user views the area recognition result through the user terminal and corrects the area recognition result when the area recognition result is found to be incorrect. The user terminal obtains the correction information input by the user and generates the area recognition based on the correction information entered by the user Result correction information, and send the area recognition result correction information to the cleaning robot, the cleaning robot replaces the area recognition result with the area recognition result correction information, so that the cleaning robot will switch according to the corrected area recognition result in subsequent cleaning work Operating mode.
在本发明的一个实施例中,用户终端还可以根据修正后的区域识别结果,生成区域识别样本,区域识别样本包括该室内区域中各个房间区域的图形信息及对应的区域识别结果。用户终端将区域识别样本发送至服务器,服务器将区域识别样本添加到预设识别信息中,从而更新预设识别信息,服务器可以定期的将更新后的预设识别信息发送至所有与服务器通信的清洁机器人,从而使清洁机器人能够更加准确的识别出各个区域的功能,提高区域识别结果的准确性。In an embodiment of the present invention, the user terminal may also generate an area identification sample according to the corrected area identification result, where the area identification sample includes the graphic information of each room area in the indoor area and the corresponding area identification result. The user terminal sends the area identification sample to the server, and the server adds the area identification sample to the preset identification information, thereby updating the preset identification information, and the server can periodically send the updated preset identification information to all the cleaners that communicate with the server Robot, so that the cleaning robot can more accurately identify the function of each area, and improve the accuracy of the area recognition results.
在本发明的一个实施例中,本发明实施例所提供的区域识别方法还包括:In an embodiment of the present invention, the area recognition method provided by the embodiment of the present invention further includes:
根据各个房间区域对应的区域识别结果,确定各个房间区域对应的工作模式。According to the area recognition results corresponding to each room area, the working mode corresponding to each room area is determined.
在本实施例中,由于普通家庭住宅室内的各个区域的功能类型不同,其地面的洁净情况也不同,根据不同功能的房间对清洁机器人设置不同的工作模式,能够使清洁机器人更加有针对性的进行清洁工作,从而提高机器人的清洁水平和效率。In this embodiment, due to the different types of functions in each area of the ordinary family house, the floor cleaning conditions are also different. Setting different working modes for the cleaning robot according to the rooms with different functions can make the cleaning robot more targeted Carry out cleaning work to improve the cleaning level and efficiency of the robot.
在本发明的一个实施例中,所述区域识别结果包括厨房、客厅和卧室,本发明实施例所提供的区域识别方法还具体包括:In an embodiment of the present invention, the area recognition result includes a kitchen, a living room, and a bedroom. The area recognition method provided in the embodiment of the present invention further specifically includes:
若所述区域识别结果为厨房,则调整所述工作模块为超强净污模式;If the result of the area recognition is a kitchen, adjust the working module to a super pollution purification mode;
若所述区域识别结果为客厅,则调整所述工作模式为强力清洁模式;If the area recognition result is a living room, adjust the working mode to a strong cleaning mode;
若所述区域识别结果为卧室,则调整所述工作模式为常规清洁模式。If the area recognition result is a bedroom, the working mode is adjusted to a regular cleaning mode.
在本实施例中,不同的工作模式可以包括不同的清洁力度和清洁频率。从而针对不同功能的区域采用不同的清扫力度和清扫频率。例如,客厅和厨房的清扫频率可以大于卧室的清扫频率。如此,清洁机器人既可以保持整个室内空间的洁净,又可以缩短清洁工作的时间,延长清洁机器人的使用寿命。In this embodiment, different working modes may include different cleaning powers and cleaning frequencies. Therefore, different cleaning powers and cleaning frequencies are adopted for areas with different functions. For example, the cleaning frequency of the living room and kitchen may be greater than the cleaning frequency of the bedroom. In this way, the cleaning robot can not only keep the entire indoor space clean, but also shorten the time of cleaning work and prolong the service life of the cleaning robot.
以一个具体应用为例,在普通家庭住宅室内区域,厨房由于需要处理食材,通常地面会比较脏且伴有油渍,因此机器人在厨房内的工作模式可以采用超强净污模式,使清洁机器人能够清除地面垃圾和油渍;客厅由于经常有人出入,地面较脏,因此可针对客厅采用强力清洁模式,使清洁机器人能够清除客厅的尘土和垃圾;卧室由于较少人出入,因此,针对卧室可选择常规清洁模式。Taking a specific application as an example, in the indoor area of a common family house, the kitchen needs to process ingredients, and the ground is usually dirty and accompanied by oil stains. Therefore, the working mode of the robot in the kitchen can adopt a super-cleaning mode, so that the cleaning robot can Remove ground rubbish and oil stains; because there are frequent people in and out of the living room, the ground is dirty, so a powerful cleaning mode can be used for the living room, so that the cleaning robot can remove the dust and garbage in the living room; because there are fewer people in and out of the bedroom, you can choose regular Clean mode.
在本发明的一个实施例中,本发明实施例所提供的区域识别方法还包括:In an embodiment of the present invention, the area recognition method provided by the embodiment of the present invention further includes:
获取用户输入的禁入区域,并将所述区域识别结果与所述禁入区域进行对比;若所述区域识别结果与所述禁入区域一致,则调整所述工作模式为禁止清扫模式。Obtain the forbidden area entered by the user, and compare the area identification result with the forbidden area; if the area identification result is consistent with the forbidden area, adjust the working mode to the forbidden cleaning mode.
在本实施例中,用户可以对识别出的区域识别结果中的某个房间区域设置为禁入区域,该禁入区域包括多个边缘,禁止清扫模式下,当机器人到达禁止区域的外边缘时,则停止前进,并转向继续在禁止区域外的其他区域工作。例如,若禁止区域为厨房,则机器人不进入厨房,并在到达厨房边缘时转向,只清扫未设置成禁入区域的房间区域。In this embodiment, the user can set a certain room area in the recognized area recognition result as a prohibited area, which includes multiple edges. In the prohibited cleaning mode, when the robot reaches the outer edge of the prohibited area , Then stop advancing and turn to continue to work in other areas outside the prohibited area. For example, if the prohibited area is a kitchen, the robot does not enter the kitchen and turns when it reaches the edge of the kitchen, and only cleans the room area that is not set as a no-entry area.
应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本发明实施例的实施过程构成任何限定。It should be understood that the size of the sequence numbers of the steps in the above embodiments does not mean the order of execution, and the execution order of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
实施例Examples 22 :
如图4所示,本发明的一个实施例提供的室内区域划分和识别装置100,用于执行图1所对应的实施例中的方法步骤,其包括:As shown in FIG. 4, an indoor area dividing and identifying device 100 provided by an embodiment of the present invention is used to execute the method steps in the embodiment corresponding to FIG. 1, which includes:
初始地图获取模块110,用于获取初始地图;The initial map acquisition module 110 is used to acquire an initial map;
房间区域获取模块120,用于采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域;The room area acquisition module 120 is configured to use morphological image processing technology to perform area division on the initial map to obtain at least one room area of the indoor area image;
区域识别结果获取模块130,用于根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果。The area recognition result obtaining module 130 is used to determine the area recognition result corresponding to each room area according to the graphic information and preset identification information of each room area.
从上述实施例可知,本发明实施例首先获取初始地图;采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域;根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果。本发明实施例通过对根据初始地图划分的房间区域进行区域识别,得到各个房间区域的区域识别结果,能够为机器人的工作提供更加准确地清扫数据,使机器人根据各个区域的功能类型针对性的进行清洁工作,使清洁路径更加明确,提高机器人的工作效率。It can be known from the above embodiments that the embodiment of the present invention first obtains an initial map; uses morphological image processing technology to divide the initial map into regions to obtain at least one room area of the indoor area image; according to the graphic information of each room area and Preset identification information to determine the area identification result corresponding to each room area. In the embodiment of the present invention, by performing area recognition on the room areas divided according to the initial map, the area recognition results of each room area are obtained, which can provide more accurate cleaning data for the work of the robot, so that the robot can be targeted according to the function type of each area The cleaning work makes the cleaning path clearer and improves the working efficiency of the robot.
在本发明的一个实施例中,图4所对应的实施例中的初始地图获取模块110具体包括:In an embodiment of the present invention, the initial map acquisition module 110 in the embodiment corresponding to FIG. 4 specifically includes:
定位信息获取单元,用于获取机器人在所述室内区域的定位信息。The positioning information acquiring unit is used to acquire positioning information of the robot in the indoor area.
初始地图获取单元,用于根据即时定位与地图构建算法及所述定位信息对所述室内区域进行地图构建,生成所述初始地图。An initial map acquisition unit is used to construct a map of the indoor area according to the real-time positioning and map construction algorithm and the positioning information to generate the initial map.
从上述实施例可知,通过SLAM算法,可在清洁机器人第一次工作时实时的完成整个室内区域的地图构建,从而提高初始地图的准确性,并为后续的精准清洁提供地图数据支持。It can be seen from the above embodiment that, through the SLAM algorithm, the map construction of the entire indoor area can be completed in real time when the cleaning robot first works, thereby improving the accuracy of the initial map and providing map data support for subsequent accurate cleaning.
如图5所示,在本发明的一个实施例中,图4中房间区域获取模块120还包括用于执行图2所对应的实施例中的方法步骤的结构,其包括:As shown in FIG. 5, in an embodiment of the present invention, the room area acquisition module 120 in FIG. 4 further includes a structure for executing the method steps in the embodiment corresponding to FIG. 2, which includes:
二值化图像获取单元121,用于对所述初始地图进行二值化处理,得到所述初始地图对应的二值化图像;A binarized image acquisition unit 121, configured to perform binarization processing on the initial map to obtain a binarized image corresponding to the initial map;
室内区域图像获取单元122,用于对所述二值化图像进行图像腐蚀处理,得到所述室内区域图像,并检测所述室内区域图像中的连通域。The indoor area image acquisition unit 122 is configured to perform image erosion processing on the binarized image to obtain the indoor area image, and detect the connected domain in the indoor area image.
房间区域获取单元123,用于对所述室内区域图像中的各个连通域分别进行膨胀处理,并将经过膨胀处理后的各个连通域的最小外接多边形内的区域作为对应连通域的房间区域。The room area acquisition unit 123 is configured to perform expansion processing on each connected domain in the indoor area image, and use the area within the smallest circumscribed polygon of each connected domain after the expansion processing as the room area corresponding to the connected domain.
在本发明的一个实施例中,图形信息包括区域面积、区域形状和区域连接拓扑关系,图4中的区域识别结果获取模块具体包括:In one embodiment of the present invention, the graphic information includes area area, area shape, and area connection topology relationship. The area recognition result acquisition module in FIG. 4 specifically includes:
根据各个房间区域对应的区域面积、区域形状、区域连接拓扑关系及预设识别信息,得到各个房间区域的功能类型。According to the area area, area shape, area connection topology relationship and preset identification information corresponding to each room area, the function type of each room area is obtained.
在本发明的一个实施例中,室内区域划分和识别装置100还包括用于执行图3所对应的实施例中的方法步骤的结构,其包括:In an embodiment of the present invention, the indoor area division and recognition device 100 further includes a structure for executing the method steps in the embodiment corresponding to FIG. 3, which includes:
区域识别结果发送模块,用于将所述区域识别结果发送至用户终端,以使所述用户终端显示所述区域识别结果;An area recognition result sending module, configured to send the area recognition result to a user terminal, so that the user terminal displays the area recognition result;
区域识别结果修正模块,用于接收所述预设终端发送的区域识别结果修正信息,并根据所述区域识别结果修正信息修正所述区域识别结果,所述区域识别结果修正信息为所述用户终端获取到的用户在检查出所述区域识别结果存在错误时输入的修正信息。An area recognition result correction module, configured to receive area recognition result correction information sent by the preset terminal, and correct the area recognition result according to the area recognition result correction information, and the area recognition result correction information is the user terminal The obtained correction information that the user inputs when checking that the area recognition result has an error.
从上述实施例可知,用户通过用户终端修正机器人自动识别的区域识别结果,能够进一步提高区域识别结果的准确性,从而使清洁机器人在后续的清洁工作中根据修正后的区域识别结果对应的切换工作模式。It can be seen from the above embodiment that the user corrects the area recognition result automatically recognized by the robot through the user terminal, which can further improve the accuracy of the area recognition result, so that the cleaning robot can perform the switching work according to the corrected area recognition result in the subsequent cleaning work mode.
在本发明的一个实施例中,室内区域划分和识别装置还包括:In an embodiment of the present invention, the indoor area division and identification device further includes:
工作模式确认模块,用于根据各个房间区域对应的区域识别结果,确定各个房间区域对应的工作模式。The working mode confirmation module is used to determine the working mode corresponding to each room area according to the area recognition result corresponding to each room area.
在本发明的一个实施例中,工作模式确认模块具体包括:In an embodiment of the invention, the working mode confirmation module specifically includes:
超强净污模式确认单元,用于若所述区域识别结果为厨房,则调整所述工作模块为超强净污模式;A super strong pollution purification mode confirmation unit, used to adjust the working module to a super strong pollution purification mode if the area recognition result is a kitchen;
强力清洁模式确认单元,用于若所述区域识别结果为客厅,则调整所述工作模式为强力清洁模式;A powerful cleaning mode confirmation unit, configured to adjust the working mode to a powerful cleaning mode if the area recognition result is a living room;
常规清洁模式确认单元,用于若所述区域识别结果为卧室,则调整所述工作模式为常规清洁模式。The normal cleaning mode confirmation unit is used to adjust the working mode to the normal cleaning mode if the area recognition result is a bedroom.
在本发明的一个实施例中,工作模式确认模块还包括:In an embodiment of the invention, the working mode confirmation module further includes:
禁入区域获取单元,用于获取用户输入的禁入区域,并将所述区域识别结果与所述禁入区域进行对比;A forbidden area acquisition unit, configured to acquire a forbidden area input by a user, and compare the area identification result with the forbidden area;
禁入工作模块确认单元,用于若所述区域识别结果与所述禁入区域一致,则调整所述工作模式为禁止清扫模式。The forbidden working module confirmation unit is configured to adjust the working mode to a forbidden cleaning mode if the area recognition result is consistent with the forbidden area.
在本实施例中,由于普通家庭住宅的各个区域的功能不同,其地面的洁净情况也不同,根据不同功能的房间对清洁机器人设置不同的工作模式,能够使清洁机器人更加有针对性的进行清洁工作,从而提高机器人的清洁水平和工作效率。In this embodiment, due to the different functions of each area of an ordinary family house, the ground cleanliness is also different. Setting different working modes for the cleaning robot according to the rooms with different functions can make the cleaning robot more targeted for cleaning Work, thereby improving the cleaning level and working efficiency of the robot.
在一个实施例中,室内区域划分和识别装置100还包括其他功能模块/单元,用于实现实施例1中各实施例中的方法步骤。In one embodiment, the indoor area division and identification device 100 further includes other functional modules / units for implementing the method steps in each of the embodiments.
实施例Examples 33 :
本发明实施例还提供了一种终端设备6,包括存储器61、处理器60以及存储在存储器61中并可在处理器60上运行的计算机程序62,所述处理器60执行所述计算机程序62时实现如实施例1中所述的各实施例中的步骤,例如图1所示的步骤S101至步骤S103。或者,所述处理器60执行所述计算机程序62时实现如实施例2中所述的各装置实施例中的各模块的功能,例如图4所示的模块110至130的功能。An embodiment of the present invention further provides a terminal device 6, including a memory 61, a processor 60, and a computer program 62 stored in the memory 61 and executable on the processor 60, and the processor 60 executes the computer program 62 The steps in each of the embodiments described in Embodiment 1 are implemented, for example, steps S101 to S103 shown in FIG. 1. Alternatively, when the processor 60 executes the computer program 62, the functions of each module in each device embodiment described in Embodiment 2 are realized, for example, the functions of the modules 110 to 130 shown in FIG. 4.
所述终端设备6可以是桌上型计算机、笔记本、掌上电脑及云端服务器等计算设备。所述终端设备6可包括,但不仅限于,处理器60、存储器61。例如所述终端设备6还可以包括输入输出设备、网络接入设备、总线等。The terminal device 6 may be a computing device such as a desktop computer, a notebook, a palmtop computer and a cloud server. The terminal device 6 may include, but is not limited to, a processor 60 and a memory 61. For example, the terminal device 6 may further include input and output devices, network access devices, buses, and the like.
所称处理器60可以是中央处理单元(Central Processing Unit,CPU),还可以是其他通用处理器、数字信号处理器 (Digital Signal Processor,DSP)、专用集成电路 (Application Specific Integrated Circuit,ASIC)、现成可编程门阵列 (Field-Programmable Gate Array,FPGA) 或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。The so-called processor 60 may be a central processing unit (Central Processing Unit (CPU), can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (Application Specific Integrated Circuit (ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
所述存储器61可以是所述终端设备6的内部存储单元,例如终端设备6的硬盘或内存。所述存储器61也可以是所述终端设备6的外部存储设备,例如所述终端设备6上配备的插接式硬盘,智能存储卡(Smart Media Card, SMC),安全数字(Secure Digital, SD)卡,闪存卡(Flash Card)等。进一步地,所述存储器61还可以既包括终端设备6的内部存储单元也包括外部存储设备。所述存储器61用于存储所述计算机程序62以及所述终端设备6所需的其他程序和数据。所述存储器61还可以用于暂时地存储已经输出或者将要输出的数据。The memory 61 may be an internal storage unit of the terminal device 6, such as a hard disk or a memory of the terminal device 6. The memory 61 may also be an external storage device of the terminal device 6, such as a plug-in hard disk equipped on the terminal device 6, a smart memory card (Smart Media Card, SMC), and secure digital (SD) Flash card Card) etc. Further, the memory 61 may also include both an internal storage unit of the terminal device 6 and an external storage device. The memory 61 is used to store the computer program 62 and other programs and data required by the terminal device 6. The memory 61 can also be used to temporarily store data that has been or will be output.
实施例Examples 44 :
本发明实施例还提供了一种计算机可读存储介质,计算机可读存储介质存储有计算机程序62,计算机程序62被处理器60执行时实现如实施例1中所述的各实施例中的步骤,例如图1所示的步骤S101至步骤S103。或者,所述计算机程序62被处理器60执行时实现如实施例2中所述的各装置实施例中的各模块的功能,例如图4所示的模块110至130的功能。An embodiment of the present invention also provides a computer-readable storage medium that stores a computer program 62, and when the computer program 62 is executed by the processor 60, the steps in the embodiments described in Embodiment 1 are implemented. , For example, steps S101 to S103 shown in FIG. 1. Alternatively, when the computer program 62 is executed by the processor 60, the functions of the modules in the device embodiments described in Embodiment 2 are implemented, for example, the functions of the modules 110 to 130 shown in FIG.
所述的计算机程序62可存储于一计算机可读存储介质中,该计算机程序62在被处理器60执行时,可实现上述各个方法实施例的步骤。其中,所述计算机程序62包括计算机程序代码,所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质可以包括:能够携带所述计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、电载波信号、电信信号以及软件分发介质等。需要说明的是,所述计算机可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减,例如在某些司法管辖区,根据立法和专利实践,计算机可读介质不包括是电载波信号和电信信号。The computer program 62 can be stored in a computer-readable storage medium. When the computer program 62 is executed by the processor 60, the steps of the foregoing method embodiments can be implemented. Wherein, the computer program 62 includes computer program code, and the computer program code may be in a source code form, an object code form, an executable file, or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a mobile hard disk, a magnetic disk, an optical disc, a computer memory, a read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signals, telecommunication signals, and software distribution media. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in jurisdictions. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media Excluded are electrical carrier signals and telecommunications signals.
本发明实施例方法中的步骤可以根据实际需要进行顺序调整、合并和删减。The steps in the method of the embodiment of the present invention may be adjusted, merged, and deleted sequentially according to actual needs.
本发明实施例系统中的模块或单元可以根据实际需要进行合并、划分和删减。The modules or units in the system of the embodiment of the present invention may be combined, divided, and deleted according to actual needs.
以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。The above are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modification, equivalent replacement and improvement made within the spirit and principle of the present invention should be included in the protection of the present invention Within range.

Claims (11)

  1. 一种室内区域划分和识别方法,其特征在于,包括:An indoor area division and identification method, which is characterized by including:
    获取初始地图;Get the initial map;
    采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域;Morphological image processing technology is used to divide the initial map into regions to obtain at least one room region of the indoor region image;
    根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果。According to the graphic information and preset identification information of each room area, the area identification result corresponding to each room area is determined.
  2. 如权利要求1所述的室内区域划分和识别方法,其特征在于,所述采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域,包括:The indoor area division and recognition method according to claim 1, wherein the morphological image processing technology is used to divide the initial map to obtain at least one room area of the indoor area image, including:
    对所述初始地图进行二值化处理,得到所述初始地图对应的二值化图像;Performing binary processing on the initial map to obtain a binary image corresponding to the initial map;
    对所述二值化图像进行图像腐蚀处理,得到室内区域图像,并检测所述室内区域图像中的连通域;Performing image erosion processing on the binary image to obtain an indoor area image, and detecting connected domains in the indoor area image;
    对所述室内区域图像中的各个连通域分别进行膨胀处理,并将经过膨胀处理后的各个连通域的最小外接多边形内的区域作为对应连通域的房间区域。Each connected domain in the indoor area image is subjected to expansion processing, and the area within the smallest circumscribed polygon of each connected domain after the expansion processing is taken as the room area corresponding to the connected domain.
  3. 如权利要求1所述的室内区域划分和识别方法,其特征在于,所述图形信息包括区域面积、区域形状和区域连接拓扑关系,所述根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果,包括:The indoor area division and identification method according to claim 1, wherein the graphic information includes an area area, an area shape and an area connection topological relationship, and the determination is based on the graphic information of each room area and preset identification information The area recognition results corresponding to each room area include:
    根据各个房间区域对应的区域面积、区域形状、区域连接拓扑关系及预设识别信息,得到各个房间区域的功能类型。According to the area area, area shape, area connection topology relationship and preset identification information corresponding to each room area, the function type of each room area is obtained.
  4. 如权利要求1所述的室内区域划分和识别方法,其特征在于,在所述根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果之后,还包括:The indoor area division and identification method according to claim 1, wherein after determining the area identification result corresponding to each room area according to the graphic information and preset identification information of each room area, further comprising:
    将所述区域识别结果发送至用户终端,以使所述用户终端显示所述区域识别结果;Sending the area recognition result to the user terminal, so that the user terminal displays the area recognition result;
    接收所述预设终端发送的区域识别结果修正信息,并根据所述区域识别结果修正信息修正所述区域识别结果,所述区域识别结果修正信息为所述用户终端获取到的用户在检查出所述区域识别结果存在错误时输入的修正信息。Receiving the area identification result correction information sent by the preset terminal, and correcting the area identification result according to the area identification result correction information, the area identification result correction information is for the user acquired by the user terminal Correction information entered when there is an error in the area recognition result.
  5. 如权利要求1至4任一项所述的室内区域划分和识别方法,其特征在于,在所述根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果之后,还包括:The indoor area division and recognition method according to any one of claims 1 to 4, wherein after determining the area recognition result corresponding to each room area according to the graphic information and preset identification information of each room area, Also includes:
    根据各个房间区域对应的区域识别结果,确定各个房间区域对应的工作模式。According to the area recognition results corresponding to each room area, the working mode corresponding to each room area is determined.
  6. 如权利要求5所述的室内区域划分和识别方法,其特征在于,所述区域识别结果包括厨房、客厅和卧室;所述根据各个房间区域对应的区域识别结果,确定各个房间区域对应的工作模式,还包括:The indoor area division and recognition method according to claim 5, wherein the area recognition result includes a kitchen, a living room, and a bedroom; and the work mode corresponding to each room area is determined according to the area recognition result corresponding to each room area ,Also includes:
    若所述区域识别结果为厨房,则调整所述工作模块为超强净污模式;If the result of the area recognition is a kitchen, adjust the working module to a super pollution purification mode;
    若所述区域识别结果为客厅,则调整所述工作模式为强力清洁模式;If the area recognition result is a living room, adjust the working mode to a strong cleaning mode;
    若所述区域识别结果为卧室,则调整所述工作模式为常规清洁模式。If the area recognition result is a bedroom, the working mode is adjusted to a regular cleaning mode.
  7. 如权利要求5所述的室内区域划分和识别方法,其特征在于,所述根据各个房间区域对应的区域识别结果,确定各个房间区域对应的工作模式,还包括:The indoor area division and identification method according to claim 5, wherein the determining the working mode corresponding to each room area according to the area identification result corresponding to each room area further comprises:
    获取用户输入的禁入区域,并将所述区域识别结果与所述禁入区域进行对比;Obtain the forbidden area entered by the user, and compare the area identification result with the forbidden area;
    若所述区域识别结果与所述禁入区域一致,则调整所述工作模式为禁止清扫模式。If the result of the area recognition is consistent with the forbidden area, the working mode is adjusted to the no-cleaning mode.
  8. 一种室内区域划分和识别装置,其特征在于,包括:An indoor area division and identification device, characterized in that it includes:
    初始地图获取模块,用于获取初始地图;The initial map acquisition module is used to acquire the initial map;
    房间区域获取模块,用于采用形态学图像处理技术对所述初始地图进行区域划分,得到所述室内区域图像的至少一个房间区域;A room area acquisition module, configured to use morphological image processing technology to partition the initial map to obtain at least one room area of the indoor area image;
    区域识别结果获取模块,用于根据各个房间区域的图形信息及预设识别信息,确定各个房间区域对应的区域识别结果。The area recognition result acquisition module is used to determine the area recognition result corresponding to each room area according to the graphic information and preset identification information of each room area.
  9. 如权利要求8所述的室内区域划分和识别装置,其特征在于,所述房间区域获取模块包括:The indoor area division and identification device according to claim 8, wherein the room area acquisition module comprises:
    二值化图像获取单元,用于对所述初始地图进行二值化处理,得到所述初始地图对应的二值化图像;A binary image acquisition unit, configured to perform binary processing on the initial map to obtain a binary image corresponding to the initial map;
    室内区域图像获取单元,用于对所述二值化图像进行图像腐蚀处理,得到室内区域图像,并检测所述室内区域图像中的连通域;An indoor area image acquisition unit, configured to perform image erosion processing on the binary image to obtain an indoor area image, and detect a connected domain in the indoor area image;
    房间区域获取单元,用于对所述室内区域图像中的各个连通域分别进行膨胀处理,并将经过膨胀处理后的各个连通域的最小外接多边形内的区域作为对应连通域的房间区域。The room area acquisition unit is configured to perform expansion processing on each connected domain in the indoor area image, and use the area within the smallest circumscribed polygon of each connected domain after the expansion processing as the room area corresponding to the connected domain.
  10. 一种终端设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现如权利要求1至7任一项所述方法的步骤。A terminal device, including a memory, a processor, and a computer program stored in the memory and runable on the processor, characterized in that the processor implements the computer program as claimed in claims 1 to 7 The steps of any one of the methods.
  11. 一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1至7任一项所述方法的步骤。A computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.
PCT/CN2018/123779 2018-10-18 2018-12-26 Method and apparatus for dividing and identifying indoor region, and terminal device WO2020077850A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811213519.2A CN109522803B (en) 2018-10-18 2018-10-18 Indoor area division and identification method and device and terminal equipment
CN201811213519.2 2018-10-18

Publications (1)

Publication Number Publication Date
WO2020077850A1 true WO2020077850A1 (en) 2020-04-23

Family

ID=65772058

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/123779 WO2020077850A1 (en) 2018-10-18 2018-12-26 Method and apparatus for dividing and identifying indoor region, and terminal device

Country Status (2)

Country Link
CN (1) CN109522803B (en)
WO (1) WO2020077850A1 (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111950422A (en) * 2020-08-05 2020-11-17 万翼科技有限公司 Drawing identification method and related device
CN112015175A (en) * 2020-08-12 2020-12-01 深圳华芯信息技术股份有限公司 Room partitioning method, system, terminal, and medium for mobile robot
CN112257623A (en) * 2020-10-28 2021-01-22 长沙立中汽车设计开发股份有限公司 Road surface cleanliness judging and automatic cleaning method and automatic cleaning environmental sanitation device
CN112419346A (en) * 2020-11-02 2021-02-26 尚科宁家(中国)科技有限公司 Cleaning robot and partitioning method
CN112561927A (en) * 2020-12-07 2021-03-26 深圳市愚公科技有限公司 Image area dividing method, system, electronic device and storage medium
CN113253622A (en) * 2021-05-19 2021-08-13 云米互联科技(广东)有限公司 HomeMap-based network environment visualization control method and system
CN113253623A (en) * 2021-05-19 2021-08-13 云米互联科技(广东)有限公司 HomeMap-based air environment visualization control method and system
CN113503877A (en) * 2021-06-22 2021-10-15 深圳拓邦股份有限公司 Robot partition map establishing method and device and robot
CN113780233A (en) * 2021-09-23 2021-12-10 追觅创新科技(苏州)有限公司 Aisle area identification method and device
CN113848892A (en) * 2021-09-10 2021-12-28 广东盈峰智能环卫科技有限公司 Robot cleaning area dividing method, path planning method and device
CN113985866A (en) * 2021-09-09 2022-01-28 浙江大华技术股份有限公司 Sweeping robot path planning method and device, electronic equipment and storage medium
CN114872056A (en) * 2022-04-21 2022-08-09 美智纵横科技有限责任公司 House map generation method and device, cleaning assembly and cleaning equipment
CN115413959A (en) * 2021-05-12 2022-12-02 美智纵横科技有限责任公司 Operation method and device based on cleaning robot, electronic equipment and medium
CN115661762A (en) * 2022-12-15 2023-01-31 山东德普检测技术有限公司 Library environment intelligent monitoring management system and method
WO2023115661A1 (en) * 2021-12-22 2023-06-29 广东栗子科技有限公司 Method and apparatus for intelligent division of area

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110260856A (en) * 2019-06-26 2019-09-20 北京海益同展信息科技有限公司 One kind building drawing method and device
CN110390304A (en) * 2019-07-24 2019-10-29 广东南方数码科技股份有限公司 Automatic classification method, device, electronic equipment and storage medium
CN110742557B (en) * 2019-10-24 2021-07-27 深圳市银星智能科技股份有限公司 Camera control method and device and electronic equipment
CN110888960B (en) * 2019-11-29 2021-06-08 深圳市银星智能科技股份有限公司 Indoor space partitioning method and device and mobile robot
CN111104879B (en) * 2019-12-09 2020-11-27 贝壳找房(北京)科技有限公司 Method and device for identifying house functions, readable storage medium and electronic equipment
CN113805589A (en) * 2021-08-31 2021-12-17 中煤科工集团重庆研究院有限公司 Mobile platform control system and method based on multi-source sensor data
CN113854903A (en) * 2021-09-28 2021-12-31 追觅创新科技(苏州)有限公司 Control method and device of cleaning equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105824310A (en) * 2015-01-08 2016-08-03 江苏美的清洁电器股份有限公司 Robot walking control method and robot
CN106863305A (en) * 2017-03-29 2017-06-20 赵博皓 A kind of sweeping robot room map creating method and device
CN107341810A (en) * 2017-06-16 2017-11-10 重庆交通大学 A kind of automatic vehicle identification method, apparatus and electronic equipment

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6039274A (en) * 1983-08-12 1985-03-01 Fujitsu Ltd Object recognizing device
CN102005132A (en) * 2010-11-04 2011-04-06 任杰 Parking berth detection system based on berth mark identification
CN103148804B (en) * 2013-03-04 2015-05-20 清华大学 Indoor unknown structure identification method based on laser scanning
CN106525031B (en) * 2015-09-11 2019-08-06 王庆文 A kind of combined indoor orientation method
CN106895839A (en) * 2017-03-15 2017-06-27 万象三维视觉科技(北京)有限公司 A kind of indoor positioning air navigation aid based on scanning identification code
CN107248176B (en) * 2017-06-30 2020-06-23 联想(北京)有限公司 Indoor map construction method and electronic equipment
CN107918759A (en) * 2017-10-09 2018-04-17 大圣科技股份有限公司 Automatic segmentation recognition method, electronic equipment and the storage medium of indoor object
CN107981790B (en) * 2017-12-04 2020-06-09 深圳市无限动力发展有限公司 Indoor area dividing method and sweeping robot

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105824310A (en) * 2015-01-08 2016-08-03 江苏美的清洁电器股份有限公司 Robot walking control method and robot
CN106863305A (en) * 2017-03-29 2017-06-20 赵博皓 A kind of sweeping robot room map creating method and device
CN107341810A (en) * 2017-06-16 2017-11-10 重庆交通大学 A kind of automatic vehicle identification method, apparatus and electronic equipment

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111950422A (en) * 2020-08-05 2020-11-17 万翼科技有限公司 Drawing identification method and related device
CN112015175A (en) * 2020-08-12 2020-12-01 深圳华芯信息技术股份有限公司 Room partitioning method, system, terminal, and medium for mobile robot
CN112257623B (en) * 2020-10-28 2022-08-23 长沙立中汽车设计开发股份有限公司 Road surface cleanliness judgment and automatic cleaning method and automatic cleaning environmental sanitation device
CN112257623A (en) * 2020-10-28 2021-01-22 长沙立中汽车设计开发股份有限公司 Road surface cleanliness judging and automatic cleaning method and automatic cleaning environmental sanitation device
CN112419346A (en) * 2020-11-02 2021-02-26 尚科宁家(中国)科技有限公司 Cleaning robot and partitioning method
CN112561927A (en) * 2020-12-07 2021-03-26 深圳市愚公科技有限公司 Image area dividing method, system, electronic device and storage medium
CN112561927B (en) * 2020-12-07 2024-03-12 深圳市愚公科技有限公司 Image area dividing method, system, electronic device and storage medium
CN115413959A (en) * 2021-05-12 2022-12-02 美智纵横科技有限责任公司 Operation method and device based on cleaning robot, electronic equipment and medium
CN113253623B (en) * 2021-05-19 2023-04-07 云米互联科技(广东)有限公司 HomeMap-based air environment visualization control method and system
CN113253623A (en) * 2021-05-19 2021-08-13 云米互联科技(广东)有限公司 HomeMap-based air environment visualization control method and system
CN113253622B (en) * 2021-05-19 2023-04-07 云米互联科技(广东)有限公司 HomeMap-based network environment visualization control method and system
CN113253622A (en) * 2021-05-19 2021-08-13 云米互联科技(广东)有限公司 HomeMap-based network environment visualization control method and system
CN113503877A (en) * 2021-06-22 2021-10-15 深圳拓邦股份有限公司 Robot partition map establishing method and device and robot
CN113985866A (en) * 2021-09-09 2022-01-28 浙江大华技术股份有限公司 Sweeping robot path planning method and device, electronic equipment and storage medium
CN113848892A (en) * 2021-09-10 2021-12-28 广东盈峰智能环卫科技有限公司 Robot cleaning area dividing method, path planning method and device
CN113848892B (en) * 2021-09-10 2024-01-16 广东盈峰智能环卫科技有限公司 Robot cleaning area dividing method, path planning method and device
CN113780233A (en) * 2021-09-23 2021-12-10 追觅创新科技(苏州)有限公司 Aisle area identification method and device
CN113780233B (en) * 2021-09-23 2024-04-12 追觅创新科技(苏州)有限公司 Aisle area identification method and device
WO2023115661A1 (en) * 2021-12-22 2023-06-29 广东栗子科技有限公司 Method and apparatus for intelligent division of area
CN114872056A (en) * 2022-04-21 2022-08-09 美智纵横科技有限责任公司 House map generation method and device, cleaning assembly and cleaning equipment
CN115661762A (en) * 2022-12-15 2023-01-31 山东德普检测技术有限公司 Library environment intelligent monitoring management system and method

Also Published As

Publication number Publication date
CN109522803B (en) 2021-02-09
CN109522803A (en) 2019-03-26

Similar Documents

Publication Publication Date Title
WO2020077850A1 (en) Method and apparatus for dividing and identifying indoor region, and terminal device
US11537138B2 (en) Adaptive region division method and system
CN109508002B (en) Method and device for cleaning ground by robot and robot
CN111176301A (en) Map construction method and sweeping method of sweeping robot
CN112100298B (en) Picture construction method and device, computer readable storage medium and robot
CN111709965B (en) Map optimization method and device for sweeping robot
CN112462758B (en) Drawing establishing method and device, computer readable storage medium and robot
CN112180931A (en) Sweeping path planning method and device of sweeper and readable storage medium
WO2023045798A1 (en) Method and apparatus for identifying aisle area
CN114365974B (en) Indoor cleaning and partitioning method and device and floor sweeping robot
CN108133116B (en) Method and system for automatically identifying wall thickness of CAD house type graph
CN113744329A (en) Automatic region division and robot walking control method, system, equipment and medium
CN113516765B (en) Map management method, map management device and intelligent equipment
CN112155476A (en) Robot control method and device, electronic equipment and storage medium
KR20150013040A (en) System, method, and medium for image object and contour feature extraction
CN113015153B (en) Method and device for identifying attribution of serving cell
CN112205927B (en) Intelligent sweeping method and device of sweeping robot
CN114663316B (en) Method for determining edgewise path, mobile device and computer storage medium
CN117762128A (en) Floor sweeping machine, cleaning starting point planning method and device thereof and storage medium
CN116530898A (en) Sweeping method, device, equipment and medium of sweeping robot
CN113223020B (en) Partition method and device for cleaning area and cleaning equipment
CN117685951A (en) Sweeper, partition creation method and device thereof and storage medium
WO2023155681A1 (en) Method and device for processing region information, storage medium, and electronic device
CN114343507A (en) Map data generation method and device and sweeping robot
CN116929355A (en) Cost map updating method, robot and computer storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18937037

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18937037

Country of ref document: EP

Kind code of ref document: A1