WO2023207407A1 - Floor material recognition method and apparatus, storage medium, and electronic apparatus - Google Patents

Floor material recognition method and apparatus, storage medium, and electronic apparatus Download PDF

Info

Publication number
WO2023207407A1
WO2023207407A1 PCT/CN2023/082089 CN2023082089W WO2023207407A1 WO 2023207407 A1 WO2023207407 A1 WO 2023207407A1 CN 2023082089 W CN2023082089 W CN 2023082089W WO 2023207407 A1 WO2023207407 A1 WO 2023207407A1
Authority
WO
WIPO (PCT)
Prior art keywords
credibility
target device
area
measured
ground material
Prior art date
Application number
PCT/CN2023/082089
Other languages
French (fr)
Chinese (zh)
Inventor
孙佳佳
王睿麟
关奥
Original Assignee
追觅创新科技(苏州)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 追觅创新科技(苏州)有限公司 filed Critical 追觅创新科技(苏州)有限公司
Publication of WO2023207407A1 publication Critical patent/WO2023207407A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/80Recognising image objects characterised by unique random patterns

Definitions

  • Embodiments of the present invention relate to the field of robotic technology, and specifically, to a ground material identification method and device, a storage medium, and an electronic device.
  • a single device is generally used to identify the material material.
  • ultrasonic or infrared signals or artificial intelligence (Artificial Intelligence, referred to as AI) installed in the target device for example, a sweeping robot
  • AI artificial intelligence
  • Embodiments of the present invention provide a ground material identification method and device, a storage medium, and an electronic device, so as to at least solve the problem of inaccurate ground material identification in related technologies.
  • a ground material identification method which includes: obtaining posture information of a target device during movement in an area to be measured; and determining based on the posture information that the target device recognizes the ground material in the area to be measured.
  • the credibility determine the recognition result of the ground material in the above-mentioned area to be measured based on the above credibility.
  • a ground material recognition device including: a first acquisition module, used to acquire posture information of the target device during movement in the area to be measured; a first determination module, based on The above posture information determines the credibility of the target device in identifying the ground material in the area to be measured; the second determination module is used to determine the recognition result of the ground material in the area to be measured based on the credibility.
  • the first acquisition module includes: a first acquisition unit, configured to acquire the vertical distance from the target device to the surface of the area to be measured when the posture information includes distance information.
  • the above-mentioned first acquisition unit includes: a first determination sub-unit, used to determine the center point of the above-mentioned target device; a first calculation sub-unit, used to calculate, based on the above-mentioned center point, the destination of the above-mentioned target device. The vertical distance to the surface of the above-mentioned area to be measured.
  • the above-mentioned first acquisition unit includes: a second determination sub-unit, used to determine a plurality of measurement points in the above-mentioned target device; a second calculation sub-unit, used to calculate each measurement point to the above-mentioned target device.
  • the vertical distance of the surface of the measured area is measured to obtain multiple vertical distances; the third determination subunit is used to determine the average value of the multiple vertical distances as the vertical distance from the target device to the surface of the area to be measured.
  • the first determination module includes: a first determination unit, configured to determine the credibility of the target device in identifying the ground material in the area to be measured based on the vertical distance and the preset distance interval. .
  • the above-mentioned first determination unit includes: a fourth determination sub-unit, configured to determine the above-mentioned credibility as the first credibility when the above-mentioned vertical distance is not greater than a first preset threshold. ; The fifth determination subunit is used to determine the credibility as the second credibility when the vertical distance is greater than the first preset threshold and less than the second preset threshold; the sixth determination subunit, It is used to determine the above-mentioned credibility as the third credibility when the above-mentioned vertical distance is not less than the above-mentioned second preset threshold; wherein the above-mentioned first credibility is greater than the above-mentioned second credibility, and the above-mentioned second credibility can The reliability is greater than the third credibility mentioned above.
  • the second determination module includes a second determination unit configured to determine the recognition result as the first target of the ground material when the credibility is the first credibility. Recognition result; the second acquisition unit is used to obtain the second target recognition result of the ground material according to a preset strategy when the credibility is the second credibility; the first indication unit is used to obtain the second target recognition result of the ground material when the credibility is the credibility When the degree of confidence reaches the third credibility level, the target device is instructed to stop working and a prompt message is issued, where the prompt information is used to prompt that the movement of the target device is abnormal.
  • the above-mentioned second acquisition unit includes: a seventh determination sub-unit, used to determine the distance information of the above-mentioned target device within a preset time period; an eighth determination sub-unit, used to determine when the above-mentioned distance information When the above-mentioned second credibility is continuously satisfied, N recognition results within the above-mentioned preset time period are determined, wherein the above-mentioned N is a natural number greater than 1; the ninth determination sub-unit is used to determine the N recognition results from the above-mentioned N recognition results. The above second target recognition result.
  • the above-mentioned ninth determination subunit is also used to perform one of the following: determine M result sets according to different result types among the above N recognition results, wherein the recognition result sets with the same result type In the same result set, a recognition result is an element in the above-mentioned result set, and the above-mentioned M is a natural number greater than or equal to 1; the result type corresponding to the result set with the largest number of elements among the above-mentioned M result sets is determined as the above-mentioned th 2.
  • Target recognition results is also used to perform one of the following: determine M result sets according to different result types among the above N recognition results, wherein the recognition result sets with the same result type In the same result set, a recognition result is an element in the above-mentioned result set, and the above-mentioned M is a natural number greater than or equal to 1; the result type corresponding to the result set with the largest number of elements among the above-mentioned M result sets is determined as the above-mentione
  • the above device further includes: a first indication module, configured to determine M result sets according to different result types among the above N recognition results, when the number of elements in each result set is less than When the number is preset, the above target device is instructed to stop working and the above prompt message is issued.
  • a first indication module configured to determine M result sets according to different result types among the above N recognition results, when the number of elements in each result set is less than When the number is preset, the above target device is instructed to stop working and the above prompt message is issued.
  • the above-mentioned first determination module includes: a third determination unit, used to determine the inclination angle between the above-mentioned target device and the above-mentioned area surface to be measured; a fourth determination unit, used to determine when the above-mentioned vertical distance is greater than When the first preset threshold is less than the second preset threshold, and the inclination angle is less than the third preset threshold, the credibility is determined as the second credibility; the fifth determination unit is used to determine when the vertical angle When the distance is greater than the above-mentioned first preset threshold and less than the above-mentioned second preset threshold, and the above-mentioned tilt angle is not less than the above-mentioned third preset threshold, the above-mentioned credibility is determined as the third credibility; wherein, the above-mentioned second credibility The credibility is greater than the third credibility mentioned above.
  • a computer-readable storage medium is also provided.
  • a computer program is stored in the computer-readable storage medium, wherein the computer program is configured to execute any of the above methods when running. Steps in Examples.
  • an electronic device including a memory and a processor.
  • a computer program is stored in the memory, and the processor is configured to run the computer program to perform any of the above. Steps in method embodiments.
  • the credibility of the target device in identifying the ground material in the area to be measured is determined by obtaining the attitude information of the target device during its movement in the area to be measured; and the identification of the ground material in the area to be measured is determined based on the credibility. result. After the target device recognizes the ground material, the credibility of the recognition result is further verified through the posture information, further verifying the accuracy of the recognition of the ground material. Therefore, the problem of inaccurate identification of ground materials in related technologies can be solved, and the accuracy of identifying ground materials can be improved.
  • Figure 1 is a hardware structure block diagram of a mobile terminal for a ground material identification method according to an embodiment of the present invention
  • Figure 2 is a flow chart of a ground material identification method according to an embodiment of the present invention.
  • Figure 3 is a structural block diagram of a ground material identification device according to an embodiment of the present invention.
  • FIG. 1 is a hardware structure block diagram of a mobile terminal for a ground material identification method according to an embodiment of the present invention.
  • the mobile terminal may include one or more (only one is shown in Figure 1) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the above-mentioned mobile terminal may also include a transmission device 106 and an input and output device 108 for communication functions.
  • processors 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA
  • a memory 104 for storing data
  • the above-mentioned mobile terminal may also include a transmission device 106 and an input and output device 108 for communication functions.
  • the structure shown in Figure 1 is only illustrative, and it does not limit the structure of the above-mentioned mobile terminal.
  • the mobile terminal may also include more or fewer components than shown in FIG. 1 , or have a different configuration than shown in FIG. 1 .
  • the memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the ground material identification method in the embodiment of the present invention.
  • the processor 102 runs the computer program stored in the memory 104, thereby Execute various functional applications and data processing, that is, implement the above methods.
  • Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory.
  • the memory 104 may further include memory located remotely relative to the processor 102, and these remote memories may be connected to the mobile terminal through a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.
  • the transmission device 106 is used to receive or send data via a network.
  • Specific examples of the above-mentioned network may include a wireless network provided by a communication provider of the mobile terminal.
  • the transmission device 106 includes a network adapter (Network Interface Controller, NIC for short), which can Connect to other network devices to communicate with the Internet.
  • the transmission device 106 may be a radio frequency (Radio Frequency, RF for short) module, which is used to communicate with the Internet wirelessly.
  • RF Radio Frequency
  • FIG. 2 is a flow chart of a method for identifying ground materials according to an embodiment of the present invention. As shown in Figure 2, the process includes the following steps:
  • Step S202 Obtain the posture information of the target device during movement in the area to be measured
  • the target device includes but is not limited to home appliances, such as sweeping robots, vacuum cleaners, etc.
  • the area to be tested includes, but is not limited to, an area where the target material is provided, such as a floor with tiles or wooden floors.
  • the posture information includes distance information and angle information between the target device and the ground when it is moving in the area to be measured.
  • the target device is a sweeping robot
  • the sweeping robot is moving on a floor laid with tiles. , in an attitude parallel to the ground, the distance between the target device and the ground can be obtained; or, when the sweeping robot crosses the threshold, it is in an inclined attitude, and the tilt angle between the target device and the ground can be obtained.
  • Step S204 Determine the credibility of the target device in identifying the ground material in the area to be measured based on the posture information
  • the distance to the ground is calculated based on different posture information of the target device. For example, if the sweeping robot remains parallel to the ground during movement, it can detect the distance between the chassis of the target device and the ground, and detect the credibility of the ground material recognition based on the distance.
  • Step S206 Determine the recognition result of the ground material in the area to be measured based on the credibility.
  • the recognition result includes the material information of the ground. For example, it is detected that the floor laid on the ground is made of wooden material, or it is detected that the floor laid on the ground is made of stone material.
  • the execution subject of the above steps may be a terminal, a server, a specific processor provided in the terminal or server, or a processor or processing device provided relatively independently from the terminal or server, but is not limited thereto.
  • the credibility of the target device's identification of the ground material in the area to be measured is determined by obtaining the posture information of the target device during its movement in the area to be measured; and the identification of the ground material in the area to be measured is determined based on the credibility.
  • the results detect the target device and the target based on the attitude information of the target device in the target area.
  • the distance between the target areas is determined, and the recognition result of the target device's material of the target material is verified according to the target distance.
  • the credibility of the recognition result is further verified through the attitude information target distance, thereby improving the accuracy of the ground material identification of the target material. Therefore, the problem of inaccurate identification of the ground material of the material in the related technology can be solved, and the accuracy of identifying the material of the ground material can be improved.
  • obtaining the posture information of the target device during movement in the area to be measured includes:
  • This embodiment is suitable for scenarios where the target device is parallel to the ground. For example, a scene of normal movement on flat ground.
  • the vertical distance from the target device to the surface of the area to be measured is the vertical distance from the target device to the surface of the area to be measured.
  • the vertical distance from the target device to the surface of the area to be measured can be obtained through a sensor.
  • the sensor can be set at the chassis of the target device or at other locations on the target device.
  • the sensor can be an ultrasonic sensor or an infrared sensor.
  • the sensor is installed on the chassis of the sweeping robot to detect the distance between the chassis device and the ground during the movement of the sweeping robot.
  • the sweeping robot can identify the ground material while moving and can also identify the ground material when stationary.
  • the ground material can be directly identified through sensors (for example, ultrasonic sensors or infrared sensors); the ground material can also be identified through other methods, for example, the acquired characteristics of the target material are uploaded to the processor, and the ground material is identified through the processor.
  • the target distance is obtained after the sweeping robot identifies the material of the target material set on the ground.
  • obtaining the vertical distance from the target device to the surface of the area to be measured includes:
  • the vertical distance from the center point of the target device to the ground is the vertical distance.
  • the vertical distance between the center point of the chassis of the sweeping robot and the ground is measured through sensor measurement.
  • obtaining the vertical distance from the target device to the surface of the area to be measured includes:
  • S43 Determine the average value of multiple vertical distances as the vertical distance from the target device to the surface of the area to be measured.
  • the vertical distance from multiple measurement points in the target device to the ground is the vertical distance.
  • the multiple measurement points can be different positions on the chassis of the target device, such as multiple positions evenly distributed on the chassis of the target device.
  • a sensor can be used to measure the vertical distance between multiple measurement points on the chassis of a sweeping robot and the floor to obtain multiple Vertical distance (for example, 2.5cm, 3.5cm, 3cm), the average value of multiple vertical distances is determined as the vertical distance (for example, 3cm).
  • determining the credibility of the target device's recognition of the ground material in the area to be measured based on the posture information includes:
  • S51 Determine the credibility of the target device in identifying the ground material in the area to be measured based on the vertical distance and the preset distance interval.
  • the preset distance interval may be determined based on a distance threshold that can be identified by a sensor that measures vertical distance.
  • a distance threshold that can be identified by a sensor that measures vertical distance.
  • the target device has different reliability in identifying ground materials. In a lower range, it means that the target device is closer to the ground, and the recognition reliability is higher.
  • the vertical distance is relatively large, it avoids that the target device is further away from the ground, and its reliability in identifying the ground material is lower.
  • the chassis of the target equipment is relatively far from the ground, such as being in a high suspended state, which will have an impact on the safety of the target equipment. For example, if the distance threshold that the sensor can recognize is 10cm, the preset distance can be set to a value less than 8cm.
  • determining the credibility of the target device in identifying the ground material in the area to be measured based on the vertical distance and the preset distance interval includes:
  • the first credibility is greater than the second credibility
  • the second credibility is greater than the third credibility
  • both the first preset threshold and the second preset threshold are included in the preset distance interval.
  • the first preset threshold may be set to a value less than 3 cm; the second preset threshold may be set to a value greater than or equal to 3 cm and less than 6 cm.
  • the smaller the vertical distance the greater the credibility of the ground material, and vice versa.
  • the recognition result of the ground material is wooden material, and the vertical distance is 1cm, it means that the probability that the ground material is wooden material is greater than 90%; if the recognition result of the ground material is wooden material, and the vertical distance When the distance is 5cm, it means that the probability that the ground material is wooden material is less than 50%.
  • the ground material needs to be further determined; when the recognition result of the ground material is wooden material and the vertical distance is 9cm, then It means that the probability that the ground material is wooden is extremely small.
  • the target device may be in a tilted state and needs to exit the current area to terminate the recognition of the ground material.
  • first credibility, second credibility and third credibility can be designed according to the actual situation.
  • different preset distance intervals can be set according to different models of target devices.
  • only two preset distance intervals can be set, and accordingly, only two credibility levels can be determined.
  • multiple credibility levels determined by multiple regional distance intervals can also be determined. The number of reliability is not limited in the embodiment of this specification.
  • determining the recognition result of the ground material in the area to be measured based on credibility includes:
  • the first credibility, the second credibility and the third credibility are used to represent the probability that the ground material is a real material.
  • the second target recognition result of the ground material is obtained according to a preset strategy, including:
  • the distance information includes the vertical distance between the target device and the ground.
  • the target device may be in a tilted state. For example, if the sweeping robot is tilted when crossing a threshold, the ground material recognized at this time is not accurate.
  • the second target recognition result is determined from the N recognition results, including one of the following:
  • the result type corresponding to the result set with the largest number of elements among the M result sets is determined as the second target recognition result.
  • the values of M and N can be flexibly set based on actual application scenarios or recognition requirements.
  • the ground material recognized within 10 minutes includes 10 recognition results. You can select several recognition results with smaller distances from the 10 recognition results, and select the result with the most consistent recognition results as the target recognition result. For example, among the 10 recognition results, there are 4 A results, 3 B results, 2 C results, and 1 D result, then the A result can be used as the second target recognition result.
  • the above method further includes: when the number of elements in each result set is less than a preset number, indicating that the The target device stops working and issues the above prompt message. For example, if there are 4 A results among 10 recognition results and the preset number is 5, the target device may have malfunctioned and issued a prompt message. At this time, the target device terminates the recognition of the ground material. By limiting the number of presets, the reliability of material recognition at high distances can be improved.
  • determining the credibility of the target device in identifying the ground material in the area to be measured includes:
  • the second credibility is greater than the third credibility.
  • This embodiment may be applicable to scenarios where the target device is not parallel to the ground. For example, a scene in which the sweeping robot is tilted when crossing a threshold.
  • a sensor can be used to determine the tilt angle between the target device and the surface of the area to be measured.
  • the sensor can be disposed on the chassis of the target device or at other locations on the target device.
  • the sensor can be an ultrasonic sensor or an infrared sensor.
  • the tilt angle of the chassis of the sweeping robot detected by the infrared sensor is 10 degrees, which is less than the third preset threshold (for example, 20 degrees).
  • the recognition result is that the material is made of wood. , it means that the probability that the ground material is wooden material is greater than 90%.
  • the value of the third preset threshold can be set based on actual usage conditions.
  • the third preset threshold is a value less than 20. For example, if the tilt angle is 30 degrees, it is greater than the third preset threshold. If the recognition result is wooden material, it means that the probability that the ground material is wooden material is extremely small. You need to exit the current area and terminate the identification of the target material's material.
  • the target device when the credibility is determined to be the third credibility, the target device is instructed to terminate the recognition of the ground material. After the target device terminates the recognition of the ground material, it can also determine the change amplitude of the distance between the target device and the ground detected within the subsequent preset time. Different change amplitudes correspond to different recognition result calculation methods. For example, if the change amplitude is large, the target device is considered to be in an unsafe state. When the change amplitude is small, the recognition result with the most consistent recognition results is selected as the target recognition result.
  • the method according to the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is Better implementation.
  • the technical solution of the present invention can be embodied in the form of a software product in essence or the part that contributes to the existing technology.
  • the computer software product is stored in a storage medium (such as ROM/RAM, disk, CD), including several instructions to cause a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present invention.
  • module may be a combination of software and/or hardware that implements a predetermined function.
  • the apparatus described in the following embodiments is preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
  • FIG 3 is a structural block diagram of a ground material identification device according to an embodiment of the present invention. As shown in Figure 3, the device includes:
  • the first acquisition module 32 is used to acquire the posture information of the target device during its movement in the area to be measured;
  • the first determination module 34 is configured to determine the credibility of the target device's recognition of the ground material in the area to be measured based on the posture information;
  • the second determination module 36 is configured to determine the recognition result of the ground material in the area to be measured based on the credibility.
  • the above-mentioned first acquisition module includes:
  • the first acquisition unit is configured to acquire the vertical distance from the target device to the surface of the area to be measured when the attitude information includes distance information.
  • the above-mentioned first acquisition unit includes:
  • the first determination subunit is used to determine the center point of the above-mentioned target device
  • the first calculation subunit is used to calculate the vertical distance from the target device to the surface of the area to be measured based on the center point.
  • the above-mentioned first acquisition unit includes:
  • the second determination subunit is used to determine multiple measurement points in the above-mentioned target device
  • the second calculation subunit is used to calculate the vertical distance from each measurement point to the surface of the above-mentioned area to be measured, and obtain multiple vertical distances;
  • the third determination subunit is used to determine the average value of the plurality of vertical distances as the vertical distance from the target device to the surface of the area to be measured.
  • the above-mentioned first determination module includes:
  • the first determination unit is configured to determine the credibility of the target device in identifying the ground material in the area to be measured based on the vertical distance and the preset distance interval.
  • the above-mentioned first determining unit includes:
  • the fourth determination subunit is used to determine the above-mentioned credibility as the first credibility when the above-mentioned vertical distance is not greater than the first preset threshold;
  • a fifth determination subunit configured to determine the credibility as the second credibility when the vertical distance is greater than the first preset threshold and less than the second preset threshold
  • a sixth determination subunit configured to determine the above-mentioned credibility as a third credibility when the above-mentioned vertical distance is not less than the above-mentioned second preset threshold;
  • the above-mentioned first credibility is greater than the above-mentioned second credibility
  • the above-mentioned second credibility is greater than the above-mentioned third credibility
  • the above-mentioned second determination module includes:
  • a second determination unit configured to determine the recognition result as the first target recognition result of the ground material when the credibility is the first credibility
  • a second acquisition unit configured to acquire the second target recognition result of the ground material according to a preset strategy when the above-mentioned credibility is the above-mentioned second credibility;
  • the first instruction unit is configured to instruct the target device to stop working and send prompt information when the credibility is the third credibility, where the prompt information is used to prompt that the movement of the target device is abnormal.
  • the above-mentioned second acquisition unit includes:
  • the seventh determination subunit is used to determine the distance information of the above-mentioned target device within a preset time period
  • the eighth determination subunit is used to determine N recognition results within the above-mentioned preset time period when the above-mentioned distance information continues to meet the above-mentioned second credibility, wherein the above-mentioned N is a natural number greater than 1;
  • the ninth determination subunit is used to determine the above-mentioned second target recognition result from the above-mentioned N recognition results.
  • the above-mentioned ninth determination subunit is also used to perform one of the following: determine M result sets according to different result types among the above N recognition results, wherein the recognition result sets with the same result type In the same result set, a recognition result is an element in the above result set, and the above M is a natural number greater than or equal to 1;
  • the result type corresponding to the result set with the largest number of elements among the M result sets is determined as the second target recognition result.
  • the above device further includes:
  • the first instruction module is used to instruct the above-mentioned target device to stop working when the number of elements in each result set is less than the preset number after determining M result sets according to different result types among the above-mentioned N recognition results, and Issue the above prompt message.
  • the above-mentioned first determination module includes:
  • a third determination unit used to determine the inclination angle between the above-mentioned target device and the above-mentioned surface of the area to be measured;
  • the fourth determination unit is configured to determine the credibility as the second credibility when the vertical distance is greater than the first preset threshold and less than the second preset threshold, and the tilt angle is less than the third preset threshold.
  • the fifth determination unit is configured to determine the credibility as when the vertical distance is greater than the first preset threshold and less than the second preset threshold, and the tilt angle is not less than the third preset threshold. third credibility;
  • the above-mentioned second credibility is greater than the above-mentioned third credibility.
  • each of the above modules can be implemented through software or hardware.
  • it can be implemented in the following ways, but is not limited to this: the above modules are all located in the same processor; or the above modules can be implemented in any combination.
  • the forms are located in different processors.
  • Embodiments of the present invention also provide a computer-readable storage medium that stores a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when running.
  • the above-mentioned computer-readable storage medium may be configured to store a computer program for performing the above steps.
  • the computer-readable storage medium may include but is not limited to: U disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM) , mobile hard disk, magnetic disk or optical disk and other media that can store computer programs.
  • ROM read-only memory
  • RAM random access memory
  • mobile hard disk magnetic disk or optical disk and other media that can store computer programs.
  • An embodiment of the present invention also provides an electronic device, including a memory and a processor.
  • a computer program is stored in the memory, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.
  • the above-mentioned electronic device may further include a transmission device and an input and output device. equipment, wherein the transmission device is connected to the above-mentioned processor, and the input and output device is connected to the above-mentioned processor.
  • the above-mentioned processor may be configured to perform the above steps through a computer program.
  • modules or steps of the present invention can be implemented using general-purpose computing devices. They can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices. They may be implemented in program code executable by a computing device, such that they may be stored in a storage device for execution by the computing device, and in some cases may be executed in a sequence different from that shown herein. Or the described steps can be implemented by making them into individual integrated circuit modules respectively, or by making multiple modules or steps among them into a single integrated circuit module. As such, the invention is not limited to any specific combination of hardware and software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Image Processing (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

Embodiments of the present invention provide a floor material recognition method and apparatus, a storage medium, and an electronic apparatus. The method comprises: obtaining attitude information of a target device when moving in a region to be detected; determining, on the basis of the attitude information, the reliability of the target device to recognize a floor material of the region to be detected; and determining, according to the reliability, a recognition result of the floor material of the region to be detected. By means of the present invention, the problem in the related art of inaccurate recognition of floor materials is solved, thereby achieving the effect of improving the recognition accuracy of floor materials.

Description

地面材质的识别方法及装置、存储介质、电子装置Ground material identification method and device, storage medium, electronic device
本公开要求如下专利申请的优先权:于2022年04月25日提交中国专利局、申请号为:202210441624.1、发明名称为“地面材质的识别方法及装置、存储介质、电子装置”的中国专利申请;上述专利申请的全部内容通过引用结合在本公开中。This disclosure requires the priority of the following patent application: a Chinese patent application submitted to the China Patent Office on April 25, 2022, with the application number: 202210441624.1, and the invention name is "Ground material identification method and device, storage medium, electronic device" ; The entire contents of the above patent applications are incorporated into this disclosure by reference.
技术领域Technical field
本发明实施例涉及机器人技术领域,具体而言,涉及一种地面材质的识别方法及装置、存储介质、电子装置。Embodiments of the present invention relate to the field of robotic technology, and specifically, to a ground material identification method and device, a storage medium, and an electronic device.
背景技术Background technique
现有技术中,一般会利用单一设备识别材料的材质。例如,利用设置在目标设备(例如,扫地机器人)中的超声波或者红外信号或者人工智能(Artificial Intelligence,简称为AI)识别地板的材质信息。In the existing technology, a single device is generally used to identify the material material. For example, ultrasonic or infrared signals or artificial intelligence (Artificial Intelligence, referred to as AI) installed in the target device (for example, a sweeping robot) are used to identify the material information of the floor.
但在目标设备的姿态出现异常或者材质不平整的情况下,对地面材质的识别容易出现误检测的问题。However, when the posture of the target device is abnormal or the material is uneven, the recognition of ground materials is prone to false detection problems.
发明内容Contents of the invention
本发明实施例提供了一种地面材质的识别方法及装置、存储介质、电子装置,以至少解决相关技术中对地面材质的识别不准确的问题。Embodiments of the present invention provide a ground material identification method and device, a storage medium, and an electronic device, so as to at least solve the problem of inaccurate ground material identification in related technologies.
根据本发明的一个实施例,提供了一种地面材质的识别方法,包括:获取目标设备在待测区域移动过程中的姿态信息;基于上述姿态信息确定上述目标设备识别上述待测区域中地面材质的可信度;根据上述可信度确定上述待测区域中的地面材质的识别结果。According to an embodiment of the present invention, a ground material identification method is provided, which includes: obtaining posture information of a target device during movement in an area to be measured; and determining based on the posture information that the target device recognizes the ground material in the area to be measured. The credibility; determine the recognition result of the ground material in the above-mentioned area to be measured based on the above credibility.
根据本发明的另一个实施例,提供了一种地面材质的识别装置,包括:第一获取模块,用于获取目标设备在待测区域移动过程中的姿态信息;第一确定模块,用于基于上述姿态信息确定上述目标设备识别上述待测区域中地面材质的可信度;第二确定模块,用于根据上述可信度确定上述待测区域中的地面材质的识别结果。 According to another embodiment of the present invention, a ground material recognition device is provided, including: a first acquisition module, used to acquire posture information of the target device during movement in the area to be measured; a first determination module, based on The above posture information determines the credibility of the target device in identifying the ground material in the area to be measured; the second determination module is used to determine the recognition result of the ground material in the area to be measured based on the credibility.
在一个示例性实施例中,上述第一获取模块包括:第一获取单元,用于在上述姿态信息包括距离信息的情况下,获取上述目标设备到上述待测区域表面的垂向距离。In an exemplary embodiment, the first acquisition module includes: a first acquisition unit, configured to acquire the vertical distance from the target device to the surface of the area to be measured when the posture information includes distance information.
在一个示例性实施例中,上述第一获取单元包括:第一确定子单元,用于确定上述目标设备的中心点;第一计算子单元,用于根据上述中心点,计算得到上述目标设备到上述待测区域表面的垂向距离。In an exemplary embodiment, the above-mentioned first acquisition unit includes: a first determination sub-unit, used to determine the center point of the above-mentioned target device; a first calculation sub-unit, used to calculate, based on the above-mentioned center point, the destination of the above-mentioned target device. The vertical distance to the surface of the above-mentioned area to be measured.
在一个示例性实施例中,上述第一获取单元包括:第二确定子单元,用于确定上述目标设备中的多个测量点;第二计算子单元,用于计算每个测量点到上述待测区域表面的垂向距离,得到多个垂向距离;第三确定子单元,用于将上述多个垂向距离的平均值确定为上述目标设备到上述待测区域表面的垂向距离。In an exemplary embodiment, the above-mentioned first acquisition unit includes: a second determination sub-unit, used to determine a plurality of measurement points in the above-mentioned target device; a second calculation sub-unit, used to calculate each measurement point to the above-mentioned target device. The vertical distance of the surface of the measured area is measured to obtain multiple vertical distances; the third determination subunit is used to determine the average value of the multiple vertical distances as the vertical distance from the target device to the surface of the area to be measured.
在一个示例性实施例中,上述第一确定模块,包括:第一确定单元,用于根据上述垂向距离和预设距离区间,确定上述目标设备识别上述待测区域中地面材质的可信度。In an exemplary embodiment, the first determination module includes: a first determination unit, configured to determine the credibility of the target device in identifying the ground material in the area to be measured based on the vertical distance and the preset distance interval. .
在一个示例性实施例中,上述第一确定单元,包括:第四确定子单元,用于当上述垂向距离不大于第一预设阈值时,将上述可信度确定为第一可信度;第五确定子单元,用于当上述垂向距离大于上述第一预设阈值,且小于第二预设阈值时,将上述可信度确定为第二可信度;第六确定子单元,用于当上述垂向距离不小于上述第二预设阈值时,将上述可信度确定为第三可信度;其中,上述第一可信度大于上述第二可信度,上述第二可信度大于上述第三可信度。In an exemplary embodiment, the above-mentioned first determination unit includes: a fourth determination sub-unit, configured to determine the above-mentioned credibility as the first credibility when the above-mentioned vertical distance is not greater than a first preset threshold. ; The fifth determination subunit is used to determine the credibility as the second credibility when the vertical distance is greater than the first preset threshold and less than the second preset threshold; the sixth determination subunit, It is used to determine the above-mentioned credibility as the third credibility when the above-mentioned vertical distance is not less than the above-mentioned second preset threshold; wherein the above-mentioned first credibility is greater than the above-mentioned second credibility, and the above-mentioned second credibility can The reliability is greater than the third credibility mentioned above.
在一个示例性实施例中,上述第二确定模块,包括,第二确定单元,用于当上述可信度为上述第一可信度时,将上述识别结果确定为上述地面材质的第一目标识别结果;第二获取单元,用于当上述可信度为上述第二可信度时,按照预设策略获取上述地面材质的第二目标识别结果;第一指示单元,用于当上述可信度为上述第三可信度时,指示上述目标设备停止工作,并发出提示信息,其中,上述提示信息用于提示上述目标设备的移动出现异常。In an exemplary embodiment, the second determination module includes a second determination unit configured to determine the recognition result as the first target of the ground material when the credibility is the first credibility. Recognition result; the second acquisition unit is used to obtain the second target recognition result of the ground material according to a preset strategy when the credibility is the second credibility; the first indication unit is used to obtain the second target recognition result of the ground material when the credibility is the credibility When the degree of confidence reaches the third credibility level, the target device is instructed to stop working and a prompt message is issued, where the prompt information is used to prompt that the movement of the target device is abnormal.
在一个示例性实施例中,上述第二获取单元,包括:第七确定子单元,用于确定上述目标设备在预设时间段内的距离信息;第八确定子单元,用于当上述距离信息持续满足上述第二可信度时,确定上述预设时间段内N个识别结果,其中,上述N为大于1的自然数;第九确定子单元,用于从上述N个识别结果中确定出 上述第二目标识别结果。In an exemplary embodiment, the above-mentioned second acquisition unit includes: a seventh determination sub-unit, used to determine the distance information of the above-mentioned target device within a preset time period; an eighth determination sub-unit, used to determine when the above-mentioned distance information When the above-mentioned second credibility is continuously satisfied, N recognition results within the above-mentioned preset time period are determined, wherein the above-mentioned N is a natural number greater than 1; the ninth determination sub-unit is used to determine the N recognition results from the above-mentioned N recognition results. The above second target recognition result.
在一个示例性实施例中,上述第九确定子单元还用于执行以下之一:按照上述N个识别结果中的不同结果类型,确定M个结果集合,其中,具有相同结果类型的识别结果集合在同一结果集合中,一个识别结果是上述结果集合中的一个元素,上述M是大于或等于1的自然数;将上述M个结果集合中元素数量最多的结果集合对应的结果类型,确定为上述第二目标识别结果。In an exemplary embodiment, the above-mentioned ninth determination subunit is also used to perform one of the following: determine M result sets according to different result types among the above N recognition results, wherein the recognition result sets with the same result type In the same result set, a recognition result is an element in the above-mentioned result set, and the above-mentioned M is a natural number greater than or equal to 1; the result type corresponding to the result set with the largest number of elements among the above-mentioned M result sets is determined as the above-mentioned th 2. Target recognition results.
在一个示例性实施例中,上述装置还包括:第一指示模块,用于按照上述N个识别结果中的不同结果类型,确定M个结果集合之后,当每个结果集合中的元素数量均小于预设数量时,指示上述目标设备停止工作,并发出上述提示信息。In an exemplary embodiment, the above device further includes: a first indication module, configured to determine M result sets according to different result types among the above N recognition results, when the number of elements in each result set is less than When the number is preset, the above target device is instructed to stop working and the above prompt message is issued.
在一个示例性实施例中,上述第一确定模块,包括:第三确定单元,用于确定上述目标设备与上述待测区域表面的倾斜角度;第四确定单元,用于当上述垂向距离大于第一预设阈值,且小于第二预设阈值,且上述倾斜角度小于第三预设阈值时,将上述可信度确定为第二可信度;第五确定单元,用于当上述垂向距离大于上述第一预设阈值,且小于上述第二预设阈值,且上述倾斜角度不小于上述第三预设阈值时,将上述可信度确定为第三可信度;其中,上述第二可信度大于上述第三可信度。In an exemplary embodiment, the above-mentioned first determination module includes: a third determination unit, used to determine the inclination angle between the above-mentioned target device and the above-mentioned area surface to be measured; a fourth determination unit, used to determine when the above-mentioned vertical distance is greater than When the first preset threshold is less than the second preset threshold, and the inclination angle is less than the third preset threshold, the credibility is determined as the second credibility; the fifth determination unit is used to determine when the vertical angle When the distance is greater than the above-mentioned first preset threshold and less than the above-mentioned second preset threshold, and the above-mentioned tilt angle is not less than the above-mentioned third preset threshold, the above-mentioned credibility is determined as the third credibility; wherein, the above-mentioned second credibility The credibility is greater than the third credibility mentioned above.
根据本发明的又一个实施例,还提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有计算机程序,其中,所述计算机程序被设置为运行时执行上述任一项方法实施例中的步骤。According to yet another embodiment of the present invention, a computer-readable storage medium is also provided. A computer program is stored in the computer-readable storage medium, wherein the computer program is configured to execute any of the above methods when running. Steps in Examples.
根据本发明的又一个实施例,还提供了一种电子装置,包括存储器和处理器,所述存储器中存储有计算机程序,所述处理器被设置为运行所述计算机程序以执行上述任一项方法实施例中的步骤。According to yet another embodiment of the present invention, an electronic device is also provided, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to perform any of the above. Steps in method embodiments.
通过本发明,通过获取的目标设备在待测区域移动过程中的姿态信息,确定目标设备识别待测区域中地面材质的可信度;并根据可信度确定待测区域中的地面材质的识别结果。使得在目标设备对地面材质进行识别之后,进一步地通过姿态信息验证识别结果的可信度,进一步的验证了地面材质的识别准确度。因此,可以解决相关技术中对地面材质的识别不准确的问题,达到提高识别地面材质的准确性的效果。 Through the present invention, the credibility of the target device in identifying the ground material in the area to be measured is determined by obtaining the attitude information of the target device during its movement in the area to be measured; and the identification of the ground material in the area to be measured is determined based on the credibility. result. After the target device recognizes the ground material, the credibility of the recognition result is further verified through the posture information, further verifying the accuracy of the recognition of the ground material. Therefore, the problem of inaccurate identification of ground materials in related technologies can be solved, and the accuracy of identifying ground materials can be improved.
附图说明Description of drawings
图1是本发明实施例的一种地面材质的识别方法的移动终端的硬件结构框图;Figure 1 is a hardware structure block diagram of a mobile terminal for a ground material identification method according to an embodiment of the present invention;
图2是根据本发明实施例的地面材质的识别方法的流程图;Figure 2 is a flow chart of a ground material identification method according to an embodiment of the present invention;
图3是根据本发明实施例的地面材质的识别装置的结构框图。Figure 3 is a structural block diagram of a ground material identification device according to an embodiment of the present invention.
具体实施方式Detailed ways
下文中将参考附图并结合实施例来详细说明本发明的实施例。Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and embodiments.
需要说明的是,本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.
本申请实施例中所提供的方法实施例可以在移动终端、计算机终端或者类似的运算装置中执行。以运行在移动终端上为例,图1是本发明实施例的一种地面材质的识别方法的移动终端的硬件结构框图。如图1所示,移动终端可以包括一个或多个(图1中仅示出一个)处理器102(处理器102可以包括但不限于微处理器MCU或可编程逻辑器件FPGA等的处理装置)和用于存储数据的存储器104,其中,上述移动终端还可以包括用于通信功能的传输设备106以及输入输出设备108。本领域普通技术人员可以理解,图1所示的结构仅为示意,其并不对上述移动终端的结构造成限定。例如,移动终端还可包括比图1中所示更多或者更少的组件,或者具有与图1所示不同的配置。The method embodiments provided in the embodiments of this application can be executed in a mobile terminal, a computer terminal, or a similar computing device. Taking running on a mobile terminal as an example, FIG. 1 is a hardware structure block diagram of a mobile terminal for a ground material identification method according to an embodiment of the present invention. As shown in Figure 1, the mobile terminal may include one or more (only one is shown in Figure 1) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the above-mentioned mobile terminal may also include a transmission device 106 and an input and output device 108 for communication functions. Persons of ordinary skill in the art can understand that the structure shown in Figure 1 is only illustrative, and it does not limit the structure of the above-mentioned mobile terminal. For example, the mobile terminal may also include more or fewer components than shown in FIG. 1 , or have a different configuration than shown in FIG. 1 .
存储器104可用于存储计算机程序,例如,应用软件的软件程序以及模块,如本发明实施例中的地面材质的识别方法对应的计算机程序,处理器102通过运行存储在存储器104内的计算机程序,从而执行各种功能应用以及数据处理,即实现上述的方法。存储器104可包括高速随机存储器,还可包括非易失性存储器,如一个或者多个磁性存储装置、闪存、或者其他非易失性固态存储器。在一些实例中,存储器104可进一步包括相对于处理器102远程设置的存储器,这些远程存储器可以通过网络连接至移动终端。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the ground material identification method in the embodiment of the present invention. The processor 102 runs the computer program stored in the memory 104, thereby Execute various functional applications and data processing, that is, implement the above methods. Memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely relative to the processor 102, and these remote memories may be connected to the mobile terminal through a network. Examples of the above-mentioned networks include but are not limited to the Internet, intranets, local area networks, mobile communication networks and combinations thereof.
传输装置106用于经由一个网络接收或者发送数据。上述的网络具体实例可包括移动终端的通信供应商提供的无线网络。在一个实例中,传输装置106包括一个网络适配器(Network Interface Controller,简称为NIC),其可通过基站 与其他网络设备相连从而可与互联网进行通讯。在一个实例中,传输装置106可以为射频(Radio Frequency,简称为RF)模块,其用于通过无线方式与互联网进行通讯。The transmission device 106 is used to receive or send data via a network. Specific examples of the above-mentioned network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, NIC for short), which can Connect to other network devices to communicate with the Internet. In one example, the transmission device 106 may be a radio frequency (Radio Frequency, RF for short) module, which is used to communicate with the Internet wirelessly.
在本实施例中提供了一种地面材质的识别方法,图2是根据本发明实施例的地面材质的识别方法的流程图,如图2所示,该流程包括如下步骤:This embodiment provides a method for identifying ground materials. Figure 2 is a flow chart of a method for identifying ground materials according to an embodiment of the present invention. As shown in Figure 2, the process includes the following steps:
步骤S202,获取目标设备在待测区域移动过程中的姿态信息;Step S202: Obtain the posture information of the target device during movement in the area to be measured;
在本实施例中,目标设备包括但不限于是家电设备,例如,扫地机器人、吸尘器等。待测区域包括但不限于是设置有目标材料的区域,例如,铺设瓷砖或木地板的地面。In this embodiment, the target device includes but is not limited to home appliances, such as sweeping robots, vacuum cleaners, etc. The area to be tested includes, but is not limited to, an area where the target material is provided, such as a floor with tiles or wooden floors.
在本实施例中,姿态信息包括目标设备在待测区域移动过程中与地面之间的距离信息和角度信息,例如,在目标设备是扫地机器人时,扫地机器人在铺设瓷砖的地面移动的过程中,处于与地面平行的姿态,可以获取目标设备与地面之间的距离;或者,扫地机器人在过门槛时,处于倾斜的姿态,可以获取目标设备与地面之间的倾斜角度。In this embodiment, the posture information includes distance information and angle information between the target device and the ground when it is moving in the area to be measured. For example, when the target device is a sweeping robot, the sweeping robot is moving on a floor laid with tiles. , in an attitude parallel to the ground, the distance between the target device and the ground can be obtained; or, when the sweeping robot crosses the threshold, it is in an inclined attitude, and the tilt angle between the target device and the ground can be obtained.
步骤S204,基于所述姿态信息确定目标设备识别待测区域中地面材质的可信度;Step S204: Determine the credibility of the target device in identifying the ground material in the area to be measured based on the posture information;
在本实施例中,按照目标设备不同的姿态信息计算与地面之间的距离。例如,扫地机器人在移动的过程中,与地面保持平行的状态,则可以检测目标设备的底盘与地面之间的距离,按照距离检测对地面材质识别的可信度。In this embodiment, the distance to the ground is calculated based on different posture information of the target device. For example, if the sweeping robot remains parallel to the ground during movement, it can detect the distance between the chassis of the target device and the ground, and detect the credibility of the ground material recognition based on the distance.
步骤S206,根据可信度确定待测区域中的地面材质的识别结果。Step S206: Determine the recognition result of the ground material in the area to be measured based on the credibility.
在本实施例中,识别结果中包括地面的材质信息,例如,检测出地面铺设的地板是木质材料的,或者检测出地面铺设的地板是石质材料的。In this embodiment, the recognition result includes the material information of the ground. For example, it is detected that the floor laid on the ground is made of wooden material, or it is detected that the floor laid on the ground is made of stone material.
其中,上述步骤的执行主体可以为终端、服务器、终端或服务器中设置的具体处理器,或者与终端或者服务器相对独立设置的处理器或者处理设备等,但不限于此。The execution subject of the above steps may be a terminal, a server, a specific processor provided in the terminal or server, or a processor or processing device provided relatively independently from the terminal or server, but is not limited thereto.
通过上述步骤,通过获取的目标设备在待测区域移动过程中的姿态信息,确定目标设备识别待测区域中地面材质的可信度;并根据可信度确定待测区域中的地面材质的识别结果基于目标设备在目标区域中的姿态信息检测目标设备与目 标区域之间的距离,确定目标距离,并按照目标距离验证目标设备对目标材料的材质的识别结果。使得在目标设备对目标材料的地面材质进行识别之后,进一步地通过姿态信息目标距离验证识别结果的可信度,从而提高了目标材料的地面材质识别的准确度性。因此,可以解决相关技术中对材料的地面材质的识别不准确的问题,达到提高识别地面材料的材质的准确性的效果。Through the above steps, the credibility of the target device's identification of the ground material in the area to be measured is determined by obtaining the posture information of the target device during its movement in the area to be measured; and the identification of the ground material in the area to be measured is determined based on the credibility. The results detect the target device and the target based on the attitude information of the target device in the target area. The distance between the target areas is determined, and the recognition result of the target device's material of the target material is verified according to the target distance. After the target device identifies the ground material of the target material, the credibility of the recognition result is further verified through the attitude information target distance, thereby improving the accuracy of the ground material identification of the target material. Therefore, the problem of inaccurate identification of the ground material of the material in the related technology can be solved, and the accuracy of identifying the material of the ground material can be improved.
在一个示例性实施例中,在姿态信息包括距离信息的情况下,获取目标设备在待测区域移动过程中的姿态信息,包括:In an exemplary embodiment, when the posture information includes distance information, obtaining the posture information of the target device during movement in the area to be measured includes:
S21,获取目标设备到待测区域表面的垂向距离。S21: Obtain the vertical distance from the target device to the surface of the area to be measured.
本实施例适用于目标设备与地面保持平行的场景中。例如,在平整地面正常移动的场景。This embodiment is suitable for scenarios where the target device is parallel to the ground. For example, a scene of normal movement on flat ground.
在本实施例中,目标设备到待测区域表面的垂向距离,即是目标设备到待测区域表面的垂直方向的距离。例如,扫地机器人的底盘的中心点与所在地板之间的垂直距离;或者,扫地机器人的底盘的中心点与所在地板之间多个距离的平均距离。In this embodiment, the vertical distance from the target device to the surface of the area to be measured is the vertical distance from the target device to the surface of the area to be measured. For example, the vertical distance between the center point of the chassis of the sweeping robot and the floor; or the average distance of multiple distances between the center point of the chassis of the sweeping robot and the floor.
在本实施例中,可以通过传感器获取目标设备到待测区域表面的垂向距离。传感器可以设置在目标设备的底盘处,也可以设置在目标设备的其他位置。传感器可以是超声波传感器或者红外传感器。例如,以目标设备是扫地机器人为例进行说明,传感器设置在扫地机器人的底盘处,在扫地机器人移动的过程中检测底盘设备与地面之间的距离。需要说明的是,扫地机器人可以在移动的过程中识别地面材质,也可以在静止时识别地面材质。可以通过传感器(例如,超声波传感器或者红外传感器)直接识别地面材质;也可以通过其他方式识别地面材质,例如,将获取的目标材料的特征上传到处理器中,通过处理器识别地面材质。In this embodiment, the vertical distance from the target device to the surface of the area to be measured can be obtained through a sensor. The sensor can be set at the chassis of the target device or at other locations on the target device. The sensor can be an ultrasonic sensor or an infrared sensor. For example, taking the target device as a sweeping robot as an example, the sensor is installed on the chassis of the sweeping robot to detect the distance between the chassis device and the ground during the movement of the sweeping robot. It should be noted that the sweeping robot can identify the ground material while moving and can also identify the ground material when stationary. The ground material can be directly identified through sensors (for example, ultrasonic sensors or infrared sensors); the ground material can also be identified through other methods, for example, the acquired characteristics of the target material are uploaded to the processor, and the ground material is identified through the processor.
此外,本实施例是在扫地机器人对地面设置的目标材料的材质进行识别之后获取的目标距离。In addition, in this embodiment, the target distance is obtained after the sweeping robot identifies the material of the target material set on the ground.
在一个示例性实施例中,获取目标设备到待测区域表面的垂向距离,包括:In an exemplary embodiment, obtaining the vertical distance from the target device to the surface of the area to be measured includes:
S31,确定目标设备的中心点;S31, determine the center point of the target device;
S32,根据中心点,计算得到目标设备到待测区域表面的垂向距离。S32: Calculate the vertical distance from the target device to the surface of the area to be measured based on the center point.
在本实施例中,目标设备的中心点到地面的垂直距离即是垂向距离。例如, 通过传感器测量测量得到扫地机器人的底盘的中心点地面之间的垂直距离。In this embodiment, the vertical distance from the center point of the target device to the ground is the vertical distance. For example, The vertical distance between the center point of the chassis of the sweeping robot and the ground is measured through sensor measurement.
在一个示例性实施例中,获取目标设备到待测区域表面的垂向距离,包括:In an exemplary embodiment, obtaining the vertical distance from the target device to the surface of the area to be measured includes:
S41,确定目标设备中的多个测量点;S41, determine multiple measurement points in the target device;
S42,计算每个测量点到待测区域表面的垂向距离,得到多个垂向距离;S42, calculate the vertical distance from each measurement point to the surface of the area to be measured, and obtain multiple vertical distances;
S43,将多个垂向距离的平均值确定为目标设备到待测区域表面的垂向距离。S43: Determine the average value of multiple vertical distances as the vertical distance from the target device to the surface of the area to be measured.
在本实施例中,目标设备中的多个测量点到地面的垂直距离,即是垂向距离。多个测量点可以为目标设备底盘不同的位置,比如目标设备底盘均匀分布的多个位置,例如,通过传感器测量扫地机器人的底盘上的多个测量点与地板之间的垂直距离,得到多个垂直距离(例如,2.5cm、3.5cm、3cm),将多个垂直距离的平均值确定为垂向距离(例如,3cm)。In this embodiment, the vertical distance from multiple measurement points in the target device to the ground is the vertical distance. The multiple measurement points can be different positions on the chassis of the target device, such as multiple positions evenly distributed on the chassis of the target device. For example, a sensor can be used to measure the vertical distance between multiple measurement points on the chassis of a sweeping robot and the floor to obtain multiple Vertical distance (for example, 2.5cm, 3.5cm, 3cm), the average value of multiple vertical distances is determined as the vertical distance (for example, 3cm).
在一个示例性实施例中,基于姿态信息确定目标设备识别待测区域中地面材质的可信度,包括:In an exemplary embodiment, determining the credibility of the target device's recognition of the ground material in the area to be measured based on the posture information includes:
S51,根据垂向距离和预设距离区间,确定目标设备识别待测区域中地面材质的可信度。S51: Determine the credibility of the target device in identifying the ground material in the area to be measured based on the vertical distance and the preset distance interval.
在本实施例中,预设距离区间可以是基于测量垂向距离的传感器所能识别的距离阈值确定的,可以理解为,在不同的距离范围内,目标设备对地面材质识别的可靠性不同,在较低的范围内,说明目标设备离地面更近,识别的可靠性更高,相反,当所述垂向距离比较大,避免目标设备离地面距离更远,其对地面材质识别的可靠性会更低,进一步地,当所述垂向距离比较大,也表面了目标设备底盘离地面比较远,比如处于较高的悬空状态,会对目标设备的安全性带来影响。例如,在传感器所能识别的距离阈值是10cm,预设距离可以设置为小于8cm的值。In this embodiment, the preset distance interval may be determined based on a distance threshold that can be identified by a sensor that measures vertical distance. It can be understood that within different distance ranges, the target device has different reliability in identifying ground materials. In a lower range, it means that the target device is closer to the ground, and the recognition reliability is higher. On the contrary, when the vertical distance is relatively large, it avoids that the target device is further away from the ground, and its reliability in identifying the ground material is lower. Furthermore, when the vertical distance is relatively large, it also means that the chassis of the target equipment is relatively far from the ground, such as being in a high suspended state, which will have an impact on the safety of the target equipment. For example, if the distance threshold that the sensor can recognize is 10cm, the preset distance can be set to a value less than 8cm.
在一个示例性实施例中,根据垂向距离和预设距离区间,确定目标设备识别待测区域中地面材质的可信度,包括:In an exemplary embodiment, determining the credibility of the target device in identifying the ground material in the area to be measured based on the vertical distance and the preset distance interval includes:
S61,当垂向距离不大于第一预设阈值时,将可信度确定为第一可信度;S61, when the vertical distance is not greater than the first preset threshold, determine the credibility as the first credibility;
S62,当垂向距离大于第一预设阈值,且小于第二预设阈值时,将可信度确定为第二可信度;S62, when the vertical distance is greater than the first preset threshold and less than the second preset threshold, determine the credibility as the second credibility;
S63,当垂向距离不小于第二预设阈值时,将可信度确定为第三可信度; S63, when the vertical distance is not less than the second preset threshold, determine the credibility as the third credibility;
其中,第一可信度大于第二可信度,第二可信度大于第三可信度。Among them, the first credibility is greater than the second credibility, and the second credibility is greater than the third credibility.
在本实施例中,第一预设阈值和第二预设阈值均包括在预设距离区间中。例如,第一预设阈值可以设置为小于3cm的值;第二预设阈值可以设置为大于或等于3cm,且小于6cm的值。In this embodiment, both the first preset threshold and the second preset threshold are included in the preset distance interval. For example, the first preset threshold may be set to a value less than 3 cm; the second preset threshold may be set to a value greater than or equal to 3 cm and less than 6 cm.
在本实施例中,垂向距离越小,地面材质的可信度越大,反之越小。例如,在对地面材质的识别结果是木质材料,且垂向距离是1cm的情况下,则表示地面材质是木质材料的概率大于90%;在对地面材质的识别结果是木质材料,且垂向距离是5cm的情况下,则表示地面材质是木质材料的概率小于50%,此时需要进一步的确定地面材质;在地面材质的识别结果是木质材料,且垂向距离是9cm的情况下,则表示地面材质是木质材料的概率极小,此时目标设备可能处于倾斜的状态,需要退出当前所在的区域,终止对地面材质的识别。In this embodiment, the smaller the vertical distance, the greater the credibility of the ground material, and vice versa. For example, if the recognition result of the ground material is wooden material, and the vertical distance is 1cm, it means that the probability that the ground material is wooden material is greater than 90%; if the recognition result of the ground material is wooden material, and the vertical distance When the distance is 5cm, it means that the probability that the ground material is wooden material is less than 50%. At this time, the ground material needs to be further determined; when the recognition result of the ground material is wooden material and the vertical distance is 9cm, then It means that the probability that the ground material is wooden is extremely small. At this time, the target device may be in a tilted state and needs to exit the current area to terminate the recognition of the ground material.
需要说明的是,上述第一可信度、第二可信度和第三可信度的确定范围可以根据实际情况设计,比如,根据不同的目标设备的型号设置不同的预设距离区间,当然,在一些其他实施例中,也可以只设置两个预设距离区间,相应地,只确定两个可信度,进一步地,也可以由多个区域距离区间确定的多个可信度,可信度的数量在本说明书实施例不做限定。It should be noted that the determination ranges of the above-mentioned first credibility, second credibility and third credibility can be designed according to the actual situation. For example, different preset distance intervals can be set according to different models of target devices. Of course, , in some other embodiments, only two preset distance intervals can be set, and accordingly, only two credibility levels can be determined. Furthermore, multiple credibility levels determined by multiple regional distance intervals can also be determined. The number of reliability is not limited in the embodiment of this specification.
在一个示例性实施例中,根据可信度确定待测区域中的地面材质的识别结果,包括,In an exemplary embodiment, determining the recognition result of the ground material in the area to be measured based on credibility includes:
S71,当可信度为第一可信度时,将识别结果确定为地面材质的第一目标识别结果;S71, when the credibility is the first credibility, determine the recognition result as the first target recognition result of the ground material;
S72,当可信度为第二可信度时,按照预设策略获取地面材质的第二目标识别结果;S72, when the credibility is the second credibility, obtain the second target recognition result of the ground material according to the preset strategy;
S73,当可信度为第三可信度时,指示目标设备停止工作,并发出提示信息,其中,提示信息用于提示目标设备的移动出现异常。S73, when the credibility is the third credibility, instruct the target device to stop working and send out prompt information, where the prompt information is used to prompt that the movement of the target device is abnormal.
在本实施例中,第一可信度、第二可信度以及第三可信度,用于表示地面材质是真实材质的概率。In this embodiment, the first credibility, the second credibility and the third credibility are used to represent the probability that the ground material is a real material.
在一个示例性实施例中,当可信度为第二可信度时,按照预设策略获取地面材质的第二目标识别结果,包括: In an exemplary embodiment, when the credibility is the second credibility, the second target recognition result of the ground material is obtained according to a preset strategy, including:
S81,确定目标设备在预设时间段内的距离信息;S81, determine the distance information of the target device within the preset time period;
S82,当距离信息持续满足第二可信度时,确定预设时间段内N个识别结果,其中,N为大于1的自然数;S82, when the distance information continues to meet the second credibility, determine N recognition results within the preset time period, where N is a natural number greater than 1;
S83,从N个识别结果中确定出第二目标识别结果。S83: Determine the second target recognition result from the N recognition results.
在本实施例中,距离信息包括目标设备与地面之间的垂直距离。当距离信息持续满足第二可信度时,则目标设备可能处于倾斜状态。例如,扫地机器人在过门槛的过程中处于倾斜的状态,此时识别的地面材质并不准确。In this embodiment, the distance information includes the vertical distance between the target device and the ground. When the distance information continues to satisfy the second confidence level, the target device may be in a tilted state. For example, if the sweeping robot is tilted when crossing a threshold, the ground material recognized at this time is not accurate.
在本实施例中,从所述N个识别结果中确定出所述第二目标识别结果,包括以下之一:In this embodiment, the second target recognition result is determined from the N recognition results, including one of the following:
按照N个识别结果中的不同结果类型,确定M个结果集合,其中,具有相同结果类型的识别结果集合在同一结果集合中,一个识别结果是结果集合中的一个元素,M是大于或等于1的自然数;Determine M result sets according to different result types among the N recognition results, where the recognition result sets with the same result type are in the same result set, one recognition result is an element in the result set, and M is greater than or equal to 1 of natural numbers;
将M个结果集合中元素数量最多的结果集合对应的结果类型,确定为第二目标识别结果。The result type corresponding to the result set with the largest number of elements among the M result sets is determined as the second target recognition result.
在本实施例中,M、N的取值是可以基于实际应用场景或者识别要求来灵活设置的,例如,在10分钟之内识别的地面材质包括10个识别结果。可以从10个识别结果中选择距离较小的几个识别结果,从中选择识别结果一致性最多的结果作为目标识别结果。例如,在10个识别结果中A结果包括4个,B结果包括3个,C结果包括2个,D结果包括1个,则可以将A结果作为第二目标识别结果。In this embodiment, the values of M and N can be flexibly set based on actual application scenarios or recognition requirements. For example, the ground material recognized within 10 minutes includes 10 recognition results. You can select several recognition results with smaller distances from the 10 recognition results, and select the result with the most consistent recognition results as the target recognition result. For example, among the 10 recognition results, there are 4 A results, 3 B results, 2 C results, and 1 D result, then the A result can be used as the second target recognition result.
在本实施例中,按照所述N个识别结果中的不同结果类型,确定M个结果集合之后,上述方法还包括:当每个结果集合中的元素数量均小于预设数量时,指示所述目标设备停止工作,并发出所述提示信息。例如,在10个识别结果中A结果为4个,预设数量是5个的情况下,目标设备可能出现了故障,发出提示信息。此时目标设备终止对地面材质的识别。通过对预设数量的限制,可以提高在高距离下材质识别的可靠性。In this embodiment, after determining M result sets according to different result types among the N recognition results, the above method further includes: when the number of elements in each result set is less than a preset number, indicating that the The target device stops working and issues the above prompt message. For example, if there are 4 A results among 10 recognition results and the preset number is 5, the target device may have malfunctioned and issued a prompt message. At this time, the target device terminates the recognition of the ground material. By limiting the number of presets, the reliability of material recognition at high distances can be improved.
在一个示例性实施例中,基于姿态信息,确定目标设备识别待测区域中地面材质的可信度,包括:In an exemplary embodiment, based on the posture information, determining the credibility of the target device in identifying the ground material in the area to be measured includes:
S91,确定目标设备与待测区域表面的倾斜角度; S91, determine the inclination angle between the target device and the surface of the area to be measured;
S92,当垂向距离大于第一预设阈值,且小于第二预设阈值,且倾斜角度小于第三预设阈值时,将可信度确定为第二可信度;S92, when the vertical distance is greater than the first preset threshold and less than the second preset threshold, and the tilt angle is less than the third preset threshold, determine the credibility as the second credibility;
S93,当垂向距离大于第一预设阈值,且小于第二预设阈值,且倾斜角度不小于第三预设阈值时,将可信度确定为第三可信度;S93, when the vertical distance is greater than the first preset threshold and less than the second preset threshold, and the tilt angle is not less than the third preset threshold, determine the credibility as the third credibility;
其中,第二可信度大于第三可信度。Among them, the second credibility is greater than the third credibility.
本实施例可以适用于目标设备与地面未保持平行的场景中。例如,扫地机器人过门槛时处于倾斜状态的场景。This embodiment may be applicable to scenarios where the target device is not parallel to the ground. For example, a scene in which the sweeping robot is tilted when crossing a threshold.
在本实施例中,可以通过传感器确定目标设备与待测区域表面的倾斜角度。传感器可以设置在目标设备的底盘上,也可以设置在目标设备的其他位置处。传感器可以超声波传感器,也可以是红外传感器。例如,以红外传感器对扫地机器人的倾斜角度进行测量为例进行说明,红外传感器检测的扫地机器人的底盘的倾斜角度是10度,小于第三预设阈值(例如20度),识别结果是木质材质,则表示地面材质是木质材料的概率大于90%。第三预设阈值的取值可以基于实际使用情况进行设定,例如,第三预设阈值是小于20的值。例如,在倾斜角度是30度,则大于第三预设阈值,在识别结果是木质材质的情况下,则表示地面材质是木质材料的概率极小。需要退出当前所在的区域,终止对目标材料的材质的识别。In this embodiment, a sensor can be used to determine the tilt angle between the target device and the surface of the area to be measured. The sensor can be disposed on the chassis of the target device or at other locations on the target device. The sensor can be an ultrasonic sensor or an infrared sensor. For example, take the infrared sensor to measure the tilt angle of the sweeping robot as an example. The tilt angle of the chassis of the sweeping robot detected by the infrared sensor is 10 degrees, which is less than the third preset threshold (for example, 20 degrees). The recognition result is that the material is made of wood. , it means that the probability that the ground material is wooden material is greater than 90%. The value of the third preset threshold can be set based on actual usage conditions. For example, the third preset threshold is a value less than 20. For example, if the tilt angle is 30 degrees, it is greater than the third preset threshold. If the recognition result is wooden material, it means that the probability that the ground material is wooden material is extremely small. You need to exit the current area and terminate the identification of the target material's material.
在本实施例中,可信度确定为第三可信度的情况下,指示目标设备终止对地面材质的识别。目标设备终止对地面材质的识别之后,还可以判断后续预设时间内检测的目标设备与地面之间的距离的变化幅度,不同的变化幅度对应不同的识别结果计算方式。例如,变化幅度较大时,则认为目标设备处于不安全状态。变化幅度较小时,则从中选择识别结果一致性最多的识别结果作为目标识别结果。In this embodiment, when the credibility is determined to be the third credibility, the target device is instructed to terminate the recognition of the ground material. After the target device terminates the recognition of the ground material, it can also determine the change amplitude of the distance between the target device and the ground detected within the subsequent preset time. Different change amplitudes correspond to different recognition result calculation methods. For example, if the change amplitude is large, the target device is considered to be in an unsafe state. When the change amplitude is small, the recognition result with the most consistent recognition results is selected as the target recognition result.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到根据上述实施例的方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is Better implementation. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or the part that contributes to the existing technology. The computer software product is stored in a storage medium (such as ROM/RAM, disk, CD), including several instructions to cause a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present invention.
在本实施例中还提供了一种地面材质的识别装置,该装置用于实现上述实施 例及优选实施方式,已经进行过说明的不再赘述。如以下所使用的,术语“模块”可以实现预定功能的软件和/或硬件的组合。尽管以下实施例所描述的装置较佳地以软件来实现,但是硬件,或者软件和硬件的组合的实现也是可能并被构想的。This embodiment also provides a ground material identification device, which is used to implement the above implementation. Examples and preferred embodiments that have already been described will not be described again. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, implementation in hardware, or a combination of software and hardware, is also possible and contemplated.
图3是根据本发明实施例的地面材质的识别装置的结构框图,如图3所示,该装置包括:Figure 3 is a structural block diagram of a ground material identification device according to an embodiment of the present invention. As shown in Figure 3, the device includes:
第一获取模块32,用于获取目标设备在待测区域移动过程中的姿态信息;The first acquisition module 32 is used to acquire the posture information of the target device during its movement in the area to be measured;
第一确定模块34,用于基于上述姿态信息确定上述目标设备识别上述待测区域中地面材质的可信度;The first determination module 34 is configured to determine the credibility of the target device's recognition of the ground material in the area to be measured based on the posture information;
第二确定模块36,用于根据上述可信度确定上述待测区域中的地面材质的识别结果。The second determination module 36 is configured to determine the recognition result of the ground material in the area to be measured based on the credibility.
在一个示例性实施例中,上述第一获取模块包括:In an exemplary embodiment, the above-mentioned first acquisition module includes:
第一获取单元,用于在上述姿态信息包括距离信息的情况下,获取上述目标设备到上述待测区域表面的垂向距离。The first acquisition unit is configured to acquire the vertical distance from the target device to the surface of the area to be measured when the attitude information includes distance information.
在一个示例性实施例中,上述第一获取单元包括:In an exemplary embodiment, the above-mentioned first acquisition unit includes:
第一确定子单元,用于确定上述目标设备的中心点;The first determination subunit is used to determine the center point of the above-mentioned target device;
第一计算子单元,用于根据上述中心点,计算得到上述目标设备到上述待测区域表面的垂向距离。The first calculation subunit is used to calculate the vertical distance from the target device to the surface of the area to be measured based on the center point.
在一个示例性实施例中,上述第一获取单元包括:In an exemplary embodiment, the above-mentioned first acquisition unit includes:
第二确定子单元,用于确定上述目标设备中的多个测量点;The second determination subunit is used to determine multiple measurement points in the above-mentioned target device;
第二计算子单元,用于计算每个测量点到上述待测区域表面的垂向距离,得到多个垂向距离;The second calculation subunit is used to calculate the vertical distance from each measurement point to the surface of the above-mentioned area to be measured, and obtain multiple vertical distances;
第三确定子单元,用于将上述多个垂向距离的平均值确定为上述目标设备到上述待测区域表面的垂向距离。The third determination subunit is used to determine the average value of the plurality of vertical distances as the vertical distance from the target device to the surface of the area to be measured.
在一个示例性实施例中,上述第一确定模块,包括:In an exemplary embodiment, the above-mentioned first determination module includes:
第一确定单元,用于根据上述垂向距离和预设距离区间,确定上述目标设备识别上述待测区域中地面材质的可信度。The first determination unit is configured to determine the credibility of the target device in identifying the ground material in the area to be measured based on the vertical distance and the preset distance interval.
在一个示例性实施例中,上述第一确定单元,包括: In an exemplary embodiment, the above-mentioned first determining unit includes:
第四确定子单元,用于当上述垂向距离不大于第一预设阈值时,将上述可信度确定为第一可信度;The fourth determination subunit is used to determine the above-mentioned credibility as the first credibility when the above-mentioned vertical distance is not greater than the first preset threshold;
第五确定子单元,用于当上述垂向距离大于上述第一预设阈值,且小于第二预设阈值时,将上述可信度确定为第二可信度;A fifth determination subunit configured to determine the credibility as the second credibility when the vertical distance is greater than the first preset threshold and less than the second preset threshold;
第六确定子单元,用于当上述垂向距离不小于上述第二预设阈值时,将上述可信度确定为第三可信度;A sixth determination subunit, configured to determine the above-mentioned credibility as a third credibility when the above-mentioned vertical distance is not less than the above-mentioned second preset threshold;
其中,上述第一可信度大于上述第二可信度,上述第二可信度大于上述第三可信度。Wherein, the above-mentioned first credibility is greater than the above-mentioned second credibility, and the above-mentioned second credibility is greater than the above-mentioned third credibility.
在一个示例性实施例中,上述第二确定模块,包括,In an exemplary embodiment, the above-mentioned second determination module includes:
第二确定单元,用于当上述可信度为上述第一可信度时,将上述识别结果确定为上述地面材质的第一目标识别结果;a second determination unit configured to determine the recognition result as the first target recognition result of the ground material when the credibility is the first credibility;
第二获取单元,用于当上述可信度为上述第二可信度时,按照预设策略获取上述地面材质的第二目标识别结果;A second acquisition unit, configured to acquire the second target recognition result of the ground material according to a preset strategy when the above-mentioned credibility is the above-mentioned second credibility;
第一指示单元,用于当上述可信度为上述第三可信度时,指示上述目标设备停止工作,并发出提示信息,其中,上述提示信息用于提示上述目标设备的移动出现异常。The first instruction unit is configured to instruct the target device to stop working and send prompt information when the credibility is the third credibility, where the prompt information is used to prompt that the movement of the target device is abnormal.
在一个示例性实施例中,上述第二获取单元,包括:In an exemplary embodiment, the above-mentioned second acquisition unit includes:
第七确定子单元,用于确定上述目标设备在预设时间段内的距离信息;The seventh determination subunit is used to determine the distance information of the above-mentioned target device within a preset time period;
第八确定子单元,用于当上述距离信息持续满足上述第二可信度时,确定上述预设时间段内N个识别结果,其中,上述N为大于1的自然数;The eighth determination subunit is used to determine N recognition results within the above-mentioned preset time period when the above-mentioned distance information continues to meet the above-mentioned second credibility, wherein the above-mentioned N is a natural number greater than 1;
第九确定子单元,用于从上述N个识别结果中确定出上述第二目标识别结果。The ninth determination subunit is used to determine the above-mentioned second target recognition result from the above-mentioned N recognition results.
在一个示例性实施例中,上述第九确定子单元还用于执行以下之一:按照上述N个识别结果中的不同结果类型,确定M个结果集合,其中,具有相同结果类型的识别结果集合在同一结果集合中,一个识别结果是上述结果集合中的一个元素,上述M是大于或等于1的自然数;In an exemplary embodiment, the above-mentioned ninth determination subunit is also used to perform one of the following: determine M result sets according to different result types among the above N recognition results, wherein the recognition result sets with the same result type In the same result set, a recognition result is an element in the above result set, and the above M is a natural number greater than or equal to 1;
将上述M个结果集合中元素数量最多的结果集合对应的结果类型,确定为上述第二目标识别结果。 The result type corresponding to the result set with the largest number of elements among the M result sets is determined as the second target recognition result.
在一个示例性实施例中,上述装置还包括:In an exemplary embodiment, the above device further includes:
第一指示模块,用于按照上述N个识别结果中的不同结果类型,确定M个结果集合之后,当每个结果集合中的元素数量均小于预设数量时,指示上述目标设备停止工作,并发出上述提示信息。The first instruction module is used to instruct the above-mentioned target device to stop working when the number of elements in each result set is less than the preset number after determining M result sets according to different result types among the above-mentioned N recognition results, and Issue the above prompt message.
在一个示例性实施例中,上述第一确定模块,包括:In an exemplary embodiment, the above-mentioned first determination module includes:
第三确定单元,用于确定上述目标设备与上述待测区域表面的倾斜角度;A third determination unit, used to determine the inclination angle between the above-mentioned target device and the above-mentioned surface of the area to be measured;
第四确定单元,用于当上述垂向距离大于第一预设阈值,且小于第二预设阈值,且上述倾斜角度小于第三预设阈值时,将上述可信度确定为第二可信度;The fourth determination unit is configured to determine the credibility as the second credibility when the vertical distance is greater than the first preset threshold and less than the second preset threshold, and the tilt angle is less than the third preset threshold. Spend;
第五确定单元,用于当上述垂向距离大于上述第一预设阈值,且小于上述第二预设阈值,且上述倾斜角度不小于上述第三预设阈值时,将上述可信度确定为第三可信度;The fifth determination unit is configured to determine the credibility as when the vertical distance is greater than the first preset threshold and less than the second preset threshold, and the tilt angle is not less than the third preset threshold. third credibility;
其中,上述第二可信度大于上述第三可信度。Wherein, the above-mentioned second credibility is greater than the above-mentioned third credibility.
需要说明的是,上述各个模块是可以通过软件或硬件来实现的,对于后者,可以通过以下方式实现,但不限于此:上述模块均位于同一处理器中;或者,上述各个模块以任意组合的形式分别位于不同的处理器中。It should be noted that each of the above modules can be implemented through software or hardware. For the latter, it can be implemented in the following ways, but is not limited to this: the above modules are all located in the same processor; or the above modules can be implemented in any combination. The forms are located in different processors.
本发明的实施例还提供了一种计算机可读存储介质,该计算机可读存储介质中存储有计算机程序,其中,该计算机程序被设置为运行时执行上述任一项方法实施例中的步骤。Embodiments of the present invention also provide a computer-readable storage medium that stores a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when running.
在本实施例中,上述计算机可读存储介质可以被设置为存储用于执行以上各步骤的计算机程序。In this embodiment, the above-mentioned computer-readable storage medium may be configured to store a computer program for performing the above steps.
在一个示例性实施例中,上述计算机可读存储介质可以包括但不限于:U盘、只读存储器(Read-Only Memory,简称为ROM)、随机存取存储器(Random Access Memory,简称为RAM)、移动硬盘、磁碟或者光盘等各种可以存储计算机程序的介质。In an exemplary embodiment, the computer-readable storage medium may include but is not limited to: U disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM) , mobile hard disk, magnetic disk or optical disk and other media that can store computer programs.
本发明的实施例还提供了一种电子装置,包括存储器和处理器,该存储器中存储有计算机程序,该处理器被设置为运行计算机程序以执行上述任一项方法实施例中的步骤。An embodiment of the present invention also provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.
在一个示例性实施例中,上述电子装置还可以包括传输设备以及输入输出设 备,其中,该传输设备和上述处理器连接,该输入输出设备和上述处理器连接。In an exemplary embodiment, the above-mentioned electronic device may further include a transmission device and an input and output device. equipment, wherein the transmission device is connected to the above-mentioned processor, and the input and output device is connected to the above-mentioned processor.
在一个示例性实施例中,上述处理器可以被设置为通过计算机程序执行以上各步骤。In an exemplary embodiment, the above-mentioned processor may be configured to perform the above steps through a computer program.
本实施例中的具体示例可以参考上述实施例及示例性实施方式中所描述的示例,本实施例在此不再赘述。For specific examples in this embodiment, reference may be made to the examples described in the above-mentioned embodiments and exemplary implementations, and details will not be described again in this embodiment.
显然,本领域的技术人员应该明白,上述的本发明的各模块或各步骤可以用通用的计算装置来实现,它们可以集中在单个的计算装置上,或者分布在多个计算装置所组成的网络上,它们可以用计算装置可执行的程序代码来实现,从而,可以将它们存储在存储装置中由计算装置来执行,并且在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤,或者将它们分别制作成各个集成电路模块,或者将它们中的多个模块或步骤制作成单个集成电路模块来实现。这样,本发明不限制于任何特定的硬件和软件结合。Obviously, those skilled in the art should understand that the above-mentioned modules or steps of the present invention can be implemented using general-purpose computing devices. They can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices. They may be implemented in program code executable by a computing device, such that they may be stored in a storage device for execution by the computing device, and in some cases may be executed in a sequence different from that shown herein. Or the described steps can be implemented by making them into individual integrated circuit modules respectively, or by making multiple modules or steps among them into a single integrated circuit module. As such, the invention is not limited to any specific combination of hardware and software.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。 The above descriptions are only preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present invention shall be included in the protection scope of the present invention.

Claims (16)

  1. 一种地面材质的识别方法,其特征在于,包括:A method for identifying ground materials, which is characterized by including:
    获取目标设备在待测区域移动过程中的姿态信息;Obtain the attitude information of the target device during movement in the area to be measured;
    基于所述姿态信息确定所述目标设备识别所述待测区域中地面材质的可信度;Determine the credibility of the target device in identifying the ground material in the area to be measured based on the posture information;
    根据所述可信度确定所述待测区域中的地面材质的识别结果。The recognition result of the ground material in the area to be measured is determined based on the credibility.
  2. 根据权利要求1所述的方法,其特征在于,在所述姿态信息包括距离信息的情况下,所述获取目标设备在待测区域移动过程中的姿态信息,包括:The method according to claim 1, characterized in that, when the posture information includes distance information, the obtaining the posture information of the target device during movement in the area to be measured includes:
    获取所述目标设备到所述待测区域表面的垂向距离。Obtain the vertical distance from the target device to the surface of the area to be measured.
  3. 根据权利要求2所述的方法,其特征在于,所述获取所述目标设备到所述待测区域表面的垂向距离,包括:The method according to claim 2, characterized in that said obtaining the vertical distance from the target device to the surface of the area to be measured includes:
    确定所述目标设备的中心点;Determine the center point of the target device;
    根据所述中心点,计算得到所述目标设备到所述待测区域表面的垂向距离。According to the center point, the vertical distance from the target device to the surface of the area to be measured is calculated.
  4. 根据权利要求2所述的方法,其特征在于,所述获取所述目标设备到所述待测区域表面的垂向距离,包括:The method according to claim 2, characterized in that said obtaining the vertical distance from the target device to the surface of the area to be measured includes:
    确定所述目标设备中的多个测量点;determining a plurality of measurement points in the target device;
    计算每个测量点到所述待测区域表面的垂向距离,得到多个垂向距离;Calculate the vertical distance from each measurement point to the surface of the area to be measured, and obtain multiple vertical distances;
    将所述多个垂向距离的平均值确定为所述目标设备到所述待测区域表面的垂向距离。The average value of the plurality of vertical distances is determined as the vertical distance from the target device to the surface of the area to be measured.
  5. 根据权利要求2所述的方法,其特征在于,基于所述姿态信息确定所述目标设备识别所述待测区域中地面材质的可信度,包括:The method according to claim 2, characterized in that, based on the posture information, determining the credibility of the target device in identifying the ground material in the area to be measured includes:
    根据所述垂向距离和预设距离区间,确定所述目标设备识别所述待测区域中地面材质的可信度。According to the vertical distance and the preset distance interval, the credibility of the target device in identifying the ground material in the area to be measured is determined.
  6. 根据权利要求5所述的方法,其特征在于,所述根据所述垂向距离 和预设距离区间,确定所述目标设备识别所述待测区域中地面材质的可信度,包括:The method according to claim 5, characterized in that, according to the vertical distance and the preset distance interval to determine the credibility of the target device in identifying the ground material in the area to be measured, including:
    当所述垂向距离不大于第一预设阈值时,将所述可信度确定为第一可信度;When the vertical distance is not greater than the first preset threshold, the credibility is determined as the first credibility;
    当所述垂向距离大于所述第一预设阈值,且小于第二预设阈值时,将所述可信度确定为第二可信度;When the vertical distance is greater than the first preset threshold and less than the second preset threshold, the credibility is determined as the second credibility;
    当所述垂向距离不小于所述第二预设阈值时,将所述可信度确定为第三可信度;When the vertical distance is not less than the second preset threshold, determine the credibility as a third credibility;
    其中,所述第一可信度大于所述第二可信度,所述第二可信度大于所述第三可信度。Wherein, the first credibility is greater than the second credibility, and the second credibility is greater than the third credibility.
  7. 根据权利要求6所述的方法,其特征在于,所述根据所述可信度确定所述待测区域中的地面材质的识别结果,包括,The method of claim 6, wherein determining the identification result of the ground material in the area to be measured based on the credibility includes:
    当所述可信度为所述第一可信度时,将所述识别结果确定为所述地面材质的第一目标识别结果;When the credibility is the first credibility, determining the recognition result as the first target recognition result of the ground material;
    当所述可信度为所述第二可信度时,按照预设策略获取所述地面材质的第二目标识别结果;When the credibility is the second credibility, obtain the second target recognition result of the ground material according to a preset strategy;
    当所述可信度为所述第三可信度时,指示所述目标设备停止工作,并发出提示信息,其中,所述提示信息用于提示所述目标设备的移动出现异常。When the credibility is the third credibility, the target device is instructed to stop working and prompt information is issued, where the prompt information is used to prompt that the movement of the target device is abnormal.
  8. 根据权利要求7所述的方法,其特征在于,当所述可信度为所述第二可信度时,按照预设策略获取所述地面材质的第二目标识别结果,包括:The method according to claim 7, characterized in that when the credibility is the second credibility, obtaining the second target recognition result of the ground material according to a preset strategy includes:
    确定所述目标设备在预设时间段内的距离信息;Determine the distance information of the target device within a preset time period;
    当所述距离信息持续满足所述第二可信度时,确定所述预设时间段内N个识别结果,其中,所述N为大于1的自然数;When the distance information continues to meet the second credibility, determine N recognition results within the preset time period, where N is a natural number greater than 1;
    从所述N个识别结果中确定出所述第二目标识别结果。The second target recognition result is determined from the N recognition results.
  9. 根据权利要求8所述的方法,其特征在于,从所述N个识别结果中 确定出所述第二目标识别结果,包括以下之一:The method according to claim 8, characterized in that, from the N recognition results The second target recognition result is determined, including one of the following:
    按照所述N个识别结果中的不同结果类型,确定M个结果集合,其中,具有相同结果类型的识别结果集合在同一结果集合中,一个识别结果是所述结果集合中的一个元素,所述M是大于或等于1的自然数;According to different result types among the N recognition results, M result sets are determined, wherein the recognition result sets with the same result type are in the same result set, and one recognition result is an element in the result set, and the M is a natural number greater than or equal to 1;
    将所述M个结果集合中元素数量最多的结果集合对应的结果类型,确定为所述第二目标识别结果。The result type corresponding to the result set with the largest number of elements among the M result sets is determined as the second target recognition result.
  10. 根据权利要求9所述的方法,其特征在于,按照所述N个识别结果中的不同结果类型,确定M个结果集合之后,所述方法还包括:The method according to claim 9, characterized in that, after determining M result sets according to different result types among the N recognition results, the method further includes:
    当每个结果集合中的元素数量均小于预设数量时,指示所述目标设备停止工作,并发出所述提示信息。When the number of elements in each result set is less than the preset number, the target device is instructed to stop working and the prompt message is issued.
  11. 根据权利要求3所述的方法,其特征在于,基于所述姿态信息,确定所述目标设备识别所述待测区域中地面材质的可信度,包括:The method according to claim 3, characterized in that, based on the posture information, determining the credibility of the target device in identifying the ground material in the area to be measured includes:
    确定所述目标设备与所述待测区域表面的倾斜角度;Determine the inclination angle between the target device and the surface of the area to be measured;
    当所述垂向距离大于第一预设阈值,且小于第二预设阈值,且所述倾斜角度小于第三预设阈值时,将所述可信度确定为第二可信度;When the vertical distance is greater than the first preset threshold and less than the second preset threshold, and the tilt angle is less than the third preset threshold, the credibility is determined as the second credibility;
    当所述垂向距离大于所述第一预设阈值,且小于所述第二预设阈值,且所述倾斜角度不小于所述第三预设阈值时,将所述可信度确定为第三可信度;When the vertical distance is greater than the first preset threshold and less than the second preset threshold, and the tilt angle is not less than the third preset threshold, the credibility is determined as the third preset threshold. Three credibility;
    其中,所述第二可信度大于所述第三可信度。Wherein, the second credibility is greater than the third credibility.
  12. 根据权利要求6至11任一所述的方法,其特征在于,所述根据所述可信度确定所述待测区域中的地面材质的识别结果,包括:The method according to any one of claims 6 to 11, wherein determining the identification result of the ground material in the area to be measured based on the credibility includes:
    在所述可信度确定为所述第三可信度的情况下,指示所述目标设备终止对地面材质的识别;When the credibility is determined to be the third credibility, instruct the target device to terminate the identification of the ground material;
    在所述目标设备终止对地面材质的识别之后,判断后续预设时间内检测的所述目标设备与地面之间的距离的变化幅度;After the target device terminates the recognition of the ground material, determine the change amplitude of the distance between the target device and the ground detected within a subsequent preset time;
    根据所述变化幅度对应的计算方式计算得到所述识别结果。The recognition result is calculated according to the calculation method corresponding to the change amplitude.
  13. 根据权利要求1至12任一所述的方法,其特征在于,所述目标设备为扫地机器人。 The method according to any one of claims 1 to 12, characterized in that the target device is a sweeping robot.
  14. 一种地面材质的识别装置,其特征在于,包括:A device for identifying ground materials, which is characterized by including:
    第一获取模块,用于获取目标设备在待测区域移动过程中的姿态信息;The first acquisition module is used to acquire the posture information of the target device during its movement in the area to be measured;
    第一确定模块,用于基于所述姿态信息确定所述目标设备识别所述待测区域中地面材质的可信度;A first determination module, configured to determine the credibility of the target device in identifying the ground material in the area to be measured based on the posture information;
    第二确定模块,用于根据所述可信度确定所述待测区域中的地面材质的识别结果。The second determination module is used to determine the recognition result of the ground material in the area to be measured based on the credibility.
  15. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储有计算机程序,其中,所述计算机程序被设置为运行时执行所述权利要求1至13任一项中所述的方法。A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, wherein the computer program is configured to execute the method described in any one of claims 1 to 13 when running. Methods.
  16. 一种电子装置,包括存储器和处理器,其特征在于,所述存储器中存储有计算机程序,所述处理器被设置为运行所述计算机程序以执行所述权利要求1至13任一项中所述的方法。 An electronic device, including a memory and a processor, characterized in that a computer program is stored in the memory, and the processor is configured to run the computer program to execute the requirements of any one of claims 1 to 13. method described.
PCT/CN2023/082089 2022-04-25 2023-03-17 Floor material recognition method and apparatus, storage medium, and electronic apparatus WO2023207407A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210441624.1A CN116993967A (en) 2022-04-25 2022-04-25 Ground material identification method and device, storage medium and electronic device
CN202210441624.1 2022-04-25

Publications (1)

Publication Number Publication Date
WO2023207407A1 true WO2023207407A1 (en) 2023-11-02

Family

ID=88517290

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/082089 WO2023207407A1 (en) 2022-04-25 2023-03-17 Floor material recognition method and apparatus, storage medium, and electronic apparatus

Country Status (2)

Country Link
CN (1) CN116993967A (en)
WO (1) WO2023207407A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170039417A1 (en) * 2015-08-05 2017-02-09 Canon Kabushiki Kaisha Image recognition method, image recognition apparatus, and recording medium
CN110361374A (en) * 2019-07-30 2019-10-22 深圳前海达闼云端智能科技有限公司 Substance detecting method, device, storage medium and electronic equipment
CN113077018A (en) * 2021-06-07 2021-07-06 浙江大华技术股份有限公司 Target object identification method and device, storage medium and electronic device
CN113485372A (en) * 2021-08-11 2021-10-08 追觅创新科技(苏州)有限公司 Map search method and apparatus, storage medium, and electronic apparatus
CN114332707A (en) * 2021-12-28 2022-04-12 浙江大华技术股份有限公司 Method and device for determining equipment effectiveness, storage medium and electronic device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170039417A1 (en) * 2015-08-05 2017-02-09 Canon Kabushiki Kaisha Image recognition method, image recognition apparatus, and recording medium
CN110361374A (en) * 2019-07-30 2019-10-22 深圳前海达闼云端智能科技有限公司 Substance detecting method, device, storage medium and electronic equipment
CN113077018A (en) * 2021-06-07 2021-07-06 浙江大华技术股份有限公司 Target object identification method and device, storage medium and electronic device
CN113485372A (en) * 2021-08-11 2021-10-08 追觅创新科技(苏州)有限公司 Map search method and apparatus, storage medium, and electronic apparatus
CN114332707A (en) * 2021-12-28 2022-04-12 浙江大华技术股份有限公司 Method and device for determining equipment effectiveness, storage medium and electronic device

Also Published As

Publication number Publication date
CN116993967A (en) 2023-11-03

Similar Documents

Publication Publication Date Title
US20210096579A1 (en) Method For Controlling An Autonomous Mobile Robot
WO2020042426A1 (en) Method for detecting straight side by robot, and method for screening reference wall side by cleaning robot
US20190202067A1 (en) Method and device for localizing robot and robot
US9307368B1 (en) Automatically generating and maintaining a floor plan
US8311548B2 (en) Automatic association of wireless devices to point names
WO2023098455A1 (en) Operation control method, apparatus, storage medium, and electronic apparatus for cleaning device
CN111337018A (en) Positioning method and device, intelligent robot and computer readable storage medium
CN112641380B (en) Cleaning robot operation method and device, cleaning robot and chip
CN112826393B (en) Sweeping robot operation management method, sweeping robot, equipment and storage medium
CN109059991A (en) Intelligently from mobile device and its method of sensor calibration, computer storage medium
US11004317B2 (en) Moving devices and controlling methods, remote controlling systems and computer products thereof
CN112051844A (en) Self-moving robot and control method thereof
CN111158374A (en) Repositioning method, repositioning system, mobile robot and storage medium
WO2021103065A1 (en) Charging pile positioning method and apparatus for sweeping robot
WO2023207407A1 (en) Floor material recognition method and apparatus, storage medium, and electronic apparatus
CN113063442B (en) Method and device for calibrating gyroscope of sweeping robot, computer equipment and memory
CN113741446A (en) Robot autonomous exploration method, terminal equipment and storage medium
CN110442123B (en) Cleaning robot, cleaning method, environment monitoring method, and computer storage medium
US10012729B2 (en) Tracking subjects using ranging sensors
KR101614941B1 (en) Method for pairing a first terminal with at lesat one terminal selected among second terminals by using rssi information, terminal and computer-readable recording media using the same
CN112859836B (en) Autonomous mobile device, correction method and computer storage medium
CN111432328B (en) Node positioning method, device and storage medium of wireless sensor network
CN113440054A (en) Method and device for determining range of charging base of sweeping robot
TWI774140B (en) Two-way signal positioning method and two-way signal positioning system thereof
CN117502990A (en) Ground material detection method and device, storage medium and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23794843

Country of ref document: EP

Kind code of ref document: A1