WO2023000679A1 - Robot recharging control method and apparatus, and storage medium - Google Patents

Robot recharging control method and apparatus, and storage medium Download PDF

Info

Publication number
WO2023000679A1
WO2023000679A1 PCT/CN2022/079253 CN2022079253W WO2023000679A1 WO 2023000679 A1 WO2023000679 A1 WO 2023000679A1 CN 2022079253 W CN2022079253 W CN 2022079253W WO 2023000679 A1 WO2023000679 A1 WO 2023000679A1
Authority
WO
WIPO (PCT)
Prior art keywords
robot
relative position
recharging
reliability
charging stand
Prior art date
Application number
PCT/CN2022/079253
Other languages
French (fr)
Chinese (zh)
Inventor
鞠汶奇
Original Assignee
美智纵横科技有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202110815732.6A external-priority patent/CN113534805B/en
Application filed by 美智纵横科技有限责任公司 filed Critical 美智纵横科技有限责任公司
Publication of WO2023000679A1 publication Critical patent/WO2023000679A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0212Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
    • G05D1/0225Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory involving docking at a fixed facility, e.g. base station or loading bay
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0268Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
    • G05D1/0274Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means using mapping information stored in a memory device

Definitions

  • the present invention relates to the technical field of robot control, in particular to a robot recharge control method, device and storage medium.
  • robots are used more and more in people's daily life, such as common sweeping robots, mopping robots, and more advanced robot housekeepers, etc.
  • the application of these robots in the home makes people's lives It becomes more comfortable and convenient, but since it is the use of robots, it must involve the charging of robots.
  • the existing charging of robots is divided into manual charging and automatic recharging of robots. Automatic recharging is more convenient and intelligent than manual charging.
  • the lidar on the robot scans and recognizes the reflective code to determine the location of the recharging station and achieve the purpose of recharging.
  • the reflective code Since the principle of the reflective code is to provide identification features by means of highly reflective and scattered laser signals, with long-term use, the reflective code will lose its strong reflection and strong scattering capabilities after being stained with dust, resulting in the failure of lidar recognition, and when there is occlusion Or in a scene with strong light, because the lidar cannot receive the signal, the lidar recognition will also fail.
  • the purpose of the present invention is to propose a robot recharging control method, device and storage medium aiming at the shortcomings of the above-mentioned prior art, and the purpose is achieved through the following technical solutions.
  • the first aspect of the present invention proposes a robot recharging control method, the method comprising:
  • a recharging route is planned based on the selected first relative position, and the robot is controlled to travel according to the recharging route so as to dock with the charging stand.
  • the acquiring the first relative position and the first reliability of the charging stand according to the sensor signal includes:
  • the sensor signal is input into its corresponding trained first model, and the input sensor signal is processed by the first model to output a first relative position and a first reliability of the charging stand.
  • the planning of the recharging route based on the selected first relative position includes:
  • an integrated relative position of the charging stand is obtained according to the multiple first relative positions, and a recharging route is planned using the integrated relative position.
  • the obtaining the integrated relative position of the charging stand according to the plurality of first relative positions includes:
  • the integrated relative position of the charging stand is obtained by using each first relative position and the corresponding weight.
  • the method also includes:
  • the second reliability exceeding the third threshold use the second relative position to plan a recharging route, and control the robot to travel according to the recharging route, so as to dock with the charging stand for charging;
  • the method further includes: storing the selected first relative position and its corresponding first reliability;
  • the method also includes:
  • the stored first degree of confidence and its corresponding first relative position are updated.
  • the method further includes a training process of the first model corresponding to the sensor:
  • the method also includes the training process of the second model:
  • a network model is constructed, and the constructed network model is trained by using the labeled sensor signals until the network model converges to obtain a second model.
  • the second aspect of the present invention provides a robot recharging control device, the device includes a memory, a processor and a computer program stored in the memory and operable on the processor, the processor executes the The computer program implements the steps of the method described in the first aspect above.
  • a third aspect of the present invention provides a robot, comprising:
  • a variety of sensors are used to collect signals of the surrounding environment of the robot.
  • a fourth aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps of the method described in the above-mentioned first aspect are implemented.
  • the sensor signals collected by the existing sensors on the robot are obtained, and the position and reliability of the charging stand are obtained according to each sensor signal, and the position of the charging stand that meets the reliability standard is selected for recharging.
  • Route planning since the various sensors on the robot collect signals from different angles, if one or more sensors have incomplete or invalid signal due to the charging stand being blocked or in a strong light scene, there will be other The position of the charging stand is obtained with high reliability by the angle sensor signal, and then the recharging route planning is carried out based on the position of the charging stand obtained by other angle sensor signals, so as to ensure that the charging stand can still be stably detected in the scene where one or more sensors fail. position, and stably complete the recharging task.
  • Fig. 1 is the structural representation of a kind of robot shown in the present invention
  • Fig. 2 is a schematic flowchart of an embodiment of a robot recharging control method according to an exemplary embodiment of the present invention
  • Fig. 3 is a schematic diagram of a recharging route according to an exemplary embodiment of the present invention.
  • Fig. 4 is a schematic diagram showing a robot docking with a charging stand according to an exemplary embodiment of the present invention
  • Fig. 5 is a schematic flowchart of another robot recharging control method according to an exemplary embodiment of the present invention.
  • Fig. 6 is a schematic structural diagram of a robot recharging control device according to an exemplary embodiment of the present invention.
  • Fig. 7 is a schematic structural diagram of a storage medium according to an exemplary embodiment of the present invention.
  • connection and “fixation” should be understood in a broad sense, for example, “fixation” can be a fixed connection, a detachable connection, or an integral body; It may be a mechanical connection or an electrical connection; it may be a direct connection or an indirect connection through an intermediary, and it may be an internal communication between two elements or an interaction relationship between two elements, unless otherwise clearly defined.
  • fixation can be a fixed connection, a detachable connection, or an integral body; It may be a mechanical connection or an electrical connection; it may be a direct connection or an indirect connection through an intermediary, and it may be an internal communication between two elements or an interaction relationship between two elements, unless otherwise clearly defined.
  • the automatic recharging of the robot mainly adopts the following two implementations:
  • Infrared sensor automatic recharging the robot realizes the automatic recharging of the robot through the docking of the infrared receiver set by itself and the infrared emitter set on the charging stand. , stability, and installation consistency are difficult to guarantee, and infrared signals are prone to interference, reflection and other abnormalities. Infrared sensors need to be received and sent one by one, which is costly and has the risk of device damage.
  • the laser radar is automatically recharged, and the robot uses its own laser radar to automatically dock the charging stand.
  • the present invention proposes a robot, referring to the schematic structural diagram of the robot shown in Figure 1, including a robot body 10, a robot recharging control device 20 and various sensors arranged on the robot body 10 (not specifically shown in Figure 1 out).
  • the robot body 10 is used for moving, and is electrically connected with the robot recharging control device 20 .
  • sensors on the robot are used to collect the surrounding environment signals during the movement of the robot to build an environmental map and plan travel routes, such as lidar sensors, ultrasonic radar sensors, camera sensors, etc.
  • Direction, during the movement of the robot scan the environment around the robot in real time to realize obstacle avoidance and path planning.
  • the robot recharging control device 20 may be independent from the robot body 10, or may be integrated in the robot body 10, which is not specifically limited in this application.
  • the robot body 10 is provided with structures such as a motion module and a control module for realizing the construction of the robot's environment map and path planning.
  • control principle of the robot recharging control device 20 is as follows:
  • the robot When the robot needs to be docked with the charging stand, control the existing multiple sensors on the robot to collect the signals of the surrounding environment of the robot, and for each sensor signal, obtain the first relative position and first reliability of the charging stand according to the sensor signal , and then select the first relative position whose first reliability exceeds the first threshold from the plurality of first relative positions, and then plan the recharging route based on the selected first relative position, and control the robot to travel according to the recharging route , to dock with the charging stand.
  • the position and reliability of the charging stand are obtained, and the position of the charging stand that meets the standard of reliability is selected for recharging route planning.
  • a variety of sensors collect signals from different angles, so when one or more sensors have incomplete or invalid sensor signals due to the occlusion or strong light scene of the charging stand, there will be sensor signals from other angles that are highly reliable.
  • the position of the charging stand is reliable, and then the recharging route planning is carried out based on the position of the charging stand obtained from the signals of other angle sensors, so as to ensure that the position of the charging stand can still be stably detected in the scene where one or more sensors fail, and the recharging task can be completed stably .
  • Fig. 2 is a schematic flow chart of an embodiment of a robot recharging control method according to an exemplary embodiment of the present invention.
  • the robot recharging control method is applicable to the robot shown in Fig. 1 above, and the robot is a sweeping robot as the following Example for illustration, as shown in Figure 2, the robot recharging control method includes the following steps:
  • Step 201 controlling multiple sensors on the robot to collect signals of the surrounding environment of the robot.
  • the robot after the robot is started, it first constructs an environmental map based on the sensor signals of the surrounding environment collected by various sensors, and performs route planning through the constructed environmental map, and then proceeds according to the planned route, and during the travel process,
  • the environment map is still constructed in real time based on the sensor signals collected by various sensors.
  • the location of the charging stand located after the last recharging can be called, and the approximate orientation of the charging stand can be marked on the environment map according to the position of the charging stand, and then the robot can be controlled to move in the direction of the marked charging stand , while controlling multiple sensors on the robot to randomly collect signals from the surrounding environment of the robot from different angles.
  • Step 202 For each sensor signal, acquire a first relative position and a first reliability of the charging stand according to the sensor signal.
  • a model for processing sensor signals can be pre-trained for each sensor, and the output of the model is the relative position and reliability of the charging stand.
  • the processing results can be improved Accuracy, thereby improving the efficiency of automatic recharging of the robot.
  • each sensor signal can be input into the corresponding pre-trained first model, so that the input sensor signal can be processed by the first model, and the first relative position and first reliability of the charging stand can be output .
  • the first degree of reliability output by the first model is used to represent the degree of reliability of the outputted first relative position of the charging stand, and the higher the degree of first degree of reliability, the higher the degree of reliability.
  • step 202 training is required to obtain the first model corresponding to each sensor, and the training process may include: collecting sensor signals at multiple distances and angles from the sensor relative to the charging stand, and for each sensor signal Label the relative position and reliability of the charging stand, which is used to calculate the loss value during the model training process, then build the network model, and use the labeled sensor signals to train the constructed network model until the network model converges to obtain the first model.
  • the lidar sensor as an example, after fixing the charging stand at a certain position, control the robot to reach a position 1 meter away from the center point of the docking slot of the charging stand and 45 degrees away from the vertical line in the docking slot to obtain multi-frame lidar sensor signals, and then Control the robot to reach a position 1 meter away from the center point of the docking slot of the charging stand, and 46 degrees away from the vertical line in the docking slot, and obtain multi-frame lidar sensor signals, and so on, to obtain sensor signals in various situations, and then repeat multiple times Change the distance between the robot and the center point of the docking slot of the charging stand, and at this distance, constantly change the angle to obtain the sensor signal. It can be seen that by continuously changing the position of the robot, many sensor signals can be collected as training samples.
  • sensor signals from multiple distances and multiple angles in different scenarios. For example, abnormal scenes with occluders, normal scenes without occluders, scenes with different lighting, etc.
  • the relative position of the charging stand may include information such as relative distance, angle, center point coordinates of the docking slot on the charging stand, and such information can guide the robot how to enter the docking slot to achieve docking.
  • Step 203 From the plurality of first relative positions, select a first relative position whose first reliability exceeds a first threshold.
  • the first threshold is used to indicate the condition of reaching the standard of credibility, so the first threshold will be relatively higher. Assuming that the value range of the credibility is 0 to 1, then the first threshold may be set above 0.8.
  • first relative positions when screening the first relative positions whose reliability meets the standard, one or more first relative positions may be screened out, and of course zero first relative positions may be screened out, that is, no There is a first relative position at which the confidence level is met.
  • the following step 204 is performed, and if the first relative position with the reliability up to the standard is not screened out, the sensor signal can be re-acquired for screening. If the first relative position that reaches the standard of reliability has not been found, the second model can be used to jointly judge multiple sensor signals.
  • the specific implementation process please refer to the description of the following embodiments, and the present invention will not be described in detail here.
  • the selected first relative position and its corresponding first reliability may also be stored. , to be replaced with higher confidence and relative position for subsequent robot travel.
  • Step 204 Planning a recharging route based on the selected first relative position, and controlling the robot to travel according to the recharging route so as to dock with the charging stand.
  • the recharging route can be planned directly using the selected first relative positions; if the number of selected first relative positions If there are more than one, then the comprehensive relative position of the charging stand can be obtained according to the selected multiple first relative positions, and then the comprehensive relative position can be used to plan the recharging route.
  • each selected first relative position its corresponding weight can be determined according to the first reliability corresponding to the first relative position, and then use Each first relative position and corresponding weight obtains an integrated relative position of the charging stand.
  • the quotient of the first credibility level corresponding to one of the first relative positions and the sum of all first credibility levels up to the standard can be used as the weight of this first relative position, so as to achieve the higher credibility , the purpose of greater weight.
  • the relative position used for planning the route includes the distance L between the robot and the charging stand, and the angle ⁇ relative to the vertical line in the docking slot.
  • the planned recharging route is that after traveling southward to L1, the robot reaches the vertical line of the docking slot, and then the robot is facing the charging stand, and then travels westward to L2 to dock with the docking slot of the charging stand.
  • the docking effect is shown in the figure 4.
  • the robot when traveling along the recharging route, it can continue to control multiple sensors in real time to collect signals from the surrounding environment of the robot, and for each sensor signal, obtain the first relative position and the second relative position of the charging stand according to the sensor signal.
  • a credibility and compare the newly obtained first credibility with the stored first credibility, when there is a first credibility higher than the stored first credibility, you can use
  • the newly obtained first relative position of the first degree of reliability is used to update the recharging route, so that the robot can dock with the charging stand more accurately.
  • the stored first reliability and its corresponding first relative position when the robot is traveling along the recharging route, it can continue to control multiple sensors in real time to collect signals from the surrounding environment of the robot, and for each sensor signal, obtain the first relative position and the second relative position of the charging stand according to the sensor signal.
  • a credibility and compare the newly obtained first credibility with the stored first credibility, when there is a first credibility higher than the stored first credibility, you can use
  • the newly obtained first relative position of the first degree of reliability is used
  • the robot when traveling along the recharging route, it will continue to calculate the reliability of the newly collected sensor signal and the relative position of the charging stand in real time. If there is a relative position with higher reliability, it will use this reliability Higher relative positions update recharge routes.
  • the newly obtained first relative position can also be used in combination with the route traveled by the robot on the recharging route and the stored to update the recharging route.
  • Fig. 5 is a schematic flowchart of another robot recharging control method according to an exemplary embodiment of the present invention. Based on the embodiment shown in Fig. 2 above, the robot recharging control method includes the following steps:
  • Step 501 Controlling multiple sensors on the robot to collect signals of the surrounding environment of the robot.
  • Step 502 For each sensor signal, acquire a first relative position and a first reliability of the charging stand according to the sensor signal.
  • Step 503 Judging whether there is a first confidence level exceeding the first threshold, if yes, execute step 504, if not, execute step 505.
  • Step 504 Planning a recharging route based on the first relative position whose first reliability exceeds the first threshold, and controlling the robot to travel according to the recharging route so as to dock with the charging stand.
  • step 501 to step 504 For the specific implementation of the above step 501 to step 504, reference may be made to the description of the above embodiment, and the present invention will not repeat them here.
  • Step 505 start timing, and compare the counted time with the preset duration, if the counted time is less than the preset duration, continue to execute step 501, and if the counted time is greater than the preset duration, execute step 506.
  • Step 506 From the latest collected sensor signals, select the sensor signals whose first reliability exceeds the second threshold.
  • the second threshold is lower than the first threshold, and the sensor signal whose first reliability exceeds the second threshold is a signal whose reliability can be improved through comprehensive processing.
  • the senor signal whose first reliability exceeds the second threshold but is lower than the first threshold it may be that the charging stand is blocked or the signal obtained by the charging stand in a strong light scene results in an incomplete signal, which may Reliability is not up to standard.
  • Step 507 Input the selected sensor signal into the trained second model, and the second model comprehensively processes the input sensor signal and outputs the second relative position and the second reliability of the charging stand.
  • the training process may include: in a scene with an occluder or a strong light, collecting data of multiple distances and multiple angles of each sensor relative to the charging stand Sensor signals, and label the relative position and reliability of the charging stand for each sensor signal collected under the same distance and the same angle, and then build a network model, and use the labeled sensor signals to construct the network model. Train until the network model converges to obtain the second model.
  • the outputted second relative position and second reliability are the positions and reliability obtained by integrating multiple sensor signals.
  • Step 508 If the second reliability exceeds the third threshold, use the second relative position to plan a recharging route, and control the robot to travel according to the recharging route, so as to dock with the charging stand for charging.
  • the type of information contained in the second relative position is the same as that contained in the first relative position, so the principle of planning the recharging route by using the second relative position is consistent with the principle of planning the recharging route by using the first relative position.
  • the third threshold is greater than the second threshold, but the third threshold may be the same as or different from the first threshold, which is not specifically limited in the present invention.
  • Step 509 If the second reliability does not exceed the third threshold, output an alarm prompt that the charging stand cannot be found.
  • the recharging process shown in Figure 5 above is completed.
  • the data collected from the latest Among the sensor signals the sensor signal whose first reliability exceeds the second threshold is selected as the input of the second model, and the second model makes a comprehensive judgment and outputs a comprehensive second relative position and second reliability of the charging stand , and use the second relative position to plan the recharging route, so as to ensure that the position of the charging stand can still be stably detected in the scene where one or more sensors fail, and the recharging task can be completed stably.
  • Embodiments of the present invention also provide a robot recharging control device corresponding to the robot recharging control method provided in the foregoing embodiments, so as to implement the above robot recharging control method.
  • Fig. 6 is a hardware structure diagram of a robot recharging control device according to an exemplary embodiment of the present invention.
  • the robot recharging control device includes: a communication interface 701, a processor 702, a memory 703 and a bus 704;
  • the interface 701 , the processor 702 and the memory 703 communicate with each other through the bus 704 .
  • the processor 702 can execute the robot recharging control method described above by reading and executing the machine-executable instructions corresponding to the control logic of the robot recharging control method in the memory 703.
  • the memory 703 mentioned in the present invention can be any electronic, magnetic, optical or other physical storage device, which can contain stored information, such as executable instructions, data and so on.
  • memory 703 can be RAM (Random Access Memory, random access memory), flash memory, storage drive (such as hard drive), any type of storage disk (such as optical disc, DVD, etc.), or similar storage media, or their The combination.
  • the communication connection between the system network element and at least one other network element is realized through at least one communication interface 701 (which may be wired or wireless), and the Internet, wide area network, local network, metropolitan area network, etc. can be used.
  • the bus 704 may be an ISA bus, a PCI bus, or an EISA bus, etc.
  • the bus can be divided into address bus, data bus, control bus and so on.
  • the memory 703 is used to store a program, and the processor 702 executes the program after receiving an execution instruction.
  • the processor 702 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 702 or instructions in the form of software.
  • the above-mentioned processor 702 can be a general-purpose processor, including a central processing unit (Central Processing Unit, referred to as CPU), a network processor (Network Processor, referred to as NP) etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
  • CPU Central Processing Unit
  • NP Network Processor
  • DSP digital signal processor
  • ASIC application-specific integrated circuit
  • FPGA off-the-shelf programmable gate array
  • Various methods, steps, and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed.
  • a general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.
  • the steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor.
  • the robot recharging control device provided in the embodiment of the present application is based on the same inventive concept as the robot recharging control method provided in the embodiment of the present application, and has the same beneficial effect as the method adopted, operated or implemented.
  • the embodiment of the present application also provides a computer-readable storage medium corresponding to the robot recharging control method provided in the foregoing embodiment, please refer to FIG.
  • a computer program that is, a program product
  • the computer program is run by the processor, it will execute the robot recharging control method provided in any of the foregoing implementation manners.
  • examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random Access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other optical and magnetic storage media will not be repeated here.
  • PRAM phase change memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • RAM random Access memory
  • ROM read only memory
  • EEPROM electrically erasable programmable read only memory
  • flash memory or other optical and magnetic storage media will not be repeated here.
  • the computer-readable storage medium provided by the above-mentioned embodiments of the present application is based on the same inventive concept as the robot recharging control method provided by the embodiments of the present application, and has the same beneficial effects as the method adopted, run or implemented by its stored application program .

Abstract

A robot recharging control method and apparatus, and a storage medium. The method comprises: controlling a plurality of sensors of a robot to collect signals around the robot (S201); acquiring, according to each sensor signal, a first relative position and a first confidence level of a charging base (S202); selecting a first relative position, the first confidence level of which exceeds a first threshold value, from among a plurality of first relative positions (S203); and planning a recharging route on the basis of the selected first relative position, and controlling, according to the recharging route, the robot to travel to be connected to the charging base (S204). Various sensors on a robot perform signal collection from different angles, such that if signals of one or more sensors are incomplete or the sensors fail due to a charging base being blocked or in a strong light environment, the position of the charging base, which has a high confidence level, can still be obtained by means of sensor signals from other angles, and thus a recharging route is planned according to the sensor signals from the other angles, thereby ensuring that the position of the charging base can be stably detected even in a scenario where one or more of the sensors fail.

Description

机器人回充控制方法、装置和存储介质Robot recharging control method, device and storage medium
本申请要求于2021年07月19日提交中国专利局、申请号为202110815732.6、申请名称为“机器人回充控制方法、装置和存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202110815732.6 and the application name "robot recharging control method, device and storage medium" submitted to the China Patent Office on July 19, 2021, the entire contents of which are incorporated by reference in In this application.
技术领域technical field
本发明涉及机器人控制技术领域,具体涉及一种机器人回充控制方法、装置和存储介质。The present invention relates to the technical field of robot control, in particular to a robot recharge control method, device and storage medium.
背景技术Background technique
随着科技的发展,机器人在人们的日常生活中应用越来越多,例如常见的扫地机器人、擦地机器人,以及更为高级的机器人管家等,这些机器人在家庭中的应用,使得人们的生活变得更为舒适便利,但是既然是机器人的使用,就必须涉及机器人的充电问题。现有的机器人充电分为人工充电和机器人的自动回充,自动回充较人工充电更为方便智能。With the development of science and technology, robots are used more and more in people's daily life, such as common sweeping robots, mopping robots, and more advanced robot housekeepers, etc. The application of these robots in the home makes people's lives It becomes more comfortable and convenient, but since it is the use of robots, it must involve the charging of robots. The existing charging of robots is divided into manual charging and automatic recharging of robots. Automatic recharging is more convenient and intelligent than manual charging.
现有机器人自动回充方式中,通过在充电座上贴反光码,机器人上的激光雷达通过扫描并识别反光码,以确定回充站的位置,达到回充目的。In the existing automatic recharging method of the robot, by pasting a reflective code on the charging stand, the lidar on the robot scans and recognizes the reflective code to determine the location of the recharging station and achieve the purpose of recharging.
由于反光码原理是通过高反光和散射激光信号的方式,提供识别特征,随着长时间使用,反光码沾上灰尘后将失去强反射和强散射能力,导致激光雷达识别失效,并且在有遮挡或者有强光场景下,由于激光雷达无法收到信号,也会导致激光雷达识别失效。Since the principle of the reflective code is to provide identification features by means of highly reflective and scattered laser signals, with long-term use, the reflective code will lose its strong reflection and strong scattering capabilities after being stained with dust, resulting in the failure of lidar recognition, and when there is occlusion Or in a scene with strong light, because the lidar cannot receive the signal, the lidar recognition will also fail.
发明内容Contents of the invention
本发明的目的是针对上述现有技术的不足提出的一种机器人回充控制方法、装置和存储介质,该目的是通过以下技术方案实现的。The purpose of the present invention is to propose a robot recharging control method, device and storage medium aiming at the shortcomings of the above-mentioned prior art, and the purpose is achieved through the following technical solutions.
本发明的第一方面提出了一种机器人回充控制方法,所述方法包括:The first aspect of the present invention proposes a robot recharging control method, the method comprising:
控制机器人上已有的多个传感器采集所述机器人周围环境的信号;Controlling the existing multiple sensors on the robot to collect signals from the surrounding environment of the robot;
针对每个传感器信号,根据该传感器信号获取充电座的第一相对位置和第一可信度;For each sensor signal, acquiring a first relative position and a first reliability of the charging stand according to the sensor signal;
从多个第一相对位置中,选择第一可信度超过第一阈值的第一相对位置;From the plurality of first relative positions, selecting a first relative position whose first degree of confidence exceeds a first threshold;
基于选择的第一相对位置规划回充路线,并按照所述回充路线控制机器人行进,以与充电座对接。A recharging route is planned based on the selected first relative position, and the robot is controlled to travel according to the recharging route so as to dock with the charging stand.
在本申请的一些实施例中,所述根据该传感器信号获取充电座的第一相对位置和第一可信度,包括:In some embodiments of the present application, the acquiring the first relative position and the first reliability of the charging stand according to the sensor signal includes:
将该传感器信号输入其对应的已训练第一模型,由第一模型处理输入的传感器信号并输出充电座的第一相对位置和第一可信度。The sensor signal is input into its corresponding trained first model, and the input sensor signal is processed by the first model to output a first relative position and a first reliability of the charging stand.
在本申请的一些实施例中,所述基于选择的第一相对位置规划回充路线,包括:In some embodiments of the present application, the planning of the recharging route based on the selected first relative position includes:
在选择的第一相对位置的数量为1时,利用选择的第一相对位置规划回充路线;When the number of selected first relative positions is 1, use the selected first relative positions to plan the recharging route;
在选择的第一相对位置的数量为多个时,根据所述多个第一相对位置获得充电座的综合相对位置,并利用所述综合相对位置规划回充路线。When there are multiple selected first relative positions, an integrated relative position of the charging stand is obtained according to the multiple first relative positions, and a recharging route is planned using the integrated relative position.
在本申请的一些实施例中,所述根据所述多个第一相对位置获得充电座的综合相对位置,包括:In some embodiments of the present application, the obtaining the integrated relative position of the charging stand according to the plurality of first relative positions includes:
针对选择的每个第一相对位置,依据所述第一相对位置对应的第一可信度确定其对应的权重;For each selected first relative position, determine its corresponding weight according to the first reliability corresponding to the first relative position;
利用每个第一相对位置和对应的权重获得充电座的综合相对位置。The integrated relative position of the charging stand is obtained by using each first relative position and the corresponding weight.
在本申请的一些实施例中,所述方法还包括:In some embodiments of the present application, the method also includes:
在每个传感器信号对应的第一可信度均未超过第一阈值时,继续执行控制机器人上的多个传感器采集所述机器人周围环境的信号的步骤;When the first reliability corresponding to each sensor signal does not exceed the first threshold, continue to perform the step of controlling multiple sensors on the robot to collect signals of the robot's surrounding environment;
经过预设时长后每个传感器信号对应的第一可信度始终未超过第一阈值时,从最近一次采集的各个传感器信号中,选择第一可信度超过第二阈值的传感器信号;When the first reliability corresponding to each sensor signal has not exceeded the first threshold after the preset period of time, select the sensor signal whose first reliability exceeds the second threshold from the latest collected sensor signals;
将选择的传感器信号输入已训练第二模型,由第二模型对输入的传感器信号进行综合处理并输出充电座的第二相对位置和第二可信度;Input the selected sensor signal into the trained second model, and the second model comprehensively processes the input sensor signal and outputs the second relative position and the second reliability of the charging stand;
根据所述第二可信度超过第三阈值,利用所述第二相对位置规划回充路线,并按照所述回充路线控制机器人行进,以与充电座对接充电;According to the second reliability exceeding the third threshold, use the second relative position to plan a recharging route, and control the robot to travel according to the recharging route, so as to dock with the charging stand for charging;
根据所述第二可信度未超过第三阈值,输出无法找到充电座的报警提示。According to the fact that the second reliability does not exceed the third threshold, an alarm prompt that the charging stand cannot be found is output.
在本申请的一些实施例中,在从多个第一相对位置中,选择第一可信度超过第一阈值的第一相对位置之后,所述方法还包括:存储选择的第一相对位置和其对应的第一可信度;In some embodiments of the present application, after selecting a first relative position whose first reliability exceeds a first threshold from the plurality of first relative positions, the method further includes: storing the selected first relative position and its corresponding first reliability;
所述方法还包括:The method also includes:
在按照所述回充路线控制机器人行进过程中,继续控制多个传感器采集所述机器人周围环境的信号,并针对每个传感器信号,根据该传感器信号获取充电座的第一相对位置和第一可信度;In the process of controlling the robot to move according to the recharging route, continue to control a plurality of sensors to collect signals of the surrounding environment of the robot, and for each sensor signal, obtain the first relative position and the first possible position of the charging base according to the sensor signal. Reliability;
在每个传感器信号的第一可信度中存在比已存储的第一可信度更高的第一可信度时,基于该更高的第一可信度的第一相对位置更新所述回充路线,并按照更新后的回充路线控制机器人行进;When there is a first degree of confidence in the first degree of confidence of each sensor signal that is higher than the stored first degree of confidence, updating the first relative position based on the higher first degree of confidence Recharging route, and control the robot to travel according to the updated recharging route;
利用该更高的第一可信度和其对应的第一相对位置,更新已存储的第一可信度和其对应的第一相对位置。Utilizing the higher first degree of confidence and its corresponding first relative position, the stored first degree of confidence and its corresponding first relative position are updated.
在本申请的一些实施例中,所述方法还包括传感器对应的第一模型的训练过程:In some embodiments of the present application, the method further includes a training process of the first model corresponding to the sensor:
获取该传感器相对充电座的多个距离多个角度的传感器信号,并为每个传感器信号标注充电座的相对位置和可信度的标签;Obtain the sensor signals of multiple distances and angles of the sensor relative to the charging stand, and label the relative position and reliability of the charging stand for each sensor signal;
构建网络模型,并利用标注标签后的传感器信号对构建的网络模型进行训练,直至网络模型收敛,得到第一模型。Constructing a network model, and using the labeled sensor signals to train the constructed network model until the network model converges to obtain the first model.
在本申请的一些实施例中,所述方法还包括第二模型的训练过程:In some embodiments of the present application, the method also includes the training process of the second model:
在有遮挡物或强光场景中,收集各个传感器相对充电座的多个距离多个角度的传感器信号,并为相同距离相同角度条件下收集到的各个传感器信号标注充电座的相对位置和可信度的标签;In scenes with occluders or strong light, collect sensor signals at multiple distances and angles from each sensor relative to the charging stand, and mark the relative position and reliability of the charging stand for each sensor signal collected at the same distance and at the same angle degree label;
构建网络模型,并利用标注标签后的各个传感器信号对构建的网络模型进行训练,直至网络模型收敛,得到第二模型。A network model is constructed, and the constructed network model is trained by using the labeled sensor signals until the network model converges to obtain a second model.
本发明的第二方面提供了一种机器人回充控制装置,所述装置包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时实现如上述第一方面所述方法的步骤。The second aspect of the present invention provides a robot recharging control device, the device includes a memory, a processor and a computer program stored in the memory and operable on the processor, the processor executes the The computer program implements the steps of the method described in the first aspect above.
本发明的第三方面提供了一种机器人,包括:A third aspect of the present invention provides a robot, comprising:
如上述第二方面所述的机器人回充控制装置;The robot recharging control device as described in the second aspect above;
多种传感器,用于采集所述机器人周围环境的信号。A variety of sensors are used to collect signals of the surrounding environment of the robot.
本发明的第四方面提供了一种计算机可读存储介质,其上存储有计算机程序,所述程序被处理器执行时实现如上述第一方面所述方法的步骤。A fourth aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps of the method described in the above-mentioned first aspect are implemented.
基于上述第一方面所述的机器人回充控制方法,本发明技术方案具有如下有益效果或好处:Based on the robot recharging control method described in the first aspect above, the technical solution of the present invention has the following beneficial effects or benefits:
在机器人需要回充时,通过获取机器人上已有的多个传感器采集的传感器信号,并根据每个传感器信号得到充电座位置和可信度,从中选择可信度达标的充电座位置进行回充路线规划,由于机器人上的多种传感器是从不同角度进行信号采集,因此在一个或多个传感器因充电座在遮挡或强光场景中导致传感器信号不完整或失效的情况下,还会有其他角度的传感器信号得到高可信度的充电座位置,进而由其他角度传感器信号得到的充电座位置进行回充路线规划,保证在一个或多个传感器失效的场景中依然能够稳定检测到充电座的位置,稳定完成回充任务。When the robot needs to be recharged, the sensor signals collected by the existing sensors on the robot are obtained, and the position and reliability of the charging stand are obtained according to each sensor signal, and the position of the charging stand that meets the reliability standard is selected for recharging. Route planning, since the various sensors on the robot collect signals from different angles, if one or more sensors have incomplete or invalid signal due to the charging stand being blocked or in a strong light scene, there will be other The position of the charging stand is obtained with high reliability by the angle sensor signal, and then the recharging route planning is carried out based on the position of the charging stand obtained by other angle sensor signals, so as to ensure that the charging stand can still be stably detected in the scene where one or more sensors fail. position, and stably complete the recharging task.
附图说明Description of drawings
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本申请的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiment. The drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the application. Also throughout the drawings, the same reference numerals are used to designate the same components. In the attached picture:
图1为本发明示出的一种机器人的结构示意图;Fig. 1 is the structural representation of a kind of robot shown in the present invention;
图2为本发明根据一示例性实施例示出的一种机器人回充控制方法的实施例流程示意图;Fig. 2 is a schematic flowchart of an embodiment of a robot recharging control method according to an exemplary embodiment of the present invention;
图3为本发明根据一示例性实施例示出的一种回充路线示意图;Fig. 3 is a schematic diagram of a recharging route according to an exemplary embodiment of the present invention;
图4为本发明根据一示例性实施例示出的一种机器人与充电座完成对接的示意图;Fig. 4 is a schematic diagram showing a robot docking with a charging stand according to an exemplary embodiment of the present invention;
图5为本发明根据一示例性实施例示出的另一种机器人回充控制方法的实施例流程示意图;Fig. 5 is a schematic flowchart of another robot recharging control method according to an exemplary embodiment of the present invention;
图6为本发明根据一示例性实施例示出的一种机器人回充控制装置的结构示意图;Fig. 6 is a schematic structural diagram of a robot recharging control device according to an exemplary embodiment of the present invention;
图7为本发明根据一示例性实施例示出的一种存储介质的结构示意图。Fig. 7 is a schematic structural diagram of a storage medium according to an exemplary embodiment of the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明的一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创 造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts all belong to the protection scope of the present invention.
需要说明,本发明实施例中所有方向性指示(诸如上、下、左、右、前、后……)仅用于解释在某一特定姿态(如附图所示)下各部件之间的相对位置关系、运动情况等,如果该特定姿态发生改变时,则该方向性指示也相应地随之改变。It should be noted that all directional indications (such as up, down, left, right, front, back...) in the embodiments of the present invention are only used to explain the relationship between the components in a certain posture (as shown in the accompanying drawings). Relative positional relationship, movement conditions, etc., if the specific posture changes, the directional indication will also change accordingly.
另外,在本发明中如涉及“第一”、“第二”等的描述仅用于描述目的,而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本发明的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, in the present invention, descriptions such as "first", "second" and so on are used for description purposes only, and should not be understood as indicating or implying their relative importance or implicitly indicating the quantity of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present invention, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.
在本发明中,除非另有明确的规定和限定,术语“连接”、“固定”等应做广义理解,例如,“固定”可以是固定连接,也可以是可拆卸连接,或成一体;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通或两个元件的相互作用关系,除非另有明确的限定。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本发明中的具体含义。In the present invention, unless otherwise specified and limited, the terms "connection" and "fixation" should be understood in a broad sense, for example, "fixation" can be a fixed connection, a detachable connection, or an integral body; It may be a mechanical connection or an electrical connection; it may be a direct connection or an indirect connection through an intermediary, and it may be an internal communication between two elements or an interaction relationship between two elements, unless otherwise clearly defined. Those of ordinary skill in the art can understand the specific meanings of the above terms in the present invention according to specific situations.
另外,本发明各个实施例之间的技术方案可以相互结合,但是必须是以本领域普通技术人员能够实现为基础,当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在,也不在本发明要求的保护范围之内。In addition, the technical solutions of the various embodiments of the present invention can be combined with each other, but it must be based on the realization of those skilled in the art. When the combination of technical solutions is contradictory or cannot be realized, it should be considered as a combination of technical solutions. Does not exist, nor is it within the scope of protection required by the present invention.
目前,机器人的自动回充主要采用以下两种实现:At present, the automatic recharging of the robot mainly adopts the following two implementations:
1、红外传感自动回充,机器人通过自身设置的红外接收器和充电座上设置的红外发射器的对接实现机器人的自动回充,这种方法在大批量生产时,红外传感器本身的一致性、稳定性、安装一致性都难以保障,且红外信号易发生干扰、反射等异常,红外传感器需要一收一发,成本高,有器件损坏风险。1. Infrared sensor automatic recharging, the robot realizes the automatic recharging of the robot through the docking of the infrared receiver set by itself and the infrared emitter set on the charging stand. , stability, and installation consistency are difficult to guarantee, and infrared signals are prone to interference, reflection and other abnormalities. Infrared sensors need to be received and sent one by one, which is costly and has the risk of device damage.
2、激光雷达自动回充,机器人利用自身设置的激光雷达进行充电座的自动对接。2. The laser radar is automatically recharged, and the robot uses its own laser radar to automatically dock the charging stand.
然而,上述方法均未考虑到在一些场景中,例如充电座有遮挡、处于强光环境下,会出现某些传感器信号不完整或者失效的现象,导致无法完成充电座自动回充。However, none of the above methods takes into account that in some scenarios, such as when the charging stand is covered or in a strong light environment, some sensor signals may be incomplete or invalid, resulting in the inability to complete the automatic recharging of the charging stand.
为解决上述技术问题,本发明提出一种机器人,参见图1所示的机器人结构示意图,包括机器人本体10、机器人回充控制装置20和机器人本体10上设置的多种传感器(图1未具体示出)。In order to solve the above-mentioned technical problems, the present invention proposes a robot, referring to the schematic structural diagram of the robot shown in Figure 1, including a robot body 10, a robot recharging control device 20 and various sensors arranged on the robot body 10 (not specifically shown in Figure 1 out).
其中,机器人本体10用于进行移动,其与机器人回充控制装置20电连接。机器人上设有的多种传感器用于采集机器人移动过程中的周围环境信号,以用于构建环境地图和规划行进路线,例如激光雷达传感器、超声波雷达传感器、摄像头传感器等,设置在机器人上的不同方向,在机器人移动过程中,实时扫描机器人周围的环境,实现避障、路径规划。Wherein, the robot body 10 is used for moving, and is electrically connected with the robot recharging control device 20 . A variety of sensors on the robot are used to collect the surrounding environment signals during the movement of the robot to build an environmental map and plan travel routes, such as lidar sensors, ultrasonic radar sensors, camera sensors, etc. Direction, during the movement of the robot, scan the environment around the robot in real time to realize obstacle avoidance and path planning.
可选的,机器人回充控制装置20可以独立于机器人本体10之外,当然也可以集成在机器人本体10内,本申请对此不进行具体限定。Optionally, the robot recharging control device 20 may be independent from the robot body 10, or may be integrated in the robot body 10, which is not specifically limited in this application.
需要说明的是,机器人本体10中设置有运动模块、控制模块等结构,以用于实现机器人的环境地图的构建和路径规划。It should be noted that the robot body 10 is provided with structures such as a motion module and a control module for realizing the construction of the robot's environment map and path planning.
基于上述各个结构的功能描述,机器人回充控制装置20的控制原理为:Based on the functional descriptions of the above structures, the control principle of the robot recharging control device 20 is as follows:
在机器人需要与充电座对接时,控制机器人上已有的多个传感器采集机器人周围环境的信号,并针对每个传感器信号,根据该传感器信号获取充电座的第一相对位置和第一可信度,然后从多个第一相对位置中,选择第一可信度超过第一阈值的第一相对位置,进而基于选择的第一相对位置规划回充路线,并按照所述回充路线控制机器人行进,以与充电座对接。When the robot needs to be docked with the charging stand, control the existing multiple sensors on the robot to collect the signals of the surrounding environment of the robot, and for each sensor signal, obtain the first relative position and first reliability of the charging stand according to the sensor signal , and then select the first relative position whose first reliability exceeds the first threshold from the plurality of first relative positions, and then plan the recharging route based on the selected first relative position, and control the robot to travel according to the recharging route , to dock with the charging stand.
基于上述描述可达到的技术效果有:The technical effects that can be achieved based on the above description are:
通过获取机器人上已有的多种传感器采集的传感器信号,并根据每个传感器信号得到充电座位置和可信度,从中选择可信度达标的充电座位置进行回充路线规划,由于机器人上的多种传感器是从不同角度进行信号采集,因此在一个或多个传感器因充电座在遮挡或强光场景中导致传感器信号不完整或失效的情况下,还会有其他角度的传感器信号得到高可信度的充电座位置,进而由其 他角度传感器信号得到的充电座位置进行回充路线规划,保证在一个或多个传感器失效的场景中依然能够稳定检测到充电座的位置,稳定完成回充任务。By obtaining the sensor signals collected by various sensors on the robot, and according to each sensor signal, the position and reliability of the charging stand are obtained, and the position of the charging stand that meets the standard of reliability is selected for recharging route planning. A variety of sensors collect signals from different angles, so when one or more sensors have incomplete or invalid sensor signals due to the occlusion or strong light scene of the charging stand, there will be sensor signals from other angles that are highly reliable. The position of the charging stand is reliable, and then the recharging route planning is carried out based on the position of the charging stand obtained from the signals of other angle sensors, so as to ensure that the position of the charging stand can still be stably detected in the scene where one or more sensors fail, and the recharging task can be completed stably .
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.
实施例一:Embodiment one:
图2为本发明根据一示例性实施例示出的一种机器人回充控制方法的实施例流程示意图,所述机器人回充控制方法适用于上述图1所示的机器人,下面以机器人为扫地机器人为例进行示例性说明,如图2所示,所述机器人回充控制方法包括如下步骤:Fig. 2 is a schematic flow chart of an embodiment of a robot recharging control method according to an exemplary embodiment of the present invention. The robot recharging control method is applicable to the robot shown in Fig. 1 above, and the robot is a sweeping robot as the following Example for illustration, as shown in Figure 2, the robot recharging control method includes the following steps:
步骤201:控制机器人上的多个传感器采集所述机器人周围环境的信号。Step 201: controlling multiple sensors on the robot to collect signals of the surrounding environment of the robot.
在一些实施例中,机器人启动后,先通过各种传感器采集的周围环境的传感器信号构建环境地图,并通过构建的环境地图进行路线规划,然后按照规划好的路线行进,并且在行进过程中,仍然实时根据各种传感器采集的传感器信号构建环境地图。In some embodiments, after the robot is started, it first constructs an environmental map based on the sensor signals of the surrounding environment collected by various sensors, and performs route planning through the constructed environmental map, and then proceeds according to the planned route, and during the travel process, The environment map is still constructed in real time based on the sensor signals collected by various sensors.
可选的,在机器人需要回充时,可以通过调用上一次回充后定位的充电座位置,并根据充电座位置在环境地图上标记充电座大致方位,然后控制机器人向标记的充电座方向行进,同时控制机器人上的多个传感器随机从不同角度采集机器人周围环境的信号。Optionally, when the robot needs to be recharged, the location of the charging stand located after the last recharging can be called, and the approximate orientation of the charging stand can be marked on the environment map according to the position of the charging stand, and then the robot can be controlled to move in the direction of the marked charging stand , while controlling multiple sensors on the robot to randomly collect signals from the surrounding environment of the robot from different angles.
步骤202:针对每个传感器信号,根据该传感器信号获取充电座的第一相对位置和第一可信度。Step 202: For each sensor signal, acquire a first relative position and a first reliability of the charging stand according to the sensor signal.
在一可选的具体实施方式中,可以预先为每个传感器训练一个用来处理传感器信号的模型,模型输出为充电座的相对位置和可信度,通过使用模型处理传感器信号,可以提高处理结果的精准度,进而提升机器人自动回充效率。基于此,可以将每个传感器信号分别输入所对应的预先训练好的第一模型,以由第一模型对输入的传感器信号进行处理,并输出充电座的第一相对位置和第一可信度。In an optional specific implementation, a model for processing sensor signals can be pre-trained for each sensor, and the output of the model is the relative position and reliability of the charging stand. By using the model to process sensor signals, the processing results can be improved Accuracy, thereby improving the efficiency of automatic recharging of the robot. Based on this, each sensor signal can be input into the corresponding pre-trained first model, so that the input sensor signal can be processed by the first model, and the first relative position and first reliability of the charging stand can be output .
其中,第一模型输出的第一可信度用于表示其输出的充电座的第一相对位置的可靠程度,第一可信度越高,表示可靠程度越高。Wherein, the first degree of reliability output by the first model is used to represent the degree of reliability of the outputted first relative position of the charging stand, and the higher the degree of first degree of reliability, the higher the degree of reliability.
需要说明的是,在执行步骤202之前,需要训练获得每个传感器对应的第一模型,训练过程可以包括:采集传感器相对充电座的多个距离多个角度的传 感器信号,并为每一传感器信号标注充电座的相对位置和可信度的标签,该标签用于模型训练过程中计算损失值使用,然后构建网络模型,并利用标注标签后的传感器信号对构建的网络模型进行训练,直至网络模型收敛,以获得第一模型。It should be noted that before step 202 is performed, training is required to obtain the first model corresponding to each sensor, and the training process may include: collecting sensor signals at multiple distances and angles from the sensor relative to the charging stand, and for each sensor signal Label the relative position and reliability of the charging stand, which is used to calculate the loss value during the model training process, then build the network model, and use the labeled sensor signals to train the constructed network model until the network model converges to obtain the first model.
以激光雷达传感器为例,将充电座固定某一位置后,控制机器人到达距离充电座对接槽中心点1米,偏离对接槽中垂线45度的位置,获取多帧激光雷达的传感器信号,再控制机器人到达距离充电座对接槽中心点1米,偏离对接槽中垂线46度的位置,获取多帧激光雷达的传感器信号,以此类推,得到多种情况下的传感器信号,然后再多次改变机器人距离充电座对接槽中心点距离,并在该距离下,不断改变角度获取传感器信号。由此可见,通过不断改变机器人位置,可以收集到很多传感器信号作为训练样本。Taking the lidar sensor as an example, after fixing the charging stand at a certain position, control the robot to reach a position 1 meter away from the center point of the docking slot of the charging stand and 45 degrees away from the vertical line in the docking slot to obtain multi-frame lidar sensor signals, and then Control the robot to reach a position 1 meter away from the center point of the docking slot of the charging stand, and 46 degrees away from the vertical line in the docking slot, and obtain multi-frame lidar sensor signals, and so on, to obtain sensor signals in various situations, and then repeat multiple times Change the distance between the robot and the center point of the docking slot of the charging stand, and at this distance, constantly change the angle to obtain the sensor signal. It can be seen that by continuously changing the position of the robot, many sensor signals can be collected as training samples.
可选的,为了提升模型精准度,可以通过在不同场景中,获取多个距离多个角度的传感器信号。例如,有遮挡物的异常场景、无遮挡物的正常场景、不同光照的场景等。Optionally, in order to improve the accuracy of the model, it is possible to obtain sensor signals from multiple distances and multiple angles in different scenarios. For example, abnormal scenes with occluders, normal scenes without occluders, scenes with different lighting, etc.
在具体实施时,充电座的相对位置可以包括相对距离、角度、充电座上对接槽的中心点坐标等信息,这些信息能够引导机器人如何进入对接槽实现对接。During specific implementation, the relative position of the charging stand may include information such as relative distance, angle, center point coordinates of the docking slot on the charging stand, and such information can guide the robot how to enter the docking slot to achieve docking.
步骤203:从多个第一相对位置中,选择第一可信度超过第一阈值的第一相对位置。Step 203: From the plurality of first relative positions, select a first relative position whose first reliability exceeds a first threshold.
其中,第一阈值用来表示可信度达标条件,因此第一阈值会比较高些。假设可信度的取值范围为0至1,那么第一阈值可以设置在0.8以上。Wherein, the first threshold is used to indicate the condition of reaching the standard of credibility, so the first threshold will be relatively higher. Assuming that the value range of the credibility is 0 to 1, then the first threshold may be set above 0.8.
需要说明的是,在实际应用中,在筛选可信度达标的第一相对位置时,可能筛选出一个或一个以上第一相对位置,当然也可能筛选出零个第一相对位置,也即不存在可信度达标的第一相对位置。It should be noted that in practical applications, when screening the first relative positions whose reliability meets the standard, one or more first relative positions may be screened out, and of course zero first relative positions may be screened out, that is, no There is a first relative position at which the confidence level is met.
其中,如果筛选出一个或一个以上第一相对位置,则执行下述步骤204,而如果没有筛选出可信度达标的第一相对位置,可以重新获取传感器信号进行筛选,如果重新筛选一定时间后仍未找到可信度达标的第一相对位置,可以采用第二模型对多种传感器信号进行联合判断,具体实现过程可以参见下述实施例的描述,本发明在此暂不详述。Wherein, if one or more first relative positions are screened out, the following step 204 is performed, and if the first relative position with the reliability up to the standard is not screened out, the sensor signal can be re-acquired for screening. If the first relative position that reaches the standard of reliability has not been found, the second model can be used to jointly judge multiple sensor signals. For the specific implementation process, please refer to the description of the following embodiments, and the present invention will not be described in detail here.
需要说明的是,在从多个第一相对位置中,选择第一可信度超过第一阈值的第一相对位置之后,还可以存储选择的第一相对位置和其对应的第一可信度, 以用于后续机器人行进过程中用更高的可信度和相对位置替换。It should be noted that, after selecting the first relative position whose first reliability exceeds the first threshold from the plurality of first relative positions, the selected first relative position and its corresponding first reliability may also be stored. , to be replaced with higher confidence and relative position for subsequent robot travel.
步骤204:基于选择的第一相对位置规划回充路线,并按照所述回充路线控制机器人行进,以与充电座对接。Step 204: Planning a recharging route based on the selected first relative position, and controlling the robot to travel according to the recharging route so as to dock with the charging stand.
基于上述步骤203的描述,可选的,如果选择到的第一相对位置的数量为1,则可以直接利用选择到的第一相对位置规划回充路线;如果选择到的第一相对位置的数量为1个以上,则可以根据选择到的多个第一相对位置获得充电座的综合相对位置,进而利用综合相对位置进行回充路线规划。Based on the description of step 203 above, optionally, if the number of selected first relative positions is 1, the recharging route can be planned directly using the selected first relative positions; if the number of selected first relative positions If there are more than one, then the comprehensive relative position of the charging stand can be obtained according to the selected multiple first relative positions, and then the comprehensive relative position can be used to plan the recharging route.
在一可选的具体实施方式中,对于综合相对位置的获得过程,可以针对选择的每个第一相对位置,依据该第一相对位置对应的第一可信度确定其对应的权重,进而利用每个第一相对位置和对应的权重获得充电座的综合相对位置。In an optional specific implementation, for the process of obtaining the comprehensive relative position, for each selected first relative position, its corresponding weight can be determined according to the first reliability corresponding to the first relative position, and then use Each first relative position and corresponding weight obtains an integrated relative position of the charging stand.
其中,第一相对位置对应的第一可信度越高,确定的权重越大。Wherein, the higher the first reliability corresponding to the first relative position, the greater the determined weight.
可选的,可以将其中一个第一相对位置对应的第一可信度与所有达标的第一可信度之和的商,作为这一个第一相对位置的权重,以达到可信度越高,权重越大的目的。Optionally, the quotient of the first credibility level corresponding to one of the first relative positions and the sum of all first credibility levels up to the standard can be used as the weight of this first relative position, so as to achieve the higher credibility , the purpose of greater weight.
举例来说,如图3所示,假设用于规划路线的相对位置包括机器人相对充电座的距离L,相对对接槽中垂线的角度θ,利用距离L和角度θ计算获得L1和L2,也就是说,规划的回充路线为向南行进L1后,机器人到达对接槽中垂线上,然后机器人正对着充电座再向西行进L2后与充电座的对接槽对接上,对接效果如图4所示。For example, as shown in Figure 3, it is assumed that the relative position used for planning the route includes the distance L between the robot and the charging stand, and the angle θ relative to the vertical line in the docking slot. Using the distance L and angle θ to calculate and obtain L1 and L2, also That is to say, the planned recharging route is that after traveling southward to L1, the robot reaches the vertical line of the docking slot, and then the robot is facing the charging stand, and then travels westward to L2 to dock with the docking slot of the charging stand. The docking effect is shown in the figure 4.
需要说明的是,机器人在按照回充路线行进过程中,可以继续实时控制多个传感器采集机器人周围环境的信号,并针对每个传感器信号,根据该传感器信号获取充电座的第一相对位置和第一可信度,并将新获取的第一可信度与已存储的第一可信度进行比较,当出现比已存储的第一可信度更高的第一可信度时,可以利用新获取的第一可信度的第一相对位置来更新回充路线,以使得机器人更加精准与充电座对接,同时利用新获取的第一可信度和其对应的第一相对位置,更新已存储的第一可信度和其对应的第一相对位置。It should be noted that when the robot is traveling along the recharging route, it can continue to control multiple sensors in real time to collect signals from the surrounding environment of the robot, and for each sensor signal, obtain the first relative position and the second relative position of the charging stand according to the sensor signal. A credibility, and compare the newly obtained first credibility with the stored first credibility, when there is a first credibility higher than the stored first credibility, you can use The newly obtained first relative position of the first degree of reliability is used to update the recharging route, so that the robot can dock with the charging stand more accurately. The stored first reliability and its corresponding first relative position.
也就是说,机器人按照回充路线行进过程中,会继续实时计算新采集的传感器信号的可信度和充电座的相对位置,如果出现可信度更高的相对位置,会利用这个可信度更高的相对位置更新回充路线。That is to say, when the robot is traveling along the recharging route, it will continue to calculate the reliability of the newly collected sensor signal and the relative position of the charging stand in real time. If there is a relative position with higher reliability, it will use this reliability Higher relative positions update recharge routes.
进一步地,在利用新获取的第一可信度的第一相对位置更新回充路线时, 还可以利用新获取的第一相对位置,并结合机器人在回充路线上已行进的路线和已存储的第一相对位置,来更新回充路线。Further, when updating the recharging route with the newly obtained first relative position of the first reliability, the newly obtained first relative position can also be used in combination with the route traveled by the robot on the recharging route and the stored to update the recharging route.
至此,完成上述图2所示的回充流程,在机器人需要回充时,通过获取机器人上已有的多种传感器采集的传感器信号,并根据每个传感器信号得到充电座位置和可信度,从中选择可信度达标的充电座位置进行回充路线规划,由于机器人上的多种传感器是从不同角度进行信号采集,因此在一个或多个传感器因充电座在遮挡或强光场景中导致传感器信号不完整或失效的情况下,还会有其他角度的传感器信号得到高可信度的充电座位置,进而由其他角度传感器信号得到的充电座位置进行回充路线规划,保证在一个或多个传感器失效的场景中依然能够稳定检测到充电座的位置,稳定完成回充任务。So far, the recharging process shown in Figure 2 above is completed. When the robot needs to be recharged, the sensor signals collected by the various sensors already on the robot are obtained, and the position and reliability of the charging stand are obtained according to each sensor signal. Select the position of the charging stand with the reliability standard to plan the recharging route. Since the various sensors on the robot collect signals from different angles, when one or more sensors are blocked by the charging stand or in the scene of strong light, the sensor will be damaged. When the signal is incomplete or invalid, there will be sensor signals from other angles to obtain the position of the charging stand with high reliability, and then the position of the charging stand obtained from the signals of other angle sensors will be used to plan the recharging route to ensure that one or more In the scene where the sensor fails, the position of the charging stand can still be detected stably, and the recharging task can be completed stably.
实施例二:Embodiment two:
图5为本发明根据一示例性实施例示出的另一种机器人回充控制方法的实施例流程示意图,基于上述图2所示实施例的基础上,所述机器人回充控制方法包括如下步骤:Fig. 5 is a schematic flowchart of another robot recharging control method according to an exemplary embodiment of the present invention. Based on the embodiment shown in Fig. 2 above, the robot recharging control method includes the following steps:
步骤501:控制机器人上的多个传感器采集机器人周围环境的信号。Step 501: Controlling multiple sensors on the robot to collect signals of the surrounding environment of the robot.
步骤502:针对每个传感器信号,根据该传感器信号获取充电座的第一相对位置和第一可信度。Step 502: For each sensor signal, acquire a first relative position and a first reliability of the charging stand according to the sensor signal.
步骤503:判断是否有超过第一阈值的第一可信度,若有,则执行步骤504,若没有,则执行步骤505。Step 503: Judging whether there is a first confidence level exceeding the first threshold, if yes, execute step 504, if not, execute step 505.
步骤504:基于第一可信度超过第一阈值的第一相对位置规划回充路线,并按照所述回充路线控制机器人行进,以与充电座对接。Step 504: Planning a recharging route based on the first relative position whose first reliability exceeds the first threshold, and controlling the robot to travel according to the recharging route so as to dock with the charging stand.
针对上述步骤501至步骤504的具体实现,可以参见上述实施例的描述,本发明在此不再赘述。For the specific implementation of the above step 501 to step 504, reference may be made to the description of the above embodiment, and the present invention will not repeat them here.
步骤505:开始计时,并将计时时间与预设时长比较,若计时时间小于预设时长,则继续执行步骤501,若计时时间大于预设时长,则执行步骤506。Step 505: start timing, and compare the counted time with the preset duration, if the counted time is less than the preset duration, continue to execute step 501, and if the counted time is greater than the preset duration, execute step 506.
步骤506:从最近一次采集的传感器信号中,选择第一可信度超过第二阈值的传感器信号。Step 506: From the latest collected sensor signals, select the sensor signals whose first reliability exceeds the second threshold.
其中,第二阈值低于第一阈值,对于第一可信度超过第二阈值的传感器信号是有希望通过综合处理提升可信度的信号。Wherein, the second threshold is lower than the first threshold, and the sensor signal whose first reliability exceeds the second threshold is a signal whose reliability can be improved through comprehensive processing.
需要说明的是,对于第一可信度超过第二阈值但低于第一阈值的传感器信 号,可能是充电座被遮挡或者充电座在强光场景中获得的信号,导致信号不完整,从而可信度不达标。It should be noted that for the sensor signal whose first reliability exceeds the second threshold but is lower than the first threshold, it may be that the charging stand is blocked or the signal obtained by the charging stand in a strong light scene results in an incomplete signal, which may Reliability is not up to standard.
步骤507:将选择的传感器信号输入已训练第二模型,由第二模型对输入的传感器信号进行综合处理并输出充电座的第二相对位置和第二可信度。Step 507: Input the selected sensor signal into the trained second model, and the second model comprehensively processes the input sensor signal and outputs the second relative position and the second reliability of the charging stand.
在执行步骤507之前,需要训练获得对多种传感器信号综合处理的第二模型,训练过程可以包括:在有遮挡物或强光场景中,收集各个传感器相对充电座的多个距离多个角度的传感器信号,并为相同距离相同角度条件下收集到的各个传感器信号标注充电座的相对位置和可信度的标签,然后构建网络模型,并利用标注标签后的各个传感器信号对构建的网络模型进行训练,直至网络模型收敛,以得到第二模型。Before performing step 507, it is necessary to train to obtain a second model for comprehensive processing of various sensor signals. The training process may include: in a scene with an occluder or a strong light, collecting data of multiple distances and multiple angles of each sensor relative to the charging stand Sensor signals, and label the relative position and reliability of the charging stand for each sensor signal collected under the same distance and the same angle, and then build a network model, and use the labeled sensor signals to construct the network model. Train until the network model converges to obtain the second model.
需要说明的是,第二模型在对各个传感器信号综合处理后,输出的第二相对位置和第二可信度是由多个传感器信号综合得到的位置和可信度。It should be noted that, after the second model comprehensively processes each sensor signal, the outputted second relative position and second reliability are the positions and reliability obtained by integrating multiple sensor signals.
步骤508:若第二可信度超过第三阈值,则利用第二相对位置规划回充路线,并按照所述回充路线控制机器人行进,以与充电座对接充电。Step 508: If the second reliability exceeds the third threshold, use the second relative position to plan a recharging route, and control the robot to travel according to the recharging route, so as to dock with the charging stand for charging.
其中,第二相对位置包含的信息类型与第一相对位置包含的信息类型相同,因此利用第二相对位置规划回充路线的原理,与利用第一相对位置规划回充路线的原理一致。Wherein, the type of information contained in the second relative position is the same as that contained in the first relative position, so the principle of planning the recharging route by using the second relative position is consistent with the principle of planning the recharging route by using the first relative position.
需要说明的是,第三阈值大于第二阈值,但第三阈值可以与第一阈值相同,也可以不相同,本发明对此不进行具体限定。It should be noted that the third threshold is greater than the second threshold, but the third threshold may be the same as or different from the first threshold, which is not specifically limited in the present invention.
步骤509:若第二可信度未超过第三阈值,则输出无法找到充电座的报警提示。Step 509: If the second reliability does not exceed the third threshold, output an alarm prompt that the charging stand cannot be found.
至此,完成上述图5所示的回充流程,在出现各种传感器信号的可信度持续不达标而无法规划回充路线的情况下,并且该情况持续一定时间后,通过从最近一次采集的传感器信号中,选择第一可信度超过第二阈值的传感器信号作为第二模型的输入,由第二模型进行综合判断并输出一个综合后的充电座的第二相对位置和第二可信度,并利用第二相对位置规划回充路线,以保证在一个或多个传感器失效的场景中依然能够稳定检测到充电座的位置,稳定完成回充任务。So far, the recharging process shown in Figure 5 above is completed. In the event that the reliability of various sensor signals continues to fall short of the standard and the recharging route cannot be planned, and after the situation lasts for a certain period of time, the data collected from the latest Among the sensor signals, the sensor signal whose first reliability exceeds the second threshold is selected as the input of the second model, and the second model makes a comprehensive judgment and outputs a comprehensive second relative position and second reliability of the charging stand , and use the second relative position to plan the recharging route, so as to ensure that the position of the charging stand can still be stably detected in the scene where one or more sensors fail, and the recharging task can be completed stably.
本发明实施方式还提供一种与前述实施方式所提供的机器人回充控制方法对应的机器人回充控制装置,以执行上述机器人回充控制方法。Embodiments of the present invention also provide a robot recharging control device corresponding to the robot recharging control method provided in the foregoing embodiments, so as to implement the above robot recharging control method.
图6为本发明根据一示例性实施例示出的一种机器人回充控制装置的硬件结构图,该机器人回充控制装置包括:通信接口701、处理器702、存储器703和总线704;其中,通信接口701、处理器702和存储器703通过总线704完成相互间的通信。处理器702通过读取并执行存储器703中与机器人回充控制方法的控制逻辑对应的机器可执行指令,可执行上文描述的机器人回充控制方法,该方法的具体内容参见上述实施例,此处不再累述。Fig. 6 is a hardware structure diagram of a robot recharging control device according to an exemplary embodiment of the present invention. The robot recharging control device includes: a communication interface 701, a processor 702, a memory 703 and a bus 704; The interface 701 , the processor 702 and the memory 703 communicate with each other through the bus 704 . The processor 702 can execute the robot recharging control method described above by reading and executing the machine-executable instructions corresponding to the control logic of the robot recharging control method in the memory 703. For details of the method, refer to the above-mentioned embodiments. I won't repeat it here.
本发明中提到的存储器703可以是任何电子、磁性、光学或其它物理存储装置,可以包含存储信息,如可执行指令、数据等等。具体地,存储器703可以是RAM(Random Access Memory,随机存取存储器)、闪存、存储驱动器(如硬盘驱动器)、任何类型的存储盘(如光盘、DVD等),或者类似的存储介质,或者它们的组合。通过至少一个通信接口701(可以是有线或者无线)实现该系统网元与至少一个其他网元之间的通信连接,可以使用互联网、广域网、本地网、城域网等。The memory 703 mentioned in the present invention can be any electronic, magnetic, optical or other physical storage device, which can contain stored information, such as executable instructions, data and so on. Specifically, memory 703 can be RAM (Random Access Memory, random access memory), flash memory, storage drive (such as hard drive), any type of storage disk (such as optical disc, DVD, etc.), or similar storage media, or their The combination. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 701 (which may be wired or wireless), and the Internet, wide area network, local network, metropolitan area network, etc. can be used.
总线704可以是ISA总线、PCI总线或EISA总线等。所述总线可以分为地址总线、数据总线、控制总线等。其中,存储器703用于存储程序,所述处理器702在接收到执行指令后,执行所述程序。The bus 704 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus can be divided into address bus, data bus, control bus and so on. Wherein, the memory 703 is used to store a program, and the processor 702 executes the program after receiving an execution instruction.
处理器702可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器702中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器702可以是通用处理器,包括中央处理器(Central Processing Unit,简称CPU)、网络处理器(Network Processor,简称NP)等;还可以是数字信号处理器(DSP)、专用集成电路(ASIC)、现成可编程门阵列(FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。 通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。The processor 702 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above method may be completed by an integrated logic circuit of hardware in the processor 702 or instructions in the form of software. The above-mentioned processor 702 can be a general-purpose processor, including a central processing unit (Central Processing Unit, referred to as CPU), a network processor (Network Processor, referred to as NP) etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), off-the-shelf programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods, steps, and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor.
本申请实施例提供的机器人回充控制装置与本申请实施例提供的机器人回充控制方法出于相同的发明构思,具有与其采用、运行或实现的方法相同的有益效果。The robot recharging control device provided in the embodiment of the present application is based on the same inventive concept as the robot recharging control method provided in the embodiment of the present application, and has the same beneficial effect as the method adopted, operated or implemented.
本申请实施方式还提供一种与前述实施方式所提供的机器人回充控制方法对应的计算机可读存储介质,请参考图7所示,其示出的计算机可读存储介质为光盘30,其上存储有计算机程序(即程序产品),所述计算机程序在被处理器运行时,会执行前述任意实施方式所提供的机器人回充控制方法。The embodiment of the present application also provides a computer-readable storage medium corresponding to the robot recharging control method provided in the foregoing embodiment, please refer to FIG. A computer program (that is, a program product) is stored, and when the computer program is run by the processor, it will execute the robot recharging control method provided in any of the foregoing implementation manners.
需要说明的是,所述计算机可读存储介质的例子还可以包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他光学、磁性存储介质,在此不再一一赘述。It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random Access memory (RAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other optical and magnetic storage media will not be repeated here.
本申请的上述实施例提供的计算机可读存储介质与本申请实施例提供的机器人回充控制方法出于相同的发明构思,具有与其存储的应用程序所采用、运行或实现的方法相同的有益效果。The computer-readable storage medium provided by the above-mentioned embodiments of the present application is based on the same inventive concept as the robot recharging control method provided by the embodiments of the present application, and has the same beneficial effects as the method adopted, run or implemented by its stored application program .
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本发明的其它实施方案。本发明旨在涵盖本发明的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本发明的一般性原理并包括本发明未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本发明的真正范围和精神由下面的权利要求指出。Other embodiments of the invention will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The present invention is intended to cover any modification, use or adaptation of the present invention. These modifications, uses or adaptations follow the general principles of the present invention and include common knowledge or conventional technical means in the technical field not disclosed in the present invention . The specification and examples are to be considered exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明保护的范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the present invention. within the scope of protection.

Claims (11)

  1. 一种机器人回充控制方法,其特征在于,所述方法包括:A method for controlling recharging of a robot, characterized in that the method comprises:
    控制机器人上的多个传感器采集所述机器人周围环境的信号;controlling a plurality of sensors on the robot to collect signals of the surrounding environment of the robot;
    针对每个传感器信号,根据该传感器信号获取充电座的第一相对位置和第一可信度;For each sensor signal, acquiring a first relative position and a first reliability of the charging stand according to the sensor signal;
    从所述多个第一相对位置中,选择第一可信度超过第一阈值的第一相对位置;From the plurality of first relative positions, selecting a first relative position with a first confidence level exceeding a first threshold;
    基于选择的第一相对位置规划回充路线,并按照所述回充路线控制机器人行进,以与充电座对接。A recharging route is planned based on the selected first relative position, and the robot is controlled to travel according to the recharging route so as to dock with the charging stand.
  2. 如权利要求1所述的方法,其特征在于,所述根据该传感器信号获取充电座的第一相对位置和第一可信度,包括:The method according to claim 1, wherein said obtaining the first relative position and the first reliability of the charging stand according to the sensor signal comprises:
    将该传感器信号输入其对应的已训练第一模型,由第一模型处理输入的传感器信号并输出充电座的第一相对位置和第一可信度。The sensor signal is input into its corresponding trained first model, and the input sensor signal is processed by the first model to output a first relative position and a first reliability of the charging stand.
  3. 如权利要求1所述的方法,其特征在于,所述基于选择的第一相对位置规划回充路线,包括:The method according to claim 1, wherein planning the recharging route based on the selected first relative position comprises:
    在选择的第一相对位置的数量为1时,利用选择的第一相对位置规划回充路线;When the number of selected first relative positions is 1, use the selected first relative positions to plan the recharging route;
    在选择的第一相对位置的数量为多个时,根据所述多个第一相对位置获得充电座的综合相对位置,并利用所述综合相对位置规划回充路线。When there are multiple selected first relative positions, an integrated relative position of the charging stand is obtained according to the multiple first relative positions, and a recharging route is planned using the integrated relative position.
  4. 如权利要求3所述的方法,其特征在于,所述根据所述多个第一相对位置获得充电座的综合相对位置,包括:The method according to claim 3, wherein said obtaining the comprehensive relative position of the charging stand according to the plurality of first relative positions comprises:
    针对选择的每个第一相对位置,依据所述第一相对位置对应的第一可信度确定其对应的权重;For each selected first relative position, determine its corresponding weight according to the first reliability corresponding to the first relative position;
    利用每个第一相对位置和对应的权重获得充电座的综合相对位置。The integrated relative position of the charging stand is obtained by using each first relative position and the corresponding weight.
  5. 如权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1, further comprising:
    在每个传感器信号对应的第一可信度均未超过第一阈值时,继续执行控制机器人上的多个传感器采集所述机器人周围环境的信号的步骤;When the first reliability corresponding to each sensor signal does not exceed the first threshold, continue to perform the step of controlling multiple sensors on the robot to collect signals of the robot's surrounding environment;
    经过预设时长后每个传感器信号对应的第一可信度始终未超过第一阈值时,从最近一次采集的各个传感器信号中,选择第一可信度超过第二阈值的传感器信号;When the first reliability corresponding to each sensor signal has not exceeded the first threshold after the preset period of time, select the sensor signal whose first reliability exceeds the second threshold from the latest collected sensor signals;
    将选择的传感器信号输入已训练第二模型,由第二模型对输入的传感器信号进行 综合处理并输出充电座的第二相对位置和第二可信度;Input the selected sensor signal into the trained second model, and the second model comprehensively processes the input sensor signal and outputs the second relative position and the second reliability of the charging stand;
    根据所述第二可信度超过第三阈值,利用所述第二相对位置规划回充路线,并按照所述回充路线控制机器人行进,以与充电座对接充电;According to the second reliability exceeding the third threshold, use the second relative position to plan a recharging route, and control the robot to travel according to the recharging route, so as to dock with the charging stand for charging;
    根据所述第二可信度未超过第三阈值,输出无法找到充电座的报警提示。According to the fact that the second reliability does not exceed the third threshold, an alarm prompt that the charging stand cannot be found is output.
  6. 如权利要求1所述的方法,其特征在于,在从所述多个第一相对位置中,选择第一可信度超过第一阈值的第一相对位置之后,所述方法还包括:存储选择的第一相对位置和其对应的第一可信度;The method according to claim 1, wherein after selecting a first relative position whose first reliability exceeds a first threshold from the plurality of first relative positions, the method further comprises: storing the selected The first relative position of and its corresponding first reliability;
    所述方法还包括:The method also includes:
    在按照所述回充路线控制机器人行进过程中,继续控制多个传感器采集所述机器人周围环境的信号,并针对每个传感器信号,根据该传感器信号获取充电座的第一相对位置和第一可信度;In the process of controlling the robot to move according to the recharging route, continue to control a plurality of sensors to collect signals of the surrounding environment of the robot, and for each sensor signal, obtain the first relative position and the first possible position of the charging base according to the sensor signal. Reliability;
    在每个传感器信号的第一可信度中存在比已存储的第一可信度更高的第一可信度时,基于该更高的第一可信度对应的第一相对位置更新所述回充路线,并按照更新后的回充路线控制机器人行进;When there is a higher first reliability in the first reliability of each sensor signal than the stored first reliability, the first relative position corresponding to the higher first reliability is updated based on the first relative position. Describe the recharging route, and control the robot to move according to the updated recharging route;
    利用该更高的第一可信度和其对应的第一相对位置,更新已存储的第一可信度和其对应的第一相对位置。Utilizing the higher first degree of confidence and its corresponding first relative position, the stored first degree of confidence and its corresponding first relative position are updated.
  7. 如权利要求2所述的方法,其特征在于,所述方法还包括传感器对应的第一模型的训练过程:The method according to claim 2, wherein the method further comprises a training process of the first model corresponding to the sensor:
    获取该传感器相对充电座的多个距离多个角度的传感器信号,并为每个传感器信号标注充电座的相对位置和可信度的标签;Obtain the sensor signals of multiple distances and angles of the sensor relative to the charging stand, and label the relative position and reliability of the charging stand for each sensor signal;
    构建网络模型,并利用标注标签后的传感器信号对构建的网络模型进行训练,直至网络模型收敛,得到第一模型。Constructing a network model, and using the labeled sensor signals to train the constructed network model until the network model converges to obtain the first model.
  8. 如权利要求5所述的方法,其特征在于,所述方法还包括第二模型的训练过程:The method according to claim 5, wherein the method further comprises a training process of the second model:
    在有遮挡物或强光场景中,收集机器人上各个传感器相对充电座的多个距离多个角度的传感器信号,并为相同距离相同角度条件下收集到的各个传感器信号标注充电座的相对位置和可信度的标签;In scenes with occluders or strong light, collect sensor signals at multiple distances and angles from each sensor on the robot relative to the charging stand, and mark the relative position and location of the charging stand for each sensor signal collected at the same distance and at the same angle. credibility label;
    构建网络模型,并利用标注标签后的各个传感器信号对构建的网络模型进行训练,直至网络模型收敛,得到第二模型。A network model is constructed, and the constructed network model is trained by using the labeled sensor signals until the network model converges to obtain a second model.
  9. 一种机器人回充控制装置,所述装置包括存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现如权利要求1-8任一项所述方法的步骤。A robot recharging control device, the device includes a memory, a processor and a computer program stored on the memory and operable on the processor, characterized in that, when the processor executes the computer program Implementing the steps of the method according to any one of claims 1-8.
  10. 一种机器人,其特征在于,包括:A robot, characterized in that it comprises:
    如上述权利要求9所述的机器人回充控制装置;The robot recharging control device according to the above claim 9;
    多种传感器,用于采集所述机器人周围环境的信号。A variety of sensors are used to collect signals of the surrounding environment of the robot.
  11. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述程序被处理器执行时实现如权利要求1-8任一项所述方法的步骤。A computer-readable storage medium, on which a computer program is stored, wherein, when the program is executed by a processor, the steps of the method according to any one of claims 1-8 are realized.
PCT/CN2022/079253 2021-07-19 2022-03-04 Robot recharging control method and apparatus, and storage medium WO2023000679A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110815732.6A CN113534805B (en) 2021-07-19 Robot recharging control method, device and storage medium
CN202110815732.6 2021-07-19

Publications (1)

Publication Number Publication Date
WO2023000679A1 true WO2023000679A1 (en) 2023-01-26

Family

ID=78128781

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/079253 WO2023000679A1 (en) 2021-07-19 2022-03-04 Robot recharging control method and apparatus, and storage medium

Country Status (1)

Country Link
WO (1) WO2023000679A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070050086A1 (en) * 2005-08-31 2007-03-01 Samsung Gwangju Electronics Co., Ltd. System and method for returning robot cleaner to charger
KR101437778B1 (en) * 2013-05-06 2014-09-11 (주)마미로봇 Guide signal transmitter of docking station
JP2018017826A (en) * 2016-07-26 2018-02-01 株式会社豊田中央研究所 Autonomous moving body and environment map update device
CN110378285A (en) * 2019-07-18 2019-10-25 北京小狗智能机器人技术有限公司 A kind of recognition methods of cradle, device, robot and storage medium
CN110632915A (en) * 2018-06-21 2019-12-31 科沃斯机器人股份有限公司 Robot recharging path planning method, robot and charging system
CN111481107A (en) * 2019-01-28 2020-08-04 北京奇虎科技有限公司 Positioning method and device of charging seat of sweeper, computing equipment and storage medium
CN112214015A (en) * 2020-09-04 2021-01-12 安克创新科技股份有限公司 Self-moving robot and recharging method, system and computer storage medium thereof
CN113534805A (en) * 2021-07-19 2021-10-22 美智纵横科技有限责任公司 Robot recharging control method and device and storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070050086A1 (en) * 2005-08-31 2007-03-01 Samsung Gwangju Electronics Co., Ltd. System and method for returning robot cleaner to charger
KR101437778B1 (en) * 2013-05-06 2014-09-11 (주)마미로봇 Guide signal transmitter of docking station
JP2018017826A (en) * 2016-07-26 2018-02-01 株式会社豊田中央研究所 Autonomous moving body and environment map update device
CN110632915A (en) * 2018-06-21 2019-12-31 科沃斯机器人股份有限公司 Robot recharging path planning method, robot and charging system
CN111481107A (en) * 2019-01-28 2020-08-04 北京奇虎科技有限公司 Positioning method and device of charging seat of sweeper, computing equipment and storage medium
CN110378285A (en) * 2019-07-18 2019-10-25 北京小狗智能机器人技术有限公司 A kind of recognition methods of cradle, device, robot and storage medium
CN112214015A (en) * 2020-09-04 2021-01-12 安克创新科技股份有限公司 Self-moving robot and recharging method, system and computer storage medium thereof
CN113534805A (en) * 2021-07-19 2021-10-22 美智纵横科技有限责任公司 Robot recharging control method and device and storage medium

Also Published As

Publication number Publication date
CN113534805A (en) 2021-10-22

Similar Documents

Publication Publication Date Title
US11351681B2 (en) Method and apparatus for charging robot
US20220057212A1 (en) Method for updating a map and mobile robot
US20220074762A1 (en) Exploration Of A Robot Deployment Area By An Autonomous Mobile Robot
US20210096580A1 (en) Method for robot repositioning
JP5560794B2 (en) Control device, control method and program
CN106444777A (en) Robot automatic return charging method and system
CN108983761B (en) Method and system for searching charging device by robot and robot
JP2020021257A (en) Autonomous mobile device, autonomous mobile method, and program
US11119501B2 (en) Moving robot and control method for the same
CN110609562B (en) Image information acquisition method and device
US20210132213A1 (en) Apparatus and methods for multi-sensor slam systems
CN110597265A (en) Recharging method and device for sweeping robot
JP6640779B2 (en) Autonomous mobile device and mobile control system
WO2021103065A1 (en) Charging pile positioning method and apparatus for sweeping robot
WO2022222490A1 (en) Robot control method and robot
KR20230137395A (en) 3D map construction method and device
WO2022227877A1 (en) Obstacle avoidance method and apparatus for automatic walking device, medium, and electronic device
US20210141381A1 (en) Information processing device, information processing system, behavior planning method, and computer program
WO2023000679A1 (en) Robot recharging control method and apparatus, and storage medium
WO2024007807A1 (en) Error correction method and apparatus, and mobile device
US20200409388A1 (en) Controller, control method, and program
CN113534805B (en) Robot recharging control method, device and storage medium
TW202214401A (en) Moving robot system
TW202228587A (en) Moving robot system
KR20200048918A (en) Positioning method and apparatus thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22844852

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE