WO2024032601A1 - Système de commande à niveaux multiples pour robot - Google Patents

Système de commande à niveaux multiples pour robot Download PDF

Info

Publication number
WO2024032601A1
WO2024032601A1 PCT/CN2023/111712 CN2023111712W WO2024032601A1 WO 2024032601 A1 WO2024032601 A1 WO 2024032601A1 CN 2023111712 W CN2023111712 W CN 2023111712W WO 2024032601 A1 WO2024032601 A1 WO 2024032601A1
Authority
WO
WIPO (PCT)
Prior art keywords
management module
module
processing module
level
sensing
Prior art date
Application number
PCT/CN2023/111712
Other languages
English (en)
Chinese (zh)
Inventor
任化龙
Original Assignee
深圳忆海原识科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳忆海原识科技有限公司 filed Critical 深圳忆海原识科技有限公司
Publication of WO2024032601A1 publication Critical patent/WO2024032601A1/fr

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls

Definitions

  • the present application belongs to the field of robot technology, and more specifically, relates to a multi-level robot control system.
  • Robots such as bionic robots, humanoid robots, operational robots, collaborative robots, and dexterous hand systems have many degrees of freedom, often more than 30, and the robots need to make corresponding adjustments according to the environment when working. Therefore, the sensing elements and execution The number of components is large; therefore, there are many lines, information redundancy, the burden on the central processing module (computer) is too great, and the response speed is low.
  • Embodiments of the present application provide a multi-level robot control system, including: a central processing module, one or more peripheral processing modules, one or more sensing management modules, and one or more execution management modules;
  • the central processing module communicates with the peripheral processing module and controls the peripheral processing module
  • the peripheral processing module communicates with the sensor management module and controls the sensor management module
  • the peripheral processing module communicates with and controls the execution management module.
  • a multi-level control system is formed by a central processing module, a peripheral processing module, a sensing management module, and an execution management module; the sensing management module, the execution management module, the peripheral processing module, and the central processing module
  • the emergency response speed goes from fast to slow, and the computing processing power goes from weak to strong. They can be reasonably matched. Cooperation and division of labor. For those that require faster feedback and response, it can be completed by the sensing management module, execution management module, or peripheral processing module; for more complex situations that require comprehensive processing of a large amount of information, it can be processed by the central processing module; multi-level The response speed of the control system is fast.
  • the robot multi-level control system includes a direct control path.
  • the sensing management module or the execution management module performs signal processing on the controlled element. Process to obtain output information; the sensing management module and the execution management module monitor the corresponding controlled element according to the output information and output the monitoring results; and/or,
  • the multi-level control system of the robot includes a secondary control path.
  • the sensing management module or the execution management module will process the output information obtained by the signal of the controlled element.
  • the monitoring results of the controlled element by the sensing management module or the execution management module, and at least one of the internal information of the sensing management module or the execution management module is uploaded to the peripheral processing module; and /or,
  • the multi-level control system of the robot includes a three-level control path.
  • the peripheral processing module will process the output information of the signal of the controlled element.
  • the sensing management module or At least one of the monitoring results of the controlled components by the execution management module, the internal information of the sensing management module or the execution management module, and the internal information of the peripheral processing module is uploaded to the central processing module .
  • the controlled element includes a sensing element, and the sensing element is connected to the sensing management module and/or the execution management module.
  • the controlled element includes an execution element, and the execution management module is connected to and controls at least one execution element.
  • the upper-level module can issue instructions to intervene in the lower-level processing process under certain conditions, further ensuring the reliability and flexibility of the system.
  • the sensing management module and the execution management module are provided with a first preset condition set and a first preset processing process set; when the sensing management module or the Any one of the output information processed by the execution management module on the signal of the controlled element, the monitoring result of the controlled element by the sensing management module or the execution management module reaches the first preset condition When, the execution management module and/or the sensing management module execute the first preset processing process; and/or,
  • the peripheral processing module is provided with a second preset condition set and a second preset processing process set; when the sensing management module or the execution management module processes the signal of the controlled element, the output is obtained information, the monitoring results of the controlled components by the sensing management module or the execution management module, the internal information of the sensing management module or the execution management module, the peripheral processing module's response to the received When any of the monitoring results obtained by further processing of the information reaches the second preset condition, the peripheral processing module executes the second preset processing process; and/or,
  • the central processing module is provided with a third preset condition set and a third preset processing process set; when the sensing management module or the execution management module processes the signal of the controlled element, the output Information, the monitoring results of the controlled components by the sensing management module or the execution management module, the internal information of the sensing management module or the execution management module, the monitoring results of the peripheral processing module, When any of the internal information of the peripheral processing module and the monitoring results obtained by further processing the received information by the central processing module reaches the third preset condition, the central processing module executes the third preset condition. Set up the processing process.
  • the peripheral processing module issues a second-level control instruction when executing the second preset processing process;
  • the central processing module issues a third-level control instruction when executing the third preset processing process;
  • the instructions of the direct control path to execute the first preset processing process, the second-level control instructions, and the third-level control instructions each have an importance coefficient
  • the instruction with the largest importance coefficient is executed.
  • the central processing module is equipped with a brain-like computing platform that runs a brain-like neural network to realize autonomous control of the robot.
  • the central processing module has an algorithm or program based on brain neural circuits.
  • the central processing module is equipped with a program module for running programs/scripts to implement robot program control.
  • the central processing module and/or peripheral processing module are also connected to a motion capture device.
  • the motion capture device converts the user's actions into input signals and provides them to the system for realizing robot remote control. control.
  • the robot autonomous control, robot program control, and robot remote control are mixed and used. Make the multi-level robot control system meet the needs of different application environments and ensure system reliability.
  • the motion capture device also has a feedback module, and the central The processing module and/or peripheral processing module outputs feedback information to the motion capture device, and the information is transmitted to the user through the feedback module. It allows users of motion capture equipment to experience environmental feedback such as force, resistance, object shape and texture.
  • the central processing module is also connected to an image input module and a sound input module to realize visual and auditory perception (advanced cognition).
  • the central processing module is implemented through one or more of software, firmware, hardware, and reconfigurable devices;
  • the peripheral processing module is implemented through one or more of software, firmware, hardware, and reconfigurable devices.
  • the execution management module includes at least one driving unit; the driving unit includes a driving circuit.
  • the execution management module further includes at least one management unit.
  • the management unit communicates with the driving unit and coordinates each driving unit;
  • the management unit communicates with the peripheral processing module.
  • the drive circuit is composed of an H-bridge chip or discrete components to form a voltage, current, torque, speed, and angle control loop; an isolation device is provided between the management unit and each drive unit.
  • the signals between the management unit and each drive unit are electromagnetic isolated through isolation devices.
  • the isolation device can be an optocoupler, a magnetic couple, or other isolation chips.
  • the sensing element includes a tactile sensing element, a force sensing element, One or more of a torque sensing element, a position sensing element, a speed sensing element, a current sensing element, a voltage sensing element, and a temperature sensing element.
  • the sensing element with a large signal amount is connected to the sensing management module; the sensing element with a small signal amount is connected to the execution management module.
  • the sensing management module is integrated in a peripheral processing module, and/or the execution management module is integrated in a peripheral processing module.
  • the sensor management module can be merged into the peripheral processing module; when an execution management module has a small number of execution elements, the sensor management module can be integrated into the peripheral processing module.
  • the execution management module can be incorporated into the peripheral processing module.
  • the actuator includes one or more of a motor, a hydraulic component, a pneumatic component, and an artificial muscle.
  • the central processing module and/or the peripheral processing module are also connected to an emergency braking device.
  • the central processing module communicates with the peripheral processing module through one or more of Ethernet, WiFi, Bluetooth, 5G, 4G, USB, serial bus, and industrial bus.
  • the peripheral processing module communicates with the execution management module through one or more of Ethernet, WiFi, Bluetooth, USB, serial bus, and industrial bus.
  • the management unit communicates with each driving unit through a bus, and the bus adopts one or more of CAN, I2C, and SPI.
  • the communication between the central processing module and the peripheral processing module is first-level communication.
  • the goals of the first-level communication include macro operations of joints; the peripheral processing module and the execution management module
  • the communication between groups is the second-level communication, and the target of the second-level communication includes the execution components connected to the execution management module.
  • the first-level communication and the second-level communication each have one or more layers of protocols
  • the data packet format includes instructions; the data packet format may also include targets and/or parameters;
  • the data packet format includes instructions; the data packet format may also include targets and/or parameters.
  • the peripheral processing module is configured as an embedded circuit based on a reconfigurable unit and a communication management unit;
  • the communication management unit communicates with the central processing module.
  • the central processing module sends a first message to the communication management unit.
  • the communication management unit decodes the first message to obtain a second message and transmits the second message. to reconfigurable units.
  • the reconfigurable unit can be configured as FPGA; the communication management unit is ARM or DSP;
  • FPGA and ARM or DSP as the communication management unit can be independent chips, or they can be bound to the same chip to increase the communication bandwidth between them; or, the firmware of ARM or DSP can also be embedded in the reconfigurable unit FPGA .
  • the reconfigurable unit may also be configured as reconfigurable hardware.
  • Reconfigurable hardware refers to hardware devices whose hardware circuits and functions can be reconstructed according to software at runtime.
  • the multi-level robot control system is equipped with a power storage device as a backup power source.
  • a power storage device as a backup power source.
  • temporary power supply can be provided to ensure that the action of the actuator can be completed or to put the robot's movement into a safe state.
  • the sensing management module is equipped with a computing power supply (for example, battery-powered) to further reduce electromagnetic interference suffered by the analog signal sampling part.
  • a computing power supply for example, battery-powered
  • the robot multi-level control system also includes a protective shell, which has one or more of an explosion-proof structure, an electromagnetic radiation-proof structure, a waterproof structure, a dust-proof structure, and a shock-proof structure. .
  • a multi-level control system is formed by a central processing module, a peripheral processing module, a sensing management module, and an execution management module; the sensing management module, the execution management module, the peripheral processing module, and the central processing module
  • the emergency response speed increases from fast to slow, and the computing processing power increases from weak to strong. They can reasonably cooperate and divide work. For those that require faster feedback and response, it can be completed by the sensing management module, execution management module, or peripheral processing module; for more complex situations that require comprehensive processing of a large amount of information, it can be processed by the central processing module; multi-level The response speed of the control system is fast.
  • Figure 1 is a schematic diagram of a multi-level robot control system provided by this application.
  • Figure 2 is a schematic structural diagram of a multi-level robot control system provided by an embodiment of the present application.
  • Figure 3 is a schematic structural diagram of a multi-level robot control system provided by another embodiment of the present application.
  • Figure 4 is a schematic structural diagram of a peripheral processing module provided by an embodiment of the present application.
  • each figure in the figure is marked with: 10-Central processing module, 20-Peripheral processing module, 30-Sensor management module, 40-Execution management module, 50-Executive element, 60-Sensor element, 11-Brain-inspired computing platform, 12-Program Module, 13-emergency braking device, 21-communication management unit, 22-FPGA, 31-management unit, 32-drive unit, 70-motion capture equipment, 71-motion capture module, 72-feedback module, 81-image input Module, 82 - Sound input module.
  • first and second are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Therefore, features defined as “first” and “second” may explicitly or implicitly include one or more of these features.
  • plurality means two or more than two, unless otherwise explicitly and specifically limited.
  • the multi-level robot control system includes: a central processing module 10, one or more peripheral processing modules 20, one or more sensing management modules 30, one or more execution modules Management Module 40.
  • the central processing module 10 communicates with each peripheral processing module 20 and controls the peripheral processing module 20;
  • the peripheral processing module 20 communicates with and controls the sensor management module 30 under its jurisdiction;
  • the peripheral processing module 20 communicates with and controls the execution management module 40 under its jurisdiction.
  • the controlled element includes an executing element 50 , and the controlled element includes a sensing element 60 .
  • the robot includes one or more executing elements 50 and one or more sensing elements 60 .
  • the execution management module 40 is connected to and controls at least one execution element 50; the sensing element 60 is connected to the sensing management module 30 and/or the execution management module 40.
  • the central processing module 10 and the peripheral processing module 20 form a superior and subordinate relationship.
  • the peripheral processing module 20 and the sensor management module 30 form a superior and subordinate relationship.
  • the peripheral processing module 20 and the execution management module 40 form a superior and subordinate relationship.
  • the sensing management module 30 and the execution management module 40 have a same-level relationship.
  • the actuator 50 may include one or more of motors, hydraulic components, pneumatic components, and artificial muscles.
  • the execution component 50 is controlled by the execution management module 40 .
  • the sensing element 60 includes a tactile sensing element, a force sensing element such as a tendon tension sensing element, a torque sensing element, a position sensing element such as a joint angle sensing element, and a speed sensing element such as a joint angular velocity sensing element and motor speed.
  • a sensing element a current sensing element, a voltage sensing element, and a temperature sensing element. It can be understood that the sensing element 60 includes but is not limited to the above.
  • the signals of the sensing element 60 and the actuating element 50 include not only the output signals of the sensing element 60 and the actuating element 50 , but also the detection information of the power supply terminals of the sensing element 60 and the actuating element 52 , such as voltage, current and other signals. In order to subsequently determine whether there is an abnormality in the sensing element 60 and the actuating element 50 based on the signal, for example, whether it is missing or working abnormally such as short circuit, etc.
  • Joint angle sensing elements are installed at each joint of the robot, and their output signals are processed by the sensing management module 30 to obtain joint position information; tactile sensing elements are distributed in the bionic skin, and their output signals are processed by the sensing management module.
  • the module 30 processes to obtain tactile information; the torque sensing element is installed at the joint of the robot, and its output signal is processed by the sensing management module 30 to obtain the joint torque information; the tendon tension sensing element is installed on the tendon, and its output signal The tendon tension information is obtained through processing by the sensing management module 30 .
  • the sensing management module 30 supplies power to the sensing element 60 by applying constant power or applying power in a periodic scanning manner.
  • the sensing management module 30 amplifies, filters, samples and converts the output signals of these sensing elements 60, monitors whether any sensing elements 60 are missing or working abnormally, and transmits the processed output signals and/or monitoring results to The superior module or execution management module 40.
  • the sensing management module 30 can use analog-to-digital conversion devices, control devices, communication protocol chips, power management chips and other components to form circuits, and be equipped with programs to realize the above functions.
  • the sensing management module 30 applies power to and samples each sensing element 60, and the frequency of applying power and the sampling frequency of its output signal can be automatically adjusted.
  • the sensing management module 30 has a battery or other DC (stabilized voltage) power supply as the computing power supply to further reduce the electromagnetic interference suffered by the analog signal sampling part.
  • the execution management module 40 generally only monitors the current, voltage, temperature, etc. of the actuator 50 to form a current loop, voltage loop, temperature loop, etc.
  • the execution management module 40 also monitors the actuator 50 such as the encoder of the motor to measure the rotation speed and rotation angle.
  • the execution management module 40 controls the execution element 50 , monitors whether the execution element 50 is missing or works abnormally, and transmits the current, voltage, speed and monitoring results of the execution element 50 to the peripheral processing module 20 .
  • the execution management module 40 of the specific embodiment of the present application includes at least one driving unit 32 .
  • the drive unit 32 is connected to the actuator 50 .
  • the driving unit 32 includes a driving circuit.
  • the drive circuit can be composed of H-bridge chips, other integrated chips, and discrete components to form voltage, current, torque, speed, and angle control loops.
  • the execution management module 40 also includes at least one management unit 31; in the same execution management module 40, the management unit 31 forms a superior and subordinate relationship with each driving unit 32; the management unit 31 communicates with the driving unit 32, It also controls and coordinates each drive unit 32 to provide PWM signals, enable signals, and direction signals.
  • the communication method is configured as a bus; for example, the bus can use one or more of CAN, I2C, and SPI.
  • the management unit 31 also communicates with the upper-level peripheral processing module 20, and the management unit 31 reports the information of each execution element 50 and the information of each current loop to the peripheral processing module.
  • an isolation device is provided between the management unit 31 and each drive unit 32, and the signals between the management unit 31 and each drive unit 32 are electromagnetically isolated through the isolation device.
  • the isolation device can be an optocoupler, a magnetic couple, or other isolation chips.
  • the signal lines are directly connected to the sensing management Mod 30.
  • the sensing elements 60 with small signal volume such as the motor's own encoder, torque sensing element, and current sensing signal
  • the signal lines can be connected to the execution management module 40 to form a torque loop, speed loop, position loop, etc. .
  • the multi-level control system of the robot includes a direct control channel (a primary control channel), a secondary control channel, and a third-level control channel.
  • the robot multi-level control system includes a direct control path (first-level control path).
  • the sensing management module 30 or the execution management module 40 processes the signals of the controlled components to obtain output information.
  • the signals of the sensing element 60 and the execution element 50 are transmitted to the corresponding sensing management module 30 or execution management module 40, and are processed to obtain output information.
  • Sensing management module The group 30 or the execution management module 40 monitors the corresponding controlled element (the sensing element 60 or the actuating element 50) according to the output information and outputs the monitoring result.
  • the monitoring result information mainly refers to the controlled element such as transmission Check whether the sensing element 60 and the actuating element 50 are normal, whether they are overloaded or missing, etc.
  • the sensing element 60 can be connected to the sensing management module 30 or the execution management module 40; the corresponding sensing management module 30 or the execution management module 40 responds to the signal of the sensing element 60. Perform processing and obtain output information; the sensing management module 30 or the execution management module 40 monitors the sensing element 60 according to the output information and outputs the monitoring results.
  • the execution element 50 can be connected to the execution management module 40; the corresponding execution management module 40 processes the signal of the execution element 50 and obtains output information; the execution management module 40 according to the output information Monitor the actuator 50 and output the monitoring results.
  • a first preset condition set and a first preset processing procedure set are set in the sensing management module 30 and the execution management module 40 .
  • the preset processing process means that when a preset situation occurs, the corresponding module makes a decision and instructs other modules/or components to take further processing or actions.
  • the direct control path when the sensing management module 30 or the execution management module 40 processes the signal of the controlled element, the output information (that is, the output information processed by the direct control path) , when any one of the monitoring results of the controlled element by the sensing management module 30 or the execution management module 40 (that is, the monitoring results of the direct control path) reaches the first preset condition, the execution management module of the direct control path 40 or the sensor management module 30 performs quick response processing on the sensor element 60 or the actuator element 50 according to the first preset processing process.
  • the execution management module 40 when the execution management module 40 monitors that the execution element 50 reaches the first preset condition, the execution management module 40 executes the first preset processing process, and performs fast processing through the direct control path. Fast response processing.
  • the execution management module 40 can monitor the actuator 50 through the sensing element 60 , and the temperature information (output information) of the actuator 50 can be obtained by processing the output signal of the temperature sensing element at the actuator 50 .
  • the execution management module 40 monitors the temperature information of the execution elements 50.
  • the execution management module 40 When the execution management module 40 detects that the temperature of an execution element 50 reaches a preset temperature, the execution management module 40 executes the first preset processing process and automatically Stop supplying power to the actuator 50 until the temperature drops below the preset temperature to reduce the risk of short circuit and prevent the actuator 50 from burning.
  • the sensing element 60 matched with the actuator 50 can be connected to the execution management module 40 to which the actuator 50 belongs, or can be connected to the corresponding sensor management module 30 to form a first direct control path.
  • the execution management module 40 can monitor the voltage, current and other signals of the execution element 52 through the signal acquisition circuit to determine whether the execution element 50 is working abnormally; when the execution management module 40 detects that a certain execution element 50 When the voltage or current reaches the preset condition, the execution management module 40 executes the first preset processing process and automatically stops power supply to the actuator 50 .
  • the sensing management module 30 when the sensing management module 30 monitors that the information of the sensing element 60 reaches the first preset condition, the sensing management module 30 passes the monitoring result to the execution management module 40, and the execution management module The group 40 executes the first preset processing process, and performs quick response processing on the corresponding execution element 50 through the direct control path.
  • the output signal of a torque sensing element at a certain joint can be processed to obtain joint torque information (output information).
  • the sensor management module 30 transmits the monitoring results to the execution management module 40; the execution management module 40 issues instructions to the actuator 50, and Apply more force to the joint or loosen it to avoid damaging the joint.
  • the torque sensing element used to measure joint torque information can be connected to the sensing management module 30 to which it belongs, and can also be connected to the execution management module 40 to which the corresponding actuator 50 belongs, forming a second Directly control the pathway.
  • the sensor management module 30 detects that the information of the sensor element 60 reaches the first preset condition
  • the sensor management module 30 executes the first preset processing process; for example, a torque sensor or force sensor is used.
  • the sensor is connected to its sensing management module 30; if the sensing management module 30 detects that the torque sensor or force sensor is short-circuited or missing, the sensing management module 30 directly disconnects the corresponding torque sensor or force sensor. Electrical treatment.
  • the sensing element 60 is connected to the sensing management module 30.
  • the sensing management module 30 processes the output signal of the sensing element 60 to obtain the output information, and monitors whether there is any abnormality in the sensing element 60. .
  • the sensor management module 30 detects that the output information of the sensor element 60 reaches a preset condition, the sensor management module 30 executes the first preset processing process to control the sensor element 60 .
  • the actuator 50 or the sensor element 60 works abnormally, such as the actuator 50 fails, the sensor element 60 fails or is missing, or the robot joints and moving parts reach the limit state (position limit, force limit, collision) , can perform quick response processing through direct control channels without having to wait for instructions from the superior module. This shortens the response time.
  • the "lower-level” module can respond quickly and then follow further instructions from the "upper-level” module.
  • the upper-level module can issue instructions to intervene in the lower-level processing process under certain conditions.
  • the "lower-level” module determines that there is a major collision between the robot limb (robot arm) and the operated object, and takes some kind of quick response to retract the limb (return the robot arm to the rest position), but the central processing module 10 can use the image
  • the input device or image input module (such as a camera device and a visual perception module) determines whether there is an abnormality between the robot and the surrounding environment. If it is determined that the robot's limbs may come into contact with an approaching person during the retraction path, the central processing module 10 will Intervening in the lower-level processing process can, for example, weaken the force exerted by the actuator 50 on the moving parts, change the movement trajectory, or even stop the movement of the moving parts for avoidance.
  • the sensing management module 30 or the execution management module 40 will directly control the path.
  • the processed output information of the channel and the monitoring results of the direct control channel are uploaded to the peripheral processing module 20 .
  • the peripheral processing module 20 can intervene in the secondary control path to directly control the processing process of the path.
  • the internal information of the sensing management module 30 or the execution management module 40 such as whether the sensing management module 30 or the execution management module 40 is normal, what emergency handling procedures have been adopted, and other related information, is also uploaded to the peripheral processing. Mod 20.
  • the peripheral processing module 20 can further process the above-mentioned received information and monitor the preset target.
  • the emergency response speeds of direct control channels, secondary control channels, and tertiary control channels are from fast to slow.
  • the computing processing capabilities of the direct control path, the secondary control path, and the tertiary control path are from weak to strong.
  • the peripheral processing module 20 is provided with a second preset condition set and a second preset processing process set.
  • the sensing management module 30 or the execution management module 40 processes the output information of the controlled element.
  • the peripheral processing The module 20 executes the second preset processing process.
  • the peripheral processing module 20 can issue secondary control instructions to control the subordinate execution management module 40 or the sensing management module 30 to intervene in the processing process of the direct control channel. .
  • the peripheral processing module 20 combines the output information processed by the direct control path and the monitoring results of the direct control path, the internal information of the sensing management module 30 or the execution management module 40, and the peripheral processing module 20, the internal information of the peripheral processing module 20 of the secondary control channel is uploaded to the central processing module 10.
  • the central processing module 10 can intervene in the processing process of the direct control path and/or the secondary control path through the third-level control path.
  • the internal information of the peripheral processing module 20 includes the working status of the peripheral processing module 20 (whether it is normal, which algorithm is being executed) and what emergency measures have been taken. Process and other related information.
  • the central processing module 10 is provided with a third preset condition set and a third preset processing process set.
  • the central processing module 10 monitors at least one piece of information, it includes the output information processed by the sensor management module 30 or the execution management module 40 on the signal of the controlled element, the sensor management module 30 or the monitoring results of the controlled components by the execution management module 40, the internal information of the sensing management module 30 or the execution management module 40, the monitoring results of the peripheral processing module 20, the internal information of the peripheral processing module 20, the central
  • the central processing module 10 executes the third preset processing process.
  • the central processing module 10 can issue a three-level control instruction to the subordinate peripheral processing module 20 or the next-level execution management module 40 or the sensor management module 30. Control, interfere with the processing of direct control pathways and/or secondary control pathways.
  • the peripheral processing module 20 can process the output information and monitoring results and other information processed by several direct control channels, and then comprehensively determine whether the second preset condition is met.
  • the central processing module 10 can process several received information, such as the output information processed by the direct control path and the monitoring results of the direct control path, as well as the peripheral processing After processing the monitoring results of the module 20 and the information of the secondary control channel, it is comprehensively determined whether the third preset condition is met.
  • the three-level control instructions issued by the central processing module 10 can focus on macroscopic operations such as joints.
  • the target can be a specific joint
  • the corresponding instructions are internal rotation, external rotation, etc.
  • the corresponding parameters are joint angles, Joint angular velocity, joint angular acceleration, joint torque, etc.
  • the secondary control instructions issued by the peripheral processing module 20 can target a specific actuator 50 , and the corresponding instructions are the start and stop of the actuator 50 , and the steering around the actuator 50 (such as a motor). , rotation speed, torque, the corresponding parameters are the rotation angle, rotation speed, torque, etc. of the actuator 50 (such as the motor).
  • the instructions of the direct control path to execute the first preset processing process, the second-level control instructions, and the third-level control instructions each have an importance coefficient.
  • the instruction with the largest importance coefficient is executed. This importance factor can be specified by the user.
  • the sensing management module is integrated in the peripheral processing module, and/or the execution management module is integrated in the peripheral processing module.
  • the sensing management module is integrated in the peripheral processing module, and/or the execution management module is integrated in the peripheral processing module.
  • the sensor management module 30 can be merged into Peripheral processing module 20 or execution management module 40.
  • the execution management module 40 can be merged into the peripheral processing module 20 .
  • the corresponding sensing management module 30 and execution management Module 40 may be incorporated into peripheral processing module 20 .
  • the central processing module 10 has an algorithm or program based on brain neural circuits.
  • the central processing module 10 is equipped with a brain-like computing platform 11, which runs and accelerates the brain-like neural network, runs algorithms or programs that draw on brain neural circuits, and realizes autonomous control of the robot.
  • the network can draw lessons from the visual cortex, middle temporal lobe, prefrontal lobe, motor cortex, basal ganglia, cerebellum and other brain neural circuits to form a perception module, memory module, decision-making module, movement planning module, movement execution module, and movement coordination module. multiple modules within.
  • the solutions recorded in related patents such as application number 201910738132.7, application number 202010424999.8, and application number 202010425110.8 realize autonomous control of robots by drawing on algorithms or programs of brain neural circuits.
  • the central processing module 10 can be provided with a program module 12.
  • the program module 12 is equipped with a user-specified program/script to guide the robot operation and is used to realize robot program control. This script can specify the motion trajectory of each joint of the robot, as well as the priority of various instructions, the initial value of the importance coefficient, and various necessary preset values required for system operation.
  • the central processing module 10 can also be connected to a motion capture device 70.
  • the motion capture device 70 includes a motion capture module 71 (which can be a motion capture glove, a whole body motion capture device, or an optical motion capture device). It converts the user's movements into input signals and provides them to the system to realize robot remote control.
  • the motion capture device 70 may also be connected at the peripheral processing module 20 .
  • robot autonomous control In practical applications, robot autonomous control, robot program control, and robot remote control are generally used in a mixed manner.
  • the motion capture device 70 can also be equipped with a feedback module 72.
  • the corresponding central processing module 10 or peripheral processing module 20 outputs feedback information to the motion capture device 70, and the feedback module 72 transmits the information to user.
  • the feedback module 72 may be force feedback or vibration feedback, allowing the user of the motion capture device 70 to experience environmental feedback such as a sense of force, resistance, object shape and texture. This method is called remote control, remote operation, or virtual operation, and the central processing module 10 does not need to actually execute it.
  • the central processing module 10 is also connected with an input module and an output module.
  • an image input module 81 such as a monocular/binocular camera and a sound input module 82 can be connected to the central processing module 10 to realize visual and auditory perception.
  • This method is suitable for fully autonomous control of the robot.
  • the image input module 81 and the sound input module 82 can be directly installed on the central processing module 10 , or can be used as peripheral devices to communicate with the central processing module 10 .
  • the central processing module 10 can also be equipped with general I/O devices, such as keyboards, monitors, etc.
  • the central processing module 10 and/or the peripheral processing module 20 are also connected to the emergency braking device 13 .
  • the central processing module 10 is implemented through one or more of software, firmware, hardware, and reconfigurable devices.
  • the central processing module 10 may be composed of a computer or a server cluster, or may be composed of one or more of a single board computer, a single chip microcomputer, and an embedded device.
  • the central processing module 10 is configured as a computer with strong core computing resources such as CPU, GPU, and TPU.
  • the peripheral processing module 20 is implemented through one or more of software, firmware, hardware, and reconfigurable devices.
  • the peripheral processing module 20 may be composed of one or more single board computers, microcontrollers, and embedded circuits.
  • Reconfigurable devices are devices based on reconfigurable hardware that reconstruct internal logic through software at runtime.
  • the central processing module 10 communicates with the peripheral processing module 20 through one or more of Ethernet, WiFi, Bluetooth, 5G, 4G, USB, serial bus, industrial bus, and industrial Internet.
  • the central processing module 10 can communicate with the peripheral processing module 20 in full-duplex, and the preferred full-duplex communication between the two is Ethernet or industrial Internet.
  • the peripheral processing module 20 communicates with the execution management module 40 through one or more of Ethernet, WiFi, Bluetooth, USB, serial bus, and industrial bus.
  • the communication between the central processing module and the peripheral processing module is the first-level communication, which revolves around macro operations such as joints.
  • the target can be a specific joint, the corresponding instructions are internal rotation, external rotation, etc., and the corresponding parameters are joint angle, Joint angular velocity, joint angular acceleration, joint torque, etc.
  • the communication between the peripheral processing module and the execution management module is the second-level communication.
  • the target can be a specific execution element, and the corresponding instructions are the start and stop of the execution element, and the steering, speed, and speed of the execution element (such as a motor). Torque, the corresponding parameters are the rotation angle of the actuator (such as motor), motor speed, motor torque, etc.
  • Both first-level and second-level communications are two-way communications.
  • the data packet (payload) format includes instructions; the data packet format can also include targets and/or parameters.
  • the data packet (payload) format may include three parts: target, instruction, and parameter.
  • the payload format includes instructions; the data packet format can also include targets and/or parameters.
  • the data packet (payload) format may include three parts: target, instruction, and parameter.
  • first-level communication and second-level communication each have one or more layers of protocols; for example, in first-level communication, if Ethernet communication is used, the protocol stack can include the physical layer, link layer, IP, TCP and other levels, and its upper-layer protocol is the application layer; for another example, in the second-level communication, the chip's own communication management function includes lower-layer protocols (SPI, CAN), and its upper-layer protocol consists of data packets (payload).
  • SPI lower-layer protocols
  • CAN upper-layer protocol
  • the control allows skipping, that is, the central processing module 10 can directly control the actuator 50, so that the control algorithm is flexible to implement and easy to debug.
  • the data packet (payload) in the upper layer protocol of the first-level communication can target a specific joint, the corresponding instructions are internal rotation, external rotation, etc., and the corresponding parameters are joint angle, joint angular velocity, joint Angular acceleration, joint torque, etc.; it can also be a specific actuator, the corresponding instructions are the start and stop of the actuator, the steering, speed, and torque surrounding the actuator (such as a motor), and the corresponding parameters are the actuator (such as a motor) Rotation angle, motor speed, motor torque, etc.
  • the corresponding parameters are actual information obtained by the sensing element 60, so the data packet (payload) can have default instructions.
  • the subordinates should be able to pass all kinds of signals to the superiors as much as possible, and the superiors will decide how to handle them. Therefore, the protocol should include bottom-up fault codes and top-down backup command codes for troubleshooting. It can be implemented flexibly by using the instructions and parameters in the data packet (payload).
  • the peripheral processing module 20 is configured as an embedded circuit based on the reconfigurable unit 22 and the communication management unit 21;
  • the reconfigurable unit 22 can be configured as an FPGA, and the communication management unit 21 includes an ARM.
  • the FPGA of the reconfigurable unit 22 and the ARM of the communication management unit 21 may be independent chips, or may be bound to the same chip, or ARM firmware may be embedded in the FPGA.
  • FPGA and ARM are bound in the same chip to increase the communication bandwidth between them.
  • the communication management unit 21 is configured to be responsible for communicating with the central processing module 10; preferably, The communication management unit 21 can communicate with the central processing module 10 in full duplex.
  • the central processing module 10 sends the first message to the communication management unit 21 .
  • the communication management unit 21 decodes the first message to obtain a second message, and transmits the second message to the reconfigurable unit 22 . If the first message is encrypted, the communication management unit 21 is also responsible for decryption.
  • the reconfigurable unit 22 includes at least one sensing management driver component and at least one execution management driver component.
  • the sensor management driver component is used to drive the sensor management module 40 under the jurisdiction of the peripheral processing module where it is located, and the execution management driver component is used to drive the execution management module 30 under the jurisdiction of the peripheral processing module 20 where it is located.
  • the peripheral processing module 20 includes a recurrent neural network (RNN), and an algorithm or program that simulates the spinal cord neural circuit through the recurrent neural network (RNN).
  • RNN recurrent neural network
  • RNN encodes motion trajectories through the connection relationships and weights between neurons.
  • the recurrent neural network (RNN) can be embedded in the FPGA, and the neural network components including the recurrent neural network (RNN) are independent of other components of the FPGA.
  • the neural network component communicates one-way or two-way with the execution management drive component 30 and the sensor management drive component 40 at the same time, that is, it receives sensor information and sends out execution signals.
  • reconfigurable unit 22 may also be configured as reconfigurable hardware.
  • Reconfigurable hardware refers to hardware devices whose hardware circuits and functions can be reconstructed according to software at runtime.
  • the ARM of the communication management unit 21 can also be replaced by a DSP circuit/chip, which can achieve the same function.
  • the former is more flexible and can support any communication protocol stack; the latter is simple, reliable and cheap.
  • the advantage of using FPGA for the peripheral processing module 20 is that the various components it carries can be executed in parallel, which is especially suitable for solving the situation of multiple sensing elements, multiple execution elements, and multiple control targets, and can respond at high speed and in real time.
  • the advantage of using ARM or DSP for communication management is its high efficiency in encoding and decoding, software (compared to Based on the firmware), communication protocols and routing rules can be implemented and upgraded more flexibly, and development is convenient.
  • ARM can be used to carry embedded systems and better support WiFi/Ethernet protocol stacks.
  • the management unit 31 is configured as a single-chip computer or a CPLD.
  • the I/O pins of the FPGA are not enough, the I/O can be expanded at a lower cost to connect more motor driver chips and analog-to-digital converters (ADCs).
  • ADCs analog-to-digital converters
  • the management unit 31 is configured as a CPLD, the CPLD and FPGA can be integrated on one circuit as a peripheral processing module to reduce the communication cost between the execution management module 30 and the peripheral processing module 20. This is considered Electromagnetic compatibility and signal integrity; among them, CPLD also serves as the management unit and communicates with each drive unit.
  • the management unit 31 communicates with each driving unit 32 through a bus, and the bus adopts one or more of CAN, I2C, and SPI.
  • Communication between any two levels can be encrypted to prevent the device from being hi-jacked.
  • each module can be powered on and off respectively in a certain order to avoid malfunctions.
  • the multi-level control system of the present application has a power storage device (such as a capacitor or battery) as a backup power supply.
  • a power storage device such as a capacitor or battery
  • the main power supply can provide temporary power supply to ensure that the action of the actuator 50 can be completed. , or put the robot's movement into a safe state.
  • the robot multi-level control system also includes a protective shell, which has an explosion-proof structure, an anti-electromagnetic radiation structure (for example, using a metal shielding net), a waterproof structure, and a dust-proof structure (for example, using a sealing ring to achieve One or more of the following: waterproof, dustproof and explosion-proof), shock-proof structure (such as installing rubber buffer pads at the connection points between circuits and other structures). Used to achieve explosion-proof, anti-electromagnetic radiation, waterproof, anti- dustproof, shockproof and other functions.

Abstract

Système de commande à niveaux multiples pour robot comprenant : un module de traitement central (10), un ou plusieurs modules de traitement périphériques (20), un ou plusieurs modules de gestion de détection (30) et un ou plusieurs modules de gestion d'exécution (40). Le module de traitement central communique avec les modules de traitement périphériques et commande les modules de traitement périphériques. Les modules de traitement périphériques communiquent avec les modules de gestion de détection et commandent les modules de gestion de détection. Les modules de traitement périphériques communiquent avec les modules de gestion d'exécution et commandent les modules de gestion d'exécution. Les vitesses de réponse d'urgence des modules de gestion de détection, de gestion d'exécution, de traitement périphériques et de traitement central diminuent progressivement, les capacités de traitement de fonctionnement sont progressivement améliorées et une coopération et une division raisonnables du travail peuvent être effectuées parmi ces modules. Pour une situation nécessitant une rétroaction rapide et une génération de réponse, la situation peut être traitée par les modules de gestion de détection, de gestion d'exécution ou de traitement périphériques et, pour une situation complexe selon laquelle une grande quantité d'informations doit être traitée de manière complète, un traitement centralisé peut être effectué par le module de traitement central et, ainsi, la vitesse de réponse du système de commande à niveaux multiples est rapide.
PCT/CN2023/111712 2022-08-09 2023-08-08 Système de commande à niveaux multiples pour robot WO2024032601A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210948344.XA CN117621030A (zh) 2022-08-09 2022-08-09 机器人多级控制系统
CN202210948344.X 2022-08-09

Publications (1)

Publication Number Publication Date
WO2024032601A1 true WO2024032601A1 (fr) 2024-02-15

Family

ID=89850905

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/111712 WO2024032601A1 (fr) 2022-08-09 2023-08-08 Système de commande à niveaux multiples pour robot

Country Status (2)

Country Link
CN (1) CN117621030A (fr)
WO (1) WO2024032601A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040168837A1 (en) * 2002-11-27 2004-09-02 Universite De Sherbrooke Modular robotic platform
CN102637036A (zh) * 2012-05-08 2012-08-15 北京理工大学 一种复合式仿生四足机器人控制器
CN108297098A (zh) * 2018-01-23 2018-07-20 上海大学 人工智能驱动的机器人控制系统及方法
CN109249395A (zh) * 2018-10-18 2019-01-22 清华大学深圳研究生院 一种多功能多足机器人控制系统
CN110842952A (zh) * 2019-12-02 2020-02-28 深圳忆海原识科技有限公司 基于多传感器的灵巧手拮抗式控制系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040168837A1 (en) * 2002-11-27 2004-09-02 Universite De Sherbrooke Modular robotic platform
CN102637036A (zh) * 2012-05-08 2012-08-15 北京理工大学 一种复合式仿生四足机器人控制器
CN108297098A (zh) * 2018-01-23 2018-07-20 上海大学 人工智能驱动的机器人控制系统及方法
CN109249395A (zh) * 2018-10-18 2019-01-22 清华大学深圳研究生院 一种多功能多足机器人控制系统
CN110842952A (zh) * 2019-12-02 2020-02-28 深圳忆海原识科技有限公司 基于多传感器的灵巧手拮抗式控制系统

Also Published As

Publication number Publication date
CN117621030A (zh) 2024-03-01

Similar Documents

Publication Publication Date Title
US20110071672A1 (en) Framework and method for controlling a robotic system using a distributed computer network
US8369992B2 (en) Embedded diagnostic, prognostic, and health management system and method for a humanoid robot
US8868234B2 (en) Communication system and method
CN106375421A (zh) 基于远程操控的机器人辅助智能维护系统
US8442684B2 (en) Integrated high-speed torque control system for a robotic joint
JP2008543578A (ja) 拡張可能な動作制御システム
KR20140038329A (ko) 로봇 구조물 상에 분포된 전자 구동 장치를 갖는 산업용 로봇
Lentini et al. Alter-ego: a mobile robot with a functionally anthropomorphic upper body designed for physical interaction
CN105116833A (zh) 一种基于双机冗余策略的超高压电源测控系统及方法
CN114153166A (zh) 一种基于模块化应用的集成飞行器系统
WO2024032601A1 (fr) Système de commande à niveaux multiples pour robot
WO2003103903A1 (fr) Systeme de commande et procede de commande d'un ou de plusieurs manipulateurs
Leu et al. CORBYS cognitive control architecture for robotic follower
JP4480010B2 (ja) 分散制御システム
JP2729758B2 (ja) 遠隔操作型ロボットの自動実行監視方式
Aldridge et al. Control architecture for the robonaut space humanoid
CN112792812A (zh) 机器人控制装置及机器人系统
Catanoso et al. Rapid lightweight firmware architecture of the mobile metamaterial internal co-integrator robot
WO2007107277A1 (fr) Manipulateur, par exemple un robot industriel, et dispositif d'entrainement pour un manipulateur
Yin et al. Robot communication system based on OIO middleware
Vasalya et al. Smart telerobotic surveillance system via internet with reduced time delay
Fargier et al. JACOW: Operational Controls for Robots Integrated in Accelerator Complexes
WO2024032578A1 (fr) Module de commande, appareil de commande et robot
CN111061203A (zh) 机器人的实时控制系统及机器人
CN203217357U (zh) 一种控制模块及巡线机器人

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23851822

Country of ref document: EP

Kind code of ref document: A1