WO2021227900A1 - 机器人助理 - Google Patents
机器人助理 Download PDFInfo
- Publication number
- WO2021227900A1 WO2021227900A1 PCT/CN2021/091582 CN2021091582W WO2021227900A1 WO 2021227900 A1 WO2021227900 A1 WO 2021227900A1 CN 2021091582 W CN2021091582 W CN 2021091582W WO 2021227900 A1 WO2021227900 A1 WO 2021227900A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- arm
- lifting mechanism
- foldable arm
- drawer
- robot
- Prior art date
Links
- 230000007246 mechanism Effects 0.000 claims abstract description 211
- 230000033001 locomotion Effects 0.000 claims abstract description 127
- 230000004044 response Effects 0.000 claims abstract description 21
- 210000003811 finger Anatomy 0.000 description 82
- 238000000034 method Methods 0.000 description 45
- 230000008569 process Effects 0.000 description 21
- 238000010586 diagram Methods 0.000 description 20
- 210000002435 tendon Anatomy 0.000 description 16
- 239000000725 suspension Substances 0.000 description 15
- 230000005540 biological transmission Effects 0.000 description 11
- 210000003813 thumb Anatomy 0.000 description 11
- 238000003032 molecular docking Methods 0.000 description 9
- 238000013439 planning Methods 0.000 description 9
- 230000036544 posture Effects 0.000 description 9
- 230000000007 visual effect Effects 0.000 description 9
- 238000001514 detection method Methods 0.000 description 8
- 230000004438 eyesight Effects 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000013461 design Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 239000011159 matrix material Substances 0.000 description 6
- 239000002245 particle Substances 0.000 description 6
- 239000006096 absorbing agent Substances 0.000 description 5
- 238000007599 discharging Methods 0.000 description 5
- 239000003814 drug Substances 0.000 description 5
- 238000007726 management method Methods 0.000 description 5
- 230000035939 shock Effects 0.000 description 5
- 239000012636 effector Substances 0.000 description 4
- 230000003044 adaptive effect Effects 0.000 description 3
- 238000013016 damping Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 239000013013 elastic material Substances 0.000 description 3
- 230000001815 facial effect Effects 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 239000002184 metal Substances 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 239000004033 plastic Substances 0.000 description 3
- 238000010248 power generation Methods 0.000 description 3
- 125000006850 spacer group Chemical group 0.000 description 3
- 238000012384 transportation and delivery Methods 0.000 description 3
- 241000282412 Homo Species 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 2
- 238000005452 bending Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000006073 displacement reaction Methods 0.000 description 2
- 229940079593 drug Drugs 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 239000004417 polycarbonate Substances 0.000 description 2
- 229920000515 polycarbonate Polymers 0.000 description 2
- 239000000955 prescription drug Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000001681 protective effect Effects 0.000 description 2
- 230000003252 repetitive effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000005355 Hall effect Effects 0.000 description 1
- 235000004443 Ricinus communis Nutrition 0.000 description 1
- 240000000528 Ricinus communis Species 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000004308 accommodation Effects 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000005669 field effect Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- -1 gloves Substances 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000012913 prioritisation Methods 0.000 description 1
- 238000010845 search algorithm Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000002366 time-of-flight method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0268—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
- G05D1/0274—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means using mapping information stored in a memory device
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
- B25J11/008—Manipulators for service tasks
- B25J11/009—Nursing, e.g. carrying sick persons, pushing wheelchairs, distributing drugs
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
- B25J19/0075—Means for protecting the manipulator from its environment or vice versa
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
- B25J19/02—Sensing devices
- B25J19/021—Optical sensing devices
- B25J19/023—Optical sensing devices including video camera means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J5/00—Manipulators mounted on wheels or on carriages
- B25J5/007—Manipulators mounted on wheels or on carriages mounted on wheels
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/0009—Constructional details, e.g. manipulator supports, bases
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/10—Programme-controlled manipulators characterised by positioning means for manipulator elements
- B25J9/106—Programme-controlled manipulators characterised by positioning means for manipulator elements with articulated links
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/10—Programme-controlled manipulators characterised by positioning means for manipulator elements
- B25J9/12—Programme-controlled manipulators characterised by positioning means for manipulator elements electric
- B25J9/123—Linear actuators
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1615—Programme controls characterised by special kind of manipulator, e.g. planar, scara, gantry, cantilever, space, closed chain, passive/active joints and tendon driven manipulators
- B25J9/162—Mobile manipulator, movable base with manipulator arm mounted on it
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
- B25J9/1697—Vision controlled systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
- B65G1/02—Storage devices
- B65G1/026—Racks equipped with a displaceable load carrying surface to facilitate loading or unloading
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G61/00—Use of pick-up or transfer devices or of manipulators for stacking or de-stacking articles not otherwise provided for
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/0011—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot associated with a remote control arrangement
- G05D1/0016—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot associated with a remote control arrangement characterised by the operator's input device
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
- G05D1/0217—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory in accordance with energy consumption, time reduction or distance reduction criteria
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0242—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using non-visible light signals, e.g. IR or UV signals
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0268—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means
- G05D1/027—Control of position or course in two dimensions specially adapted to land vehicles using internal positioning means comprising intertial navigation means, e.g. azimuth detector
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0212—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory
- G05D1/0214—Control of position or course in two dimensions specially adapted to land vehicles with means for defining a desired trajectory in accordance with safety or protection criteria, e.g. avoiding hazardous areas
Definitions
- the present invention relates generally to robots, and in particular to intelligent logistics robot assistants that can perform delivery, tracking, and other tasks.
- robotic assistant can be designed to assist humans in performing tasks, such as performing logistics and transportation tasks.
- robot assistants especially those used in healthcare industries such as hospitals, usually include wheels for moving and fixed storage containers/trays. This allows the robot assistants to combine information such as medicines, equipment, and food.
- the objects of the class are delivered to the desired location.
- the non-modular design of robot assistants means that they can only perform one task and cannot provide end-to-end logistics services (for example, collection, storage, navigation, distribution, etc.) for healthcare facilities such as elderly care facilities or hospitals. ).
- the non-modular design of the robot assistant does not allow slight modifications to the platform for different business application scenarios.
- the purpose of the present invention is to provide a robot assistant, which aims to solve the above-mentioned existing problems.
- a robot assistant includes: a wheeled base; a storage unit including one or more drawers; a foldable arm including an arm end tool connected to the distal end of the foldable arm, so The foldable arm is connected to the top of the storage unit; a lifting mechanism positioned on a wheeled base, the lifting mechanism being configured to move the storage unit up and down; and a control system that receives a command instruction, in response to the command Instructions, the control system is configured to move the wheeled base, open or close the one or more drawers, drive the movement of the foldable arm and the end-of-arm tool to pick up and place external objects from a determined position The object arrives at a certain position, and the storage unit is controlled to drive the one or more drawers.
- the lifting mechanism includes an actuator and a lifting mechanism, the lifting mechanism is connected to the storage unit and the wheel base, and the actuator is fixed to the wheel base and configured to drive the lifting mechanism to Extend or retract in the vertical direction.
- the storage unit includes a housing and one or more driving devices, and the one or more driving devices are configured to drive the one or more drawers to slide relative to the housing to an open position and a closed position .
- the robot assistant further includes a camera configured to detect an object, and the control system indicates that the foldable arm is in a certain state through the connection of one or more of the N rotary joints and the N linkages.
- the direction and/or position of the camera and instruct the end-of-arm tool to pick up external objects from the one or more drawers and place external objects to the one or more drawers based on the command instructions based on the output from the camera middle.
- the camera is located on the foldable arm and close to the end-of-arm tool, or located on/in the end-of-arm tool.
- the robot assistant also includes an arm guard for protecting the foldable arm, and the arm guard is fixed or retractable.
- the actuator is a linear actuator configured to apply a pushing force or a pulling force to the lifting mechanism to drive the lifting mechanism to extend or retract in a vertical direction.
- the robot assistant further includes a plurality of actuating feet connected to the wheeled base, and the control system instructs the actuating feet to move down to make contact with a surface.
- the foldable arm is configured to be folded on the top of the storage unit in a substantially flat state.
- the present invention also provides a robot assistant including: a wheeled base; a drawer mechanism including one or more drawers; a foldable arm connected to the top of the drawer mechanism, the foldable arm including an arm end tool, responsive According to the command instruction, the arm end tool is configured to pick up external objects from a certain position and place the external objects to a certain position through the drive of the foldable arm; and a lifting mechanism positioned on the wheel base , The lifting mechanism is configured to move the one or more drawers up and down.
- the determined position is a position in the one or more drawers after being fully opened.
- the lifting mechanism includes an actuator and a lifting mechanism, the lifting mechanism is connected to the drawer mechanism and the wheel base, the actuator is fixed to the wheel base, and is configured to drive the The lifting mechanism extends or retracts in the vertical direction.
- the drawer mechanism includes a housing and one or more driving devices configured to drive one or more drawers to slide relative to the housing to an open position and a closed position.
- the robot assistant also includes a camera configured to detect an object, and a control system indicates that the foldable arm is in a certain state through the connection of one or more of the N rotary joints and the N linkages.
- a control system indicates that the foldable arm is in a certain state through the connection of one or more of the N rotary joints and the N linkages.
- the camera is located on the foldable arm and close to the end-of-arm tool, or located on/in the end-of-arm tool.
- the foldable arm is configured to be folded in a substantially flat state on the top of the drawer mechanism.
- the present invention also provides a robot assistant, which includes: a wheeled base; a storage unit; a foldable arm, which includes an arm end tool connected to the distal end of the foldable arm, the foldable arm is connected to the On the top of the storage unit, the arm end tool is configured to pick up external objects from a certain position and place the external objects to a certain position through the drive of the foldable arm; and a lift positioned on the wheeled base
- the lifting mechanism is configured to move the one or more drawers up and down.
- the lifting mechanism includes an actuator and a lifting mechanism, the lifting mechanism is connected to the lifting mechanism and the wheel base, the actuator is fixed to the wheel base, and is configured to drive the The lifting mechanism extends or retracts in the vertical direction.
- the robot assistant of the present invention includes a foldable arm and a lifting mechanism.
- the foldable arm and the lifting mechanism enable the robot assistant to have a mechanism that extends the reach, and the mechanism that extends the reach Extends beyond the basic physical footprint of the robot assistant.
- Robot assistants can be autonomous robots with capabilities including precise positioning, motion planning, and trajectory tracking. They can implement intelligent logistics and provide unsupervised end-to-end logistics solutions.
- Figure 1A is an isometric view of a robotic assistant according to one embodiment.
- Figure 1B is an isometric view of a robotic assistant according to another embodiment.
- Fig. 2 is a plan view of the robot assistant of Fig. 1A.
- Fig. 3 is an isometric view of the robot assistant of Fig. 1A in an elevated state.
- Fig. 4 is an isometric view of the wheeled base of the robotic assistant of Fig. 1A.
- Fig. 5 is a semi-exploded view of the wheel base of Fig. 4 viewed from a different angle.
- Fig. 6 is an isometric view of the wheel base driving wheel mechanism of Fig. 4.
- Figure 7 is an isometric view of the wheel base caster of Figure 4.
- Figure 8A is a plan view of the wheel base of Figure 4 with the actuating foot in its retracted position.
- Fig. 8B is a plan view of the wheel base of Fig. 4 with the actuating foot in its extended position.
- FIG. 9 shows a comparison of the reachability of the foldable arm of the robot assistant with and without the actuation foot in FIG. 4.
- Fig. 10A shows a schematic diagram of a wheeled base including a driving wheel mechanism and casters according to an embodiment.
- Figure 10B shows a schematic diagram of an alternative wheeled base including two drive wheel mechanisms and four casters according to one embodiment.
- Figure 11 is an isometric view of the drawer mechanism of the robotic assistant according to one embodiment.
- Fig. 12 is an isometric view of the drawer mechanism of the robot assistant viewed from a different angle according to another embodiment.
- Fig. 13 is an isometric exploded view of the foldable arm of the robotic assistant of Fig. 1B according to one embodiment.
- Fig. 14A is an isometric view of the foldable arm of Fig. 13 in an original flat state according to an embodiment, the foldable arm has an end-of-arm tool (EOAT) or an EOAT manipulator.
- EOAT end-of-arm tool
- FIG. 14B is an isometric view of the foldable arm with the EOAT of FIG. 13 in an original flat state according to another embodiment.
- Fig. 14C is an isometric view of the foldable arm in Fig. 14B in an intermediate state.
- Fig. 14D is an isometric view of the foldable arm of Fig. 14B in a final state when grasping an object.
- Figure 15A is an isometric view of another embodiment of the EOAT of the robotic assistant according to one embodiment.
- Figure 15B is an isometric exploded view of the EOAT of Figure 15A.
- Figure 15C is an isometric view of the EOAT of Figure 15A.
- Figure 16A is an isometric view of another EOAT of the robotic assistant according to one embodiment.
- Figure 16B is an isometric view of the EOAT of Figure 16A.
- Figure 16C is an isometric view of the EOAT of Figure 16A.
- Figure 17A is an isometric view of another embodiment of the EOAT of the robotic assistant according to one embodiment.
- Figure 17B is an isometric exploded view of the EOAT of Figure 17A.
- Figure 17C is an isometric view of the EOAT of Figure 17A.
- Figure 17D is an isometric view of another embodiment of the EOAT of the robotic assistant according to one embodiment.
- Figure 18A is an isometric view of another embodiment of the EOAT of the robotic assistant according to one embodiment.
- Figure 18B is an isometric exploded view of the EOAT of Figure 18A.
- Figure 18C is an isometric exploded view of the EOAT of Figure 18A viewed from a different angle.
- Figure 19A is an isometric view of another embodiment of the EOAT of the robot assistant according to one embodiment.
- Figure 19B is an isometric exploded view of the EOAT of Figure 19A.
- Figure 20 is an isometric exploded view of the vacuum module EOAT of the robotic assistant according to one embodiment.
- FIG. 21A shows a camera mounted on the EOAT of the foldable arm of FIG. 13.
- Figure 21B is similar to Figure 20A and shows the EOAT mounted on the camera and rotated to a different direction.
- Figure 21C shows a camera connected to the foldable arm of Figure 13 close to the EOAT of the robotic assistant.
- Figure 21D shows the camera connected to the EOAT of the robot assistant.
- Figure 22 is an isometric view of the lifting mechanism of the robotic assistant.
- Fig. 23 is an isometric view of the lifting mechanism of Fig. 22 viewed from a different angle, with the top plate separated.
- Fig. 24 shows a plan view of the lifting mechanism of the drawer mechanism of Fig. 22.
- FIG. 25 is a schematic diagram showing that the robot assistant avoids obstacles while moving along the planned path.
- Fig. 26 is a schematic diagram showing that the robot assistant picks up a certain object from the storage rack.
- Fig. 27 is a schematic block diagram of a robot assistant according to an embodiment.
- Fig. 28 is a schematic block diagram of the base control subsystem of the robot assistant according to an embodiment.
- Fig. 29 is a schematic block diagram of a body control subsystem of a robot assistant according to an embodiment.
- Fig. 30 is a schematic block diagram of a sensor subsystem of a robot assistant according to an embodiment.
- Fig. 31 is a schematic block diagram of a battery pack of a robot assistant according to an embodiment.
- Fig. 32 is a schematic block diagram of a power supply system of a robot assistant according to an embodiment.
- Figure 33A is a schematic diagram illustrating a user interface used with a robotic assistant according to one embodiment.
- FIG. 33B is a schematic diagram showing a user interface used with the robot assistant according to one embodiment.
- Figure 33C is a schematic diagram illustrating a user interface used with a robotic assistant according to one embodiment.
- Fig. 34 is a schematic flowchart of a method implemented by a control system of a robot assistant according to an embodiment.
- FIG. 35 is a schematic diagram showing the movement trajectory of a foldable arm according to an embodiment.
- FIG. 36 is a schematic flowchart of a method for controlling a foldable arm and an EOAT of a robot assistant according to an embodiment.
- Fig. 37 is a schematic flowchart of a method for controlling a drawer of a robot assistant.
- Fig. 38 is a schematic flowchart of a robot assistant navigation method according to an embodiment.
- Fig. 39 is a schematic flowchart of a method for determining parameters of a foldable arm.
- FIG. 40A is a schematic diagram showing the structure and boundaries of a foldable arm.
- FIG. 40B is a plan view showing a schematic diagram of the configuration of the foldable arm.
- FIG. 40C is a schematic diagram showing the configuration of a foldable arm.
- Figure 40D is a schematic diagram showing the order in which the accessibility of the points in the drawer is determined.
- 41A and 41B are schematic diagrams showing the reachable working space of the foldable arm in/on the shelf when the lifting mechanism is at different heights.
- first and second are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined with “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the present invention, “plurality” means two or more than two, unless otherwise specifically defined.
- the terms “installed”, “connected”, “connected”, “fixed” and other terms should be understood in a broad sense, for example, it can be a fixed connection or a detachable connection. , Or integrated; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal communication of two components or the interaction relationship between two components.
- installed can be a fixed connection or a detachable connection. , Or integrated; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal communication of two components or the interaction relationship between two components.
- the robot assistant 100 uses a lifting mechanism and an extended reach mechanism to assist humans in performing tasks such as logistics and transportation tasks.
- the robot assistant 100 may be used in places such as healthcare facilities, elderly care facilities, etc., to help healthcare professionals perform their daily tasks.
- the robot assistant 100 can also be used in security/surveillance scenarios.
- the robot assistant 100 can be used in assisted living places or health care places to provide unsupervised end-to-end logistics solutions to meet all kinds of timely delivery and logistics from food to medicine. need.
- the robotic assistant 100 can free healthcare providers from time-consuming tasks and other trivial and repetitive tasks, including acquiring and delivering objects together, so that they can focus on satisfying the more important needs of the assisted person or other people. Physical and emotional needs.
- the robot assistant 100 may be used in other places, such as warehouses, packaging places, schools, restaurants, and so on.
- the robot assistant 100 includes a wheeled base 10, a storage unit (for example, a drawer mechanism 20 including one or more drawers 21), a foldable arm 30 connected to the top of the drawer mechanism 20, and a lifting mechanism 40.
- Sensors 62, 63, 63, 64, and 65, and a control system 70 that receives commands from the host computer, and a graphical user interface (GUI) displayed on the display 82.
- GUI graphical user interface
- the graphical user interface allows the operator to directly control the robot assistant.
- the control system 70 controls the movement of the wheel base 10, the foldable arm 30 and the lifting mechanism 40, and/or other mechanical or software aspects of the robot assistant 100.
- the storage unit may include an open shelf.
- the foldable arm 30 may be omitted or replaced by a differently configured manipulator with different degrees of freedom.
- the wheel base 10 provides a moving mechanism for the robot assistant 100 to move from one position to another.
- the wheel base 10 includes two differential drive wheel mechanisms 11 and one or more other wheels.
- the driving wheel mechanism 11 allows the wheel base 10 to move along a determined path, and one or more other wheels realize the balance and stability of the wheel base 10.
- the suspension system of the wheel base 10 enables smoother travel through smaller gaps, carpets, mats, and floor defects.
- the use of the wheeled base 10 allows the robot assistant 100 to pass through various floors of the assisted living place by entering and exiting the elevator.
- the one or more other wheels may be casters or omnidirectional drive wheels. A further description of the wheel base 10 is provided below.
- the storage unit includes a drawer mechanism 20 which is a platform for one or more drawers 21. Driven by the drawer mechanism 20, the drawer 21 can be in an open state and a closed state. In one embodiment, prescription drugs, needles, and surgical equipment may be stored in the drawer 21.
- One or more drawers 21 can be stacked on top of each other in the vertical direction (for example, along the y-axis shown in FIG. 1) to save valuable space and/or in the horizontal direction (for example, along the x-axis shown in FIG. 3) Stacked on top of each other. Each drawer 21 can be opened individually or in combination.
- the drawer 21 can be locked and can only be unlocked and opened by an authorized healthcare professional, and/or when the robot assistant 100 delivers one or more items to a designated location by an authorized person Unlock and open.
- the number and structure of the drawers 21 are not limited and can be changed according to actual needs.
- the drawer 21 may be in the form of an open shelf.
- food items such as plates, trays, and cups
- Open shelves can be stacked vertically and/or horizontally.
- the drawer 21 may be in the form of a closed or semi-closed housing having depth, height, length, and width.
- the foldable arm 30 is connected to the top of the drawer mechanism 20, and includes an end of arm tooling (EOAT) 50 or a robotic gripper (EOAT) at the distal end of the foldable arm 30.
- EOAT end of arm tooling
- EOAT robotic gripper
- the foldable arm 30 can be extended to the open position or the folded position. In the folded position, the foldable arm 30 may be driven to fold on the top of the drawer mechanism 20 in a flat state or a substantially flat state.
- a visor or protective cover which can be made of transparent or translucent plastic/polycarbonate or any other material, can be used to cover and/or protect the arm 30.
- the shield/shield can be automatically retracted to increase the working space of the foldable arm 30.
- the foldable arm 30 and the lifting mechanism 40 enable the assistant robot 100 to have a mechanism that extends the reach, which extends beyond the basic physical footprint of the assistant robot 100.
- the EOAT50 is provided at the distal end of the foldable arm 30, and can hold various objects, such as prescription drugs, gloves, or water bottles.
- the foldable arm 30 and the EOAT 50 can be used to grasp objects on the shelf and place those objects in the drawer 21. Subsequently, the foldable arm 30 and the EOAT 50 are configured to extend into the drawer 21, retrieve the objects, and deliver them to different shelves, tables, or to the hands of healthcare professionals or patients.
- the foldable arm 30 and the EOAT 50 are also configured to place objects in the empty drawer 21 and empty shelf. More details are provided below.
- the EOAT 50 can be similar to a human hand to further personify the robot assistant 100.
- the lifting mechanism 40 is connected between the wheel base 10 and the drawer mechanism 20. Driven by the lifting mechanism 40, the drawer mechanism 20 can move up and down between the retracted position (see FIG. 1A) and the extended position (see FIG. 3). In this retracted position, the lifting mechanism 40 allows the robot assistant 100 to have a limited height, which contributes to stability during the movement and travel of the robot assistant 100. In this extended position, the lifting mechanism 40 allows the foldable arm 30 to have increased accessibility in the vertical direction. The lifting mechanism 40 may be driven to adjust the robotic assistant 100 to a comfortable height for the elderly who may be lying on a bed, sitting in a wheelchair, or standing. A further description of the lifting mechanism 40 is provided below.
- the lifting mechanism 40 allows the base of the foldable arm 30 to be flush with the top edge of the arm guard, so that the foldable arm 30 has the largest working space.
- the arm guard 281 can be fully retracted to create the maximum working space for the foldable arm 30 without adjusting the height of the lifting mechanism 40.
- the sensor enables the robot assistant 100 to perceive the environment so that the robot assistant 100 can perform tasks.
- the sensor includes a ranging sensor, which does not need to be in physical contact with the detected object. They enable the robot assistant 100 to perceive obstacles without actually having to contact the obstacles.
- Ranging sensors may include infrared (IR) sensors 64, ultrasonic sensors 65, one or more light detection and ranging (LiDAR) sensors 63, near field communication (NFC), and RFID sensors/readers.
- the sensor may include an inertial measurement unit (IMU) sensor and a camera 62.
- Each IMU sensor 66 includes at least one accelerometer and at least one gyroscope.
- One or more LiDAR sensors 63 are used to create a map of the environment.
- the LiDAR sensor 63 is used to determine the real-time position of the robot assistant 100 in the environment map.
- the data from the ranging sensor and the camera 62 is used to detect obstacles such as equipment or people during the movement of the robot assistant 100.
- the robot assistant 100 can therefore move autonomously along the determined path.
- These sensors can be positioned along the wheel base 10 or other positions of the robot assistant 100, such as on the foldable arm 30 or the EOAT 50. The sensor will be further explained below.
- the control system 70 is electrically connected to the wheel base 10, the drawer mechanism 20, the foldable arm 30, the lifting mechanism 40, and sensors, and is configured to receive commands to control the robot assistant 100 to perform tasks.
- the command instruction may be received from the control system 70 in response to the movement/action of the robot assistant, or the control system 70 may receive the command instruction from the host computer wirelessly or through a wired connection or through the GUI on the display 82.
- the control system 70 controls the movement of the wheel base 10, opens or closes one or more drawers 21, drives the movement of the foldable arm 30 and the EOAT 50 to pick up and place external objects from a determined position To a certain position, and control the drawer mechanism 20 to drive one or more drawers 21.
- the determined position may be a position in one or more drawers that are fully opened.
- the wheel base 10 is a differential drive platform.
- the wheel base 10 includes two independently driven drive wheel mechanisms 11 and two caster wheel mechanisms 13.
- the two driving wheel mechanisms 11 are spaced apart from each other and are arranged on opposite sides of the wheel base 100, and their rotation axes are aligned with each other and extend in the width direction of the wheel base 10.
- Two caster mechanisms 13 are arranged near opposite ends of the wheel base 10 in the length direction, respectively.
- the number and arrangement of the driving wheel mechanism 11 and the caster mechanism 13 can be changed according to actual needs.
- two drive wheel mechanisms 11 and two caster mechanisms 13 may be arranged at the four corners of the wheel base 10, respectively.
- the two driving wheel mechanisms 11 may be arranged in a manner similar to the one embodiment in FIG. Corner.
- the wheel base 10 includes a base 12 that includes a top part 121 and a bottom part 122 that are spaced apart from each other and connected to each other.
- the top part 121 is in the form of a rectangular frame and includes a plurality of rods connected to each other.
- the bottom member 122 includes a plurality of outer rods 123, two inner rods 124, and four connecting rods 125 connected to each other.
- the two inner rods 124 are accommodated in the space defined by the outer rod 123 and extend along the length direction of the base 12.
- the opposite end of each inner rod 124 is connected to the outer rod 123 at the opposite end of the base body 12, respectively.
- the first pair of connecting rods 125 are connected to an inner rod 124 and an outer rod 123 on one side of the base 12 so as to define a space for accommodating a driving wheel mechanism 11.
- the second pair of connecting rods 125 are connected to another inner rod 124 and an outer rod 123 on opposite sides of the base body 12, and they define a space for accommodating another driving wheel mechanism 11. It should be understood that the connecting rods 125 provide support and placement, and their number can be adjusted according to actual needs.
- one driving wheel mechanism 11 is connected to the first pair of connecting rods 125 and one inner rod 124, and the other driving wheel mechanism 11 is connected to the second pair of connecting rods 125 and the other inner rod 124.
- the caster 13 is connected to the inner rod 124 and is located near the opposite longitudinal end of the base 12.
- each driving wheel mechanism 11 includes a spring and shock absorber suspension mechanism 110, and a wheel 111 connected to the suspension mechanism 110.
- the motor may be arranged in the wheel 111 and configured to drive the wheel 111 to rotate.
- the suspension mechanism 110 gives each wheel 111 the freedom to move slightly up and down relative to the base 12, which can achieve smooth passage through the gap between the floor and the elevator and other small bumps or gaps.
- the suspension mechanism 110 includes: a housing 1102, which is fixed to a pair of connecting rods 125 and an inner rod 124; a fixing member 113, which is fixed to the housing 1102; a slidable member 112; two linear slides
- the bearing 114 realizes the up and down movement of the slidable part 112 relative to the fixed part 113; and a plurality of dampers 115 which are fixed to the fixed part 113.
- the damping performance can be achieved by replacing the driving wheel with a pneumatic tire or adjusting the tire material of the driving wheel.
- the housing 1102 is a structure that accommodates the components of the suspension mechanism 110.
- the fixing member 113 is a flat plate and is substantially horizontal when fixed to the housing 1102.
- the slidable member 112 includes a main body 116, a cover 118, and a post 117, and opposite ends of the post 117 are fixed to the main body 116 and the cover 118, respectively.
- the main body 116 is connected to the housing 11 through a linear sliding bearing 114.
- the main body 116 includes a base 1161, two side walls 1162 protruding from opposite ends of the base 1161, and a wheel connection portion 1163 protruding from the lower side of the base 1161.
- Each sliding bearing 114 includes a sliding track 1141 and a sliding block 1142 slidable on the sliding track 1141.
- the sliding rail 1141 is fixed to the housing 1102 and extends in a substantially vertical direction.
- the side walls 1162 are respectively fixed to the slider 1142, which enables the main body 116 to move together with the slider 1142 in a substantially vertical direction.
- the wheel 111 may be fixed to the wheel connection part 1163.
- the post 117 is substantially perpendicular to the main body 116 and passes through the through hole in the fixing member 113, which allows the post 17 to move in the vertical direction together with the main body 116.
- the cover 118 is a flat piece fixed to the top end of the pillar 117, and the cover 118 and the main body 116 are located on opposite sides of the fixing member 113.
- the shock absorber 115 may be a well-known internal spring shock absorber. It will not be described here.
- Each includes a hollow tube 1151 and a spring-loaded rod 1152 that is partially received in the tube 1151 and is slidable relative to the tube 1151.
- the rod 1151 can move into the tube 1151 and compress the spring to absorb the impact, and return to the normal position under the push of the spring.
- four dampers 115 are fixed to the fixing member 113, the rods 1151 of two dampers 115 abut the main body 116, and the rods of the other two dampers 115 abut the cover 118.
- the driving wheel mechanism 11 may further include one or more springs. The spring returns to the neutral position in response to the unevenness of the ground, and the shock absorber 115 smoothes the movement and limits the resonance effect caused by the movement of the drive wheel mechanism 11 and the spring.
- each caster mechanism 13 includes a spring and shock absorber suspension mechanism 130, a wheel connector connected to the bottom of the suspension mechanism 130 and rotatable about a substantially vertical axis 132 and round 131.
- the wheel 131 is connected to the wheel connecting member 132 and is rotatable about a substantially horizontal axis. With this arrangement, the wheel 131 has two degrees of freedom and can therefore align itself with the direction of travel.
- the suspension mechanism 130 includes a housing 1301 that houses other components of the suspension mechanism 130 (FIG. 5).
- the suspension mechanism 130 further includes a hollow tube 133, a movable member 134 and a plurality of dampers 137.
- the hollow tube 133 includes a cylindrical portion 1331 and a piece 1332 formed at the top end of the cylindrical portion 1331 and extending in the axial direction of the cylindrical portion 1331.
- the sheet 1332 is fixed on the housing 1301.
- the movable member 134 includes a spring-loaded rod 1341 connected to and passing through the tube 133, and a connecting plate 1342 and a sheet 136 connected to opposite ends of the rod 1341, respectively.
- the rod 1341 is slidable in the vertical direction, and may be movably connected to the barrel 1331 through a sliding bearing 139.
- the sliding bearing 139 is fixed to the piece 1332 of the tube 133.
- the connecting plate 1342 is connected to the wheel connecting piece 132.
- the rod 1341 can move relative to the tube 133 and compress the spring to absorb the impact, and return to a normal position when pushed by the spring.
- dampers 137 are fixed to the sheet 1332 and have the same configuration as the damper 115.
- the rods of the two dampers 137 abut the sheet 136, and the rods of the other two dampers 137 abut the two blocks 138 protruding from the connecting plate 1342 to achieve bidirectional damping performance.
- the two blocks 138 may be omitted, and the rods of the other two dampers 137 may directly contact the connecting plate 1342.
- the damper 137 can absorb the impact and vibration exerted on the wheel 131 by the gap between the floor and the elevator and other small bumps or gaps.
- the suspension mechanism 130 can be modified by using a pair of dampers or one damper to provide unidirectional damping performance.
- the robot assistant 100 further includes a plurality of actuating feet 15 connected to the wheel base 10.
- actuating feet 15 are arranged at the four corners of the wheel base 10.
- Each actuation foot 15 includes: a motor 152 (for example, a linear motor), which is fixed to the top part 121 of the wheel base 10; and a foot 151, which is driven by the linear motor and can be in a retracted position (see Figure Move between 8A) and the extended position (see Figure 8B).
- the feet 151 are controlled to move to their retracted positions so that the wheels 111 and 131 can contact the supporting surface (for example, the floor).
- the feet 151 are controlled to move to their extended position and contact the supporting surface, and the wheel 111 and 131 are not in contact with the supporting surface to isolate the suspension mechanism from the entire system, thereby achieving more precise grasping and operating performance. Since the feet 151 can provide a larger support polygon than the wheels 111 and 131, the robot assistant 100 can have increased static stability, which is a key factor during the operation task. The feet 151 also eliminate the effects of the suspension and provide a firmer connection to the floor, so that the arm base does not move around due to its movement.
- the arrangement of the actuating foot 15 can also promote an increase in the reachability of the foldable arm 30.
- the wheeled base 10 including the actuating feet 15 allows the foldable arm 30 to have a significant increase in the stable reachable area, which is not actuated by the surrounding area.
- the curves of the wheel base of the caster and the wheel base 10 including the actuating foot 15 are represented. It should be noted that in one embodiment, when the wheel base 10 does not include any suspension system, the four actuating feet 15 may be omitted.
- the drawer mechanism 20 includes a housing 22 surrounding the drawer 21.
- the housing 22 includes a main body 223, a bottom plate 221 and a top plate 222.
- the bottom plate 221 and the top plate 222 are fixed to the bottom and top of the frame 223.
- the main body 223 is a frame, which includes a plurality of substantially vertical rods 2231 connected to each other by a plurality of connecting rods 2232.
- the bottom plate 221 and the top plate 222 are fixed to the connecting rod 2232.
- the vertical rod 2231 may be directly connected to the bottom plate 221 and the top plate 222.
- the housing 22 may be made of a bent metal plate.
- the main body 223 may be a structural frame made of curved metal sheet ribs that are fixed to a metal plate to reduce weight without compromising rigidity.
- the drawer 21 is slidable relative to the housing 22.
- the housing 22 further includes a plurality of sliding rails 224, which are fixed to the vertical rod 223 to provide support for the drawer 21.
- Each slide rail 224 extends in a substantially horizontal direction and defines a groove 2241 extending along the length of the slide rail 224.
- each drawer 21 includes a main body 211 and two sliders 212 on opposite sides of the main body 211.
- the sliding blocks 212 extend in a substantially horizontal direction, and are respectively fitted in the grooves 2241 of the two sliding rails 224 and slidable therein. With this arrangement, each drawer 21 can slide relative to the housing 22 between an open position (see Fig. 11) and a closed position (see Fig. 1).
- the drawer mechanism 20 further includes a plurality of driving devices 23 for driving the drawer 21 to slide between its open position and its closed position, respectively.
- Each driving device 23 includes a motor 231 fixed on one of the vertical rods 2231 and a transmission device 232 for converting the rotary motion from the motor 231 into sliding motion.
- the transmission device 232 includes an output gear 233 fixed to the output shaft of the motor 231 and a rack 234 fixed to one side of the main body 211 of the drawer 21.
- the rack 234 is substantially parallel to a slider 212 fixed on the same side of the main body 211 and meshing with the output gear 233. When the output gear 233 rotates with the output shaft of the motor 231, the rack 234 moves and drives the corresponding drawer 21 to slide relative to the housing 22.
- the drawer mechanism 20 further includes two limit switches 24 for each drawer 21.
- the two limit switches 24 are respectively fixed to the two vertical rods 2231, and can contact the block 25 which can be fixed to the shelf 234 or the main body 211 of one drawer 21 and slide together therewith.
- the limit switch 24 sends a signal to the motor controller, and the motor controller stops the rotation of the motor 231 again. The movement of the drawer 21 is therefore stopped.
- the travel limit of the drawer 21 can be monitored, and when the travel limit of the drawer 21 is reached, the motor 231 is de-energized.
- the drive motor of the drive device may include an absolute encoder that is attached to determine the precise position of the drawer.
- collision detection sensors such as force sensitive resistors and tactile sensors may be provided on the robot assistant 100, such as on the front surface 213 and the inner surface 214 of the drawer 21. If a collision is detected (for example, someone hits the robot assistant 100), the collision detection sensor can send a signal to the motor controller to turn off the power of the motor 231, which can prevent the motor 231 from being damaged.
- other non-contact sensors such as distance sensors and safety light curtains, can be provided on the drawer 21 to determine potential collisions, so that the drawer 21 is only opened when there is enough open space.
- the collision can be detected by sensing the current of the motor and setting a threshold to determine whether the collision has been detected during the drawer opening operation. On the other hand, when the drawer 21 is closed, a potential blockage caused by a human finger or an object incorrectly inserted into the drawer 21 can be detected. In this case, the movement of the drawer 21 can be stopped.
- FIG. 12 shows a drawer mechanism 20a according to an alternative embodiment, which is different from the drawer mechanism 20 in that the drawer mechanism 20a includes a housing 22a and a driving device 23a.
- the housing 22a includes two side plates 221a, in which the drawer 21 is connected to the side plate 221a in a similar mechanism as described above and is slidable relative to the side plate 221a.
- Each driving device 23a includes a motor 231a and a transmission device 232a.
- the transmission device 232a includes a timing belt 233a, a pulley 234a rotatably connected to a side plate 221a, and a drawer 21 fixed on the side where the pulley 234a is located.
- the rack 235a extends from the longitudinal groove 222a defined on the plate 221a.
- the timing belt 233a surrounds the pulley 234a and the output gear connected to the output shaft of the motor 231a, and meshes with the rack 235a.
- the timing belt 233a is arranged around the pulley 234a and the output gear connected to the output shaft of the motor 231a, and meshes with the rack 235a.
- the timing belt 233a moves and drives the rack 235a to move.
- the drawer 21a slides between the open position and the closed position with respect to the housing 22a.
- the driving mechanism for moving the drawer 21 is not limited to the above embodiment, and can be changed according to actual needs.
- a linear actuator can be used to move the drawer 21 between the open position and the closed position.
- the driving mechanism for driving the drawer 21 is not limited to the embodiments shown in 11 and 12, and can be modified according to actual needs.
- a piston-like linear actuator can be used to drive each drawer 21.
- the linear actuator may be arranged under the drawer 21, wherein the drawer 21 is fixed to the shaft of the linear actuator.
- the drawer 21 can slide together with the shaft of the linear actuator.
- a stepper motor can be used to drive each drawer 21.
- the stepping motor may include a lead screw and a nut that can slide along the lead screw.
- the drawer 21 can be fixed on the nut and can slide along the screw when the screw is rotated.
- the driving mechanism may include a motor and a friction wheel fixed to the output shaft of the motor.
- the friction wheel may be arranged under each drawer 21 and keep in contact with the bottom surface of the drawer 21. When the friction wheel rotates, the friction wheel can drive the drawer 21 to slide relative to the housing 22.
- the drawer mechanism 20 may include only one drawer 21 or two drawers 21 arranged side by side.
- the drawer mechanism 20 may further include an ID check module.
- the ID check module may include a keyboard 202 (FIG. 11) to allow input of passwords, card readers, facial recognition cameras, and the like. With the help of the ID check module, the robot assistant can allow authorized personnel to access stored items.
- the foldable arm 30 is an articulated arm with a single-axis rotation type joint.
- the rotary joint chain provides great freedom and flexibility for the movement of the foldable arm.
- the configuration of the foldable arm 30 can be changed as required.
- the foldable arm 30 may be a selectively compliant articulated robotic arm (SCARA).
- SCARA selectively compliant articulated robotic arm
- the foldable arm 30 includes a first link 31, a second link 32, a third link 33, a fourth link 34, a fifth link 35, and a sixth link 36.
- the foldable arm 30 also includes six rotary joints 37 for providing rotary motion to the above links.
- the second link 32, the third link 33, the fourth link 34, the fifth link 35, and the sixth link 36 pass through 5 of the rotary joints 37 ("first rotary joint").
- first rotary joint Are rotatably connected to each other in series.
- the first link 31 is substantially vertical and is rotatably connected to the base 301 fixed on the top of the drawer mechanism 20 via the remaining rotation joints (“second rotation joint 37”).
- the base 301 may be omitted, and the first link 31 may be directly rotatably connected to the top of the drawer mechanism 20.
- the first link 31 can rotate about a substantially vertical axis relative to the top of the drawer mechanism 20.
- the first link 31 may be hollow and house the second rotary joint 37.
- the first link 31 includes a vertical body 311 and a connecting portion 312 protruding from the side surface of the vertical body 311.
- the second link 32 is rotatably connected to the connection part 312 and is rotatable about an axis substantially perpendicular to the vertical main body 311.
- the second link 32 includes an elongated body 321 and a connecting portion 322 connected to the first end of the elongated body 321.
- One of the connecting portion 312 of the first link 31 and the connecting portion 322 of the second link 32 accommodates a first rotary joint 37, and the connecting portion 312 of the first link 31 and the connecting portion 322 of the second link 32 The other one is fixed to the output shaft of the first rotary joint 37, and the second link 32 is rotatably connected to the first link 31.
- the second link 32 can rotate about an axis substantially perpendicular to the elongated body 321.
- one end of the third link 33 is fixed to the second end of the elongated body 321 of the second link 32 opposite to the connecting portion 322.
- the fourth link 34 includes a curved body 341 and a connecting portion 342 connected to one end of the curved body 341.
- One of the third link 33 and the curved body 341 accommodates a first rotary joint 37, and the other of the third link 33 and the curved body 341 is fixed on the output shaft of the first rotary joint 37 to connect the fourth link 34 is rotatably connected to the third link 33.
- the fourth link 34 is rotatable about an axis substantially perpendicular to the length direction of the elongated body 321 of the second link 32. As shown in FIGS.
- the curved body 341, the EOAT, the sixth link 36, the fifth link 35, and the fourth link 34 can be moved to be in contact with the first link 31 and the second link 32.
- the elongated body 321 is adjacent to the position.
- the foldable arm 30 as a whole can be actuated to fold on the top of the drawer mechanism 20 in a compact and substantially flat state. This saves valuable space in the horizontal and vertical directions.
- the shield/shield can be used to partially or completely surround the foldable arm 30.
- the shield/protective cover can be retracted from the open position to the closed position.
- the fifth link 35 is substantially U-shaped and includes a base 351 and two side walls 352 connected to the base 351.
- the connecting part 342 of the fourth link 34 accommodates a first rotary joint 37, and the base part 351 is fixed to the output shaft of the first rotary joint 37, and the fifth link 35 is rotatably connected to the fourth link 34.
- the fifth link 35 is rotatable about an axis that is substantially perpendicular to the rotation axis of the fourth link 34.
- the sixth link 36 is partially accommodated in the space defined by the base 351 and the two side walls 352.
- the sixth link 36 is rotatably connected to the side wall 352 through a first rotary joint 37.
- the sixth link 36 is rotatable about an axis that is substantially perpendicular to the rotation axis of the fifth link 35.
- the sixth link 36 also houses a first rotary joint 37 therein, and the first rotary joint 37 rotatably connects the EOAT 50 to the sixth link 36.
- the EOAT 50 can rotate around an axis that is substantially perpendicular to the sixth link 36 of the rotation axis.
- Connect the EOAT 50 to the rotating joint 37 of the sixth link 36, connect the sixth link 36 to the rotating joint 37 of the fifth link 35, and connect the fifth link 35 to the rotating body of the fourth link 34 37 forms a spherical joint.
- each rotary joint 37 may be a motor assembly including a motor, an encoder, a motor controller, a transmission device, and a brake.
- the encoder provides a closed-loop feedback signal by tracking the speed and/or position of the motor output shaft.
- the transmission device is configured to transfer movement from the motor to a connecting rod driven by the motor assembly.
- the brake is configured to lock the link driven by the motor assembly in place, so that in the event of a power failure or other technical failure, the foldable arm 30 can be locked in place. It should be noted that the rotary joint for the robot arm has been well developed, and the configuration of the rotary joint 37 can be changed according to actual needs.
- the foldable arm 30 may have more or fewer degrees of freedom, which requires more or fewer links and rotating joints.
- FIGS. 14A to 14D show changes in the state of the foldable arm 30 during the picking task, including an initial compact and substantially flat state (FIG. 14A and FIG. 14B), an intermediate state (FIG. 14C) and a grasping determination The final pose of the object 200 ( Figure 14D).
- the foldable arm 30 In the initial compact and substantially flat state, the foldable arm 30 may be flush with the edge of the shield/shield, or the shield may be completely retracted. This can achieve the maximum working accessibility of the foldable arm 30.
- the EOAT 50b includes two parallel-jaw fingers 52b and 53b and an adaptive thumb 54b. This configuration allows precise pinch grasping using only two flat fingers 52b, 53b, and grasping larger and heavier objects when the thumb 54b is engaged and the fingers 52b and 53b are joined together or separated from each other.
- the EOAT 50b further includes a base 51b, and the fingers 52b and 53b and the thumb 54b are connected to the base 51b.
- the base 51b includes a bottom plate 55b, a front cover 56b and a rear cover 58b spaced apart from each other and fixed to the bottom plate 55b, and an internal support 57b fixed to and located between the front cover 56b and the rear cover 58.
- the fingers 52b and 53b have the same configuration, and each of the fingers 52b and 53b and the base 51b form a four-bar linkage mechanism. Specifically, each of the fingers 52b and 53b includes a crank 521b, a rocker 522b, and a link 523b.
- the crank 521b includes two rods 527b spaced apart from each other and parallel to each other.
- the two rods 527b have substantially the same configuration, and are connected to each other by a shaft 528b at their first ends.
- the two rods 527b are respectively rotatably connected to the front cover 56b and the rear cover 58b at their second ends, which allows the two rods 527b to rotate about a common axis.
- one shaft 525b fits in each through hole 561b defined in the main body 562b of the front cover 56b.
- the other rod 527b may be rotatably connected to the back cover 58b in the same manner, and it will not be repeated here.
- the rocker 522b is rotatably connected to the inner support 57b and the link 523b at its opposite ends, respectively.
- the inner support 57b includes a main body 571b and two spacers 576b protruding on the top of the main body 571b.
- Each rocker 522b is rotatably connected to a spacer 576b by a shaft 524b, and the opposite end of the shaft 524b extends beyond the rocker 522b and is received in a through hole 574b defined in the spacer 576b.
- the link 523b includes a connecting rod 529b and a fingertip 530b.
- One end of the connecting rod 529b is rotatably connected to the two rods 527b through a shaft 528b, and the other end of the connecting rod 529b is rotatably connected to the rocker 522b.
- the fingertip 530b is fixed to the other end of the connecting rod 529b.
- one rod 527b rotates when driven by the motor 515b, and drives the link 523b and the rocker 522b to rotate. Then, the link 523b of the two fingers 52b and 53b can move toward/away from each other, which allows the link 523b to grab/release the object.
- the crank 521b, the rocker 522b, and the link 523b are configured such that the link 523b remains substantially parallel to each other during their movement toward/away from each other.
- the fingertips 530b each have a curved configuration, which allows non-prehensile tasks, such as pulling a handle, lifting an object using a ring feature, or repositioning an object.
- the motor 515b is accommodated in a space 573b defined in the main body 571b of the inner bracket 57b.
- the transmission mechanism transmits movement from the motor 515b to the two rods 527b of the fingers 52b and 53b.
- the transmission mechanism includes: an output gear 516b fixed on the output shaft of the motor 515b; and two gears 526b rotatably arranged around the shaft 525b. Two rods 527b are fixed to two gears 526b.
- one of the two gears 526b is a stepped gear, which includes a large gear meshing with the other gear 526b and a small gear meshing with the output gear 516b.
- the EOAT 50b may further include two shafts 531b, which rotatably pass through two through holes 575b defined in the main body 571b of the inner support 57b.
- the two rods 527b of the finger 52b are respectively fixed to the opposite ends of one shaft 531b, and the two rods 527b of the finger 53b are respectively fixed to the opposite ends of the other shaft 531b.
- the thumb 54b includes a base 546b, a motor assembly 545b, a crank 543b, a link 541b, and a rocker 542b.
- the base 546b is connected to the bottom plate 55b.
- the lower end of the crank 543b is fixed to the output shaft of the motor assembly 545b, and the upper end of the crank 543b is rotatably connected to the lower end of the link 541b.
- the lower end of the rocker 542b is rotatably connected to a connecting member 544b fixed to the top of the motor assembly 545b.
- the upper end of the rocker 542b is rotatably connected to the link 541b.
- the crank 543b rotates when driven by the motor assembly 545b, and drives the coupling 541b to rotate toward/away from the two fingers 52b and 53b. Thumb 54b can then cooperate with fingers 52b and 53b to grasp larger, heavier objects.
- the thumb 54b is rotatably connected to the bottom plate 55b.
- the main body 562b of the front cover 56b defines a space 563b at the lower corner.
- the top surface 564b of the space 563b, the bottom surface of the inner support 57b, and the bottom surface of the rear cover 58b are substantially flush with each other. These surfaces face the bottom plate 55b, and a receiving space is formed between these surfaces and the bottom plate 55b, which allows the base 546b of the thumb 54b to rotate in the receiving space.
- the base 546b is partially accommodated in the accommodation space, and is rotatably connected to the bottom plate 55b by a shaft 548b.
- the lower end of the shaft 548b is rotatably fitted in the through hole 551b defined in the bottom plate 55b, and the top end of the shaft 548b is rotatably received in the hole defined in the inner support 57b.
- the shaft 548b is substantially vertical, and the base 546b is therefore rotatable about a vertical axis.
- FIG. 15A shows that the thumb 54b is in the first position
- FIG. 15C shows that the thumb 54b has been rotated from the first position to the second position to release the operating space for the fingers 52b and 53b.
- the rocker 542b is a spring-loaded two link member.
- the rocker 542b includes a first member 5421b and a second member 5422b rotatably connected to the first member 5421b.
- the rocker 542b is passively reconfigured when in contact with an object. After the object is released, the first member 5421b and the second member 5422b are returned to their original positions by the spring.
- the thumb 54b can be rotated to various positions to adapt to different objects with different shapes and sizes, which makes the EOAT 50b have great versatility to grasp different objects.
- sensors may be embedded in fingers 52b, 53b, and 54b for additional grasping robustness.
- the EOAT 50b further includes a motor 511b, which is fixed to the inner support 57b and accommodated in a space 572b defined in the inner support 57b.
- the movement from the motor 551b passes through an output gear 512b fixed to the output shaft of the motor 511b, an intermediate gear 513b rotatably connected to the block 514b fixed to the front cover 56b and meshed with the output gear 512b, fixed on the shaft 548b and connected with
- the gear 547b meshed with the intermediate gear 513b is transmitted to the base 546 of the thumb 54b.
- the EOAT 50c includes a base 51c and three fingers 52c rotatably connected to the base 541c.
- the base 51c includes a bottom plate 511c, a middle plate 512c, and a top plate 513c, and the bottom plate 511c, the middle plate 512c, and the top plate 513c are spaced apart from each other in the vertical direction and connected to each other via a plurality of vertical rods 514c.
- the EOAT 50c also includes a linear platform 55c, which is connected to a column 56c fixed on the bottom plate 511c and the top plate 513c.
- the column 56c is substantially vertical, and the linear platform 55c can slide along the column 56c.
- the linear platform 55c is arranged between the middle plate 512c and the top plate 513c.
- the EOAT 50c also includes three links 54c, and each link includes opposite ends that are rotatably connected to the linear platform 55c and a finger 52c. Each finger 52c is further rotatably connected to the top plate 513c.
- the EOAT 50c further includes a linear motor 53c arranged between the bottom plate 511c and the middle plate 512c.
- the linear stage 55c is fixed on a slider connected to the output shaft of the linear motor 53c.
- the finger 52c may be made of an elastic material and passively deform and cover a smaller object for a firmer grasp.
- the sensor may be embedded in the finger 52c. The use of elastic materials as the overall structure can increase robustness.
- the EOAT 50d includes a base 51d and two fingers 52d connected to the base 51d.
- the EOAT 50d also includes a crank 54d and a rocker 53d for each finger 52d.
- the base 51d includes a front cover 511d, a bottom plate 514d, and a rear cover 515d.
- the front cover 511d is fixed on the bottom plate 514d, and the rear cover 515d is fixed on the front cover 511d.
- each crank 54d is in the form of two rods parallel to each other and fixed to opposite ends of a shaft 541d that extends out of the through hole 512d in the front cover 511d and the through hole in the rear cover 515d ( Not shown).
- the two rods of each crank 54d are rotatably connected to one finger 52d.
- each rocker 53d is in the form of two rods parallel to each other, and is fixed to the opposite end of a shaft 531d that extends out of the through hole 513d in the front cover 511d and the rear cover 515d Through holes in the (not shown).
- the two rods of each rocker 53d are rotatably connected to one finger 52d.
- each finger 52d, the crank 54d of the finger 52d and the rocker 53d, and the base 51d compositely form a four-bar linkage mechanism.
- the crank 54d of the two fingers 52d rotates, the two fingers 52d move toward/away from each other, which allows the two fingers 52d to grasp/release the object.
- each finger 52d and its crank 54d and rocker 53d are configured such that during the movement of the two fingers 52d, the gripping surfaces 521d of the two fingers 52d remain parallel to each other.
- the finger 52d is made of an elastic material, and is passively deformed and enveloped around a smaller object for a firmer grasp.
- the sensor may be embedded in the finger 52d for additional robustness.
- the EOAT 50d further includes a motor 55d fixed to the rear cover 515d by a fixing member 56d.
- the motor 55d is configured to drive the crank 54d of the two fingers 52d to rotate.
- the motor 55d includes a worm 551d fixed on the output shaft of the motor 55d.
- the EOAT 50d also includes two worm gears 542 fixed on the shaft 541d and meshed with the worm shaft 551d, which allows the transmission of rotational motion from the output shaft of the motor 55d to the crank 54d.
- FIG 17D shows EOAT 50d' similar to EOAT 50d according to one embodiment.
- the EOAT50d' includes a base 51d', two fingers 52d', a crank 54d' for each finger 52d', and a rocker.
- EOAT 50d' also includes a motor 55d' for driving the rotation of two cranks 54d'.
- the structure and operation of EOAT 50d' are similar to those of EOAT 50d.
- the difference between EOAT 50d' and EOAT 50d is that the joystick 53d' is a single lever.
- the difference between EOAT 50d' and EOAT 50d is that the curved fingertips can achieve a variety of non-prehensile tasks.
- the EOAT 50e includes a base 51e, a first finger 52e, a second finger 53e, a first motor 55e for driving the first finger 52e, and a second finger 53e The second motor 54e.
- the base 51e includes a bottom plate 511e and a top plate 512e spaced apart from each other and fixed to each other by a plurality of pillars 513.
- the first finger 52e includes a connection base 521e fixed to the top of the top plate 512e, a first knuckle 522e rotatably connected to the connection base 521e, and a first knuckle 522e rotatably connected to the first knuckle 522e.
- the top second knuckle 523e The first knuckle 522e includes two half knuckles 5221e arranged side by side and connected to each other.
- the EOAT 50e also includes three pulleys 501e, 502e, and 503e, which are arranged between the first half-knuckle 5221e and the pulley 504 connected to the connection base 521e.
- the pulley 501e is arranged adjacent to the second knuckle 523e
- the pulley 503e with a larger diameter is arranged adjacent to the connection base 521e
- the pulley 502e is arranged between the pulleys 501e and 503e. It should be noted that the number, size and arrangement of the pulleys can be adjusted according to actual needs.
- the EOAT 50e further includes a first tendon 56e.
- the top end of the tendon 56e is fixed to the second knuckle 523e, and the tendon 56e is wound on the pulleys 501e, 502e, 503e, and 504e in sequence. Then, the tendon 56e passes through the through hole in the top plate 512e and is wound on the wheel 551e fixed to the output shaft of the motor 55e.
- the first finger 52e and the second finger 53e are initially in contact with each other. In the process of grasping a certain object, the wheel 551e rotates together with the output shaft of the motor 55e and pulls the tendon 56e.
- the EOAT 50e further includes a tension spring 58e arranged between the second knuckle 523e and the first knuckle 522e.
- the tension spring 58e is stretched, and after the motor 55e is de-energized, it urges the second knuckle 523e to return to its original position.
- the tendon 56e passes through the knuckles 522e and 523e to achieve adaptive behavior through an underactuated design.
- a tension spring (not shown) is arranged between the first knuckle 522e and the connection base 521e, and the tension spring urges the first knuckle 522e to return to its original position after the motor 55e is de-energized. After the motor 55e is de-energized, the tension spring here can keep the tendon 56e in a tensioned state. It should be noted that the use of the tendon in robotic applications has been studied since the 1980s, and the tendon 56e will not be described in detail here.
- the second finger 53e includes a connection base 531e fixed on the top of the top plate 512e, and is rotatably connected to the knuckles 532e and tendons 57e of the connection base 531e.
- One end of the tendon 57e is fixed on the knuckle 532e and is wound on the pulley 505e rotatably connected to the connection base 531e, passes through the through hole on the top plate 512e, and is wound on the output shaft fixed to the motor 54e On the round 541e.
- the EOAT 50e also includes a tension spring 59e arranged between the connection bases 531e.
- the tension spring 58e is stretched, which urges the second phalanx 523e to return to its original position after the motor 55e is de-energized.
- the tendon 57e may be replaced by a timing belt wound on the pulley 505e.
- the first finger 52e and the second finger 53e can be controlled to be away from each other to create enough space for the object, and rotate back to contact the object when pushed by the spring.
- the EOAT 50f includes a base 51f and two first fingers 52f and second fingers 53f connected to the base 51f.
- Each first finger 52f is constructed in the same manner as the first finger 52e of FIG. 18A and is stacked on the motor 55f.
- the motor 55f is configured to drive the first finger 52f in the same manner as the motor 53e of FIG. 18A.
- the second finger 53f is constructed in the same manner as the second finger 53e of FIG. 18A and is stacked on the motor 56f.
- the motor 56f is configured to drive the second finger 53f in the same manner as the motor 54e of FIG. 18A.
- the base 51f defines a first chamber 511f and a second chamber 512f to accommodate the motors 55f of the two first fingers 52f.
- the EOAT 50f also includes a motor 54f housed in a third chamber 513 defined in the base 51f.
- the motor 54f is configured to drive the second finger 53f and the motor 56f to rotate about a substantially vertical axis as a whole.
- the second finger 53f also includes a first piece 531f and a second piece 532f spaced apart from each other. The first piece 531f and the second piece 532f are connected to the output shaft and the bearing on the bottom and top surfaces of the motor 54f.
- the second finger 53f and the motor 56f as a whole can rotate to a certain position relative to the base 51f.
- the second finger 53f can be rotated to various positions to adapt to different objects with different shapes and sizes, which makes the EOAT 50f have great versatility to grasp different objects.
- Each of the fingers 52f and 53f is designed to be modular, thereby simplifying maintenance, and the parameters of each finger (for example, link length or degree of freedom) can be modified to suit the target task.
- the EOAT as described above may have integrated sensors to provide assistance in grasping and manipulation behaviors.
- the sensor may include an IR range sensor similar to the sensor used in the wheel base 10, which is used in combination with a high-definition 2D RGB camera to achieve the same capabilities as a larger 3D RGBD camera.
- this allows the robotic assistant 100 to obtain higher definition images than conventional systems for object recognition.
- This also makes it possible to use smaller, more compact camera modules that can be more tightly integrated into EOAT.
- the camera can also have active lighting to make the vision system more suitable for changing ambient lighting conditions and help the camera capture the details of the object with maximum clarity.
- the sensor may include a tactile sensor for detecting contact and identifying a stable grasp.
- the tactile sensor may be a resistive bending sensor that changes resistance in response to bending strain, and may be overmolded in one or more EOAT compliant fingertips as described above.
- the tactile sensor may be a resistive pressure pad molded in one or more EOAT's compliant finger pads as described above.
- the tactile sensor can be a mechanical switch fixed behind one or more EOAT compliant finger pads. As described above, the stiffness of the finger pad material determines the force threshold for detecting a contact event.
- the robot assistant 100 may further include a vacuum module 510 that can be fixed to the aforementioned EOAT.
- the vacuum module 510 includes a base 511, a connecting tube 512, and a soft rubber, plastic or elastic suction cup 513.
- the suction cup 513 is configured to be pressed against the object by pushing down, so that the air under the suction cup is discharged to form a seal, thereby providing a lifting force to the object.
- the vacuum module 510 can be used as a stand-alone picking tool or used to provide assistance in non-prehensile (such as push/pull) tasks to place the target object in a more favorable posture for the jaws of EOAT 50 (jaw)/Finger grabbing.
- the suction cup 513 is connected to the connecting tube 512 via a nut 514 and is slidable along the connecting tube 512.
- the nut 514 is connected to the base 511 by a spring 515 arranged around the connecting pipe 512.
- the nut 514 pushes and compresses the spring 515, which in turn pushes the suction cup 513 to tightly abut the object.
- the robot assistant 100 further includes a camera 61.
- the camera 61 assists the robot assistant 100 to perceive the environment and guide the foldable arm 30 to perform object manipulation tasks.
- the control system 70 of the robot assistant orients the foldable arm 30 to a certain direction through the articulation of one or more of the N rotary joints and N links of the foldable arm 30, and guides the EOAT 50 picks up external objects from one or more drawers 21 or places external objects in one or more drawers 21 based on the output from the camera 61 according to the command instruction.
- the camera 61 may be a wrist-mounted camera. Specifically, as shown in FIG. 21C, the camera 61 is connected to the side of the output plate of the rotary joint 37, and the rotary joint 37 is accommodated in the sixth link 36 of the foldable arm 30, next to the EOAT 50, which is connected to the rotary joint On the end surface of the output disk of 37, the rotary joint 37 is accommodated in the sixth link 36.
- the camera 61 can observe the task environment with the smallest obstacles of the operating system (manipulation system), while minimizing the total footprint.
- the camera 61 may be arranged at different positions of the foldable arm 30 adjacent to the EOAT 50, or may be rotatable. The rotatability of the camera 61 can make the camera always face the grasping working space, regardless of the placement of the jaws/fingers of the EOAT 50.
- the termination may end with a revolving joint whose axis is parallel to the normal vector of the EOAT "palm".
- a revolving joint whose axis is parallel to the normal vector of the EOAT "palm".
- alternative joint designs with additional offsets or terminated prismatic joints can be considered to minimize the singularity in the arm working space and achieve the above-mentioned dual design goals.
- the camera 61 may be a camera-in-hand or a palm-mounted camera.
- the camera may be arranged in the "palm" of the EOAT 50 (i.e., FIG. 21D), or mounted on the outer surface of the EOAT 50 (i.e., FIG. 21A and FIG. 21B).
- This allows EOAT to continuously visualize the environment while approaching the object without resetting to the predefined configuration of the scan, and to view the object permanently. Constantly observing the task while reaching and grasping may help minimize posture errors before grasping.
- one or more cameras may be arranged on the ceiling or on a high rack of shelves, for example in a storage room.
- a camera arranged on the ceiling can provide information of a fixed point including visual information of the environment of the foldable arm 30, a shelf, an obstacle, and an object to be grasped.
- the use of a camera mounted on the ceiling and a camera placed on the EOAT 50 and/or on/near the palm can improve object manipulation tasks.
- the vision sensor may have a problem with short-range target detection, when the EOAT is close to the target object (for example, 30-50mm), it may be difficult to adjust adaptively according to the visual feedback.
- tactile or proximity sensors can be integrated into the EOAT 50 or palm.
- the camera 61 may be a 3D vision system including one or more 3D cameras.
- the camera 61 can be selected from many commercial 3D vision systems according to the object to be detected.
- a laser rangefinder using the time-of-flight method can be used to locate distant objects
- a stereo imaging system may be more suitable for imaging high-contrast objects.
- projected texture techniques such as structured light.
- the 3D vision system used to assist robots in detecting and picking up objects is well known and will not be described in detail here.
- the lifting mechanism 40 is based on a lifting mechanism.
- the lifting mechanism 40 includes a lifting mechanism 42 connected to the drawer mechanism 20 and the wheel base 10 and an actuation mechanism that is fixed on the wheel base 10 and configured to drive the lifting mechanism 42 to extend or retract in the vertical direction. ⁇ 41.
- the lifting mechanism 42 When the lifting mechanism 42 is extended, the drawer mechanism 20 moves upward in the vertical direction, and when the lifting mechanism 42 is retracted, it moves downward in the vertical direction.
- the lifting mechanism 40 is not restricted and can be adjusted according to actual needs.
- the lifting mechanism may be a scissor lifting mechanism.
- the lifting mechanism 42 includes a pair of support members 421 and 422, and the support members 421 and 422 are rotatably connected to each other and form a crisscross pattern of "X".
- the support 421 includes two rods 4211 that are substantially the same in length and parallel to each other and fixed.
- the top ends of the two rods 4211 are rotatably connected to the top plate 432, and the drawer mechanism 20 is connected to the top plate 432.
- the lower ends of the two rods 4211 are rotatably connected to the bottom plate 431 fixed to the wheel base 10.
- the bottom plate 431 defines two grooves 4311 to receive two wheels 423 rotatably connected to the lower ends of the two rods 4211, respectively.
- the two wheels 423 can roll and move in the two grooves 4311.
- the two wheels 423 can be replaced by two sliders, which are rotatably connected to the lower ends of the two rods 4211 and are received in the two grooves 4311.
- the two sliders can slide in the two grooves 4311.
- the support 422 is constructed and arranged in a manner similar to the support 421.
- the support 422 includes two rods 4221 that have substantially the same length and are parallel and fixed to each other.
- One rod 4221 is rotatably connected to one rod 4211 at its middle position, and the other rod 4221 is rotatably connected to the other rod 4211 at its middle position.
- the bottom ends of the two rods 4221 are rotatably connected to the bottom plate 431.
- the upper ends of the two rods 4221 are movably connected to the top plate 432.
- the top plate 432 defines two grooves 4321 to receive two wheels 423 rotatably connected to the upper ends of the two rods 4221, respectively.
- the two wheels 423 can roll and move in the two grooves 4321.
- the two wheels 423 may be replaced by two sliders, which are rotatably connected to the upper ends of the two rods 4221 and are received in the two grooves 4321.
- the two sliding blocks can slide in the two grooves 4321.
- the linear track 41 can be positioned at an angular displacement relative to the bottom plate, and the lower end of the support 422 is located at a displacement away from the end of the bottom plate.
- the lifting mechanism 42 extends/retracts in the vertical direction, thereby moving the drawer mechanism 20 to the raising/lowering position.
- the lifting mechanism 42 may include more than one pair of support members 421 and 422. The arrangement of these supports 421 and 422 is well known, and will not be described in detail here.
- the actuator 41 is a linear actuator configured to apply a pushing or pulling force to the lifting mechanism 42 to drive the lifting mechanism 42 to extend or retract in the vertical direction.
- the actuator 41 includes an output shaft 411 which can move in a direction parallel to the groove 4311 of the bottom plate 431.
- the lower end of the rod 4211 of the support 421 is connected to the output shaft 411 through a connecting rod 412. Then, the output shaft 411 may apply a pushing/pull force to the lower end of the rod 4211 of the support 421.
- the wheels of the support 421 can then move in the groove 4311, thereby driving the lifting mechanism 42 to extend or retract.
- the lifting mechanism 40 further includes two rods 433 fixed to the top plate 432 and two pipes 434 fixed to the bottom plate 431.
- the guide rod 433 is substantially perpendicular to the top plate 432.
- the tube 434 is substantially perpendicular to the bottom plate 432 and is arranged according to the two rods 433.
- the lifting mechanism 40 also includes two springs 435. The bottom end of each spring 435 is fixed in a tube 434, and each rod 433 is fixed in a spring 435.
- the spring 435 When the lifting mechanism 42 is in a fully retracted state, the spring 435 is compressed by the top plate 432. When the lifting mechanism 42 is in a fully extended state, the spring 435 returns to its original shape.
- the spring 435 is gradually compressed by the top plate 432, which can reduce the load acting on the linear track of the actuator 41.
- four springs 435 are arranged at the four corners of the bottom plate.
- the robot assistant 100 may be an autonomous robot with capabilities including precise positioning, motion planning, and trajectory tracking.
- the robot assistant 100 can determine its real-time position in a known map during movement along the planned path. If there is a dynamic obstacle (such as the obstacle in FIG. 25) on the planned path, the robot assistant 100 can detect the obstacle and plan a new path to avoid the obstacle. With these functions, the robot assistant 100 can autonomously move between the starting position and the target position, thereby realizing assigned tasks, such as moving from position A to position B, extracting medicine from position B, and delivering medicine to position C. This enables smart logistics and provides unsupervised end-to-end logistics solutions.
- the robot assistant 100 including the above-mentioned mechanical and software aspects can be an autonomous robot, including a foldable arm 30 and a highly dexterous EOAT 50.
- the EOAT 50 has sufficient versatility to accurately grasp small objects. It can also be used for powerful grasping of heavier/bulky objects (powergrasps).
- the robot assistant 100 can recognize objects in the scene, train or detect the best grasping posture for each object geometry, locate the object relative to the manipulator base or EOAT, and plan collision-free or "collision-safe" paths to achieve pre-grabbing Take the posture, plan the grab configuration, and locate the object in the post grab configuration. Using these capabilities, the robot assistant 100 can provide unsupervised end-to-end logistics solutions to meet various delivery and logistics needs.
- the robot assistant 100 moves to the target position (for example, the shelf 300), the foldable arm 30 and the EOAT 50 are controlled to be in a state, so that the EOAT 50 can reach a certain position to pick and determine ⁇ object 400.
- the robot assistant 100 will determine the accessibility to the object 400, and can control the lifting mechanism 40 to move the drawer mechanism 20 to a determined height, so that the foldable arm 30 and the EOAT 50 can reach the object 400.
- the robot assistant 100 can open a drawer 21 to allow the foldable arm 30 to load the object 400 into the drawer 21, and close the drawer 21 before the robot assistant 100 is in a moving state .
- the robot assistant 100 may open the drawer 21 to allow the foldable arm 30 to unload the object 400.
- the robot assistant 100 may employ a tracking system (for example, RFID-enabled item tracking or barcode scanner) to track the inventory of objects (for example, medicines, gloves) being loaded and unloaded.
- the tracking system allows the robotic assistant 100 to determine which authorized person or patient has loaded, received, and/or opened the drawer mechanism 20. All this information can be uploaded to a centralized database for tracking and can be used to automatically reorder inventory when certain thresholds are met.
- the tracking system may send a visual, audio, or electronic alert.
- control system 70 includes a processor 71 and a memory 72 storing computer-readable instructions.
- the processor 71 runs or executes various software programs and/or instruction sets stored in the memory 72 to perform various functions of the robot assistant 100 and process data.
- the processor 71 may be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a programmable logic device, a discrete gate, and transistor logic Devices, discrete hardware components, or a combination of some or all of these components.
- the general-purpose processor may be a microprocessor or any conventional processor or the like.
- the memory 72 may store software programs and/or computer-readable instruction sets, may include high-speed random access memory, and may include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Storage device.
- the robot assistant 100 also includes a base motion controller 101 electrically connected to the processor 71, and a motor electrically connected to the base motion controller 101 and configured to drive a motor 152 (hereinafter referred to as "foot motor 152") of the actuating foot 15
- the driver 153 and the motor driver 102 are electrically connected to the base motion controller 101 and configured to drive a motor of the base 10 (hereinafter referred to as "base motor 1101").
- the robot assistant 100 further includes a body motion controller 401 electrically connected to the processor 71, and a motor 231 or 231a (hereinafter referred to as “drawer motor 231”) electrically connected to the body motion controller 401 and configured to drive the drawer mechanism 20. ) Of the motor driver 26 and the motor driver 402, the motor driver 402 is electrically connected to the body motion controller 401 and is configured to drive the actuator 41 of the lifting mechanism 40 (hereinafter referred to as "lift motor 41").
- lift motor 41 the actuator 41 of the lifting mechanism 40
- the robot assistant 100 further includes an arm motion controller 302 electrically connected to the processor 71, and a motor driver 303 electrically connected to the arm motion controller 302 and configured to drive a joint motor 370 of the joint 37 of the foldable arm 30 .
- the robot assistant 100 also includes an EOAT motion controller 501 electrically connected to the processor 71, and a motor driver 502 electrically connected to the EOAT motion controller 501 and configured to drive an EOAT motor 503 of the EOAT 50.
- the EOAT motor 503 may include one or more of the aforementioned motors 511b, 515b, 545b, 53c, 55d, 54e, 55e, 54f, 55f, and 56f.
- the robot assistant 100 also includes a power supply system 81 that supplies power to various components of the robot assistant 100.
- the power supply system 81 may include a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a charging system, a power failure detection circuit, a power converter or inverter, and a power status indicator (e.g., illuminated Diodes (LEDs) and any other components related to power generation, power management and distribution.
- the power supply system 81 may also include a self-charging unit that can be engaged with a docking charging station at a fixed position, thereby allowing the robot assistant 100 to be charged.
- the robot assistant 100 may also include a display 82.
- the display 82 may be a touch-sensitive screen and provide an input interface and an output interface between the robot assistant robot 100 and the user.
- the display 82 displays visual output to the user.
- the visual output can include graphics, text, icons, video, and any combination thereof.
- the robot assistant 100 may further include a speaker 83 and a microphone 84, which provide an audio interface between the user and the robot assistant 100.
- the microphone 84 receives audio data, converts the audio data into an electric signal, and the electric signal is sent to the control system 70 as a command.
- the speaker 83 converts the electric signal into sound waves audible to human ears.
- FIG. 27 only shows an example of the robot assistant 100, and the robot assistant 100 may have more or fewer components than shown, may combine two or more components, or may have different The configuration or arrangement of the components.
- the robot assistant 100 may further include a wireless communication interface 85, such as WIFI and Bluetooth modules.
- the EOAT motion controller can be connected to the arm motion controller.
- the command to EOAT is passed through the arm motion controller.
- the command goes directly to EOAT.
- the processor is responsible for commanding EOAT directly or indirectly.
- the various components shown in FIG. 27 can be implemented by hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
- the robot assistant 100 includes two base motors 1101, which are used to drive the two wheels 111 of the base 10, respectively.
- the base motor 1101 may be a direct current (DC) motor.
- the robot assistant 100 includes two motor drivers 102, which drive two base motors 1101 respectively.
- the base movement controller 101 instructs the movement of the base motor 1101 in response to a command instruction from the processor 71.
- the base motion controller 101 may be a DC motor controller capable of implementing speed control of a DC motor using a pulse width modulation (PWM) method.
- PWM pulse width modulation
- the base motion controller 101 executes various calculations based on its programming and provides outputs to the gate drivers of the motor driver 102 and the motor driver 153, thereby driving the base motor 1101 and the foot motor 152.
- the base motor 1101 and the foot motor 152 may be controlled by two or more separate motion controllers.
- each motor driver 102 includes a gate driver 103 electrically connected to the base motion controller 101 and a plurality of transistors 104 electrically connected to one base motor 1101.
- the gate driver 103 and the transistor 104 may be separate components or integrated into a single integrated circuit.
- Each base motor 1101 includes an encoder 105 configured to detect the angular position of the rotor of the base motor 1101 and output the rotor angle information to the base motion controller 101 as a rotor position signal.
- the encoder 105 can be replaced by other position sensors, such as a Hall effect sensor, a back electromotive force (EMF) zero-crossing detector, and/or can generally generate information indicating the angular position of the rotor of the base motor 1101 Any other equipment.
- EMF back electromotive force
- the angular position signals from the two encoders 105 allow the base motion controller 101 to generate closed-loop commands that are provided to the gate driver 103.
- the angular position signals from the two encoders 105 are also used as additional odometer information to enhance navigation and self-positioning performance.
- the gate driver 126 then generates a variable duty cycle PWM motor drive signal to drive the base motor 1101.
- the six transistors 104 generate a variable duty cycle PWM motor drive signal that rotates a base motor 1101.
- each of the transistors 104 is an N-channel metal oxide semiconductor field effect transistor (MOSFET).
- MOSFET metal oxide semiconductor field effect transistor
- the transistor 104 is not limited to N-channel MOSFET, other types of switching elements can be used, such as P-channel MOSFET, bipolar junction transistor (bjt), silicon controlled rectifier (scr), thyristor, triac or other similar switches. element.
- the motor driver 12 is not limited and can be changed according to actual needs. For example, the motor driver 12 may be replaced by a commercially available DC motor driver.
- the base motion controller 101 receives commands from the processor 71. These commands may include many different instructions, including a description of the movement to be achieved by the wheel 111, or instructions for the base motion controller 101 to perform other system maintenance/system monitoring tasks.
- An example of an instruction describing a movement is the transmission of a target speed to be reached within a predetermined time.
- the base motion controller 101 is programmed in such a way that the signal from the encoder 105 associated with each wheel 111 is used to continuously monitor and calculate the speed of the wheel 111, and therefore it is possible to determine the difference between the target speed and the current speed. The difference between. Then, the base motion controller 101 can convert this difference into an instruction to its onboard pulse width modulator (PWM) system to increase or decrease the duty cycle of the PWM signal.
- PWM pulse width modulator
- This PWM signal is fed to the transistor 104 through the gate driver 103 and causes a corresponding increase or decrease in the current directed to the coil of the base motor 1101, thereby causing the base motor 1101 to go faster or slower.
- the direction of movement can also be controlled, because the base motion controller 101 can convert the left or right turn commands from the processor 71 into signals that drive the two wheels 111 at different speeds, and move in the robot assistant 100. Turn it when.
- another sequence of operations for the base motion controller 101 is to receive a command to move the wheel base 10 forward, backward, or along the direction described as relative to the current position of the wheel base 10. The path of the position sequence moves a predetermined distance.
- the base motion controller 101 can also perform other functions. Specifically, the base motion controller 101 can report the position of the wheel 111, the angular distance or the speed moved by the wheel 111 to the processor 71 by calculating the information from the information derived from the encoder 105.
- the robot assistant 100 including two differential drive wheels 111 is a differential drive wheel type mobile robot.
- the two wheels are driven independently.
- One or more passive castors are used for balance and stability. If the wheels rotate at the same speed, the robot will move directly or backwards. If one wheel runs faster than the other wheel, the robot will follow a curve along the arc of the instantaneous circle. If the two wheels rotate in opposite directions at the same speed, the robot will rotate around the midpoint of the two driving wheels.
- the foot motor 152 is a DC motor
- each motor driver 153 may include an H-bridge circuit including four switching elements (for example, MOSFETs).
- the H-bridge circuit includes two high-side switching elements S1 and S2, and two low-side switching elements S3 and S4.
- the high-side switching element S1 and the low-side switching element S3 are connected in series, and the high-side switching element S2 and the low-side switching element S4 are connected in series.
- the switching elements S1, S3 and the switching elements S2, S4 are connected in parallel between the power supply and the ground.
- the foot motor 152 driven by the motor driver 153 is connected to the connection point of the switching elements S1 and S3 and the connection point of the switching elements S2 and S4.
- the foot motor 152 driven by the motor driver 153 rotates in a first direction (for example, a clockwise direction).
- the switching elements S2 and S3 are turned on, the foot motor 152 rotates in an opposite second direction (for example, a counterclockwise direction).
- the configuration of the H-bridge circuit is not limited and can be changed according to actual needs.
- Each motor driver 153 may also include a gate driver.
- the gate driver is configured to generate a gate driving signal to drive the H-bridge circuit. By changing the duty cycle of the PWM input signal from the base motion controller 101, the speed of the foot motor 152 can be adjusted. It should be noted that the configuration of the motor driver 153 is not limited, and other commercial DC motor drivers may be used instead.
- the base motion controller 101 controls the foot motor 152 to move the foot 151 between its retracted position (see FIG. 8A) and an extended position (see FIG. 8B).
- the foot motor 152 may be a linear motor that cannot be driven backwards, which means that when the foot motor 152 is powered off, the slider of the foot motor 152 will be locked, so that the foot 151 will remain with the supporting surface during a power failure during an object operation task. touch.
- each foot motor 152 may have a built-in mechanical capture action switch to automatically stop its movement when it reaches any end of the foot stroke.
- FIG. 28 shows only one example, and the robotic assistant hand 100 may have more components than shown, or may have a different configuration or arrangement of components.
- the arm motion controller 302 may have the same or similar configuration as the base motion controller 101.
- the motor driver 303 may have the same or similar configuration as the motor driver 102 or 153.
- the joint motor 370 may be a DC motor.
- the processor 71 may execute a motion planning algorithm to generate a probabilistic roadmap or PRM. PRM is a figure composed of points in an obstacle-free space. The straight lines between these points are called "edges", and direct movement between them will not cause collisions.
- the processor 71 sends a command to the arm motion controller 302, and the arm motion controller 302 in turn drives the joint motor 370. Then, each joint motor 370 rotates by a certain angle so as to move the foldable arm 30 in the obstacle-free space.
- the EOAT motion controller 501 may have the same or similar configuration as the base motion controller 101.
- the motor driver 502 may have the same or similar configuration as the motor driver 102, 153, or 303.
- the EOAT motor 503 may be a DC motor.
- the processor 71 may monitor the grip force acting on the determined object, and send a command to the EOAT motion controller 501 when the grip force reaches a determined value.
- the EOAT motion controller 501 then sends a signal to the motor driver 502 to stop the motion of the EOAT motor 503, which enables the fingers of the EOAT 50 to grasp the determined object without sliding.
- the processor 71 can execute the motion planning algorithm and send a signal to the arm motion controller 302 to control the foldable arm 30 to move to a certain drawer 21 in the barrier-free space.
- the processor 71 After the EOAT 50 has moved to a position within a predetermined range of the drawer 21, the processor 71 then sends a signal to the EOAT motion controller 501 to control the finger of the EOAT 50 to release the object. The object is then placed in the drawer 21.
- the body motion controller 401 may have the same or similar configuration as the base motion controller 101.
- the motor driver 26 may have the same or similar configuration as the motor driver 102, 153, 303, or 502.
- the drawer motor 231 may be a DC motor.
- the body motion controller 401 may receive commands from the processor 71. These commands may include many different instructions, including a description of the movement achieved by the determined drawer 21, such as a sliding movement from an open position (see FIG. 11) to a closed position (see FIG. 1). Then, a motor driver 26 sends a rotation signal to the corresponding drawer motor 231 to drive the determined drawer 21 to slide from the open position to the closed position.
- the body motion controller 401 can stop the operation of the drawer motor 231 when receiving a signal from a limit switch 24 indicating that the drawer 21 has reached its stroke limit. In another embodiment, the body motion controller 401 may determine the position of the drawer in its working space based on a position feedback signal from an encoder device attached to the drawer mechanism.
- the motor driver 402 may have the same or similar configuration as the motor driver 102, 153, 303, 502, or 26.
- the lifting motor 41 may be a DC motor.
- the body motion controller 401 may receive commands from the processor 71. These commands can include many different instructions, including describing the movement that the drawer mechanism 20 driven by the lifting mechanism 40 will achieve, such as moving up from the original lowered position (see Figure 1A) to the raised position (see Figure 3).
- the body motion controller 401 can monitor the distance traveled by the drawer mechanism 20 by performing calculations based on the signal from the angle sensor 44 that indicates the rotation angle of the rotor of the lifting motor 41. After the drawer mechanism 20 has moved to a predetermined distance and moved to a certain position, the motion controller 401 can stop the operation of the lifting motor 41. When a signal indicating that the drawer mechanism 20 has reached its stroke limit is received from one of the two limit switches 45, the body motion controller 401 may stop the operation of the lifting motor 231.
- the robot assistant 100 may also include an arm guard 280 (FIG. 1B) or 281 (FIG. 1A) made of transparent or translucent plastic/polycarbonate for covering and/or protecting the foldable arm 30. ).
- the arm guard 280/281 is connected to the drawer mechanism 20, and is slidable or retractable between a raised position ( Figure 1A) and a hidden position ( Figure 1B).
- the arm guard 280/281 is mounted on the outer housing and can be retransmitted or lifted by the cover motor 28.
- the robot assistant 100 may also include an arm guard motor 28 for moving the arm guard 280/281 between a raised position and a hidden position.
- the arm guard motor 28 may be a DC motor.
- the robot assistant 100 may also include a motor driver 27 configured to drive the arm guard motor 28.
- the motor driver 27 may have the same or similar configuration as the motor driver 102, 153, 303, 502, 26, or 402.
- the body motion controller 401 may receive commands from the processor 71. These commands can include many different instructions, including describing the movement to be achieved by the arm guard 280/281, such as a sliding movement from a hidden position to a raised position.
- the body motion controller 401 can stop the operation of the arm protection motor 28, which indicates that the drawer 21 has reached its travel limit.
- the robot assistant 100 may further include a vacuum pump motor 507 to evacuate most of the air from under the suction cup 513 in FIG. 20.
- the vacuum pump motor 507 may be a DC motor.
- the robot assistant 100 may also include a motor driver 506 that drives the vacuum pump motor 507.
- the motor driver 506 may have the same or similar configuration as the motor driver 102, 153, 303, 502, 26, 27, or 402.
- the body motion controller 401 can monitor the pressure level in the suction cup below the ambient atmospheric pressure based on the signal from the pressure sensor 508.
- the body motion controller 401 can then send a signal to the motor driver 506 to drive the vacuum pump motor 507 so that the pressure level in the suction cup below the ambient atmospheric pressure can be maintained at a certain value, which allows the suction cup to provide a certain value to the object during the object operation task Lifting power.
- FIG. 29 shows only one example, and the robot assistant 100 may have more components than shown, or may have a different configuration or arrangement of components.
- the robot assistant 100 includes a plurality of sensors 60, including two RGB-D or 3D cameras 61 and 62, a plurality of LiDAR sensors 63, a plurality of IR sensors 64, a plurality of ultrasonic sensors 65 and Multiple IMU sensors 66.
- the above-mentioned one camera 61 is arranged on the foldable arm 30 or the EOAT 50.
- the other camera 62 is arranged on a housing provided around the drawer mechanism 20, as shown in FIG. 1A.
- the IR sensor 64 and the ultrasonic sensor 65 are arranged on a housing provided around the wheel base 10, as shown in FIG. 1A.
- the IMU sensor 66 is arranged on the wheel base 10.
- the sensors 62 to 66 are configured to output data to the processor 71 so that the processor 71 can perform positioning, motion planning, trajectory tracking control, and obstacle avoidance for the robot assistant 100, which will be described in detail below.
- the sensors 61 to 66 are directly electrically connected to the processor 71.
- the IR sensor 64 and the ultrasonic sensor 65 may be electrically connected to the sensor processor 601.
- the sensor processor 601 receives and processes the data from the IR sensor 64 and the ultrasonic sensor 65, and sends the processed data (for example, the distance from the sensor to the object) to the processor 71 and/or the aforementioned one or more motion controllers .
- two IR sensors 64 and two ultrasonic sensors 65 are arranged on the front side of the robot assistant 100, and two IR sensors 64 and two ultrasonic sensors 65 are arranged on the rear side of the robot assistant 100.
- the number and arrangement of IR sensors 64 and ultrasonic sensors 65 can be changed according to actual needs.
- the IR sensor 64 and the ultrasonic sensor 65 are electrically connected to the sensor processor 601 through a plurality of differential drivers.
- two differential drivers 602 and two differential drivers 603 are electrically connected to the sensor processor 601.
- Each differential driver 602 is electrically connected to two differential drivers 651, and each differential driver 651 is electrically connected to one ultrasonic sensor 65.
- Each differential driver 603 is electrically connected to two differential drivers 641, and each differential driver 641 is electrically connected to one IR sensor 64.
- the differential drivers 602, 603, 641, and 651 have the same configuration and may be differential driver I 2 C bus buffers.
- the differential drivers 602, 603, 641, and 651 can receive the digital signal data packets sent by the IR sensor 64 and the ultrasonic sensor 65, and convert them into signals that can be recognized by the sensor processor 601.
- the bus connected to the IR sensor 64 passes through a differential driver to protect it from electromagnetic noise emitted by the base motor 1101.
- the differential driver also provides level conversion from 3.3V to 5V and then to 3.3V to further improve the signal-to-noise ratio of the sensor cable.
- an I/O expander 642 is connected to each IR sensor 64 and a differential driver 641.
- the sensor processor 601 can individually reset/restart each IR sensor 64 via an I/O expander, so that the IR sensor 64 can have different I 2 C bus addresses, which are assigned by the sensor processor 601 and reset in turn Each IR sensor 64 and immediately issue a write command.
- the arrangement of the I/O expander 642 and the differential driver 641 can also be applied to a sonar sensor.
- the use of the I/O expander 642 can provide remote IO functions through the I 2 C bus, and therefore limits the number of wires extending on the robot assistant 100.
- FIG. 30 shows only one example of the arrangement of the sensor processor, the differential drive, the IR sensor, and the ultrasonic sensor, and the robot assistant 100 may have more components than shown, or may have a different configuration or arrangement of components .
- the power supply system 81 includes a battery pack including a battery monitor 810 electrically connected to the processor 71 and a battery module 814, and the battery module 814 includes a plurality of battery cells 815.
- the processor 71 can use the battery monitor 810 to implement battery management functions, such as monitoring (cell voltage, battery current, battery temperature), protection (controlling charge/discharge FET), and balancing.
- the power supply system 81 also includes an FET driver 811, a charging FET 812, and a discharging FET 813.
- the charging FET 812 is connected to the positive terminal of the battery module 814
- the discharging FET 813 is connected to the positive charging terminal of the battery module 814.
- the battery unit 815 can be replaced by a separate battery module, which can back up each other and provide more freedom because they can be arranged in different positions according to actual needs.
- the charging FET 812 and the discharging FET 813 may be N-channel MOSFETs. Both the charging FET 812 and the discharging FET 813 are electrically connected to the FET driver 811. In response to a command from the battery monitor 810, the FET driver 811 can turn on/off the charging FET 812 and/or the discharging FET 813. When the charging FET 812 is turned on, it allows the charging current from the charging terminal CHR+ to flow into the battery cell 815 to charge the battery cell 815. When the discharge FET 813 is turned on, it allows the discharge current from the battery 815 to flow to the positive terminal of the battery module 814, so that the battery module 814 can supply power to other components of the robot assistant 100.
- FIGS. 31 and 32 only show one example of the power supply system 81, and the power supply system 81 may have more components than shown, or may have a different component configuration or arrangement.
- the power supply system 81 may further include a power generation and distribution system connected to the battery pack of FIG. 31.
- the power generation and distribution system may include a power system controller that manages the generation and distribution of different DC power supply voltages to the rest of the robot assistant.
- these power supply voltages may be 24V, 12V, and the voltage on PACK+ of actuators for robots, and 12V for other electronic devices of robot assistants.
- the power system controller can disable power in these different power outputs.
- the emergency stop switch can also cut off the power output of some of the power sources, so as to stop the actuator of the robot assistant in an emergency.
- the docking station used with the robot assistant is a fixed element connected to a wall socket.
- the robot assistant When the robot assistant is docked on the docking station, it uses the electricity available on the socket to generate a charging current to charge the battery pack of the robot assistant.
- the power system controller also allows docking to the docking station and battery charging process.
- the docking process also includes the beacon on the docking station and the beacon sensor on the robotic assistant power system, as well as the tits processor, motion controller and other sensing elements.
- the beacon on the docking station may include an infrared light emitting diode and its driving circuit.
- the docking sensor on the robot assistant power system may include an infrared sensitive phototransistor and its driving circuit.
- Figure 33A depicts three examples of user interfaces that can provide for receiving requests from care seekers, communicating with care seekers, and creating task requests.
- the user interface is presented on the display of the mobile device 910, and can be generated by a mobile application or a website.
- the mobile device 910 described as a mobile phone in this embodiment may include, but is not limited to, any mobile computing device such as a smart phone, a tablet computer, or a wearable computing device.
- the user interface includes a first user interface 911 that allows the healthcare professional to receive video communication requests from care seekers.
- Video communication refers to the transmission of information through real-time video streaming or through video sharing. Through this form of communication, the sender and recipient of the message can interact with each other using audio and video.
- the user interface also includes a second user interface 912 that allows the healthcare professional to communicate with the care seeker after accepting the video communication request. Healthcare professionals can understand the needs of people seeking care.
- the user interface also includes a third user interface 913 that allows healthcare professionals to create a task request including the object to be delivered and the location of the object to be delivered, and send the task request to a robot assistant 100 assigned to perform the task. Management system. The task request can be sent directly to a robot assistant 100 to perform the task.
- FIG. 33A only depicts an example of a user interface for the robot assistant 100, and more user interfaces with different elements may be provided.
- Figure 33B depicts an example of a user interface that can give a more holistic view of tasks.
- the user interface gives care providers intuitive fleet management and traceability. It can locate not only the robot assistant 100 at work, but also roaming healthcare professionals (such as nurses and doctors) or anywhere in the bedside or aged care facility. Seek caregivers (such as the elderly and patients).
- the user interface is presented on the display of the mobile device 920 and can be generated by a mobile application or a website.
- the mobile device 920 may be a tablet computer or a laptop computer with a display capable of displaying more content.
- the user interface presents a task description 921 to the user.
- the task description 921 may include the name of the object and the location where the object needs to be delivered.
- the user interface also includes a schematic floor plan 922 associated with the task.
- the profile images of the care seeker 923 and the healthcare professional 924 will be displayed on the floor plan of their location.
- the user interface also includes an image 925 representing the robot assistant 100 performing the current task.
- the position of the robot assistant 100 is updated in real time, and the position of the image 925 in the floor plan is adjusted accordingly.
- the direction of movement of the robot assistant can also be displayed.
- the user interface may further include buttons "change”, “cancel”, “task queue” and “record”, which allow users (eg, healthcare professionals) to adjust current tasks, access information on all tasks, and record audio.
- FIG. 33B only depicts an example of one user interface for the robot assistant 100, and more user interfaces with different elements may be provided.
- FIG. 33C depicts an example of a user interface that may be presented on the display of a personal computer (eg, desktop computer, laptop computer) 930 and generated by an application program. All the features of the mobile and tablet user interface mentioned above will be available. The information displayed can be customized for the care provider. For example, the user interface displays information about all tasks that one or more robotic assistants are performing or preparing to perform. The application is very suitable for healthcare managers or administrators to access the most data-rich user interface and have complete visibility into the entire operation. From prioritization to authorization, complete control is concentrated in the most efficient workflow. It should be noted that FIG. 33C only depicts an example of one user interface used with the robot assistant 100, and more user interfaces with different elements may be provided. All these user interfaces enable care providers to have the functions needed for "smart logistics", including responding to requests, optimizing task schedules, and determining optimal routes.
- a personal computer eg, desktop computer, laptop computer
- FIG. 34 is a flowchart showing a method of controlling the robot assistant 100 according to an embodiment, which includes the following steps. It should be noted that the order of the steps shown in FIG. 34 is not limited and can be changed according to actual needs.
- the wheel base 10 can be controlled to move to a certain position, and then before one or more drawers 21 are controlled to open, the drawer mechanism 20 can be controlled to move up/down to a certain position. Then, the foldable arm 30 and the EOAT 50 are controlled to grab one or more certain objects.
- Step S101 Receive a command instruction.
- the processor 71 of the control system 70 receives command instructions.
- the processor 71 may receive a command instruction from a user (eg, a healthcare professional) who requests the robot assistant 100 to retrieve an object from one location and deliver the object to another location.
- a user eg, a healthcare professional
- Step S201 Move the wheel base 10 in response to the first command instruction.
- the processor 71 may analyze each command instruction, and move the wheel base 10 to a determined position in response to the first command instruction.
- the first command instruction may include a description of the position that the robot assistant 100 needs to reach. For example, when a user (eg, a healthcare professional) requests the robot assistant 100 to acquire and deliver an object, the first command instruction may include a description of the starting position of the object storage and the target position of the object to be delivered.
- the processor 71 can execute software programs and/or instruction sets stored in the memory 72 to perform positioning, motion planning, and trajectory tracking, so that the wheel base 10 can determine its position in a known map during movement along the planned path. Real-time location. If there is a dynamic obstacle on the planned path (such as the obstacle in FIG. 25), the processor 71 can plan a new path to avoid the obstacle.
- the wheel base 10 can move autonomously, first to the starting position, and then to the target position.
- Step S301 Open or close one or more drawers 21 in response to the second command instruction.
- the processor 71 may analyze each command command and open or close one or more drawers 21 in response to the second command command.
- the processor may receive a second command instruction from a user (for example, a healthcare professional) to open or close one or more drawers 21.
- a user for example, a healthcare professional
- the processor 71 may open or close one or more drawers 21.
- the healthcare professional can use his/her company badge (typically a lanyard badge or wristband or other identification indicator) for the RFID sensor, using voice commands or facial recognition unlocking to authorize the drawer 21 Open.
- the RFID information of the company badge and/or the facial recognition information of the person can be uploaded to the tracking system.
- Step S801 Receive a command from the user or data from a sensor reflecting the user's intention.
- the processor 71 may receive a command from a user who tries to open or close the drawer 21.
- the processor 71 may receive data from one or more sensors that reflect the user's intention.
- one or more sensors may include a non-contact sensor (such as a camera) to detect user gestures associated with the user's intention to open/close the drawer 21.
- Step S802 Perform an obstacle check to determine whether there is an obstacle that will prevent the determined movement of the drawer 21.
- the processor 71 may determine whether there is an obstacle based on data from a collision detection sensor (for example, a force-sensitive resistor and a distance sensor), and the obstacle will prevent the determined movement of the drawer 21. If an obstacle is detected, the process proceeds to step S805, otherwise, the processor proceeds to step S804.
- Step S804 Control the determined drawer 21 to move.
- the processor 71 may control the drawer 21 to open or close in response to commands or data from the sensor.
- the processor 71 may output a visual and/or audio warning message to warn the user of potential abnormal conditions. Then, the processor 71 may suspend the response to the command or data from the sensor.
- Step S401 In response to the third command instruction, drive the movement of the foldable arm 30 and the EOAT 50 to pick up the external object from the determined position and place the external object to the determined position.
- the processor 71 can drive the movement of the foldable arm 30 and the EOAT 50 to pick up and place external objects in response to the third command instruction.
- the third command instruction may include a description of the position that the robot assistant 100 needs to reach and the object that needs to be delivered. After the robot assistant 100 has reached the determined position, the processor 71 may determine the position of the object. For example, the processor 71 may detect objects from a pre-trained list of items based on data from the camera 61 and possible supplementary range/proximity sensors (collectively referred to as "vision modules").
- the vision module can report the posture of the detected object relative to the camera 61 and the global coordinate frame. Fiducial tags/marks can be added to the container, features in the environment, and/or selected objects to make the detection more robust.
- the foldable arm 30 can help reposition and orient the vision module installed at the end of the foldable arm 30 to increase its default field of view and coverage. It can be used in scanning tasks to comprehensively search for surrounding target objects, and to compensate for the fixed focus of the camera module. Coordinated positioning and image acquisition can also be performed iteratively to maximize the accuracy of target positioning. Many target detection and recognition methods have been discussed in publications, such as papers and patents, and will not be described in detail here.
- the processor 71 may execute a motion planning algorithm to generate a probabilistic roadmap or PRM.
- PRM is a figure composed of points in an obstacle-free space. The straight lines between these points are called "edges", and direct movement between them will not cause collisions.
- the processor 71 can then control the foldable arm 30 to move in the unobstructed space.
- the processor 71 can move the finger of the EOAT 50 when the EOAT 50 approaches the determined object, which allows the EOAT 50 to grasp the determined object.
- the processor 71 can monitor the gripping force acting on the determined object, so that the fingers of the EOT 50 can grasp the determined object without sliding. Then, the processor 71 can control the foldable arm 30 to move to a certain drawer 21 in the barrier-free space. After the EOAT 50 has moved to a position within the predetermined range of the drawer 21, the processor 71 may then control the finger of the EOAT 50 to release the object. Then put the object in the drawer 21.
- an arm motion profile can be created to control the motion of the foldable arm 30.
- tracking includes unfolding the foldable arm 30 to the extended state, moving the foldable arm 30 to the leftmost position, moving the foldable arm 30 to the rightmost position, and folding the foldable arm 30 back to the original flat state.
- the foldable arm 30 is controlled to accelerate in the first 20% of each movement stage, then move at a constant speed in the next 60% of the time, and decelerate in the remaining 20% of each movement stage.
- step S401 may include the following steps.
- Step S402 locate the determined object.
- Step S403 Move the foldable arm 30 and the EOAT 50 to the pre-grabbing posture.
- Step S404 Determine whether the EOAT 50 has moved to the pre-grabbing posture. If the EOAT 50 has been moved to the pre-grabbing posture, the process proceeds to step S405; otherwise, the process returns to step S403.
- Step S405 Control the EOAT 50 to grab the object.
- Step S406 It is determined whether the object is successfully grasped. If the object has been grasped successfully, the process proceeds to step S407; otherwise, the process returns to step S404.
- Step S407 Control the foldable arm 30 and the EOAT 50 to move and place the object to a determined position.
- Step S501 In response to the fourth command instruction, the lifting mechanism 40 is controlled to move the drawer mechanism 20 up and down.
- the processor 71 may control the lifting mechanism 40 to move the drawer mechanism 20 up and down in response to the fourth command instruction.
- the fourth command instruction may include a description of the position that the robot assistant 100 needs to reach and the object that needs to be delivered.
- the processor 71 After the processor 71 has determined the location of the object, it can determine the accessibility to the object. According to the determined accessibility, the processor 71 may control the lifting mechanism 40 to move the drawer mechanism 20 upward so that the foldable arm 30 can reach the determined object. In the process of putting the object into the drawer, the processor 70 may control the lifting mechanism 40 to move the drawer mechanism 20 down to its original lowered position.
- FIG. 38 is a flowchart showing a method of controlling the robot assistant 100 according to an embodiment, which includes the following steps.
- Step S601 At least according to the movement of the wheel base 10, an environment map is created based on at least one sensor.
- simultaneous localization and mapping (SLAM) can be used to create a map of the environment.
- SLAM realizes synchronous positioning and map construction based on self-awareness.
- SLAM can combine data from different sensors to calculate location and build a map at the same time.
- the robot assistant 100 Starting from an unknown position in an unknown environment, the robot assistant 100 locates its own position and orientation by repeatedly observing environmental features during movement, and then constructs an incremental map of the surrounding environment based on its own position, thereby achieving synchronous positioning and positioning.
- Two common SLAM methods include visual SLAM and LiDAR-based SLAM.
- a LiDAR-based SLAM may be used to create an environment map, which combines data from the LiDAR sensor 63 and the IMU sensor 66.
- a visual SLAM combining data from camera 62 and IMU sensor 66 may be used to create a map of the environment.
- other types of SLAM methods can be used to calculate the location and build the map at the same time.
- Step S602 Determine the current position of the robot assistant 100 in the environment map.
- a LiDAR-based SLAM may be used to determine the real-time direction and position of the robot assistant 100.
- the real-time direction and position of the robot assistant 100 can be determined using visual SLAM.
- the real-time direction and position of the robot assistant 100 in the previously created environment map can be determined by using adaptive Monte Carlo positioning (AMCL). Specifically, if there is an environment map, the AMCL algorithm uses a particle filter to represent the distribution of possible states, and each particle represents a possible state, that is, the hypothesis where the robot assistant 100 is located.
- AMCL adaptive Monte Carlo positioning
- the algorithm usually starts with a uniform random distribution of particles in the configuration space, which means that the robot assistant 100 has no information about where it is and assumes that it is equally likely at any point in the space. Whenever the robot assistant 100 moves, it moves the particles to predict the new state after the movement. Whenever the robot assistant 100 senses something, the particles are resampled based on a recursive Bayesian estimation (ie, how closely the actual sensed data is related to the predicted state). Eventually, the particles should converge toward the actual position of the robot assistant 100.
- Step S603 While the robot assistant 100 is moving along the determined path, instruct the robot assistant 100 to avoid obstacles.
- the A-star algorithm can be used to determine the collision-free path of the robot assistant 100.
- the purpose of the A-star algorithm is to avoid collisions with obstacles, and to deal with the problem of the mobile robot assistant 100 based on feedback information from sensors (for example, LiDAR sensor 63, IMU sensor 66, camera 62).
- the A-star algorithm can modify the trajectory of the robot assistant 100 in real time, so that the robot assistant 100 can avoid collisions with dynamic obstacles found on its path.
- the A-star algorithm uses a grid-based search area divided into squares. Each square can be a free space or an obstacle.
- a collision-free trajectory composed of free space squares (also called nodes) is calculated.
- the A-star algorithm provides efficient and complete path finding. However, other obstacle avoidance algorithms may be used to determine the collision-free path of the robot assistant 100.
- the Dijkstra algorithm can be used to determine the collision-free path of the robot assistant 100.
- Dijkstra algorithm is a graph search algorithm, which solves the single-source shortest path problem of graphs with non-negative edge path costs, and generates the shortest path tree. For a given source vertex (node) in the graph, the algorithm finds the path with the lowest cost (namely the shortest path) between the vertex and every other vertex. Specifically, let the distance of node Y be the distance from the initial node to Y. Dijkstra's algorithm will assign some initial distance values and try to improve them step by step.
- Step 1 Specify a tentative distance value for each node: for the initial node, set it to zero, and for all other nodes, set it to infinity.
- Step 2 Mark all unvisited nodes. Set the initial node as the current node. Create a group of unvisited nodes, called the unvisited set composed of all nodes.
- Step 4 After all neighbors of the current node are considered, mark the current node as visited and remove it from the unvisited set. The visited nodes will no longer be checked.
- Step 5 If the target node has been marked as visited (when planning a path between two specific nodes), or if the minimum tentative distance between nodes in the unvisited set is infinity (when planning a complete traversal When there is no connection between the initial node and the remaining unvisited nodes), then stop. The algorithm is over.
- Step 6 Select the unvisited node marked with the smallest tentative distance, set it as the new "current node", and then return to step 3.
- the Dijkstra algorithm can modify the trajectory of the robot assistant 100 in real time, so that the robot assistant 100 can avoid collisions with dynamic obstacles found on its path.
- trajectory tracking control may be performed to control the robot assistant 100 to track the planned path.
- a motion controller based on a nonlinear proportional integral derivative (PID) may be used to perform trajectory tracking control.
- the PWM signal is generated according to the input PWM value, and is fed to the motor controller of the base motor 1101 to drive the base motor 1101. It should be noted that many methods have been proposed for the trajectory tracking control of the wheeled robot by using the PID motion controller, which can be used for the trajectory tracking control of the robot assistant 100.
- the kinematics model can be used to optimize the Denavit-Hartenberg (DH) parameters of the foldable arm 30a, so that the foldable arm 30a can have maximum accessibility to one or more working spaces in the drawer 21.
- the joint 1 refers to a rotary joint that drives the first link 31a of the foldable arm 30a to rotate about a first vertical axis.
- the joint 2 represents a rotary joint, which drives the second link 32a to rotate relative to the first link 31a about a second axis that is substantially perpendicular to the first axis.
- the joint 3 represents a revolute joint, which drives the third link 33a to rotate relative to the second link 32a about a third axis that is substantially parallel to the second axis.
- Joints 4, 5, and 6 respectively represent driving the fourth link 34a to rotate relative to the third link 33a, driving the fifth link 35a to rotate relative to the fourth link 34a, and driving the sixth link 36a relative to the fifth link. 35a rotating revolute joint.
- the joints 1 to 6 are arranged based on the foldable arm 30a in a flat state.
- FIG. 40A is a schematic diagram showing the structure and boundary of the foldable arm, which shows an optimization problem of the working space.
- the longitudinal direction of the drawer mechanism 20 is the X axis
- the lateral direction of the drawer mechanism 20 is the Y axis
- the longitudinal direction of the drawer mechanism 20 is the Z axis to establish a reference coordinate system.
- the coordinates of the center of the top plate of the drawer mechanism 20 are (x, y, -z), where x, y, and z are greater than zero.
- the projection of joints 1-6 on the X-Y plane is shown in Figure 40B.
- the projection of joint 1 on the X-Y plane is a point that coincides with the origin of the base coordinate system.
- the projection of joint 2 on the X-Y plane is a line segment located on the X axis.
- the projection of joint 3 on the X-Y plane is a line segment perpendicular to the projection of joint 2.
- the projections of joints 4 to 6 on the X-Y plane are represented by line segments parallel to the projection of joint 2.
- d1 is the distance between the joint 2 and the top plate of the drawer mechanism 20.
- d2 is the distance between the projection center of the joint 2 and the origin of the base coordinate system.
- a2 is equal to the projection length of the line segment on the X axis, which starts from the center of joint 2 and ends at the center of joint 3.
- d3 is equal to the projection length of the line segment on the Y axis, which starts from the center of joint 2 and ends at the center of joint 3.
- d4 is the distance between the projection centers of joints 3 to 6.
- FIG. 39 is a flowchart showing a method for determining the parameters of the foldable arm 30a according to an embodiment.
- the method may include the following steps.
- Step S701 Receive information about the movement structure of the foldable arm 30a, the joint angle of the foldable arm 30a when the foldable arm 30a is folded, the size of the drawer 21, and the outer envelope of the foldable arm 30a. This information includes information associated with the above-mentioned movement structure of the foldable arm 30a.
- the joint angle of the foldable arm 30a refers to the angle of the rotation joint of the foldable arm 30a when the foldable arm 30a is in a folded and flat state, as shown in FIG. 1A.
- the size of the drawer 21 includes the width, length and depth of the drawer 21.
- Step S702 randomly generating DH parameters of the foldable arm 30a.
- the parameters may include the coordinates x and y of the center of the top plate of the drawer mechanism 20, and the distances d1, d2, a2, d3, d4, and d6, where d6 is the difference between the projection center of joints 4 to 6 and the center of EOAT 50 The distance between. Random values will be generated and assigned to these parameters.
- Step S703 Determine whether the foldable arm 30a can be folded within the boundary of the top plate of the drawer mechanism 20. After assigning random values to x, y, d1, d2, a2, d3, d4, and d6, it can be determined based on the information received at step S701 whether there are joints 1 to 6 and points on EOAT 50 that fall on a predetermined Outside the area. If so, the foldable arm 30a cannot be folded within the boundary of the top plate of the drawer mechanism 20 due to the collision with the arm guard 281, and the flow returns to step S702. Otherwise, the process goes to step S703.
- the predetermined area is a rectangular area smaller than the top plate of the drawer mechanism 20.
- the maximum radius of each link of the foldable arm 30a is not greater than 0.05m
- the distance between the long side of the predetermined area and the long side of the top plate of the drawer mechanism 20 is not less than 0.05m, and the same applies to the predetermined area
- the distance between the short side and the top plate of the drawer mechanism 20 can also be a factor in determining the predetermined area.
- Step S704 Determine the accessibility of the foldable arm 30a to the working space of the drawer 21.
- the work space accessibility here refers to the ratio of the volume in the drawer 21 that the EOAT 50 can reach to the total volume of the space in the drawer 21.
- Work space accessibility can be used to evaluate whether the movement configuration of the foldable arm 30a is sufficient to complete the required task. Many methods have been proposed to determine the workspace that the robot EOAT can reach.
- one method uses an algorithm based on direct kinematics to calculate reachable workspace points.
- the redundant manipulator is modeled as a series of links connected with rotary joints or prismatic joints. It is assumed that each joint has a degree of freedom without loss of generality. Joints with m degrees of freedom are modeled as m joints connected to a zero-length link. In order to describe the relationship between two consecutive links, a coordinate frame is attached to each case.
- the homogeneous matrix Ai is used to describe the relationship between successive frames.
- the elements of matrix A are calculated using Denavit–Hartenberg notation for prismatic joints and rotation joints.
- the Denavit–Hartenberg (DH) convention is used to assign coordinate frames to each joint of the manipulator in a simplified and consistent way.
- the transformation matrix A of the rotation joint is:
- the four quantities ⁇ i, ai, di, and ⁇ i are parameters related to the link i and the joint i.
- the four parameters ai, ⁇ i, di, and ⁇ i are in, and they usually give the names of link length, link twist, link offset, and joint angle, respectively.
- the DH convention of robot manipulators is well known and will not be described in detail here. If it is a rotary joint ( ⁇ i), it is called an angle variable, and the other three fixed quantities (di, ai, ⁇ i) are called link parameters.
- the computational cost of calculating each point is ⁇ (n), where n is the number of degrees of freedom associated with the joint in the path from the end effector to the proximal link.
- the working space points calculated by direct kinematics are not necessarily located on the boundary of the curved surface.
- the edge detection algorithm can be used to obtain the working space boundary and the holes and cavities hidden in the reachable working space. This can be achieved by calculating the size of the cube containing the workspace points. This cube is divided into multiple units based on the resolution required by the application.
- the matrix Tn is a square matrix with a dimension of 4x4.
- the first, second, and third elements in the last column of this matrix are the x-coordinate, y-coordinate and z-coordinate of the position of the end effector in the base coordinate system. In this way, you can determine the point that is located in the drawer and that the EOAT 50 can reach. Therefore, the accessibility of the working space of the drawer 21 can be determined. That is, the ratio of the volume occupied by these points to the total volume of the space in the drawer 21 can be determined.
- inverse kinematics can be used to calculate the reachable working space.
- inverse kinematics is the mathematical process of calculating the variable joint parameters required to place the robot end effector in a given position and direction. For a given position, if there are one or more solutions for the joint parameters, the given position is the reachable position. As shown in Figure 40D, the three-dimensional grid of points inside the drawer will be checked to determine which of these points can reach the EOAT of the foldable arm. For the position of each point, inverse kinematics expressions will be used to calculate to determine whether there are one or more solutions to the joint parameters that enable EOAT 50 to reach the point. These points can be checked in a predetermined order.
- Step S705 Determine whether there is reference reachability. If there is reference reachability, the process proceeds to step S707, otherwise, the process proceeds to step S706.
- Step S706 Select the current work area reachability as the reference reachability.
- Step S707 Compare the current work area reachability with the reference reachability, and select the larger one as the reference reachability.
- Step S708 It is determined whether the determination of the accessibility of the working space in step S704 reaches a predetermined number of times. If the determination of the accessibility of the workspace in step S704 has reached the predetermined number of times, the flow proceeds to step S709, otherwise, the flow returns to step S702.
- the value of the predetermined number of times may be set to 1000.
- Step S709 Output the parameters of the foldable arm 30a corresponding to the reference reachability.
- step S704 when the determination of the accessibility of the workspace in step S704 does not reach the predetermined number of times, then it is determined whether the number of determinations of the accessibility of the workspace in step S704 is greater than a preset value (for example, 10). If so, the process goes to step S710, otherwise, the process returns to step S702.
- a preset value for example, 10
- Step S710 Generate the parameters of the foldable arm 30a by randomly changing ⁇ n% of each parameter of the foldable arm 30a associated with the reference reachability, where n is greater than zero. Then, the flow returns to step S703.
- the parameters determined according to the method of FIG. 39 make the foldable arm 30a have satisfactory working space accessibility to the drawer 21, so that the EOAT 50 can reach almost any position in the drawer 21.
- the accessibility of the foldable arm 30a in/on the work space of the shelf can also be evaluated.
- the width and depth of the shelf is 0.35 m, which is half of the width of the drawer 21.
- the distance from the back of the drawer mechanism 20 to the shelf can be set to 0.21 m, which is the radius required for the robot assistant 100 to rotate 90 degrees.
- the accessibility to the work space of the shelf can be determined in the same or similar manner as the accessibility of the work space of the drawer 21 described above.
- the foldable arm 30a can reach most of the positions in the shelf by means of the lifting mechanism.
- the accessible working space includes a fully accessible working space, a lower part of the accessible working space, and an upper part of the accessible working space, as shown in Figures 40A and 40B.
- the robot assistant 100 can be used in assisted living places or medical care places to provide an unsupervised end-to-end logistics solution.
- the present invention is not limited to this.
- the robot assistant 100 can be used in schools, offices, warehouses, and the like.
Abstract
Description
Claims (20)
- 一种机器人助理,其特征在于,包括:轮式基座;包括一个或多个抽屉的贮存单元;可折叠臂,其包括连接至所述可折叠臂的远端的臂端工具,所述可折叠臂连接至所述贮存单元的顶部;在轮式基座上定位的升降机构,所述升降机构被配置为上下移动所述贮存单元;及接收命令指令的控制系统,响应于该命令指令,该控制系统被配置为:移动轮式基座,打开或关闭所述一个或多个抽屉,驱动所述可折叠臂和臂端工具的运动,以从确定的位置拾取外部物体和放置外部物体到确定的位置,及控制所述贮存单元驱动所述一个或多个抽屉。
- 如权利要求1所述的机器人助理,其特征在于,所述升降机构包括致动器和提升机构,所述提升机构连接到贮存单元和轮式基座,所述致动器固定到轮式基座并被配置为驱动所述提升机构以在竖直方向上伸长或缩回。
- 如权利要求1所述的机器人助理,其特征在于,所述贮存单元包括壳体以及一个或多个驱动装置,所述一个或多个驱动装置被配置为驱动所述一个或多个抽屉相对于所述壳体滑动到打开位置和关闭位置。
- 如权利要求1所述的机器人助理,其特征在于,所述可折叠臂包括N个连杆、M个第一旋转关节和一个第二个旋转关节,所述N个连杆通过所述M个第一旋转关节可旋转地彼此串联连接,所述N个连杆中的第一个通过所述第二旋转关节可旋转地连接到所述贮存单元的顶部,其中N是大于2的自然数, 并且N=M+1。
- 如权利要求4所述的机器人助理,其特征在于,还包括摄像头,该摄像头被配置为侦测物体,所述控制系统通过所述N个旋转关节和N个连杆中的一个或多个的连接指示所述可折叠臂处于确定的方向和/或位置,及基于来自所述摄像头的输出根据所述命令指令指示所述臂端工具从所述一个或多个抽屉中拾取外部物体和放置外部物体到所述一个或多个抽屉中。
- 如权利要求5所述的机器人助理,其特征在于,所述摄像头位于所述可折叠臂上且靠近所述臂端工具,或者位于所述臂端工具之上/之中。
- 如权利要求1所述的机器人助理,其特征在于,还包括用于保护所述可折叠臂的臂护装置,所述臂护装置是固定的或可缩回的。
- 如权利要求2所述的机器人助理,其特征在于,所述致动器是线性致动器,其被配置为向所述提升机构施加推力或拉力以驱动所述提升机构在竖直方向上伸长或缩回。
- 如权利要求1所述的机器人助理,其特征在于,还包括连接到所述轮式基座的多个致动脚,所述控制系统指示所述致动脚向下移动以与一表面接触。
- 如权利要求1所述的机器人助理,其特征在于,所述可折叠臂被配置成以大体上平坦的状态折叠在所述贮存单元的顶部上。
- 一种机器人助理,其特征在于,包括:轮式基座;包括一个或多个抽屉的抽屉机构;连接到所述抽屉机构的顶部的可折叠臂,该可折叠臂包括臂端工具,响应于命令指令,所述臂端工具被配置为通过所述可折叠臂的驱动来从确定的位置 拾取外部物体及放置外部物体到确定的位置;及定位于所述轮式基座上的升降机构,该升降机构配置为上下移动所述一个或多个抽屉。
- 如权利要求11所述的机器人助理,其特征在于,所述确定的位置是完全打开后的所述一个或多个抽屉中的位置。
- 如权利要求11所述的机器人助理,其特征在于,所述升降机构包括致动器和提升机构,所述提升机构连接到所述抽屉机构和轮式基座,所述致动器被固定到轮式基座,并且被配置成驱动所述提升机构在竖直方向上伸长或缩回。
- 如权利要求11所述的机器人助理,其特征在于,所述抽屉机构包括壳体以及一个或多个驱动装置,该驱动装置备配置成驱动一个或多个抽屉相对于壳体滑动至打开位置和闭合位置。
- 如权利要求11所述的机器人助理,其特征在于,所述可折叠臂包括N个连杆、M个第一旋转关节和一个第二个旋转关节,所述N个连杆通过所述M个第一旋转关节可旋转地彼此串联连接,所述N个连杆中的第一个通过所述第二旋转关节可旋转地连接到所述抽屉机构,其中N是大于2的自然数,并且N=M+1。
- 如权利要求15所述的机器人助理,其特征在于,还包括摄像头,该摄像头被配置为侦测物体,一控制系统通过所述N个旋转关节和N个连杆中的一个或多个的连接指示所述可折叠臂处于确定的方向和/或位置,及基于来自所述摄像头的输出根据所述命令指令指示所述臂端工具从所述一个或多个抽屉中拾取外部物体和放置外部物体到所述一个或多个抽屉中。
- 如权利要求16所述的机器人助理,其特征在于,所述摄像头位于所述可折叠臂上且靠近所述臂端工具,或者位于所述臂端工具之上/之中。
- 如权利要求11所述的机器人助理,其特征在于,所述可折叠臂被配置为在所述抽屉机构的顶部上以基本平坦的状态折叠。
- 一种机器人助理,其特征在于,包括:轮式基座;贮存单元;可折叠臂,其包括连接至所述可折叠臂的远端的臂端工具,所述可折叠臂连接至所述贮存单元的顶部,所述臂端工具被配置为通过所述可折叠臂的驱动来从确定的位置拾取外部物体及放置外部物体到确定的位置;及定位于所述轮式基座上的升降机构,该升降机构配置为上下移动所述一个或多个抽屉。
- 如权利要求11所述的机器人助理,其特征在于,所述升降机构包括致动器和提升机构,所述提升机构连接到所述提升机构和轮式基座,所述致动器被固定到轮式基座,并且被配置成驱动所述提升机构在竖直方向上伸长或缩回。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2022567374A JP2023524550A (ja) | 2020-05-09 | 2021-04-30 | ロボットアシスタント |
CN202211421838.9A CN116021495A (zh) | 2020-05-09 | 2021-04-30 | 轮式基座 |
KR1020227042415A KR20230004866A (ko) | 2020-05-09 | 2021-04-30 | 로봇 어시스턴트 |
CN202180003315.XA CN114025922A (zh) | 2020-05-09 | 2021-04-30 | 机器人助理 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/870,903 US11518042B2 (en) | 2020-05-09 | 2020-05-09 | Robotic assistant |
US16/870,903 | 2020-05-09 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021227900A1 true WO2021227900A1 (zh) | 2021-11-18 |
Family
ID=78412106
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/091582 WO2021227900A1 (zh) | 2020-05-09 | 2021-04-30 | 机器人助理 |
Country Status (5)
Country | Link |
---|---|
US (2) | US11518042B2 (zh) |
JP (1) | JP2023524550A (zh) |
KR (1) | KR20230004866A (zh) |
CN (2) | CN116021495A (zh) |
WO (1) | WO2021227900A1 (zh) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10814489B1 (en) * | 2020-02-28 | 2020-10-27 | Nimble Robotics, Inc. | System and method of integrating robot into warehouse management software |
KR102557033B1 (ko) * | 2021-12-02 | 2023-07-19 | 주식회사 씨랩 | 탄성 그리퍼를 구비한 수중드론 로봇암 |
WO2023110818A1 (en) * | 2021-12-14 | 2023-06-22 | Eeve Bv | A multi-functional robot with integrated container and extendable tool system |
EP4309611A1 (en) * | 2022-07-20 | 2024-01-24 | Cyber Surgery, S.L. | Parking robot system |
KR102604615B1 (ko) | 2023-01-25 | 2023-11-22 | 서정원 | 진료 협업 로봇 운영 시스템 및 그 구동방법 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150032252A1 (en) * | 2013-07-25 | 2015-01-29 | IAM Robotics, LLC | System and method for piece-picking or put-away with a mobile manipulation robot |
CN104552230A (zh) * | 2013-10-22 | 2015-04-29 | 西华大学 | 图书馆取书机器人 |
CN107520848A (zh) * | 2016-06-16 | 2017-12-29 | 康茂股份公司 | 机器人单元 |
CN207071924U (zh) * | 2017-07-12 | 2018-03-06 | 贝肯智能科技(苏州)有限公司 | 一种可送样的取样机械手 |
CN207858826U (zh) * | 2018-01-24 | 2018-09-14 | 深圳市大象机器人科技有限公司 | 一种机器人工作站 |
CN109352571A (zh) * | 2018-12-11 | 2019-02-19 | 沈阳航空航天大学 | 一种基于语音识别的智能扳手更换车 |
US20190291955A1 (en) * | 2018-03-20 | 2019-09-26 | Bastian Solutions, Llc | Robotic shuttle system |
CN110654804A (zh) * | 2019-10-09 | 2020-01-07 | 广州大学 | 一种物流机器人自动装卸系统 |
CN210161132U (zh) * | 2018-12-26 | 2020-03-20 | 莱森姆智能科技(常州)有限公司 | 一种移动式机器人平台 |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6443543B1 (en) * | 2001-04-06 | 2002-09-03 | Wayne Chiang | Mobile personal computer |
JP4129452B2 (ja) * | 2004-11-30 | 2008-08-06 | 株式会社東芝 | 移動ロボット |
US9428336B2 (en) * | 2010-07-28 | 2016-08-30 | Par Systems, Inc. | Robotic storage and retrieval systems |
CN104786236A (zh) * | 2015-04-30 | 2015-07-22 | 北京特种机械研究所 | 一种用作工业机器人底盘的全向智能移动平台 |
KR20230098694A (ko) * | 2015-09-04 | 2023-07-04 | 마코 서지컬 코포레이션 | 휴대용 외과 로봇의 조향 메커니즘 |
CN105397817A (zh) * | 2015-12-22 | 2016-03-16 | 山东鲁班机械科技有限公司 | 一种应急救援机器人 |
CN205852774U (zh) * | 2016-07-27 | 2017-01-04 | 太原科技大学 | 多功能整理机器人 |
CN108247598A (zh) * | 2016-12-28 | 2018-07-06 | 大连四达高技术发展有限公司 | 智能agv升降机器人制孔系统 |
WO2019213900A1 (zh) * | 2018-05-10 | 2019-11-14 | 深圳蓝胖子机器人有限公司 | 一种货物装卸车、货物转运系统及其自动调平方法 |
US10556334B1 (en) * | 2018-07-13 | 2020-02-11 | Vecna Robotics, Inc. | System and method of asynchronous robotic retrieval and delivery of items between two sites |
US10549915B1 (en) * | 2018-07-13 | 2020-02-04 | Vecna Robotics, Inc. | System and method of asynchronous robotic retrieval and delivery of items |
DE102018217471A1 (de) * | 2018-10-12 | 2020-04-16 | Krones Ag | Modulares Robotersystem für eine Behälterverarbeitungsanlage |
CN209111089U (zh) * | 2018-11-30 | 2019-07-16 | 宣城市安工大工业技术研究院有限公司 | 一种防线缆缠绕的智能钻孔机器人 |
CN209758195U (zh) * | 2019-02-01 | 2019-12-10 | 深圳市海柔创新科技有限公司 | 一种搬运机器人 |
CN109986580B (zh) * | 2019-04-29 | 2022-03-25 | 宁波大学 | 一种仿生家用移动式助理机器人 |
-
2020
- 2020-05-09 US US16/870,903 patent/US11518042B2/en active Active
- 2020-07-07 US US16/923,069 patent/US11511437B2/en active Active
-
2021
- 2021-04-30 JP JP2022567374A patent/JP2023524550A/ja active Pending
- 2021-04-30 CN CN202211421838.9A patent/CN116021495A/zh active Pending
- 2021-04-30 WO PCT/CN2021/091582 patent/WO2021227900A1/zh active Application Filing
- 2021-04-30 CN CN202180003315.XA patent/CN114025922A/zh active Pending
- 2021-04-30 KR KR1020227042415A patent/KR20230004866A/ko unknown
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150032252A1 (en) * | 2013-07-25 | 2015-01-29 | IAM Robotics, LLC | System and method for piece-picking or put-away with a mobile manipulation robot |
CN104552230A (zh) * | 2013-10-22 | 2015-04-29 | 西华大学 | 图书馆取书机器人 |
CN107520848A (zh) * | 2016-06-16 | 2017-12-29 | 康茂股份公司 | 机器人单元 |
CN207071924U (zh) * | 2017-07-12 | 2018-03-06 | 贝肯智能科技(苏州)有限公司 | 一种可送样的取样机械手 |
CN207858826U (zh) * | 2018-01-24 | 2018-09-14 | 深圳市大象机器人科技有限公司 | 一种机器人工作站 |
US20190291955A1 (en) * | 2018-03-20 | 2019-09-26 | Bastian Solutions, Llc | Robotic shuttle system |
CN109352571A (zh) * | 2018-12-11 | 2019-02-19 | 沈阳航空航天大学 | 一种基于语音识别的智能扳手更换车 |
CN210161132U (zh) * | 2018-12-26 | 2020-03-20 | 莱森姆智能科技(常州)有限公司 | 一种移动式机器人平台 |
CN110654804A (zh) * | 2019-10-09 | 2020-01-07 | 广州大学 | 一种物流机器人自动装卸系统 |
Also Published As
Publication number | Publication date |
---|---|
CN116021495A (zh) | 2023-04-28 |
JP2023524550A (ja) | 2023-06-12 |
CN114025922A (zh) | 2022-02-08 |
KR20230004866A (ko) | 2023-01-06 |
US11511437B2 (en) | 2022-11-29 |
US11518042B2 (en) | 2022-12-06 |
US20210347060A1 (en) | 2021-11-11 |
US20210347059A1 (en) | 2021-11-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021227900A1 (zh) | 机器人助理 | |
US11396096B2 (en) | Humanoid robotics system and methods | |
Jain et al. | EL-E: an assistive mobile manipulator that autonomously fetches objects from flat surfaces | |
US10265227B2 (en) | Mobile human-friendly assistive robot | |
Graf et al. | Care-O-bot II—Development of a next generation robotic home assistant | |
JP3601737B2 (ja) | 搬送ロボットシステム | |
Hashimoto et al. | A field study of the human support robot in the home environment | |
US20160362147A1 (en) | Dynamically stable stair climbing home robot | |
Hendrich et al. | Architecture and software design for a service robot in an elderly-care scenario | |
EP2214111A2 (en) | Medical tele-robotic system | |
US11642780B2 (en) | Monitoring of surface touch points for precision cleaning | |
US20230072318A1 (en) | Robotic assistant and method for controlling the same | |
US11806303B2 (en) | Robotic walking assistant | |
Cremer et al. | Application requirements for robotic nursing assistants in hospital environments | |
Falck et al. | Human-centered manipulation and navigation with Robot DE NIRO | |
Lee et al. | A self-reliance assistive tool for disable people | |
Hermann et al. | Hardware and software architecture of a bimanual mobile manipulator for industrial application | |
Elarbi-Boudihir et al. | Eye-in-hand/eye-to-hand configuration for a wmra control based on visual servoing | |
Pudchuen et al. | Medical Telerobotic: IRAPs SHaRE-aGIVeR | |
US20240139957A1 (en) | Mobile robotic arm configured to provide on-demand assistance | |
Hendrich et al. | Robotics | |
SureshKumar et al. | Design and development of indoor mobile robot for disabled people | |
Sun et al. | Food Basket Delivery with the Stretch RE1 | |
Versluis et al. | Collaborative control aspects for rehabilitation robots | |
Hannigan | Endpoint force sensing for mobile manipulators |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21803680 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022567374 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 20227042415 Country of ref document: KR Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21803680 Country of ref document: EP Kind code of ref document: A1 |