EP4587228A1 - Humanoid robot with tracks on legs configured for stand up sequence - Google Patents
Humanoid robot with tracks on legs configured for stand up sequenceInfo
- Publication number
- EP4587228A1 EP4587228A1 EP23818365.1A EP23818365A EP4587228A1 EP 4587228 A1 EP4587228 A1 EP 4587228A1 EP 23818365 A EP23818365 A EP 23818365A EP 4587228 A1 EP4587228 A1 EP 4587228A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- robot
- track
- main body
- robot according
- surveying
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D57/00—Vehicles characterised by having other propulsion or other ground- engaging means than wheels or endless track, alone or in addition to wheels or endless track
- B62D57/02—Vehicles characterised by having other propulsion or other ground- engaging means than wheels or endless track, alone or in addition to wheels or endless track with ground-engaging propulsion means, e.g. walking members
- B62D57/028—Vehicles characterised by having other propulsion or other ground- engaging means than wheels or endless track, alone or in addition to wheels or endless track with ground-engaging propulsion means, e.g. walking members having wheels and mechanical legs
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J13/00—Controls for manipulators
- B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
- B25J13/081—Touching devices, e.g. pressure-sensitive
- B25J13/084—Tactile sensors
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
- B25J19/02—Sensing devices
- B25J19/021—Optical sensing devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J5/00—Manipulators mounted on wheels or on carriages
- B25J5/005—Manipulators mounted on wheels or on carriages mounted on endless tracks or belts
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Program-controlled manipulators
- B25J9/10—Program-controlled manipulators characterised by positioning means for manipulator elements
- B25J9/104—Program-controlled manipulators characterised by positioning means for manipulator elements with cables, chains or ribbons
- B25J9/1045—Program-controlled manipulators characterised by positioning means for manipulator elements with cables, chains or ribbons comprising tensioning means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Program-controlled manipulators
- B25J9/16—Program controls
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/40—Robotics, robotics mapping to robotics vision
- G05B2219/40264—Human like, type robot arm
Definitions
- the invention relates generally to a mobile robot configured to provide metrology grade measurements in production environments. E.g., to generally support quality control, and especially lengthy, high-precision measurement or calibration activities that require long-term, concentrated effort and/or non-natural bodily gestures by a human operator.
- a further object is to provide increased mobility for the mobile robot as a whole and/or for the measurement implements of the robot.
- One aspect of the invention relates to a humanoid robot.
- the robot comprises a main body and two mechanically actuated legs attached to the main body at a lower portion of the main body by respective upper leg joints located at opposing sides of the main body.
- many aspects of the invention are discussed in details, respectively illustrated, via humanoid robots. Nevertheless, the applicability of the aspects of the inventions, unless explicitly provided, are not limited to humanoid robot.
- terms such as “leg,” “arm,” “head,” etc. are not to be construed as representing structurally identical, or not even similar, components of a human body part.
- Each of the legs of the robot can be swiveled independently of the other leg about a respective swivel axis of the corresponding upper leg joint.
- Each of the legs comprises corresponding upper and lower parts, which are connected to each other via a lower leg joint and can be swiveled against each other about an axis of the lower leg joint.
- the upper leg joint might also be referred to as "hip joint”, while the lower leg joint might also be referred to as "knee joint”.
- Each of the lower parts comprises a track drive comprising a track running over a lower pulley and an upper pulley.
- the track drive provides a running surface between the lower and the upper pulley.
- the lower pulley is arranged at a distal end away from the lower leg joint and the upper pulley is arranged closer to the lower leg joint than the lower pulley.
- Each of the lower leg joints is configured to provide 360° rotatability for the lower part about the axis of the lower leg joint and the robot is configured to provide a stand-up sequence.
- the stand-up sequence comprises (i) establishing an inverted state of the two lower parts, and (ii) raising the upper pulleys from the ground by swiveling the lower leg joints in opposing directions.
- a first vector extending from the upper pulley to the lower pulley of one of the two lower parts and a second vector extending from the upper pulley to the lower pulley of the other of the two lower parts point to opposite sides of the robot.
- the first vector points to an area in front of the robot and the second vector points to an area in the back of the robot.
- the swiveling of the lower leg joint might be realized in a passive manner, when the swiveling is a consequence of an action of another component of the track drive, e.g., by driving the track.
- the swiveling can also be actively realized by a drive element assigned to the joint causing a targeted swiveling movement, in particular independently of the other elements of the leg.
- the swiveling can also be realized as a combination of the above.
- the robot might select the type of stand-up action based on the internal or external conditions, in particular the ground conditions.
- the first vector comprises a forward pointing component and the second vector comprises a backward pointing component, defined with respect to (i) a central body axis disposed between the upper leg joints and extending in a direction perpendicular to a leg suspension axis connecting the upper leg joints, and (ii) a middle plane comprising the leg suspension axis and the central body axis.
- the forward and backward pointing components are perpendicular to the middle plane and point to opposite directions.
- each of the lower pulleys is farther away from the central body axis than the corresponding upper pulley.
- one of the lower parts is completely located in a front domain and the other lower part is completely located in a rear domain.
- the front domain is the domain on one side of the middle plane and the rear domain is the domain on the other side of the middle plane.
- each of the lower parts is partly located in a front domain and partly located in a rear domain, wherein the front domain is the domain on one side of the middle plane and the rear domain is the domain on the other side of the middle plane.
- One upper pulley and one lower pulley might be located in the front domain and one upper pulley and one lower pulley might be located in the rear domain.
- the axes ofthe lower leg joints are parallel to each other. In some specific embodiments the axes ofthe lower leg joints are aligned to leg suspension axis connecting the upper leg joints.
- the robot is configured to provide locomotion by track locomotion both in a stand-up mode and in a full track mode.
- the stand-up mode provides a surface contact face of the running surface that has smaller area size than a surface contact face of the running surface provided by the full track mode.
- the robot automatically arranges the lower part relative to the upper part such that during the locomotion the upper pulley is raised to a raised position that is farther from ground than a position of the lower pulley.
- the robot supports itself by self-balancing locomotion to maintain the raised position of the upper pulley.
- the stand-up sequence ends in a stand-up position where the robot supports itself by solely standing on a curved part of the track which is curved by the circumferential area of the lower pulley.
- the robot comprises an inertial sensor, a gyroscopic sensor and a control algorithm.
- the control algorithm is configured to automatically control the track drive based on the inertial sensor such that the robot is balanced in a defined upright position associated with the raised position of the upper pulley.
- the inertial sensor might be embodied as a set of accelerometers and the gyroscopes.
- a further aspect of aspect of the invention taken separately or in combination with the other aspects of the invention, relates to a humanoid robot.
- the robot comprises a main body and mechanically actuated extremities attached to the main body.
- the mechanically actuated extremities comprise two mechanically actuated legs attached to the main body at a lower portion of the main body by respective upper leg joints. Each of the legs can be swiveled independently of the other leg about a swivel axis of the corresponding upper leg joint.
- the legs are configured to provide locomotion of the robot over ground.
- At least one of the mechanically actuated extremities is releasably attachable to the main body by an extremity locking mechanism.
- the extremity locking mechanism is provided by a receptacle having a depression for receiving a spigot along a penetration axis.
- the receptacle and the spigot have matching cornered, particularly hexagonal, shapes.
- the spigot has at least three, particularly six, latching elements. In a basic position of a release mechanism, each of the latching elements pushes radially outwards in order to engage in a corresponding cavity of the receptacle. An activation of the release mechanism enables the latching elements to radially escape into the spigot in order to allow the spigot to be released from the receptacle.
- each of the latching elements is configured as a rotation body, in particular as a sphere or an ellipsoid, a trapezoid, a pyramid, a trapezoid having rounded corners, or a pyramid having rounded corners.
- the latching elements and the cavities are configured and matched to each other in such a manner that the engagement of the latching elements in the cavities causes a self-centering of the spigot, in particular a self-centering with respect to the penetration axis.
- the release mechanism is arranged in the spigot.
- the release mechanism comprises (i) at least one radial pin for activating the release mechanism, (ii) an axial pin for blocking or allowing radial escape of the latching elements, and (iii) a tensioning spring to maintain the basic position.
- the radial pin, the axial pin and the tensioning spring are operatively connected in such a way that (a) in the basic position of the release mechanism the axial pin forces the latching elements radially outwards, and (b) when the release mechanism is activated a displacement of the radial pin moves the axial pin towards the tensioning spring, and the axial pin releases space due to its displacement and thus enables the radial escape of the latching elements into the spigot.
- each of the latching elements has at least two points of contact with its corresponding cavity.
- the extremity locking mechanism is configured to provide (i) a mounted state, and (ii) a dismounting functionality.
- a mounted state at least one of the mechanically actuated extremities is mechanically constrained by the degrees of freedom provided by the joint attaching the at least one of the mechanically actuated extremities to the main body.
- a flow of electrical energy is enabled between the at least one of the mechanically actuated extremities and the main body.
- the dismounting functionality is configured to block the flow of electrical energy between the at least one of the mechanically actuated extremities and the main body.
- the dismounting functionality is also configured to cancel at least a part of the mechanical constraints between the at least one of the mechanically actuated extremities and the main body. I.e. the dismounting functionality allows a separation of the at least one of the mechanically actuated extremities from the main body.
- the extremity locking mechanism comprises a set of pogo-pins, or in other words spring loaded electric connectors comprising an integrated helical spring in the pin, arranged on a front face of the spigot and a set of corresponding recesses arranged on a corresponding face of the depression in the receptable.
- the pogo-pins and the recesses are configured to engage each other thereby providing an electrical connection between the mechanically actuated extremity and the main body.
- the integrated helical spring in the pin applies a constant normal force against the recess.
- Such pogo-pins are therefore especially suited for providing stable electrical connection between moving components.
- the receptacle and the spigot have shapes that only allow inserting the spigot into the receptacle in a single pre-defined relative orientation with respect to each other.
- the engagement of the latching elements in the cavities causes a self-alignment of corresponding rotational angles in a plane perpendicular to the penetration axis, in particular the self-centering and self-alignment provides a fixed initial angle for the leg.
- a further aspect of aspect of the invention taken separately or in combination with the other aspects of the invention, relates to a humanoid robot.
- the robot comprises a main body and two mechanically actuated legs attached to the main body at a lower portion of the main body by respective upper leg joints located at opposing sides of the main body.
- Each of the legs can be swiveled independently of the other leg about a respective swivel axis provided by the corresponding upper leg joint.
- Each of the legs comprises corresponding upper and lower parts, which are connected to each other via a lower leg joint.
- the lower and upper parts and can be swiveled against each other about an axis provided by the lower leg joint.
- Each of the lower parts comprises a track drive comprises a track running over a lower pulley and an upper pulley.
- the track drive provides a running surface between the lower and the upper pulley.
- the lower pulley is arranged at a distal end away from the lower leg joint and the upper pulley is arranged closer to the lower leg joint than the lower pulley.
- the robot is configured to angle the lower parts relative to the upper parts to support the robot on the running surfaces to provide locomotion by the track drive.
- the robot is configured to provide a stand-up position. In the stand-up position the lower parts are raised relative to the upper parts such that the upper pulleys are raised to raised positions that are farther from ground than positions of the lower pulleys. In the stand-up position the running surfaces might be vertical.
- Each of the track drives comprises a pretensioning arrangement.
- the pretensioning arrangement is configured to provide tensioning of the track by providing a tensioning force acting to increase a distance between the lower pulley and the upper pulley.
- the pretensioning arrangement is configured to set the tensioning force by making use of a gravitational force and/or an impact force acting on the pretensioning arrangement in the stand-up position.
- each of the pretensioning arrangements comprises a counter mechanism configured to set a tensioning state of a spring-based tensioning unit in reaction to the gravitational force and/or the impact force.
- the tensioning state of the spring-based tensioning unit might be provided in incremental steps as a function of a tension of the track.
- the spring-based tensioning unit comprises an upper fixed component, a lower fixed component, and a floating component.
- the floating component is arranged between the upper and lower pulley, the upper fixed component is fixed with the upper pulley, and the lower fixed component is fixed with the lower pulley.
- the counter mechanism is provided by a latch arrangement connecting the floating component with the upper and lower fixed components. A movement of the floating component relative to the upper fixed component and movement of the floating component relative to the lower fixed component are restricted to different unidirectional directions of movement. A relative position of the floating component and one of the upper or lower fixed components defines the tensioning state of the spring-based tensioning unit.
- the spring-based tensioning unit comprises two springs.
- a first of the two springs connects the floating body and the upper fixed component and a second of the two springs connects the floating body unit and the lower fixed component.
- the latch arrangement comprises a first latch component between the floating body and the upper fixed component.
- the first latch component is configured to restrict a movement of the floating body with respect to the upper fixed component to a first unidirectional movement.
- the latch arrangement comprises a second latch component between the floating body and the lower fixed component.
- the second latch component is configured to restrict a movement of the floating body with respect to the lower fixed component to a second unidirectional movement.
- the first and second unidirectional movement have opposite directions.
- the pretensioning arrangement comprises a rope connecting the second of the two springs and the lower fixed component.
- the rope transmits a spring force of the second of the two springs to the lower fixed component.
- the upper fixed component has a rope guide surface, in particular in the form of a surface with a semicircular crosssection, which acts as a fixed deflection pulley with respect to the rope and thereby converts the direction of pull of the rope.
- the second spring is high stiffness spring.
- High stiffness in the sense of the invention means that the spring experience no significant deformation owing to the weight of the robot and/or the weight of the track drive.
- the spatial relations of the members of the track drive is invariant irrespectively whether track drive is horizontal, vertically hanging on the upper pulley or vertically supporting the weight of the robot.
- the pretensioning arrangement comprises and axial member and a peripherical member.
- the axial member arranged along an axis connecting the upper and lower pulleys, such that is axially displaceable along said axis.
- the peripherical member is arranged transversally offset from said axis, such that it is transversally displaceable by the axial displacement of the axial member.
- the peripherical member is configured to set by its transversal displacement a distance between the upper and lower fixed components.
- the axial member has a conical or frustrum shape
- the peripherical member has a conical or frustrum shape.
- the floating body comprises a further peripherical member arranged symmetrically to the peripherical member.
- the tensioning of the tracks causes portions of the track located between the upper and lower pulleys to align to a common tangent of said pulleys.
- a further aspect of aspect of the invention taken separately or in combination with the other aspects of the invention, relates to a humanoid robot.
- the humanoid robot comprises a main body and two mechanically actuated legs attached to the main body at a lower portion of the main body by respective upper leg joint arrangements located at opposing sides of the main body.
- Each of the legs can be swiveled independently of the other leg about a respective first swivel axis of the corresponding upper leg joint arrangement for deflecting the legs forwards and backwards for providing a walking motion of the robot.
- the first swivel axes and an axis connecting the upper leg joint arrangements might be located in the same plane.
- Each of the legs comprises a track drive comprising a track providing a running surface for track locomotion.
- Each of the upper leg joint arrangements is configured to provide a pivotability for the corresponding leg about a second swivel axis of the upper leg joint arrangement that is different from the respective first swivel axis.
- the second swivel axis might be orthogonal to the axis connecting the upper leg joint arrangements.
- a respective motor unit for providing the pivotability for the corresponding leg about the second swivel axis is arranged offset from the leg joint arrangement.
- the motor unit comprises a linear actuator.
- the linear actuator might be arranged in the main body.
- the motor unit comprises (i) an axle, (ii) a traveler configured to be linearly displaceable along the axle, and (iii) a motor to move the traveler along the axle.
- the traveler is kinematically linked by a transfer element to a rotary element of the upper leg joint arrangement for providing the pivotability of the leg about the second swivel axis.
- the transfer element and the rotary element are configured to translate a linear movement of the traveler to a rotational movement of the rotary element.
- the humanoid robot is configured to provide a walking locomotion by shifting its center of gravity by a coordinated swiveling of the legs about the corresponding second swivel axis.
- each of the linear actuators comprises at least one passive damping element.
- the passive damping element is arranged to an endpoint of the axle and configured to provide a restore force acting on the traveler and a causing a departure of the traveler from the endpoint.
- the passive damping element might be embodied as a spring.
- the linear actuator comprises a ball-screw gear.
- a displacement range of each of the second swivel axes is at least 10°.
- the second swivel axes might be configured to provide an inward tilt of the corresponding legs.
- each of the leg joint arrangements comprises a further rotary element for providing a swiveling of the respective leg about the respective first swivel axis, Said further rotary elements are located outside a volume defined by a housing of the main body.
- the robot is configured to maintain a defined orientation of the main body with respect to a direction of gravity by the coordinated swiveling of the legs about the corresponding second swivel axis.
- the robot is configured maintain contact between the ground and each of the running surfaces by a coordinated swiveling of the legs about the corresponding second swivel axis.
- a further aspect of aspect of the invention taken separately or in combination with the other aspects of the invention, relates to a mobile robot.
- the robot comprises a main body and two mechanically actuated legs attached to the main body at a lower portion of the main body by respective upper leg joints.
- Each of the legs comprises respective first and second track drives.
- Each of the track drives comprising a track running over respective lower and upper pulleys and providing a corresponding running surface for track locomotion.
- the upper pulleys of the first and second track drives of the first leg are mounted coaxially to a track swivel axis of the first leg, such that the first and second track drives of the first leg are independently pivotable about the track swivel axis of the first leg.
- the upper pulleys of the first and second track drives of the second leg are mounted coaxially to a track swivel axis of the second leg, such that the first and second track drives of the second leg are independently pivotable about the track swivel axis of the second leg.
- each of the legs comprises corresponding upper and lower parts, which are connected to each other via a lower leg joint such that they can be swiveled against each other.
- the respective first and second track drives are comprised by the lower parts of the corresponding leg.
- the respective track swivel axes are provided by the corresponding lower leg joints.
- first and second track drives are located on an outer face of the upper part of the leg, wherein the outer face is the face more remote from the main body.
- the robot is configured to provide an extended track mode.
- the respective first and second track drives are twisted to each other about the respective track swivel axis so that the upper pulleys are located between the lower pulleys.
- track locomotion is provided by running surfaces of all the first and second track drives.
- the upper and lower pulleys of the first and second track drives might be arranged to a common plane.
- the robot is to provide an extended track stand-up sequence.
- the extended track stand-up sequence comprises (i) establishing the extended track mode for both of the legs, and (ii) raising the upper pulleys from the ground by swiveling each of first and second track drives in a coordinated manner such that the robot supports itself on the four lower pulleys.
- the specific features of the stand-up sequence might be applied correspondingly to the extended stand-up sequence.
- the robot is configured to provide a climbing mode.
- a climbing mode In the climbing mode an angle between a first track vector extending from the upper pulley of the first track drive to the lower pulley of the first track drive and a second track vector extending from the upper pulley of the second track drive to the lower pulley second track drive falls into a range of 15° to 55°.
- the skilled person understands that the features of the extended track mode and the climbing mode are beneficially combinable with each other.
- the robot is configured to adjust the angle between the first and second track vectors such that both the first and second track drives maintain at least two- point contact with the ground.
- the respective leg and at least one of the respective first track drive and the respective second track drive comprise matching counterparts of a coupling interface configured to releasably attach the at least one of the respective first track drive and the respective second track drive to the respective leg.
- the coupling interface is configured to provide for independent swiveling of the first track drive and the second track drive about the track swivel axis.
- the coupling interface is configured to releasably attach the respective first track drive and the respective second track drive to opposite sides of the respective leg.
- the coupling interface is configured to releasably attach the respective second track drive to the respective first track drive.
- the respective leg and the respective first and second track drives are stacked one above the other in the order leg-first track drive-second track drive so that they can rotate around the respective track swivel axis of the leg.
- the first and second track drives are independently pivotable about the track swivel axis of the leg.
- an additional interface part is passed through the first track drive into the leg axially to the track swivel axis.
- the additional interface part is configured to engage a rotating motor component inside the leg so that a rotational movement about the track swivel axis is transmitted from the rotating motor component inside the leg to the second track drive by means of the additional interface part.
- the second track drive is attached with its counterpart of the coupling interface to a matching counterpart on the additional interface component.
- first track drive and the second track drive comprise identical counterparts of the coupling interface, each matching the counterpart of the coupling interface arranged on the respective leg, which is identical to the counterpart arranged on the additional interface component.
- each of the first and second track drives comprises a corresponding track drive motor configured to provide a driving force for at least one of the respective lower or upper pulleys.
- Each of the legs comprises a first and a second swivel motor.
- the coupling interface is configured such that the first swivel motor drives a swiveling of the first track drive about the track swivel axis and the second swivel motor drives a swiveling of the second track drive about the track swivel axis.
- the coupling interface is configured such that the second swivel motor drives two shafts.
- the two shafts are arranged and configured to engage coupling interface components that are approached to the leg from opposite sides of the leg.
- the coupling interface is provided by a receptacle having a depression for receiving a spigot along the track swivel axis.
- the receptacle and the spigot have matching cornered, particularly hexagonal, shapes.
- the spigot has at least three, particularly six, latching bodies, wherein in a basic position of a release mechanism, each of the latching bodies pushes radially outwards, away from the track swivel axis, in order to engage in a corresponding cavity of the receptacle.
- An activation of the release mechanism enables the latching bodies to radially escape into the spigot in order to allow the spigot to be released from the receptacle.
- extremity locking mechanism is correspondingly applicable to the coupling interface.
- a further aspect of aspect of the invention taken separately or in combination with the other aspects of the invention, relates to a humanoid robot.
- the robot comprises a main body, two mechanically actuated legs attached to the main body at a lower portion of the main body by respective upper leg joints, and a mechanically actuated arm attached to the main body by an upper arm joint.
- the legs and the arm can be swiveled independently of one another.
- the humanoid robot comprises a depth measuring sensor, configured to generate distance measuring data to an environment of the robot.
- the humanoid robot is configured to use the arm to hold and position a mobile scanning device in a plurality of positions and orientation relative to an object to be measured.
- the mobile scanning device is configured to approach the object to be measured and to generate 3D position measuring data of the object to be measured.
- the robot is configured to hold the device with a position and orientation accuracy which corresponds to a calibration routine of said device. More particularly the robot is configured to hold the mobile scanning device in an essentially vibration free manner.
- the humanoid robot is configured to autonomously move the mobile scanning device (by moving the arm and/or the robot position) to different positions and orientations relative to the object to be measured, and based thereof, to use the mobile scanning device to generate 3D position measuring data of the object to be measured according to a defined measurement criterion.
- the humanoid robot is configured to determine and set a next position and orientation of the mobile scanning device by moving the arm based on an evaluation regarding achievement of the measurement criterion taking into account previous positions and orientations of the mobile scanning device, known measurement characteristics of the mobile scanning device, and distance measuring data of the depth measuring sensor for measuring distances to the object to be measured and the mobile scanning device.
- the mobile scanning device is embodied as a laser-based scanner, a tactile scanning device, or a stereo imaging device.
- the depth measuring sensor is embodied as a laser-based distance measuring device, a time-of-flight camera, or a stereo imaging device.
- the evaluation is configured to provide an optimization of a scanning distance and/or a viewing angle of the mobile scanning device to the object to be measured in order to meet the measurement criterion.
- the robot is configured to determine the previous positions and orientations of the mobile scanning device by tracking position and orientation of the mobile scanning device by the distance measuring data of the depth measuring sensor.
- the humanoid robot is configured to determine track data for tracking position and orientation of the mobile scanning device relative to a position of the tracking device and the robot by using the distance measuring data of the depth measuring sensor and to use the track data to identify and avoid upcoming line-of-sight breaking between the tracking device and the mobile scanner.
- the evaluation regarding achievement of the measurement criterion takes into account feedback from the mobile scanner.
- a further aspect of aspect of the invention taken separately or in combination with the other aspects of the invention, relates to a humanoid robot.
- the robot comprises a main body, a mechanically actuated arm attached to the main body, and a hand-joint arrangement at a distal end of the arm remote from the main body.
- the hand-joint arrangement is configured to hold a touch sensor or the hand-joint arrangement comprises a touch sensor.
- the touch sensor comprises an elastomeric component for contacting a surface patch of an object to be measured.
- the touch sensor is configured to generate tactile sensing data that provide geometric 3D information of the surface patch based on observation of deformation of an inner face of the elastomeric component when an outer face of the elastomeric component is brought into physical contact with the object to be measured.
- the pose data comprise kinematic chain data determined by angular encoders of the robot for tracking movement of the arm and/or the hand-joint arrangement.
- the pose data comprise tracking data determined by a camerabased or light-based tracking sensor of the robot configured to capture at least part of at least one of the arm, the hand-joint arrangement, and the tactile sensor.
- the camera-based or light-based tracking sensor is arranged in the main body or in a mechanically actuated head attached to the main body at the top of the main body.
- the camera-based or light-based tracking sensor might have an active illumination source included.
- the robot is configured to provide the pose data by carrying out a point cloud matching procedure on tactile sensing data associated with overlapping surface patches of the different surface patches.
- the robot is configured to use the tactile sensing data and the pose data to generate a 3D model of the object.
- the robot comprises a visual sensor configured to generate visual data of the different surface patches.
- the robot is configured to provide for referencing the visual data relative to the tactile sensing data, particularly when the robot is configured to use the visual data to texture the 3D model of the object.
- the robot is configured to use the visual data during the iterative tactile sampling to determine a next surface patch to be measured by the touch sensor.
- next surface patch is determined based on a surface reconstruction of the object by processing the visual data based on a photogrammetric principle, particularly based on a structure from motion algorithm.
- the robot is configured to use the visual data to determine a tactile sensing confidence value of the tactile sensing data.
- the robot is configured to adapt placement of the touch sensor on the object during the iterative tactile sampling and/or to adapt a data assignment to complement the tactile sensing data with the visual data based on the tactile sensing confidence value.
- the tactile sensing confidence value is determined by identifying flat surfaces and/or contrast changes exceeding a contrast change threshold.
- the comparison module is configured to provide the confidence value based on an explicit feedback regarding the executed surveying task from an operator.
- at least a part of explicit feedback is provided as voice input from the operator.
- the robot is configured to execute surveying tasks that involve specific movements of the robot and the use of a metrology-grade surveying sensor.
- the metrology-grade surveying sensor is part of the robot or is held by the hand-joint arrangement.
- the robot comprises a large language module, a gesture recognition module, an instruction interpreter, and a robot instruction executor.
- the large language module (LLM module, see also above) is configured to transform text input of a planned surveying task to an output comprising robot command language.
- the gesture recognition module is configured to analyze the perception data to recognize a gesture made by an operator that is associated with the planned surveying task.
- the instruction interpreter is configured to provide robot commands based on output of the LLM-module and the gesture recognition module, and the a robot instruction executor is configured to cause the robot to execute the robot commands, resulting in an executed surveying task executed by the robot.
- the robot is configured to execute surveying tasks that involve specific movements of the robot and the use of a metrology-grade surveying sensor.
- the metrology-grade surveying sensor is part of the robot or is held by the hand-joint arrangement.
- the robot comprises a gesture recognition module, an instruction interpreter, a robot instruction executor, and a confirmation module.
- the gesture recognition module is configured to analyze the perception data to recognize a gesture made by an operator that is associated with a planned surveying task that involves a specific movement of the robot and the use of the metrology-grade surveying sensor.
- the gesture recognition module is configured to translate a recognized gesture into a planned model movement sequence of a set of robot parts that are involved in the planned task.
- the instruction interpreter is configured to provide robot commands based on the planned model movement sequence.
- the robot instruction executor is configured to cause the robot to execute the robot commands, resulting in an executed surveying task executed by the robot.
- the confirmation module is configured (i) to analyze perception data of the perception sensor capturing at least part of the set of robot parts to recognize an observed movement of the set of robot parts, (ii) to translate the observed movement into an executed model movement sequence of the set of robot parts, and (iii) to provide a confidence value regarding a matching of the planned model movement sequence and the executed model movement sequence.
- the robot is configured to take into account the confidence value to adapt movement of the robot when repeating the planned surveying task.
- the robot is configured to take into account the confidence value to adapt processing of the gesture recognition module to provide a further planned model movement sequence.
- the robot is configured that the further model movement sequence is processed by the instruction interpreter to provide a set of robot commands.
- the robot is configured to take into account the confidence value to adapt processing of the instruction interpreter to provide a further set of robot commands based on the planned model movement sequence or the further model movement sequence. Therefore, the robot is configured to carry out an adapted executed surveying task based on the robot instruction executor causing the robot to execute the set of robot commands and/or the further set of robot commands.
- the robot is configured to provide the planned model movement sequence as a scaled movement sequence or an absolute movement sequence.
- the magnitudes of the planned model movement sequence are in one-to-one correspondence with the recognized gesture made by the operator.
- For a scaled movement sequence at least one magnitude of the planned model movement sequence is rescaled with respect to recognized gesture made by the operator by the gesture recognition module.
- a further aspect of aspect of the invention taken separately or in combination with the other aspects of the invention, relates to a humanoid robot configured for 3D surveying of an environment.
- the robot comprises a main body, two mechanically actuated legs attached to the main body at a lower portion of the main body, and a mechanically actuated arm attached to the main body at an arm joint at an upper portion of the main body.
- Each of the legs comprises a track drive providing a track for track locomotion, and the robot is configured to autonomously move through the environment and to autonomously change between an upright measurement mode and a crouching measurement mode.
- the main body In the upright measurement mode, the main body is placed higher above ground than in the crouching measurement mode, contact faces of the tracks contacting the ground have smaller area sizes than contact faces of the tracks in the crouching measurement mode, and a posture of the robot is automatically balanced based on a control algorithm configured to automatically stabilize the posture based on inertial data of an inertial sensor of the robot.
- the robot resumes a tilt-resistant posture by having increased area sizes of the contact faces of the tracks compared to the upright measurement mode, such that the tilt-resistant posture can be maintained free of active balancing by the robot.
- the robot is configured to execute surveying tasks by a metrology-grade surveying sensor to generate 3D surveying data that provide geometric 3D information of the environment, wherein the metrology-grade surveying sensor is part of the arm or is held by the arm.
- the robot is configured to capture perception data of the environment and to carry out a classification of objects and environment areas within the perception data based on object type and area type, wherein different object types and different area types are assigned different surveying criteria for surveying with the surveying sensor.
- the robot is configured to use this classification to automatically switch between the upright measurement mode and the crouching measurement mode.
- the robot comprises a visual sensor configured to provide at least part of the perception data.
- the surveying criteria define at least one of (i) a desired measurement point density, (ii) a desired coordinate measurement accuracy, (iii) a desired measurement point pattern, (iv) a desired surveying field of view, and (v) a desired perspective onto the object or environment area.
- Figure 6 depicts schematically an embodiment of upper leg joint arrangements with two-axes pivotability.
- Figure 14 schematically depicts options to provide the confidence value used by the embodiment described by Fig. 13;
- robots with a plurality of wheels, track drives 31 or comprising one or more adjustable support element per leg 3 are also considered humanoid in the sense of the invention.
- a robot with legs 3 consisting of a track drive 31 mounted by a respective pivotable joint 6 might also be consider humanoid in the sense of the invention.
- the legs 3 are attached pivotably to the main body 2.
- the humanoid robot is configured to perform a plurality of postures by swiveling the legs 3 with respect to the main body 2.
- the different postures represent different functionalities of the robot. More preferably at least one of the postures is configured for stability, and at least one posture is configured for the speed of locomotion.
- the humanoid robot is configured for a stepwise motion similar to the walking or running motion of a human.
- the robot might also comprise a headlike 5 assembly, particularly comprising a sensor suite and/or communication. Aesthetic reasons aside placing sensing and communication elements on the top of the robot can provide further benefits in the form of a better field of view or signal coverage.
- the robot 1 a, 1 b comprises legs 3 which are attached to the main body 2 by the upper leg or hip joints 6. For transparency reasons some reference signs relating to further identical components, e.g., the second leg 3, are omitted.
- Each of the legs 3 comprises an upper part 7.
- the upper part 7 comprises a battery compartment 20.
- the legs 3 comprise respective lower parts 9.
- the lower 9 and upper parts 7 are connected to each other by the lower leg or knee joint 8.
- the knee joint 8 provides a swiveling movement of the lower part 9 relative to the upper part 7.
- the lower part 9 comprises a track 32 running over a lower pulley 33 and an upper pulley 34.
- the lower pulley 33 is arranged on the distal end away from the knee joint 8.
- the upper pulley 34 is arranged closer to the knee joint 8, e.g., wherein its suspension arrangement might comprise elements of the knee joint 8.
- the complete lower part 9 is embodied as a track drive 31 .
- the depicted lower part 9 of the leg (the track 32) further comprises one or more support pulleys 35 arranged between the lower pulley 33 and the upper pulley 34 such that the one or more support pulleys 35 is/are in contact with the track 32.
- the upper pulley 34 is a driven pulley, wherein the upper pulley 34 is driven by utilizing components arranged in the knee joint 8 and/or in the upper part 7 of the leg.
- the lower pulley 33 might be a driven pulley too, e.g., wherein separate motors drive the upper pulley 34 and the lower pulley 33, respectively.
- a driven pulley comprises an electric motor integrated into or onto the pulley.
- a surface contact face of the running surface has smaller area size than a surface contact face of the running surface provided by the full track mode 1 b.
- the robot supports itself by standing on a curved part of the track 36 which is curved by the circumferential area of the lower pulley 33.
- the stand-up mode 1 a in particular the locomotion in the stand-up mode 1 a, is provided by a self-balancing over the lower pulley 33.
- the robot comprises an inertial sensor unit 38 in the main body 2, e.g., acceleration sensors and gyroscopic sensors, and a control algorithm configured to automatically control movement of the lower pulleys 33 based on the sensors readings such that the robot is balanced in a defined upright position.
- the robot supports itself by standing on the largest possible surface contact face provided by the track 37 and the locomotion is provided by track locomotion. In other words, at least a part of the running surface 37 engages the ground.
- the track drive 31 might comprise a further inertial sensor 39, e.g., an accelerometer.
- the further inertial sensor 39 in the track drive 31 provides wheelspin, track slippage, or shock information.
- Said full-track mode 1 b can be advantageously utilized to provide a stable platform, e.g. in a crouching mode as described above.
- the robot is configured to provide the stand-up mode 1 a by a raising of the upper pulleys 32 relative to the lower pulleys 33 to provide selection between two different running surface contact faces, wherein the two contact faces differ from each other by their respective area size.
- the robot is configured to provide different "feet sizes" by raising the upper pulleys 34 to different heights above ground and being able to maintain different raised positions.
- the robot is configured to provide track locomotion in the standup mode 1 a.
- the robot is configured to vary running surface contact faces (vary area sizes) either actively or passively, e.g., by comprising and using additional “displaceable pulleys” (at least one per track drive 31) and a spring pre-forcing to get a pre-forced track.
- the robot can adapt the “feet size” depending on the task of the robot, e.g., adapt the raised position and use a small feet size when standing on position and keeping position is important but use a flatter (larger feet size) for walking up a steep and difficult terrain.
- the robot might provide a locomotion in the stand-up mode 1 a by stepped motion of the legs 3. During such stepped motion the tracks 32 or a part of the pulleys 33-35 might be immobilized.
- the main body 2 defines a reference system of the robot.
- the main axes are defined by a leg suspension axis 142 connecting the upper leg or hip joints 6, and a central body axis 141 extending perpendicularly to the leg suspension axis 142.
- a central body axis 141 can be foreseen as a kinematic link equivalent to the main body 2.
- a forward direction 143 and a backward direction 144 can be defined on the basis of the central axis 141 and the leg suspension axis 142.
- the robot also comprises two arms 4 attached to the main body 2 at an upper part of the main body 2 and configured to move relative to the main body 2.
- Each of the two arms 4 is attached to the main body 2 by a shoulder joint 1 1 , e.g., wherein the shoulder joint 1 1 provides movement in two rotational degrees of freedom relative to the main body.
- each of the two arms 4 further comprises an elbow joint 12 and a hand joint arrangement 13.
- Each of the elbow joints 12 provides movement in one rotational degree of freedom, e.g., for providing an arm folding movement.
- the depicted hand joint arrangement 13 is configured to provide for performing a gripping operation.
- the hand joint arrangement 13 is configured to provide a hand embodied like a human hand.
- the hand joint arrangement provides for a simpler gripping tool like a two or three fingered claw.
- the hand joint arrangement 13 might comprise metrology grade sensors.
- the robot might be further configured to provide the self-balancing movement by the aid of an automatic movement control for movement of the arms 4 during locomotion so that movements by the arms 4 support the robot being balanced in the defined upright position.
- the robot comprises a control algorithm configured to automatically adjust the relative pose of the two mechanically actuated arms based on the tilt sensors and the gyroscopic sensors so that the weight and orientation of the arms 4 provide a stabilizing effect to maintain the upright position of the robot 1 .
- the robot also comprises a head 5 and arranged to a head joint 15 connecting the head 5 to the main body 2.
- the head joint 15 might provide at least one degrees of freedom movability of the head 5 with respect to the main body 2.
- the head 5 might comprise perception, such as a lidar unit 23, one or more time of flight camera 26, one or more high field of view camera 27 or one or more microphone 30.
- the head 5 might also comprise a positioning unit 29 providing positioning data based on external positioning signals, such as GNSS, WLAN or Bluetooth signals.
- the main body 2 could comprise a part of, or all the above sensors.
- Said sensors 23, 26, 27, 29, 30 provide data, in addition or alternatively of the inertial sensor unit 38, for the control algorithm configured to automatically control movement of the lower pulleys 33 based on the sensors readings such that the robot is balanced in a defined upright position.
- the robot comprises exactly two mechanically actuated legs 3, exactly two mechanically actuated arms 4 attached to an upper portion of the main body 2 and configured to move relative to the main body and a, particularly mechanically actuated, head 5 attached to the at the top of the main body 2, as depicted.
- each of the arms 4 is attached to the main body by an upper arm joint providing movement 11 in one rotational degree of freedom, particularly two rotational degrees of freedom, relative to the main body 2.
- each of the arms 4 comprises a lower arm joint 12 providing movement in one rotational degree of freedom and a hand joint arrangement 13 configured for performing a gripping operation.
- the humanoid robot is preferably configured to provide the locomotion in a walking mode by stepped motion of the legs 3, in particular wherein the running surfaces 37 are immobilized in the walking mode.
- Figure 2 depicts a second embodiment of the inventive humanoid robot during a standup sequence.
- the robot is the full track mode 1 b, such that a first vector 147r extending from an upper pulley 34r to a lower pulley 33r of a first 31 r of two track drives 311,31 r and a second vector 1471 extending from an upper pulley 341 to a lower pulley 331 of a second 311 of the two track drives 311,31 r both points to the forward direction 143.
- the depicted inverted state might be seen as a part of a stand-up sequence 1 c or an alternative embodiment of the full track mode 1 b.
- it When it is part of the stand-up sequence 1 c it can follow, as depicted, by raising the upper pulleys 34l,34l from the ground by swiveling 1461,146r the lower leg 8r,8l joints in opposing directions.
- the lower pulleys 33l,33r are far away from the main body 2, thus the depicted stand-up sequence 1 c is more resistant to the inevitable small instabilities.
- Figure 3b depicts a basic position of a release mechanism 153b arranged in the spigot 149.
- each of the latching elements 151 pushes radially outwards from the penetration axis 152 in order to engage in a corresponding cavity 154 of the receptacle 150.
- the latching element 151 has at least two points of contact with the corresponding cavity 154.
- Figure 4a depicts a track drive 31 comprising a first embodiment of the inventive pretensioning arrangement 163 configured to provide tensioning of the track 32 by providing a tensioning force acting to increase a distance between the lower pulley 33 and the upper pulley 34.
- the depicted pretensioning arrangement 163 is configured to set the tensioning force by making use of an impact force 164 acting on the pretensioning arrangement 163 in the stand-up position.
- the pretensioning arrangement 163 might use the weight of the robot for the same purpose.
- the spring 178 connects the floating body 167 and the lower fixed component 165 such that an impact force 164 causes a displacement of the floating body 167.
- the spring 178 is a high stiffness spring, wherein high stiffness in the sense of the invention means that the spring experience no significant deformation owing to the weight of the robot and/or the weight of the track drive 31 .
- the spatial relations of the members of the track drive 31 is invariant irrespectively whether track drive is horizontal, vertically hanging on the upper pulley 34 or vertically supporting the weight of the robot.
- the impact force 164 might be provided by pre-programmed sequence of stepping, particularly a trampling movement.
- the pretensioning arrangement 163 also comprises a latch arrangement connecting the floating component 167 with the upper 166 and lower fixed components 165.
- the latch arrangement comprises a first latch component 170 between the floating body 167 and the upper fixed component 166.
- the first latch component 170 is configured to restrict a movement of the floating body 167 with respect to the upper fixed component 166 to a first unidirectional movement 172.
- the latch arrangement also comprises a second latch component 169 between the floating body 167 and the lower fixed component 165.
- the second latch component 169 is configured to restrict a movement of the floating body 167 with respect to the lower fixed component 165 to a second unidirectional movement 171 .
- the first 172 and second unidirectional movement 171 have opposite direction.
- a first spring connects 179 the floating body 167 and the upper fixed component 166.
- a rope 180 connects an anchoring point 184, in the proximity to first spring 179 and transmits a force to the lower fixed component 165.
- the upper fixed component 166 has a rope guide surface 181 , depicted as a surface with a semicircular cross-section.
- the rope guide surface 181 acts as a fixed deflection pulley with respect to the rope 180 and thereby converts the direction of pull 182 of the rope 180.
- the rope 180 is anchored 183 at the lower fixed component 165 and provides second unidirectional movement 171 via its pull 182.
- the ball 305 By a relative movement of the first body 302 to the second body 303 in the enabling direction 301 a the ball 305 is conveyed to the enabling-position 306.
- the ball 305 can be easily dislocated by a displacement or rotation 307, so that it offers negligible resistance to movement in the enabling direction 301 a.
- the depicted motor unit 189 is embodied as a linear actuator with (i) an axle 190 aligned to a direction substantially orthogonal to the first 187 and second swivel axis 188, (ii) a traveler 191 configured to be linearly displaceable along the axle 190, and (iii) a motor 192 to move the traveler 191 along the axle 190.
- the depicted motor unit 189 comprises a plurality passive damping elements 198, embodied as a set of springs, arranged to an end point of the axle 190.
- the damping elements 198 are configured to provide a restore force acting on the traveler 191 and a causing a departure of the traveler 191 from the endpoint.
- FIG. 7a depicts a mobile robot 101 a comprising a main body 2 and two mechanically actuated legs attached to the main body 2 at a lower portion 205 of the main body 2 by respective upper leg 6 joints (only one is shown).
- Each of the legs 3l,3r comprises an upper part 7 and a corresponding set of track drives 31 ,208 attached to the upper part 7 at a corresponding lower leg joint 8.
- Each of the track drives 31 ,208 comprising a track running over respective lower and upper pulleys and providing a running surface for track locomotion.
- the upper pulleys 34,209 of the first 31 and second track drives 208 of the first leg 3r are mounted coaxially to the corresponding lower leg joint 8 of the first leg 3r, such that the first 34 and second track drives 209 of the first leg 3r are independently pivotable about the axis of the lower leg joint 8 as a track swivel axis of the first leg 3r.
- the construction of the second leg 3I is analogous.
- the second track drives 31 might be stacked on the first track drives 208.
- the depicted robot 101 a comprises two articulated arms 4l,4r and a perception sensor suite comprising a stereo camera 40. Due to the number of extremities said mobile robot 101 a can also be understood as humanoid. Alternative embodiments with more arms 4l,4r are also possible in the sense of the present invention.
- one of the arms 4I comprises a locking port 206 configured to provide a fixed mechanical connection with the environment, while the other arm 4r comprises an integrated metrology sensor 207, e.g., a lidar.
- Figure 7b depicts the same robot in an extended track mode 101 b.
- the respective first 31 and second track drives 208 are twisted 211 to each other about the respective track swivel axis so that the upper pulleys 34,209 are located between the lower pulleys 33,210.
- track locomotion is provided by running surfaces of all the first 31 and second track drives 208, particularly wherein the upper and lower pulleys of the first and second track drives are arranged to a common plane.
- the extended track drive mode is especially advantageous as it provides a longer running surface, i.e., a more stable platform especially on uneven ground.
- the robot can utilize the extended track drive mode for ditch crossing and stair climbing.
- An exemplary realization of stair climbing is shown in Figure 7c. This also implies that the length each of the first and second track exceeds a typical distance between two stairs, in particular it exceeds 40 cm.
- Figure 7c depicts the mobile robot in a climbing mode 101 c.
- an angle between a first track vector extending from the upper pulley 34 of the first track drive 31 to the lower pulley 33 of the first track drive 31 and a second track vector extending from the upper pulley 209 of the second track drive 208 to the lower pulley 210 second track drive 208 falls into a range of 15° to 55.
- Said angle corresponds to the typical ascent angle 213 of stairs 212, i.e., the mobile robot is configured to foreseen to climb common stairs.
- FIG. 8 depicts, with dashed lines, an exemplary embodiment of a leg 3 as it can be used in a robot according to the invention.
- the leg comprises an upper part 7 and lower part 9 such that upper 7 and lower parts 9 are connected by a knee joint 8 configured to provide a swiveling movement of the lower part 9 relative to the upper part.
- the upper part 7 of the leg comprises a drive shaft 46 mechanically connected to an electric motor 47.
- the knee joint comprises a further shaft 48 mechanically connected to the knee joint, such that a rotation and/or swiveling movement of the further shaft 48 causes a swiveling movement of the knee joint.
- the drive shaft 46 and the further shaft 48 are connected by a mechanical transmission element 49 such that the drive shaft 46 provides a mechanical actuation of the further shaft 48 via the mechanical transmission element 49.
- the drive shaft 46 and the further shaft 48 each comprise a toothed area and the mechanical transmission element 49 is a chain drive.
- Alternative embodiments might comprise (non-exhaustive list) a belt drive, e.g., a v-belt, or a toothed bar as mechanical transmission element 49.
- Figure 9 depicts schematically the drive arrangement of a mobile robot having one first 208, and two second track drives 31 a, 31 b.
- the first track drive 208 and one of the second track drives 31 a are located on an outer face of the upper part 7 of the leg, wherein the outer face is the face more remote from the main body 2 (only the interface is shown).
- the other second track drive 31 b is located at the opposite side.
- the first track drive 208-and the second track drives 31 a, 31 b are attached so that they can rotate around the respective track swivel axis, here the axis 220 of the lower leg joint 8, such that the first 208 and second track drives 31 a, 31 b are independently pivotable about said track swivel axis 220.
- FIGs 10 and 1 1 schematically depict a humanoid robot according to embodiments of the invention, wherein the robot is configured to carry out an iterative tactile sampling of an object to be measured to generate a 3D model of the object.
- the tactile sampling is carried out by a touch sensor 450, 451 , wherein in the embodiment depicted by Fig. 10, the robot is configured to hold an external touch sensor 450 in its hand whereas in the embodiment depicted by Fig. 11 , the robot itself comprises the touch sensor 451 , e.g. wherein the touch sensor is arranged in a hand of the robot.
- the iterative tactile sampling comprises movement of the arm and the hand of the robot to change poses (position and orientation) of the touch sensor 450, 451 to provide for touching different surface patches 452 with the elastomeric component.
- the robot is further configured to generate pose data that provide for referencing tactile sensing data associated with different poses of the touch sensor 450, 451 to a common coordinate system.
- the robot comprises a visual sensor 454, 455 configured to generate visual data of different surface areas of the object, and the robot is configured to provide for referencing the visual data relative to the tactile sensing data.
- the visual sensor 454, 455 is embodied as at least one of a high-resolution camera, a time-of-flight camera (TOF camera, often also referred to as range imaging camera, RIM camera), a LIDAR sensor, and a structured light scanner.
- TOF camera time-of-flight camera
- RIM camera range imaging camera
- LIDAR sensor LIDAR sensor
- FIG. 12 schematically depicts a humanoid robot according to an embodiment of the invention, wherein the robot is configured to hold and position a metrology grade mobile scanning device 500 in a fixed position and orientation relative to an object to be measured 501 .
- the mobile scanning device 500 is configured for scanning the object 501 by means of laser-based scanning and/or camera-based scanning.
- the mobile scanning device comprises multiple cooperative targets 502, e.g. retro-reflectors, for being tracked by a stationary laser tracker 503.
- the mobile scanning device 500 comprises markings 504 that allow determination of the 6DoF pose of the scanning device 500.
- the laser tracker 503 comprises a 6DoF-camera for detecting and analyzing the markings 504 by image processing.
- the measurement criterion is at least one of a point density, a distance measurement accuracy, a coordinate measurement accuracy, and a signal-to-noise ratio to be achieved by the measurement with the mobile scanning device 500.
- the evaluation Based on the 3D information of the object 501 and previous relative positions and orientations between the mobile scanning device 500, the object 501 , and the laser tracker 503, determined from data of the depth sensor 505, the evaluation provides an optimization of a scanning distance and/or a viewing angle of the mobile scanning device 500 to the object to be measured 501.
- the robot is further configured to determine track data for tracking position and orientation of the mobile scanning device 500 relative to a position of the laser tracker 503 and the robot by using the distance measuring data of the depth sensor 505 and to use the track data to identify and avoid upcoming line-of-sight breaking between the laser tracker 503 and the mobile scanner 500.
- Figure 13 schematically depicts a working principle of a further embodiment of a humanoid robot according to the invention, wherein the robot is configured to be controlled via general text input and to use a closed loop configuration with a large language model (LLM) for robot teaching and interaction of manipulation tasks, e.g. in combination with locomotion tasks.
- LLM large language model
- the robot further comprises a large language model module (LLM-module) 507 for processing text input of a planned surveying task to be executed by the robot, wherein the planned surveying task involves a specific movement of the robot arm relative to the object.
- LLM-module is trained 508 to transform the text input of the planned surveying task to an output comprising robot command language.
- the LLM-module is implemented by means of a machine learning algorithm, e.g. an artificial neural network (pre-)trained using selfsupervised learning and/or semi-supervised learning.
- the output is analyzed by a robot arm instruction interpreter 509, configured to select robot commands out of the output of the LLM- module 507.
- the complete text of the LLM-module output is parsed and only parts in robot command language are selected, e.g. parts in JSON or XML.
- a robot arm instruction executor 510 of the robot then causes the robot to execute the robot commands selected by the robot arm instruction interpreter 509, resulting in an executed surveying task executed by the robot.
- the robot comprises a speech to text module 511 for transforming spoken instructions into text instructions provided to the LLM-module 507. Thanks to pre-training 508 and conditioning of the LLM-module 507, the output of the LLM-module is providing general text including specific robot commands, e.g. an instruction list in parse-able form.
- the robot may further be configured to provide feedback regarding the output of the LLM-module to a user, e.g. in text form via a display 512 or in audible form via a text to speech module 513.
- the robot further comprises a comparison module 514 configured to provide a comparison of the planned surveying task and the executed surveying task based on perception data of the perception sensor 506 to provide a confidence value regarding achievement of the planned surveying task, wherein the robot is configured to take into account the confidence value to adapt movement of the robot when repeating the planned surveying task.
- the perception data capture a relative positional relationship between the object and at least part of the robot, e.g. the arm, and thereby provide visual feedback of the executed surveying task.
- the closed loop for providing the confidence value may further include - similar to the robot arm instruction interpreter 509 and the robot arm instruction executor 510 - a locomotion instruction interpreter 515 and a locomotion instruction executor 516.
- the locomotion instruction interpreter 515 selects the specific robot commands for locomotion out of the general text output by the LLM-module 507, and forwards them to locomotion instruction executor 516, which then executes the instruction for locomotion of the robot and moves the robot to the instructed place (physical action).
- locomotion sensors 517 comprising at least one of an IMU (inertial measurement unit), a camera, and LiDAR (depth sensing) take notion of the robot locomotion and provide input for a simultaneous localization and mapping (SLAM) module 518.
- the comparison module 514 then calculates the distance between the locomotion instruction and the actual position reached and provides feedback to the LLM-module 507.
- the robot is configured to automatically recognize whether the planned surveying task is correctly executed or whether additional robot instructions are required.
- task interpretation by the robot is incrementally improved, e.g., wherein the robot is configured to stop operation as a function of a counter of successively derived confidence values below or above a defined threshold.
- the actual state of the robot is defined by movement sensors 525 of the robot, e.g. providing encoder and IMU readings as well as 2D image information 526 and 3D information 527, e.g. provided by the visual perception sensor 506 and possibly further cameras of the robot.
- This information is compared to a pre-defined list of values 528 for the movement sensors 525 and allowed relative positions 529 of robot parts relative to other robot parts (robot selfcapture).
- the actual state of the environment is determined by 2D image information 530 of the environment and 3D information of the environment 531 , e.g. provided by the visual perception sensor 506 and possibly further cameras of the robot.
- the state of the environment is then compared to a defined range 532 of allowable locations of an object described in the task, e.g. to determine whether any change of the object is as expected.
- the state of the environment may also be compared to a capture 533 of the environment before and after the task, e.g. to determine whether something else than the object to be measured changed and whether this change is as expected.
- Known (allowable) poses of the robot may be defined by physical constraints to provide metrology measurements with sufficient accuracy and repeatability. For example, certain arm positions provide unwanted increased vibration on the surveying sensor, e.g. when the arm is stretched far away from the main body of the robot.
- the robot may have a defined set of preferred stable poses and movement patterns in an upright or crouching robot position for providing surveying data by the surveying sensor with sufficient quality. It may also be defined that the robot is not allowed to fall below certain minimal distances to objects of the environment.
- optimal measurement distances and viewing angles with defined tolerance levels may be associated to different types of measurements using the metrology grade surveying sensor, and the robot may not be allowed to exceed these tolerance levels.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Robotics (AREA)
- Human Computer Interaction (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Transportation (AREA)
- Manipulator (AREA)
Abstract
Description
Claims
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/EP2023/084173 WO2025119448A1 (en) | 2023-12-04 | 2023-12-04 | Humanoid robot with tracks on legs configured for stand up sequence |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4587228A1 true EP4587228A1 (en) | 2025-07-23 |
Family
ID=89121607
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP23818365.1A Pending EP4587228A1 (en) | 2023-12-04 | 2023-12-04 | Humanoid robot with tracks on legs configured for stand up sequence |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP4587228A1 (en) |
| WO (1) | WO2025119448A1 (en) |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7348747B1 (en) * | 2006-03-30 | 2008-03-25 | Vecna | Mobile robot platform |
| JP4982413B2 (en) * | 2008-03-19 | 2012-07-25 | 株式会社日立製作所 | Leg wheel type mobile robot |
-
2023
- 2023-12-04 WO PCT/EP2023/084173 patent/WO2025119448A1/en active Pending
- 2023-12-04 EP EP23818365.1A patent/EP4587228A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2025119448A1 (en) | 2025-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7339340B2 (en) | Control system and related method for multi-limbed, multi-legged robot | |
| Jain et al. | Pulling open doors and drawers: Coordinating an omni-directional base and a compliant arm with equilibrium point control | |
| CN114800509B (en) | Robot system and method for controlling the same | |
| US20200290217A1 (en) | Robotic Leg | |
| US8127871B2 (en) | Frame walker predicated on a parallel mechanism | |
| US20160279800A1 (en) | Robot, robot control device, and robotic system | |
| CN105518486A (en) | Systems and methods for tracking location of movable target object | |
| Kim et al. | Full-body collision detection and reaction with omnidirectional mobile platforms: a step towards safe human–robot interaction | |
| US20220101213A1 (en) | Method of performing display with respect to control parameters for robot, program, and information processing apparatus | |
| Ramos et al. | A balance feedback interface for whole-body teleoperation of a humanoid robot and implementation in the HERMES system | |
| Quigley et al. | Low-cost accelerometers for robotic manipulator perception | |
| Hermann et al. | Hardware and software architecture of the bimanual mobile manipulation robot HoLLiE and its actuated upper body | |
| Yashin et al. | LocoGear: locomotion analysis of robotic landing gear for multicopters | |
| US20250196333A1 (en) | Robotic manipulation of objects | |
| US20220314428A1 (en) | Mobile-body manipulation device and manipulation system | |
| WO2025119448A1 (en) | Humanoid robot with tracks on legs configured for stand up sequence | |
| EP4696466A2 (en) | Mobile robot providing reality capture and metrology grade geometric measurement for supporting surveillance and metrology applications | |
| Ott et al. | Autonomous opening of a door with a mobile manipulator: A case study | |
| JP2008068339A (en) | Walking pattern creation device, biped walking robot device, walking pattern creation method, biped walking robot device control method, program, and recording medium | |
| Chong et al. | Autonomous wall cutting with an Atlas humanoid robot | |
| JP2014124734A (en) | Robot, and motion trajectory control system | |
| Hodoshima et al. | Telerobotic control system to enhance rescue operations for arm-equipped tracked vehicle HELIOS IX | |
| Tooyama et al. | Development of an assistive system for position control of a human hand with high speed and high accuracy | |
| Kurisu | A study on teleoperation system for a hexapod robot—Development of a prototype platform | |
| Lee et al. | System improvements in mobile haptic interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20240923 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: HEXAGON ROBOTICS GMBH |