CN112976025B - Soft and hard object recognition and adaptive grasping method based on humanoid manipulator - Google Patents

Soft and hard object recognition and adaptive grasping method based on humanoid manipulator Download PDF

Info

Publication number
CN112976025B
CN112976025B CN202110199135.5A CN202110199135A CN112976025B CN 112976025 B CN112976025 B CN 112976025B CN 202110199135 A CN202110199135 A CN 202110199135A CN 112976025 B CN112976025 B CN 112976025B
Authority
CN
China
Prior art keywords
grasped
finger
index finger
control board
pwm duty
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110199135.5A
Other languages
Chinese (zh)
Other versions
CN112976025A (en
Inventor
吴化平
孙申申
陈欢
施宽强
裘烨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University of Technology ZJUT
Original Assignee
Zhejiang University of Technology ZJUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University of Technology ZJUT filed Critical Zhejiang University of Technology ZJUT
Priority to CN202110199135.5A priority Critical patent/CN112976025B/en
Publication of CN112976025A publication Critical patent/CN112976025A/en
Application granted granted Critical
Publication of CN112976025B publication Critical patent/CN112976025B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J15/00Gripping heads and other end effectors
    • B25J15/0009Gripping heads and other end effectors comprising multi-articulated fingers, e.g. resembling a human hand
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1694Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Manipulator (AREA)

Abstract

The invention discloses an object hardness identification and self-adaptive grabbing method based on a humanoid manipulator device. The method for realizing the soft and hard identification and the self-adaptive grabbing of the object comprises the steps of setting the output force of a miniature electric push rod; judging the hardness of the grasped object; the device comprises a bracket, a humanoid manipulator, a sensing module, a control system and a driving module; the human-simulated manipulator is fixed on the support, the sensing module is arranged on fingers of the human-simulated manipulator, the driving module is connected to the back face of a palm of the human-simulated manipulator, the input end of the control system is electrically connected with the sensing module, and the output end of the control system is electrically connected with the driving module. The humanoid manipulator device can identify the hardness and softness of an object and can adaptively and stably grab the object with different hardness and softness attributes, is constructed by 3D printing and is provided with various sensing and sensing modules, and is expected to become a portable artificial limb or be applied to the field of service robots.

Description

Object soft and hard recognition and self-adaptive grabbing method based on humanoid manipulator device
Technical Field
The invention relates to the technical field of humanoid robots, in particular to a method for recognizing hardness and self-adaptive grabbing of an object based on a humanoid manipulator device, which can actively sense the hardness and softness of the object and realize self-adaptive grabbing of the object on the premise of not damaging the object.
Background
With the rapid development of the robot technology, the use of a mechanical gripper to grab and control an object is a basic task in life, production and scientific research, and the hardness and softness as one of the important attributes of the object can influence the grabbing control of the manipulator to the object to a great extent. At present, most of bionic mechanical arm researches are on the structure and the driving mode of the mechanical arm, and the mechanical arm can complete simple stretching, grabbing and other actions like a human hand, but the most defect of the mechanical arm researches is that multi-mode tactile information related to touch, force sense, pressure sense and the like cannot be acquired like the human hand. In the contact process of the manipulator and the object, the touch feedback information is a dynamic variable quantity, and the soft and hard attributes of the object cannot be well identified by only depending on the force feedback signal.
From the requirement of realizing the self functions of the bionic manipulator, most objects in real life are rigid or deformable, and the acquisition of the soft and hard attributes of the objects by sensing in advance is a precondition and an important guarantee for realizing the stable grabbing of the objects by the manipulator. When the manipulator grabs a hard object, the manipulator can control the magnitude of the grabbing force, so that the object can be stably grabbed, and the damage to the structure of the manipulator caused by excessive force in the grabbing process can be prevented; when the soft object is grabbed, the manipulator can be ensured to grab the object with proper grabbing force, and the grabbed object is prevented from being deformed or damaged due to overlarge grabbing force. The manipulator applies proper grabbing force according to the soft and hard characteristics of the object, so that the grabbed object is not damaged by extrusion, and the manipulator does not bear excessive reaction force, thereby realizing stable and flexible grabbing action.
Disclosure of Invention
The invention provides an object hardness identification and self-adaptive grabbing method based on a humanoid manipulator device, aiming at the defects that the bionic manipulator can not accurately reflect the hardness and softness of an object only by relying on a force feedback signal.
The technical scheme of the invention is as follows:
humanoid manipulator device
The device comprises a bracket, a humanoid manipulator, a sensing module, a control system and a driving module; the human-simulated manipulator is fixed on the support, the sensing module is arranged on fingers of the human-simulated manipulator, the driving module is connected to the back face of a palm of the human-simulated manipulator, the input end of the control system is electrically connected with the sensing module, and the output end of the control system is electrically connected with the driving module.
The human-simulated manipulator comprises a palm and five fingers connected with the palm, wherein the five fingers comprise an index finger, a middle finger, a ring finger, a thumb and a little finger; the sensing module comprises a liquid metal flexible strain sensor and a PVDF piezoelectric sensor; the control system comprises an STM32 control panel and an upper computer; the driving module comprises three miniature electric push rods of a first miniature electric push rod, a second miniature electric push rod and a third miniature electric push rod, a torsion spring and a driving flexible rope;
PVDF piezoelectric sensors wrapped by Polydimethylsiloxane (PDMS) are pasted on fingertips of an index finger, a ring finger and a thumb of the humanoid manipulator, liquid metal flexible strain sensors are pasted on a distal knuckle rotating joint and a middle knuckle rotating joint of the index finger of the humanoid manipulator, torsion springs are uniformly distributed at the distal knuckle rotating joints of the index finger, the middle finger, the ring finger and the little finger respectively, one torsion spring is uniformly distributed at the middle knuckle joints of the index finger, the middle finger, the ring finger and the little finger respectively, one torsion spring is distributed at the distal knuckle rotating joint of the thumb, no proximal knuckle rotating joint exists in five fingers of the humanoid manipulator, and proximal knuckles of the five fingers of the humanoid manipulator are vertically fixed on a palm and do not bend; the three miniature electric push rods are vertically fixed on the back of the palm, in the specific implementation, the bottoms of the three miniature electric push rods are vertically fixed on the bottom of the back of the palm, the tops of the three miniature electric push rods are fixed in the middle of the back of the palm, the three miniature electric push rods realize the bending of fingers by stretching the driving flexible ropes, one end of each driving flexible rope is fixed on the far knuckle of each finger of an index finger, a ring finger, a middle finger, a big finger and a small finger, and the other end of each driving flexible rope sequentially penetrates through the far knuckle, the far knuckle rotating joint, the middle knuckle rotating joint and the near knuckle of each finger and then is tied to the miniature electric push rods on the back of the palm;
PVDF piezoelectric sensor is through AD620 filtering collection module enlargies and connect the analog input end of STM32 control panel behind the conversion filtering, the flexible strain transducer of liquid metal is through dividing another input of electric road roller electricity connection STM32 control panel, the signal unidirectional transfer of PVDF piezoelectric sensor and the flexible strain transducer of liquid metal is for the STM32 control panel, the host computer is connected to an output electric connection of STM32 control panel, STM32 control panel and the two-way transmission signal of host computer, three miniature electric putter is connected to another output electricity of STM32 control panel, miniature electric putter realizes crooked and extension through the flexible rope of tensile drive and the imitative people manipulator of torsional spring control.
The upper computer and the STM32 control board control the three miniature electric push rods to contract, so that the driving flexible ropes of the fingers are tensioned, the torsion springs at the knuckle rotating joints of the fingers are bent, and the fingers are further driven to bend; the upper computer and the STM32 control board are stretched through controlling three miniature electric push rods, and then the drive flexible rope of each finger is loosened to make the drive flexible rope loosened, and the extension of each finger is realized under the effect of the torsional spring of each knuckle rotation joint department to each finger.
The drive flexible rope on the forefinger is tied on a first miniature electric push rod close to the back of the palm of the thumb, the drive flexible ropes on the middle finger, the ring finger and the little finger are all tied on a second miniature electric push rod in the middle of the back of the palm, and the drive flexible rope on the little finger is tied on a third miniature electric push rod far away from the back of the palm of the thumb.
The PVDF piezoelectric sensor monitors dynamic force, in the invention, when the pressure of a grasped object received by a finger changes, the PVDF piezoelectric sensor generates a voltage signal, and when the pressure of the grasped object received by the finger does not change, the PVDF piezoelectric sensor does not generate the voltage signal.
The PVDF piezoelectric sensor is prepared by a salivation method, the PVDF piezoelectric sensor is wrapped by Polydimethylsiloxane (PDMS) through a layered mode inversion method and is solidified in a 3D printed template, and the surface of a composite structure obtained after solidification has a fingerprint microstructure similar to human skin, so that the detection sensitivity is improved, the friction of a contact surface is increased, and the sliding during grabbing is avoided.
The liquid metal flexible strain sensor is prepared by adopting a mask method, a snake-shaped circuit structure is arranged in the liquid metal flexible strain sensor to increase the sensitivity of the liquid metal flexible strain sensor, and two ends of the liquid metal flexible strain sensor are respectively stuck and fixed at two rotating joints of an index finger in a sticking mode through a resin type silicon rubber special strong adhesive 988.
Second, object hardness identification and self-adaptive grabbing method based on humanoid manipulator device
The method comprises the following specific steps:
step S1: setting the output force of the miniature electric push rod:
step S11: firstly, the upper computer sends a program instruction with a PWM duty ratio signal of 80 to an STM32 control board, the STM32 control board controls a first micro electric push rod to retract, further pulls a driving flexible rope on a forefinger to enable the driving flexible rope to be tensioned, a torsional spring on the forefinger bends to enable the forefinger to bend, the forefinger bends to contact with a grasped object and completes knocking, when the forefinger does not contact with the grasped object, no voltage signal is generated by a PVDF piezoelectric sensor on the forefinger, when the forefinger contacts with the grasped object, a voltage signal is generated by the PVDF piezoelectric sensor on the forefinger, when the forefinger completes knocking, the grasped object receives a feedback force given by a humanoid manipulator, the PVDF piezoelectric sensor on the forefinger senses the grasped object and generates a voltage signal, after the forefinger completes knocking, the upper computer sends the program instruction with the PWM duty ratio signal of-80 to the STM32 control board, the STM32 control board controls the first micro electric push rod to extend, thereby driving the flexible driving rope on the forefinger to be loosened, and the torsion spring on the forefinger deforms and restores and drives the forefinger to restore to a straight state;
step S12: the voltage signal that PVDF piezoelectric sensor on the forefinger produced amplifies and converts the post-filtering to voltage signal output and sends to STM32 control panel through AD620 filtering collection module, judges the voltage interval that voltage signal belongs to through STM32 control panel operation processing, then STM32 control panel obtains the hardness grade that the voltage interval corresponds according to the following corresponding relation according to the voltage interval that voltage signal belongs to and obtains the hardness grade of being grabbed the object to the hardness grade that will be grabbed the object sends for the host computer:
if the voltage interval in which the voltage signal is located is [ 5-10) mv, the hardness grade of the grasped object is A, if the voltage interval in which the voltage signal is located is [ 10-25) mv, the hardness grade of the grasped object is B, if the voltage interval in which the voltage signal is located is [ 25-60) mv, the hardness grade of the grasped object is C, and if the voltage interval in which the voltage signal is located is [ 60-150 ] mv, the hardness grade of the grasped object is D;
the hardness scale a indicates softness, the hardness scale B indicates relatively softness, the hardness scale C indicates somewhat softness, and the hardness scale D indicates relatively hardness.
Step S13: the upper computer judges a PWM duty ratio signal interval corresponding to the hardness grade of the grasped object and an output force interval corresponding to the PWM duty ratio signal interval according to the obtained hardness grade of the grasped object and the following corresponding relation:
if the hardness grade of the grasped object is A, a PWM duty cycle signal interval corresponding to the hardness grade A is [ 80-100 ], and an output force interval corresponding to the PWM duty cycle signal interval [ 80-100) is [ 2-2.5) N; if the hardness grade of the grasped object is B, the PWM duty cycle signal interval corresponding to the hardness grade B is [ 100-140 ], and the output force interval corresponding to the PWM duty cycle signal interval [ 100-140 ] is [ 2.5-5) N; if the hardness grade of the grasped object is C, the PWM duty cycle signal interval corresponding to the hardness grade C is [ 140-190 ], and the output force interval corresponding to the PWM duty cycle signal interval [ 140-190) is [ 5-8.5) N; if the hardness grade of the grasped object is D, the PWM duty cycle signal interval corresponding to the hardness grade D is [ 190-255 ], and the output force interval corresponding to the PWM duty cycle signal interval [ 190-255 ] is [ 8.5-12.5 ] N;
the upper computer sends a program instruction of a minimum signal value corresponding to a PWM duty cycle signal interval corresponding to the hardness grade of the grasped object to an STM32 control board according to the obtained hardness grade of the grasped object, and the STM32 control board controls the micro electric push rod to output an output force corresponding to the minimum signal value corresponding to the PWM duty cycle signal interval according to the obtained program instruction;
step S2: judging the hardness of the grasped object:
step S21: the STM32 control panel is with the program command control first miniature electric putter of the minimum signal value that the hardness grade that obtains corresponds that PWM duty cycle signal interval corresponds that step S13 is contracted, and then the drive flexible rope on the taut forefinger makes the drive flexible rope by the tensioning, and the torsional spring on the forefinger is crooked and then makes the forefinger crooked until the forefinger is no longer crooked, forefinger and the object contact of being grabbed and accomplish the press of forefinger to the object of being grabbed, when the forefinger is accomplished to press the object of being grabbed, what the forefinger of imitative people 'S manipulator received is grabbed the object' S that the forefinger receivedPressure F2The output force is equal to the output force corresponding to the minimum signal value corresponding to the PWM duty ratio signal interval output by the first miniature electric push rod;
step S22: in the process of bending the forefinger, the two liquid metal sensors on the forefinger are stretched, the two liquid metal sensors output respective resistance signals, the forefinger stops bending until the resistance values of the resistance signals output by the two liquid metal sensors are not changed any more, the respective resistance signals output by the two liquid metal strain sensors are sent to an STM32 control panel through respective voltage division circuits, the STM32 control panel obtains the two resistance values and sends the two resistance values to an upper computer, the upper computer converts the two resistance values into two corners through analysis and calculation, the lengths of a far knuckle and a middle knuckle of the forefinger are known, and then the upper computer further obtains the fingertip displacement of the forefinger through calculation according to the two corners;
step S23: the hardness sensitivity coefficient S is used as the measurement of hardness of the grasped object, and the displacement of the fingertip of the index finger is equal to the deformation x of the grasped object under pressure in the process that the index finger presses the grasped object2(ii) a The soft and hard sensitivity coefficient S is calculated using the following formula:
Figure BDA0002947449010000051
in the formula, K1Denotes the elastic coefficient, x, of the index finger tip2Representing the amount of compressive deformation of the gripped object, F2Indicating the pressure applied by the index finger of the manipulator when the pressing is finished;
obtaining the softness and hardness of the grasped object after obtaining the softness and hardness sensitivity coefficient S; the closer the value of the soft and hard sensitivity coefficient S is to 1, the softer the object is; the closer the value of the soft and hard sensitivity coefficient S is to 0, the harder the object is;
step S3: stably grabbing a grabbed object:
step S31: when the grabbed object is grabbed, the mechanical arm is fixed on the humanoid manipulator to realize that the grabbed object is grabbed after five fingers are contacted with the grabbed object; the STM32 control board controls the three micro electric push rods to contract according to the program instruction of the minimum signal value corresponding to the PWM duty ratio signal interval corresponding to the hardness grade obtained in the step S13, so that five fingers including the index finger, the ring finger, the middle finger, the thumb and the small finger of the manipulator are bent;
step S32: when the five fingers bend to be in contact with a grasped object, the PVDF piezoelectric sensors on the index finger, the ring finger and the thumb all generate voltage signals, and when the pressure of the grasped object on the five fingers is equal to the output force corresponding to the minimum signal value corresponding to the PWM duty ratio signal interval output by the three miniature electric push rods, the grasping of the grasped object by the five fingers is completed;
step S33: after the five fingers complete the grabbing of the grabbed object, the PVDF piezoelectric sensors on the index finger, the ring finger and the thumb do not generate voltage signals, and in the grabbing process of the grabbed object under the action of the mechanical arm: friction force is generated between a grasped object and five fingers, if the value of the maximum friction force is larger than or equal to the gravity of the grasped object, relative sliding does not occur between the five fingers and the grasped object, no voltage signal is generated by the PVDF piezoelectric sensors on the index finger, the ring finger and the thumb, the five fingers can stably grasp the grasped object, if the value of the maximum friction force is smaller than the gravity of the grasped object, relative sliding occurs between the five fingers and the grasped object, voltage signals are generated by the PVDF piezoelectric sensors on the index finger, the ring finger and the thumb, and the five fingers do not stably grasp the grasped object;
if no voltage signal is generated by the PVDF piezoelectric sensors on the index finger, the ring finger and the thumb, which indicates that no sliding occurs between the five fingers and the grasped object, the stable grasping of the grasped object by the five fingers is completed;
if at least one of the PVDF piezoelectric sensors on the index finger, the ring finger and the thumb is detected to generate a voltage signal, the sliding between the five fingers and the grasped object is indicated, and then the step S34 is carried out;
step S34: voltage signals generated by the PVDF piezoelectric sensor are amplified, converted and filtered by an AD620 filtering and collecting module, then the voltage signals are output and sent to an STM32 control panel, then the STM32 control panel sends the obtained voltage signals to an upper computer, the upper computer gradually updates and enlarges signal values corresponding to PWM duty cycle signal intervals corresponding to the hardness grade of a grasped object in an instruction program and sends the signal values to an STM32 control panel, the STM32 control panel controls three miniature electric push rods to contract according to the instruction program which is gradually updated and enlarged each time, and then five fingers of a forefinger, a ring finger, a middle finger, a thumb and a little finger of the manipulator are bent;
step S35: repeating the steps S32-S34, and in the step S34, if the adjusted PWM duty ratio signal value reaches the maximum signal value corresponding to the PWM duty ratio signal interval corresponding to the hardness grade of the grasped object, detecting that a voltage signal is generated by the PVDF piezoelectric sensor in the process of grasping the grasped object under the action of the mechanical arm in the step S33, preventing the grasped object from being damaged, directly abandoning the grasping, and judging that the grasping fails, which indicates that five fingers do not finish stably grasping the grasped object.
The invention can be used for judging the hardness of the grasped object, and can also be used for judging the hardness of the grasped object and grasping the grasped object; only the hardness of the grasped object is judged by performing the steps S1 to S2.
The invention has the beneficial effects that:
(1) the human-simulated manipulator system is based on a rigid manipulator framework, but is not limited to a rigid manipulator, and the manipulator sensor is flexible, so that the system for realizing object hardness perception can be applied to a flexible manipulator;
(2) through the PVDF piezoelectric sensor and the liquid metal flexible sensor, the soft and hard of the object are represented and identified through the voltage and strain dual signals, the soft and hard attributes of the object can be accurately identified, and the self-adaptive stable grabbing of the humanoid manipulator for the objects with different soft and hard attributes is realized;
(3) in the grabbing process, whether an object slides can be detected in real time through whether the PVDF piezoelectric sensor outputs a piezoelectric signal or not, and convenience and accuracy are achieved;
(4) the artificial limb is expected to become a portable artificial limb or be applied to the field of service robots by adopting the structural design of a human palm imitation and being provided with various sensing modules;
(5) the manipulator is constructed through 3D printing, so that the manufacturing cost is low and the period is short.
Summarizing, the humanoid manipulator device can identify the hardness and softness of objects and can adaptively and stably grab the objects with different hardness and softness attributes, and the humanoid manipulator device is constructed by 3D printing and is provided with various perception sensing modules, so that the humanoid manipulator device is expected to become a portable artificial limb or be applied to the field of service robots.
Drawings
FIG. 1 is a schematic structural view of a humanoid manipulator of the present invention;
FIG. 2 is a schematic diagram of the index finger of the humanoid manipulator of the present invention;
FIG. 3 is a schematic view of a driving structure of the humanoid manipulator of the present invention;
FIG. 4 is a schematic view of the humanoid robot system of the present invention;
FIG. 5 is a flow chart of the soft and hard identification of the humanoid manipulator system of the invention;
FIG. 6 is a flow chart of the stabilized grasping of the humanoid manipulator system of the present invention;
FIG. 7 is a graph of voltage signals from PVDF voltage sensors as a robot recognizes objects of different stiffness in accordance with the present invention;
FIG. 8 is a signal diagram of a liquid metal strain sensor for identifying an object by a manipulator according to the present invention; in FIG. 8, R1 represents the measured signal of the flexible liquid metal strain sensor at the knuckle of the index finger; r2 represents the measured signal of the flexible liquid metal strain sensor at the distal knuckle revolute joint of the index finger.
In the figure, 1 forefinger, 2 middle finger, 3 ring finger, 4 little finger, 6 thumb, 7 palm, 8 supports, 9PVDF piezoelectric sensors, 10 torsion springs, 11 distal knuckle rotating joints, 12 driving flexible ropes, 13 liquid metal flexible strain sensors, 15 middle knuckle rotating joints, 16 first miniature electric push rods, 17 second miniature electric push rods and 18 third miniature electric push rods.
Detailed Description
In order to more clearly explain the technical solution of the present invention, the following detailed description will be made with reference to the accompanying drawings and examples.
As shown in fig. 1, the device of the invention comprises a bracket 8, a humanoid manipulator, a sensing module, a control system and a driving module; the humanoid manipulator is fixed on the support 8, the sensing module is arranged on fingers of the humanoid manipulator, the driving module is arranged and connected to the back face of a palm of the humanoid manipulator, the input end of the control system is electrically connected with the sensing module, and the output end of the control system is electrically connected with the driving module.
As shown in fig. 2 and 3, the humanoid manipulator comprises a palm 7 and five fingers connected with the palm 7, wherein the five fingers comprise an index finger 1, a middle finger 2, a ring finger 3, a big finger 6 and a small finger 4; the sensing module comprises a liquid metal flexible strain sensor 13 and a PVDF piezoelectric sensor 9; the control system comprises an STM32 control panel and an upper computer; the driving module comprises three miniature electric push rods of a first miniature electric push rod 16, a second miniature electric push rod 17 and a third miniature electric push rod 18, a torsion spring 10 and a driving flexible rope 12;
PVDF piezoelectric sensors 9 wrapped by polydimethylsiloxane PDMS are pasted on fingertips of an index finger 1, a ring finger 3 and a thumb 6 of the human-simulated manipulator, liquid metal flexible strain sensors 13 are pasted on a distal knuckle rotating joint 11 and a middle knuckle rotating joint 15 of the index finger 1 of the human-simulated manipulator, torsion springs 10 are respectively arranged at distal knuckle rotating joints of the index finger 1, a middle finger 2, the ring finger 3 and the small finger 4, torsion springs 10 are respectively arranged at middle knuckle joints of the index finger 1, the middle finger 2, the ring finger 3 and the small finger 4, torsion springs 10 are respectively arranged at distal knuckle rotating joints of the thumb 6, no proximal knuckle rotating joint exists in five fingers of the human-simulated manipulator, and proximal knuckles of the five fingers of the human-simulated manipulator are vertically fixed on a palm 7 and do not bend; the three miniature electric push rods are vertically fixed on the back of the palm 7, in the specific implementation, the bottoms of the three miniature electric push rods are vertically fixed on the bottom of the back of the palm, the tops of the three miniature electric push rods are fixed in the middle of the back of the palm 7, the three miniature electric push rods realize the bending of fingers by stretching the driving flexible ropes 12, one end of each driving flexible rope 12 is fixed on the far knuckle of each finger of the forefinger 1, the ring finger 3, the middle finger 2, the big finger 6 and the small finger 4, and the other end of each driving flexible rope 12 sequentially penetrates through the far knuckle, the far knuckle rotating joint, the middle knuckle rotating joint and the near knuckle of each finger and then is tied to the miniature electric push rods on the back of the palm 7;
PVDF piezoelectric sensor 9 is through AD620 filtering collection module enlargies and connect the analog input end of STM32 control panel behind the conversion filtering, flexible strain transducer 13 of liquid metal is through dividing another input of electric road roller electricity connection STM32 control panel, the signal unidirectional transfer of PVDF piezoelectric sensor 9 and flexible strain transducer 13 of liquid metal is for the STM32 control panel, the host computer is connected to an output electricity of STM32 control panel, STM32 control panel and the two-way transmission signal of host computer, three miniature electric putter is connected to another output electricity of STM32 control panel, miniature electric putter realizes crooked and extension through tensile drive flexible rope 12 and torsional spring 10 control humanoid manipulator.
As shown in fig. 4, the upper computer and the STM32 control board control the three micro electric push rods to contract, and further tension the driving flexible ropes 12 of each finger, so that the driving flexible ropes 12 are tensioned, and the torsion springs 10 at the knuckle rotating joints of each finger are bent, and further the fingers are driven to bend; the upper computer and the STM32 control board control the three micro electric push rods to stretch, and further loosen the driving flexible ropes 12 of each finger to enable the driving flexible ropes 12 to be loosened, and the extension of each finger is realized under the action of the torsion springs 10 at the rotating joints of each knuckle.
The driving flexible rope 12 on the forefinger 1 is tied on a first miniature electric push rod 16 close to the back of the palm 7 of the thumb, the driving flexible ropes 12 on the middle finger 2, the ring finger 3 and the little finger 4 are all tied on a second miniature electric push rod 17 in the middle of the back of the palm 7, and the driving flexible rope 12 on the little finger 6 is tied on a third miniature electric push rod 18 far away from the back of the palm 7 of the thumb.
The PVDF piezoelectric transducer 9 of the invention monitors dynamic forces, when the force changes, the PVDF piezoelectric transducer 9 generates a voltage signal, when the force does not change, the PVDF piezoelectric transducer 9 does not generate a voltage signal.
The PVDF piezoelectric sensor 9 is prepared by a salivation method, the PVDF piezoelectric sensor 9 is wrapped by polydimethylsiloxane PDMS through a layered mode inversion method and is solidified in a 3D printed template, and the surface of a composite structure obtained after solidification has a fingerprint microstructure similar to human skin, so that the detection sensitivity is improved, the friction of a contact surface is increased, and the sliding during grabbing is avoided.
The liquid metal flexible strain sensor 13 is prepared by adopting a mask method, a snake-shaped circuit structure is arranged in the liquid metal flexible strain sensor 13 to increase the sensitivity of the liquid metal flexible strain sensor, and two ends of the liquid metal flexible strain sensor 13 are respectively stuck and fixed at two rotating joints of the forefinger 1 in a sticking way through a resin type silicon rubber special strong adhesive 988.
As shown in fig. 5 and 6, the method for recognizing hardness of an object and performing adaptive grasping by using a humanoid manipulator device for recognizing hardness of the object and performing adaptive grasping includes the following steps:
step S1: setting and acquiring the output force of the miniature electric push rod:
step S11: firstly, the upper computer sends a program instruction with a PWM duty ratio signal of 80 to an STM32 control board, the STM32 control board controls a first micro electric push rod 16 to retract, and further pulls a driving flexible rope 12 on a forefinger 1 to tension the driving flexible rope 12, a torsion spring 10 on the forefinger 1 bends to bend the forefinger 1, the forefinger 1 bends to contact with a grasped object and complete knocking, when the forefinger 1 does not contact with the grasped object, no voltage signal is generated by a PVDF piezoelectric sensor 9 on the forefinger 1, when the forefinger 1 contacts with the grasped object, a voltage signal is generated by the PVDF piezoelectric sensor 9 on the forefinger 1, when the forefinger 1 completes knocking, the grasped object receives a feedback force given by a humanoid manipulator, the PVDF piezoelectric sensor 9 on the forefinger 1 senses the grasped object and generates the voltage signal, after the forefinger 1 completes knocking, the upper computer sends the program instruction with the PWM duty ratio signal of-80 to the STM32 control board, the STM32 control panel controls the first miniature electric push rod 16 to extend out, and then drives the driving flexible rope 12 on the forefinger 1 to be loosened, the torsion spring 10 on the forefinger 1 deforms and restores and drives the forefinger 1 to restore to the straight state;
step S12: the voltage signal that PVDF piezoelectric sensor 9 on forefinger 1 produced amplifies and converts the post-filtration through AD620 filtering collection module and sends voltage signal output to STM32 control panel, judges the voltage interval that voltage signal belongs to through STM32 control panel operation processing, then the hardness grade that obtains the hardness grade that the voltage interval corresponds according to the voltage interval that voltage signal belongs to the STM32 control panel according to the following corresponding relation obtains the hardness grade of being grabbed the object, and will be grabbed the hardness grade of object and send for the host computer:
if the voltage interval in which the voltage signal is located is [ 5-10) mv, the hardness grade of the grasped object is A, if the voltage interval in which the voltage signal is located is [ 10-25) mv, the hardness grade of the grasped object is B, if the voltage interval in which the voltage signal is located is [ 25-60) mv, the hardness grade of the grasped object is C, and if the voltage interval in which the voltage signal is located is [ 60-150 ] mv, the hardness grade of the grasped object is D;
the hardness scale a indicates softness, the hardness scale B indicates relatively softness, the hardness scale C indicates somewhat softness, and the hardness scale D indicates relatively hardness.
Step S13: the upper computer judges a PWM duty ratio signal interval corresponding to the hardness grade of the grasped object and an output force interval corresponding to the PWM duty ratio signal interval according to the obtained hardness grade of the grasped object and the following corresponding relation:
if the hardness grade of the grasped object is A, the PWM duty cycle signal interval corresponding to the hardness grade A is [ 80-100 ], and the output force interval corresponding to the PWM duty cycle signal interval [ 80-100) is [ 2-2.5N; if the hardness grade of the grasped object is B, the PWM duty cycle signal interval corresponding to the hardness grade B is [ 100-140 ], and the output force interval corresponding to the PWM duty cycle signal interval [ 100-140 ] is [ 2.5-5N; if the hardness grade of the grasped object is C, the PWM duty cycle signal interval corresponding to the hardness grade C is [ 140-190 ], and the output force interval corresponding to the PWM duty cycle signal interval [ 140-190) is [ 5-8.5N; if the hardness grade of the grasped object is D, the PWM duty cycle signal interval corresponding to the hardness grade D is [ 190-255 ], and the output force interval corresponding to the PWM duty cycle signal interval [ 190-255 ] is [ 8.5-12.5 ] N;
the upper computer sends a program instruction of a minimum signal value corresponding to a PWM duty cycle signal interval corresponding to the hardness grade of the grasped object to an STM32 control board according to the obtained hardness grade of the grasped object, and the STM32 control board controls the micro electric push rod to output an output force corresponding to the minimum signal value corresponding to the PWM duty cycle signal interval according to the obtained program instruction;
step S2: judging the hardness of the grasped object:
step S21: the STM32 control board controls the first micro electric push rod 16 to contract according to the program instruction of the minimum signal value corresponding to the PWM duty cycle signal interval corresponding to the hardness grade obtained in the step S13, further, the driving flexible rope 12 on the index finger 1 is tensioned, the torsion spring 10 on the index finger 1 bends, further, the index finger 1 bends until the index finger 1 does not bend, the index finger 1 contacts with the grasped object and completes the pressing of the index finger 1 on the grasped object, and when the index finger 1 finishes the pressing of the grasped object, the pressure F of the grasped object received by the index finger 1 of the humanoid manipulator2Is equal to the magnitude of the output force corresponding to the minimum signal value corresponding to the PWM duty cycle signal interval output by the first miniature electric push rod 16;
step S22: in the bending process of the index finger 1, the two liquid metal sensors 13 on the index finger 1 are stretched, the two liquid metal sensors 13 output respective resistance signals, the index finger 1 stops bending when the resistance values of the resistance signals output by the two liquid metal sensors 13 are not changed, the respective resistance signals output by the two liquid metal strain sensors 13 are sent to an STM32 control board through respective voltage division circuits, the STM32 control board obtains two resistance values and sends the two resistance values to an upper computer, the upper computer converts the two resistance values into two rotation angles through analysis and calculation, and as shown in FIG. 8, R1 represents the measured signals of the flexible liquid metal strain sensors at the knuckle rotating joint of the index finger; r2 represents the measured signal of the flexible liquid metal strain sensor at the rotating joint of the far knuckle of the index finger, the length of the far knuckle and the middle knuckle of the index finger is known, and then the upper computer further calculates to obtain the fingertip displacement of the index finger 1 according to the two rotating angles;
step S23: to be softThe hard sensitivity coefficient S is used as the measurement of the hardness of the grasped object, and the displacement of the fingertip of the index finger 1 is equal to the deformation x of the grasped object under pressure in the process that the index finger 1 presses the grasped object2(ii) a The soft and hard sensitivity coefficient S is calculated using the following formula:
Figure BDA0002947449010000111
in the formula, K1Denotes the elastic coefficient, x, of the index finger 1 tip2Representing the amount of compressive deformation of the gripped object, F2Indicating the pressure applied by the index finger 1 of the manipulator when the pressing is finished;
obtaining the softness and hardness of the grasped object after obtaining the softness and hardness sensitivity coefficient S; the closer the value of the soft and hard sensitivity coefficient S is to 1, the softer the object is; the closer the value of the soft and hard sensitivity coefficient S is to 0, the harder the object is;
in specific implementation, the mechanical arm is regarded as elastic deformation, and under a certain mechanical pressure F, the overall deformation of the system can be expressed as the deformation x of the fingertip sensor1And deformation x of the object to be grasped2Then the equivalent elastic coefficient of the system can be expressed as:
Figure BDA0002947449010000112
assuming that the system elastic coefficient varies with contact, S ═ dK/dK is defined2Is the soft and hard sensitivity coefficient. Wherein, dK2Representing the elastic coefficient of the gripped object.
If the contact force is low, the mechanical behavior of the grasped object and the fingertip sensor is considered to be in accordance with linear elastic deformation, and K is used at the moment2As variables and derived from them, we can:
Figure BDA0002947449010000113
the elastic coefficient of the grabbed object is obtained through the compressive deformation quantity of the object, and then the soft and hard sensitivity coefficient S capable of representing the soft and hard attributes of the object is calculated, so that the humanoid manipulator system can sense the soft and hard attributes of the object.
After the soft and hard attributes of the object are obtained, the humanoid manipulator system can apply different grabbing forces to the object with different hardness, and then the manipulator can grab the object in a self-adaptive mode.
The humanoid manipulator can also judge whether preslip and slide occur in the grabbing process through the signal output of the piezoelectric sensor, and further guarantee that the manipulator stably grabs the object.
Step S3: stably grabbing a grabbed object:
step S31: when the grabbed object is grabbed, the mechanical arm is fixed on the humanoid manipulator to realize that the grabbed object is grabbed after five fingers are contacted with the grabbed object; the STM32 control board controls the three micro electric push rods to contract according to the program instruction of the minimum signal value corresponding to the PWM duty ratio signal interval corresponding to the hardness grade obtained in the step S13, so that five fingers of the index finger 1, the ring finger 3, the middle finger 2, the thumb 6 and the little finger 4 of the manipulator are bent;
step S32: when the five fingers bend to be in contact with a grasped object, the PVDF piezoelectric sensors 9 on the index finger 1, the ring finger 3 and the thumb 6 all generate voltage signals, and when the pressure of the grasped object on the five fingers is equal to the output force corresponding to the minimum signal value corresponding to the PWM duty cycle signal interval output by the three miniature electric push rods, the grasping of the grasped object by the five fingers is completed;
step S33: after the five fingers complete the grabbing of the grabbed object, the PVDF piezoelectric sensors 9 on the index finger 1, the ring finger 3 and the thumb 6 do not generate voltage signals, and in the grabbing process of the grabbed object under the action of the mechanical arm:
friction force is generated between the grasped object and five fingers, if the value of the maximum friction force is larger than or equal to the gravity of the grasped object, relative sliding does not occur between the five fingers and the grasped object, no voltage signal is generated by the PVDF piezoelectric sensors 9 on the index finger 1, the ring finger 3 and the thumb 6, the five fingers can stably grasp the grasped object, if the value of the maximum friction force is smaller than the gravity of the grasped object, relative sliding occurs between the five fingers and the grasped object, voltage signals are generated by the PVDF piezoelectric sensors 9 on the index finger 1, the ring finger 3 and the thumb 6, and the five fingers do not stably grasp the grasped object.
If no voltage signal is generated on the PVDF piezoelectric sensors on the index finger 1, the ring finger 3 and the thumb 6, which indicates that no sliding occurs between the five fingers and the grasped object, the stable grasping of the grasped object by the five fingers is completed;
if at least one of the PVDF piezoelectric sensors 9 on the index finger 1, the ring finger 3 and the thumb 6 is detected to have a voltage signal generated, the sliding between the five fingers and the grasped object is indicated, and then the step S34 is carried out;
step S34: voltage signals generated by the PVDF piezoelectric sensor 9 are amplified, converted and filtered by an AD620 filtering and collecting module, then the voltage signals are output and sent to an STM32 control panel, then the STM32 control panel sends the obtained voltage signals to an upper computer, the upper computer gradually updates and adjusts signal values corresponding to PWM duty cycle signal intervals corresponding to the hardness grade of a grasped object in an instruction program and sends the signal values to an STM32 control panel, the STM32 control panel controls three micro electric push rods to contract according to the instruction program which is gradually updated and adjusted each time, and then five fingers of a forefinger 1, a ring finger 3, a middle finger 2, a thumb 6 and a little finger 4 of the manipulator are bent;
step S35: repeating the steps S32-S34, and in step S34, if the adjusted PWM duty signal value reaches the maximum signal value corresponding to the PWM duty signal interval corresponding to the hardness level of the grasped object, it is still detected that the PVDF piezoelectric sensor 9 generates a voltage signal in the process of grasping the grasped object under the action of the robot arm in step S33, so as to prevent the grasped object from being damaged, directly abandon the grasping, and determine that the grasping fails, which indicates that the five fingers have not completed the stable grasping of the grasped object.
Fig. 7 is a voltage signal diagram obtained by the PVDF voltage sensor when the manipulator identifies objects with different hardness, fig. 7 is a voltage signal diagram obtained by the PVDF voltage sensor when the manipulator identifies the sponge, the Ecoflex, the PDMS, and the steel block in sequence from left to right, and voltage signals generated by the PVDF voltage sensor are also different when the manipulator identifies objects with different hardness.
According to the invention, the hard humanoid manipulator manufactured by 3D printing is used as a framework, so that soft and hard identification and self-adaptive stable grabbing of an object can be realized. However, since the flexible sensor is used to identify the physical properties of the object in the present invention, the present invention is not limited to the foregoing embodiments, and can be applied to various flexible robot systems.

Claims (6)

1.一种基于仿人机械手装置的物体软硬识别和自适应抓取方法,其特征在于:包括以下具体步骤:1. a kind of object soft and hard recognition and self-adaptive grasping method based on humanoid manipulator device, it is characterized in that: comprise the following concrete steps: 步骤S1:设置微型电动推杆的输出力:Step S1: Set the output force of the miniature electric actuator: 步骤S11:首先,上位机向STM32控制板发送PWM占空比信号为80的程序指令,STM32控制板控制第一微型电动推杆(16)进行缩回,进而拉动食指(1)上的驱动柔绳(12)使驱动柔绳(12)被拉紧,食指(1)上的扭簧(10)弯曲进而使得食指(1)弯曲,食指(1)弯曲至与被抓物体接触并完成敲击一下,食指(1)完成敲击时,食指(1)上的PVDF压电传感器(9)产生电压信号,食指(1)完成敲击之后,上位机为STM32控制板发送PWM占空比信号为-80的程序指令,STM32控制板控制第一微型电动推杆(16)进行伸出,进而带动食指(1)上的驱动柔绳(12)被放松,食指(1)上的扭簧(10)变形恢复并带动食指(1)恢复到伸直状态;Step S11: First, the host computer sends a program command with a PWM duty cycle signal of 80 to the STM32 control board, and the STM32 control board controls the first micro electric push rod (16) to retract, and then pulls the drive soft on the index finger (1). The rope (12) makes the driving rope (12) taut, the torsion spring (10) on the index finger (1) is bent and the index finger (1) is bent, and the index finger (1) is bent to contact the grasped object and complete the knock When the index finger (1) completes the tapping, the PVDF piezoelectric sensor (9) on the index finger (1) generates a voltage signal. After the index finger (1) completes the tapping, the host computer sends the PWM duty cycle signal to the STM32 control board as -80 program command, the STM32 control board controls the first micro electric push rod (16) to extend, which in turn drives the driving cord (12) on the index finger (1) to be loosened, and the torsion spring (10) on the index finger (1). ) deformation recovery and drive the index finger (1) to return to the straight state; 步骤S12:食指(1)上的PVDF压电传感器(9)产生的电压信号经滤波采集模块放大和转换滤波后输出发送至STM32控制板,经STM32控制板运算处理判断电压信号所在的电压区间,然后STM32控制板根据电压信号所在的电压区间按照以下对应关系获得电压区间对应的硬度等级得到被抓物体的硬度等级,并将被抓物体的硬度等级发送给上位机:Step S12: The voltage signal generated by the PVDF piezoelectric sensor (9) on the index finger (1) is amplified, converted and filtered by the filter acquisition module, and then output and sent to the STM32 control board, and the STM32 control board arithmetic processing determines the voltage range where the voltage signal is located, Then the STM32 control board obtains the hardness level corresponding to the voltage range according to the voltage range in which the voltage signal is located according to the following correspondence, and then sends the hardness level of the grasped object to the host computer: 若电压信号所在的电压区间为[5~10)mv,则被抓物体的硬度等级为A,若电压信号所在的电压区间为[10~25)mv,则被抓物体的硬度等级为B,若电压信号所在的电压区间为[25~60)mv,则被抓物体的硬度等级为C,若电压信号所在的电压区间为[60~150]mv,则被抓物体的硬度等级为D;If the voltage range where the voltage signal is located is [5~10)mv, the hardness level of the grasped object is A; if the voltage range where the voltage signal is located is [10~25)mv, the hardness level of the grasped object is B. If the voltage range of the voltage signal is [25~60]mv, the hardness level of the grasped object is C; if the voltage range of the voltage signal is [60~150]mv, the hardness level of the grasped object is D; 步骤S13:上位机根据获得的被抓物体的硬度等级,按照以下对应关系判断被抓物体的硬度等级对应的PWM占空比信号区间以及PWM占空比信号区间对应的输出力区间:Step S13: The host computer judges the PWM duty cycle signal interval corresponding to the hardness class of the grasped object and the output force interval corresponding to the PWM duty cycle signal interval according to the obtained hardness level of the object to be grasped according to the following correspondence: 若获得的被抓物体的硬度等级为A,则硬度等级A对应的PWM占空比信号区间为[80~100),PWM占空比信号区间[80~100)对应的输出力区间为[2~2.5)N;若获得的被抓物体的硬度等级为B,则硬度等级B对应的PWM占空比信号区间为[100~140),PWM占空比信号区间[100~140)对应的输出力区间为[2.5~5)N;若获得的被抓物体的硬度等级为C,则硬度等级C对应的PWM占空比信号区间为[140~190),PWM占空比信号区间[140~190)对应的输出力区间为[5~8.5)N;若获得的被抓物体的硬度等级为D,则硬度等级D对应的PWM占空比信号区间为[190~255],PWM占空比信号区间[190~255]对应的输出力区间为[8.5~12.5]N;If the obtained hardness level of the object to be grasped is A, the PWM duty cycle signal interval corresponding to hardness level A is [80~100), and the output force interval corresponding to the PWM duty cycle signal interval [80~100) is [2 ~2.5)N; if the obtained hardness level of the object to be grasped is B, the PWM duty cycle signal interval corresponding to hardness level B is [100~140), and the output corresponding to the PWM duty cycle signal interval [100~140) The force interval is [2.5~5)N; if the obtained hardness level of the object to be grasped is C, the PWM duty cycle signal interval corresponding to hardness level C is [140~190), and the PWM duty cycle signal interval is [140~ 190) The corresponding output force interval is [5~8.5)N; if the obtained hardness level of the object to be grasped is D, the PWM duty cycle signal interval corresponding to hardness level D is [190~255], and the PWM duty cycle The output force interval corresponding to the signal interval [190~255] is [8.5~12.5]N; 上位机根据所获得的被抓物体的硬度等级向STM32控制板发送被抓物体的硬度等级对应的PWM占空比信号区间对应的最小信号值的程序指令,STM32控制板根据所获得的程序指令控制微型电动推杆输出PWM占空比信号区间对应的最小信号值对应的输出力;The host computer sends the program command of the minimum signal value corresponding to the PWM duty cycle signal interval corresponding to the hardness level of the grasped object to the STM32 control board according to the obtained hardness level of the object to be grasped, and the STM32 control board controls according to the obtained program command. The miniature electric push rod outputs the output force corresponding to the minimum signal value corresponding to the PWM duty cycle signal interval; 步骤S2:判断被抓物体的软硬:Step S2: Determine the hardness of the grasped object: 步骤S21:STM32控制板以步骤S13所获得的硬度等级对应的PWM占空比信号区间对应的最小信号值的程序指令控制第一微型电动推杆(16)进行收缩,进而拉紧食指(1)上的驱动柔绳(12)被张紧,食指(1)上的扭簧(10)弯曲进而使得食指(1)弯曲直至食指(1)不再弯曲时,食指(1)与被抓物体接触并完成食指(1)对被抓物体的按压,在食指(1)完成按压被抓物体时,仿人机械手的食指(1)受到的压力F2的大小等于第一微型电动推杆(16)输出的PWM占空比信号区间对应的最小信号值对应的输出力的大小;Step S21: The STM32 control board controls the first micro electric push rod (16) to shrink according to the program command of the minimum signal value corresponding to the PWM duty cycle signal interval corresponding to the hardness level obtained in step S13, and then tightens the index finger (1) The driving cable (12) on the upper part is tensioned, and the torsion spring (10) on the index finger (1) is bent so that the index finger (1) is bent until the index finger (1) is no longer bent, and the index finger (1) is in contact with the object to be grasped. And complete the index finger (1) pressing the object to be grasped, when the index finger (1) completes pressing the object to be grasped, the magnitude of the pressure F 2 received by the index finger (1) of the humanoid manipulator is equal to the first miniature electric push rod (16) The magnitude of the output force corresponding to the minimum signal value corresponding to the output PWM duty cycle signal interval; 步骤S22:在食指(1)弯曲过程中,食指(1)上的两个液态金属传感器(13)均被拉伸,两个液态金属传感器(13)输出各自的电阻信号,直至两个液态金属传感器(13)输出的电阻信号的电阻值均不再变化时食指(1)停止弯曲,两个液态金属应变传感器(13)输出的各自的电阻信号均经分压电路发送至STM32控制板,STM32控制板获得两个电阻值并发送给上位机,上位机经分析计算将两个电阻值转化为两个转角,然后,上位机根据两个转角进一步经计算获得食指(1)指尖位移;Step S22: During the bending process of the index finger (1), the two liquid metal sensors (13) on the index finger (1) are stretched, and the two liquid metal sensors (13) output respective resistance signals until the two liquid metal sensors (13) When the resistance value of the resistance signal output by the sensor (13) no longer changes, the index finger (1) stops bending, and the respective resistance signals output by the two liquid metal strain sensors (13) are sent to the STM32 control board through the voltage divider circuit, and the STM32 The control board obtains two resistance values and sends them to the host computer. The host computer converts the two resistance values into two corners after analysis and calculation. Then, the host computer further calculates the displacement of the index finger (1) according to the two corners; 步骤S23:以软硬敏感性系数S作为被抓物体软硬的度量,食指按压被抓物体的过程中,食指指尖位移等于被抓物体受压变形量x2;软硬敏感性系数S采用以下公式计算:Step S23: The soft and hard sensitivity coefficient S is used as a measure of the softness and hardness of the grasped object. During the process of pressing the grasped object with the index finger, the displacement of the forefinger fingertip is equal to the compression deformation amount x 2 of the grasped object; the soft and hard sensitivity coefficient S adopts The following formula calculates:
Figure FDA0002947448000000021
Figure FDA0002947448000000021
式中,K1表示食指指尖的弹性系数,x2表示被抓物体受压形变量,F2表示机械手的食指按压完成时受到的压力;In the formula, K 1 represents the elastic coefficient of the index finger tip, x 2 represents the compression deformation of the grasped object, and F 2 represents the pressure received by the index finger of the manipulator when the pressing is completed; 获得软硬敏感性系数S后,即获得被抓物体的软硬;After obtaining the soft and hard sensitivity coefficient S, the soft and hard of the grasped object is obtained; 步骤S3:对被抓物体稳定抓取:Step S3: Grasp the grasped object stably: 步骤S31:对被抓物体进行抓取时,在仿人机械手上固定机械臂以实现五个手指与被抓物体接触后把被抓物体抓起来;STM32控制板以步骤S13所获得的硬度等级对应的PWM占空比信号区间对应的最小信号值的程序指令控制三个微型电动推杆进行收缩,进而使得机械手的五个手指均弯曲;Step S31: When grasping the object to be grasped, fix the robotic arm on the humanoid manipulator to realize that five fingers are in contact with the object to be grasped and then grasp the object to be grasped; the STM32 control board corresponds to the hardness level obtained in step S13 The program command of the minimum signal value corresponding to the PWM duty cycle signal interval controls the three miniature electric push rods to shrink, so that all five fingers of the manipulator are bent; 步骤S32:五个手指弯曲至与被抓物体接触时,食指(1)、无名指(3)和大拇指(6)上的PVDF压电传感器(9)均产生电压信号,当五个手指受到的压力的大小均等于三个微型电动推杆输出的PWM占空比信号区间对应的最小信号值对应的输出力的大小时完成五个手指对被抓物体的抓取;Step S32: when the five fingers are bent to contact the grasped object, the PVDF piezoelectric sensors (9) on the index finger (1), the ring finger (3) and the thumb (6) all generate voltage signals. When the magnitude of the pressure is equal to the magnitude of the output force corresponding to the minimum signal value corresponding to the PWM duty cycle signal interval output by the three miniature electric actuators, the grasping of the object to be grasped by five fingers is completed; 步骤S33:五个手指完成对被抓物体的抓取后,食指(1)、无名指(3)和大拇指(6)上的PVDF压电传感器(9)均不产生电压信号,再在机械臂的作用下把被抓物体抓起来的过程中:Step S33: After the five fingers complete the grasping of the object to be grasped, the PVDF piezoelectric sensors (9) on the index finger (1), the ring finger (3) and the thumb (6) do not generate a voltage signal, and then the mechanical arm does not generate a voltage signal. During the process of grabbing the object being grasped under the action of: 若检测到食指(1)、无名指(3)和大拇指(6)上的PVDF压电传感器均没有电压信号产生,则五个手指完成对被抓物体的稳定抓取;If it is detected that the PVDF piezoelectric sensors on the index finger (1), the ring finger (3) and the thumb (6) have no voltage signal generated, the five fingers complete the stable grasp of the grasped object; 若检测到食指(1)、无名指(3)和大拇指(6)上的PVDF压电传感器(9)至少其中之一有电压信号产生,则五个手指与被抓物体之间发生滑动,然后进行步骤S34;If it is detected that at least one of the PVDF piezoelectric sensors (9) on the index finger (1), the ring finger (3) and the thumb (6) generates a voltage signal, the five fingers and the grasped object will slide, and then Go to step S34; 步骤S34:PVDF压电传感器(9)产生的电压信号经滤波采集模块放大和转换滤波后输出发送至STM32控制板,然后,STM32控制板再将所获得的电压信号发送给上位机,上位机逐步更新调大指令程序中被抓物体的硬度等级对应的PWM占空比信号区间对应的信号值,并发送给STM32控制板,STM32控制板根据逐步的每次更新调大后的指令程序控制三个微型电动推杆进行收缩,进而使得机械手的五个手指均弯曲;Step S34: The voltage signal generated by the PVDF piezoelectric sensor (9) is amplified, converted and filtered by the filter acquisition module and then output and sent to the STM32 control board, and then the STM32 control board sends the obtained voltage signal to the host computer, and the host computer gradually Update the signal value corresponding to the PWM duty cycle signal interval corresponding to the hardness level of the grasped object in the increase command program, and send it to the STM32 control board. The STM32 control board controls the three The miniature electric push rod shrinks, so that all five fingers of the manipulator are bent; 步骤S35:重复步骤S32-步骤S34,并且在步骤S34中,若调整后的PWM占空比信号值达到被抓物体的硬度等级对应的PWM占空比信号区间对应的最大信号值后,仍检测到步骤S33中在机械臂的作用下把被抓物体抓起来的过程中,PVDF压电传感器(9)有电压信号产生,防止把被抓物体抓坏,直接放弃抓取,并判断抓取失败。Step S35: Repeat step S32-step S34, and in step S34, if the adjusted PWM duty cycle signal value reaches the maximum signal value corresponding to the PWM duty cycle signal interval corresponding to the hardness level of the object being grasped, still detect In the process of picking up the object to be grasped under the action of the robotic arm in step S33, the PVDF piezoelectric sensor (9) generates a voltage signal to prevent the object being grasped from being damaged. .
2.根据权利要求1所述的基于仿人机械手装置的物体软硬识别和自适应抓取方法,其特征在于:2. the soft and hard object recognition and self-adaptive grasping method based on humanoid manipulator device according to claim 1, is characterized in that: 方法采用以下仿人机械手装置,仿人机械手装置包括支架(8)、仿人机械手、传感模块、控制系统和驱动模块;仿人机械手固定于支架(8)上,传感模块置于仿人机械手的手指上,驱动模块布置连接于仿人机械手的手掌背面,控制系统的输入端与传感模块电连接,控制系统的输出端与驱动模块电连接。The method adopts the following humanoid manipulator device, the humanoid manipulator device comprises a bracket (8), a humanoid manipulator, a sensing module, a control system and a drive module; the humanoid manipulator is fixed on the bracket (8), and the sensing module is placed on the humanoid manipulator On the fingers of the manipulator, the drive module is arranged and connected to the back of the palm of the humanoid manipulator, the input end of the control system is electrically connected to the sensing module, and the output end of the control system is electrically connected to the drive module. 3.根据权利要求2所述的基于仿人机械手装置的物体软硬识别和自适应抓取方法,其特征在于:所述的仿人机械手包括手掌(7)以及与手掌(7)连接的五个手指,五个手指包括食指(1)、中指(2)、无名指(3)、大拇指(6)和小拇指(4);传感模块包括液态金属柔性应变传感器(13)和PVDF压电传感器(9);控制系统包括STM32控制板和上位机;驱动模块包括第一微型电动推杆(16)、第二微型电动推杆(17)和第三微型电动推杆(18)的三个微型电动推杆以及扭簧(10)和驱动柔绳(12);3. The soft and hard object recognition and adaptive grasping method based on a humanoid manipulator device according to claim 2, characterized in that: the humanoid manipulator comprises a palm (7) and a five The five fingers include the index finger (1), the middle finger (2), the ring finger (3), the thumb (6) and the little finger (4); the sensing module includes a liquid metal flexible strain sensor (13) and a PVDF piezoelectric sensor (9); the control system includes an STM32 control board and a host computer; the drive module includes three miniature electric push rods (16), a second mini electric push rod (17) and a third mini electric push rod (18). electric push rod, torsion spring (10) and drive cord (12); 仿人机械手的食指(1)、无名指(3)和大拇指(6)的指尖均粘贴有PVDF压电传感器(9),仿人机械手的食指(1)的远指节转动关节(11)和中指节转动关节(15)上均贴敷有液态金属柔性应变传感器(13),食指(1)、中指(2)、无名指(3)和小拇指(4)各自的远指节转动关节处均布置有一个扭簧(10),食指(1)、中指(2)、无名指(3)和小拇指(4)各自的中指节关节处均布置有一个扭簧(10),大拇指(6)的远指节转动关节处布置有一个扭簧(10),仿人机械手的五个手指均无近指节转动关节,仿人机械手的五个手指的近指节均竖直固定于手掌(7),且不发生弯曲;三个微型电动推杆均竖直固定于手掌(7)背面,每个手指的远指节上均固定一个驱动柔绳(12)的一端,驱动柔绳(12)的另一端依次穿过各自手指的远指节、远指节转动关节、中指节、中指节转动关节及近指节后绑在手掌(7)背面的微型电动推杆上;The fingertips of the index finger (1), ring finger (3) and thumb (6) of the humanoid robot are all pasted with PVDF piezoelectric sensors (9), and the index finger (1) of the humanoid robot has a distal knuckle rotating joint (11) Liquid metal flexible strain sensors (13) are applied to the rotating joints (15) of the index finger (1), the middle finger (2), the ring finger (3) and the little finger (4) respectively at the rotating joints of the distal phalanx (4). A torsion spring (10) is arranged, and a torsion spring (10) is arranged at the respective middle knuckle joints of the index finger (1), the middle finger (2), the ring finger (3) and the little finger (4). A torsion spring (10) is arranged at the rotating joint of the distal knuckle, the five fingers of the humanoid manipulator have no rotating joints near the knuckle, and the proximal knuckles of the five fingers of the humanoid manipulator are all vertically fixed on the palm (7) , and does not bend; the three miniature electric push rods are vertically fixed on the back of the palm (7), and one end of a driving flexible rope (12) is fixed on the distal knuckle of each finger. The other end passes through the distal phalanx, the distal phalanx rotating joint, the middle phalanx, the middle phalanx rotating joint and the proximal phalanx of the respective fingers in turn, and is then tied to the miniature electric push rod on the back of the palm (7); PVDF压电传感器(9)经滤波采集模块放大和转换滤波后连接STM32控制板的一个模拟输入端,液态金属柔性应变传感器(13)经分电压路电连接STM32控制板的另一个输入端,STM32控制板的一个输出端电连接上位机,STM32控制板的另一个输出端电连接三个微型电动推杆。The PVDF piezoelectric sensor (9) is amplified, converted and filtered by the filter acquisition module and then connected to an analog input of the STM32 control board. The liquid metal flexible strain sensor (13) is electrically connected to the other input of the STM32 control board through a voltage divider circuit. The STM32 One output end of the control board is electrically connected to the upper computer, and the other output end of the STM32 control board is electrically connected to three miniature electric push rods. 4.根据权利要求2所述的基于仿人机械手装置的物体软硬识别和自适应抓取方法,其特征在于:所述的上位机及STM32控制板通过控制三个微型电动推杆收缩,进而拉紧各个手指的驱动柔绳(12)使驱动柔绳(12)被张紧,实现各个手指的各指节转动关节处的扭簧(10)的弯曲,进而带动各个手指的弯曲;上位机及STM32控制板通过控制三个微型电动推杆伸张,进而松弛各个手指的驱动柔绳(12)使驱动柔绳(12)被放松,各个手指在各指节转动关节处的扭簧(10)的作用下实现各手指的伸展。4. The soft and hard object recognition and self-adaptive grasping method based on humanoid manipulator device according to claim 2, is characterized in that: described host computer and STM32 control board shrink by controlling three miniature electric push rods, and then Tighten the driving ropes (12) of each finger so that the driving ropes (12) are tensioned, so as to realize the bending of the torsion springs (10) at the rotating joints of each knuckle of each finger, thereby driving the bending of each finger; the upper computer And the STM32 control board controls the extension of the three miniature electric push rods, and then relaxes the driving ropes (12) of each finger, so that the driving ropes (12) are loosened, and the torsion springs (10) of each finger at the rotating joint of each knuckle The extension of each finger is achieved under the action of . 5.根据权利要求2所述的基于仿人机械手装置的物体软硬识别和自适应抓取方法,其特征在于:所述的食指(1)上的驱动柔绳(12)绑在靠近大拇指的手掌(7)背面的第一微型电动推杆(16)上,中指(2)、无名指(3)和小拇指(4)上的驱动柔绳(12)均绑在手掌(7)背面中间的第二微型电动推杆(17)上,小拇指(6)上的驱动柔绳(12)绑在远离大拇指的手掌(7)背面的第三微型电动推杆(18)上。5. The soft and hard object recognition and adaptive grasping method based on a humanoid manipulator device according to claim 2, characterized in that: the drive cord (12) on the index finger (1) is tied close to the thumb On the first miniature electric putter (16) on the back of the palm (7), the driving cords (12) on the middle finger (2), the ring finger (3) and the little finger (4) are all tied to the middle of the back of the palm (7). On the second miniature electric push rod (17), the driving cord (12) on the little finger (6) is tied to the third miniature electric push rod (18) on the back of the palm (7) away from the thumb. 6.根据权利要求2所述的基于仿人机械手装置的物体软硬识别和自适应抓取方法,其特征在于:所述的PVDF压电传感器(9)监测动态力,当力有变化时,PVDF压电传感器(9)产生电压信号,当力没有变化时,PVDF压电传感器(9)不产生电压信号。6. the soft and hard object recognition and self-adaptive grasping method based on humanoid manipulator device according to claim 2, it is characterized in that: described PVDF piezoelectric sensor (9) monitors dynamic force, when force has change, The PVDF piezoelectric sensor (9) generates a voltage signal, and when the force does not change, the PVDF piezoelectric sensor (9) does not generate a voltage signal.
CN202110199135.5A 2021-02-22 2021-02-22 Soft and hard object recognition and adaptive grasping method based on humanoid manipulator Active CN112976025B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110199135.5A CN112976025B (en) 2021-02-22 2021-02-22 Soft and hard object recognition and adaptive grasping method based on humanoid manipulator

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110199135.5A CN112976025B (en) 2021-02-22 2021-02-22 Soft and hard object recognition and adaptive grasping method based on humanoid manipulator

Publications (2)

Publication Number Publication Date
CN112976025A CN112976025A (en) 2021-06-18
CN112976025B true CN112976025B (en) 2022-03-11

Family

ID=76350265

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110199135.5A Active CN112976025B (en) 2021-02-22 2021-02-22 Soft and hard object recognition and adaptive grasping method based on humanoid manipulator

Country Status (1)

Country Link
CN (1) CN112976025B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111230911B (en) * 2020-03-20 2021-05-04 燕山大学 A 4D printing flexible finger joint gripper and its trajectory tracking control method
CN113733149B (en) * 2021-09-02 2024-03-19 浙江大学 A soft-finger manipulator and detection method for sensing fruit hardness
CN114193486A (en) * 2021-11-18 2022-03-18 上海大学 Pneumatic perception end effector of fruit and vegetable picking robot
CN114619445B (en) * 2022-03-11 2024-05-03 北京理工大学 Grabbing system
CN115435819A (en) * 2022-09-23 2022-12-06 哈尔滨工业大学 A triboelectric multifunctional sensor, robot and testing method based on controlled buckling structure
CN116766212B (en) * 2023-08-17 2023-12-19 深圳市心流科技有限公司 Bionic hand control method, bionic hand control device, bionic hand control equipment and storage medium
CN118322224B (en) * 2024-05-13 2025-01-10 南京林业大学 Rigid-flexible coupling mechanical arm type plant phenotype information measurement platform and measurement method
CN118650630B (en) * 2024-08-01 2024-11-29 广东尚工机械制造有限公司 Self-adaptive control system and method for mechanical arm

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4990815A (en) * 1989-07-11 1991-02-05 Lindner Douglas K Robot gripper control system using PYDF piezoelectric sensors
CN106002995A (en) * 2016-05-28 2016-10-12 上海大学 Grabbing control system for five-finger anthropomorphic manipulator
CN107263470A (en) * 2017-05-26 2017-10-20 吉林大学 Soft grasping method for controlling robot based on multi-sensor information fusion
CN108789384A (en) * 2018-09-03 2018-11-13 深圳市波心幻海科技有限公司 A kind of flexible drive manipulator and the object identification method based on three-dimensional modeling
CN110039533A (en) * 2019-04-17 2019-07-23 苏州柔性智能科技有限公司 For detecting the multi-functional software manipulator of fruit maturity

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4990815A (en) * 1989-07-11 1991-02-05 Lindner Douglas K Robot gripper control system using PYDF piezoelectric sensors
CN106002995A (en) * 2016-05-28 2016-10-12 上海大学 Grabbing control system for five-finger anthropomorphic manipulator
CN107263470A (en) * 2017-05-26 2017-10-20 吉林大学 Soft grasping method for controlling robot based on multi-sensor information fusion
CN108789384A (en) * 2018-09-03 2018-11-13 深圳市波心幻海科技有限公司 A kind of flexible drive manipulator and the object identification method based on three-dimensional modeling
CN110039533A (en) * 2019-04-17 2019-07-23 苏州柔性智能科技有限公司 For detecting the multi-functional software manipulator of fruit maturity

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"仿人机械手设计与硬度感知研究";张颖等;《东北大学学报(自然科学版)》;20200331;第41卷(第3期);全文 *

Also Published As

Publication number Publication date
CN112976025A (en) 2021-06-18

Similar Documents

Publication Publication Date Title
CN112976025B (en) Soft and hard object recognition and adaptive grasping method based on humanoid manipulator
Carrozza et al. Experimental analysis of an innovative prosthetic hand with proprioceptive sensors
Ueda et al. Development of the NAIST-Hand with vision-based tactile fingertip sensor
Yang et al. A low-cost linkage-spring-tendon-integrated compliant anthropomorphic robotic hand: MCR-Hand III
CN208100400U (en) A kind of three joint finger mechanisms
CN108453766A (en) A kind of bionical dexterity of multi-joint is done evil through another person finger
CN107825393A (en) A kind of total joint measurement type data glove
CN108673538B (en) Mechanical finger and mechanical arm
Gerratt et al. Stretchable capacitive tactile skin on humanoid robot fingers—First experiments and results
Buescher et al. Augmenting curved robot surfaces with soft tactile skin
JP4737099B2 (en) Robot and robot control apparatus and control method
Deng et al. Design of a soft gripper with improved microfluidic tactile sensors for classification of deformable objects
CN107065618A (en) A kind of pneumatic software hand control system and its control method
Takamuku et al. Repetitive grasping with anthropomorphic skin-covered hand enables robust haptic recognition
CN109834719A (en) A method of measurement humanoid dexterous finger finger tip stress
WO2010074045A1 (en) Robot hand system with gripping section
CN113910279A (en) Perception-driving integrated rigid-flexible coupling finger and flexible robot dexterous hand
CN113146665A (en) Dexterous hand with tactile feedback and variable rigidity and control method thereof
Ang et al. 3D printed soft pneumatic actuators with intent sensing for hand rehabilitative exoskeletons
CN214643717U (en) A imitative people manipulator device that is used for object hardness to discern and self-adaptation snatchs
Canbay et al. Calibration of tactile/force sensors for grasping with the PRISMA Hand II
Tsutsui et al. Robot hand with soft tactile sensors and underactuated control
Nojiri et al. Sensing and control of friction mode for contact area variable surfaces (friction-variable surface structure)
CN116678307A (en) Curvature measurement system and method for a flexible mechanical gripper
Sebastiani et al. Experimental analysis and performance comparison of three different prosthetic hands designed according to a biomechatronic approach

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20210618

Assignee: Zhejiang cloud byte information technology Co.,Ltd.

Assignor: JIANG University OF TECHNOLOGY

Contract record no.: X2023980033010

Denomination of invention: Soft and hard object recognition and adaptive grasping method based on humanoid manipulator

Granted publication date: 20220311

License type: Common License

Record date: 20230228

EE01 Entry into force of recordation of patent licensing contract
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20210618

Assignee: ZHEJIANG GUANGLI ENGINEERING MACHINERY Co.,Ltd.

Assignor: JIANG University OF TECHNOLOGY

Contract record no.: X2023980037308

Denomination of invention: Object Soft and Hard Recognition and Adaptive Grasping Method Based on Humanoid Robot Device

Granted publication date: 20220311

License type: Common License

Record date: 20230630

EE01 Entry into force of recordation of patent licensing contract