CN113084848B - Master-slave type dexterous hand following method and terminal equipment - Google Patents
Master-slave type dexterous hand following method and terminal equipment Download PDFInfo
- Publication number
- CN113084848B CN113084848B CN202110378018.5A CN202110378018A CN113084848B CN 113084848 B CN113084848 B CN 113084848B CN 202110378018 A CN202110378018 A CN 202110378018A CN 113084848 B CN113084848 B CN 113084848B
- Authority
- CN
- China
- Prior art keywords
- hand
- finger
- fingers
- dexterous
- current moment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000005452 bending Methods 0.000 claims abstract description 221
- 230000009471 action Effects 0.000 claims abstract description 47
- 238000013507 mapping Methods 0.000 claims description 31
- 238000004590 computer program Methods 0.000 claims description 21
- 210000001015 abdomen Anatomy 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 5
- 230000003993 interaction Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000008878 coupling Effects 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 4
- 238000005859 coupling reaction Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000000540 analysis of variance Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J15/00—Gripping heads and other end effectors
- B25J15/0009—Gripping heads and other end effectors comprising multi-articulated fingers, e.g. resembling a human hand
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J13/00—Controls for manipulators
- B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J3/00—Manipulators of master-slave type, i.e. both controlling unit and controlled unit perform corresponding spatial movements
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1612—Programme controls characterised by the hand, wrist, grip control
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1679—Programme controls characterised by the tasks executed
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Orthopedic Medicine & Surgery (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention is suitable for the technical field of man-machine interaction, and provides a master-slave type dexterous hand following method and terminal equipment, wherein the method comprises the following steps: determining the gesture information of the dexterous hand according to the information of the angle sensor arranged on the dexterous hand; comprehensively determining gesture information of the human hand according to information of a rotation angle sensor, a first bending sensor and a second bending sensor which are arranged on the human hand; and then according to the gesture information of each finger of the hand and the gesture information of each finger of the dexterous hand, the action direction and the action time of each finger of the dexterous hand at the current moment are respectively determined, and the following of the dexterous hand to the hand is realized. According to the invention, through fusing sensor data of various different types, the smart hand can accurately follow the gestures of the human hand, and the human hand can control the smart hand to effectively perform remote grabbing operation.
Description
Technical Field
The invention belongs to the technical field of human-computer interaction, and particularly relates to a master-slave type dexterous hand following method and terminal equipment.
Background
The master-slave type dexterous hand gesture following system can use the highly intelligent and powerful learning capacity of human hands in the task planning of the dexterous hand, and control the remote dexterous hand by using the hand position information and the motion information of a local operator, thereby being suitable for various complex and severe environments.
In the prior art, the following of the dexterous hand to the hand is usually realized based on bioelectricity signals such as electroencephalogram and myoelectricity, but because the complete decoding rate of the electric signals is relatively low, the information decoupling is not enough, so that the following accuracy of the dexterous hand to the hand gesture is not high enough, and the dexterous hand can not be controlled by the hand to carry out effective remote grabbing operation.
Disclosure of Invention
In view of this, the embodiment of the invention provides a master-slave type dexterous hand following method and terminal equipment, so as to solve the problem that the following of a dexterous hand to a human hand is usually realized based on bioelectricity signals such as electroencephalogram and myoelectricity, and the accuracy is not high enough in the prior art.
The first aspect of the embodiment of the invention provides a master-slave type dexterous hand following method, which comprises the following steps:
for each dexterous hand finger on a dexterous hand: acquiring a first bending angle characteristic of the fingers of the dexterous hand at the current moment detected by an angle sensor in real time; determining the gesture information of the fingers of the dexterous hand at the current moment according to the first bending angle characteristics of the fingers of the dexterous hand at the current moment; wherein, the angle sensor is arranged at the proximal knuckle of the finger of the dexterous hand;
for each human finger on the human hand: acquiring a second bending angle characteristic of the fingers of the hand at the current moment detected by the rotation angle sensor, a third bending angle characteristic of the fingers of the hand at the current moment detected by the first bending sensor and a fourth bending angle characteristic of the fingers of the hand at the current moment detected by the second bending sensor in real time; determining the gesture information of the fingers of the hand at the current moment according to the second bending angle characteristics of the fingers of the hand at the current moment, the third bending angle characteristics of the fingers of the hand at the current moment and the fourth bending angle characteristics of the fingers of the hand at the current moment; the first bending sensor is arranged on the back side of the fingers of the human hand, the second bending sensor is arranged on the abdomen side of the fingers of the human hand, and the rotation angle sensor is arranged at the joint of the finger palm of the fingers of the human hand;
respectively determining the action direction and the action time of each dexterous hand finger at the current moment according to the gesture information of each human finger at the current moment and the gesture information of each dexterous hand finger at the current moment;
and respectively driving the corresponding fingers of the dexterous hand to follow the fingers of the human hand according to the action direction and the action time of each finger of the dexterous hand at the current moment.
A second aspect of an embodiment of the present invention provides a master-slave type dexterous hand following device, including:
a first gesture information determination module for, for each dexterous hand finger on the dexterous hand: acquiring a first bending angle characteristic of the fingers of the dexterous hand at the current moment detected by an angle sensor in real time; determining the gesture information of the fingers of the dexterous hand at the current moment according to the first bending angle characteristics of the fingers of the dexterous hand at the current moment; wherein, the angle sensor is arranged at the proximal knuckle of the finger of the dexterous hand;
a second gesture information determination module for, for each human hand finger on the human hand: acquiring a second bending angle characteristic of the fingers of the hand at the current moment detected by the rotation angle sensor, a third bending angle characteristic of the fingers of the hand at the current moment detected by the first bending sensor and a fourth bending angle characteristic of the fingers of the hand at the current moment detected by the second bending sensor in real time; determining gesture information of the fingers of the human hand at the current moment according to the second bending angle characteristic of the fingers of the human hand at the current moment, the third bending angle characteristic of the fingers of the human hand at the current moment and the fourth bending angle characteristic of the fingers of the human hand at the current moment; the first bending sensor is arranged on the back side of the fingers of the human hand, the second bending sensor is arranged on the abdomen side of the fingers of the human hand, and the rotation angle sensor is arranged at the joint of the finger palm of the fingers of the human hand;
the following information determining module is used for respectively determining the action direction and the action time of each finger of the dexterous hand at the current moment according to the gesture information of each finger of the person at the current moment and the gesture information of each finger of the dexterous hand at the current moment;
and the following module is used for respectively driving the corresponding dexterous fingers to follow the fingers of the human hand according to the action direction and the action time of each dexterous finger at the current moment.
A third aspect of the embodiments of the present invention provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the steps of the master-slave type dexterous hand following method provided in the first aspect of the embodiments of the present invention.
A fourth aspect of the embodiments of the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the master-slave dexterous hand following method as provided in the first aspect of the embodiments of the present invention.
The embodiment of the invention provides a master-slave type dexterous hand following method, which comprises the following steps: determining the gesture information of the dexterous hand according to the information of the angle sensor arranged on the dexterous hand; comprehensively determining gesture information of the human hand according to information of a rotation angle sensor, a first bending sensor and a second bending sensor which are arranged on the human hand; and then according to the gesture information of each finger of the hand and the gesture information of each finger of the dexterous hand, respectively determining the action direction and the action time of each finger of the dexterous hand at the current moment, and realizing the following of the dexterous hand to the hand. According to the embodiment of the invention, the sensor data of various different types are fused, so that the dexterous hand can accurately follow the hand gesture of the person, and the dexterous hand can be controlled by the person to effectively perform remote grabbing operation.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
FIG. 1 is a schematic flow chart of the implementation of the master-slave dexterous hand following method according to the embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a dexterous hand provided by an embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a data glove provided by an embodiment of the invention;
FIG. 4 is a schematic structural diagram of another data glove provided by an embodiment of the present invention;
FIG. 5 is a schematic diagram of a master-slave dexterous hand following device provided by an embodiment of the present invention;
fig. 6 is a schematic diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
In order to explain the technical means of the present invention, the following description will be given by way of specific examples.
Referring to fig. 1, an embodiment of the present invention provides a master-slave type dexterous hand following method, including:
s101: for each dexterous hand finger on a dexterous hand: acquiring a first bending angle characteristic of the fingers of the dexterous hand at the current moment detected by an angle sensor in real time; determining the gesture information of the fingers of the dexterous hand at the current moment according to the first bending angle characteristics of the fingers of the dexterous hand at the current moment; wherein, the angle sensor is arranged at the proximal knuckle of the finger of the dexterous hand;
s102: for each human finger on the human hand: acquiring a second bending angle characteristic of the fingers of the hand at the current moment detected by the rotation angle sensor, a third bending angle characteristic of the fingers of the hand at the current moment detected by the first bending sensor and a fourth bending angle characteristic of the fingers of the hand at the current moment detected by the second bending sensor in real time; determining gesture information of the fingers of the human hand at the current moment according to the second bending angle characteristic of the fingers of the human hand at the current moment, the third bending angle characteristic of the fingers of the human hand at the current moment and the fourth bending angle characteristic of the fingers of the human hand at the current moment; the first bending sensor is arranged on the back side of the fingers of the human hand, the second bending sensor is arranged on the abdomen side of the fingers of the human hand, and the rotation angle sensor is arranged at the joint of the finger palm of the fingers of the human hand;
s103: respectively determining the action direction and the action time of each dexterous hand finger at the current moment according to the gesture information of each human finger at the current moment and the gesture information of each dexterous hand finger at the current moment;
s104: and respectively driving the corresponding fingers of the dexterous hand to follow the fingers of the human hand according to the action direction and the action time of each finger of the dexterous hand at the current moment.
The embodiment of the invention provides a master-slave type dexterous hand following method which is used for controlling a dexterous hand to follow the manual work of a person.
Referring to fig. 2, the dexterous hand is provided with five modularized human-simulated three-knuckle dexterous hand fingers with completely identical structures, and the mechanical dimensions and transmission relationship of the fingers of the dexterous hand are determined according to the physiological structure parameters of the fingers of the hand and the coupling motion mechanism; the unique angle sensor is arranged at the proximal knuckle of the finger of the dexterous hand and used for collecting the first bending angle characteristic of the finger of the dexterous hand during operation of the dexterous hand and obtaining the gesture information of the finger of the dexterous hand according to the first bending angle characteristic.
According to the physiological structure of the human hand, a first bending sensor is arranged on the back side of each finger of the human hand, a second bending sensor is arranged on the abdomen side of each finger of the human hand, and a rotation angle sensor is arranged at the finger palm joint and is used for acquiring a second bending angle characteristic, a third bending angle characteristic and a fourth bending angle characteristic when the human hand acts.
And determining the control quantity (action time and action direction) required by the dexterous hand according to the obtained gesture information of the fingers of the dexterous hand and the gesture information of the fingers of the hand, and driving the dexterous hand to execute the grabbing operation. The embodiment of the invention fuses sensor data of various different types, realizes accurate following of the gestures of the dexterous hand to the human hand, and can control the dexterous hand to carry out effective remote grabbing operation through the human hand.
The smart fingers adopt an under-actuated design, and the micro electric push rod is used as a unique driving source to drive the fingers to move according to the calculated control quantity, so that grabbing is realized.
In some embodiments, referring to fig. 3 and 4, the first bending sensor 23, the second bending sensor 24 and the rotation angle sensor 22 are disposed on the data glove 21, and the data glove 21 is worn on a human hand.
The data glove 21 is further provided with an exoskeleton joint 25 and a palm fixing seat 26. The rotation angle sensor 22 is fixedly installed on the palm fixing seat 26, one end of the exoskeleton joint 25 is fixedly connected with the data glove 21, the other end of the exoskeleton joint is fixedly connected with the rotation angle sensor 22, and the palm fixing seat 26 is fixed on the wrist of a human hand by a magic tape; the first bending sensor 23 and the second bending sensor 24 are disposed on the dorsal side and the ventral side of the data glove 21, respectively.
In some embodiments, the gesture information Θ of the ith individual finger at time tiThe calculation formula of (t) may be:
wherein,
for the second bend angle characteristic of the ith individual finger at time t,
for the third bend angle characteristic of the ith individual finger at time t,
a fourth bend angle characteristic of an ith individual finger at time t; k is a radical of1Is a first weight coefficient, k2Is the second weight coefficient, m1Is a third weight coefficient, m2Is a fourthWeight coefficient, f2Is a mapping relation between the second bending angle characteristic and the bending angle of the finger of the human hand, f3As a mapping relation between the third bending angle characteristic and the bending angle of the finger of the human hand, f4Is the mapping relation between the fourth bending angle characteristic and the bending angle of the finger of the human hand.
According to the embodiment of the invention, the data of each sensor is fused by adopting an average weighting method to obtain the gesture information of the human hand, the calculation result is accurate, and the method is simple and practical.
In some embodiments, prior to S102, the master-slave dexterous hand following method may further comprise:
s105: for at least one human finger on a human hand: acquiring a second bending angle characteristic, a third bending angle characteristic and a fourth bending angle characteristic which correspond to the fingers of the person at a plurality of preset positions respectively; acquiring images of the human fingers shot by a camera, which correspond to the human fingers at a plurality of preset positions respectively, and determining human finger bending angles corresponding to the human fingers at the plurality of preset positions respectively according to the images of the human fingers, which correspond to the human fingers at the plurality of preset positions respectively;
s106: determining a mapping relation between the second bending angle characteristic and the human hand finger bending angle according to a second bending angle characteristic corresponding to at least one human hand finger on the human hand at a plurality of preset positions respectively and a human hand finger bending angle corresponding to at least one human hand finger on the human hand at a plurality of preset positions respectively;
s107: determining a mapping relation between the third bending angle characteristic and the bending angle of the fingers of the human hand according to the third bending angle characteristic corresponding to the fingers of the human hand at a plurality of preset positions and the bending angle of the fingers of the human hand at a plurality of preset positions;
s108: and determining a mapping relation between the fourth bending angle characteristic and the bending angles of the fingers of the human hand according to the fourth bending angle characteristic corresponding to the fingers of the human hand at a plurality of preset positions and the bending angles of the fingers of the human hand at a plurality of preset positions.
In the embodiment of the invention, the human hand wears the data glove to operate, so that the data glove is kept to be attached to the human hand, and the stability of the operation process is kept. And calibrating the gesture information of the fingers of the human hand and the output values of the sensors on the data glove by using the high-speed camera. The high-speed camera is over against the side face of the data glove, fingers of the hand are slowly bent to preset positions, and the bending angles of the fingers of the hand are obtained after image processing. And simultaneously acquiring data of the three sensors on the data glove at preset positions, and respectively calculating to obtain the mapping relation between the data of each sensor and the bending angle of the fingers of the hand. In order to improve the calibration accuracy, a plurality of fingers on the hand of a person can be operated, and a plurality of preset positions can be selected.
In some embodiments, the calibration process of the sensor on the data glove may be repeated multiple times, and the first weighting factor k may be determined using a multi-factor ANOVA method1Second weight coefficient k2The third weight coefficient m1Fourth weighting factor m2。
In some embodiments, the gesture information Θ of the ith dexterous hand finger at the time ti' (t) can be calculated as:
wherein,
is the first bending angle characteristic of the ith dexterous finger at the moment t, f1Is the mapping relation between the first bending angle characteristic and the bending angle of the finger of the dexterous hand.
In some embodiments, prior to S101, the master-slave dexterous hand following method may further comprise:
s109: for at least one dexterous hand finger on the dexterous hand: acquiring corresponding first bending angle characteristics of fingers of the dexterous hand at a plurality of preset positions respectively; acquiring images of the fingers of the dexterous hand shot by a camera corresponding to the fingers at a plurality of preset positions respectively, and determining corresponding bending angles of the fingers of the dexterous hand when the fingers of the dexterous hand are at the plurality of preset positions respectively according to the corresponding images of the fingers of the dexterous hand at the plurality of preset positions respectively;
s1010: determining the mapping relation between the first bending angle characteristic and the bending angle of the fingers of the dexterous hand according to the first bending angle characteristic corresponding to the fingers of the dexterous hand at a plurality of preset positions and the bending angle of the fingers of the dexterous hand corresponding to the fingers of the dexterous hand at a plurality of preset positions.
And controlling the dexterous hand to carry out empty grabbing operation, and calibrating the bending angle of the fingers of the dexterous hand and the output value (first bending angle characteristic) of the angle sensor by using the high-speed camera. The high-speed camera is right opposite to the side surface of the simulated human fingers of the dexterous hand, and the simulated human fingers of the dexterous hand are bent to a preset position under the driving of the miniature electric push rod; processing the image shot by the high-speed camera to obtain a flexible finger bending angle; and meanwhile, acquiring a first bending angle characteristic detected by the angle sensor, and calculating to obtain a mapping relation between the first bending angle characteristic and the bending angle of the finger of the dexterous hand.
In some embodiments, S103 may include:
s1031: for each dexterous hand finger on a dexterous hand: and determining the difference between the gesture information of the finger of the dexterous hand at the current moment and the gesture information of the finger of the person followed by the finger of the dexterous hand at the current moment, and determining the action direction and the action time of the finger of the dexterous hand at the current moment according to the difference.
In some embodiments, the formula for calculating the motion direction and the motion time of the ith dexterous hand finger at time t may be:
Δti(t)＝Ti 2(t)-Ti 1(t)
Ti 1(t)＝f5′Θi′(t)
Ti 2(t)＝f5′Θi(t)
wherein, thetai' (t) is the ith dexterous hand finger at time tGesture information of (1), thetai(t) gesture information of an ith individual finger at time t; f. of5' is a mapping relation between the bending angle of the fingers of the dexterous hand and the driving time; t isi 1(T) is the total driving time of the ith dexterous hand finger at the time T, Ti 2(t) the expected total driving time of the ith dexterous hand finger at the time t; Δ ti(t) is the motion time of the ith dexterous hand finger at the time t; Δ ti(t)>The action direction of the dexterous hand is continuous bending at 0 hour, delta ti(t)<The direction of the dexterous hand motion is reverse extension at 0.
Δti(t)>When 0, the gesture of the dexterous hand lags behind the gesture of the hand of the user, and the dexterous hand needs to be controlled to continuously bend; Δ ti(t) ═ 0 means that the dexterous hand gesture is consistent with the hand gesture, and the dexterous hand does not need to move; Δ ti(t)<And 0 represents that the hand gesture of the dexterous hand is prior to the hand gesture of the human hand, and the dexterous hand needs to be controlled to extend reversely. Δ ti(t) Positive and negative represent the direction of motion, Δ tiThe absolute value of (t) represents the action time value.
The motion direction and the motion time of each finger of the dexterous hand are obtained, five micro electric push rods are used for controlling the five fingers of the dexterous hand respectively, and the bending angles of the five fingers of the dexterous hand are controlled by adjusting the motion direction and the motion time of the micro electric push rods, so that the dexterous hand can accurately follow the hand of the person.
In some embodiments, before S1031, S103 may further include:
s1032: for at least one dexterous hand finger on a dexterous hand: acquiring corresponding driving time when the fingers of the dexterous hand move to a plurality of preset positions respectively; acquiring images of the fingers of the dexterous hand shot by a camera corresponding to the fingers at a plurality of preset positions respectively, and determining corresponding bending angles of the fingers of the dexterous hand when the fingers of the dexterous hand are at the plurality of preset positions respectively according to the corresponding images of the fingers of the dexterous hand at the plurality of preset positions respectively;
s1033: determining the mapping relation between the driving time and the finger bending angles of the dexterous hand according to the driving time corresponding to the situation that at least one finger of the dexterous hand on the dexterous hand moves to a plurality of preset positions respectively and the finger bending angles corresponding to the situation that at least one finger of the dexterous hand on the dexterous hand moves to the preset positions respectively.
The miniature electric push rod of the dexterous hand adopts constant voltage drive, and the bending angle of the fingers of the dexterous hand and the driving time of the miniature electric push rod are calibrated by utilizing a high-speed camera. The high-speed camera is right opposite to the side face of the finger of the dexterous hand, the finger of the dexterous hand is bent to a preset position under the driving of the micro electric push rod, the image obtained by shooting the high-speed camera is processed to obtain the bending angle of the finger of the dexterous hand, and then the mapping relation between the bending angle of the finger of the dexterous hand and the driving time is obtained through calculation.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Referring to fig. 5, an embodiment of the present invention further provides a master-slave type dexterous hand following device, including:
a first gesture information determination module 31 for, for each dexterous hand finger on the dexterous hand: acquiring a first bending angle characteristic of the finger of the dexterous hand at the current moment detected by an angle sensor in real time; determining the gesture information of the fingers of the dexterous hand at the current moment according to the first bending angle characteristics of the fingers of the dexterous hand at the current moment; wherein, the angle sensor is arranged at the proximal knuckle of the finger of the dexterous hand;
a second gesture information determination module 32 for, for each finger of the human hand: acquiring a second bending angle characteristic of the fingers of the hand at the current moment detected by the rotation angle sensor, a third bending angle characteristic of the fingers of the hand at the current moment detected by the first bending sensor and a fourth bending angle characteristic of the fingers of the hand at the current moment detected by the second bending sensor in real time; determining gesture information of the fingers of the human hand at the current moment according to the second bending angle characteristic of the fingers of the human hand at the current moment, the third bending angle characteristic of the fingers of the human hand at the current moment and the fourth bending angle characteristic of the fingers of the human hand at the current moment; the first bending sensor is arranged on the back side of the fingers of the human hand, the second bending sensor is arranged on the abdomen side of the fingers of the human hand, and the rotation angle sensor is arranged at the joint of the finger palm of the fingers of the human hand;
the following information determining module 33 is used for respectively determining the action direction and the action time of each finger of the dexterous hand at the current moment according to the gesture information of each finger of the person at the current moment and the gesture information of each finger of the dexterous hand at the current moment;
and the following module 34 is used for respectively driving the corresponding fingers of the dexterous hand to follow the fingers of the human hand according to the action direction and the action time of each finger of the dexterous hand at the current moment.
In some embodiments, the gesture information Θ of the ith individual finger at time tiThe calculation formula of (t) may be:
wherein,
for the second bend angle characteristic of the ith individual finger at time t,
for the third bend angle characteristic of the ith individual finger at time t,
a fourth bend angle characteristic of an ith individual finger at time t; k is a radical of1Is a first weight coefficient, k2Is the second weight coefficient, m1Is a third weight coefficient, m2Is a fourth weight coefficient, f2As a mapping between the second bending angle characteristic and the bending angle of the finger of the human hand, f3As a mapping between the third bend angle characteristic and the bend angle of the human finger, f4Is the mapping relation between the fourth bending angle characteristic and the bending angle of the human finger.
In some embodiments, the master-slave dexterous hand-following device may further comprise:
a first parameter acquisition module 35 for, for at least one human hand finger on a human hand: acquiring a second bending angle characteristic, a third bending angle characteristic and a fourth bending angle characteristic which correspond to the fingers of the person at a plurality of preset positions respectively; acquiring images of the human fingers shot by a camera, which correspond to the human fingers at a plurality of preset positions respectively, and determining human finger bending angles corresponding to the human fingers at the plurality of preset positions respectively according to the images of the human fingers, which correspond to the human fingers at the plurality of preset positions respectively;
the first calibration module 36 is configured to determine a mapping relationship between the second bending angle characteristic and the bending angles of the fingers of the human hand according to the second bending angle characteristic corresponding to the fingers of the human hand at a plurality of preset positions and the bending angles of the fingers of the human hand at a plurality of preset positions;
the second calibration module 37 is configured to determine a mapping relationship between the third bending angle characteristic and the bending angles of the fingers of the human hand according to the third bending angle characteristic corresponding to the fingers of the human hand at a plurality of preset positions and the bending angles of the fingers of the human hand at a plurality of preset positions;
the third calibration module 38 is configured to determine a mapping relationship between the fourth bending angle characteristic and the bending angle of the finger of the human hand according to the fourth bending angle characteristic corresponding to the finger of the human hand at the multiple preset positions and the bending angle of the finger of the human hand corresponding to the finger of the human hand at the multiple preset positions.
In some embodiments, the gesture information Θ of the ith dexterous hand finger at the time ti' (t) can be calculated as:
wherein,
is the first bending angle characteristic of the ith dexterous finger at time t, f1Is the mapping relation between the first bending angle characteristic and the bending angle of the finger of the dexterous hand.
In some embodiments, the master-slave dexterous hand following device may further comprise:
a second parameter acquisition module 39 for, for at least one dexterous hand finger on the dexterous hand: acquiring first bending angle characteristics corresponding to the fingers of the dexterous hand at a plurality of preset positions respectively; acquiring images which are shot by a camera and correspond to the fingers of the skillful hand at a plurality of preset positions respectively, and determining corresponding bending angles of the fingers of the skillful hand when the fingers of the skillful hand are at the plurality of preset positions respectively according to the images which correspond to the fingers of the skillful hand at the plurality of preset positions respectively;
the fourth calibration module 310 is configured to determine a mapping relationship between the first bending angle characteristic and the bending angle of the finger of the dexterous hand according to the first bending angle characteristic corresponding to the finger of the dexterous hand at a plurality of preset positions and the bending angle of the finger of the dexterous hand corresponding to the finger of the dexterous hand at a plurality of preset positions.
In some embodiments, the following information determining module 33 may include:
a finger following information determination unit 331 for, for each dexterous hand finger on the dexterous hand: and determining the difference between the gesture information of the finger of the dexterous hand at the current moment and the gesture information of the finger of the person followed by the finger of the dexterous hand at the current moment, and determining the action direction and the action time of the finger of the dexterous hand at the current moment according to the difference.
In some embodiments, the formula for calculating the motion direction and the motion time of the ith dexterous hand finger at time t may be:
Δti(t)＝Ti 2(t)-Ti 1(t)
Ti 1(t)＝f5′Θi′(t)
Ti 2(t)＝f5′Θi(t)
wherein, thetai' t is the gesture information of the ith dexterous hand finger at the time t, thetai(t) gesture information of the ith individual finger at time t; f. of5' is a mapping relation between the bending angle of the fingers of the dexterous hand and the driving time; t isi 1(T) is the total driving time of the ith dexterous hand finger at the time T, Ti 2(t) the expected total driving time of the ith dexterous hand finger at the time t; Δ ti(t) is the action time of the finger of the ith dexterous hand at the moment t; Δ ti(t)>The motion direction of the dexterous hand at 0 is continuous bending, delta ti(t)<The direction of the dexterous hand motion is reverse extension at 0.
It is obvious to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional units and modules is merely used as an example, and in practical applications, the above function distribution may be performed by different functional units and modules as needed, that is, the internal structure of the terminal device is divided into different functional units or modules to perform all or part of the above described functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the above-mentioned apparatus may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
Fig. 6 is a schematic block diagram of a terminal device according to an embodiment of the present invention. As shown in fig. 6, the terminal device 4 of this embodiment includes: one or more processors 40, a memory 41, and a computer program 42 stored in the memory 41 and executable on the processors 40. The processor 40, when executing the computer program 42, implements the steps in the various master-slave dexterous hand following method embodiments described above, such as steps S101 to S104 shown in fig. 1. Alternatively, the processor 40, when executing the computer program 42, implements the functionality of the modules/units of the master-slave dexterous hand-following device embodiment described above, such as the modules 31 to 34 shown in fig. 5.
Illustratively, the computer program 42 may be divided into one or more modules/units, which are stored in the memory 41 and executed by the processor 40 to accomplish the present application. One or more of the modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used to describe the execution of the computer program 42 in the terminal device 4. For example, the computer program 42 may be divided into a first gesture information determination module 31, a second gesture information determination module 32, a following information determination module 33, and a following module 34.
A first gesture information determination module 31 for, for each dexterous hand finger on the dexterous hand: acquiring a first bending angle characteristic of the fingers of the dexterous hand at the current moment detected by an angle sensor in real time; determining the gesture information of the fingers of the dexterous hand at the current moment according to the first bending angle characteristics of the fingers of the dexterous hand at the current moment; wherein, the angle sensor is arranged at the proximal knuckle of the finger of the dexterous hand;
a second gesture information determination module 32 for, for each finger of the human hand: acquiring a second bending angle characteristic of the fingers of the hand at the current moment detected by the rotation angle sensor, a third bending angle characteristic of the fingers of the hand at the current moment detected by the first bending sensor and a fourth bending angle characteristic of the fingers of the hand at the current moment detected by the second bending sensor in real time; determining gesture information of the fingers of the human hand at the current moment according to the second bending angle characteristic of the fingers of the human hand at the current moment, the third bending angle characteristic of the fingers of the human hand at the current moment and the fourth bending angle characteristic of the fingers of the human hand at the current moment; the first bending sensor is arranged on the back side of the fingers of the human hand, the second bending sensor is arranged on the abdomen side of the fingers of the human hand, and the rotation angle sensor is arranged at the joint of the finger palm of the fingers of the human hand;
the following information determining module 33 is used for respectively determining the action direction and the action time of each finger of the dexterous hand at the current moment according to the gesture information of each finger of the person at the current moment and the gesture information of each finger of the dexterous hand at the current moment;
and the following module 34 is used for respectively driving the corresponding fingers of the dexterous hand to follow the fingers of the human hand according to the action direction and the action time of each finger of the dexterous hand at the current moment. Other modules or units are not described in detail herein.
The Processor 40 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The storage 41 may be an internal storage unit of the terminal device, such as a hard disk or a memory of the terminal device. The memory 41 may also be an external storage device of the terminal device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like provided on the terminal device. Further, the memory 41 may also include both an internal storage unit of the terminal device and an external storage device. The memory 41 is used for storing the computer program 42 and other programs and data required by the terminal device. The memory 41 may also be used to temporarily store data that has been output or is to be output.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiments provided in the present application, it should be understood that the disclosed terminal device and method may be implemented in other ways. For example, the above-described terminal device embodiments are merely illustrative, and for example, a module or a unit may be divided into only one logical function, and may be implemented in other ways, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow in the method of the embodiments described above can be realized by a computer program, which can be stored in a computer readable storage medium and can realize the steps of the embodiments of the methods described above when the computer program is executed by a processor. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like.
The above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.
Claims (9)
1. A master-slave type dexterous hand following method is characterized by comprising the following steps:
for each dexterous hand finger on a dexterous hand: acquiring a first bending angle characteristic of the fingers of the dexterous hand at the current moment detected by an angle sensor in real time; determining the gesture information of the fingers of the dexterous hand at the current moment according to the first bending angle characteristic of the fingers of the dexterous hand at the current moment; wherein, the angle sensor is arranged at the proximal knuckle of the finger of the dexterous hand;
for each human finger on the human hand: acquiring a second bending angle characteristic of the fingers of the hand at the current moment detected by the rotation angle sensor, a third bending angle characteristic of the fingers of the hand at the current moment detected by the first bending sensor and a fourth bending angle characteristic of the fingers of the hand at the current moment detected by the second bending sensor in real time; determining gesture information of the fingers of the human hand at the current moment according to the second bending angle characteristic of the fingers of the human hand at the current moment, the third bending angle characteristic of the fingers of the human hand at the current moment and the fourth bending angle characteristic of the fingers of the human hand at the current moment; the first bending sensor is arranged on the back side of the finger of the human hand, the second bending sensor is arranged on the abdomen side of the finger of the human hand, and the rotation angle sensor is arranged at the palm joint of the finger of the human hand;
respectively determining the action direction and the action time of each dexterous hand finger at the current moment according to the gesture information of each human finger at the current moment and the gesture information of each dexterous hand finger at the current moment;
respectively driving the corresponding fingers of the dexterous hand to follow the fingers of the human hand according to the action direction and the action time of each finger of the dexterous hand at the current moment;
according to the gesture information of each finger of the person at the current moment and the gesture information of each finger of the dexterous hand at the current moment, the action direction and the action time of each finger of the dexterous hand at the current moment are respectively determined, and the method comprises the following steps:
for each dexterous hand finger on a dexterous hand: determining the difference value between the gesture information of the finger of the dexterous hand at the current moment and the gesture information of the finger of the person following the finger of the dexterous hand at the current moment, and determining the action direction and the action time of the finger of the dexterous hand at the current moment according to the difference value.
2. The master-slave dexterous hand following method of claim 1, wherein t is tGesture information theta of ith individual finger at momentiThe formula for (t) is:
wherein,
for the second bend angle characteristic of the ith individual finger at time t,
for the third bend angle characteristic of the ith individual finger at time t,
a fourth bend angle characteristic of an ith individual finger at time t; k is a radical of1Is a first weight coefficient, k2Is the second weight coefficient, m1Is a third weight coefficient, m2Is a fourth weight coefficient, f2As a mapping between the second bending angle characteristic and the bending angle of the finger of the human hand, f3As a mapping relation between the third bending angle characteristic and the bending angle of the finger of the human hand, f4Is the mapping relation between the fourth bending angle characteristic and the bending angle of the finger of the human hand.
3. A master-slave dexterous hand following method according to claim 2, characterized in that for each hand finger on the hand: acquiring a second bending angle characteristic of the fingers of the hand at the current moment detected by the rotation angle sensor, a third bending angle characteristic of the fingers of the hand at the current moment detected by the first bending sensor and a fourth bending angle characteristic of the fingers of the hand at the current moment detected by the second bending sensor in real time; before determining the gesture information of the fingers of the person at the current moment according to the second bending angle characteristic of the fingers of the person at the current moment, the third bending angle characteristic of the fingers of the person at the current moment and the fourth bending angle characteristic of the fingers of the person at the current moment, the master-slave type dexterous hand following method further comprises the following steps:
for at least one human finger on a human hand: acquiring a second bending angle characteristic, a third bending angle characteristic and a fourth bending angle characteristic which correspond to the fingers of the person at a plurality of preset positions respectively; acquiring images which are shot by a camera and correspond to the fingers of the hand at the plurality of preset positions respectively, and determining the bending angles of the fingers of the hand corresponding to the fingers of the hand at the plurality of preset positions respectively according to the images which correspond to the fingers of the hand at the plurality of preset positions respectively;
determining a mapping relation between the second bending angle characteristic and the human finger bending angle according to a second bending angle characteristic corresponding to the human finger on the human hand at the plurality of preset positions and a human finger bending angle corresponding to the human finger on the human hand at the plurality of preset positions;
determining a mapping relation between the third bending angle characteristic and the human finger bending angle according to a third bending angle characteristic corresponding to the human finger at the plurality of preset positions and a human finger bending angle corresponding to the human finger at the plurality of preset positions;
and determining a mapping relation between the fourth bending angle characteristic and the bending angles of the fingers of the human hand according to the fourth bending angle characteristic corresponding to the fingers of the human hand at the preset positions and the bending angles of the fingers of the human hand at the preset positions.
4. The master-slave dexterous hand following method of claim 1, wherein the gesture information Θ of the ith dexterous hand finger at time ti' (t) is calculated as:
wherein,
is the first bending angle characteristic of the ith dexterous finger at the moment t, f1Is the mapping relation between the first bending angle characteristic and the bending angle of the finger of the dexterous hand.
5. A master-slave dexterous hand following method as claimed in claim 4, wherein for each dexterous hand finger on the dexterous hand: acquiring a first bending angle characteristic of the fingers of the dexterous hand at the current moment detected by an angle sensor in real time; before determining the gesture information of the fingers of the dexterous hand at the current moment according to the first bending angle characteristic of the fingers of the dexterous hand at the current moment, the master-slave type dexterous hand following method further comprises the following steps:
for at least one dexterous hand finger on the dexterous hand: acquiring first bending angle characteristics corresponding to the fingers of the dexterous hand at a plurality of preset positions respectively; acquiring images of the fingers of the dexterous hand shot by the camera corresponding to the preset positions respectively, and determining corresponding bending angles of the fingers of the dexterous hand when the fingers of the dexterous hand are at the preset positions respectively according to the corresponding images of the fingers of the dexterous hand when the fingers of the dexterous hand are at the preset positions respectively;
determining the mapping relation between the first bending angle characteristic and the bending angles of the fingers of the dexterous hand according to the first bending angle characteristic corresponding to the fingers of the dexterous hand in the preset positions and the bending angles of the fingers of the dexterous hand corresponding to the fingers of the dexterous hand in the preset positions.
6. The master-slave dexterous hand following method according to claim 1, wherein the calculation formula of the motion direction and the motion time of the ith dexterous hand finger at the time t is as follows:
Δti(t)＝Ti 2(t)-Ti 1(t)
Ti 1(t)＝f5′Θi′(t)
Ti 2(t)＝f5′Θi(t)
wherein, thetai' t is the gesture information of the ith dexterous hand finger at the time t, thetai(t) gesture information of an ith individual finger at time t; f. of5' is a mapping relation between the bending angle of the fingers of the dexterous hand and the driving time; t isi 1(T) is the total driving time of the ith dexterous hand finger at the time T, Ti 2(t) the expected total driving time of the ith dexterous hand finger at the time t; Δ ti(t) is the motion time of the ith dexterous hand finger at the time t; Δ ti(t)>The motion direction of the dexterous hand at 0 is continuous bending, delta ti(t)<The direction of the dexterous hand motion is reverse extension at 0.
7. A master-slave dexterous hand following device, comprising:
a first gesture information determination module for, for each dexterous hand finger on the dexterous hand: acquiring a first bending angle characteristic of the fingers of the dexterous hand at the current moment detected by an angle sensor in real time; determining the gesture information of the fingers of the dexterous hand at the current moment according to the first bending angle characteristic of the fingers of the dexterous hand at the current moment; wherein, the angle sensor is arranged at the proximal knuckle of the finger of the dexterous hand;
a second gesture information determination module for, for each human hand finger on the human hand: acquiring a second bending angle characteristic of the fingers of the hand at the current moment detected by the rotation angle sensor, a third bending angle characteristic of the fingers of the hand at the current moment detected by the first bending sensor and a fourth bending angle characteristic of the fingers of the hand at the current moment detected by the second bending sensor in real time; determining gesture information of the fingers of the human hand at the current moment according to the second bending angle characteristic of the fingers of the human hand at the current moment, the third bending angle characteristic of the fingers of the human hand at the current moment and the fourth bending angle characteristic of the fingers of the human hand at the current moment; the first bending sensor is arranged on the back side of the finger of the human hand, the second bending sensor is arranged on the abdomen side of the finger of the human hand, and the rotation angle sensor is arranged at the palm joint of the finger of the human hand;
the following information determining module is used for respectively determining the action direction and the action time of each finger of the dexterous hand at the current moment according to the gesture information of each finger of the person at the current moment and the gesture information of each finger of the dexterous hand at the current moment;
the following module is used for respectively driving the corresponding fingers of the dexterous hand to follow the fingers of the human hand according to the action direction and the action time of each finger of the dexterous hand at the current moment;
the following information determination module includes:
a finger following information determination unit for, for each dexterous hand finger on the dexterous hand: determining the difference value between the gesture information of the finger of the dexterous hand at the current moment and the gesture information of the finger of the person following the finger of the dexterous hand at the current moment, and determining the action direction and the action time of the finger of the dexterous hand at the current moment according to the difference value.
8. A terminal device comprising a memory, a processor and a computer program stored in said memory and executable on said processor, characterized in that said processor when executing said computer program realizes the steps of the master-slave dexterous hand following method of any of claims 1 to 6.
9. A computer-readable storage medium, having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of a master-slave dexterous hand following method according to any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110378018.5A CN113084848B (en) | 2021-04-08 | 2021-04-08 | Master-slave type dexterous hand following method and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110378018.5A CN113084848B (en) | 2021-04-08 | 2021-04-08 | Master-slave type dexterous hand following method and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113084848A CN113084848A (en) | 2021-07-09 |
| CN113084848B true CN113084848B (en) | 2022-06-14 |
Family
ID=76675461
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110378018.5A Active CN113084848B (en) | 2021-04-08 | 2021-04-08 | Master-slave type dexterous hand following method and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113084848B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106896796A (en) * | 2017-02-13 | 2017-06-27 | 上海交通大学 | Industrial robot master-slave mode teaching programmed method based on data glove |
| CN111645093A (en) * | 2020-05-22 | 2020-09-11 | 北京工业大学 | Force sense feedback data glove for teleoperation |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101941844B1 (en) * | 2012-01-10 | 2019-04-11 | 삼성전자주식회사 | Robot and Control method thereof |
| CN105150188A (en) * | 2015-10-10 | 2015-12-16 | 花茂盛 | System and method for controlling actions of robot |
| CN105328700A (en) * | 2015-11-12 | 2016-02-17 | 东北大学 | Data glove for teaching programming of robot dexterous hand |
| CN109871116B (en) * | 2017-12-05 | 2024-06-21 | 博世汽车部件(苏州)有限公司 | Apparatus and method for recognizing gesture |
| US20210393343A1 (en) * | 2018-10-30 | 2021-12-23 | Cyberdyne Inc. | Interactive information transfer system, interactive information transfer method, and information transfer system |
| CN109773816A (en) * | 2019-04-01 | 2019-05-21 | 吉林大学 | A kind of driving five-needle pines blister rust structure and control system entirely |
| US11358284B2 (en) * | 2019-04-25 | 2022-06-14 | Jack Adiletta | Signing robotic hand assembly apparatuses, systems, and methods |
| CN111185906B (en) * | 2020-01-10 | 2023-04-18 | 上海大学 | Leap Motion-based dexterous hand master-slave control method |
| CN111240489A (en) * | 2020-02-27 | 2020-06-05 | 广州大学华软软件学院 | Gesture recognition method and system based on gesture recognition glove and gesture recognition glove |
-
2021
- 2021-04-08 CN CN202110378018.5A patent/CN113084848B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106896796A (en) * | 2017-02-13 | 2017-06-27 | 上海交通大学 | Industrial robot master-slave mode teaching programmed method based on data glove |
| CN111645093A (en) * | 2020-05-22 | 2020-09-11 | 北京工业大学 | Force sense feedback data glove for teleoperation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113084848A (en) | 2021-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3487457B1 (en) | Adaptive system for deriving control signals from measurements of neuromuscular activity | |
| JP6144743B2 (en) | Wearable device | |
| CN113829357B (en) | Remote operation method, device, system and medium for robot arm | |
| CN112775931B (en) | Mechanical arm control method and device, computer-readable storage medium and robot | |
| Leigh et al. | Morphology extension kit: A modular robotic platform for physically reconfigurable wearables | |
| Roy et al. | Flex sensor based wearable gloves for robotic gripper control | |
| Adnan et al. | The development of a low cost data glove by using flexible bend sensor for resistive interfaces | |
| CN110837301A (en) | Data glove for gesture recognition and gesture recognition method | |
| CN113084848B (en) | Master-slave type dexterous hand following method and terminal equipment | |
| Baldi et al. | Using inertial and magnetic sensors for hand tracking and rendering in wearable haptics | |
| Gardner et al. | An unobtrusive vision system to reduce the cognitive burden of hand prosthesis control | |
| Müezzinoğlu et al. | Wearable glove based approach for human-UAV interaction | |
| CN113561172B (en) | Dexterous hand control method and device based on binocular vision acquisition | |
| CN113496168A (en) | Sign language data acquisition method, sign language data acquisition equipment and storage medium | |
| Milea et al. | Detection and tele-replication of human hand motions by a robotic hand | |
| CN113211440B (en) | Continuous robot shape sensing method based on multi-attitude calculation | |
| Fegade et al. | Wireless gesture controlled semi-humanoid robot | |
| KR102677990B1 (en) | Hand-wearable device for immersive interaction | |
| Hendrich et al. | Multi-sensor based segmentation of human manipulation tasks | |
| Denz et al. | A high-accuracy, low-budget Sensor Glove for Trajectory Model Learning | |
| Thompson | Redesigning the human-robot interface: intuitive teleoperation of anthropomorphic robots | |
| JP7446581B2 (en) | Robot hand equipped with a vibration sensor and robot system equipped with the same | |
| CN118123847B (en) | Man-machine cooperation system, operation control method and device | |
| Bankapur et al. | Bibliometric analysis on hand gesture controlled robot | |
| CN110216676B (en) | Mechanical arm control method, mechanical arm control device and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhang Yingkun Inventor after: Wang Na Inventor after: Cheng Yu Inventor after: Hao Cunming Inventor after: Ren Yaheng Inventor after: Wu Lilong Inventor after: Yao Libin Inventor after: Zhao Hang Inventor before: Zhang Yingkun Inventor before: Cheng Yu Inventor before: Hao Cunming Inventor before: Ren Yaheng Inventor before: Wu Lilong Inventor before: Yao Libin Inventor before: Zhao Hang |
|
| CB03 | Change of inventor or designer information |