CN117323074A - Wearable prosthetic glove control method and system - Google Patents

Wearable prosthetic glove control method and system Download PDF

Info

Publication number
CN117323074A
CN117323074A CN202311629652.7A CN202311629652A CN117323074A CN 117323074 A CN117323074 A CN 117323074A CN 202311629652 A CN202311629652 A CN 202311629652A CN 117323074 A CN117323074 A CN 117323074A
Authority
CN
China
Prior art keywords
finger
prosthetic
bending angle
user
glove
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202311629652.7A
Other languages
Chinese (zh)
Other versions
CN117323074B (en
Inventor
张世武
金虎
随梦理
欧阳一鸣
王二龙
柴祯熠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Science and Technology of China USTC
Original Assignee
University of Science and Technology of China USTC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Science and Technology of China USTC filed Critical University of Science and Technology of China USTC
Priority to CN202311629652.7A priority Critical patent/CN117323074B/en
Publication of CN117323074A publication Critical patent/CN117323074A/en
Application granted granted Critical
Publication of CN117323074B publication Critical patent/CN117323074B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014Hand-worn input/output arrangements, e.g. data gloves
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50Prostheses not implantable in the body
    • A61F2/54Artificial arms or hands or parts thereof
    • A61F2/58Elbows; Wrists ; Other joints; Hands
    • A61F2/583Hands; Wrist joints
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50Prostheses not implantable in the body
    • A61F2/68Operating or control means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/0006Exoskeletons, i.e. resembling a human figure
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1628Programme controls characterised by the control loop
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1628Programme controls characterised by the control loop
    • B25J9/163Programme controls characterised by the control loop learning, adaptive, model based, rule based expert control
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00Programme-controlled manipulators
    • B25J9/16Programme controls
    • B25J9/1656Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1661Programme controls characterised by programming, planning systems for manipulators characterised by task planning, object-oriented languages
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50Prostheses not implantable in the body
    • A61F2/68Operating or control means
    • A61F2/70Operating or control means electrical
    • A61F2002/704Operating or control means electrical computer-controlled, e.g. robotic control

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Robotics (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Transplantation (AREA)
  • Cardiology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Vascular Medicine (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Multimedia (AREA)
  • Social Psychology (AREA)
  • Psychiatry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Prostheses (AREA)

Abstract

The invention discloses a wearable prosthetic glove control method, which comprises the following steps: s1: establishing a mapping relation between the joint bending angle of the body toe/finger part of a user and the joint bending angle of the artificial finger at the missing finger; s2: collecting the actual joint bending angle of a user's body at the toe/finger part of the limb, and generating a prosthesis motion control instruction according to the mapping relation between the joint bending angle of the user's body at the toe/finger part of the limb and the joint bending angle of the prosthesis finger at the missing finger; s3: and controlling the prosthetic finger of the wearable prosthetic glove at the missing finger to complete corresponding actions according to the prosthetic motion control instruction. Correspondingly, the invention also discloses a wearable prosthetic glove control system which is used for implementing the wearable prosthetic glove control method. The wearable prosthetic glove control method can predict the action of the prosthetic finger and control the prosthetic finger, and has the advantages of high man-machine interaction level, low cost and better effect.

Description

Wearable prosthetic glove control method and system
Technical Field
The invention relates to the technical field of wearable artificial limbs, in particular to a method and a system for controlling a wearable artificial limb glove.
Background
In recent years, more disabled patients with missing fingers caused by trauma are getting more and more, and hospitals adopt a repairing mode of operations such as toe transplantation or finger reconstruction and the like to cause secondary injury to patients easily, and the patients suffer great pain after the operation, so that the toe functionality after the transplantation is poor. Thus, currently such patients typically employ wearable prosthetic devices to compensate for the missing finger function.
At present, a part of whole-hand amputees wear a whole-hand artificial limb to realize motion control of the artificial limb by utilizing an arm electromyographic signal or an electroencephalogram signal, but the artificial limb is difficult to move according to the intention of the patient due to complex electromyographic and electroencephalogram signal characteristic extraction and analysis.
In addition, some finger amputees often wear passive prostheses, i.e., bending of the wrist drives a pull-cord to bend the finger, however such passive prostheses do not provide precise control of each joint movement and are poorly functional.
In the prior art, few patients adopt and wear active partial prostheses to compensate for the missing finger function, and the main reasons are as follows: when designing active partial artificial limb, real-time control signal (myoelectricity or electroencephalogram signal) of patient is difficult to identify, and the artificial limb is controlled to move by adopting a preprogrammed mode, so that human-computer interaction is poor, human-computer co-fusion cannot be realized, sensing is difficult to integrate, control precision is low, and cost is high.
Disclosure of Invention
The technical problems to be solved by the invention are as follows: the method and the system for controlling the wearable prosthetic glove are provided to solve the problems that the existing active partial prosthetic glove is poor in man-machine interaction, difficult to extract real-time control signals and poor in use effect due to the fact that the man-machine interaction is carried out in a pre-programming mode.
In order to solve the technical problems, the technical scheme of the invention is as follows: a method of controlling a wearable prosthetic glove, comprising the steps of:
s1: establishing a mapping relation between the joint bending angle of the body toe/finger part of a user and the joint bending angle of the artificial finger at the missing finger;
s2: collecting the actual joint bending angle of a user's body at the toe/finger part of the limb, and generating a prosthesis motion control instruction according to the mapping relation between the joint bending angle of the user's body at the toe/finger part of the limb and the joint bending angle of the prosthesis finger at the missing finger;
s3: and controlling the prosthetic finger of the wearable prosthetic glove at the missing finger to complete corresponding actions according to the prosthetic motion control instruction.
Further, in the method for controlling a wearable prosthetic glove according to the present invention, in step S1, the method specifically includes the following steps:
enabling the healthy side hand of the user to complete a preset action gesture, collecting the bending angle data of each joint when the healthy side hand of the user completes the preset action gesture, and storing the bending angle data into a database;
and establishing a mapping relation between the joint bending angle of the finger of the affected hand of the user and the joint bending angle of the artificial finger at the missing finger according to the database.
Further, in the method for controlling a wearable prosthetic glove according to the present invention, in step S2, the method specifically includes the following steps:
and acquiring the actual joint bending angle of each healthy finger of the patient side hand of the user, so as to generate an artificial limb motion control instruction according to the mapping relation between the joint bending angle of the healthy finger of the patient side hand of the user and the joint bending angle of the artificial limb finger at the missing finger.
Further, in the wearable prosthetic glove control method according to the present invention, in step S1, the preset motion gesture includes a usual motion gesture of a user.
Further, in the wearable prosthetic glove control method of the present invention, in step S1, the mapping relationship between the joint bending angle of the finger of the affected hand of the user and the joint bending angle of the prosthetic finger at the missing finger is specifically:
and classifying the gestures by using a deep learning algorithm and establishing a mapping relation between the joint bending angle of the finger of the affected side hand of the user and the joint bending angle of the artificial finger at the missing finger.
Furthermore, in the wearable prosthetic glove control method of the invention, the deep learning algorithm is an RNN algorithm.
Further, in the method for controlling a wearable prosthetic glove according to the present invention, in step S1, the method specifically includes the following steps:
establishing a mapping relation between the toe bending angle of a user's key at the toe and the joint bending angle of the tail end knuckle of the prosthetic finger at the missing finger;
and acquiring an actual toe bending angle of the body building of the user on the toe so as to generate an artificial limb motion control instruction according to the mapping relation between the joint bending angle of the body building of the user on the toe and the joint bending angle of the tail end knuckle of the artificial limb finger at the missing finger.
Further, in the wearable prosthetic glove control method of the present invention, the mapping relationship between the toe bending angle of the toe of the user and the joint bending angle of the distal knuckle of the prosthetic finger at the missing finger is specifically:
according to the normalization algorithm, a mapping relation between the toe bending angle of the user's key at the toe and the joint bending angle of the end knuckle of the prosthetic finger at the missing finger is established.
Accordingly, another object of the present invention is to disclose a wearable prosthetic glove control system for implementing the above-mentioned wearable prosthetic glove control method of the present invention, comprising: data acquisition gloves, prosthetic gloves, curvature sensors, stay wires, drivers and controllers;
the prosthetic glove comprises a prosthetic finger arranged at the position of the missing finger of a user, and the data acquisition glove and the prosthetic glove both comprise a first angle sensor for acquiring the bending angle of the tail end knuckle of the finger and a second angle sensor for acquiring the bending angles of other knuckles of the finger; the controller is respectively connected with the first angle sensor, the second angle sensor, the bending sensor and the driver, the bending sensor is used for collecting toe bending angles of toes, one end of the stay wire is connected with a prosthetic finger, and the other end of the stay wire is connected with the driver.
Further, in the wearable prosthetic glove control system of the present invention, the prosthetic finger includes a first phalange and a second phalange connected to each other, a radially magnetized magnetic ring and a magnetic encoder are integrated at a joint between the first phalange and the second phalange, the magnetic ring rotates synchronously with the first phalange, the magnetic encoder rotates synchronously with the second phalange, and the magnetic ring rotates concentrically with the magnetic encoder.
The invention has the beneficial effects that: in order to solve the problem that the existing active partial artificial limb adopts a pre-programming mode to perform man-machine interaction and the extraction of real-time control signals is difficult, the inventor optimally designs a wearable artificial limb glove control method, by collecting the joint bending angle of a patient's body at the toe/finger part of a limb, so as to construct the mapping relation between the joint bending angle of the user's body at the toe/finger part of the limb and the joint bending angle of the artificial limb finger at the position of the missing finger, thereby effectively predicting the action of the artificial limb finger and performing real-time control on the artificial limb finger when the motion state of the healthy finger of the patient's affected side hand or the bending degree of the user's body at the toe is collected, greatly improving the man-machine interaction level, reducing the cost of the wearable artificial limb glove and realizing the effective control on the artificial limb finger of the wearable artificial limb glove, and having good popularization prospect and application value.
Accordingly, in the present invention, a wearable prosthetic glove control system is also designed, which is used to implement the above-mentioned wearable prosthetic glove control method of the present invention, which also has the above-mentioned advantages and beneficial effects.
Drawings
Fig. 1 is a schematic flow chart of steps of a wearable prosthetic glove control method according to an embodiment of the invention.
Fig. 2 schematically shows a schematic flow chart of the steps of the method for controlling a wearable prosthetic glove according to the invention in another embodiment.
Fig. 3 schematically shows a schematic flow chart of the steps of a method for wearing prosthetic gloves according to the invention in a further embodiment.
Fig. 4 schematically shows a schematic view of the structure of a prosthetic glove according to an embodiment of the wearable prosthetic glove system of the invention, worn on a patient's side hand.
Fig. 5 schematically shows a schematic view of the structure of a prosthetic glove of the wearable prosthetic glove system according to the invention in one embodiment worn on another affected hand.
Fig. 6 schematically shows a schematic diagram of a prosthetic glove of the wearable prosthetic glove system of the invention in an embodiment worn on a patient's side hand.
Fig. 7 schematically shows a schematic diagram of the structure of a wearable prosthetic glove system of the invention with a data acquisition glove in one embodiment worn on a healthy side hand.
Figure 8 schematically shows a schematic view of the configuration of a wearable prosthetic glove system of the invention with a toe-mounted flexion sensor in one embodiment.
Fig. 9 is a schematic view of the structure of a prosthetic finger of a wearable prosthetic glove system according to the invention in one embodiment.
Fig. 10 is a schematic exploded view of the structure at the distal joint of the prosthetic finger of fig. 9.
Fig. 11 is a schematic exploded view of the structure at the other joints of the prosthetic glove of fig. 9.
Description of the reference numerals:
1. the hands are protected;
2. a patient side hand;
3. a data acquisition glove;
4. prosthetic gloves;
5. a first angle sensor;
6. a second angle sensor;
7. a curvature sensor;
8. a pull wire;
9. a driver;
10. a controller;
11. a data acquisition and transmission unit;
12. a prosthetic finger; 121. distal phalangeal bones; 122. middle phalanx; 123. proximal phalanx; 124. metacarpal bones; 125. a cross axis; 126. a rotating shaft; 127. a magnetic ring; 128. a magnetic encoder.
Detailed Description
In order to describe the technical contents, the achieved objects and effects of the present invention in detail, the following description will be made with reference to the embodiments in conjunction with the accompanying drawings.
Research finds that in the current prior art, the existing passive partial finger prosthesis cannot realize independent control on the movement of each joint of the finger, and has poor functionality; the existing active partial artificial limb adopts pre-control, has poor man-machine interaction, low control precision and higher cost; in addition, although some active partial artificial limbs adopt real-time electromyographic signals or electroencephalogram signals to control the motion of the artificial limbs, the signal characteristics are complex to identify and extract, the equipment is large, the integration level is low, and the artificial limbs are inconvenient to wear.
Therefore, in order to solve the above-mentioned problems in the prior art, as shown in fig. 1, the present invention provides a wearable prosthetic glove control method, which includes the steps of:
s1: establishing a mapping relationship between the joint bending angle of the body toe/finger of the user and the joint bending angle of the prosthetic finger 12 at the missing finger;
s2: collecting the actual joint bending angle of a user's body in the limb toe/finger part, and generating a prosthesis motion control instruction according to the mapping relation between the joint bending angle of the user's body in the limb toe/finger part and the joint bending angle of the prosthesis finger 12 at the missing finger;
s3: and controlling the prosthetic finger 12 of the wearable prosthetic glove at the missing finger to complete corresponding actions according to the prosthetic motion control instruction.
As can be seen from the above description, in the present invention, the inventor optimally designs a wearable prosthetic glove control method to effectively predict the motion of the prosthetic finger 12 by constructing a mapping relationship between the joint bending angle of the toe/finger of the user and the joint bending angle of the prosthetic finger 12 at the missing finger, thereby utilizing the actually collected joint bending angle of the toe/finger of the user, and performing real-time control on the motion of the prosthetic finger 12, which can greatly improve the man-machine interaction level and improve the user experience.
It should be noted that, when the wearable prosthetic glove method is actually applied, the prosthetic finger 12 of the wearable prosthetic glove can be effectively controlled without collecting an electromyographic signal or an electroencephalogram signal to control the motion of the prosthetic, and the production cost of the wearable prosthetic glove can be effectively reduced. In addition, in practical application, the joint bending angle of the prosthetic finger 12 can be effectively predicted and controlled due to the fact that the mapping relation is constructed, so that man-machine interaction experience is improved, control accuracy of the prosthetic finger 12 is improved, and the method has good popularization prospect and application value.
Further, in the method for controlling a wearable prosthetic glove according to the present invention, in step S1, the method specifically includes the following steps:
enabling the healthy side hand 1 of the user to complete a preset action gesture, collecting the bending angle data of each joint of the healthy side hand 1 of the user when the preset action gesture is completed, and storing the bending angle data into a database;
according to the database, a mapping relation between the joint bending angle of the finger of the affected side hand 2 of the user and the joint bending angle of the artificial finger 12 at the missing finger is established.
Further, in the wearable prosthetic glove control method according to the present invention, in step S2, the method specifically includes the following steps:
the actual joint bending angle of each healthy finger of the patient side hand 2 of the user is acquired to generate a prosthesis motion control instruction according to the mapping relation between the joint bending angle of the healthy finger of the patient side hand 2 of the user and the joint bending angle of the prosthesis finger 12 at the missing finger.
As shown in fig. 2, in the above technical solution of the present invention, in practical application, a wearable prosthetic glove may be designed to include a data acquisition glove 3 and a prosthetic glove 4, where the data acquisition glove 3 is capable of acquiring the respective joint bending angle data of all the fingers of the user's healthy side hand 1 when completing the gesture of the preset motion, and storing the joint bending angle data together in a database to form a gesture library.
In the present invention, the inventor considers that the operations of the fingers are generally the same or similar when the left hand and the right hand of the user perform the same gesture, so that the mapping relationship between the joint bending angle of the finger of the other affected hand 2 and the joint bending angle of the prosthetic finger 12 at the missing finger can be equivalently replaced and correspondingly established according to the obtained database composed of the joint bending angle data of all the fingers when the healthy side hand 1 of the user completes the preset action gesture.
In this case, when the user wears the prosthetic glove 4 and makes a gesture on the affected side hand 2, the prosthetic glove 4 can correspondingly collect the actual joint bending angle of each finger of the affected side hand 2 of the user, so as to predict the motion of the prosthetic finger 12 according to the mapping relationship between the joint bending angle of the finger of the affected side hand 2 of the user and the joint bending angle of the prosthetic finger 12 at the missing finger, and generate a prosthetic motion control command, so as to control the motion of the prosthetic finger 12, as shown in fig. 2.
Further, in the wearable prosthetic glove control method according to the present invention, in step S1, the preset motion gesture includes a usual motion gesture of a user.
In the above technical solution of the present invention, a designer may set preset motion gestures in advance, and in order to facilitate a user to complete a usual motion in life by using the prosthetic finger 12 in the prosthetic glove 4 after wearing the prosthetic glove 4, the preset motion gestures may specifically include a usual motion gesture of the user.
Of course, in practical application, the present invention does not put special restrictions and special requirements on the preset motion gestures, and when the designer customizes the personalized prosthetic glove 4 for the user, the designer can set the required preset motion gestures according to the specific requirements of the user.
And, after the preset action gestures are designed, the preset action gestures may be sequenced in advance to form a preset action gesture sequence, so that when the healthy side hand 1 of the user completes each preset action gesture in turn according to the preset action gesture sequence, the action gestures can be classified and stored according to the collected bending angle data of each joint.
Further, in the wearable prosthetic glove control method of the present invention, in step S1, the mapping relationship between the joint bending angle of the finger of the affected hand 2 of the user and the joint bending angle of the prosthetic finger 12 at the missing finger is established, specifically:
the gesture is classified by a deep learning algorithm and a mapping relation between the joint bending angle of the finger of the affected side hand 2 of the user and the joint bending angle of the artificial finger 12 at the missing finger is established.
Furthermore, in the wearable prosthetic glove control method of the invention, the deep learning algorithm is an RNN algorithm.
Further, in the method for controlling a wearable prosthetic glove according to the present invention, in step S1, the method specifically includes the following steps:
establishing a mapping relationship between the toe bending angle of a user's key at the toe and the joint bending angle of the distal knuckle of the prosthetic finger 12 at the missing finger;
the actual toe bending angle of the user's healthy toe is collected to generate a prosthesis motion control command according to the mapping relationship between the joint bending angle of the user's healthy toe and the joint bending angle of the distal knuckle of the prosthetic finger 12 at the missing finger.
As shown in fig. 3, in the above-mentioned technical solution of the present invention, the inventor further improves the wearable prosthetic glove control method considering that in some specific embodiments, the user may need to implement the health of the affected hand 2 without moving the fingers, but only with the movement of the prosthetic finger 12.
At this time, when the wearable prosthetic glove control method is applied, the bending sensor 7 may be further placed on the healthy toe of the user, and the bending sensor 7 may be used to detect the toe bending angle, so as to establish a mapping relationship between the toe bending angle of the user's toe and the joint bending angle of the distal knuckle of the prosthetic finger 12 at the missing finger by using the toe bending angle of the user's toe, and accurately control the prosthetic finger 12 to work by using the mapping relationship and matching with the actually collected toe bending angle.
Further, in the wearable prosthetic glove control method of the present invention, the mapping relationship between the toe bending angle of the toe of the user and the joint bending angle of the distal knuckle of the prosthetic finger 12 at the missing finger is specifically:
according to the normalization algorithm, a mapping relationship of the toe bending angle of the user's key at the toe and the joint bending angle of the distal knuckle of the prosthetic finger 12 at the missing finger is established.
In the above technical solution of the present invention, a designer may pre-establish a mapping relationship between the toe bending angle of the toe of the user and the joint bending angle of the distal knuckle of the prosthetic finger 12 at the missing finger according to a normalization algorithm, so as to facilitate the subsequent motion control of the prosthetic finger 12. The normalization algorithm is an algorithm content well known to those skilled in the art, and will not be described in detail herein.
Correspondingly, the invention also discloses a wearable prosthetic glove control system, which is used for implementing the wearable prosthetic glove method, and specifically comprises the following steps: the data acquisition glove 3, the prosthetic glove 4, the bending sensor 7, the stay wire 8, the driver 9 and the controller 10;
wherein the prosthetic glove 4 comprises a prosthetic finger 12 arranged at the position of the missing finger of the user, and the data acquisition glove 3 and the prosthetic glove 4 comprise a first angle sensor 5 for acquiring the bending angle of the tail end knuckle of the finger and a second angle sensor 6 for acquiring the bending angles of other knuckles of the finger; the controller 10 is respectively connected with the first angle sensor 5, the second angle sensor 6, the bending sensor 7 and the driver 9, the bending sensor 7 is used for collecting toe bending angles of toes, one end of the pull wire 8 is connected with the prosthetic finger 12, and the other end of the pull wire 8 is connected with the driver 9.
As can be seen by referring to fig. 4 to 11, in the above technical solutions of the present invention, the wearable prosthetic glove control system may include both the data acquisition glove 3 and the prosthetic glove 4, and the data acquisition glove 3 and the prosthetic glove 4 each include the first angle sensor 5 and the second angle sensor 6, and both the first angle sensor 5 and the second angle sensor 6 may be used to detect the bending angle of the finger joint.
As shown in fig. 4, 5 and 6, in practical application, the data acquisition glove 3 and the prosthetic glove 4 are provided with three joint angle sensors corresponding to the healthy fingers of each finger, that is, two second angle sensors 6 and one first angle sensor 5, and the first angle sensor 5 may be a two-dimensional joint angle sensor, which may detect metacarpophalangeal joint bending and swinging.
It should be noted that in the present invention, a highly integrated prosthetic finger 12 is provided on the wearable prosthetic glove to replace the finger function of the user where the finger is missing. It should be emphasized here that the prosthetic finger 12 is not limited to a single finger, but may be a single finger or a combination of two adjacent finger bones. In addition, a plurality of prosthetic fingers 12 may be integrated into the wearable prosthetic glove.
Further, in the wearable prosthetic glove control system according to the present invention, the prosthetic finger 12 includes a first phalange and a second phalange connected to each other, a radially magnetized magnetic ring 127 and a magnetic encoder 128 are integrated at a joint between the first phalange and the second phalange, the magnetic ring 127 rotates synchronously with the first phalange, the magnetic encoder 128 rotates synchronously with the second phalange, and the magnetic ring 127 rotates concentrically with the magnetic encoder 128.
In the wearable prosthetic glove control system designed by the invention, in order to solve the problems of poor integration and inconvenient wearing of the existing active partial prosthetic limb, a radial magnetizing magnetic ring 127 and a magnetic encoder 128 can be integrated at the joint between a first phalange and a second phalange of the wearable prosthetic glove, the magnetic ring 127 can rotate along with the phalange and generate a regularly-changed magnetic field, and the magnetic encoding output voltage value is changed, so that the corresponding joint bending angle is judged according to the output voltage value.
Embodiment one:
as can be seen in fig. 1, 2 and 4-11, a first embodiment of the present invention is: a wearable prosthetic glove control system, the wearable prosthetic glove control system comprising: data acquisition glove 3, prosthetic glove 4, flexion sensor 7, pull wire 8, driver 9, and controller 10.
Wherein the prosthetic glove 4 comprises a prosthetic finger 12 arranged at the position of the missing finger of the user, and the data acquisition glove 3 and the prosthetic glove 4 comprise a first angle sensor 5 for acquiring the bending angle of the tail end knuckle of the finger and a second angle sensor 6 for acquiring the bending angles of other knuckles of the finger; wherein, the first angle sensor 5 is a two-dimensional joint angle sensor, one first angle sensor 5 is provided, and two second angle sensors 6 are provided.
In actual operation, as shown in fig. 9, 10 and 11, including the prosthetic finger 12 and the healthy finger, all the fingers include a distal phalanx 121, a middle phalanx 122, a proximal phalanx 123 and a metacarpal bone 124, which are sequentially connected, and a radially magnetized magnetic ring 127 and a magnetic encoder 128 are integrated between two bones adjacent to each other. As shown in fig. 10, the distal phalanx 121 is integrated with a magnetic ring 127, which can simultaneously and synchronously rotate; the front end of the middle phalanx 122 is integrated with a magnetic encoder 128, and the two can synchronously rotate; the rotating shaft 126 passes through the middle phalangeal 122 and the magnetic ring 127, ensuring that the magnetic ring 127 rotates concentrically with the magnetic encoder 128. The magnetic encoder 128 can detect the rotation of the magnetic ring 127 and output a corresponding voltage signal for the controller 10 to acquire the joint angle information. In the same way, the joint detection design method between the middle phalanx 122 and the proximal phalanx 123, and the joint detection design method between the proximal phalanx 123 and the metacarpal bone 124 can be realized. In this way, the first angle sensor 5 and the second angle sensor 6 can detect the bending angles of the joints of the fingers (including the healthy finger and the artificial finger 12).
In addition, in the wearable prosthetic glove control system designed by the invention, the controller 10 is also arranged on an arm, the controller 10 is respectively connected with the first angle sensor 5, the second angle sensor 6, the bending sensor 7 and the driver 9, the bending sensor 7 is used for collecting the toe bending angle of toes, one end of the control stay wire 8 is connected with the prosthetic finger 12, and the other end of the stay wire 8 is connected with the driver 9, so that the controller 10 controls the driver 9 to drive the stay wire 8, and the prosthetic finger 12 is pulled to act.
Accordingly, as can be seen further from fig. 9, in this embodiment, the distal phalanx 121 is provided with a stay fixing point a/a, and the stay 8 connected to the point a sequentially passes through the through holes in the middle phalanx 122, the proximal phalanx 123, the cross shaft 125, and the metacarpal 124, and is connected to the rear end driver 9, and the driver 9 may be a device capable of generating displacement, such as a motor, a shape memory alloy, or the like. The pull wire 8 connected with the point A can be connected with a spring fixedly arranged on the middle phalanx 122, and when the driver 9 pulls the point a to move, the joint between the middle phalanx 122 and the far phalanx 121 can rotate, and the spring is stretched to generate elastic force. When the driver 9 moves in the opposite direction, the joint between the middle phalanx 122 and the distal phalanx 121 is restored by the elastic force, which can effectively save one driving unit. Accordingly, the movement of the two joints of the rest stay fixing point B/B and the stay fixing point C/C is basically identical to the movement. Wherein the C/C-connected pull wire 8 drives the metacarpal 124 and proximal phalangeal 123 to swing.
In the first embodiment, as shown in fig. 2, the user's health side hand 1 may wear the data acquisition glove 3, and connect the data sensing glove with the computer terminal, so that the user controls the user's health side hand 1 to complete a preset action gesture, that is, a usual action gesture in life, and uses the data acquisition glove 3 to acquire the bending angle data of each joint of the user's health side hand 1 when completing the preset action gesture, and send the bending angle data to the computer terminal for storage in the database.
Accordingly, a deep learning method is utilized, including, but not limited to, RNN algorithm, classifying actions on gestures and establishing a mapping relationship between the joint bending angle of the finger of the affected hand 2 of the user and the joint bending angle of the prosthetic finger 12 at the missing finger, and writing the mapping relationship into the controller 10 of the prosthetic glove 4.
After the above steps are completed, the user can wear the customized prosthetic glove 4 and complete the usual actions in life, and the prosthetic glove 4 can effectively use the actual joint bending angle of each finger of the affected side hand 2 of the user, so as to generate a prosthetic motion control instruction according to the mapping relationship between the joint bending angle of the finger of the affected side hand 2 of the user and the joint bending angle of the prosthetic finger 12 at the missing finger by using the controller 10. The controller 10 sends a prosthesis motion control instruction to the driver 9, and the driver 9 drives the stay wire 8 to realize accurate closed-loop control on the prosthesis finger 12.
In addition, in some other cases, the user may need to achieve a healthy finger immobilization of the affected side hand 2, but only the movement of the prosthetic finger 12. For this reason, in the present embodiment, the above-mentioned bending sensor 7 is also placed on the healthy toe of the user to detect the toe bending angle of the healthy toe by using the bending sensor 7, and the above-mentioned toe bending angle data is transmitted to the controller 10 of the prosthetic glove 4 by using the data acquisition and transmission unit 11 provided at the ankle part (transmission manner is optionally wireless or wired).
After receiving the toe bending angle data of the toe, the controller 10 first needs to use a normalization algorithm to establish a mapping relationship between the toe bending angle of the toe and the joint bending angle of the distal knuckle of the prosthetic finger 12 at the missing finger, and encapsulates the mapping relationship into the controller 10.
When the user wears the prosthetic glove 4, the user's healthy toe bends, the bending sensor 7 can collect the actual toe bending angle of the user's healthy toe, and send the actual toe bending angle to the controller 10 through the data collecting and sending unit 11, and the controller 10 can correspondingly generate a prosthetic motion control instruction according to the actual toe bending angle and the mapping relationship between the joint bending angle of the user's healthy toe and the joint bending angle of the end knuckle of the prosthetic finger 12 at the missing finger, and send the prosthetic motion control instruction to the driver 9, and the driver 9 drives the stay wire 8 to realize accurate closed loop control on the finger. The aim of controlling the movement of the prosthetic finger 12 on the toes is achieved through the above steps.
In summary, in the invention, the wearable prosthetic glove control method and system designed by the inventor can effectively utilize the wearable prosthetic glove to make up the function of missing fingers of a user, reduce the manual planning cost of the prosthetic hand, have high man-machine co-melting level, are convenient to use, and can effectively solve the problems of difficult extraction of electromyographic signals or electroencephalogram signals and large equipment of the existing active partial prosthetic hand.
In addition, in the invention, the inventor also utilizes the pull wire 8 to simulate tendons, thereby realizing the high-degree bionic of the prosthetic glove 4 and compensating the function of missing fingers; in addition, in some preferred embodiments, the invention also provides a brand new design for the prosthetic finger 12, and the angle sensing mode of the magnetic ring 127 and the magnetic encoder 128 is utilized to realize the bending angle sensing integration of the prosthetic finger 12, so that the prosthetic finger 12 can realize accurate closed-loop motion control.
The foregoing description is only illustrative of the present invention and is not intended to limit the scope of the invention, and all equivalent changes made by the specification and drawings of the present invention, or direct or indirect application in the relevant art, are included in the scope of the present invention.

Claims (10)

1. A method of controlling a wearable prosthetic glove, comprising the steps of:
s1: establishing a mapping relation between the joint bending angle of the body toe/finger part of a user and the joint bending angle of the artificial finger at the missing finger;
s2: collecting the actual joint bending angle of a user's body at the toe/finger part of the limb, and generating a prosthesis motion control instruction according to the mapping relation between the joint bending angle of the user's body at the toe/finger part of the limb and the joint bending angle of the prosthesis finger at the missing finger;
s3: and controlling the prosthetic finger of the wearable prosthetic glove at the missing finger to complete corresponding actions according to the prosthetic motion control instruction.
2. The method for controlling a wearable prosthetic glove according to claim 1, characterized in that in step S1, it specifically comprises the steps of:
enabling the healthy side hand of the user to complete a preset action gesture, collecting the bending angle data of each joint when the healthy side hand of the user completes the preset action gesture, and storing the bending angle data into a database;
and establishing a mapping relation between the joint bending angle of the finger of the affected hand of the user and the joint bending angle of the artificial finger at the missing finger according to the database.
3. The method for controlling a wearable prosthetic glove according to claim 2, characterized in that in step S2, it specifically comprises the steps of:
and acquiring the actual joint bending angle of each healthy finger of the patient side hand of the user, so as to generate an artificial limb motion control instruction according to the mapping relation between the joint bending angle of the healthy finger of the patient side hand of the user and the joint bending angle of the artificial limb finger at the missing finger.
4. The method according to claim 2, characterized in that in step S1, the preset motion gesture comprises a usual motion gesture of a user.
5. The method according to claim 2, wherein in step S1, the mapping relationship between the joint bending angle of the finger of the affected hand of the user and the joint bending angle of the prosthetic finger at the missing finger is established, specifically:
and classifying the gestures by using a deep learning algorithm and establishing a mapping relation between the joint bending angle of the finger of the affected side hand of the user and the joint bending angle of the artificial finger at the missing finger.
6. The method of claim 5, wherein the deep learning algorithm is RNN algorithm.
7. The method for controlling a wearable prosthetic glove according to claim 1, characterized in that in step S1, it specifically comprises the steps of:
establishing a mapping relation between the toe bending angle of a user's key at the toe and the joint bending angle of the tail end knuckle of the prosthetic finger at the missing finger;
and acquiring an actual toe bending angle of the body building of the user on the toe so as to generate an artificial limb motion control instruction according to the mapping relation between the joint bending angle of the body building of the user on the toe and the joint bending angle of the tail end knuckle of the artificial limb finger at the missing finger.
8. The method for controlling a wearable prosthetic glove according to claim 7, wherein the mapping relationship between the toe bending angle of the toe of the user's finger and the joint bending angle of the distal knuckle of the prosthetic finger at the missing finger is specifically:
according to the normalization algorithm, a mapping relation between the toe bending angle of the user's key at the toe and the joint bending angle of the end knuckle of the prosthetic finger at the missing finger is established.
9. A wearable prosthetic glove control system for use in a wearable prosthetic glove control method according to any one of claims 1-8, comprising: data acquisition gloves, prosthetic gloves, curvature sensors, stay wires, drivers and controllers;
the prosthetic glove comprises a prosthetic finger arranged at the position of the missing finger of a user, and the data acquisition glove and the prosthetic glove both comprise a first angle sensor for acquiring the bending angle of the tail end knuckle of the finger and a second angle sensor for acquiring the bending angles of other knuckles of the finger; the controller is respectively connected with the first angle sensor, the second angle sensor, the bending sensor and the driver, the bending sensor is used for collecting toe bending angles of toes, one end of the stay wire is connected with a prosthetic finger, and the other end of the stay wire is connected with the driver.
10. The wearable prosthetic glove control system of claim 9, wherein the prosthetic finger comprises a first phalange and a second phalange connected to each other, a radially magnetized magnetic ring and a magnetic encoder are integrated at a joint between the first phalange and the second phalange, the magnetic ring rotates synchronously with the first phalange, the magnetic encoder rotates synchronously with the second phalange, and the magnetic ring rotates concentrically with the magnetic encoder.
CN202311629652.7A 2023-12-01 2023-12-01 Wearable prosthetic glove control method and system Active CN117323074B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311629652.7A CN117323074B (en) 2023-12-01 2023-12-01 Wearable prosthetic glove control method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311629652.7A CN117323074B (en) 2023-12-01 2023-12-01 Wearable prosthetic glove control method and system

Publications (2)

Publication Number Publication Date
CN117323074A true CN117323074A (en) 2024-01-02
CN117323074B CN117323074B (en) 2024-03-29

Family

ID=89279729

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311629652.7A Active CN117323074B (en) 2023-12-01 2023-12-01 Wearable prosthetic glove control method and system

Country Status (1)

Country Link
CN (1) CN117323074B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118238152A (en) * 2024-05-28 2024-06-25 华东交通大学 Design method and system of passive underactuated mechanical finger based on deep learning

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101321508A (en) * 2005-11-29 2008-12-10 泰茨艾玛斯有限公司 Prostheses with mechanically operable digit members
CN202235782U (en) * 2011-08-22 2012-05-30 阙玉涛 Assembly type bionic mechanical finger
US20120226197A1 (en) * 2011-02-07 2012-09-06 University Of Washington Through Its Center For Commercialization Limb volume accommodation in people with limb amputation
KR20160043632A (en) * 2014-10-13 2016-04-22 전북대학교산학협력단 Electronic artificial hand based on symmetric motion and control method thereof
US20170296363A1 (en) * 2016-04-15 2017-10-19 Board Of Regents, The University Of Texas System Systems, apparatuses and methods for controlling prosthetic devices by gestures and other modalities
JP2019181020A (en) * 2018-04-16 2019-10-24 祐介 齋藤 Robot hand, joint structure and artificial hand
CN110811940A (en) * 2019-10-31 2020-02-21 中国科学院长春光学精密机械与物理研究所 Intelligent artificial limb device and control method
US20200323657A1 (en) * 2019-04-15 2020-10-15 Board Of Regents, The University Of Texas System Systems And Methods For Robotic Mirror Therapy Of The Hand
TWI718762B (en) * 2019-11-15 2021-02-11 國立雲林科技大學 Smart wearable system and operation method thereof
CN115016645A (en) * 2022-06-15 2022-09-06 哈尔滨工业大学 Multi-degree-of-freedom acquired data glove for cooperative control of artificial fingers
CN116236328A (en) * 2023-02-22 2023-06-09 中国科学院沈阳自动化研究所 Visual-based intelligent artificial limb system capable of realizing natural grabbing

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101321508A (en) * 2005-11-29 2008-12-10 泰茨艾玛斯有限公司 Prostheses with mechanically operable digit members
US20120226197A1 (en) * 2011-02-07 2012-09-06 University Of Washington Through Its Center For Commercialization Limb volume accommodation in people with limb amputation
CN202235782U (en) * 2011-08-22 2012-05-30 阙玉涛 Assembly type bionic mechanical finger
KR20160043632A (en) * 2014-10-13 2016-04-22 전북대학교산학협력단 Electronic artificial hand based on symmetric motion and control method thereof
US20170296363A1 (en) * 2016-04-15 2017-10-19 Board Of Regents, The University Of Texas System Systems, apparatuses and methods for controlling prosthetic devices by gestures and other modalities
JP2019181020A (en) * 2018-04-16 2019-10-24 祐介 齋藤 Robot hand, joint structure and artificial hand
US20200323657A1 (en) * 2019-04-15 2020-10-15 Board Of Regents, The University Of Texas System Systems And Methods For Robotic Mirror Therapy Of The Hand
CN110811940A (en) * 2019-10-31 2020-02-21 中国科学院长春光学精密机械与物理研究所 Intelligent artificial limb device and control method
TWI718762B (en) * 2019-11-15 2021-02-11 國立雲林科技大學 Smart wearable system and operation method thereof
CN115016645A (en) * 2022-06-15 2022-09-06 哈尔滨工业大学 Multi-degree-of-freedom acquired data glove for cooperative control of artificial fingers
CN116236328A (en) * 2023-02-22 2023-06-09 中国科学院沈阳自动化研究所 Visual-based intelligent artificial limb system capable of realizing natural grabbing

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
TAKANORI HIGASHIHARA , YUKIO SAITO HIROSHIITOH , 袁一镭: "用微型计算机控制的六自由度电动假肢的研究", 机械设计与研究, no. 03 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118238152A (en) * 2024-05-28 2024-06-25 华东交通大学 Design method and system of passive underactuated mechanical finger based on deep learning

Also Published As

Publication number Publication date
CN117323074B (en) 2024-03-29

Similar Documents

Publication Publication Date Title
CN109953761B (en) Lower limb rehabilitation robot movement intention reasoning method
CN117323074B (en) Wearable prosthetic glove control method and system
US11478367B2 (en) Systems and methods for postural control of a multi-function prosthesis
EP2467101B1 (en) Control system for jointed mechanical devices
Liu et al. Development of a multi-DOF prosthetic hand with intrinsic actuation, intuitive control and sensory feedback
Losier et al. An overview of the UNB hand system
JP2016502904A (en) Prosthetic hand system
CN110039507A (en) A kind of remote control system and method based on ectoskeleton data glove and myoelectricity bracelet
Xu et al. A prosthetic arm based on EMG pattern recognition
EP4076291A1 (en) Electromyography and motion based control of upper limb prosthetics
Bandara et al. Upper extremity prosthetics: current status, challenges and future directions
Zhang et al. Design and control of a multisensory five-finger prosthetic hand
Johansen et al. A novel hand prosthesis control scheme implementing a tongue control system
Abd Razak et al. Development and performance of a new prosthesis system using ultrasonic sensor for wrist movements: a preliminary study
Domínguez-Ruiz et al. Low limb prostheses and complex human prosthetic interaction: A systematic literature review
KR20200114389A (en) Control system for hand motion of myoelectric hand and control method thereof
Nia et al. Reinforcement learning-based grasp pattern control of upper limb prosthetics in an AI platform
CN110811940B (en) Intelligent artificial limb device and control method
Cardona et al. Impact of diverse aspects in user-prosthesis interfaces for myoelectric upper-limb prostheses
CN115252240A (en) Semi-autonomous smart control system for upper arm prosthesis of human-in-loop
CN211271430U (en) Control system of intelligent bionic knee joint
CN103405293A (en) Intelligent joint assembly and intelligent artificial limb using same
CN212020797U (en) Control device of bionic hand
Hu et al. Noninvasive Human‐Computer Interface Methods and Applications for Robotic Control: Past, Current, and Future
Osman et al. 10 Prosthetic Hand using

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant