WO2020122792A1 - Control of an active orthotic device - Google Patents
Control of an active orthotic device Download PDFInfo
- Publication number
- WO2020122792A1 WO2020122792A1 PCT/SE2019/051248 SE2019051248W WO2020122792A1 WO 2020122792 A1 WO2020122792 A1 WO 2020122792A1 SE 2019051248 W SE2019051248 W SE 2019051248W WO 2020122792 A1 WO2020122792 A1 WO 2020122792A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- limb
- intended
- force
- movement
- actuators
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
- A61F2/50—Prostheses not implantable in the body
- A61F2/68—Operating or control means
- A61F2/70—Operating or control means electrical
- A61F2/72—Bioelectric control, e.g. myoelectric
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H1/00—Apparatus for passive exercising; Vibrating apparatus; Chiropractic devices, e.g. body impacting devices, external devices for briefly extending or aligning unbroken bones
- A61H1/02—Stretching or bending or torsioning apparatus for exercising
- A61H1/0274—Stretching or bending or torsioning apparatus for exercising for the upper limbs
- A61H1/0285—Hand
- A61H1/0288—Fingers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/22—Ergometry; Measuring muscular strength or the force of a muscular blow
- A61B5/224—Measuring muscular strength
- A61B5/225—Measuring muscular strength of the fingers, e.g. by monitoring hand-grip force
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/389—Electromyography [EMG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4836—Diagnosis combined with treatment in closed-loop systems or methods
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4851—Prosthesis assessment or monitoring
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/6804—Garments; Clothes
- A61B5/6806—Gloves
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
- A61F2/50—Prostheses not implantable in the body
- A61F2/68—Operating or control means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F5/00—Orthopaedic methods or devices for non-surgical treatment of bones or joints; Nursing devices ; Anti-rape devices
- A61F5/01—Orthopaedic devices, e.g. long-term immobilising or pressure directing devices for treating broken or deformed bones such as splints, casts or braces
- A61F5/0102—Orthopaedic devices, e.g. long-term immobilising or pressure directing devices for treating broken or deformed bones such as splints, casts or braces specially adapted for correcting deformities of the limbs or for supporting them; Ortheses, e.g. with articulations
- A61F5/0104—Orthopaedic devices, e.g. long-term immobilising or pressure directing devices for treating broken or deformed bones such as splints, casts or braces specially adapted for correcting deformities of the limbs or for supporting them; Ortheses, e.g. with articulations without articulation
- A61F5/0118—Orthopaedic devices, e.g. long-term immobilising or pressure directing devices for treating broken or deformed bones such as splints, casts or braces specially adapted for correcting deformities of the limbs or for supporting them; Ortheses, e.g. with articulations without articulation for the arms, hands or fingers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F5/00—Orthopaedic methods or devices for non-surgical treatment of bones or joints; Nursing devices ; Anti-rape devices
- A61F5/01—Orthopaedic devices, e.g. long-term immobilising or pressure directing devices for treating broken or deformed bones such as splints, casts or braces
- A61F5/0102—Orthopaedic devices, e.g. long-term immobilising or pressure directing devices for treating broken or deformed bones such as splints, casts or braces specially adapted for correcting deformities of the limbs or for supporting them; Ortheses, e.g. with articulations
- A61F5/013—Orthopaedic devices, e.g. long-term immobilising or pressure directing devices for treating broken or deformed bones such as splints, casts or braces specially adapted for correcting deformities of the limbs or for supporting them; Ortheses, e.g. with articulations for the arms, hands or fingers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H1/00—Apparatus for passive exercising; Vibrating apparatus; Chiropractic devices, e.g. body impacting devices, external devices for briefly extending or aligning unbroken bones
- A61H1/02—Stretching or bending or torsioning apparatus for exercising
- A61H1/0274—Stretching or bending or torsioning apparatus for exercising for the upper limbs
- A61H1/0285—Hand
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Program-controlled manipulators
- B25J9/0006—Exoskeletons, i.e. resembling a human figure
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/12—Driving means
- A61H2201/1207—Driving means with electric or magnetic drive
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/16—Physical interface with patient
- A61H2201/1602—Physical interface with patient kind of interface, e.g. head rest, knee support or lumbar support
- A61H2201/1635—Hand or arm, e.g. handle
- A61H2201/1638—Holding means therefor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/16—Physical interface with patient
- A61H2201/1602—Physical interface with patient kind of interface, e.g. head rest, knee support or lumbar support
- A61H2201/165—Wearable interfaces
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5007—Control means thereof computer controlled
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
- A61H2201/5061—Force sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
- A61H2201/5064—Position sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
- A61H2201/5084—Acceleration sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2205/00—Devices for specific parts of the body
- A61H2205/06—Arms
- A61H2205/065—Hands
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2205/00—Devices for specific parts of the body
- A61H2205/06—Arms
- A61H2205/065—Hands
- A61H2205/067—Fingers
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2230/00—Measuring physical parameters of the user
- A61H2230/08—Other bio-electrical signals
- A61H2230/085—Other bio-electrical signals used as a control parameter for the apparatus
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2230/00—Measuring physical parameters of the user
- A61H2230/60—Muscle strain, i.e. measured on the user, e.g. Electromyography [EMG]
- A61H2230/605—Muscle strain, i.e. measured on the user, e.g. Electromyography [EMG] used as a control parameter for the apparatus
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Program-controlled manipulators
- B25J9/16—Program controls
- B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/37—Measurements
- G05B2219/37357—Force, pressure, weight or deflection
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/40—Robotics, robotics mapping to robotics vision
- G05B2219/40305—Exoskeleton, human robot interaction, extenders
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/40—Robotics, robotics mapping to robotics vision
- G05B2219/40413—Robot has multisensors surrounding operator, to understand intention of operator
Definitions
- the present invention relates to the field of orthotic devices, and in particular to a technique for controlling an active orthotic device.
- An orthotic device is an externally applied device that is designed and fitted to the body of an individual to modify structural and functional characteristics of the neuromuscular and skeletal system.
- One class of orthotic devices are electromechanical devices that are powered and controlled by a microprocessor or the like for the purpose of augmenting or assisting motor activities of the individual. This type of orthotic device is also known as an active orthosis or exoskeleton.
- Active orthotic devices may be used for restoring or at least improving the motor activity of an individual that has fully or partly lost the ability to move one or more limbs or coordinate the movement of two or more limbs, e.g. as a result of an injury, a neuromuscular disease or disorder, functional weakness, or a congenital disorder.
- upper-limb (or upper extremity) orthotic devices which are applied externally to the arm and/or hand, or segments thereof, and lower-limb orthotic devices for movement assistance in locomotion-related tasks.
- An active orthotic device comprises a number of actuators which are operable to impart a movement to one or more limbs.
- the actuators may include servomotors, e.g. as exemplified in US2015/0148728, a gas actuated piston, e.g. as exemplified in US5800561, a combination of artificial tendons and electric motors, e.g. as exemplified in US2010/0041521, or a shape memory material for selective heating, e.g. as exemplified in US9387112 and WO2018/138537.
- the active orthotic device may be controlled based on bioelectric signals from one or more bioelectric sensors that are arranged to detect the electrical activity of relevant muscles.
- bioelectric sensors include so-called electromyography (EMG) sensors, which may be implanted (intramuscular electromyography, iEMG) or applied to the skin of the individual (surface electromyography, sEMG).
- EMG electromyography
- An EMG sensor detects the electric potential generated by muscle cells when these cells are electrically or neurologically activated.
- a control device for an active orthotic device may be configured to infer the intended movement of a limb based on the wearer's activation of relevant muscle cells.
- W02018/050191 proposes to infer the intention of a wearer of an active exoskeleton based on force sensors (FSRs) rather than bioelectric sensors.
- the FSRs are mounted around an upper limb to measure radially directed muscle pressure.
- Force signals from the FSRs are processed by a machine learning algorithm to detect the human intention with respect to both motion and force of an arm or leg.
- a controller for the exoskeleton receives a reference torque from the machine learning algorithm and generates a reference velocity as input to a feedback loop for velocity control.
- a control signal for the exoskeleton is generated based on an error signal which is computed as a difference between a reference velocity and a measured feedback value.
- a further objective is to provide a technique of controlling an active orthotic device with improved correspondence to the intention of the wearer.
- a first aspect of the invention is a method of controlling an active orthotic device attached to one or more limbs of a human subject.
- the active orthotic device comprises a respective set of actuators for moving a respective limb among the one or more limbs.
- the method comprises: obtaining one or more bioelectric signals from one or more bioelectric sensors attached to or implanted in the human subject; processing the one or more bioelectric signals for prediction of an intended application force of the respective limb onto an object; obtaining a force signal from a force sensing device associated with the respective set of actuators and/or the respective limb; and generating, as a function of a momentary difference between the intended application force and the force signal, a respective set of control signals for the respective set of actuators.
- the first aspect enables an active orthotic device to be controlled to actuate one or more limbs based on bioelectric signals that are detected on or in the wearer.
- the first aspect is based on the insight that an improved correspondence between the intention of the wearer and the resulting movement of the limb(s) by the orthotic device in relation to an object may be achieved by determining the intended application force of the wearer and by controlling the orthotic device accordingly.
- the ability of the orthotic device to effect a well-controlled interaction between the limb(s) and the object is achieved by controlling the set of actuators for the respective limb based on the momentary difference between an intended application force and a force signal that represents measured (actual) application force for the respective limb.
- the force signal is provided by a force sensing device, which may be included in the orthotic device.
- the intended force is determined based on the bioelectric signal(s), which allows the orthotic device to be intuitively and automatically controlled in accordance with the intention of the wearer.
- the force sensing device may be of any type and may measure the actual application force directly or indirectly.
- the actual application force may be the total force applied by a limb onto an object or the force provided to the limb by the orthotic device.
- the actual application force at least represents the force provided to the limb by the orthotic device, via the set of actuators, and may optionally also include the muscular force applied by the wearer to the limb.
- the force sensing device is a force or strain sensor which is arranged on the limb to measure contact force between the limb and the object.
- the force sensing device is a force or strain sensor arranged in the actuator to measure a force that corresponds to or represents the application force.
- the force sensing device may be a calculation module, which is implemented in software and/or hardware to compute the application force based on a measured orientation/position of one or more moveable elements in the actuator, e.g. a drive axis, a gear, a spring, etc.
- each limb that is controlled by the orthotic device is considered to be associated with a respective set of actuators for imparting a movement to the limb, even if it is conceivable that one actuator is arranged to impart a movement to two limbs (or more limbs).
- each such actuator is considered to be included in two sets of actuators, one for each of the two limbs.
- different sets of actuators may overlap with respect to the included actuator(s).
- the respective set of actuators may be of any type and may include a servomotor, a DC motor, a pneumatic actuator, a rotary motor, a linear motor, shape memory alloy, conductive polymers, electroactive polymers, electrostatic devices, and combinations thereof. Different types of actuators may be used for different movements and/or for different limbs.
- the set of actuators convert potential energy (e.g., electrical, compressed gas, fluid pressure, etc.) as supplied by a power source into mechanical energy.
- the mechanical energy may be transferred to the limb in any way, e.g. by artificial tendons, gears, hinges, etc.
- the method further comprises: determining an intended limb movement for the respective limb, wherein the respective set of control signals is further generated as a function of the intended limb movement.
- the method further comprises: identifying one or more selected actuators among the respective set of actuators based on the intended limb movement for the respective limb, and generating the respective set of control signals for the one or more selected actuators.
- the respective set of control signals is generated to cause the respective limb to perform the intended limb movement and apply the intended application force.
- the intended limb movement is determined among at least two predefined limb movements, and each of the predefined limb movements corresponds to a predefined movement trajectory of the respective limb.
- one of the predefined limb movements corresponds to a predefined movement trajectory in which the respective limb is in a relaxed and/or stationary state.
- the intended limb movement is determined collectively for two or more limbs of the human subject.
- said determining the intended limb movement comprises: processing the one or more bioelectric signals by a pattern recognition algorithm.
- the method further comprises: extracting signal features from the one or more bioelectric signals, and operating the pattern recognition algorithm on input values comprising the signal features, to cause the pattern recognition algorithm to process the input values for determination of the intended limb movement of the respective limb.
- the pattern recognition algorithm outputs at least one candidate limb movement for the respective limb, and said determining the intended limb movement further comprises: validating the at least one candidate limb movement against a position signal representing actual movement of the respective limb.
- the method further comprises: determining a force value from the force signal, and providing the force value as a further input value for the pattern recognition algorithm.
- the method further comprises: obtaining an inertial signal from an inertial sensor in the active orthotic device or on the human subject,
- the method further comprises: obtaining a respective position signal from a respective position sensing device associated with the respective set of actuators and/or the respective limb, determining a position value from the respective position signal, the position value being indicative of a momentary position of the respective limb, and providing the position value as a further input value for the pattern recognition algorithm.
- the pattern recognition algorithm comprises an artificial neural network, which is trained to process the input values for determination of the intended limb movement of the respective limb.
- the method further comprises: the artificial neural network has an output layer configured to provide output data indicative of the intended limb movement, said method further comprising: obtaining a respective position signal representing actual movement of the respective limb, and modifying one or more weight factors of the output layer as a function of the respective position signal.
- the method further comprises: obtaining an inertial signal from an inertial sensor in the active orthotic device or on the human subject, processing the inertial signal for detection of a disturbance condition, and, when detecting the disturbance condition, disabling at least the step of generating the respective set of control signals.
- the respective limb is a finger on a hand of the human subject.
- the respective limb is a respective finger on a hand of the human subject
- the intended limb movement corresponds to an intended grip to be formed by one or more fingers on the hand.
- a second aspect of the invention is a computer-readable medium comprising computer instructions which, when executed by a processor, cause the processor to perform the method of the first aspect and any of its embodiments.
- a third aspect is a control device for an active orthotic device attached to one or more limbs of a human subject.
- the active orthotic device comprises a respective set of actuators for moving a respective limb among the one or more limbs, and the control device is configured to perform the method of the first aspect or any of its
- a fourth aspect of the invention is an active orthotic device configured to be attached to one or more limbs of a human subject.
- the active orthotic device comprises a respective set of actuators for moving a respective limb among the one or more limbs, and the control device of the third aspect.
- FIG. 1 is a schematic view of an active orthosis arranged on the hand of a human subject.
- FIGS 2A-2D illustrate examples of grips that may be attained by use of an active orthosis.
- FIG. 3A is a block diagram of a control system of an active orthosis
- FIG. 3B is a detailed block diagram the control system of FIG. 3A for controlling a single finger.
- FIG. 4 is a flow chart of a method for controlling an active orthosis.
- FIG. 5 is a schematic view of an artificial neural network for determining an intended grip of a human subject wearing an active orthosis.
- FIG. 6 is a block diagram of a control device for operating an active orthosis.
- any of the advantages, features, functions, devices, and/or operational aspects of any of the embodiments of the present invention described and/or contemplated herein may be included in any of the other embodiments of the present invention described and/or contemplated herein, and/or vice versa.
- any terms expressed in the singular form herein are meant to also include the plural form and/or vice versa, unless explicitly stated otherwise.
- “at least one” shall mean “one or more” and these phrases are intended to be interchangeable. Accordingly, the terms “a” and/or “an” shall mean “at least one” or “one or more”, even though the phrase “one or more” or “at least one” is also used herein.
- an "orthotic device” or “orthosis” refers to an externally applied device that is designed and fitted to the body of an individual to modify structural and functional characteristics of the neuromuscular and skeletal system.
- the wearer of the orthosis may be incapable of moving one or more limbs or may have an impaired ability to control or effect the movement of one or more limbs.
- the orthosis may thus be arranged to perform, stabilize or assist a movement of one or more limbs, and well as to enhance the force by which a limb interacts with an object.
- the orthosis may be configured for any limbs or combinations of limbs, including but not limited to any upper body extremity such as an upper arm, a forearm, a hand, a finger, a phalange, or any lower body extremity such as a thigh, a lower leg, a foot, a toe or a phalange.
- Each such limb is moved in relation to one or more joints, such as a shoulder joint, an elbow joint, a wrist, finger joint, a hip joint, a knee joint, an ankle or a toe joint.
- the orthotic device will be exemplified as a hand orthosis, which is configured to be worn on the hand of an individual and is operable to impart a controlled limb movement to one or more fingers.
- a hand orthosis such a controlled limb movement for one or more limbs may be referred to as a "grip".
- the hand orthosis may perform, stabilize or assist a grip involving one or more fingers and/or strengthen a grip in contact with an object.
- FIG. 1 is a perspective view of a hand 1 wearing an example orthosis 2 which comprises a cover or sheath 3A configured as a finger glove.
- the sheath 3A is arranged on the thumb 1A and the index finger IB and in engagement with the palm and the back of the hand of the individual.
- the orthosis 2 is configured to impart a controlled movement to each of the fingers 1A, IB.
- the sheath 3A may also, or alternatively, be configured to be worn on any one of the middle finger 1C, the ring finger ID and the little finger IE, and the orthosis 2 may be configured for movement control of any one the fingers 1A-1E or any combination thereof.
- the hand orthosis 2 comprises cords or lines that serve as artificial tendons 4.
- the tendons 4 are fastened to the sheath 3 on distal portions of the fingers 1A, IB and are arranged to extend in channels and/or guides (not shown) to a control module 5.
- the control module 5 contains a power source, one or more actuators and control electronics for imparting a defined movement to the respective tendon 4 so as to move the fingers 1A, IB into one or more predefined grips.
- the respective actuator may comprise an electric motor with one or more gears connected to a winding device, e.g. a cord reel, to which one or more of the tendons 4 is fastened.
- the orthosis 2 may include one or more actuators for each finger and/or one actuator may be attached to a tendon 4 extending to two or more fingers.
- the index finger IB may be controlled into a bending motion by one tendon 4, shown in FIG. 1.
- a further tendon (not shown) may be arranged on the rear side of the index finger IB to impart a straightening motion to the finger IB.
- the control module 5 is arranged onto the forearm 6 of the individual by a band or strap 3B.
- a set of bioelectric sensors 10 are arranged for contact with the forearm 6. Although four sensors 10 are shown in FIG. 1, any number of sensors 10 may be used.
- the bioelectric sensors 10 may be in the form of electrodes that are configured to detect the electrical activity produced by the skeletal muscles on the forearm 6 that are relevant for moving the fingers to be controlled by the orthosis 2.
- the sensors 10 may be arranged in contact with the skin or be implanted.
- the bioelectric sensors 10 are so-called EMG (electromyography) sensors and the bioelectric signals are EMG signals.
- the sensors 10 are integrated into the band 3B for application onto the skin of the forearm 6.
- the control module 5 may be arranged anywhere on the body of the individual and that the control module 5 may be physically separated into two or more devices, e.g. a power source, an actuator device and a control device (cf. 60 in FIG. 6).
- the sensors 10 may alternatively or additionally be arranged on the other forearm of the individual, thereby allowing the individual to control a hand orthosis 2 on the right hand 1 by muscle activity in the left forearm, or vice versa.
- the sensors 10 may be arranged to sense activity of muscles that are physically unrelated to the finger movement, and the orthosis 2 may be configured to move the fingers based on such muscle activity.
- the orthosis 2 may attain one or more grips in dependence of the wrist angle.
- the orthosis 2 is operable, via the actuators, to attain different states, where each state corresponds to a predefined grip.
- a "grip" not only includes activated grips in which one or more fingers 1A-1E are actively operated to apply a force onto an object, e.g. an external object or a body part, but also passive grips in which the fingers 1A-1E are relaxed and/or stationary and do not apply any force.
- the passive grip is thus an "open grip” or "relaxed grip".
- the arrangement of the fingers 1A- 1E in the open grip may be left to the wearer, e.g. by decoupling the actuators so as to allow the wearer to attain any desired relaxed grip.
- FIG. 2A shows an open (relaxed) grip GO.
- FIG. 2B shows a pinch grip G1 in which the tips of the thumb 1A and the index finger IB are moved into engagement with an object 8.
- FIG. 2C shows a lateral grip G3, in which at least the index finger IB is bent and the tip of the thumb 1A is moved laterally and to engage an object 8 between the tip of the thumb 1 and the bent index finger IB.
- FIG. 2D shows a cylindrical grip G4 in which one or more of the fingers 1A-1E are moved to press an object 8 onto the palm of the hand.
- Embodiments of the invention involve a technique of operating an orthosis 2 to better mimic the movement of the fingers of a healthy individual when attaining different grips.
- One such embodiment involves determining, based on signals from the bioelectric sensors 10, an intended grip and an intended grip force for each finger 1A- 1E involved in the intended grip.
- the intended grip may be determined among a set of predefined (predetermined) grips, e.g. as exemplified in FIGS 2A-2D, where each predefined grip is associated with a predefined movement trajectory of the respective finger 1A-1E and thus activation of one or more selected actuators among the actuators in the orthosis 2.
- the intended grip force defines one or more set points for controlling the selected actuators based on an actual contact force of the respective finger 1A-1E involved in the intended grip. Thereby, it is possible to operate the selected actuators to achieve the intended grip with the intended grip force in a well-controlled and natural manner.
- FIG. 3A is a block diagram of a control system of an orthosis attached to a number of limbs (fingers), which are schematically indicated and designated by 1A-1N.
- the control system operates on a set of EMG signals [5(f)] which are received from a set of EMG sensors 10 to selectively actuate one or more of the fingers 1A-1N.
- the control system includes a force prediction module 12, which is configured to process the EMG signals [5(f)] for determination of intended force data [F(t)] for the fingers 1A-1N.
- the intended force data [F(t)] may include an intended force value for each finger 1A-1N.
- the control system further includes a grip prediction module 14, which is configured to process the EMG signals [5(f)] for determination of intended grip data [G(t)] for the fingers 1A-1N.
- the grip data [G(t)] may include an index representing a selected grip, or a respective probability value for one or more candidate grips.
- a coordination module 16 operates on the intended force data [F(t)] and the grip data [G(t)] to generate intended force signals F A (t),..., F N (t) for finger controllers 18A-18N, which each comprise one or more actuators for moving the respective finger 1A-1N.
- the intended force signals F A (t),..., F N (t) are generated to cause the finger controllers 18A-18N to impart a desired movement of one or more of the fingers 1A-1N.
- the one or more actuators of the respective finger controller 18A-18N are configured to impart a predefined two-dimensional (2D) finger movement, e.g. by bending the finger to move its distal portion in a 2D plane, the finger controller may operate solely on the intended force signal.
- coordination module 16 may additionally provide a grip signal that indicates the intended grip and causes the finger controller to selectively operate its actuators in accordance with the intended grip.
- a grip signal G A (t ) is provided by the coordination module 16 to the finger controller 18 A.
- the force prediction module 12 may be configured to evaluate (compute) one or more force-related parameters based on one or more of the EMG signals [5(t)] and determine the intended force data [F(t)] as a function thereof.
- force-related parameters may represent the time domain, the frequency domain or the time-frequency domain, or any combination thereof.
- Examples of force-related parameters include, without limitation, Wilson amplitude, variance, mean absolute value, waveform length, histogram, mean frequency, entropy, slope, etc.
- the grip prediction module 14 may be configured to evaluate (compute) a plurality of grip-related signal features based on one or more of the EMG signals [5(f)] and operate a pattern recognition algorithm on the signal features to determine the grip data [G(t)], by assigning the signal features to one or more predefined classes that each represents an predefined grip.
- Such signal features are well-known in the art and may represent the time domain, the frequency domain or the time-frequency domain, or any combination thereof. Examples of signal features are given in the above-identified article by Mathiesen et al.
- the pattern recognition algorithm if properly defined, ensures consistent and robust grip prediction.
- the pattern recognition algorithm may range in complexity from simple to advanced, e.g. depending on the number of sensors 10, the number of predefined grips, the number of fingers controlled by the orthosis, the degrees of freedom of the respective finger, etc.
- pattern recognition algorithms include, without limitation, a simple combination of evaluation rules, Bayes classifier, linear discriminant analysis (LDA), support vector machine (SVM), Gaussian mixture model (GMM), quadratic classifier, kernel density estimation, decision tree, artificial neural network (ANN), recurrent neural network (RNN), and Long Short Term Memory (LSTM).
- LDA linear discriminant analysis
- SVM support vector machine
- GMM Gaussian mixture model
- LSTM Long Short Term Memory
- the structure of the finger controller 18A is shown in more detail, comprising a summation unit 19, an actuator controller 20 and an actuator 21.
- the summation unit 19 is configured to receive the intended force signal F A (F) from the coordination module 16 and a measured force signal P A (t) from a force sensing device 22, and output a difference or error signal e(t) corresponding to the momentary difference between the signals F A (t) and P A (t).
- the measured force signal A (t) is a time sequence of actual force values, each representing a momentary application force (contact force) occurring between the finger 1A and an object which is touched or gripped by the finger 1A.
- the force sensing device 22 may be arranged in the sheath 3A (FIG.
- the force sensing device 22 may be included in or associated with the actuator 21 to indirectly measure the application force, e.g. by measuring a force applied to a tendon (4 in FIG. 1), a strain or torque on a drive axis, etc.
- the force sensing device 22 may sense the orientation and/or position of one or more components of the actuator 21, e.g. the above-mentioned winding device, and algorithmically compute the applied force based thereon.
- the actuator controller 20 is configured to receive the error signal e(t) and generate a control signal u(t) for the actuator 21, which is arranged to impart a corresponding movement to the finger 1A.
- the finger controller 18 may include more than one actuator 21, and the actuator controller 20 may be configured to generate a respective control signal for each actuator 21 so as to minimize the error signal e(t).
- the actuator controller 20 may implement any available control algorithm, including proportional (P), integral (I) and derivative (D) control, or any combination thereof.
- the actuator controller 20 is also configured to receive the grip signal G A (t ) from the coordination module 16. Based on the grip signal G /1 (t), the actuator controller 20 is operable to infer, by appropriate logic, which one(s) of the actuators 21 that should be actively controlled to form the intended grip.
- FIG. 3B also indicates, by dashed arrows, that the grip prediction module 14 may be configured to receive the force signal P A (t) from the force sensing device 22, as well as a position signal P A (t) from a position sensing device 24.
- the position signal P A (t) is a time sequence of position values, each representing a momentary position of the finger 1A.
- a "position" refers to any metric or combination of metrics that defines the location of the finger or a part of the finger, e.g. a phalange, in relation to a predefined reference.
- the reference may, e.g., be a coordinate system, e.g.
- the position sensing device 24 is configured to algorith mically compute the position based on the current orientation or position of one or more components of the actuator 21 and/or based on signal(s) from one or more inertial sensors on the finger 1A, e.g. arranged in the sheath 3A.
- FIG. 3B further indicates, by a dashed arrow, that the grip prediction module 14 may be configured to receive one or more inertial signals l(t) from one or more inertial sensors 26, e.g. comprising one or more accelerometers and/or gyroscopes.
- the inertial signal(s) l(t) may be indicative of one or more of acceleration, angular velocity, orientation, etc.
- the inertial sensor(s) 26 may be arranged in one or more finger controllers 18A-18N, and/or on one or more fingers 1A-1N, the hand 1, the sheath 3 A, or elsewhere on the wearer of the orthosis 2.
- the finger controllers 18B-18N in FIG. 3 A may be configured in correspondence with the finger controller 18A as described above.
- FIG. 4 shows an embodiment of a method 400 for controlling an orthosis.
- the method 400 will be exemplified with reference to the control system in FIGS 3A-3B for the hand orthosis 2 in FIG. 1.
- the method 400 is divided into three sub-sequences 400A, 400B and 400C.
- Sub-sequence 400A predicts the intended grip and is performed by module 14.
- Sub-sequence 400B predicts the intended force and is performed by module 12.
- Sub-sequence 400C selects the actuators in the orthosis to be operated and controls the selected actuators to perform the intended grip.
- Sub- sequence 400C may be performed by module 16 and the finger controllers 18 A- 18N.
- the method 400 may be repeatedly executed at consecutive time steps, although the time steps may differ between the sub-sequences 400A-400C.
- EMG signals [5(f)] are obtained from the EMG sensors 10.
- the EMG signals [S(t)], or a respective subset thereof, are processed by sub-sequence 400A and sub-sequence 400B.
- sub-sequence 400A one or more EMG signals [5(f)] are pre-processed (step 402A), e.g. by amplification, filtering for noise reduction, normalization and rectification, as is well-known in the art.
- step 403 a plurality of EMG signal features are extracted within a time window in the pre-processed EMG signal(s), e.g. as exemplified above with reference to module 14.
- Steps 404-406 are optional and may be included to improve the prediction of the intended grip.
- one or more inertial signal features are extracted from the inertial signal(s) 7(t).
- the inertial signal feature(s) may represent any type of inertial parameter, including without limitation linear acceleration in one or more directions, linear velocity in one or more directions, one or more orientation angles, angular velocity in one or more directions, angular acceleration in one or more directions, etc.
- one or more force features are extracted from the measured force signal for the respective finger (cf. P A (t) in FIG. 3B).
- the force feature(s) may include an individual force value, a time average of force values, a maximum or minimum force value within a time window, a slope, a variance, etc.
- one or more position features are extracted from the measured position signal for the respective finger (cf in FIG. 3B).
- the position feature(s) may include an individual position value, a time average of position values, a maximum or minimum position value within a time window, a slope, a variance, etc.
- the features obtained by steps 403-406 are provided as input values (also denoted "feature set” herein) to a pattern recognition algorithm, which may be of any type, e.g. as exemplified above with reference to module 14.
- step 407 the pattern recognition algorithm outputs the grip data [G(t)] (FIGS 3A-3B), which is used by step 408 for determining the intended grip.
- the grip data [G(t)] comprises probabilities for different predefined grips (candidate grips)
- step 408 may select the grip with the highest probability.
- step 408 may determine the intended grip based on a combination of the grip data [G(t)] and the intended force data [F(t)], which is determined by step 410 (below).
- FIG. 5 shows an example of a pattern recognition device 50, which may be used in step 407 and may be part of the grip prediction module 14 in FIGS 3A-3B.
- the pattern recognition device 50 comprises an artificial neural network (ANN), which has been trained to classify incoming feature sets into four candidate grips, designated by G 0 - G 3 , e.g. corresponding to grips G0-G3 in FIGS 2A- 2D.
- the ANN 50 may indicate a single predicted grip among G 0 - G 3 for each feature set, or a probability value for each of G 0 - G 3 .
- ANNs are well-known as such will not be described in detail.
- the ANN 50 may have any number of hidden layers intermediate the input layer A 0 and the output layer A n .
- each neuron represented by a circle in FIG. 5
- FIG. 5 collectively designates the weights applied by the neurons in layer A x by [w l L ] and in layer A n by [w n i ]. Any conventional activation function may be used for the respective layer.
- all neurons in the respective layer are connected to all neurons in the adjacent layer(s).
- FIG. 5 also illustrates feature extraction modules 53-56 for extracting features in accordance with the respective step 403-406.
- pre- processed EMG signals S1-S4 are processed by module 53 to provide a set of EMG features to the ANN 50
- measured force signals P A, P B for fingers 1A, IB are processed by module 54 to provide a set of force features to the ANN 50
- measured position signals P A , P B for fingers 1A, IB are processed by module 55 to provide a set of posi tion features to the ANN 50
- inertial signals I A , I B for fingers 1A, IB are processed by module 56 to provide a set of inertial features to the ANN 50.
- the feature set only includes EMG signal features.
- the feature set may be achieved by expanding the feature set to include force feature(s), position feature(s) or inertial feature(s), or any combination thereof. It is realized that the values of the force features, position features and inertial features may differ between different grips and thus enable an improved classification of the feature set into an intended grip.
- the expanded feature set is applicable to all types of pattern recognition algorithms, not only ANNs.
- the inventors have further found that by including the relaxed grip G 0 among the candidate grips, irrespective of pattern recognition algorithm, the user is able to control the orthosis 2 to release an active grip in a natural and intuitive way.
- one or more EMG signals [S(t)] are pre-processed (in step 402B), e.g. by amplification and filtering for noise reduction.
- an intended force for each finger is computed for signal values within a time window of the pre-processed EMG signal(s), e.g. as exemplified above with reference to module 12.
- step 410 results in intended force data [F(t)].
- step 411 selects the actuators that should be operated to perform the intended grip.
- Step 411 may be omitted if all actuators of a finger controller are operated for all of the predefined grips.
- Step 412 obtains a current value of the actual application force for the respective finger that is involved in the intended grip.
- step 412 may obtain the current value from the resp- ective measured force signal (cf. P A(t ) in FIG. 3B).
- the current value may be a single force value or a time-average of force values in the measured force signal.
- a difference value (momentary force difference) between the intended force and the current value is computed.
- the difference value forms a signal value in the error signal e(t) in FIG. 3B.
- a control value is generated for the respective selected actuator in accordance with a predefined control algorithm and as a function of the difference value.
- the control value forms a signal value in the control signal u(t) in FIG. 3B.
- the method 400 is repeatedly executed to progressively move the fingers into the intended grip.
- the grip prediction by sub- sequence 400A and the force prediction by sub- sequence 400B may but need not be performed concurrently.
- the orthosis 2 may configured to allow the wearer to move its fingers, assuming that the wearer has such ability, without resistance from the actuators.
- the orthosis may be a handgrip strengthener, which allows the wearer to move its fingers towards or into the intended grip, and the orthosis strengthens the intended grip in accordance with the intended force.
- the force-based movement control as described in the foregoing may be performed only during part of the movement into the intended grip.
- the orthosis may nevertheless move the fingers towards the intended grip, e.g. by the coordination module 16 generating the intended force signals F A (t),..., F N (t ) with predefined values. If an intended force is detected during the movement, the coordination module 16 may switch to generating the intended force signals F A (t),..., F N (t ) to reflect the intended force, so as to achieve the intended grip with the intended force. It is also conceivable that the grip prediction by sub-sequence 400A is omitted, e.g. if the orthosis is configured to perform a single grip.
- the momentary position of the respective finger is measured (cf. P A(t) in FIG. 3B) while the wearer starts to move its fingers
- one or more measured positions of the respective finger may be analyzed to validate the output of the pattern recognition algorithm.
- Such a validation is effectively embedded into the pattern recognition algorithm when one or more position features are included in the feature set (cf. step 406 and FIG. 5).
- the method 400 may comprise a step of matching the measured position(s) to the output of the pattern recognition algorithm and refraining from proceeding to sub-sequence 400C if there is a mismatch between the measured position(s) and the movement trajectories of the grip that is predicted by the pattern recognition algorithm.
- one or more of the weight factors of the ANN 50 may be modified as function of the measured positions (cf. P A , P B ).
- the method 400 comprises a step of modifying one or more of the weight factors [w n i ] of the output layer A n based on the momentary finger position, so as to drive the prediction of the ANN 50 towards the intended grip with the movement trajectories that match the measured position signals.
- the bioelectric signals are typically weak and noisy and thereby susceptible to disturbances. For example, sudden movements of the body or a body part of the wearer may distort the bioelectric signals [5(f)] and disturb the operation of the orthosis.
- the method 400 may include a step of processing the inertial signal(s) 7(t) for detection of a disturbance condition, e.g. a sudden change in velocity, position or orientation, and step of disabling at least step 414 if the disturbance condition is detected.
- a disturbance condition e.g. a sudden change in velocity, position or orientation
- the detection of a disturbance condition may cause the operation of the orthosis 2 to be temporarily suspended.
- step 414 may be replaced with a step of using the latest intended force signals F A (t),..., F N (t ) until the disturbance has subsided or for a predefined time period, so that the operation of the orthosis 2 continues in a safe way during the disturbance.
- FIGS 2A-2D To further exemplify embodiments of the invention, reference is made to FIGS 2A-2D.
- the orthosis 2 is configured, by the respective finger controller 18A-18E, to move the fingers IB- IE along a respective default trajectory, i.e. in a predefined 2D movement, and to move the thumb 1A along three different movement trajectories. If the control system detects that the wearer intends to attain the pinch grip G1 with a first force, the orthosis operates selected actuators to move the thumb 1A on a first trajectory associated with the pinch grip G1 and the index finger IB on its default trajectory, until the first force is measured for the thumb 1A and the index finger IB.
- the orthosis may either disengage the actuators to allow the wearer to move the fingers into the relaxed grip GO or operate the selected actuator to move the fingers into the relaxed grip GO. If the control system detects that the wearer intends to attain the lateral grip G2 with a first force for the thumb 1A and a second force for the other fingers 1B-1E, the orthosis operates selected actuators to move the fingers 1B-1E on their respective default trajectory and the thumb 1A on a second trajectory associated with the lateral grip G2, until the first force is measured for the thumb 1A and the second force is measured for the fingers IB- IE.
- the orthosis operates selected actuators to move the fingers 1B-1E on their respective default trajectory and the thumb 1A on a third trajectory associated with the cylindrical grip G3, until the first force is measured for all fingers 1A-1E.
- FIG. 6 is a diagrammatic representation of a control device 60 in accordance with an embodiment of the invention.
- the device 60 comprises a communication module 61 defining one or more interfaces for data communication in accordance with any suitable protocol or protocols. As shown, the device 60 may input data from bioelectric sensor(s) 10, force sensing device(s) 22, position sensing device(s) 24, inertial sensor(s) 26, and output control signal(s) for actuator(s) 21, via the communication module 61.
- the device 60 further comprises one or more processors 62, e.g. a central processing unit (CPU), a microprocessor, a microcontroller, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or any combination thereof.
- processors 62 e.g. a central processing unit (CPU), a microprocessor, a microcontroller, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (F
- the device 60 further comprises system memory 63, which may include computer memory in the form of volatile and/or non-volatile memory such as read only memory (ROM), random access memory (RAM) and flash memory.
- the memory 63 may store computer instructions 64 (e.g. software or program code) for causing the device 60 to perform any one of the methodologies discussed herein.
- the instructions 64 may be supplied to the device 60 on a computer-readable medium 65, which may be a tangible (non-transitory) product (e.g. magnetic medium, optical medium, read-only memory, flash memory, digital tape, etc) or a propagating signal.
- the instructions 64 may cause the processor(s)
- any of the modules 12, 14, 16, 18A-18E described in the foregoing may be implemented by the processor(s) 62 executing the instructions 64.
- the modules 12, 14, 16, 18A-18E are implemented solely by dedicated hardware.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Animal Behavior & Ethology (AREA)
- Veterinary Medicine (AREA)
- Public Health (AREA)
- General Health & Medical Sciences (AREA)
- Heart & Thoracic Surgery (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Physics & Mathematics (AREA)
- Pathology (AREA)
- Biophysics (AREA)
- Medical Informatics (AREA)
- Vascular Medicine (AREA)
- Physical Education & Sports Medicine (AREA)
- Epidemiology (AREA)
- Pain & Pain Management (AREA)
- Rehabilitation Therapy (AREA)
- Transplantation (AREA)
- Orthopedic Medicine & Surgery (AREA)
- Nursing (AREA)
- Cardiology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Rehabilitation Tools (AREA)
- Prostheses (AREA)
- Manipulator (AREA)
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US17/296,960 US12090107B2 (en) | 2018-12-12 | 2019-12-07 | Control of an active orthotic device |
| JP2021533708A JP7450621B2 (ja) | 2018-12-12 | 2019-12-07 | アクティブ装用デバイス、その制御デバイス、制御方法およびコンピュータ可読媒体 |
| EP19896860.4A EP3893814A4 (en) | 2018-12-12 | 2019-12-07 | CONTROL OF AN ACTIVE ORTHOSIS |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| SE1851567A SE1851567A1 (en) | 2018-12-12 | 2018-12-12 | Control of an active orthotic device |
| SE1851567-6 | 2018-12-12 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020122792A1 true WO2020122792A1 (en) | 2020-06-18 |
Family
ID=71076100
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/SE2019/051248 Ceased WO2020122792A1 (en) | 2018-12-12 | 2019-12-07 | Control of an active orthotic device |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US12090107B2 (https=) |
| EP (1) | EP3893814A4 (https=) |
| JP (1) | JP7450621B2 (https=) |
| SE (1) | SE1851567A1 (https=) |
| WO (1) | WO2020122792A1 (https=) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112603298A (zh) * | 2020-12-30 | 2021-04-06 | 杭州电子科技大学 | 多传感信息融合的卒中急性期患者手功能康复评估系统 |
| JP2022137943A (ja) * | 2021-03-09 | 2022-09-22 | 大王製紙株式会社 | 使い捨て着用物品におけるサイドシールの破りやすさ評価方法 |
| US20230263644A1 (en) * | 2020-06-30 | 2023-08-24 | Cyberdyne Inc. | Wearable hand-finger motion support apparatus |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| SE542072C2 (en) * | 2017-06-19 | 2020-02-18 | Tendo Ab | A device for pivoting a body member around a joint |
| WO2022006282A1 (en) * | 2020-06-30 | 2022-01-06 | Ohio State Innovation Foundation | Devices, systems, and methods for quantifying stability of a joint |
| US12303447B2 (en) * | 2022-01-19 | 2025-05-20 | Animo Bionics Corp. | Telekinetic bionic glove assembly |
| SE546854C2 (en) * | 2022-05-16 | 2025-02-25 | Bioservo Ab | A system and method for strengthening a gripping movement |
| EP4620437A1 (en) * | 2024-03-21 | 2025-09-24 | Universität Heidelberg | User-wearable orthosis, method for control thereof, and non-transitory computer readable storage medium |
| CN118024306B (zh) * | 2024-04-11 | 2024-06-07 | 中北大学 | 一种自动辅助抓握的夹层式仿生软体抓手及其制备方法 |
| EP4663118A1 (en) * | 2024-06-13 | 2025-12-17 | Universität der Bundeswehr München | Computer-implemented method, computer program, and device for associating a human body gesture to a detected myoelectric signal |
| KR102850391B1 (ko) * | 2024-08-13 | 2025-08-27 | 만드로 주식회사 | 손의 동작을 감지하여 구동하는 전자 의수 |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7396337B2 (en) * | 2002-11-21 | 2008-07-08 | Massachusetts Institute Of Technology | Powered orthotic device |
| US20100268351A1 (en) * | 2007-02-06 | 2010-10-21 | Deka Products Limited Partnership | System, method and apparatus for control of a prosthetic device |
| US20120179075A1 (en) * | 2006-03-29 | 2012-07-12 | University Of Washington | Exoskeleton |
| US20120330198A1 (en) * | 2011-06-21 | 2012-12-27 | Volkan Patoglu | Exoskeleton |
| US20140171838A1 (en) * | 2012-12-19 | 2014-06-19 | Aleksandar Aleksov | Adaptive exoskeleton, control system and methods using the same |
| US20160259417A1 (en) * | 2014-07-21 | 2016-09-08 | Dexta Robotics | Hand exoskeleton force feedback system |
| WO2016146960A1 (en) * | 2015-03-19 | 2016-09-22 | Phasex Ab | A modular universal joint with harmonised control method for an assistive exoskeleton |
| WO2016166588A1 (en) * | 2015-04-15 | 2016-10-20 | Instituto Tecnológico y de Estudios Superiores de Monterrey | Non-invasive mechatronic device providing joint mobility |
| US20170266075A1 (en) * | 2014-12-04 | 2017-09-21 | Telerobot Labs S.R.L. | Aid device for the movement and/or rehabilitation of one or more fingers of a hand |
| WO2018050191A1 (en) * | 2016-09-14 | 2018-03-22 | Aalborg Universitet | A human intention detection system for motion assistance |
Family Cites Families (41)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3068638B2 (ja) | 1990-09-26 | 2000-07-24 | アイシン精機株式会社 | 熱操作によるアクチュエータ |
| US5254078A (en) * | 1991-06-03 | 1993-10-19 | Innovation Sports, Inc. | Wrist brace |
| JP2913611B2 (ja) * | 1991-10-22 | 1999-06-28 | 日本電信電話株式会社 | 学習型筋電パターン認識ロボットハンド制御装置 |
| US5800561A (en) | 1996-05-15 | 1998-09-01 | Massachusetts Institute Of Technology | Power-assisted upper extremity orthosis |
| US5778449A (en) * | 1997-02-13 | 1998-07-14 | Rollerblade, Inc. | Wrist guard |
| JP4342849B2 (ja) * | 2003-06-19 | 2009-10-14 | 株式会社 サトウスポーツプラザ | 加圧筋力増強装置、及び制御装置、並びに該制御装置にて実行される方法 |
| ES2652026T3 (es) * | 2006-09-01 | 2018-01-31 | Bioservo Technologies Ab | Guante de refuerzo |
| US10758394B2 (en) * | 2006-09-19 | 2020-09-01 | Myomo, Inc. | Powered orthotic device and method of using same |
| KR101245495B1 (ko) * | 2008-04-17 | 2013-03-25 | 가부시키가이샤 사토 스포츠 플라자 | 트레이닝 장치, 트레이닝용 제어 장치, 제어 방법 |
| US8409117B2 (en) * | 2008-09-15 | 2013-04-02 | The Hong Kong Polytechnic University | Wearable device to assist with the movement of limbs |
| JP5472680B2 (ja) | 2009-04-09 | 2014-04-16 | 国立大学法人 筑波大学 | 装着式動作補助装置 |
| GB2479358B (en) * | 2010-04-06 | 2012-04-18 | I2R Medical Ltd | Therapeutic hand exercise device |
| IL213756A (en) * | 2011-06-23 | 2016-02-29 | Rehabit-Tec Ltd | Device for restoration of damaged limb |
| US20150148728A1 (en) | 2011-09-08 | 2015-05-28 | Children's Medical Center Corporation | Isolated orthosis for thumb actuation |
| US10973736B2 (en) * | 2012-02-29 | 2021-04-13 | Frederick J. Muench | Systems, devices, components and methods for triggering or inducing resonance or high amplitude oscillations in a cardiovascular system of a patient |
| US9120220B2 (en) * | 2012-02-29 | 2015-09-01 | GM Global Technology Operations LLC | Control of a glove-based grasp assist device |
| US9326909B2 (en) * | 2012-05-11 | 2016-05-03 | University Of Tennessee Research Foundation | Portable hand rehabilitation device |
| MX352726B (es) * | 2013-02-28 | 2017-12-06 | Facebook Inc | Controlador de retroalimentación de fuerza exoesqueletal modular. |
| US9387112B2 (en) * | 2013-02-28 | 2016-07-12 | Marvin Frank Bryant | Myoelectric hand orthosis |
| KR101779100B1 (ko) | 2013-03-15 | 2017-09-18 | 에스알아이 인터내셔널 | 엑소수트 시스템 |
| US20150112448A1 (en) | 2013-10-23 | 2015-04-23 | Kurt W. Scott | Hybrid Prosthetic Hand |
| US10831318B2 (en) | 2013-12-24 | 2020-11-10 | Intel Corporation | Adaptive enclosure for a mobile computing device |
| WO2015163569A1 (ko) * | 2014-04-21 | 2015-10-29 | 한국기술교육대학교 산학협력단 | 외골격형 글로브 |
| GB2541623A (en) * | 2014-06-12 | 2017-02-22 | Nat Univ Singapore | Actuator device, method and system for limb rehabilitation |
| US20170119553A1 (en) * | 2014-06-20 | 2017-05-04 | Scuola Superiore S.Anna | A haptic feedback device |
| US10478370B2 (en) * | 2014-06-30 | 2019-11-19 | Rehabilitation Institute Of Chicago | Actuated glove orthosis and related methods |
| WO2016058092A1 (en) | 2014-10-16 | 2016-04-21 | Griffin Innovation | Mobile device systems and methods |
| US10912701B2 (en) * | 2015-01-07 | 2021-02-09 | The Board Of Regents Of The University Of Texas System | Fluid-driven actuators and related methods |
| CN105902363B (zh) * | 2015-02-19 | 2020-02-07 | 松下知识产权经营株式会社 | 辅助服、辅助服的控制部的控制方法 |
| CN105902367B (zh) * | 2015-02-19 | 2020-02-07 | 松下知识产权经营株式会社 | 辅助服、辅助服的控制部的控制方法 |
| WO2016174083A1 (en) * | 2015-04-29 | 2016-11-03 | Bioservo Technologies Aktiebolag | A control system for a strengthening glove |
| JP2018519004A (ja) | 2015-06-15 | 2018-07-19 | マイオモ インコーポレイテッド | 電動矯正デバイスおよびそれを使用する方法 |
| US20170049657A1 (en) * | 2015-08-19 | 2017-02-23 | Jane Cortez | Rehabilitative Glove Device |
| WO2017161257A1 (en) * | 2016-03-18 | 2017-09-21 | Ekso Bionics, Inc. | Device and method for strengthening the arms of huaman exoskeletons |
| US9717607B1 (en) * | 2016-10-28 | 2017-08-01 | International Business Machines Corporation | Augmented control of robotic prosthesis by a cognitive system |
| EP3342390A1 (en) * | 2016-12-29 | 2018-07-04 | ETH Zurich | Apparatus for supporting a limb of a user against gravity |
| HU230928B1 (hu) * | 2017-01-25 | 2019-04-29 | Phoenix Innovation Kft. | Aktív kéz ortézis |
| KR102042968B1 (ko) * | 2017-09-25 | 2019-11-11 | 주식회사 네오펙트 | 손가락 움직임 보조장치 |
| US11024195B2 (en) * | 2018-04-10 | 2021-06-01 | Imam Abdulrahman Bin Faisal University | Diagnostic and therapeutic system for manual therapy |
| US20190038222A1 (en) * | 2018-05-23 | 2019-02-07 | Yuri Krimon | Mitigating effects of neuro-muscular ailments |
| US10449677B1 (en) * | 2019-03-12 | 2019-10-22 | United Arab Emirates University | Robotic gripping assist |
-
2018
- 2018-12-12 SE SE1851567A patent/SE1851567A1/en not_active Application Discontinuation
-
2019
- 2019-12-07 WO PCT/SE2019/051248 patent/WO2020122792A1/en not_active Ceased
- 2019-12-07 US US17/296,960 patent/US12090107B2/en active Active
- 2019-12-07 JP JP2021533708A patent/JP7450621B2/ja active Active
- 2019-12-07 EP EP19896860.4A patent/EP3893814A4/en not_active Withdrawn
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7396337B2 (en) * | 2002-11-21 | 2008-07-08 | Massachusetts Institute Of Technology | Powered orthotic device |
| US20120179075A1 (en) * | 2006-03-29 | 2012-07-12 | University Of Washington | Exoskeleton |
| US20100268351A1 (en) * | 2007-02-06 | 2010-10-21 | Deka Products Limited Partnership | System, method and apparatus for control of a prosthetic device |
| US20120330198A1 (en) * | 2011-06-21 | 2012-12-27 | Volkan Patoglu | Exoskeleton |
| US20140171838A1 (en) * | 2012-12-19 | 2014-06-19 | Aleksandar Aleksov | Adaptive exoskeleton, control system and methods using the same |
| US20160259417A1 (en) * | 2014-07-21 | 2016-09-08 | Dexta Robotics | Hand exoskeleton force feedback system |
| US20170266075A1 (en) * | 2014-12-04 | 2017-09-21 | Telerobot Labs S.R.L. | Aid device for the movement and/or rehabilitation of one or more fingers of a hand |
| WO2016146960A1 (en) * | 2015-03-19 | 2016-09-22 | Phasex Ab | A modular universal joint with harmonised control method for an assistive exoskeleton |
| WO2016166588A1 (en) * | 2015-04-15 | 2016-10-20 | Instituto Tecnológico y de Estudios Superiores de Monterrey | Non-invasive mechatronic device providing joint mobility |
| WO2018050191A1 (en) * | 2016-09-14 | 2018-03-22 | Aalborg Universitet | A human intention detection system for motion assistance |
Non-Patent Citations (3)
| Title |
|---|
| NAN LI ; SHOURONG WEI ; MINFENG WEI ; BO LIU ; HONG HUO ; LI JIANG: "Hand motion recognition based on pressure istribution maps and LS-SVM", 2014 INTERNATIONAL CONFERENCE ON MECHATRONICS AND CONTROL (ICMC), 5 July 2014 (2014-07-05), pages 1027 - 1030, XP033213954, DOI: 10.1109/ICMC.2014.7231709 * |
| See also references of EP3893814A4 * |
| XIAO ZHEN GANG; ELNADY AHMED M; MENON CARLO: "Control an exoskeleton for forear rotation using FMG", INTERNATIONAL CONFERENCE ON BIOMEDICAL ROBOTICS AND BIOMECHATRONICS (BIOROB), 15 August 2014 (2014-08-15), pages 591 - 596, XP032779736, ISSN: 2155-1774, DOI: 10.1109/BIOROB.2014.6913842 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20230263644A1 (en) * | 2020-06-30 | 2023-08-24 | Cyberdyne Inc. | Wearable hand-finger motion support apparatus |
| CN112603298A (zh) * | 2020-12-30 | 2021-04-06 | 杭州电子科技大学 | 多传感信息融合的卒中急性期患者手功能康复评估系统 |
| CN112603298B (zh) * | 2020-12-30 | 2023-05-05 | 杭州电子科技大学 | 多传感信息融合的卒中急性期患者手功能康复评估系统 |
| JP2022137943A (ja) * | 2021-03-09 | 2022-09-22 | 大王製紙株式会社 | 使い捨て着用物品におけるサイドシールの破りやすさ評価方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| US12090107B2 (en) | 2024-09-17 |
| SE1851567A1 (en) | 2020-06-13 |
| EP3893814A4 (en) | 2022-09-14 |
| JP2022513826A (ja) | 2022-02-09 |
| EP3893814A1 (en) | 2021-10-20 |
| US20220023133A1 (en) | 2022-01-27 |
| JP7450621B2 (ja) | 2024-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12090107B2 (en) | Control of an active orthotic device | |
| Peternel et al. | Adaptive control of exoskeleton robots for periodic assistive behaviours based on EMG feedback minimisation | |
| US20200268532A1 (en) | Multi-modal upper limb prosthetic device control using myoelectric signals | |
| Zhao et al. | Levenberg-Marquardt based neural network control for a five-fingered prosthetic hand | |
| US10543111B2 (en) | Biomimetic controller for increased dexterity prosthesis | |
| CN110072678A (zh) | 用于运动辅助的人类意图检测系统 | |
| Yap et al. | Design of a wearable FMG sensing system for user intent detection during hand rehabilitation with a soft robotic glove | |
| JP2022513826A5 (https=) | ||
| Xiao et al. | Control an exoskeleton for forearm rotation using FMG | |
| CN111565680B (zh) | 用于识别生物体信号所表示的信息的系统 | |
| Zhao et al. | A five-fingered underactuated prosthetic hand control scheme | |
| Singer et al. | Automatic support control of an upper body exoskeleton—Method and validation using the Stuttgart Exo-Jacket | |
| Afrin et al. | EMG-based hand gesture dataset to control electronic wheelchair for SCI patients | |
| Kim et al. | Tele-operation system with reliable grasping force estimation to compensate for the time-varying sEMG feature | |
| Sriram et al. | Slippage control for a smart prosthetic hand prototype via modified tactile sensory feedback | |
| Meattini et al. | A control architecture for grasp strength regulation in myocontrolled robotic hands using vibrotactile feedback: Preliminary results | |
| US20240293280A1 (en) | An orthosis device | |
| Fong et al. | Exploring the utility of crutch force sensors to predict user intent in assistive lower limb exoskeletons | |
| Kaneishi et al. | A sEMG classification framework with less training data | |
| Wang et al. | Task-oriented human-robot interaction control of a robotic glove utilizing forearm electromyography | |
| EP4422559A1 (en) | Method and system for controlling prosthetic device | |
| Yan et al. | Controlling a powered exoskeleton system via electromyographic signals | |
| Abdallah et al. | A new design of a bionic hand controlled by EMG signals: A preliminary study | |
| Sakthirajan | A Low-Cost Prosthetic Arm with Real-Time Haptic Feedback and Gesture Control for Enhanced User Autonomy | |
| Ritter et al. | Grip force dynamics during exoskeleton-assisted and virtual grasping |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19896860 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2021533708 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2019896860 Country of ref document: EP Effective date: 20210712 |
|
| WWW | Wipo information: withdrawn in national office |
Ref document number: 2019896860 Country of ref document: EP |