CN116650183A - Method for controlling artificial limb or other equipment by using eye-closing action image - Google Patents

Method for controlling artificial limb or other equipment by using eye-closing action image Download PDF

Info

Publication number
CN116650183A
CN116650183A CN202310518134.1A CN202310518134A CN116650183A CN 116650183 A CN116650183 A CN 116650183A CN 202310518134 A CN202310518134 A CN 202310518134A CN 116650183 A CN116650183 A CN 116650183A
Authority
CN
China
Prior art keywords
eye
equipment
artificial limb
closing action
signals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310518134.1A
Other languages
Chinese (zh)
Inventor
罗永昭
姚峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Kesheng Prostheses Co ltd
Original Assignee
Shanghai Kesheng Prostheses Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Kesheng Prostheses Co ltd filed Critical Shanghai Kesheng Prostheses Co ltd
Priority to CN202310518134.1A priority Critical patent/CN116650183A/en
Publication of CN116650183A publication Critical patent/CN116650183A/en
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50—Prostheses not implantable in the body
    • A61F2/68—Operating or control means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50—Prostheses not implantable in the body
    • A61F2/54—Artificial arms or hands or parts thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50—Prostheses not implantable in the body
    • A61F2/54—Artificial arms or hands or parts thereof
    • A61F2/58—Elbows; Wrists ; Other joints; Hands
    • A61F2/582—Elbow joints
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50—Prostheses not implantable in the body
    • A61F2/54—Artificial arms or hands or parts thereof
    • A61F2/58—Elbows; Wrists ; Other joints; Hands
    • A61F2/583—Hands; Wrist joints
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50—Prostheses not implantable in the body
    • A61F2/54—Artificial arms or hands or parts thereof
    • A61F2/58—Elbows; Wrists ; Other joints; Hands
    • A61F2/583—Hands; Wrist joints
    • A61F2/585—Wrist joints
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F2/00—Filters implantable into blood vessels; Prostheses, i.e. artificial substitutes or replacements for parts of the body; Appliances for connecting them with the body; Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents
    • A61F2/50—Prostheses not implantable in the body
    • A61F2/68—Operating or control means
    • A61F2002/6827—Feedback system for providing user sensation, e.g. by force, contact or position

Landscapes

  • Health & Medical Sciences (AREA)
  • Transplantation (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Vascular Medicine (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Cardiology (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

A method for controlling artificial limb or other equipment by using eye-closing action image includes such steps as using a miniature camera installed on head to shoot two eye video signals, or using two miniature cameras to shoot left and right eye video signals, respectively, inputting them into intelligent image recognition microprocessor installed on head, recognizing eye-closing action signals of two eyes, filtering out blink signals, and forming control signal code after recognition for controlling artificial limb or other equipment.

Description

Method for controlling artificial limb or other equipment by using eye-closing action image
Technical Field
The invention belongs to the field of prostheses in the field of rehabilitation appliances.
Background
At present, the amputee uses the residual limb electromyographic signals to control the artificial limb is the most effective method, but the high-level amputee loses most of the muscles of the arm, the electromyographic signals cannot be led out, and the residual limb subcutaneous fat of the amputee is too thick to prevent the electromyographic signals from being led out from the skin surface.
Disclosure of Invention
The control of human eyes and faces is very quick and flexible, 3 control signal codes can be generated by actively closing left eye, closing right eye and closing both eyes, and in addition, the continuous times of closing eyes with different time periods can form more control signal codes for controlling artificial limbs and other devices. The active closing of the monocular and the rapid short closing of the both eyes has little influence on the vision, so the practicality is very strong. The control signal may also be generated with a particular facial expression that is least commonly used for video recognition.
The method is that a miniature camera installed on the head is used for shooting the two-eye video signals, or two miniature cameras are used for shooting the left and right eye video signals respectively, these signals are input into an intelligent image recognition microprocessor installed on the head, the eye closing action signals of the two eyes are recognized, blink signals are filtered, and after recognition, control signal codes are formed for controlling artificial limbs and other equipment.
The control signal code is sent to the artificial limb or other equipment by Bluetooth, the action of the artificial limb or other equipment is controlled, and the microprocessor is powered by a chargeable battery.
The miniature camera can be arranged on the hat brim or the handle end of the head band extending out of the forehead, and also can be arranged on the glasses frame.
Drawings
FIG. 1 is a schematic diagram of a method of controlling a prosthesis or other device using an eye-closure motion image in accordance with the present invention
1: control cap
2: cap peak
3: miniature camera
4: intelligent image recognition microprocessor
5: rechargeable battery
6: user' s
7: electric false arm
8: control system
Description of the embodiments
The following is a practical implementation example of , see fig. 1, a control cap 1 is worn on the head of a user 6, a miniature camera 3 is installed at the front edge of a cap peak 2 of the control cap 1, two-eye videos are shot, a video signal is input into an intelligent image recognition microprocessor 4 in the control cap 1, two-eye closed-eye action signals are recognized, blink signals are filtered, a control signal code is formed after recognition, bluetooth is sent to a control system 8 of an electric prosthetic arm 7, the electric prosthetic arm 7 has three degrees of freedom of a hand, a wrist and an elbow, one action of one joint is controlled in real time by closing one eye, for example, the left-eye closed-eye control prosthetic elbow is opened, the elbow bending action stops, the joint is kept at the position, the left-eye is further bent, if the right-eye is closed, the right-eye is bent, a cutting-cut signal (11) is generated to control the next joint, and the wrist and the three joints of the prosthetic arm are controlled by switching in a circle. The control cap 1 is powered by a rechargeable battery 5.
In this specification, the invention has been described with reference to specific embodiments thereof. It will be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.

Claims (1)

1. A method for controlling artificial limb or other equipment by using eye-closing action image is characterized by that a miniature camera head mounted on the head is used for shooting two-eye video signals or two miniature camera heads are used for respectively shooting left and right eye video signals, these signals are inputted into intelligent image identification microprocessor mounted on the head to identify eye-closing action signal of two eyes, and filter out blink signal, after identification a control signal code is formed for controlling artificial limb or other equipment.
CN202310518134.1A 2023-05-10 2023-05-10 Method for controlling artificial limb or other equipment by using eye-closing action image Pending CN116650183A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310518134.1A CN116650183A (en) 2023-05-10 2023-05-10 Method for controlling artificial limb or other equipment by using eye-closing action image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310518134.1A CN116650183A (en) 2023-05-10 2023-05-10 Method for controlling artificial limb or other equipment by using eye-closing action image

Publications (1)

Publication Number Publication Date
CN116650183A true CN116650183A (en) 2023-08-29

Family

ID=87719781

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310518134.1A Pending CN116650183A (en) 2023-05-10 2023-05-10 Method for controlling artificial limb or other equipment by using eye-closing action image

Country Status (1)

Country Link
CN (1) CN116650183A (en)

Similar Documents

Publication Publication Date Title
US10076425B2 (en) Control of limb device
Hashimoto et al. Development of the face robot SAYA for rich facial expressions
KR101511427B1 (en) A treatment device for hemiplegia
CN111281762A (en) Vision rehabilitation training method and system
CN102871784A (en) Positioning controlling apparatus and method
CN108646915B (en) Method and system for controlling mechanical arm to grab object by combining three-dimensional sight tracking and brain-computer interface
CN104997582B (en) Device and method for controlling intelligent artificial limb based on eye and lower jaw electromyographic signals
Penaloza et al. Towards intelligent brain-controlled body augmentation robotic limbs
CN110262074B (en) Intelligent eye protection instrument
CN108124468A (en) A kind of head-mounted display apparatus and its adjusting method
CN116650183A (en) Method for controlling artificial limb or other equipment by using eye-closing action image
Shi et al. A novel method of combining computer vision, eye-tracking, EMG, and IMU to control dexterous prosthetic hand
Boschmann et al. A novel immersive augmented reality system for prosthesis training and assessment
Buckley et al. Sensor suites for assistive arm prosthetics
Seo et al. EMG-based prosthetic hand control system inspired by missing-hand movement
Liu et al. A novel sEMG control-based variable stiffness exoskeleton
CN114732577A (en) Artificial hand control system and method based on camera and electromyographic signals
Kozaki et al. A facial wearable robot with eyelid gating mechanism for supporting eye blink
Segas et al. Intuitive movement-based prosthesis control enables arm amputees to reach naturally in virtual reality
CN115153983B (en) Smart artificial hand control system, device, method and storage medium based on machine vision and eye tracking
CN210444402U (en) Vision auxiliary tool
CN111374677A (en) Apparatus and method for recognizing head motion
CN106236062B (en) A kind of police equipment of real-time monitoring policeman vital sign and field conditions on duty
CN110308794A (en) There are two types of the virtual implementing helmet of display pattern and the control methods of display pattern for tool
CN108769661A (en) The 3D rendering video system taken exercise for vision restoration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination