CN117672452A - Analysis and control system for human gait by brain-computer interface technology in virtual environment - Google Patents

Analysis and control system for human gait by brain-computer interface technology in virtual environment Download PDF

Info

Publication number
CN117672452A
CN117672452A CN202211005870.9A CN202211005870A CN117672452A CN 117672452 A CN117672452 A CN 117672452A CN 202211005870 A CN202211005870 A CN 202211005870A CN 117672452 A CN117672452 A CN 117672452A
Authority
CN
China
Prior art keywords
module
analysis
brain
patient
virtual environment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211005870.9A
Other languages
Chinese (zh)
Inventor
张海峰
张海燕
赵绍晴
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Haitian Intelligent Engineering Co ltd
Original Assignee
Shandong Haitian Intelligent Engineering Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Haitian Intelligent Engineering Co ltd filed Critical Shandong Haitian Intelligent Engineering Co ltd
Priority to CN202211005870.9A priority Critical patent/CN117672452A/en
Publication of CN117672452A publication Critical patent/CN117672452A/en
Pending legal-status Critical Current

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Rehabilitation Tools (AREA)

Abstract

The utility model discloses an analysis and control system for human gait of brain-computer interface technology in a virtual environment, which comprises a brain-computer interface module, a rehabilitation robot module, a sensor module, a camera module, a virtual environment module and a servo control module which are all electrically connected with an analysis host, wherein the servo control module is electrically connected with a treadmill module; the analysis host computer is used for analyzing the information of the brain-computer interface module, the sensor module and the camera module, controlling the rehabilitation robot module and the running machine module to run according to the analysis result, generating an analysis report, and controlling the virtual environment module to display the virtual environment information. The camera module can shoot the gait of the patient from multiple angles, and meanwhile, the gait of the patient is comprehensively analyzed through software in the host by combining the data of the sensor module, so that the problems and the rehabilitation condition of the patient are judged; the lower limbs of the patient are supported by the rehabilitation robot, so that the patient can perform rehabilitation exercise under the real condition.

Description

Analysis and control system for human gait by brain-computer interface technology in virtual environment
Technical Field
The utility model relates to the technical field of rehabilitation instruments, in particular to an analysis and control system for human gait in a virtual environment by brain-computer interface technology.
Background
Along with the development of society and the continuous improvement of the level of life and the material condition of people, people also pay more and more attention to the health of themselves and families. Some patients can walk normally through a series of rehabilitation exercises due to trauma, cardiovascular and cerebrovascular diseases or long bedridden time. The traditional rehabilitation process is realized by nurses or families supporting the patients to move downwards, but the method consumes energy and physical strength, can not take correct rehabilitation training postures, has poor rehabilitation effect, and can not timely analyze the rehabilitation condition of the patients to adjust in time. At present, equipment for such rehabilitation also appears, for example, chinese patent application publication No. CN209347037U discloses a multifunctional somatosensory gait analysis training system which comprises a comprehensive evaluation analysis module, a medical bidirectional jogging platform, a top rail weight reduction module, a gait balance analysis module, a scene interaction and posture training module and a surface myoelectricity analysis module which are connected with the comprehensive evaluation analysis module; however, this apparatus is not supported on the legs of the patient, and the running machine is controlled by frequency conversion, which is inconvenient for the patient, for example, the patient who can take one step for a long time is not friendly.
Disclosure of Invention
The utility model provides an analysis and control system for human gait of brain-computer interface technology in a virtual environment, which aims to make up the defects of the prior art.
The utility model is realized by the following technical scheme:
the brain-computer interface technology is used for analyzing and controlling human gait in a virtual environment, and comprises a brain-computer interface module, a rehabilitation robot module, a sensor module, a camera module, a virtual environment module and a servo control module which are all electrically connected with an analysis host, wherein the servo control module is electrically connected with a running machine module; the brain-computer interface module is worn on the head of the patient and used for acquiring brain-computer signals of the patient; the rehabilitation robot module is worn on the lower limb of the patient and is used for receiving an action instruction sent by the analysis host according to the brain electrical signal of the patient and driving the lower limb of the patient to move or moving along the limb of the patient according to the instruction sent by the analysis host; the camera module is used for shooting the gait of the patient from a plurality of angles and transmitting the gait back to the analysis host, the virtual environment module is used for providing a virtual environment for the patient, and the servo control module is used for receiving the instruction of the analysis host and controlling the running machine to run; the sensor module is used for monitoring foot sole pressure, shoulder tension and acceleration data of legs of a patient in the rehabilitation process and sending the foot sole pressure, shoulder tension and acceleration data to the analysis host; the analysis host analyzes the information of the brain-computer interface module, the sensor module and the camera module, controls the rehabilitation robot module and the running machine module to operate according to analysis results, generates an analysis report, and is also used for controlling the virtual environment module to display virtual environment information.
The running machine module comprises a running machine provided with a rear vertical frame and a front vertical frame, two second cross beams are arranged between the rear vertical frame and the front vertical frame, a tension sensor is fixedly arranged on each second cross beam, and the tension sensor is connected with a waistcoat through a pull rope.
The rehabilitation robot module consists of a hip joint exoskeleton, a thigh exoskeleton, a shank exoskeleton, an ankle joint exoskeleton and a sole exoskeleton, wherein acceleration sensors are installed on the thigh exoskeleton, the shank exoskeleton and the ankle joint exoskeleton, and sole pressure sensors are installed on the sole exoskeleton.
The camera module comprises a first camera fixedly mounted on the support, and the first camera is opposite to the running machine.
The camera module comprises a second camera installed on the rear vertical frame and a third camera installed on the front vertical frame.
The second camera and the third camera are installed in a central symmetry mode.
The analysis host computer comprises a display, a mouse, a keyboard and a printer which are electrically connected with the workstation.
The analysis host computer is also used for carrying out mode selection, wherein the mode selection comprises an active rehabilitation mode and a passive rehabilitation mode.
The utility model has the following technical effects:
the camera module can shoot the gait of the patient from multiple angles, and simultaneously combines the sole pressure data, the acceleration speed sensor data and the tension sensor data on the rehabilitation robot, and comprehensively analyzes the gait of the patient through the host to judge the problems and the rehabilitation condition of the patient; the lower limbs of the patient are supported by the rehabilitation robot, so that the patient can perform rehabilitation movement under the real condition; the camera module is connected with the running machine module, and the host machine analyzes leg movements of patients shot by the camera and sends control commands to the servo control module to control running of the running machine, so that the running machine module can adapt to the requirements of patients in different conditions; the brain-computer interface module and the rehabilitation robot can be used for assisting a patient in rehabilitation exercise.
Drawings
The utility model is further described below with reference to the accompanying drawings.
Fig. 1 is a schematic structural view of the present utility model.
Fig. 2 is a schematic structural view of the treadmill module and the rehabilitation robot module.
In the figure, the device comprises a 1-running machine, a 2-handrail, a 3-rear vertical frame, a 4-sole exoskeleton, a 5-thigh exoskeleton, a 6-hip exoskeleton, a 7-front vertical frame, an 8-bracket, a 9-first beam, a 10-first camera, a 11-display screen, a 12-second beam, a 13-stay rope, a 14-waistcoat and a 15-second camera.
Detailed Description
The following is only a specific embodiment of the present utility model, but the scope of the present utility model is not limited thereto, and any changes or substitutions easily contemplated by those skilled in the art within the technical scope of the present utility model should be included in the scope of the present utility model.
Words describing the directional relationship of "front", "rear", "inner", "outer", etc. in the present utility model are merely for convenience of description of the embodiments, and are not to be construed as limiting the utility model. The terms "first," "second," and the like are used merely to distinguish between descriptions and are not to be construed as indicating or implying relative importance. The fixed connection mode comprises, but is not limited to, welding, screwing, clamping, interference fit and integrated forming.
Fig. 1 and 2 illustrate an embodiment of the present utility model. The embodiment provides an analysis and control system for human gait by brain-computer interface technology under a virtual environment, which comprises a brain-computer interface module, a rehabilitation robot module, a sensor module, a camera module, a virtual environment module and a servo control module which are all electrically connected with an analysis host, wherein the servo control module is electrically connected with a treadmill module.
The brain-computer interface module is worn on the head of the patient and used for acquiring brain-computer signals of the patient and sending the brain-computer signals to the analysis host;
the rehabilitation robot module is worn on the lower limb of a patient, can support the patient, can receive an action instruction sent by an analysis host according to the brain electrical signal of the patient, drives the lower limb of the patient to move, and can also move along with the limb of the patient according to the instruction sent by the analysis host.
The camera module is used for shooting the gait of the patient from a plurality of angles and sending the shot image information to the analysis host.
The virtual environment module is used for providing a virtual environment for a patient.
The servo control module is used for receiving the instruction of the analysis host computer and controlling the running machine to run.
The analysis host analyzes the information of the brain-computer interface module, the sensor module and the camera module, controls the rehabilitation robot module and the running machine module to operate according to the analysis result, and generates an analysis report through the analysis of the acquired data; and the virtual environment module is also used for controlling the virtual environment module to display the virtual environment information.
The sensor module comprises a tension sensor, a pressure sensor and an acceleration sensor, and is used for monitoring data such as sole pressure, shoulder tension, acceleration of legs and the like of a patient in the rehabilitation process and sending the data to the analysis host.
The analysis host comprises a display, a mouse, a keyboard and a printer, wherein the display, the mouse, the keyboard and the printer are electrically connected with the workstation, the workstation is used for data analysis, automatic instruction generation and the like, the display is used for displaying information needed to be seen by medical staff, the mouse and the keyboard are used for inputting manual commands such as parameter setting, mode selection and the like, and the printer is used for printing paper analysis reports. The mode selection includes an active rehabilitation mode and a passive rehabilitation mode.
As shown in fig. 2, the running machine module comprises a running machine 1, a gantry-shaped rear vertical frame 3 and a front vertical frame 7 are fixedly arranged on the running machine 1, two second cross beams 12 are arranged between the rear vertical frame 3 and the front vertical frame 7, two ends of each second cross beam 12 are fixedly connected with the tops of the rear vertical frame 3 and the front vertical frame 7 respectively, and a gap is reserved between the two second cross beams 12. And the two second cross beams 12 are fixedly provided with tension sensors, the tension sensors are connected with the waistcoat 14 through stay ropes 13, and the connection points of the stay ropes 13 of the two tension sensors and the waistcoat 14 are respectively positioned at the left shoulder and the right shoulder of the waistcoat. The waistcoat 14 is worn on the patient and is fixed to the patient by being matched with the stay cord 13.
Handrails 2 are also installed on two sides of the running machine 1.
The rehabilitation robot module consists of a hip joint exoskeleton 6, a thigh exoskeleton 5, a shank exoskeleton, an ankle joint exoskeleton and a sole exoskeleton 4; acceleration sensors are mounted on the thigh exoskeleton 5, the shank exoskeleton, and the ankle exoskeleton, and sole pressure sensors are mounted on the sole exoskeleton 4. The acceleration sensor is used for detecting the movement condition of each part of the patient when the legs move, the sole pressure sensor is used for sensing the pressure change of each part of the sole when the legs move, and the change of the center of gravity of the sole is analyzed.
The sole pressure sensor is also matched with the tension sensor, and the analysis host analyzes the change of the gravity center of the human body in the movement process through the data analysis of the sole pressure sensor and the tension sensor; the analysis host computer also can analyze the skew of patient's backbone and whole upper body in the motion process through the data analysis tension sensor, is convenient for discover patient's joint or the problem that exists and correct in time.
The virtual environment module comprises a support 8, the support 8 is positioned right in front of the running machine, a display screen 11 is arranged at the top of the support, and the display screen 11 can display virtual environment information or the action of rehabilitation training, so that a patient can conveniently follow the exercise.
The camera module comprises a first camera 10 fixedly mounted on the support 8, the first camera 10 facing the treadmill, i.e. facing the patient, for taking gait video of the patient from the front. And also comprises a second camera 15 mounted on the rear vertical frame 3 and a third camera mounted on the front vertical frame 7. The second camera 15 and the third camera are installed in a central symmetry mode. Namely, the second camera 15 photographs the patient from the rear left, and the third camera photographs the patient from the front right; or the second camera 15 shoots the patient from the left front, the third camera shoots the patient from the right rear, and the three groups of cameras shoot from different angles, so that gait information of different angles of the patient is acquired, and the analysis is more accurate.
The support 8 in this embodiment may be fixedly mounted on the running machine 1 or may be separate. The first camera 10 in this embodiment is mounted on the first cross member 9 of the bracket 8 and is located below the display screen 11.
When the active rehabilitation mode is selected, the patient does not need to wear the brain-computer interface module, and the rehabilitation robot automatically follows the leg movements of the patient. The patient can follow the action on the display screen and also can walk by oneself, and when the patient walks, the camera module can catch patient's shank action, and analysis host computer analysis gait judges stride frequency automatically regulated treadmill's functioning speed.
When the passive rehabilitation mode is selected, the patient needs to wear the brain-computer interface module. The brain-computer interface module acquires relevant brain-computer signals according to prompts of the display screen, sends the relevant brain-computer signals to the analysis host, the analysis host judges the action corresponding to the signals through analysis of the brain-computer signals, then converts the action into a computer action command, then sends the action command to the rehabilitation robot, and the rehabilitation robot drives the lower limbs of the patient to complete the action. The camera captures the action of the lower limbs of the patient and sends the action to the analysis host computer, and the running speed of the running machine is automatically adjusted by judging the stride frequency.
In the rehabilitation process, the camera captures the leg movements of a patient, the acceleration sensor is used for detecting the movement conditions of all parts of the patient when the legs move, the sole pressure sensor is used for sensing the pressure changes of all parts of the sole when the legs move, the tension sensor is used for sensing the movement of the shoulders of the patient when the patient moves, the analysis host analyzes the change of the center of gravity of the sole, the change of the center of gravity of the human body, the gait and the like according to the data, and gives an analysis report.

Claims (8)

1. A brain-computer interface technology is to analysis, control system of human gait under the virtual environment, characterized by that: the device comprises a brain-computer interface module, a rehabilitation robot module, a sensor module, a camera module, a virtual environment module and a servo control module which are all electrically connected with an analysis host, wherein the servo control module is electrically connected with a treadmill module; the brain-computer interface module is worn on the head of the patient and used for acquiring brain-computer signals of the patient; the rehabilitation robot module is worn on the lower limb of the patient and is used for receiving an action instruction sent by the analysis host according to the brain electrical signal of the patient and driving the lower limb of the patient to move or moving along the limb of the patient according to the instruction sent by the analysis host; the camera module is used for shooting the gait of the patient from a plurality of angles and transmitting the gait back to the analysis host, the virtual environment module is used for providing a virtual environment for the patient, and the servo control module is used for receiving the instruction of the analysis host and controlling the running machine to run; the sensor module is used for monitoring foot sole pressure, shoulder tension and acceleration data of legs of a patient in the rehabilitation process and sending the foot sole pressure, shoulder tension and acceleration data to the analysis host; the analysis host analyzes the information of the brain-computer interface module, the sensor module and the camera module, controls the rehabilitation robot module and the running machine module to operate according to analysis results, generates an analysis report, and is also used for controlling the virtual environment module to display virtual environment information.
2. The brain-computer interface technology according to claim 1, wherein the human gait analysis and control system in the virtual environment is characterized in that: the running machine module comprises a running machine (1) provided with a rear vertical frame (3) and a front vertical frame (7), two second cross beams (12) are arranged between the rear vertical frame (3) and the front vertical frame (7), a tension sensor is fixedly arranged on each second cross beam (12), and the tension sensor is connected with a waistcoat (14) through a pull rope (13).
3. The brain-computer interface technology according to claim 1, wherein the human gait analysis and control system in the virtual environment is characterized in that: the rehabilitation robot module consists of a hip joint exoskeleton (6), a thigh exoskeleton (5), a shank exoskeleton, an ankle joint exoskeleton and a sole exoskeleton (4), wherein acceleration sensors are arranged on the thigh exoskeleton (5), the shank exoskeleton and the ankle joint exoskeleton, and sole pressure sensors are arranged on the sole exoskeleton (4).
4. The brain-computer interface technology according to claim 2, wherein the human gait analysis and control system in the virtual environment is characterized in that: the camera module comprises a first camera (10) fixedly installed on the support (8), and the first camera (10) is opposite to the running machine.
5. The brain-computer interface technology according to claim 4, wherein the human gait analysis and control system in the virtual environment is characterized in that: the camera module comprises a second camera (15) arranged on the rear vertical frame (3) and a third camera arranged on the front vertical frame (7).
6. The brain-computer interface technology according to claim 5, wherein the human gait analysis and control system in the virtual environment is characterized in that: the second camera (15) and the third camera are installed in a central symmetry mode.
7. The brain-computer interface technology according to any one of claims 1 to 6, wherein the human gait analysis and control system in the virtual environment is characterized in that: the analysis host computer comprises a display, a mouse, a keyboard and a printer which are electrically connected with the workstation.
8. The brain-computer interface technology according to any one of claims 1 to 6, wherein the human gait analysis and control system in the virtual environment is characterized in that: the analysis host computer is also used for carrying out mode selection, wherein the mode selection comprises an active rehabilitation mode and a passive rehabilitation mode.
CN202211005870.9A 2022-08-22 2022-08-22 Analysis and control system for human gait by brain-computer interface technology in virtual environment Pending CN117672452A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211005870.9A CN117672452A (en) 2022-08-22 2022-08-22 Analysis and control system for human gait by brain-computer interface technology in virtual environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211005870.9A CN117672452A (en) 2022-08-22 2022-08-22 Analysis and control system for human gait by brain-computer interface technology in virtual environment

Publications (1)

Publication Number Publication Date
CN117672452A true CN117672452A (en) 2024-03-08

Family

ID=90070076

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211005870.9A Pending CN117672452A (en) 2022-08-22 2022-08-22 Analysis and control system for human gait by brain-computer interface technology in virtual environment

Country Status (1)

Country Link
CN (1) CN117672452A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109199786A (en) * 2018-07-26 2019-01-15 北京机械设备研究所 A kind of lower limb rehabilitation robot based on two-way neural interface
CN114366556A (en) * 2021-12-31 2022-04-19 华南理工大学 Multi-mode training control system and method for lower limb rehabilitation
WO2024011958A1 (en) * 2022-07-14 2024-01-18 香港理工大学 Control method, device, and system for rehabilitation training

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109199786A (en) * 2018-07-26 2019-01-15 北京机械设备研究所 A kind of lower limb rehabilitation robot based on two-way neural interface
CN114366556A (en) * 2021-12-31 2022-04-19 华南理工大学 Multi-mode training control system and method for lower limb rehabilitation
WO2024011958A1 (en) * 2022-07-14 2024-01-18 香港理工大学 Control method, device, and system for rehabilitation training

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
岳海波;: "步态康复训练机器人研究现状与趋势", 科技展望, no. 19, 10 July 2017 (2017-07-10) *
许彧青;: "助行康复机器人人机交互设计研究综述", 包装工程, no. 08, 20 April 2020 (2020-04-20) *

Similar Documents

Publication Publication Date Title
US11521107B2 (en) Learning system, rehabilitation support system, method, program, and trained model
CN110279557A (en) A kind of lower limb rehabilitation robot control system and control method
CN112657127B (en) Intelligent treadmill for rehabilitation training
US11521511B2 (en) Processing system, walking training system, processing method, and program
CN112137846B (en) Learning system, walking training system, method, program, and learning-completed model
US20240188848A1 (en) Learning system, walking training system, method, program, and trained model
US11996001B2 (en) Motion support system, action support method, program, learning apparatus, trained model, and learning method
TWI397408B (en) Physiological signal measurement and oxygen concentration compensation of the sports training system
JP2018139975A (en) Walking training device, walking diagnostic device, body weight relieving device, walking training method, and walking diagnostic method
CN112137836B (en) Learning system, rehabilitation support system, method, program, and learning completion model
CN112137832B (en) Learning system, rehabilitation support system, method, program, and learning completion model
US11937918B2 (en) Learning system, walking training system, method, program, and trained model
CN112137839B (en) Learning system, walking training method, program, and learning-completed model
CN117672452A (en) Analysis and control system for human gait by brain-computer interface technology in virtual environment
US20200410341A1 (en) Learning system, rehabilitation support system, method, program, and trained model
US11210966B2 (en) Rehabilitation support system, rehabilitation support method, and rehabilitation support program
TWI814682B (en) Intellectual analysis system for high jump skill
JP2019115540A (en) Symmetric motion support system
CN112137835B (en) Learning system, rehabilitation support system, method, program, and learning completion model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination