CN113903424A - Virtual reality function rehabilitation training system - Google Patents
Virtual reality function rehabilitation training system Download PDFInfo
- Publication number
- CN113903424A CN113903424A CN202010572126.1A CN202010572126A CN113903424A CN 113903424 A CN113903424 A CN 113903424A CN 202010572126 A CN202010572126 A CN 202010572126A CN 113903424 A CN113903424 A CN 113903424A
- Authority
- CN
- China
- Prior art keywords
- rehabilitation
- virtual
- module
- scene
- training
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012549 training Methods 0.000 title claims abstract description 127
- 238000000034 method Methods 0.000 claims abstract description 40
- 230000008569 process Effects 0.000 claims abstract description 34
- 238000011156 evaluation Methods 0.000 claims abstract description 22
- 238000012545 processing Methods 0.000 claims abstract description 18
- 238000004364 calculation method Methods 0.000 claims abstract description 12
- 238000005094 computer simulation Methods 0.000 claims abstract description 5
- 230000006870 function Effects 0.000 claims description 18
- 230000003993 interaction Effects 0.000 claims description 17
- 238000004458 analytical method Methods 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 6
- 238000009877 rendering Methods 0.000 claims description 6
- 230000003287 optical effect Effects 0.000 claims description 5
- 238000013461 design Methods 0.000 claims description 4
- 238000007726 management method Methods 0.000 claims description 4
- 238000007781 pre-processing Methods 0.000 claims description 4
- 238000013500 data storage Methods 0.000 claims description 3
- 230000005484 gravity Effects 0.000 claims description 3
- 230000035807 sensation Effects 0.000 claims description 3
- 230000000875 corresponding effect Effects 0.000 description 20
- 238000005516 engineering process Methods 0.000 description 19
- 230000000694 effects Effects 0.000 description 9
- 210000004556 brain Anatomy 0.000 description 5
- 230000008859 change Effects 0.000 description 5
- 238000002560 therapeutic procedure Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000007654 immersion Methods 0.000 description 4
- 208000006011 Stroke Diseases 0.000 description 3
- 238000011960 computer-aided design Methods 0.000 description 3
- 239000000284 extract Substances 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 208000014644 Brain disease Diseases 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 210000001364 upper extremity Anatomy 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 206010019468 Hemiplegia Diseases 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 230000035622 drinking Effects 0.000 description 1
- 210000003414 extremity Anatomy 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003183 myoelectrical effect Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000009023 proprioceptive sensation Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000015541 sensory perception of touch Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001225 therapeutic effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biophysics (AREA)
- Physical Education & Sports Medicine (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Graphics (AREA)
- General Engineering & Computer Science (AREA)
- Epidemiology (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Primary Health Care (AREA)
- Public Health (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- Rehabilitation Tools (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a method comprising: the system comprises a brain-computer interface signal module, a virtual reality display module, a graphic calculation module, a rehabilitation scene generation module, a physical feedback module, a rehabilitation evaluation module and an avatar model library; the brain-computer interface signal module is used for acquiring parameters of a patient; the rehabilitation scene generation module is used for generating a virtual rehabilitation training scene corresponding to the real world; the virtual reality display module is used for carrying out 360-degree immersive scene display on the virtual rehabilitation training scene; the graph calculation module is used for processing and managing graph image data; the physical feedback module is used for simulating a physical process in rehabilitation and providing physical feedback; the rehabilitation evaluation module is used for collecting and analyzing parameters in the virtual training rehabilitation process to obtain corresponding report operation evaluation; the virtual image model library is used for managing the patient image model established by a computer modeling or three-dimensional reconstruction mode according to the layering model.
Description
Technical Field
The invention relates to the technical field of medical rehabilitation equipment, in particular to a virtual reality function rehabilitation training system.
Background
China is the country with the largest number of people and the largest market potential in the world at present. In recent years, the incidence of brain diseases such as stroke has been increasing with the progress of aging of the population. Hemiplegia caused by brain diseases and rehabilitation of limb functions are always one of the more troublesome problems in clinic. In view of this, it is of great significance to find an active and effective rehabilitation therapy means to improve the upper limb function of the hemiplegic patient.
The traditional rehabilitation therapy has a plurality of defects, for example, in the traditional exercise rehabilitation therapy, the treatment process is monotonous, and the patient is easy to lose interest in the treatment process; moreover, due to the particularity of the treatment site, patients usually need to train in a designated place, and the requirements of a large number of patients are not easily met; and the traditional rehabilitation training mode has no unified evaluation standard, the individual differences of the training mode, the training intensity and the training feedback cannot be reflected, and the rehabilitation effect of the patient is greatly reduced due to the difference between the training place and the daily life place.
Related researchers have explored virtual reality as a therapeutic tool for brain-injured people, and the fusion of virtual reality and brain-computer interface technology is expected to play an important role in brain rehabilitation. Typical foreign cases are: the VR nerve rehabilitation therapy system MindMotionPro introduced by MindMaze helps stroke patients recover the activities of upper limbs, stimulates the brains of the patients to do corresponding activities to the bodies through designed VR experiences, improves the perception of the patients through repeated training, but the system lacks a corresponding evaluation system and cannot store the information of the patients and establish an independent patient information database. The Infinadeck omnidirectional treadmill is combined with VR head-mounted equipment to be used for physical rehabilitation therapy, helps stroke patients to improve balance, reduces the falling times of Parkinson patients and the like, and the system lacks complete brain electrical signal input and is not suitable for patients with normal brain thinking but mobility disorder.
Although the current virtual reality technology can carry out real-time video and voice feedback on the rehabilitation effect of the patient, the method provides great encouragement and confidence for the patient. However, electroencephalogram signal acquisition is difficult to a certain extent, and training aiming at specific functional parts of a patient is lacked.
Disclosure of Invention
The invention provides a virtual reality function rehabilitation training system, which aims to solve the problems that the existing virtual reality rehabilitation training equipment lacks pertinence to patient training, cannot carry out effective evaluation and is poor in effect.
According to a first aspect of the present invention, there is provided a virtual reality functional rehabilitation training system, comprising: the system comprises a brain-computer interface signal module, a virtual reality display module, a graphic calculation module, a rehabilitation scene generation module, a physical feedback module, a rehabilitation evaluation module and an avatar model library; wherein,
the brain-computer interface signal module is used for acquiring and processing parameters of a patient in a virtual training rehabilitation process in real time; the rehabilitation scene generation module is used for rendering and constructing a virtual three-dimensional scene in real time according to different training parts or stages to generate a virtual rehabilitation training scene corresponding to the real world; the virtual reality display module is used for carrying out 360-degree immersive scene display on the virtual rehabilitation training scene; the graphic calculation module is used for processing and managing graphic image data in the virtual training rehabilitation process; the physical feedback module is used for simulating a physical process in rehabilitation and providing physical feedback for rehabilitation training; the rehabilitation evaluation module is used for collecting and analyzing parameters in the virtual training rehabilitation process to obtain corresponding report operation evaluation, and adjusting rehabilitation steps or contents of different patients according to individual differences to form a customized rehabilitation scheme; the virtual image model library is used for managing the patient image model established by a computer modeling or three-dimensional reconstruction mode according to a layering model.
Optionally, the brain-computer interface signal module includes an electroencephalogram acquisition device and an electroencephalogram signal processing device, the electroencephalogram acquisition device is used for acquiring electroencephalogram signals of a patient, and the electroencephalogram signal processing device is used for performing signal processing on the electroencephalogram signals to obtain parameters of the patient in a virtual training rehabilitation process.
Optionally, the physical process of the physical feedback module includes collision detection and gravity detection.
Optionally, the rehabilitation scene generation module further executes corresponding interaction and scene change on the virtual rehabilitation training scene according to the input parameters of the patient.
Optionally, the rehabilitation scene generation module further includes a checkpoint scenario design unit, configured to set different rehabilitation training difficulty modes for the virtual rehabilitation training scene according to different rehabilitation training contents required by different patients and different rehabilitation training schedules.
Optionally, the rehabilitation evaluation module further includes a rehabilitation data storage unit, configured to store current rehabilitation data for management and analysis of the rehabilitation data.
Optionally, the rehabilitation scene generation module performs data preprocessing, point cloud stitching and feature analysis by using the acquired three-dimensional data of the real rehabilitation scene to generate a virtual rehabilitation training scene corresponding to the real world.
Optionally, the virtual rehabilitation training scene rendered and constructed by the rehabilitation scene generation module includes: the shape, optical property, surface texture and roughness of the objects of the real rehabilitation scene, and the relative position and shielding relationship among the objects.
Optionally, the method further includes: and the tactile feedback module is connected with the rehabilitation scene generation module and used for simulating tactile sensation through a preset vibration contact so that the patient feels feedback of the virtual rehabilitation training scene.
Optionally, the method further includes: and the human-computer interaction module is used for performing voice input and recognition so as to control the rehabilitation scene generation module to generate corresponding virtual rehabilitation training scenes according to different training parts or stages.
The virtual reality function rehabilitation training system provided by the invention has the following beneficial effects:
the three-dimensional reconstruction technology is combined with the virtual reality technology, a virtual reality functional rehabilitation training environment is established, and high reduction of objects in a virtual world is achieved, so that the experience is more real;
according to different training parts or stages, a virtual rehabilitation training scene corresponding to the real world is generated, and adjustment and evaluation are performed according to current patient parameters, so that individuation and diversification of rehabilitation training are improved, and the rehabilitation of a patient is facilitated;
the patient can contact with the virtual object by using the tactile feedback technology, so that the feeling is real, the training is closer to reality, and the rehabilitation training effect of the system is further improved;
and by adopting various interaction technologies, better man-machine interaction is realized, and the diversity is better.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic diagram of a virtual reality functional rehabilitation training system according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a checkpoint scenario design unit in an embodiment of the present invention;
fig. 3 is a schematic diagram of a virtual reality functional rehabilitation training system according to another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The technical solution of the present invention will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.
Fig. 1 is a schematic structural diagram of a virtual reality function rehabilitation training system according to an embodiment of the present invention.
Referring to fig. 1, the virtual reality function rehabilitation training system provided in this embodiment includes: the system comprises a brain-computer interface signal module 10, a virtual reality display module 20, a graph calculation module 30, a rehabilitation scene generation module 40, a physical feedback module 50, a rehabilitation evaluation module 60 and an avatar model library 70. Wherein:
the brain-computer interface signal module 10 is used for collecting and processing parameters of the patient in the virtual training rehabilitation process in real time; the rehabilitation scene generation module 40 is used for rendering and constructing a virtual three-dimensional scene in real time according to different training parts or stages to generate a virtual rehabilitation training scene corresponding to the real world; the virtual reality display module 20 is used for carrying out 360-degree immersive scene display on the virtual rehabilitation training scene; the graphic calculation module 30 is used for processing and managing graphic image data in the virtual training rehabilitation process; the physical feedback module 50 is used for simulating a physical process in rehabilitation and providing physical feedback for rehabilitation training; the rehabilitation evaluation module 60 is used for collecting and analyzing parameters in the virtual training rehabilitation process, obtaining corresponding report operation evaluation, and adjusting rehabilitation steps or contents of different patients according to individual differences to form a customized rehabilitation scheme; the avatar model library 70 is used to manage the patient avatar models created by computer modeling or three-dimensional reconstruction in accordance with the hierarchical model.
When the system is used for rehabilitation training, a patient can perform guided daily life activity training, proprioception training, coordination training, virtual left and right hand and walking exercise training only by simply wearing the sensor of the brain-computer interface signal module 10, and the training modes are generated in advance by the rehabilitation scene generation module 40 and adjusted along with real-time parameters. The system enables a patient to interact with objects in a virtual environment with multiple sensory stimuli in a natural way, the training process is highly consistent, the patient can repeatedly observe simulated exercises according to the condition of the patient, and the action of a virtual trainer is more consistent than that of a human trainer. Furthermore, the system can reduce the risk caused by erroneous operation in a real environment.
Specifically, the brain-computer interface signal module 10 in this embodiment includes an electroencephalogram acquisition device and an electroencephalogram signal processing device, wherein the electroencephalogram acquisition device is mainly used for acquiring electroencephalograms of patients, and the electroencephalogram signal processing device is used for processing the acquired electroencephalograms, so as to obtain parameters of the patients in the virtual training rehabilitation process. The patient parameter herein mainly refers to the brain-machine signal input of the patient, which is used as the medical rehabilitation feedback. The system acquires the electroencephalogram signals of the patient in real time in the rehabilitation training process, obtains the timely feedback of the condition of the patient, and is more favorable for the follow-up adjustment of the rehabilitation scene and the rehabilitation evaluation of the patient.
The virtual reality display module 20 of this embodiment is mainly composed of a virtual display head display device, and performs 360-degree immersive scene display on a virtual rehabilitation training scene through virtual display, so as to provide a training scene as real as possible for a patient. Just because the virtual environment in the system has high similarity with the real world, the motor skills learned in the virtual environment can be better migrated to the real environment in the subsequent rehabilitation training of the patient.
The graphic calculation module 30 of the present embodiment is composed of a high performance computer, and is configured to process and manage graphic image data in the virtual training rehabilitation process, and the graphic calculation module 30 provides the processing result to the rehabilitation scene generation module 40, so that the virtual training scene generation module generates and adjusts the virtual rehabilitation training scene, and provides the virtual reality display module 20 for display. For example, the graphic calculation module 30 extracts the shape, optical properties, surface texture, roughness, and relative position and occlusion relationship between objects of the real rehabilitation scene during the rehabilitation training process according to the pre-collected graphic image data, and provides the shape, optical properties, surface texture, roughness, and occlusion relationship to the rehabilitation scene generation module 40.
The rehabilitation scene generation module 40 of this embodiment performs data preprocessing, point cloud stitching, and feature analysis using the acquired three-dimensional data of the real rehabilitation scene to generate a virtual rehabilitation training scene corresponding to the real world. The dynamic environment modeling technology is mainly adopted, the three-dimensional reconstruction technology is combined with the virtual reality technology, the acquired three-dimensional data of the real rehabilitation scene is utilized to carry out data preprocessing, point cloud splicing and characteristic analysis, the high restoration of objects in the virtual world is realized, and the experience of a patient is more real. The three-dimensional data is acquired mainly by using a CAD (computer-aided design) technology (a regular environment), more environments are acquired by using a non-contact visual modeling technology, and the data acquisition efficiency can be effectively improved by organically combining the CAD technology and the non-contact visual modeling technology.
Further, the rendering the constructed virtual rehabilitation training scene by the rehabilitation scene generation module 40 includes: the shape, optical property, surface texture and roughness of the objects of the real rehabilitation scene, and the relative position and shielding relationship among the objects. The rehabilitation scene generation module 40 extracts various detailed characteristics of the object of the real rehabilitation scene according to the result of the realistic real-time rendering processing performed by the graphic calculation module 30 on the data of the real rehabilitation scene, and then renders and constructs a virtual rehabilitation training scene corresponding to the real world, so that the virtual rehabilitation training scene is as vivid as possible, the patient has a feeling of being personally on the scene, and the experience degree of rehabilitation training is improved.
The rehabilitation scene generation module 40 also performs corresponding interaction and scene change on the virtual rehabilitation training scene according to the input parameters of the patient. When the patient uses the system, the patient can operate the login system to start rehabilitation training after wearing the electroencephalogram acquisition equipment. During training, the function or the part needing rehabilitation can be selected according to the requirement, and the rehabilitation scene generation module 40 generates a training scene to enter a corresponding mode. Before entering the corresponding training mode, the system can introduce the content contained in the training scene in the modes of animation, characters, voice and the like. After the patient starts training, the electroencephalogram acquisition equipment can acquire electroencephalogram signals of the patient in real time, and the rehabilitation scene generation module 40 executes corresponding interaction and/or scene change functions on the virtual rehabilitation training scene according to the electroencephalogram signals and relevant parameters, so that interaction and personalized setting of the virtual rehabilitation training scene and the patient are realized.
The rehabilitation scene generation module 40 further includes a checkpoint scenario design unit, which is used for setting different rehabilitation training difficulty modes for the virtual rehabilitation training scene according to the different rehabilitation training contents required by different patients and the difference of rehabilitation training progress. As shown in fig. 2, the rehabilitation training difficulty mode provided by this embodiment includes three types, i.e., low difficulty training, medium difficulty training, and high difficulty training. For example, low difficulty hand raising, fist making, water drinking training; grabbing and receiving training with medium difficulty; high difficulty in jigsaw puzzle, game training, etc. The rehabilitation scenario generating module 40 may record the training levels with different difficulty levels for evaluation, and perform corresponding rehabilitation training difficulty mode adjustment according to the training level completion degree and the current parameters of the patient. The difficulty is encouraged or automatically adjusted/improved according to the corresponding prompt of the current completion condition of the patient, and the participation achievement feeling of the patient is improved so as to adjust the rehabilitation progress timely.
The physical feedback module 50 in this embodiment mainly simulates a physical process of the rehabilitation training performed by the patient, and appropriately adjusts the rehabilitation scenario generated by the rehabilitation scenario generation module 40 according to a simulation result. The physical processes herein include collision detection, gravity detection, and the like. Physical feedback can be provided for rehabilitation training through simulation, and therefore reality experience of the rehabilitation process of the patient is further improved.
The rehabilitation evaluation module 60 also includes a rehabilitation data storage unit for storing the current rehabilitation data for management analysis of the rehabilitation data. In addition, the rehabilitation evaluation module 60 also performs management analysis according to the stored completion degree for different rehabilitation training modes. For example, when the patient completes rehabilitation, the current rehabilitation data is stored in the server and is managed and analyzed together with the previous rehabilitation information. The user can conveniently extract the change condition of the patient in the rehabilitation period, and the professional or doctor can conveniently adjust the rehabilitation content for the patient.
In addition, the virtual image model library 70 mainly includes different images of men, women, old and young, and the patient image models established by computer modeling or three-dimensional reconstruction, and the models are managed according to a hierarchical model. The individual image model generated by the virtual image model library 70 can make the rehabilitation scene generated by the rehabilitation scene generation module 40 more targeted to different types of patients, and further improve the diversity and adaptability of the system rehabilitation training scene.
Preferably, referring to fig. 3, the virtual reality function rehabilitation training system provided in this embodiment further includes: and the tactile feedback module 80 is connected with the rehabilitation scene generating module 40, and is used for simulating tactile sensation through a preset vibration contact point so that the patient feels feedback of the virtual rehabilitation training scene. In particular, the haptic feedback module 80 is configured as a glove or shoe with vibrating contacts, simulating the sense of touch by mounting the vibratable contacts on a layer of the glove or shoe. These vibratable contacts are communicatively coupled to the rehabilitation scene generation module 40 to communicate a vibration feedback signal. The rehabilitation scene generating module 40 controls the vibration of the touch points and receives a feedback signal from the touch points. Thus, in the virtual environment, people can experience the feeling of being in direct contact with the virtual object and feeling the real world, thereby generating the feeling of being as if they are in the real world. The tactile feedback module 80 of the system is suitable for patients who have no barrier to electroencephalogram signal transmission, have partial sensing ability on hands and feet, but cannot realize complete control on own bodies. The functions of the virtual reality function rehabilitation training system are further enriched.
Further, referring to fig. 3 again, the virtual reality function rehabilitation training system provided in this embodiment further includes: and the human-computer interaction module 90 is used for performing voice input and recognition so as to control the rehabilitation scene generation module to generate corresponding virtual rehabilitation training scenes according to different training parts or stages. The man-machine interaction module can specifically include the following traditional ones: the system comprises a mouse, a keyboard, a receiver, a camera and other signal input devices, and further comprises a display screen, a loudspeaker and other traditional output devices, and further comprises a digital helmet, a digital glove and other complex sensor devices for acquiring and feeding back electroencephalogram signals and action signals. Human-computer interaction is carried out by combining technologies such as a three-dimensional interaction technology, voice and/or video recognition, voice and/or video input and the like, so that the interaction efficiency in the rehabilitation training process is improved. The head-mounted display equipment is adopted, and sensors such as electroencephalogram signal acquisition equipment are arranged, so that man-machine interaction is realized.
In summary, the virtual reality function rehabilitation training system provided by the invention utilizes the three-dimensional reconstruction technology to perform panoramic imaging of the virtual reality during rehabilitation training, so as to realize rehabilitation in the same virtual environment as the real world. The system can effectively improve the participation of the patient, can actively induce the patient to perform motor imagery through elaborately designing the interactive content of the patient in the virtual world, and improves the quality and the power of rehabilitation training. Most of the existing rehabilitation systems in the current market are not brain rehabilitation training based on brain-computer interface signal input, do not have the capability of natural rehabilitation interaction in an immersive virtual space, and compared with virtual reality, the immersion degree is influenced. Virtual reality rehabilitation system technology pairs such as table one:
| model number | The invention | Anokan-VR | BioMaste | MindMotion |
| Interaction | Brain-machine connection | 3D sensor | Myoelectric sensing | 3D sensor |
| Display device | Virtual cash | Flat panel display | Flat panel display | Flat panel display |
| Rehabilitation | ≥4 | 4 | 3 | 1 |
| Rehabilitation | Is provided with | Is provided with | Is free of | Is free of |
| Tactile sense | Is provided with | Is provided with | Is provided with | Is provided with |
Meanwhile, a rehabilitation evaluation module capable of performing virtual rehabilitation effect feedback is introduced into the system, the rehabilitation training effect of the patient is fed back in real time through data acquisition, storage and analysis in the rehabilitation training process of the patient, and different targeted rehabilitation schemes can be provided according to the existing effect. Meanwhile, a patient information database can be established, the patient information is stored, an independent patient information database is established, and data support is provided for subsequent rehabilitation of the patient.
The system of the invention applies a plurality of computer technologies, is an application which integrates technologies such as simulation, interface, reality, sensor and the like, and has 3I characteristics: interactivity (interactivity), immersion (immergence), and imagination (imagination). The interactivity enables the experience of the experiencer in the virtual environment to be not passive experience generated by applying the given stimulation, but to interact with the system, so that the change of experience content and form is changed; the immersion enables the experiencer to be in a virtual environment, but has the feeling of immersion as in a real environment; imagination means that the system has certain functional direction while designing a virtual environment, so that a richer virtual training scene is provided.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A virtual reality functional rehabilitation training system, comprising: the system comprises a brain-computer interface signal module, a virtual reality display module, a graphic calculation module, a rehabilitation scene generation module, a physical feedback module, a rehabilitation evaluation module and an avatar model library; wherein,
the brain-computer interface signal module is used for acquiring and processing parameters of a patient in a virtual training rehabilitation process in real time; the rehabilitation scene generation module is used for rendering and constructing a virtual three-dimensional scene in real time according to different training parts or stages to generate a virtual rehabilitation training scene corresponding to the real world; the virtual reality display module is used for carrying out 360-degree immersive scene display on the virtual rehabilitation training scene; the graphic calculation module is used for processing and managing graphic image data in the virtual training rehabilitation process; the physical feedback module is used for simulating a physical process in rehabilitation and providing physical feedback for rehabilitation training; the rehabilitation evaluation module is used for collecting and analyzing parameters in the virtual training rehabilitation process to obtain corresponding report operation evaluation, and adjusting rehabilitation steps or contents of different patients according to individual differences to form a customized rehabilitation scheme; the virtual image model library is used for managing the patient image model established by a computer modeling or three-dimensional reconstruction mode according to a layering model.
2. The virtual reality functional rehabilitation training system of claim 1, wherein the brain-computer interface signal module comprises an electroencephalogram acquisition device and an electroencephalogram signal processing device, the electroencephalogram acquisition device is used for acquiring electroencephalogram signals of the patient, and the electroencephalogram signal processing device is used for processing the electroencephalogram signals to obtain parameters of the patient in the process of virtual training rehabilitation.
3. The virtual reality functional rehabilitation training system of claim 1, wherein the physical processes of the physical feedback module include collision detection and gravity detection.
4. The virtual reality function rehabilitation training system of claim 1, wherein the rehabilitation scenario generation module further performs corresponding interactions and scenario changes on the virtual rehabilitation training scenario according to the input patient parameters.
5. The virtual reality function rehabilitation training system of claim 1, wherein the rehabilitation scene generation module further comprises a checkpoint scenario design unit for setting different rehabilitation training difficulty modes for the virtual rehabilitation training scene according to different rehabilitation training contents required by different patients and different rehabilitation training progress.
6. The virtual reality functional rehabilitation training system of claim 1, wherein the rehabilitation assessment module further comprises a rehabilitation data storage unit for storing current rehabilitation data for management analysis of rehabilitation data.
7. The virtual reality functional rehabilitation training system of claim 1, wherein the rehabilitation scene generation module performs data preprocessing, point cloud stitching and feature analysis by using the acquired three-dimensional data of the real rehabilitation scene to generate a virtual rehabilitation training scene corresponding to the real world.
8. The virtual reality function rehabilitation training system of claim 1 or 7, wherein the rehabilitation scene generation module rendering the constructed virtual rehabilitation training scene comprises: the shape, optical property, surface texture and roughness of the objects of the real rehabilitation scene, and the relative position and shielding relationship among the objects.
9. The virtual reality functional rehabilitation training system of claim 1, further comprising: and the tactile feedback module is connected with the rehabilitation scene generation module and used for simulating tactile sensation through a preset vibration contact so that the patient feels feedback of the virtual rehabilitation training scene.
10. The virtual reality functional rehabilitation training system of claim 1, further comprising: and the human-computer interaction module is used for performing voice input and recognition so as to control the rehabilitation scene generation module to generate corresponding virtual rehabilitation training scenes according to different training parts or stages.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010572126.1A CN113903424A (en) | 2020-06-22 | 2020-06-22 | Virtual reality function rehabilitation training system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010572126.1A CN113903424A (en) | 2020-06-22 | 2020-06-22 | Virtual reality function rehabilitation training system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113903424A true CN113903424A (en) | 2022-01-07 |
Family
ID=79186335
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010572126.1A Pending CN113903424A (en) | 2020-06-22 | 2020-06-22 | Virtual reality function rehabilitation training system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113903424A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115083563A (en) * | 2022-05-30 | 2022-09-20 | 邹虹 | Multi-sense-organ immersion interactive virtual reality rehabilitation training method |
| CN117747062A (en) * | 2023-09-22 | 2024-03-22 | 中央美术学院 | Cognitive training system based on VR maze |
| CN118131914A (en) * | 2024-05-06 | 2024-06-04 | 深圳旭宏医疗科技有限公司 | Control system and equipment based on VR |
-
2020
- 2020-06-22 CN CN202010572126.1A patent/CN113903424A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115083563A (en) * | 2022-05-30 | 2022-09-20 | 邹虹 | Multi-sense-organ immersion interactive virtual reality rehabilitation training method |
| CN117747062A (en) * | 2023-09-22 | 2024-03-22 | 中央美术学院 | Cognitive training system based on VR maze |
| CN117747062B (en) * | 2023-09-22 | 2024-09-20 | 中央美术学院 | Cognitive training system based on VR maze |
| CN118131914A (en) * | 2024-05-06 | 2024-06-04 | 深圳旭宏医疗科技有限公司 | Control system and equipment based on VR |
| CN118131914B (en) * | 2024-05-06 | 2024-07-19 | 深圳旭宏医疗科技有限公司 | Control system and equipment based on VR |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Genay et al. | Being an avatar “for real”: a survey on virtual embodiment in augmented reality | |
| Kim | A SWOT analysis of the field of virtual reality rehabilitation and therapy | |
| Borghese et al. | Computational intelligence and game design for effective at-home stroke rehabilitation | |
| Wang et al. | Survey of movement reproduction in immersive virtual rehabilitation | |
| CN111063416A (en) | Alzheimer disease rehabilitation training and capability assessment system based on virtual reality | |
| US20100261530A1 (en) | Game controller simulating parts of the human anatomy | |
| US10729877B2 (en) | Treatment of phantom limb syndrome and other sequelae of physical injury | |
| CN113903424A (en) | Virtual reality function rehabilitation training system | |
| CN108140421A (en) | Training | |
| US20200168311A1 (en) | Methods and systems of embodiment training in a virtual-reality environment | |
| Smys | Virtual reality gaming technology for mental stimulation and therapy | |
| Sherstyuk et al. | Mixed reality manikins for medical education | |
| Yan | Construction and Application of Virtual Reality‐Based Sports Rehabilitation Training Program | |
| CN113035000A (en) | Virtual reality training system for central integrated rehabilitation therapy technology | |
| Bahirat et al. | Using Mr. MAPP for lower limb phantom pain management | |
| Bahirat et al. | Mr. mapp: Mixed reality for managing phantom pain | |
| CN207886596U (en) | A kind of VR rehabilitation systems based on mirror neuron | |
| Rodríguez et al. | Gamification and Virtual Reality for Tongue Rehabilitation | |
| US11436806B1 (en) | Dual perspective rendering in virtual reality | |
| Han et al. | Ai-based next-generation sensors for enhanced rehabilitation monitoring and analysis | |
| JP7112077B2 (en) | CONTROLLER, CONTROLLER MANUFACTURING METHOD, SIMULATED EXPERIENCE SYSTEM, AND SIMULATED EXPERIENCE METHOD | |
| Yeh et al. | A cloud-based tele-rehabilitation system for frozen shoulder | |
| Yu et al. | Mobile VR game design for stroke rehabilitation | |
| JP7445933B2 (en) | Information processing device, information processing method, and information processing program | |
| CN109420235A (en) | A kind of virtual reality depressurized system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20220107 |
|
| WD01 | Invention patent application deemed withdrawn after publication |