CN114129852A - VR (virtual reality) targeted training system for cognitive impairment - Google Patents
VR (virtual reality) targeted training system for cognitive impairment Download PDFInfo
- Publication number
- CN114129852A CN114129852A CN202111462457.0A CN202111462457A CN114129852A CN 114129852 A CN114129852 A CN 114129852A CN 202111462457 A CN202111462457 A CN 202111462457A CN 114129852 A CN114129852 A CN 114129852A
- Authority
- CN
- China
- Prior art keywords
- training
- processing module
- virtual
- positioning device
- game
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Anesthesiology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Hematology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Acoustics & Sound (AREA)
- General Health & Medical Sciences (AREA)
- Psychology (AREA)
- Veterinary Medicine (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Rehabilitation Tools (AREA)
Abstract
The invention relates to a VR (virtual reality) targeted training system for cognitive impairment, belonging to the technical field of medical instruments. The system comprises virtual picture display equipment, a central processing unit, a positioning device, position receiving equipment, input equipment and an application software system; the central processor is internally provided with an application software system; the virtual picture display equipment, the positioning device, the position receiving equipment and the input equipment are connected with the central processing unit; the application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit. By using VR technology as an effective tool for cognitive function training, the invention realizes early recognition, early diagnosis and early intervention of cognitive disorder, reduces and delays the occurrence rate of dementia, slows down the progress of cognitive disorder diseases, and promotes the maintenance and recovery of cognitive function of patients; by training in the high-simulation virtual environment, the limit on objective conditions such as manpower, time, place and the like is eliminated, and medical resources are saved.
Description
Technical Field
The invention relates to a VR (virtual reality) targeted training system for cognitive impairment, belonging to the technical field of medical instruments.
Background
Cognition is the process of acquiring knowledge or applying knowledge by converting external information received by human brain into internal psychological activity through processing treatment. It includes aspects of memory, language, visual space, execution, calculation, and understanding judgment. Cognitive impairment refers to impairment of one or more of the above cognitive functions, which may affect the social functioning and quality of life of the patient to varying degrees, and in severe cases even lead to death of the patient. Cognitive dysfunction can be caused by various reasons such as degenerative diseases of the nervous system, cardiovascular diseases, nutrient metabolism disorder, infection, trauma, tumor, drug abuse and the like. Cognitive training is to improve cognitive function and increase cognitive reserve through training of different cognitive domains and cognitive processes. The cognitive disorder has bidirectional conversion, the cognitive function of a patient in an early stage of the disease has plasticity, and the public carries out professional cognitive intervention training in the early stage of the cognitive disorder, so that the decline of the cognitive function and the development of behavior problems of the patient can be delayed, the basic cognitive function can be maintained in a longer life cycle, the life quality of the patient and a caregiver thereof can be maintained and improved, the family and social burden can be relieved, and the life quality can be improved. However, the current people engaged in rehabilitation therapy are seriously deficient, and the professional quality is not uniform, and the rehabilitation therapy resources are also not uniformly distributed. How to solve the severe situation of the huge gap of the social rehabilitation resources at present and how to match the direction of the advanced technology development of the state to assist the rehabilitation medical treatment by science and technology becomes an important subject facing the technical field at present. With the rapid development of sensor technology, wearable technology, robotics, human-computer interaction technology and 3D game animation technology, not only the technology is promoted, but also the economic popularity is achieved, and students engaged in medical rehabilitation related research and physicians or therapists at the first line of medical treatment all over the world try to utilize and integrate the technologies, take virtual reality technology as the theoretical basis, integrate design concepts centered on users (patients), and develop various diagnostic and therapeutic tools by using interaction modes and strategies provided by human-computer interfaces.
The development of computer technology and devices has facilitated the generation of virtual reality technology (VR), which can be applied as a computer-based new form of human-computer interaction to cognitive impairment diagnosis, prevention and cognitive function exercises. According to the invention, software is adopted to develop a VR target training task aiming at cognitive dysfunction by applying human-computer interaction, virtual reality, motion capture technology and 3D game animation technology, and a user trains cognitive functions such as orientation force, spatial capability, computational power and the like in an environment similar to reality; meanwhile, cognitive tasks with different difficulty degrees can be flexibly set, different task presentation modes in a virtual environment can be flexibly customized, and the standard and interestingness of cognitive ability training are improved. In addition, the task performance, such as the time for completing the task, the accuracy and the like, is fed back in real time after each training so as to encourage the user to continuously carry out the training task and improve the enthusiasm of the user for training.
Disclosure of Invention
The purpose of the present invention is to solve the technical problem of how to apply virtual reality technology (VR) to the treatment of cognitive disorders.
In order to solve the above problems, the technical solution of the present invention is to provide a VR targeted training system for cognitive impairment, which includes a virtual image display device, a central processing unit, a positioning device, a position receiving device, an input device, and an application software system; the central processor is internally provided with an application software system; the virtual picture display equipment, the positioning device, the position receiving equipment and the input equipment are connected with the central processing unit; the application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit.
Preferably, the central processing unit comprises a position processing module, an image processing module, a sound processing module, a control module and a data storage module; the position processing module, the image processing module and the sound processing module are connected with the control module, and the image processing module, the sound processing module and the position processing module are connected with the data storage module.
Preferably, the computational power training unit comprises an item price liquidation game; the directional force training unit comprises an object searching game and a visual reconstruction game; the memory training unit comprises a virtual ATM machine game; the visual space and directional force training unit comprises a jigsaw puzzle and a shelf fetching game.
Preferably, the virtual screen display device includes a display screen; the virtual picture display equipment, the central processor, the positioning device and the position receiving equipment are arranged in virtual reality head-mounted display equipment, namely VC head-mounted glasses.
Preferably, the input device includes an operation handle that transmits patient position information; a data transmission channel is arranged between the operating handle and the VC head glasses; the operating handle is provided with an operating button. The scene experienced by the patient in the virtual image and the experienced game realize the interaction with the virtual scene displayed by the VC head glasses through operating the operating buttons on the operating handle.
Preferably, the positioning device is arranged in the real space where the handle, the VC head display glasses and the patient are positioned; the positioning device transmits the position information of the VC head display glasses and the handle worn by the patient in the real space to the position processing module. By determining the spatial position of the patient and the spatial position of the operation handle in the hand of the patient in the real space, the position processing module integrates the position information into the virtual scene, so that the position change of the patient and the operation handle in the real environment is converted into the position change in the virtual scene; the patient is enabled to complete the game task in the virtual scene by changing his position, pointing to a specific direction through a handle or selecting the options given by the game through the buttons of the handle, etc.
Preferably, the positioning means comprises a plurality of laser positioners or ultrasonic positioners.
The invention provides an application of a VR (virtual reality) targeted training system for cognitive impairment in cognitive impairment rehabilitation training.
Compared with the prior art, the invention has the following beneficial effects:
by using VR technology as an effective tool for cognitive function training, the invention can realize early recognition, early diagnosis and early intervention of cognitive disorder, reduce and delay the incidence of cognitive disorder, help patients to remodel brain functions, slow down the progress of cognitive disorder diseases, promote the maintenance and recovery of cognitive functions of patients, and improve the self-care ability and the living ability of the cognitive disorder patients in China; the cognitive disorder VR targeted training system provided by the invention provides personalized and continuous rehabilitation and nursing services for cognitive disorder crowds, maintains and improves the cognitive function state of a patient to the maximum extent, relieves the burden of government, society and family care, and improves the life quality of the patient and family members.
The VR technology of the invention gets rid of the limitation of the traditional training mode on objective conditions such as manpower, time, place and the like through a high-simulation virtual environment, and the innovative cognitive training mode saves the labor cost of medical staff.
Drawings
FIG. 1 is a flow chart of the operation of a VR targeted training system for cognitive impairment of the present invention;
Detailed Description
In order to make the invention more comprehensible, preferred embodiments are described in detail below with reference to the accompanying drawings:
as shown in fig. 1, an object of the present invention is to solve a technical problem of how to apply virtual reality technology (VR) to the treatment of cognitive disorders. The technical scheme adopted by the invention is to provide a VR target training system for cognitive impairment, which comprises a virtual picture display device, a central processing unit, a positioning device, a position receiving device, an input device and an application software system; the central processor is internally provided with an application software system; the virtual picture display equipment, the positioning device, the position receiving equipment and the input equipment are connected with the central processing unit; the application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit. The central processing unit comprises a position processing module, an image processing module, a sound processing module, a control module and a data storage module; the position processing module, the image processing module and the sound processing module are connected with the control module, and the image processing module, the sound processing module and the position processing module are connected with the data storage module. The calculation force training unit comprises an item price liquidation game; the directional force training unit comprises an object searching game and a visual reconstruction game; the memory training unit comprises a virtual ATM machine game; the visual space and directional force training unit comprises a jigsaw game and a goods shelf fetching game. The virtual picture display device comprises a display screen; the virtual picture display device, the central processing unit, the positioning device and the position receiving device are integrated in a virtual reality head-mounted display device, namely VC head-mounted display glasses. The input device comprises an operating handle for transmitting the position information of the patient; a data transmission channel is arranged between the operating handle and the VC head glasses; the operating handle is provided with an operating button. The scene that the patient experiences in the virtual image, the game that experiences, through the operation button on the operation handle, realize the interdynamic with the virtual scene that VC head display glasses show. The positioning device is arranged in the real space where the handle, the VC head display glasses and the patient are positioned; the positioning device transmits the position information of the VC head display glasses and the handle worn by the patient in the real space to the position processing module. By determining the spatial position of the patient and the spatial position of the operation handle in the hand of the patient in the real space, the position processing module integrates the position information into the virtual scene, so that the position change of the patient and the operation handle in the real environment is converted into the position change in the virtual scene; the patient is enabled to complete the game task in the virtual scene by changing his position, pointing in a particular direction by the handle or selecting options given by the game by the handle buttons, etc. The positioning device comprises a plurality of laser positioners or ultrasonic positioners.
The software of the invention provides the target training based on task simulation aiming at the cognitive disorder patient; different environmental interferences can be provided through the setting combination of a plurality of environmental parameters; the feedback design of the user interface is adopted, on one hand, visual and sound prompts are provided to distract the user, and on the other hand, feedback is also provided to stimulate the user to continuously perform the training task; the invention provides the virtual environment of immersion and timely feedback, and increases the interest and playability of training.
The application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit. Wherein the directional force training unit comprises: completing 'clock finding game' and 'visual reconstruction game'; the memory training unit includes: completing a "virtual ATM machine" game; the visual space and executive force training unit comprises: completing the 'jigsaw puzzle' and 'goods shelf fetching' games; the computational force training unit comprises: completing 'price liquidation mini game'; the application software system also comprises a data collection and result feedback function: task performance data and location data are collected in real time. After each training, the task performance, such as the time for completing the task, the accuracy and the like, is fed back in real time so as to encourage the user to continuously carry out the training task and improve the enthusiasm of the user for training.
Directional force training unit: the directional force training unit is mainly divided into space directional force training and time directional force training. The spatial orientation force training is completed by a 'clock finding game', and the time orientation force training is completed by a 'visual reconstruction game'.
(1) Clock finding game
After the subject enters from the gate, the voice starts giving instructions, which may be left/right/straight going, for a total of 5 instructions, and finally ends up finding the clock.
(2) Vision reconstruction game
The clock in the simulated daily scene is used as a training task, and the body movement simulation clock is combined to perform interesting challenge, so that the cognitive function visual reconstruction clock game training is established.
A computational force training unit: including an item price clearing game. The user is asked to perform calculations based on the items on the picture in the virtual scene.
A memory training unit: a virtual ATM machine is set in the virtual scene. Aiming at the memory function in the cognitive function, the life situation of the simulated automatic teller machine is established, and the memory power of the patient is stimulated through sound, images and the like to evaluate the cognitive function. The virtual tasks include tasks of 'withdrawal of money', 'transfer of money' and 'inquiry'.
Visual space and orientation force training unit:
comprises (1) a jigsaw puzzle:
the user operates the handle to complete the jigsaw task within a limited time, and if the jigsaw is not completed within a time-out period, the task is regarded as failed. And recording the completion time and success of the task as a basis for evaluating the visual space and the execution force.
(2) Shelf fetching game
After the game is played, a user has a goods shelf in front of the game, and a shopping list and voice prompt appear at the same time. When the handle touches the article, the edge of the article is highlighted in yellow to indicate that the article is selected, and the detailed information of the article appears. After the article is highlighted, the trigger key is buckled to place the article into the shopping cart, if the article is correct, the sound prompt of successful purchase can appear, and the article purchased on the goods shelf can disappear. If the purchase is wrong, the goods do not disappear, and a voice prompt of the purchase error appears. After all the items on the list are purchased, the shopping cart list is automatically popped up. It is necessary to make a decision at the interface that when there is enough money to purchase the items of the cart, the puck key is pressed and the checkout can be successful. If not enough money is purchased, the user does not need to make a key reaction, and the game automatically ends after a certain time.
The use of the invention:
in a room or a specific area, a patient firstly installs an external positioning device at a specified position, opens the positioning device, wears the VC head display glasses, and opens the operating handle to finish the connection of the external positioning device and the operating handle; and starting the VC head display glasses, and enabling the patient to enter virtual scenes of all training units to finish all game tasks.
While the invention has been described with respect to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention. Those skilled in the art can make various changes, modifications and equivalent arrangements, which are equivalent to those of the embodiments of the present invention, without departing from the spirit and scope of the present invention, and which can be made by utilizing the technical content disclosed above; meanwhile, any changes, modifications and variations of the above-described embodiments, which are equivalent to those of the technical spirit of the present invention, are within the scope of the technical solution of the present invention.
Claims (8)
1. A VR target training system for cognitive impairment is characterized by comprising virtual picture display equipment, a central processing unit, a positioning device, position receiving equipment, input equipment and an application software system; the central processor is internally provided with an application software system; the virtual picture display equipment, the positioning device, the position receiving equipment and the input equipment are connected with the central processing unit; the application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit.
2. The VR targeted training system for cognitive impairment of claim 1, wherein the central processor comprises a location processing module, an image processing module, a sound processing module, a control module, and a data storage module; the position processing module, the image processing module and the sound processing module are connected with the control module, and the image processing module, the sound processing module and the position processing module are connected with the data storage module.
3. The VR targeted training system for cognitive impairment of claim 2, wherein the computational power training unit includes an item clearing game; the directional force training unit comprises an object searching game and a visual reconstruction game; the memory training unit comprises a virtual ATM machine game; the visual space and directional force training unit comprises a jigsaw puzzle and a shelf fetching game.
4. The VR targeted training system for cognitive impairment of claim 3, wherein the virtual screen display device includes a display screen; the virtual picture display equipment, the central processing unit, the positioning device and the position receiving equipment are arranged in virtual reality head-mounted display equipment, namely VC head-mounted display glasses.
5. The VR targeted training system of claim 4, wherein the input device includes an operating handle to transmit patient location information; a data transmission channel is arranged between the operating handle and the VC head glasses; the operating handle is provided with an operating button.
6. The VR targeted training system of claim 5, wherein the positioning device is disposed in a real space in which the handle, the VC head glasses and the patient are located; the positioning device transmits the position information of the VC head display glasses and the handle worn by the patient in the real space to the position processing module.
7. The VR targeted training system of claim 6, wherein the positioning device comprises a plurality of laser positioners or ultrasound positioners.
8. Use of the VR targeted training system for cognitive impairment of any one of claims 1 to 7 in cognitive impairment rehabilitation training.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111462457.0A CN114129852A (en) | 2021-12-02 | 2021-12-02 | VR (virtual reality) targeted training system for cognitive impairment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111462457.0A CN114129852A (en) | 2021-12-02 | 2021-12-02 | VR (virtual reality) targeted training system for cognitive impairment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114129852A true CN114129852A (en) | 2022-03-04 |
Family
ID=80387319
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111462457.0A Pending CN114129852A (en) | 2021-12-02 | 2021-12-02 | VR (virtual reality) targeted training system for cognitive impairment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114129852A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100805274B1 (en) * | 2007-01-16 | 2008-02-20 | 성신여자대학교 산학협력단 | Method for cognitive rehabilitation using games, recording medium thereof and apparatus for cognitive rehabilitation using games |
| US20120108909A1 (en) * | 2010-11-03 | 2012-05-03 | HeadRehab, LLC | Assessment and Rehabilitation of Cognitive and Motor Functions Using Virtual Reality |
| CN103268392A (en) * | 2013-04-15 | 2013-08-28 | 福建中医药大学 | Cognitive function training system for scene interaction and application method thereof |
| CN106821333A (en) * | 2017-03-21 | 2017-06-13 | 黑龙江尔惠科技有限公司 | A kind of cognition dysfunction rehabilitation detection means based on virtual scene, method and therapeutic equipment |
| US20180204480A1 (en) * | 2017-01-18 | 2018-07-19 | Chao-Wei CHEN | Cognitive training system |
| CN109324692A (en) * | 2018-11-30 | 2019-02-12 | 中山大学 | A kind of virtual reality method and system for attention deficit hyperactivity disorder detection |
| KR20200071305A (en) * | 2018-12-11 | 2020-06-19 | 주식회사 씨투몬스터 | Dementia patient training system applying interactive technology |
| CN113160930A (en) * | 2021-04-08 | 2021-07-23 | 广东省人民医院 | Diagnosis and rehabilitation system and method for Parkinson disease mild cognitive impairment based on VR |
-
2021
- 2021-12-02 CN CN202111462457.0A patent/CN114129852A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100805274B1 (en) * | 2007-01-16 | 2008-02-20 | 성신여자대학교 산학협력단 | Method for cognitive rehabilitation using games, recording medium thereof and apparatus for cognitive rehabilitation using games |
| US20120108909A1 (en) * | 2010-11-03 | 2012-05-03 | HeadRehab, LLC | Assessment and Rehabilitation of Cognitive and Motor Functions Using Virtual Reality |
| CN103268392A (en) * | 2013-04-15 | 2013-08-28 | 福建中医药大学 | Cognitive function training system for scene interaction and application method thereof |
| US20180204480A1 (en) * | 2017-01-18 | 2018-07-19 | Chao-Wei CHEN | Cognitive training system |
| CN106821333A (en) * | 2017-03-21 | 2017-06-13 | 黑龙江尔惠科技有限公司 | A kind of cognition dysfunction rehabilitation detection means based on virtual scene, method and therapeutic equipment |
| CN109324692A (en) * | 2018-11-30 | 2019-02-12 | 中山大学 | A kind of virtual reality method and system for attention deficit hyperactivity disorder detection |
| KR20200071305A (en) * | 2018-12-11 | 2020-06-19 | 주식회사 씨투몬스터 | Dementia patient training system applying interactive technology |
| CN113160930A (en) * | 2021-04-08 | 2021-07-23 | 广东省人民医院 | Diagnosis and rehabilitation system and method for Parkinson disease mild cognitive impairment based on VR |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107480462B (en) | Intelligent clinical interaction system | |
| Weiss et al. | Video capture virtual reality as a flexible and effective rehabilitation tool | |
| Veras et al. | Scoping review of outcome measures used in telerehabilitation and virtual reality for post-stroke rehabilitation | |
| JP2014529420A (en) | Non-invasive motion tracking system, apparatus and method for enhancing physical rehabilitation performed on a patient | |
| CN109273079A (en) | AI cloud diagnosis and therapy system based on Chinese medicine | |
| Elor et al. | Deep reinforcement learning in immersive virtual reality exergame for agent movement guidance | |
| Greenleaf | Developing the tools for practical VR applications [Medicine] | |
| Lange et al. | Leveraging unencumbered full body control of animated virtual characters for game-based rehabilitation | |
| TWI505228B (en) | A self-care system for assisting quantitative assessment of rehabilitation movement | |
| Metsis et al. | Computer aided rehabilitation for patients with rheumatoid arthritis | |
| Ghisio et al. | An open platform for full body interactive sonification exergames | |
| Kolivand et al. | Review on augmented reality technology | |
| Yeh et al. | Virtual reality for post-stroke shoulder-arm motor rehabilitation: Training system & assessment method | |
| Zhang | Virtual reality games based on brain computer interface | |
| CN114129852A (en) | VR (virtual reality) targeted training system for cognitive impairment | |
| Fraiwan et al. | Therapy central: On the development of computer games for physiotherapy | |
| CN113877157B (en) | Hand function rehabilitation system combining data glove and VR technology | |
| Chebaa et al. | Multimodal analysis of serious games for cognitive and physiological assessment | |
| Dingli et al. | Realtime adaptive virtual reality for pain reduction | |
| Bouatrous et al. | A new adaptive VR-based exergame for hand rehabilitation after stroke | |
| Fluet et al. | Basis and Clinical Evidence of Virtual Reality-Based Rehabilitation of Sensorimotor Impairments After Stroke | |
| Yeh et al. | A cloud-based tele-rehabilitation system for frozen shoulder | |
| Venugopalan et al. | MotionTalk: personalized home rehabilitation system for assisting patients with impaired mobility | |
| TWI777239B (en) | Limbs rehabilitation system | |
| SJ et al. | AR Using NUI Based Physical Therapy Rehabilitation Framework with Mobile Decision Support System: A Global Solution for Remote Assistance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |