CN114129852A - VR (virtual reality) targeted training system for cognitive impairment - Google Patents

VR (virtual reality) targeted training system for cognitive impairment Download PDF

Info

Publication number
CN114129852A
CN114129852A CN202111462457.0A CN202111462457A CN114129852A CN 114129852 A CN114129852 A CN 114129852A CN 202111462457 A CN202111462457 A CN 202111462457A CN 114129852 A CN114129852 A CN 114129852A
Authority
CN
China
Prior art keywords
training
processing module
virtual
positioning device
game
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111462457.0A
Other languages
Chinese (zh)
Inventor
顾艳荭
洪洋
韩晓洁
曹健敏
盛英
岳莺
朱金芬
汪亚男
仇如霞
谢传桃
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FIFTH PEOPLE'S HOSPITAL OF SHANGHAI
Original Assignee
FIFTH PEOPLE'S HOSPITAL OF SHANGHAI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FIFTH PEOPLE'S HOSPITAL OF SHANGHAI filed Critical FIFTH PEOPLE'S HOSPITAL OF SHANGHAI
Priority to CN202111462457.0A priority Critical patent/CN114129852A/en
Publication of CN114129852A publication Critical patent/CN114129852A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Anesthesiology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Hematology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Acoustics & Sound (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychology (AREA)
  • Veterinary Medicine (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Rehabilitation Tools (AREA)

Abstract

The invention relates to a VR (virtual reality) targeted training system for cognitive impairment, belonging to the technical field of medical instruments. The system comprises virtual picture display equipment, a central processing unit, a positioning device, position receiving equipment, input equipment and an application software system; the central processor is internally provided with an application software system; the virtual picture display equipment, the positioning device, the position receiving equipment and the input equipment are connected with the central processing unit; the application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit. By using VR technology as an effective tool for cognitive function training, the invention realizes early recognition, early diagnosis and early intervention of cognitive disorder, reduces and delays the occurrence rate of dementia, slows down the progress of cognitive disorder diseases, and promotes the maintenance and recovery of cognitive function of patients; by training in the high-simulation virtual environment, the limit on objective conditions such as manpower, time, place and the like is eliminated, and medical resources are saved.

Description

VR (virtual reality) targeted training system for cognitive impairment
Technical Field
The invention relates to a VR (virtual reality) targeted training system for cognitive impairment, belonging to the technical field of medical instruments.
Background
Cognition is the process of acquiring knowledge or applying knowledge by converting external information received by human brain into internal psychological activity through processing treatment. It includes aspects of memory, language, visual space, execution, calculation, and understanding judgment. Cognitive impairment refers to impairment of one or more of the above cognitive functions, which may affect the social functioning and quality of life of the patient to varying degrees, and in severe cases even lead to death of the patient. Cognitive dysfunction can be caused by various reasons such as degenerative diseases of the nervous system, cardiovascular diseases, nutrient metabolism disorder, infection, trauma, tumor, drug abuse and the like. Cognitive training is to improve cognitive function and increase cognitive reserve through training of different cognitive domains and cognitive processes. The cognitive disorder has bidirectional conversion, the cognitive function of a patient in an early stage of the disease has plasticity, and the public carries out professional cognitive intervention training in the early stage of the cognitive disorder, so that the decline of the cognitive function and the development of behavior problems of the patient can be delayed, the basic cognitive function can be maintained in a longer life cycle, the life quality of the patient and a caregiver thereof can be maintained and improved, the family and social burden can be relieved, and the life quality can be improved. However, the current people engaged in rehabilitation therapy are seriously deficient, and the professional quality is not uniform, and the rehabilitation therapy resources are also not uniformly distributed. How to solve the severe situation of the huge gap of the social rehabilitation resources at present and how to match the direction of the advanced technology development of the state to assist the rehabilitation medical treatment by science and technology becomes an important subject facing the technical field at present. With the rapid development of sensor technology, wearable technology, robotics, human-computer interaction technology and 3D game animation technology, not only the technology is promoted, but also the economic popularity is achieved, and students engaged in medical rehabilitation related research and physicians or therapists at the first line of medical treatment all over the world try to utilize and integrate the technologies, take virtual reality technology as the theoretical basis, integrate design concepts centered on users (patients), and develop various diagnostic and therapeutic tools by using interaction modes and strategies provided by human-computer interfaces.
The development of computer technology and devices has facilitated the generation of virtual reality technology (VR), which can be applied as a computer-based new form of human-computer interaction to cognitive impairment diagnosis, prevention and cognitive function exercises. According to the invention, software is adopted to develop a VR target training task aiming at cognitive dysfunction by applying human-computer interaction, virtual reality, motion capture technology and 3D game animation technology, and a user trains cognitive functions such as orientation force, spatial capability, computational power and the like in an environment similar to reality; meanwhile, cognitive tasks with different difficulty degrees can be flexibly set, different task presentation modes in a virtual environment can be flexibly customized, and the standard and interestingness of cognitive ability training are improved. In addition, the task performance, such as the time for completing the task, the accuracy and the like, is fed back in real time after each training so as to encourage the user to continuously carry out the training task and improve the enthusiasm of the user for training.
Disclosure of Invention
The purpose of the present invention is to solve the technical problem of how to apply virtual reality technology (VR) to the treatment of cognitive disorders.
In order to solve the above problems, the technical solution of the present invention is to provide a VR targeted training system for cognitive impairment, which includes a virtual image display device, a central processing unit, a positioning device, a position receiving device, an input device, and an application software system; the central processor is internally provided with an application software system; the virtual picture display equipment, the positioning device, the position receiving equipment and the input equipment are connected with the central processing unit; the application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit.
Preferably, the central processing unit comprises a position processing module, an image processing module, a sound processing module, a control module and a data storage module; the position processing module, the image processing module and the sound processing module are connected with the control module, and the image processing module, the sound processing module and the position processing module are connected with the data storage module.
Preferably, the computational power training unit comprises an item price liquidation game; the directional force training unit comprises an object searching game and a visual reconstruction game; the memory training unit comprises a virtual ATM machine game; the visual space and directional force training unit comprises a jigsaw puzzle and a shelf fetching game.
Preferably, the virtual screen display device includes a display screen; the virtual picture display equipment, the central processor, the positioning device and the position receiving equipment are arranged in virtual reality head-mounted display equipment, namely VC head-mounted glasses.
Preferably, the input device includes an operation handle that transmits patient position information; a data transmission channel is arranged between the operating handle and the VC head glasses; the operating handle is provided with an operating button. The scene experienced by the patient in the virtual image and the experienced game realize the interaction with the virtual scene displayed by the VC head glasses through operating the operating buttons on the operating handle.
Preferably, the positioning device is arranged in the real space where the handle, the VC head display glasses and the patient are positioned; the positioning device transmits the position information of the VC head display glasses and the handle worn by the patient in the real space to the position processing module. By determining the spatial position of the patient and the spatial position of the operation handle in the hand of the patient in the real space, the position processing module integrates the position information into the virtual scene, so that the position change of the patient and the operation handle in the real environment is converted into the position change in the virtual scene; the patient is enabled to complete the game task in the virtual scene by changing his position, pointing to a specific direction through a handle or selecting the options given by the game through the buttons of the handle, etc.
Preferably, the positioning means comprises a plurality of laser positioners or ultrasonic positioners.
The invention provides an application of a VR (virtual reality) targeted training system for cognitive impairment in cognitive impairment rehabilitation training.
Compared with the prior art, the invention has the following beneficial effects:
by using VR technology as an effective tool for cognitive function training, the invention can realize early recognition, early diagnosis and early intervention of cognitive disorder, reduce and delay the incidence of cognitive disorder, help patients to remodel brain functions, slow down the progress of cognitive disorder diseases, promote the maintenance and recovery of cognitive functions of patients, and improve the self-care ability and the living ability of the cognitive disorder patients in China; the cognitive disorder VR targeted training system provided by the invention provides personalized and continuous rehabilitation and nursing services for cognitive disorder crowds, maintains and improves the cognitive function state of a patient to the maximum extent, relieves the burden of government, society and family care, and improves the life quality of the patient and family members.
The VR technology of the invention gets rid of the limitation of the traditional training mode on objective conditions such as manpower, time, place and the like through a high-simulation virtual environment, and the innovative cognitive training mode saves the labor cost of medical staff.
Drawings
FIG. 1 is a flow chart of the operation of a VR targeted training system for cognitive impairment of the present invention;
Detailed Description
In order to make the invention more comprehensible, preferred embodiments are described in detail below with reference to the accompanying drawings:
as shown in fig. 1, an object of the present invention is to solve a technical problem of how to apply virtual reality technology (VR) to the treatment of cognitive disorders. The technical scheme adopted by the invention is to provide a VR target training system for cognitive impairment, which comprises a virtual picture display device, a central processing unit, a positioning device, a position receiving device, an input device and an application software system; the central processor is internally provided with an application software system; the virtual picture display equipment, the positioning device, the position receiving equipment and the input equipment are connected with the central processing unit; the application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit. The central processing unit comprises a position processing module, an image processing module, a sound processing module, a control module and a data storage module; the position processing module, the image processing module and the sound processing module are connected with the control module, and the image processing module, the sound processing module and the position processing module are connected with the data storage module. The calculation force training unit comprises an item price liquidation game; the directional force training unit comprises an object searching game and a visual reconstruction game; the memory training unit comprises a virtual ATM machine game; the visual space and directional force training unit comprises a jigsaw game and a goods shelf fetching game. The virtual picture display device comprises a display screen; the virtual picture display device, the central processing unit, the positioning device and the position receiving device are integrated in a virtual reality head-mounted display device, namely VC head-mounted display glasses. The input device comprises an operating handle for transmitting the position information of the patient; a data transmission channel is arranged between the operating handle and the VC head glasses; the operating handle is provided with an operating button. The scene that the patient experiences in the virtual image, the game that experiences, through the operation button on the operation handle, realize the interdynamic with the virtual scene that VC head display glasses show. The positioning device is arranged in the real space where the handle, the VC head display glasses and the patient are positioned; the positioning device transmits the position information of the VC head display glasses and the handle worn by the patient in the real space to the position processing module. By determining the spatial position of the patient and the spatial position of the operation handle in the hand of the patient in the real space, the position processing module integrates the position information into the virtual scene, so that the position change of the patient and the operation handle in the real environment is converted into the position change in the virtual scene; the patient is enabled to complete the game task in the virtual scene by changing his position, pointing in a particular direction by the handle or selecting options given by the game by the handle buttons, etc. The positioning device comprises a plurality of laser positioners or ultrasonic positioners.
The software of the invention provides the target training based on task simulation aiming at the cognitive disorder patient; different environmental interferences can be provided through the setting combination of a plurality of environmental parameters; the feedback design of the user interface is adopted, on one hand, visual and sound prompts are provided to distract the user, and on the other hand, feedback is also provided to stimulate the user to continuously perform the training task; the invention provides the virtual environment of immersion and timely feedback, and increases the interest and playability of training.
The application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit. Wherein the directional force training unit comprises: completing 'clock finding game' and 'visual reconstruction game'; the memory training unit includes: completing a "virtual ATM machine" game; the visual space and executive force training unit comprises: completing the 'jigsaw puzzle' and 'goods shelf fetching' games; the computational force training unit comprises: completing 'price liquidation mini game'; the application software system also comprises a data collection and result feedback function: task performance data and location data are collected in real time. After each training, the task performance, such as the time for completing the task, the accuracy and the like, is fed back in real time so as to encourage the user to continuously carry out the training task and improve the enthusiasm of the user for training.
Directional force training unit: the directional force training unit is mainly divided into space directional force training and time directional force training. The spatial orientation force training is completed by a 'clock finding game', and the time orientation force training is completed by a 'visual reconstruction game'.
(1) Clock finding game
After the subject enters from the gate, the voice starts giving instructions, which may be left/right/straight going, for a total of 5 instructions, and finally ends up finding the clock.
(2) Vision reconstruction game
The clock in the simulated daily scene is used as a training task, and the body movement simulation clock is combined to perform interesting challenge, so that the cognitive function visual reconstruction clock game training is established.
A computational force training unit: including an item price clearing game. The user is asked to perform calculations based on the items on the picture in the virtual scene.
A memory training unit: a virtual ATM machine is set in the virtual scene. Aiming at the memory function in the cognitive function, the life situation of the simulated automatic teller machine is established, and the memory power of the patient is stimulated through sound, images and the like to evaluate the cognitive function. The virtual tasks include tasks of 'withdrawal of money', 'transfer of money' and 'inquiry'.
Visual space and orientation force training unit:
comprises (1) a jigsaw puzzle:
the user operates the handle to complete the jigsaw task within a limited time, and if the jigsaw is not completed within a time-out period, the task is regarded as failed. And recording the completion time and success of the task as a basis for evaluating the visual space and the execution force.
(2) Shelf fetching game
After the game is played, a user has a goods shelf in front of the game, and a shopping list and voice prompt appear at the same time. When the handle touches the article, the edge of the article is highlighted in yellow to indicate that the article is selected, and the detailed information of the article appears. After the article is highlighted, the trigger key is buckled to place the article into the shopping cart, if the article is correct, the sound prompt of successful purchase can appear, and the article purchased on the goods shelf can disappear. If the purchase is wrong, the goods do not disappear, and a voice prompt of the purchase error appears. After all the items on the list are purchased, the shopping cart list is automatically popped up. It is necessary to make a decision at the interface that when there is enough money to purchase the items of the cart, the puck key is pressed and the checkout can be successful. If not enough money is purchased, the user does not need to make a key reaction, and the game automatically ends after a certain time.
The use of the invention:
in a room or a specific area, a patient firstly installs an external positioning device at a specified position, opens the positioning device, wears the VC head display glasses, and opens the operating handle to finish the connection of the external positioning device and the operating handle; and starting the VC head display glasses, and enabling the patient to enter virtual scenes of all training units to finish all game tasks.
While the invention has been described with respect to a preferred embodiment, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention. Those skilled in the art can make various changes, modifications and equivalent arrangements, which are equivalent to those of the embodiments of the present invention, without departing from the spirit and scope of the present invention, and which can be made by utilizing the technical content disclosed above; meanwhile, any changes, modifications and variations of the above-described embodiments, which are equivalent to those of the technical spirit of the present invention, are within the scope of the technical solution of the present invention.

Claims (8)

1. A VR target training system for cognitive impairment is characterized by comprising virtual picture display equipment, a central processing unit, a positioning device, position receiving equipment, input equipment and an application software system; the central processor is internally provided with an application software system; the virtual picture display equipment, the positioning device, the position receiving equipment and the input equipment are connected with the central processing unit; the application software system comprises a computational force training unit, an orientation force training unit, a memory force training unit and a visual space and orientation force training unit.
2. The VR targeted training system for cognitive impairment of claim 1, wherein the central processor comprises a location processing module, an image processing module, a sound processing module, a control module, and a data storage module; the position processing module, the image processing module and the sound processing module are connected with the control module, and the image processing module, the sound processing module and the position processing module are connected with the data storage module.
3. The VR targeted training system for cognitive impairment of claim 2, wherein the computational power training unit includes an item clearing game; the directional force training unit comprises an object searching game and a visual reconstruction game; the memory training unit comprises a virtual ATM machine game; the visual space and directional force training unit comprises a jigsaw puzzle and a shelf fetching game.
4. The VR targeted training system for cognitive impairment of claim 3, wherein the virtual screen display device includes a display screen; the virtual picture display equipment, the central processing unit, the positioning device and the position receiving equipment are arranged in virtual reality head-mounted display equipment, namely VC head-mounted display glasses.
5. The VR targeted training system of claim 4, wherein the input device includes an operating handle to transmit patient location information; a data transmission channel is arranged between the operating handle and the VC head glasses; the operating handle is provided with an operating button.
6. The VR targeted training system of claim 5, wherein the positioning device is disposed in a real space in which the handle, the VC head glasses and the patient are located; the positioning device transmits the position information of the VC head display glasses and the handle worn by the patient in the real space to the position processing module.
7. The VR targeted training system of claim 6, wherein the positioning device comprises a plurality of laser positioners or ultrasound positioners.
8. Use of the VR targeted training system for cognitive impairment of any one of claims 1 to 7 in cognitive impairment rehabilitation training.
CN202111462457.0A 2021-12-02 2021-12-02 VR (virtual reality) targeted training system for cognitive impairment Pending CN114129852A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111462457.0A CN114129852A (en) 2021-12-02 2021-12-02 VR (virtual reality) targeted training system for cognitive impairment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111462457.0A CN114129852A (en) 2021-12-02 2021-12-02 VR (virtual reality) targeted training system for cognitive impairment

Publications (1)

Publication Number Publication Date
CN114129852A true CN114129852A (en) 2022-03-04

Family

ID=80387319

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111462457.0A Pending CN114129852A (en) 2021-12-02 2021-12-02 VR (virtual reality) targeted training system for cognitive impairment

Country Status (1)

Country Link
CN (1) CN114129852A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100805274B1 (en) * 2007-01-16 2008-02-20 성신여자대학교 산학협력단 Method for cognitive rehabilitation using games, recording medium thereof and apparatus for cognitive rehabilitation using games
US20120108909A1 (en) * 2010-11-03 2012-05-03 HeadRehab, LLC Assessment and Rehabilitation of Cognitive and Motor Functions Using Virtual Reality
CN103268392A (en) * 2013-04-15 2013-08-28 福建中医药大学 Cognitive function training system for scene interaction and application method thereof
CN106821333A (en) * 2017-03-21 2017-06-13 黑龙江尔惠科技有限公司 A kind of cognition dysfunction rehabilitation detection means based on virtual scene, method and therapeutic equipment
US20180204480A1 (en) * 2017-01-18 2018-07-19 Chao-Wei CHEN Cognitive training system
CN109324692A (en) * 2018-11-30 2019-02-12 中山大学 A kind of virtual reality method and system for attention deficit hyperactivity disorder detection
KR20200071305A (en) * 2018-12-11 2020-06-19 주식회사 씨투몬스터 Dementia patient training system applying interactive technology
CN113160930A (en) * 2021-04-08 2021-07-23 广东省人民医院 Diagnosis and rehabilitation system and method for Parkinson disease mild cognitive impairment based on VR

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100805274B1 (en) * 2007-01-16 2008-02-20 성신여자대학교 산학협력단 Method for cognitive rehabilitation using games, recording medium thereof and apparatus for cognitive rehabilitation using games
US20120108909A1 (en) * 2010-11-03 2012-05-03 HeadRehab, LLC Assessment and Rehabilitation of Cognitive and Motor Functions Using Virtual Reality
CN103268392A (en) * 2013-04-15 2013-08-28 福建中医药大学 Cognitive function training system for scene interaction and application method thereof
US20180204480A1 (en) * 2017-01-18 2018-07-19 Chao-Wei CHEN Cognitive training system
CN106821333A (en) * 2017-03-21 2017-06-13 黑龙江尔惠科技有限公司 A kind of cognition dysfunction rehabilitation detection means based on virtual scene, method and therapeutic equipment
CN109324692A (en) * 2018-11-30 2019-02-12 中山大学 A kind of virtual reality method and system for attention deficit hyperactivity disorder detection
KR20200071305A (en) * 2018-12-11 2020-06-19 주식회사 씨투몬스터 Dementia patient training system applying interactive technology
CN113160930A (en) * 2021-04-08 2021-07-23 广东省人民医院 Diagnosis and rehabilitation system and method for Parkinson disease mild cognitive impairment based on VR

Similar Documents

Publication Publication Date Title
CN107480462B (en) Intelligent clinical interaction system
Weiss et al. Video capture virtual reality as a flexible and effective rehabilitation tool
Veras et al. Scoping review of outcome measures used in telerehabilitation and virtual reality for post-stroke rehabilitation
JP2014529420A (en) Non-invasive motion tracking system, apparatus and method for enhancing physical rehabilitation performed on a patient
CN109273079A (en) AI cloud diagnosis and therapy system based on Chinese medicine
Elor et al. Deep reinforcement learning in immersive virtual reality exergame for agent movement guidance
Greenleaf Developing the tools for practical VR applications [Medicine]
Lange et al. Leveraging unencumbered full body control of animated virtual characters for game-based rehabilitation
TWI505228B (en) A self-care system for assisting quantitative assessment of rehabilitation movement
Metsis et al. Computer aided rehabilitation for patients with rheumatoid arthritis
Ghisio et al. An open platform for full body interactive sonification exergames
Kolivand et al. Review on augmented reality technology
Yeh et al. Virtual reality for post-stroke shoulder-arm motor rehabilitation: Training system & assessment method
Szykman et al. A perspective of games for people with physical disabilities
CN114129852A (en) VR (virtual reality) targeted training system for cognitive impairment
Fraiwan et al. Therapy central: On the development of computer games for physiotherapy
Zhang Virtual reality games based on brain computer interface
CN113877157B (en) Hand function rehabilitation system combining data glove and VR technology
Chebaa et al. Multimodal analysis of serious games for cognitive and physiological assessment
Dingli et al. Realtime adaptive virtual reality for pain reduction
Bouatrous et al. A new adaptive VR-based exergame for hand rehabilitation after stroke
Fluet et al. Basis and Clinical Evidence of Virtual Reality-Based Rehabilitation of Sensorimotor Impairments After Stroke
Yeh et al. A cloud-based tele-rehabilitation system for frozen shoulder
Venugopalan et al. MotionTalk: personalized home rehabilitation system for assisting patients with impaired mobility
TWI777239B (en) Limbs rehabilitation system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination