CN113413532B - Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality - Google Patents

Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality Download PDF

Info

Publication number
CN113413532B
CN113413532B CN202110746318.4A CN202110746318A CN113413532B CN 113413532 B CN113413532 B CN 113413532B CN 202110746318 A CN202110746318 A CN 202110746318A CN 113413532 B CN113413532 B CN 113413532B
Authority
CN
China
Prior art keywords
rehabilitation training
module
patient
assessment
rehabilitation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110746318.4A
Other languages
Chinese (zh)
Other versions
CN113413532A (en
Inventor
曾迎春
乐学光
郑树基
张俊娥
郭秀艳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University City College ZUCC
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202110746318.4A priority Critical patent/CN113413532B/en
Priority to PCT/CN2021/116733 priority patent/WO2023272935A1/en
Publication of CN113413532A publication Critical patent/CN113413532A/en
Application granted granted Critical
Publication of CN113413532B publication Critical patent/CN113413532B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0022Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the tactile sense, e.g. vibrations
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0027Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the hearing sense
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61MDEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0044Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense
    • A61M2021/005Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense images, e.g. video

Abstract

The invention discloses a cancer-related cognitive impairment evaluation and rehabilitation training system based on virtual reality, which comprises an evaluation system and a rehabilitation system, wherein the evaluation system is used for evaluating three common damaged dimensions of cancer-related cognitive impairment and comprises a visual-auditory evaluation module, a speech fluency evaluation module and a digital connection evaluation module, and the rehabilitation system comprises a single-dimensional rehabilitation training module and a multi-dimensional rehabilitation training module; the evaluation system also comprises an evaluation system for screening mild dementia for elderly cancer patients and an evaluation system for carrying out speech disorder risk for brain tumor patients, and the rehabilitation system also comprises a VR immersive nostalgic experience system for carrying out corresponding rehabilitation training for the mild dementia patients and a VR speech rehabilitation training system for carrying out corresponding rehabilitation training for the speech disorder patients; the multifunctional integrated VR cognitive disorder assessment and rehabilitation training device can highly simulate the daily living environment, and enables patients with cancer-related cognitive disorders to obtain comprehensive cognitive rehabilitation.

Description

Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality
Technical Field
The invention belongs to the technical field of cancer rehabilitation, and particularly relates to a cancer-related cognitive impairment assessment and rehabilitation training system.
Background
The incidence of cancer is on the trend of rising year by year, and up to three-fourth of cancer patients can have cognitive impairment, but the treatment space, time, manpower, money and other aspects are limited, so that the cognitive function assessment and rehabilitation requirements of many cognitive impairment patients cannot be met. The traditional paper-based cognitive assessment tool and rehabilitation training have limited help for patients, at present, research indicates that cognitive function assessment and verbal communication under ecological environment should be enhanced, a training environment highly simulating real life is provided for the patients due to the appearance of a virtual reality technology, particularly, training scenes which are difficult to contact, expensive in cost, difficult to control and dangerous when hospitals receive rehabilitation therapy are provided, the patients are helped to effectively improve cognitive functions and finally return to daily life through visual and auditory stimulation, and the problem that traditional cognitive rehabilitation training materials are single in form, dull and tedious and separated from daily practical application scenes is solved.
Through the above analysis, the problems and defects of the prior art are as follows:
(1) the traditional paper pen and computer cognitive assessment makes cancer patients feel boring when in cognitive assessment, and are easily interfered by environment such as noise to cause inaccurate cognitive assessment;
(2) most of the traditional cognitive rehabilitation training is completed through a mouse or a keyboard, interaction lacks certain feedback and interestingness, and compliance of cancer patient cognitive rehabilitation training is poor.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide a multifunctional integrated cognitive impairment assessment and rehabilitation training system based on virtual reality, which can enable cancer-related cognitive impairment patients to obtain comprehensive cognitive rehabilitation in a training environment highly simulating daily life.
In order to achieve the purpose, the invention adopts the following technical scheme:
cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality comprises an assessment system and a rehabilitation system, wherein the assessment system comprises: the visual and auditory evaluation module clicks the automatically broadcast words and performs the retentions test of the patient on the retended words, the word classification and whether the words appear or not after the word broadcast is finished;
the speech fluency evaluation module prompts the patient to speak the name of the specified object within one minute, and identifies the object corresponding to the voice content display of the patient;
the digital connection evaluation module prompts the patient to carry out digital connection according to the requirement;
the rehabilitation system comprises a single-dimensional rehabilitation training module and a multi-dimensional rehabilitation training module, wherein the single-dimensional rehabilitation training module comprises a memory rehabilitation training task, an execution rehabilitation training task and a speech rehabilitation training task, and selects one of the memory rehabilitation training task, the execution rehabilitation training task and the speech rehabilitation training task to perform rehabilitation training;
and the multidimensional rehabilitation training module prompts the patient to go to the task place according to the guide by clicking the executed instruction arrow, and enables the patient to complete the comprehensive training tasks including the memory rehabilitation training task, the execution rehabilitation training task and the language rehabilitation training task according to the task prompt at the task place.
The evaluation system and the rehabilitation system are carried on the computer and are connected with the VR head-mounted equipment, the evaluation system carries out evaluation test and feeds back the evaluation test to the computer, and the computer pushes the rehabilitation training task matched with the evaluation test result according to the corresponding evaluation test result on the basis of the cloud platform database.
As a refinement, the evaluation system further comprises a mild dementia evaluation system for screening mild dementia for an elderly cancer patient, and the rehabilitation system comprises a VR immersive nostalgic experience system corresponding to the mild dementia evaluation system; the mild dementia assessment system comprises: the instant recall test module prompts a patient to select a specified object from a VR scene through voice broadcasting, and the patient operates a VR controller to select a corresponding object to place in a box after the voice broadcasting is finished; the terrain memory testing module prompts a patient to memorize the sequence of the photos in the VR scene through voice broadcasting, then automatically breaks up the sequence of the photos after 15s, and then prompts the patient to sort the photos one by one according to the previously memorized sequence through the VR controller and put the photos back to the original position; the prospective memory testing module prompts a patient to execute a task of buying a dish or shopping with a wallet in a VR scene through voice broadcasting, and broadcasts interference voice after the voice broadcasting is carried out for 3 s; and the comprehension ability testing module prompts the patient to prepare a dish by voice, and then finishes various dish making actions step by step according to voice broadcasting. VR immersive nostalgic experience system includes commonality nostalgic module and specificity nostalgic module, and the scene is experienced in the VR nostalgic that the patient got into commonality nostalgic module or specificity nostalgic module according to guiding to observe each article in the scene under the voice broadcast suggestion, know familiar scene according to the voice broadcast suggestion.
As an improvement scheme, the evaluation system further comprises a speech disorder evaluation system for evaluating the oral expression and speech understanding of the patient, and the rehabilitation system comprises a VR speech rehabilitation training system corresponding to the speech disorder evaluation system; the speech disorder evaluation system comprises a word naming evaluation module, a word repeating evaluation module, a spontaneous language evaluation module, an image recognition evaluation module and a speech execution evaluation module; the word naming evaluation module is used for broadcasting and displaying a picture by voice, displaying different objects by picture contents, and answering the contents of the picture one by a patient; the word repeat evaluation module prompts the text content to be repeated on a picture, and prompts to repeat and broadcasts the text to be repeated by voice; a spontaneous language assessment module that voice prompts the patient to make spontaneous speech, such as from 1 to 10; the picture recognition and evaluation module prompts the patient to point out the objects on the picture through voice broadcasting, and the patient points out corresponding contents through the VR controller according to requirements; and the speech execution evaluation module prompts the operation content to be executed through voice broadcasting, and the patient operates according to the requirement through the VR controller. The VR speech rehabilitation training system comprises a naming training module and a scene dialogue training module; the naming training module displays a content model corresponding to the naming terms on a VR picture, and the patient observes the model and inputs the corresponding naming terms through voice recognition; and the scene dialogue training module is used for selecting VR dialogue scenes, and the patient can broadcast and understand dialogue scene targets one by one according to the set scene dialogue and answer one by one according to target prompts.
The invention has the following beneficial effects:
according to the cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality, the simulation environment constructed by the virtual reality technology provides visual, auditory and tactile realistic simulation, a highly immersive and interactive virtual world is brought to a user, the patient can communicate and interact with people and objects in the virtual environment, brain neurotransmitter activity is reconstructed through visual and auditory stimulation, the cognitive rehabilitation range is expanded, the cognitive function rehabilitation of the cancer patient is promoted, and meanwhile the current situation of insufficient medical manpower resources can be relieved; the following advantages are also provided: 1. by carrying out communication interaction with objects in a virtual environment and repeatedly stimulating vision and hearing, the problems that the material form is single, boring and boring, the actual application scene of daily life is separated and the like in the conventional cognitive rehabilitation system are solved; 2. the rehabilitation training task can be repeated for infinite times, and the cognitive rehabilitation requirement of an individual is met; 3. the patient can perform cognitive training in a training environment highly simulating daily life to obtain multifunctional integrated rehabilitation training of comprehensive cognitive rehabilitation; 4. each verbal skill acquired by the patient in the virtual environment can be applied to daily life, so that the cognitive function of the cancer patient is improved, and the method has important significance for the patient to finally return to the daily life.
Drawings
FIG. 1 is a block diagram of a virtual reality-based cancer-related cognitive impairment assessment and rehabilitation training system according to the present invention;
FIG. 2 is a diagram of a framework for assessment and rehabilitation training of the common impaired dimension of the virtual reality-based cancer-related cognitive impairment assessment and rehabilitation training system of the present invention;
FIG. 3 is a flowchart illustrating operation of a VR immersive nostalgic experience system of the virtual reality based cancer related cognitive impairment evaluation and rehabilitation training system of the present invention;
fig. 4 is a flowchart illustrating the operation of the contextual dialog training module of the virtual reality-based cancer-related cognitive impairment assessment and rehabilitation training system according to the present invention.
Detailed Description
The invention will be further described with reference to the accompanying drawings and specific embodiments so as to more clearly understand the technical idea of the invention claimed.
As shown in fig. 1-2, the system for cancer-related cognitive impairment assessment and rehabilitation training based on virtual reality of the present invention includes an assessment system and a rehabilitation system, wherein the assessment system performs an assessment on three common impaired dimensions of cancer-related cognitive impairment, that is, three key cognitive dimensions recommended by ICCTF (international cancer and cognitive working group), including: the visual and auditory evaluation module 1 clicks the automatically broadcast words and performs the retentions test of the patient on the retentions, the word classification and whether the words appear or not after the word broadcast is finished;
the speech fluency evaluation module 2 prompts the patient to speak the name of the specified object within one minute, and identifies the object corresponding to the voice content display of the patient;
the digital connecting line evaluation module 3 prompts the patient to carry out digital connection according to the requirement;
the rehabilitation system comprises a single-dimensional rehabilitation training module 4 and a multi-dimensional rehabilitation training module 5, wherein the single-dimensional rehabilitation training module 4 comprises a memory rehabilitation training task, an execution rehabilitation training task and a speech rehabilitation training task, and selects one of the memory rehabilitation training task, the execution rehabilitation training task and the speech rehabilitation training task to perform rehabilitation training;
and the multidimensional rehabilitation training module 5 prompts the patient to go to the task place according to the guide by a guide arrow after clicking execution, and enables the patient to complete a comprehensive training task which simultaneously comprises a memory rehabilitation training task, an execution rehabilitation training task and a language rehabilitation training task according to the task prompt at the task place.
The evaluation system and the rehabilitation system are carried on the computer and are connected with the VR head-mounted equipment, the evaluation system carries out evaluation test and feeds back the evaluation test to the computer, and the computer pushes the rehabilitation training task matched with the evaluation test result according to the corresponding evaluation test result on the basis of the cloud platform database.
The evaluation system further comprises a mild dementia evaluation system 6 for screening mild dementia for elderly cancer patients, and the rehabilitation system comprises a VR immersive nostalgic experience system 7 corresponding to the mild dementia evaluation system 6; the mild dementia evaluation system 6 includes: the instant recall test module 61 prompts the patient to select a specified object from the VR scene through voice broadcasting, and the patient operates the VR controller to select a corresponding object to place in the box after the voice broadcasting is finished; the terrain memory test module 62 prompts the patient to memorize the sequence of the photos in the VR scene through voice broadcast, then automatically breaks up the sequence of the photos after 15s, and prompts the patient to sort the photos one by one according to the previously memorized sequence through a VR controller and put the photos back to the original position; the prospective memory testing module 63 prompts the patient to carry out a task of buying with a wallet or shopping in a VR scene through voice broadcasting, and broadcasts interference voice after the voice broadcasting is carried out for 3 seconds; the comprehension ability test module 64 prompts the patient with voice to prepare a dish and then gradually completes various dish making actions according to voice broadcast. VR immersive nostalgic experience system 7 includes generic nostalgic module 71 and specific nostalgic module 72, and the patient enters the VR nostalgic experience scene of generic nostalgic module 71 or specific nostalgic module 72 as directed, as shown in fig. 3, observes objects in the scene under the voice broadcast prompt, and familiarizes the scene as voice broadcast prompt.
The evaluation system further comprises a speech disorder evaluation system 8 for evaluating the oral expression and speech comprehension of the patient, and the rehabilitation system comprises a VR speech rehabilitation training system 9 corresponding to the speech disorder evaluation system 8; the speech disorder evaluation system 8 comprises a term naming evaluation module 81, a term repeating evaluation module 82, a spontaneous language evaluation module 83, a picture recognition evaluation module 84 and a speech execution evaluation module 85; the word naming evaluation module 81 broadcasts voice and displays a picture, the content of the picture displays different objects, and the patient answers the content of the picture one by one; the word repeat evaluation module 82 is used for prompting the text content to be repeated on a picture, prompting to repeat and broadcasting the text to be repeated in a voice mode; a spontaneous language assessment module 83 that voice prompts the patient for spontaneous speech, such as from 1 to 10; a picture recognition and evaluation module 84 for prompting the patient to point out the object on the picture by voice broadcasting, and the patient points out the corresponding content according to the requirement through the VR controller; and the speech execution evaluation module 85 is used for prompting the operation content required to be executed through voice broadcasting and is operated by the patient through the VR controller according to the requirement. The VR speech rehabilitation training system 9 comprises a naming training module 91 and a scene dialogue training module 92; a naming training module 91 for displaying the content model corresponding to the naming term on the VR screen, and inputting the corresponding naming term by the patient observing the model and performing voice recognition; the contextual dialog training module 92 selects VR dialog scenes, and as shown in fig. 4, the patient broadcasts and understands dialog scene targets one by one according to the set contextual dialog, and answers one by one according to the target prompts.
According to the cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality, visual, auditory and tactile realistic simulation is provided through a virtual reality technology, namely a simulation environment constructed by VR, a highly immersive and interactive virtual world is brought to a user, the patient can communicate and interact with people and objects in the virtual environment, brain neurotransmitter activity is reconstructed through visual and auditory stimulation, the cognitive rehabilitation range is expanded, the cognitive function rehabilitation of the cancer patient is promoted, and meanwhile the situation that medical manpower resources are insufficient can be relieved; simultaneously, the method also has the following advantages: 1. by carrying out communication interaction with objects in a virtual environment and repeatedly stimulating vision and hearing, the problems that the material form is single, boring and boring, the actual application scene of daily life is separated and the like in the conventional cognitive rehabilitation system are solved; 2. the rehabilitation training task can be repeated for infinite times, and the cognitive rehabilitation requirement of an individual is met; 3. the patient can perform cognitive training in a training environment highly simulating daily life to obtain multifunctional integrated rehabilitation training of comprehensive cognitive rehabilitation; 4. each verbal skill acquired by the patient in the virtual environment can be applied to daily life, so that the cognitive function of the cancer patient is improved, and the method has important significance for the patient to finally return to the daily life.
Various other changes and modifications to the above-described embodiments and concepts will become apparent to those skilled in the art from the above description, and all such changes and modifications are intended to be included within the scope of the present invention as defined in the appended claims.

Claims (5)

1. Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality, characterized by comprising an assessment system and a rehabilitation system, wherein the assessment system comprises:
the visual and auditory evaluation module clicks the automatically broadcast words and performs the retentions test of the patient on the retended words, the word classification and whether the words appear or not after the word broadcast is finished;
the speech fluency evaluation module prompts the patient to speak the name of the specified object within one minute, and identifies the object corresponding to the voice content display of the patient;
the digital connection evaluation module prompts the patient to carry out digital connection according to the requirement;
the rehabilitation system comprises a single-dimensional rehabilitation training module and a multi-dimensional rehabilitation training module, wherein the single-dimensional rehabilitation training module comprises a memory rehabilitation training task, an execution rehabilitation training task and a speech rehabilitation training task, and selects one of the memory rehabilitation training task, the execution rehabilitation training task and the speech rehabilitation training task to perform rehabilitation training;
the multidimensional rehabilitation training module prompts a patient to go to a task place according to a guide through a guide arrow after clicking execution, and enables the patient to complete a comprehensive training task which simultaneously comprises a memory rehabilitation training task, an execution rehabilitation training task and a language rehabilitation training task according to the task prompt at the task place;
the assessment system further comprises a mild dementia assessment system for screening patients with senile cancer for mild dementia, and the rehabilitation system comprises a VR immersive nostalgic experience system corresponding to the mild dementia assessment system;
the mild dementia assessment system includes:
the instant recall test module prompts a patient to select a specified object from a VR scene through voice broadcasting, and the patient operates a VR controller to select a corresponding object to place in a box after the voice broadcasting is finished;
the terrain memory testing module prompts a patient to memorize the sequence of the photos in the VR scene through voice broadcasting, then automatically breaks up the sequence of the photos after 15s, and then prompts the patient to sort the photos one by one according to the previously memorized sequence through the VR controller and put the photos back to the original position;
the prospective memory testing module prompts a patient to execute a task of buying a dish or shopping with a wallet in a VR scene through voice broadcasting, and broadcasts interference voice after the voice broadcasting is carried out for 3 s;
the comprehension ability testing module prompts the patient to prepare a dish by voice, and then finishes various dish making actions step by step according to voice broadcast;
VR immersive nostalgic experience system includes commonality nostalgic module and specificity nostalgic module, and the scene is experienced to VR nostalgic that the patient got into commonality nostalgic module or specificity nostalgic module according to guiding to observe each article in the scene under the voice broadcast suggestion, know familiar scene according to the voice broadcast suggestion.
2. The virtual reality-based cancer-related cognitive impairment assessment and rehabilitation training system of claim 1, wherein the assessment system and the rehabilitation system are carried on a computer and connected with a VR headset, the assessment system performs assessment tests and feeds back to the computer, and the computer pushes matched rehabilitation training tasks according to corresponding assessment test results and a cloud platform database.
3. The virtual reality-based cancer-related cognitive impairment assessment and rehabilitation training system of claim 1 or 2, wherein the assessment system further comprises a speech impairment assessment system that assesses the patient's spoken language expression and speech understanding, the rehabilitation system comprising a VR speech rehabilitation training system corresponding to the speech impairment assessment system.
4. The virtual reality based cancer related cognitive impairment assessment and rehabilitation training system of claim 3, wherein the speech impairment assessment system comprises a term naming assessment module, a term repeating assessment module, a spontaneous language assessment module, a picture recognition assessment module, and a speech execution assessment module;
the word naming evaluation module broadcasts and displays a picture by voice, the picture content displays different objects, and the patient answers the contents of the picture one by one;
the word repeat evaluation module prompts the text content to be repeated on a picture, and prompts to repeat and broadcasts the text to be repeated by voice;
the spontaneous language assessment module prompts the patient with voice to perform spontaneous speech, such as 1 to 10;
the picture recognition and evaluation module prompts the patient to point out the objects on the picture through voice broadcast, and the patient points out corresponding contents through the VR controller according to requirements;
the speech execution evaluation module prompts the operation content to be executed through voice broadcasting, and the patient operates according to the requirement through the VR controller.
5. The virtual reality-based cancer-related cognitive impairment assessment and rehabilitation training system of claim 3, wherein the VR speech rehabilitation training system comprises a naming training module and a contextual dialog training module;
the naming training module displays a content model corresponding to the naming words on a VR picture, and the patient observes the model and inputs the corresponding naming words through voice recognition;
and the scene dialogue training module selects VR dialogue scenes, and the patient broadcasts and understands dialogue scene targets one by one according to the set scene dialogue and answers one by one according to target prompts.
CN202110746318.4A 2021-07-01 2021-07-01 Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality Active CN113413532B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110746318.4A CN113413532B (en) 2021-07-01 2021-07-01 Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality
PCT/CN2021/116733 WO2023272935A1 (en) 2021-07-01 2021-09-06 Virtual reality-based cancer-related cognitive impairment evaluation and rehabilitation training system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110746318.4A CN113413532B (en) 2021-07-01 2021-07-01 Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality

Publications (2)

Publication Number Publication Date
CN113413532A CN113413532A (en) 2021-09-21
CN113413532B true CN113413532B (en) 2022-03-01

Family

ID=77719996

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110746318.4A Active CN113413532B (en) 2021-07-01 2021-07-01 Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality

Country Status (2)

Country Link
CN (1) CN113413532B (en)
WO (1) WO2023272935A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117438048B (en) * 2023-12-20 2024-02-23 深圳市龙岗区第三人民医院 Method and system for assessing psychological disorder of psychiatric patient

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103327980A (en) * 2010-11-15 2013-09-25 艾吉因生物股份有限公司 Benzodiazepine derivatives, compositions and methods for treating cognitive impairment
CN105078449A (en) * 2015-08-24 2015-11-25 华南理工大学 Senile dementia monitoring system based on healthy service robot
CN105120683A (en) * 2013-04-22 2015-12-02 飞鱼有限公司 Use of a composition comprising fish oil and juice for the treatment and/or post treatment of cancer
CN204971278U (en) * 2015-08-24 2016-01-20 华南理工大学 Senile dementia monitor system based on health service robot
CN110335681A (en) * 2019-05-09 2019-10-15 哈尔滨医科大学 One kind being used for senile dementia early warning system and method for early warning
CN110382501A (en) * 2016-12-19 2019-10-25 艾吉因生物股份有限公司 For treating the benzodiazepine cycloheptatriene derivative of cognitive impairment, composition and method

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108198615B (en) * 2016-05-09 2020-09-11 南京智精灵教育科技有限公司 Online cognitive evaluation system
CN106951717A (en) * 2017-03-31 2017-07-14 山东富优生命科学有限公司 Treating dysfunction system is moved a kind of child attention defect more
CN110415788A (en) * 2018-04-27 2019-11-05 深圳市前海安测信息技术有限公司 System and method based on the auxiliary Alzheimer Disease patient memory training of VR technology
KR20190136314A (en) * 2018-05-30 2019-12-10 (주)휴먼아이티솔루션 Virtual reality-based visual evaluation and prescription system
CN109887569A (en) * 2019-01-30 2019-06-14 上海市精神卫生中心(上海市心理咨询培训中心) Neurodevelopmental disorder points based on VR calculate auxiliary training system and training method
CN110292513A (en) * 2019-06-03 2019-10-01 东莞佰和生物科技有限公司 Serve the intelligent robot system of old dementia patients rehabilitation training
CN211068962U (en) * 2019-11-12 2020-07-24 山西医科大学第一医院 Card cognitive training instrument that old man used
CN110827953A (en) * 2019-11-14 2020-02-21 复旦大学 Cognitive memory training evaluation system and method based on VR and storage medium
CN111063416A (en) * 2019-11-16 2020-04-24 嘉兴赛科威信息技术有限公司 Alzheimer disease rehabilitation training and capability assessment system based on virtual reality
CN110890140B (en) * 2019-11-25 2022-09-23 上海交通大学 Virtual reality-based autism rehabilitation training and capability assessment system and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103327980A (en) * 2010-11-15 2013-09-25 艾吉因生物股份有限公司 Benzodiazepine derivatives, compositions and methods for treating cognitive impairment
CN105120683A (en) * 2013-04-22 2015-12-02 飞鱼有限公司 Use of a composition comprising fish oil and juice for the treatment and/or post treatment of cancer
CN105078449A (en) * 2015-08-24 2015-11-25 华南理工大学 Senile dementia monitoring system based on healthy service robot
CN204971278U (en) * 2015-08-24 2016-01-20 华南理工大学 Senile dementia monitor system based on health service robot
CN110382501A (en) * 2016-12-19 2019-10-25 艾吉因生物股份有限公司 For treating the benzodiazepine cycloheptatriene derivative of cognitive impairment, composition and method
CN110335681A (en) * 2019-05-09 2019-10-15 哈尔滨医科大学 One kind being used for senile dementia early warning system and method for early warning

Also Published As

Publication number Publication date
CN113413532A (en) 2021-09-21
WO2023272935A1 (en) 2023-01-05

Similar Documents

Publication Publication Date Title
Austin et al. Presentation and production: The role of gesture in spatial communication
Bonebright et al. Testing the effectiveness of sonified graphs for education: A programmatic research project
Hwang et al. Recognition-based physical response to facilitate EFL learning
Rizzo et al. Virtual reality standardized patients for clinical training
CN113413532B (en) Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality
Ardhiani et al. USING HAND PUPPETS AS MEDIA TO IMPROVE STUDENTS’SPEAKING SKILL THROUGH NARRATIVE TEXT: A CASE OF EIGHTH STUDENTS OF SMP N 16 SEMARANG IN ACADEMIC YEAR OF 2016/2017
Lugrin et al. Adapted foreigner-directed communication towards virtual agents
CN113257061A (en) Virtual teaching method, device, electronic equipment and computer readable medium
CN108037825A (en) The method and system that a kind of virtual idol technical ability is opened and deduced
Quinton et al. Investigating effective methods of designing sonifications
Sarah et al. Effectiveness of student worksheets on environmental project-based e-learning model in building student character
Bonebright et al. Memory for auditory icons and earcons with localization cues
Nilsson Augmentation in the wild: user centered development and evaluation of augmented reality applications
Black The Phonicstick: a joystick to generate novel words using phonics
CN112950423A (en) Training system and method based on virtual intelligent standardized patient
Mioduser et al. Anticipatory cognitive mapping of unknown spaces by people who are blind using a virtual learning environment
Dongas Special Session—Designing Virtual Learning Experiences: Iterating Immersive Environments
Gilardi et al. Nursing XR–A VR application to teach decision making to student nurses
Bizoń et al. VIRCO: A virtual reality tool for long-term training and evaluation of the cognitive skills development in an interactive sensory substitution environment
Sanchez et al. Concept mapping for virtual rehabilitation and training of the blind
Li et al. A Mobile Game for Encouraging Active Listening among Deaf and Hard of Hearing People: Comparing the usage between mobile and desktop game
Jedidi et al. VR-App for a Virtual Perception of Memory Impairment in Alzheimer's Patients
CN112634684B (en) Intelligent teaching method and device
Lee et al. Enhancing Pre‐Service Teachers' Global Englishes Awareness with Technology: A Focus on AI Chatbots in 3D Metaverse Environments
Saindhane et al. Development and Implementation of Natural Language Processing and 3D Virtualization-Based Technologies in Educational Applications

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220622

Address after: 310000 No.51 Huzhou street, Gongshu District, Hangzhou City, Zhejiang Province

Patentee after: Zhejiang University City College

Address before: 510145 No.63 Duobao Road, Liwan District, Guangzhou City, Guangdong Province

Patentee before: Zeng Yingchun