WO2023272935A1 - 基于虚拟现实的癌症相关认知障碍评估与康复训练系统 - Google Patents

基于虚拟现实的癌症相关认知障碍评估与康复训练系统 Download PDF

Info

Publication number
WO2023272935A1
WO2023272935A1 PCT/CN2021/116733 CN2021116733W WO2023272935A1 WO 2023272935 A1 WO2023272935 A1 WO 2023272935A1 CN 2021116733 W CN2021116733 W CN 2021116733W WO 2023272935 A1 WO2023272935 A1 WO 2023272935A1
Authority
WO
WIPO (PCT)
Prior art keywords
module
rehabilitation training
evaluation
patient
rehabilitation
Prior art date
Application number
PCT/CN2021/116733
Other languages
English (en)
French (fr)
Inventor
曾迎春
乐学光
郭秀艳
刘思佳
梁敏余
郑树基
Original Assignee
曾迎春
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 曾迎春 filed Critical 曾迎春
Publication of WO2023272935A1 publication Critical patent/WO2023272935A1/zh

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0022—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the tactile sense, e.g. vibrations
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0027—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the hearing sense
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
    • A61M2021/0044—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense
    • A61M2021/005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus by the sight sense images, e.g. video

Definitions

  • the invention belongs to the technical field of cancer rehabilitation, and in particular relates to a cancer-related cognitive impairment evaluation and rehabilitation training system.
  • the present invention aims to provide a multifunctional integrated cognitive impairment assessment and rehabilitation training system that can enable patients with cancer-related cognitive impairment to obtain comprehensive cognitive rehabilitation in a training environment that highly simulates daily life. Cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality.
  • the present invention adopts the following technical solutions:
  • the evaluation system includes: audio-visual evaluation module, click to automatically broadcast words, and retell and classify words for patients after the word broadcast is completed and the recognition test of whether the word has appeared;
  • the speech fluency evaluation module prompts the patient to speak the name of the specified object within one minute, and recognizes the patient's voice content to display the corresponding object;
  • Digital connection evaluation module prompting patients to perform digital connection as required
  • the rehabilitation system includes a single-dimensional rehabilitation training module and a multi-dimensional rehabilitation training module.
  • the single-dimensional rehabilitation training module includes memory rehabilitation training tasks, executive rehabilitation training tasks and speech rehabilitation training tasks and selects one of them for rehabilitation training;
  • the multi-dimensional rehabilitation training module after clicking Execute, prompts the patient to follow the guidance to the task site through the guidance arrow, and at the task site allows the patient to follow the task prompts to complete the tasks including memory rehabilitation training tasks, executive rehabilitation training tasks and speech rehabilitation training tasks Comprehensive training tasks.
  • the evaluation system and rehabilitation system are installed on the computer and connected to the VR headset.
  • the evaluation system conducts evaluation tests and feeds back to the computer, and the computer pushes the corresponding rehabilitation training tasks based on the corresponding evaluation test results based on the cloud platform database.
  • the assessment system also includes a mild dementia assessment system for mild dementia screening for elderly cancer patients, and the rehabilitation system includes a VR immersive nostalgic experience system corresponding to the mild dementia assessment system;
  • the mild dementia assessment system includes: Immediate recall test module, the voice broadcast prompts the patient to select the specified object from the VR scene, and after the voice broadcast is completed, the patient operates the VR controller to select the corresponding object and put it in the box; the terrain memory test module, the voice broadcast prompts the patient to remember VR The order of the photos in the scene will be automatically disrupted after 15 seconds, and then the voice broadcast will remind the patient to sort the photos according to the order of previous memory through the VR controller and put them back to their original positions one by one; in the prospective memory test module, the voice broadcast will prompt the patient to In the VR scene, perform the task of going out to buy vegetables or go shopping with a wallet, and broadcast the interfering voice 3s after the voice broadcast; the comprehension ability test module, the voice prompts the patient to prepare a dish, and then gradually completes the cooking actions according to the voice
  • the VR immersive nostalgia experience system includes a general nostalgia module and a specific nostalgia module. Patients enter the VR nostalgia experience scene of the general nostalgia module or the specific nostalgia module according to the guidance, and observe the objects in the scene under the prompt of the voice broadcast. Voice broadcast prompts to familiarize yourself with the scene.
  • the evaluation system also includes a speech impairment evaluation system that evaluates the patient's oral expression and speech comprehension;
  • the rehabilitation system includes a VR speech rehabilitation training system corresponding to the speech impairment evaluation system;
  • the speech impairment evaluation system includes a word naming evaluation module , Word retelling evaluation module, spontaneous language evaluation module, picture recognition evaluation module and speech execution evaluation module; word naming evaluation module, voice broadcast and display a picture, the content of the picture shows different objects, and the patient answers the content of the picture one by one; words
  • the retelling evaluation module, the screen prompts the text content that needs to be recounted, the voice broadcast prompts to retell and the voice broadcasts the text that needs to be recounted;
  • the spontaneous language evaluation module the voice prompts the patient to speak spontaneously, such as counting from 1 to 10;
  • the picture recognition evaluation module The voice broadcast prompts the patient to point out the items on the screen, and the patient points out the corresponding content through the VR controller as required;
  • the speech execution evaluation module the voice broadcast prompts the operation content to be performed,
  • the VR speech rehabilitation training system includes a naming training module and a situational dialogue training module; the naming training module displays the content model corresponding to the named words on the VR screen, and the patient observes the model and inputs the corresponding named words through speech recognition; the situational dialogue training module, choose VR Dialogue scenes, patients will broadcast and understand the dialogue scene goals one by one according to the set situation dialogues, and answer one by one according to the target prompts.
  • the present invention is based on virtual reality cancer-related cognitive impairment assessment and rehabilitation training system.
  • the simulation environment constructed by virtual reality technology provides realistic simulation of multiple senses such as sight, hearing and touch, bringing users a highly immersive and interactive virtual world.
  • patients can communicate and interact with people and objects in the virtual environment, reconstruct the activity of neurotransmitters in the brain through visual and auditory stimulation, expand the scope of cognitive rehabilitation, promote the rehabilitation of cognitive functions of cancer patients, and at the same time relieve medical manpower.
  • the current situation of insufficient resources it also has the following advantages: 1. By communicating and interacting with objects in the virtual environment, the visual and auditory senses are repeatedly stimulated to solve the problem of single, boring and divorced from the reality of daily life in the existing cognitive rehabilitation system Application scenarios and other issues; 2.
  • Rehabilitation training tasks can be repeated indefinitely to meet individual cognitive rehabilitation needs; 3.
  • a multi-functional one that enables patients to perform cognitive training in a training environment that highly simulates daily life and obtain comprehensive cognitive rehabilitation 4.
  • Various language skills acquired by patients in the virtual environment can be applied in daily life, which improves the cognitive function of cancer patients and is of great significance for patients to return to daily life.
  • Fig. 1 is the frame diagram of the cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality of the present invention
  • Fig. 2 is the evaluation and rehabilitation training frame diagram of common damaged dimensions of the cancer-related cognitive impairment evaluation and rehabilitation training system based on virtual reality in the present invention
  • Fig. 3 is the operation flowchart of the VR immersive nostalgic experience system of the cancer-related cognitive impairment assessment and rehabilitation training system based on virtual reality in the present invention
  • FIG. 4 is a flow chart of the operation of the scenario dialogue training module of the virtual reality-based cancer-related cognitive impairment assessment and rehabilitation training system of the present invention.
  • the cancer-related cognitive impairment evaluation and rehabilitation training system based on virtual reality of the present invention includes an evaluation system and a rehabilitation system.
  • the evaluation system evaluates three common damaged dimensions of cancer-related cognitive impairment, including : Audio-visual evaluation module 1, click to automatically broadcast words, and perform retelling, word classification and recognition tests on whether the words have appeared to the patient after the word broadcast is completed;
  • Verbal fluency evaluation module 2 prompting the patient to speak the name of the specified object within one minute, and identifying the patient's voice content to display the corresponding object;
  • Digital connection evaluation module 3 prompting patients to perform digital connection as required
  • single-dimensional rehabilitation training module 4 includes memory rehabilitation training tasks, execution rehabilitation training tasks and speech rehabilitation training tasks, and one of them is selected for rehabilitation training ;
  • Multi-dimensional rehabilitation training module 5 after clicking Execute, the patient will be prompted to follow the guidance to the task location through the guidance arrow, and the patient will be instructed to complete the task at the task location, including memory rehabilitation training tasks, executive rehabilitation training tasks and speech rehabilitation training tasks comprehensive training tasks.
  • the evaluation system and rehabilitation system are installed on the computer and connected to the VR headset.
  • the evaluation system conducts evaluation tests and feeds back to the computer, and the computer pushes the corresponding rehabilitation training tasks based on the corresponding evaluation test results based on the cloud platform database.
  • the assessment system also includes a mild dementia assessment system 6 for mild dementia screening for elderly cancer patients, and the rehabilitation system includes a VR immersive nostalgic experience system 7 corresponding to the mild dementia assessment system 6;
  • the mild dementia assessment system 6 includes: Immediate recall test module 61, the voice broadcast prompts the patient to select a designated object from the VR scene, and after the voice broadcast is completed, the patient operates the VR controller to select the corresponding object and places it in the box; the terrain memory test module 62, the voice broadcast prompts the patient Memorize the sequence of photos in the VR scene, then automatically shuffle the sequence of photos after 15s, and then voice broadcast prompts the patient to sort the photos according to the order of memory before using the VR controller and put them back to their original positions;
  • Prospective memory test module 63 voice broadcast Prompt the patient to carry out the task of carrying a wallet to buy food or go shopping in the VR scene, and broadcast the interfering voice 3s after the voice broadcast;
  • the comprehension ability test module 64 the voice prompts the patient to prepare a dish, and then gradually
  • the VR immersive nostalgia experience system 7 includes a general nostalgia module 71 and a specific nostalgia module 72. Patients follow the guidelines to enter the VR nostalgia experience scene of the general nostalgia module 71 or the specific nostalgia module 72, as shown in FIG. Observe the objects in the scene with prompts, and follow the voice broadcast prompts to familiarize yourself with the scene.
  • the evaluation system also includes a speech impairment evaluation system 8 for evaluating the patient's oral expression and speech understanding, and the rehabilitation system includes a VR speech rehabilitation training system 9 corresponding to the speech impairment evaluation system 8; the speech impairment evaluation system 8 includes a word naming evaluation module 81.
  • Word retelling evaluation module 82 spontaneous language evaluation module 83, picture recognition evaluation module 84, and speech execution evaluation module 85; word naming evaluation module 81, voice broadcast and display a picture, the content of the picture shows different objects, and the patients are asked one by one Respond to the content of the picture; word retelling evaluation module 82, the screen prompts the text content that needs to be recounted, the voice broadcast prompts to retell and voice broadcasts the text that needs to be recounted; the spontaneous language evaluation module 83, the voice prompts the patient to carry out spontaneous speech, such as counting from 1 to 10; the picture recognition evaluation module 84, the voice broadcast prompts the patient to point out the items on the screen, and the patient points out the corresponding content as required through the VR controller; the speech execution evaluation module 85, the voice broadcast prompts the operation content to be performed, and the patient passes The VR controllers do as required.
  • the VR speech rehabilitation training system 9 includes a naming training module 91 and a situational dialogue training module 92; the naming training module 91 displays the content model corresponding to the named words on the VR screen, and the corresponding named words are input by the patient observation model and speech recognition; the situational dialogue training Module 92, select the VR dialogue scene, as shown in Figure 4, the patient broadcasts and understands the dialogue scene goals one by one according to the set scene dialogue, and answers one by one according to the target prompts.
  • This virtual reality-based cancer-related cognitive impairment assessment and rehabilitation training system provides realistic multi-sensory simulations of sight, hearing, and touch through the simulation environment constructed by virtual reality technology, bringing users a highly immersive and interactive virtual world , patients can communicate and interact with people and objects in the virtual environment, reconstruct the activity of neurotransmitters in the brain through visual and auditory stimulation, expand the scope of cognitive rehabilitation, promote the rehabilitation of cognitive functions of cancer patients, and at the same time relieve medical manpower.
  • the current situation of insufficient resources at the same time, it also has the following advantages: 1. By communicating and interacting with objects in the virtual environment, the visual and auditory senses are repeatedly stimulated to solve the problem of single, boring and divorced from daily life in the existing cognitive rehabilitation system. Practical application scenarios and other issues; 2.
  • Rehabilitation training tasks can be repeated indefinitely to meet individual cognitive rehabilitation needs; 3. Multifunctional functions that enable patients to perform cognitive training in a training environment that highly simulates daily life to obtain comprehensive cognitive rehabilitation Integrated rehabilitation training; 4. Various language skills acquired by patients in the virtual environment can be applied in daily life, which improves the cognitive function of cancer patients and is of great significance for patients to return to daily life.

Landscapes

  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Acoustics & Sound (AREA)
  • Psychology (AREA)
  • Engineering & Computer Science (AREA)
  • Anesthesiology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Hematology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • User Interface Of Digital Computer (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

一种基于虚拟现实(VR)的癌症相关认知障碍评估与康复训练系统，包括评估系统及康复系统，评估系统针对癌症相关认知障碍的常见三个受损维度进行测评，包括视听觉评测模块（1）、言语流畅性评测模块（2）及数字连线评测模块（3），康复系统包括单维度康复训练模块（4）及多维度康复训练模块（5）；评估系统还包括针对老年癌症患者进行轻度痴呆筛查的轻度痴呆评估系统（6）及对患者的口语表达和言语理解进行测评的言语障碍评估系统（8），康复系统还包括针对轻度痴呆患者进行对应康复训练的VR沉浸式怀旧体验系统（7）及对言语障碍患者进行对应的康复训练的VR言语康复训练系统（9）；该认知障碍评估与康复训练系统能高度模拟日常生活的环境，让有癌症相关认知障碍的患者得到全面认知康复。

Description

基于虚拟现实的癌症相关认知障碍评估与康复训练系统 技术领域
本发明属于癌症康复技术领域，具体涉及一种癌症相关认知障碍评估与康复训练系统。
 背景技术
癌症的发病率呈逐年上升趋势，高达四分之三的癌症患者会出现认知障碍，但存在治疗空间、时间、人力、金钱等方面限制，致使许多认知障碍患者的认知功能评估和康复需求无法得到满足。传统的纸质版认知评估工具和康复训练对患者帮助有限，目前研究指出应增强生态环境下的认知功能评估和言语沟通交流，虚拟现实技术的出现为患者提供高度模拟真实生活的训练环境, 特别是在医院接受康复治疗时难以接触、成本昂贵、不易控制、危险的训练场景，通过视觉、听觉刺激帮助患者有效提高认知功能并最终回归日常生活，弥补传统认知康复训练素材形式单一、枯燥乏味、脱离日常实际应用场景。
通过上述分析，现有技术存在的问题及缺陷为：
（1）传统的纸笔和电脑认知评估让癌症患者进行认知评估时感到枯燥，而且容易受到环境如噪音的干扰而导致认知评估不准确；
（2）传统的认知康复训练大多通过鼠标或者键盘完成，交互缺乏一定的反馈性与趣味性，导致癌症患者认知康复训练的依从性差。
 技术问题
针对现有技术的不足，本发明旨在提供一种能在高度模拟日常生活的训练环境中让癌症相关认知障碍患者得到全面认知康复的多功能一体化的认知障碍评估及康复训练的基于虚拟现实的癌症相关认知障碍评估与康复训练系统。
 技术解决方案
为实现上述目的，本发明采用如下技术方案：
基于虚拟现实的癌症相关认知障碍评估与康复训练系统，包括评估系统及康复系统，评估系统包括：视听觉评测模块，点击自动播报词语，并在词语播报完成后分别对患者进行复述、词语分类及词语是否出现过的再认测试；
言语流畅性评测模块，提示患者在一分钟时间内说出指定物类的名称，并识别患者的语音内容展示对应的实物；
数字连线评测模块，提示患者按照要求进行数字连接；
康复系统，包括单维度康复训练模块及多维度康复训练模块，单维度康复训练模块包括记忆类康复训练任务、执行类康复训练任务及言语类康复训练任务并选择其中一种进行康复训练；
多维度康复训练模块，点击执行后通过指引箭头提示患者按照指引前往任务地点，并在任务地点使患者按照任务提示完成同时包含记忆类康复训练任务、执行类康复训练任务及言语类康复训练任务的综合训练任务。
评估系统及康复系统搭载于电脑并与VR头戴设备建立连接，评估系统进行评估测试并反馈给电脑，并由电脑依据云平台数据库根据相应评估测试结果推送与之匹配的康复训练任务。
作为改进方案，评估系统还包括针对老年癌症患者进行轻度痴呆筛查的轻度痴呆评估系统，康复系统包括与轻度痴呆评估系统对应的VR沉浸式怀旧体验系统；轻度痴呆评估系统包括：即刻回忆测试模块，语音播报提示患者从VR场景中挑选指定物体，并在语音播报完成后由患者操作VR控制器选择相应物件将其放置于箱子中；地形记忆测试模块，语音播报提示患者记忆VR场景中的照片顺序，然后再15s后自动打乱照片顺序，再语音播报提示患者通过VR控制器将照片按照之前记忆的顺序逐一排序放回原位；前瞻性记忆测试模块，语音播报提示患者在VR场景中执行带钱包出门买菜或逛街的任务，并在该语音播报3s后播报干扰语音；理解能力测试模块，语音提示患者准备做一道菜，然后按照语音播报逐步完成各项做菜动作。VR沉浸式怀旧体验系统包括通用性怀旧模块和特异性怀旧模块，患者按照指引进入通用性怀旧模块或特异性怀旧模块的VR怀旧体验场景，并在语音播报提示下观察场景内的各物件，按照语音播报提示熟悉场景。
作为改进方案，评估系统还包括对患者的口语表达和言语理解进行测评的言语障碍评估系统，康复系统包括与言语障碍评估系统相对应的VR言语康复训练系统；言语障碍评估系统包括词语命名评测模块、词语复述评测模块、自发语言评测模块、图片识别评测模块及言语执行评测模块；词语命名评测模块，语音播报并显示一张图片，图片内容显示不同物件，并由患者逐一回答图片的内容；词语复述评测模块，画面提示需要复述的文字内容，语音播报提示进行复述并语音播报需要复述的文字；自发语言评测模块，语音提示患者进行自发性言语，如从1数到10；图片识别评测模块，语音播报提示患者指出画面上的物品，由患者通过VR控制器按要求指出相应的内容；言语执行评测模块，语音播报提示需要执行的操作内容，由患者通过VR控制器按要求进行操作。VR言语康复训练系统包括命名训练模块和情景对话训练模块；命名训练模块，在VR画面显示命名词语对应的内容模型，由患者观察模型并语音识别输入相应的命名词语；情景对话训练模块，选择VR对话场景，患者根据设定的情景对话逐一播报理解对话场景目标，并根据目标提示逐一进行作答。
 有益效果
本发明具有如下有益效果：
本发明基于虚拟现实的癌症相关认知障碍评估与康复训练系统，通过虚拟现实技术构建的仿真环境提供视、听、触觉等多感官的逼真模拟，给用户带来高度沉浸、可交互的虚拟世界，患者可以与虚拟环境中的人、物进行交流与互动，通过视觉、听觉刺激使大脑神经递质活性重建，拓展认知康复的范围，促进癌症患者的认知功能康复，同时能缓解医疗人力资源不足的现况；还具有以下优点：1、通过与虚拟环境中的物体进行交流互动，反复刺激视觉、听觉，解决现有认知康复系统中素材形式单一、枯燥乏味、脱离日常生活的实际应用场景等问题；2、可以无限次重复康复训练任务，满足个体的认知康复需求；3、使患者能够在高度模拟日常生活的训练环境中进行认知训练得到全面认知康复的多功能一体化的康复训练；4、患者在虚拟环境下习得的各项言语技能可在日常生活中应用，提高癌症患者的认知功能并对患者最终回归到日常生活有重要意义。
 附图说明
图1为本发明基于虚拟现实的癌症相关认知障碍评估与康复训练系统的框架图；
图2为本发明基于虚拟现实的癌症相关认知障碍评估与康复训练系统的常见受损维度的评估和康复训练框架图；
图3为本发明基于虚拟现实的癌症相关认知障碍评估与康复训练系统的VR沉浸式怀旧体验系统的运行流程图；
图4为本发明基于虚拟现实的癌症相关认知障碍评估与康复训练系统的情景对话训练模块的运行流程图。
 本发明的实施方式
下面结合附图及具体实施例，对本发明作进一步的描述，以便于更清楚地理解本发明要求保护的技术思想。
如图1-2所示本发明基于虚拟现实的癌症相关认知障碍评估与康复训练系统，包括评估系统及康复系统，评估系统针对癌症相关认知障碍的常见三个受损维度进行测评，包括：视听觉评测模块1，点击自动播报词语，并在词语播报完成后分别对患者进行复述、词语分类及词语是否出现过的再认测试；
言语流畅性评测模块2，提示患者在一分钟时间内说出指定物类的名称，并识别患者的语音内容展示对应的实物；
数字连线评测模块3，提示患者按照要求进行数字连接；
康复系统，包括单维度康复训练模块4及多维度康复训练模块5，单维度康复训练模块4包括记忆类康复训练任务、执行类康复训练任务及言语类康复训练任务并选择其中一种进行康复训练；
多维度康复训练模块5，点击执行后通过指引箭头提示患者按照指引前往任务地点，并在任务地点使患者按照任务提示完成同时包含记忆类康复训练任务、执行类康复训练任务及言语类康复训练任务的综合训练任务。
评估系统及康复系统搭载于电脑并与VR头戴设备建立连接，评估系统进行评估测试并反馈给电脑，并由电脑依据云平台数据库根据相应评估测试结果推送与之匹配的康复训练任务。
评估系统还包括针对老年癌症患者进行轻度痴呆筛查的轻度痴呆评估系统6，康复系统包括与轻度痴呆评估系统6对应的VR沉浸式怀旧体验系统7；轻度痴呆评估系统6包括：即刻回忆测试模块61，语音播报提示患者从VR场景中挑选指定物体，并在语音播报完成后由患者操作VR控制器选择相应物件将其放置于箱子中；地形记忆测试模块62，语音播报提示患者记忆VR场景中的照片顺序，然后再15s后自动打乱照片顺序，再语音播报提示患者通过VR控制器将照片按照之前记忆的顺序逐一排序放回原位；前瞻性记忆测试模块63，语音播报提示患者在VR场景中执行带钱包出门买菜或逛街的任务，并在该语音播报3s后播报干扰语音；理解能力测试模块64，语音提示患者准备做一道菜，然后按照语音播报逐步完成各项做菜动作。VR沉浸式怀旧体验系统7包括通用性怀旧模块71和特异性怀旧模块72，患者按照指引进入通用性怀旧模块71或特异性怀旧模块72的VR怀旧体验场景，如图3所示并在语音播报提示下观察场景内的各物件，按照语音播报提示熟悉场景。
评估系统还包括对患者的口语表达和言语理解进行测评的言语障碍评估系统8，康复系统包括与言语障碍评估系统8相对应的VR言语康复训练系统9；言语障碍评估系统8包括词语命名评测模块81、词语复述评测模块82、自发语言评测模块83、图片识别评测模块84及言语执行评测模块85；词语命名评测模块81，语音播报并显示一张图片，图片内容显示不同物件，并由患者逐一回答图片的内容；词语复述评测模块82，画面提示需要复述的文字内容，语音播报提示进行复述并语音播报需要复述的文字；自发语言评测模块83，语音提示患者进行自发性言语，如从1数到10；图片识别评测模块84，语音播报提示患者指出画面上的物品，由患者通过VR控制器按要求指出相应的内容；言语执行评测模块85，语音播报提示需要执行的操作内容，由患者通过VR控制器按要求进行操作。VR言语康复训练系统9包括命名训练模块91和情景对话训练模块92；命名训练模块91，在VR画面显示命名词语对应的内容模型，由患者观察模型并语音识别输入相应的命名词语；情景对话训练模块92，选择VR对话场景，如图4所示患者根据设定的情景对话逐一播报理解对话场景目标，并根据目标提示逐一进行作答。
这种基于虚拟现实的癌症相关认知障碍评估与康复训练系统，通过虚拟现实技术构建的仿真环境提供视、听、触觉等多感官的逼真模拟，给用户带来高度沉浸、可交互的虚拟世界，患者可以与虚拟环境中的人、物进行交流与互动，通过视觉、听觉刺激使大脑神经递质活性重建，拓展认知康复的范围，促进癌症患者的认知功能康复，同时能缓解医疗人力资源不足的现况；同时还具有以下优点：1、通过与虚拟环境中的物体进行交流互动，反复刺激视觉、听觉，解决现有认知康复系统中素材形式单一、枯燥乏味、脱离日常生活的实际应用场景等问题；2、可以无限次重复康复训练任务，满足个体的认知康复需求；3、使患者能够在高度模拟日常生活的训练环境中进行认知训练得到全面认知康复的多功能一体化的康复训练；4、患者在虚拟环境下习得的各项言语技能可在日常生活中应用，提高癌症患者的认知功能并对患者最终回归到日常生活有重要意义。
对于本领域的技术人员来说，可根据以上描述的技术方案以及构思，做出其它各种相应的改变以及变形，而所有的这些改变以及变形都应该属于本发明权利要求的保护范围之内。

Claims (8)

  1. 基于虚拟现实的癌症相关认知障碍评估与康复训练系统，其特征在于，包括评估系统及康复系统，所述评估系统包括：
    视听觉评测模块，点击自动播报词语，并在词语播报完成后分别对患者进行复述、词语分类及词语是否出现过的再认测试；
    言语流畅性评测模块，提示患者在一分钟时间内说出指定物类的名称，并识别患者的语音内容展示对应的实物；
    数字连线评测模块，提示患者按照要求进行数字连接；
    所述康复系统，包括单维度康复训练模块及多维度康复训练模块，所述单维度康复训练模块包括记忆类康复训练任务、执行类康复训练任务及言语类康复训练任务并选择其中一种进行康复训练；
    所述多维度康复训练模块，点击执行后通过指引箭头提示患者按照指引前往任务地点，并在任务地点使患者按照任务提示完成同时包含记忆类康复训练任务、执行类康复训练任务及言语类康复训练任务的综合训练任务。
  2. 如权利要求1所述的基于虚拟现实的癌症相关认知障碍评估与康复训练系统，其特征在于，所述评估系统及所述康复系统搭载于电脑并与VR头戴设备建立连接，所述评估系统进行评估测试并反馈给所述电脑，并由所述电脑依据云平台数据库根据相应评估测试结果推送与之匹配的康复训练任务。
  3. 如权利要求1或2所述的基于虚拟现实的癌症相关认知障碍评估与康复训练系统，其特征在于，所述评估系统还包括针对老年癌症患者进行轻度痴呆筛查的轻度痴呆评估系统，所述康复系统包括与所述轻度痴呆评估系统对应的VR沉浸式怀旧体验系统。
  4. 如权利要求3所述的基于虚拟现实的癌症相关认知障碍评估与康复训练系统，其特征在于，所述轻度痴呆评估系统包括：
    即刻回忆测试模块，语音播报提示患者从VR场景中挑选指定物体，并在语音播报完成后由患者操作VR控制器选择相应物件将其放置于箱子中；
    地形记忆测试模块，语音播报提示患者记忆VR场景中的照片顺序，然后再15s后自动打乱照片顺序，再语音播报提示患者通过VR控制器将照片按照之前记忆的顺序逐一排序放回原位；
    前瞻性记忆测试模块，语音播报提示患者在VR场景中执行带钱包出门买菜或逛街的任务，并在该语音播报3s后播报干扰语音；
    理解能力测试模块，语音提示患者准备做一道菜，然后按照语音播报逐步完成各项做菜动作。
  5. 如权利要求3所述的基于虚拟现实的癌症相关认知障碍评估与康复训练系统，其特征在于，所述VR沉浸式怀旧体验系统包括通用性怀旧模块和特异性怀旧模块，患者按照指引进入通用性怀旧模块或特异性怀旧模块的VR怀旧体验场景，并在语音播报提示下观察场景内的各物件，按照语音播报提示熟悉场景。
  6. 如权利要求1或2所述的基于虚拟现实的癌症相关认知障碍评估与康复训练系统，其特征在于，所述评估系统还包括对患者的口语表达和言语理解进行测评的言语障碍评估系统，所述康复系统包括与所述言语障碍评估系统相对应的VR言语康复训练系统。
  7. 如权利要求6所述的基于虚拟现实的癌症相关认知障碍评估与康复训练系统，其特征在于，所述言语障碍评估系统包括词语命名评测模块、词语复述评测模块、自发语言评测模块、图片识别评测模块及言语执行评测模块；
    所述词语命名评测模块，语音播报并显示一张图片，图片内容显示不同物件，并由患者逐一回答图片的内容；
    所述词语复述评测模块，画面提示需要复述的文字内容，语音播报提示进行复述并语音播报需要复述的文字；
    所述自发语言评测模块，语音提示患者进行自发性言语，如从1数到10；
    所述图片识别评测模块，语音播报提示患者指出画面上的物品，由患者通过VR控制器按要求指出相应的内容；
    所述言语执行评测模块，语音播报提示需要执行的操作内容，由患者通过VR控制器按要求进行操作。
  8. 如权利要求6所述的基于虚拟现实的癌症相关认知障碍评估与康复训练系统，其特征在于，所述VR言语康复训练系统包括命名训练模块和情景对话训练模块；
    所述命名训练模块，在VR画面显示命名词语对应的内容模型，由患者观察模型并语音识别输入相应的命名词语；
    所述情景对话训练模块，选择VR对话场景，患者根据设定的情景对话逐一播报理解对话场景目标，并根据目标提示逐一进行作答。
PCT/CN2021/116733 2021-07-01 2021-09-06 基于虚拟现实的癌症相关认知障碍评估与康复训练系统 WO2023272935A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110746318.4 2021-07-01
CN202110746318.4A CN113413532B (zh) 2021-07-01 2021-07-01 基于虚拟现实的癌症相关认知障碍评估与康复训练系统

Publications (1)

Publication Number Publication Date
WO2023272935A1 true WO2023272935A1 (zh) 2023-01-05

Family

ID=77719996

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/116733 WO2023272935A1 (zh) 2021-07-01 2021-09-06 基于虚拟现实的癌症相关认知障碍评估与康复训练系统

Country Status (2)

Country Link
CN (1) CN113413532B (zh)
WO (1) WO2023272935A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117438048A (zh) * 2023-12-20 2024-01-23 深圳市龙岗区第三人民医院 一种精神科患者用心理障碍测评方法及系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105808970A (zh) * 2016-05-09 2016-07-27 南京智精灵教育科技有限公司 一种在线认知评估系统及评估方法
CN110415788A (zh) * 2018-04-27 2019-11-05 深圳市前海安测信息技术有限公司 基于vr技术辅助阿尔茨海默症患者记忆训练的系统及方法
KR20190136314A (ko) * 2018-05-30 2019-12-10 (주)휴먼아이티솔루션 가상현실 기반 시지각 평가 및 처방 시스템
CN110827953A (zh) * 2019-11-14 2020-02-21 复旦大学 基于vr的认知记忆力训练评估系统、方法及存储介质
CN110890140A (zh) * 2019-11-25 2020-03-17 上海交通大学 基于虚拟现实的自闭症康复训练及能力评估系统及方法
CN111063416A (zh) * 2019-11-16 2020-04-24 嘉兴赛科威信息技术有限公司 一种基于虚拟现实的阿尔兹海默症康复训练及能力评估系统

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103327980A (zh) * 2010-11-15 2013-09-25 艾吉因生物股份有限公司 用于治疗认知障碍的苯并二吖庚因衍生物、组合物和方法
PT2991507T (pt) * 2013-04-22 2019-11-12 Smartfish As Utiização de uma composição utilizando óleo de peixe e sumo para o tratamento e/ou pós-tratamento do cancro
CN105078449B (zh) * 2015-08-24 2018-07-20 华南理工大学 基于健康服务机器人的老年痴呆症监护系统
CN204971278U (zh) * 2015-08-24 2016-01-20 华南理工大学 基于健康服务机器人的老年痴呆症监护系统
US20180170941A1 (en) * 2016-12-19 2018-06-21 Agenebio, Inc. Benzodiazepine derivatives, compositions, and methods for treating cognitive impairment
CN106951717A (zh) * 2017-03-31 2017-07-14 山东富优生命科学有限公司 一种儿童注意力缺陷多动障碍治疗系统
CN109887569A (zh) * 2019-01-30 2019-06-14 上海市精神卫生中心（上海市心理咨询培训中心） 基于vr的神经发育障碍点数计算辅助训练系统及训练方法
CN110335681A (zh) * 2019-05-09 2019-10-15 哈尔滨医科大学 一种用于老年痴呆预警系统及预警方法
CN110292513A (zh) * 2019-06-03 2019-10-01 东莞佰和生物科技有限公司 服务于老年痴呆患者康复训练的智能机器人系统
CN211068962U (zh) * 2019-11-12 2020-07-24 山西医科大学第一医院 一种老人用的卡牌认知训练工具

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105808970A (zh) * 2016-05-09 2016-07-27 南京智精灵教育科技有限公司 一种在线认知评估系统及评估方法
CN110415788A (zh) * 2018-04-27 2019-11-05 深圳市前海安测信息技术有限公司 基于vr技术辅助阿尔茨海默症患者记忆训练的系统及方法
KR20190136314A (ko) * 2018-05-30 2019-12-10 (주)휴먼아이티솔루션 가상현실 기반 시지각 평가 및 처방 시스템
CN110827953A (zh) * 2019-11-14 2020-02-21 复旦大学 基于vr的认知记忆力训练评估系统、方法及存储介质
CN111063416A (zh) * 2019-11-16 2020-04-24 嘉兴赛科威信息技术有限公司 一种基于虚拟现实的阿尔兹海默症康复训练及能力评估系统
CN110890140A (zh) * 2019-11-25 2020-03-17 上海交通大学 基于虚拟现实的自闭症康复训练及能力评估系统及方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117438048A (zh) * 2023-12-20 2024-01-23 深圳市龙岗区第三人民医院 一种精神科患者用心理障碍测评方法及系统
CN117438048B (zh) * 2023-12-20 2024-02-23 深圳市龙岗区第三人民医院 一种精神科患者用心理障碍测评方法及系统

Also Published As

Publication number Publication date
CN113413532B (zh) 2022-03-01
CN113413532A (zh) 2021-09-21

Similar Documents

Publication Publication Date Title
Garzón et al. How do pedagogical approaches affect the impact of augmented reality on education? A meta-analysis and research synthesis
Sun 5G joint artificial intelligence technology in the innovation and reform of university English education
Dechsling et al. Virtual reality and naturalistic developmental behavioral interventions for children with autism spectrum disorder
Clabaugh et al. Designing a socially assistive robot for personalized number concepts learning in preschool children
Bao Application of virtual reality technology in film and television animation based on artificial intelligence background
Xu et al. From psychomotor to ‘motorpsycho’: Learning through gestures with body sensory technologies
CN109876264A (zh) 一种神经发育障碍患者感统辅助训练方法及系统
Hart et al. How virtual reality training can win friends and influence people
CN107993170A (zh) 一种基于虚拟现实技术的心理健康教育系统
WO2023272935A1 (zh) 基于虚拟现实的癌症相关认知障碍评估与康复训练系统
Lo et al. Virtual reality human–robot interaction technology acceptance model for learning direct current and alternating current
Goosen Technology Opening New Worlds for Those with Autism–an Overview
Xiaohong et al. The application of artificial intelligence in modern foreign language learning
Agustina et al. The Application of Interactive E-Module Based on Android to Enhance Students’ Learning Outcome (A Useful Learning App in the Covid-19 Era)
Guan et al. Application of artificial intelligence and wireless networks to music teaching
Ma [Retracted] Teaching Mode of Augmented Reality College English Listening and Speaking Supported by Wearable Technology
Jiang et al. Relying on multi-modal contextual cross-cultural communication ability training big data analysis
Gilardi et al. Nursing XR–A VR application to teach decision making to student nurses
Dongas Special Session—Designing Virtual Learning Experiences: Iterating Immersive Environments
Xiao et al. Promotion of VR technology in Taijiquan multimedia edge computing technology
Van Helvert et al. Observing, coaching and reflecting: A multi-modal natural language-based dialogue system in a learning context
Schipor et al. End-User Recommendations on LOGOMON-a Computer Based Speech Therapy System for Romanian Language
Trubina et al. The impact of e-learning in the education in the information society
CN117789563B (zh) 基于ai和mr技术虚实融合模拟医学教学方法和系统
Chen Interactive Design of Immersive First Aid Skills Teaching Based on Multimedia Devices

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21947868

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21947868

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 21947868

Country of ref document: EP

Kind code of ref document: A1