WO2022057840A1 - 脑认知功能检测系统 - Google Patents

脑认知功能检测系统 Download PDF

Info

Publication number
WO2022057840A1
WO2022057840A1 PCT/CN2021/118615 CN2021118615W WO2022057840A1 WO 2022057840 A1 WO2022057840 A1 WO 2022057840A1 CN 2021118615 W CN2021118615 W CN 2021118615W WO 2022057840 A1 WO2022057840 A1 WO 2022057840A1
Authority
WO
WIPO (PCT)
Prior art keywords
brain
data
module
brain cognitive
server
Prior art date
Application number
PCT/CN2021/118615
Other languages
English (en)
French (fr)
Inventor
顾勇
蒲慕明
李澄宇
杨天明
崔翯
王立平
徐宁龙
常乐
叶铮
包一川
Original Assignee
中国科学院脑科学与智能技术卓越创新中心
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国科学院脑科学与智能技术卓越创新中心 filed Critical 中国科学院脑科学与智能技术卓越创新中心
Publication of WO2022057840A1 publication Critical patent/WO2022057840A1/zh

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]

Definitions

  • the present application relates to the medical and health field, and in particular, to a brain cognitive function detection system.
  • the brain as the most advanced and complex organ of the human nervous system, not only controls human movement, sensation, and language, but also occupies an absolute dominant position in psychology and emotion.
  • the brain produces organic lesions, it usually causes significant behavioral or affective symptoms related to brain function.
  • many diseases directly produce brain function or emotional disorders, but no definite evidence of brain organic lesions has been found, or evidence of brain function qualitative lesions cannot be directly obtained in the early stage of the disease. Under such circumstances, the help of imaging examinations for disease diagnosis is limited, and the correspondence between human behavior, mental state and disease becomes crucial.
  • the diagnosis of some diseases related to brain function is mainly based on the scores of manuals or scales, as well as the observation and empirical judgment of doctors.
  • the usual routine diagnosis process includes asking the patient himself and the patient's family about the medical history, analyzing and summarizing mental symptoms by medical staff through mental state examination, and assessing the physical health status through physical examination, laboratory examination and other methods. Conduct a systematic assessment.
  • the final diagnosis is often based on the doctor's understanding of the medical history and the summary of mental symptoms and their comparison with empirical manuals and scales, and finally the diagnosis of mental illness is obtained.
  • this diagnostic method is highly subjective, and the manifestations of psychiatric symptoms or brain dysfunction symptoms are often intersected in different diseases, and many disease indications overlap each other.
  • the diagnostic method is relatively single, and the indicators that can be reflected are limited.
  • the diagnosis of a specific disease in a specific population is often multi-directional, and each expert often has different opinions and different judgment indicators for the same disease, which leads to the development of testing methods and tools. different.
  • a more complex differential diagnosis experiment is carried out, such as in the form of question and answer, it is monotonous and cumbersome, and the interactive function experience is poor, which will easily bring fatigue to the tester.
  • it is often difficult for some patients with poor compliance or physical incompetence. Therefore, inconsistent conclusions are often obtained due to the diagnosis of different hospitals or different doctors, which increases the uncontrollability of the guidance and implementation of subsequent treatment plans, thereby affecting the relevant efficacy.
  • a brain cognitive function detection system which has an objective detection system, integrates multiple detection modules, and adopts an interesting game method to provide users with an easy and suitable detection training environment. , which can truly and effectively reflect various quantitative indicators of the user's brain cognitive function.
  • the purpose of this application is to provide a brain cognitive function detection system, which has an objective detection system, integrates multiple detection modules, and adopts an interesting game method to provide users with an easy and suitable detection training.
  • the environment can truly and effectively reflect the quantitative indicators of the user's brain cognitive function to the greatest extent possible.
  • the present invention provides a brain cognitive function detection system, comprising:
  • a brain cognitive toolset game software is preset on the server, the server is configured to store and manage user data and data feature database, and update, run and maintain the brain cognitive toolset game software;
  • one or more client devices configured to execute brain-cognitive toolset game software from the server,
  • the external expansion devices are configured to collect detection data that can be used to evaluate brain cognitive function of the object to be detected during game play;
  • the external expansion devices include selected from the group consisting of: eye movement device, EEG acquisition device, motion sensing sensor, or a combination thereof;
  • the background management module is configured to receive, process and maintain the detection data collected by the external expansion device that can be used to evaluate brain cognitive function;
  • a brain cognitive function analysis module configured to perform analysis and comparison based on the detection data provided by the background management module, so as to provide a brain cognitive function detection result of the object to be detected.
  • the brain cognitive toolset game software can be used to collect behavioral data and test data for training and evaluating brain cognitive function.
  • the background management module is configured to receive, process and maintain the behavioral data collected by the game software and the data collected by the external expansion device that can be used to evaluate brain cognition. function detection data.
  • one or more game scenarios for testing the cognitive function of the brain are embedded.
  • the client device includes a mobile device and/or a fixed device.
  • the client device is selected from the group consisting of a computer, a tablet computer and/or a mobile phone.
  • the client device runs the game program.
  • system further includes a host, which is connected in communication with the external expansion device, and is configured to operate, control and manage the external expansion device, and receive information from the external expansion device. Test data.
  • the host also transmits the received detection data of the external expansion device and behavioral data collected by the game software to the background management module.
  • the host is selected from the group consisting of a computer and a tablet computer.
  • the host device and the client device may be the same device.
  • the data feature library includes data selected from the following group: feature index types of brain cognitive function, parameter values of feature indexes, reference data of detected values of feature indexes, types of neural networks, neural network The feature of the network, the weight of the neural network, the branch conditions of the game task, the correspondence between diseases and tasks.
  • the feature index type is selected from the following group: cognitive control ability, memory, sequence reversal ability, attention, image recognition ability, face recognition ability, sequence reversal ability, inhibitory control ability, Manual ability, language expression ability, auditory perception ability, smell perception ability and spatial navigation ability.
  • the detection data includes: eye movement data, brain wave data, behavioral data, motion capture data, or a combination thereof.
  • the external expansion device further includes a position sensor, an acceleration sensor, a VR device, an AR device, an olfactory test card, and an EEG electroencephalogram acquisition device.
  • the external expansion device further includes an electromyography instrument and a motion platform.
  • the eye tracker is used to capture eye movement signals, including saccade, microsaccade, smooth pursuit, fixation, vergence, eyeball Tremor (OKN, Optokinetic nystagmus) and blink (blink).
  • eye movement signals including saccade, microsaccade, smooth pursuit, fixation, vergence, eyeball Tremor (OKN, Optokinetic nystagmus) and blink (blink).
  • n brain cognitive function test modules are embedded in the same game scene of the brain cognitive toolset game, where n is a positive integer greater than or equal to 3, and the brain cognitive function test
  • the modules are selected from the following group: a memory test module, a sequence reversal ability test module, an attention test module, an image recognition ability test module, and a face recognition ability test module.
  • the brain cognitive function test module may further include: inhibitory control ability test module, manual ability test module, language expression ability test module, auditory perception ability test module, reaction speed test module, flexibility test module, mathematical ability test module, word ideographic test module, planning ability test module, spatial navigation ability test module, olfactory perception ability test module, and cognitive control ability test module.
  • the attention module includes distraction attention, selective attention, time control and synchronized attention.
  • the memory module includes spatial memory, long-term memory, and working memory.
  • the brain cognitive toolset game includes one or more main line tasks, and the main line tasks can optionally be connected in series with a plurality of small tasks.
  • each small task can simultaneously measure a single or multiple objects to be measured.
  • the small tasks include chasing thieves, Stroop test, finding gold coins, drawing lottery, recognizing faces, picking fruits, and avoiding crocodiles.
  • the main line tasks include survival, treasure hunt, adventure, person-seeking, tracking, expedition, exploration, rescue, war, crossing, sailing, traveling, daily life, or a combination thereof.
  • the game duration of each main task of the brain cognitive toolset game is 10 minutes to 0.5 hours.
  • the brain cognitive toolset game can adjust the difficulty of the next game task correspondingly according to the game task result of the detection object, so as to obtain a more accurate brain cognitive function detection result of the detection object.
  • the theme of the game scene of the brain cognitive toolset game is selected from the following group: survival, treasure hunt, adventure, search for people, tracking, exploration, exploration, rescue, war , crossing, sailing, traveling, everyday, or a combination thereof.
  • the type of the brain cognitive toolset game is selected from the following group: action, fighting, adventure, role-playing, simulation games, strategy games, shooting, racing, sports, Music games, puzzle games, sandbox, elimination, parkour, flying, chess and cards, puzzle solving, sports, music and dance, development, strategy and chess, tabletop, spoofs , ported games, or a combination thereof.
  • the game modes of the brain cognitive toolset game include: a single-player game and an online game.
  • the server includes:
  • a local server for storing and managing user data, data feature database, and updating and maintenance of brain cognitive toolset game software
  • a system server (or a second server), the system server is used to issue a new version of the brain cognitive toolset game software to the local server, to obtain detection data from the local server, and to update the feature database.
  • the local server is further configured to analyze (or briefly analyze) local brain cognitive function detection data.
  • system server is further configured to analyze (or deeply analyze) the acquired brain cognitive function detection data.
  • the local server and the system server can be combined or split.
  • the local server includes:
  • the storage module is configured to store the brain cognitive toolset game software
  • the user database is configured to store data selected from the following group: basic information of the object to be detected, grouping marks, test results, and dynamic status data of cognitive abilities;
  • the data feature library is used for storing data features
  • An analysis module the analysis module is used for data analysis, auxiliary diagnosis and ability level division on the detection data.
  • the client includes:
  • the display interface is configured to display a brain cognitive toolset game software interface
  • the input module is configured to obtain the personal data, grouping, disease classification and detection data of the object to be detected;
  • the storage module is configured to store the brain cognitive toolset game software and user data
  • a processing module configured to read and execute the brain cognitive toolset game software
  • the sending module is configured to send the obtained user data test result to the server;
  • the receiving module is configured to obtain the analysis result of the server and the update push of the game software of the brain cognition toolset.
  • the brain detection system can be used for brain function training.
  • the brain detection system can be used for brain function training and brain function detection at the same time.
  • the objects to be detected include: objects with impaired brain cognitive function, objects with normal brain cognitive function, and objects at risk of brain cognition-related diseases.
  • FIG. 1 shows a schematic connection diagram of a part of a brain function detection system according to an embodiment of the present invention
  • FIG. 7 shows a schematic flowchart of training brain cognitive function in an embodiment of the present invention.
  • FIG. 8 shows the main task of the game software and a plurality of small tasks connected in series with it in an embodiment of the present invention
  • the brain cognitive function detection and training system integrates multiple detection modules and adopts interesting game
  • the method provides users with an easy and suitable testing and training environment, which can truly and effectively reflect various quantitative indicators of the user's brain cognitive function to the greatest extent possible.
  • the brain cognition toolset game of the present invention is composed of a plurality of interconnected game scenes, and each scene can simultaneously reflect a variety of brain cognition indicators of the user, thereby improving the detection efficiency.
  • Expansion devices include AR devices, eye trackers, EEG acquisition devices, olfactory test cards, and motion sensing sensors, which are used to provide objective user data in more dimensions to assist in detection and analysis.
  • a brain cognitive toolset game software is preset on the server, and the server is configured to store and manage user data and data feature database, and update, run and maintain the brain cognitive toolset game software;
  • Figure 1 and Figure 2 show a schematic diagram of the connection relationship between the client and the server;
  • the server includes a local server and a system server (refer to FIG. 2 ), and the local server is used for storing and managing user data, data feature database, and updating and maintenance of the game software of the brain cognitive toolset.
  • the server can be directly arranged on the client to achieve the purpose of off-net detection.
  • the system can perform tasks with multiple people and multiple clients at the same time.
  • the brain cognitive function detection system of the present invention will simultaneously detect multiple levels of brain cognitive ability in the same scene, and the main cognitive indicators tested by the brain cognitive function detection system include cognitive control ability, memory, sequence reversal ability, Attention, image recognition ability, facial recognition ability, inhibitory control ability, manual ability, language expression ability, auditory perception ability, smell perception ability and spatial navigation ability, etc.
  • Memory includes spatial memory, long-term memory, working memory, etc.
  • Attention includes distraction, selective attention, time control, synchronized attention, etc.
  • Each small task in the scene will simultaneously detect multiple indicators to be measured without the user's obvious awareness, such as the simultaneous measurement of attention, image recognition ability, reverse operation, suppression operation, manual detection and follow-up when chasing a thief. face recognition; sequence reversal ability, spatial memory, and partial risk decision-making ability were measured when no map was reported.
  • the brain cognitive function detection system of the present invention can perform detection in a dedicated place or a non-dedicated place (eg, the user's home).
  • Fig. 3 a schematic diagram of a dedicated brain function testing place (or room design) is also shown.
  • computer 1 is the client device
  • computer 2 is the host with an external expansion device
  • computer 1 and computer 2 are connected by network cables
  • the gray area is a soundproof dark room, which is the test area mainly used for testing EEG and eye movement tasks.
  • the white area is the main test area, mainly used for testing sports, etc.
  • a brain cognitive toolset game software is preset on the server, and the server is configured to store and manage user data and data feature database, and update, run and maintain the brain cognitive toolset game software ( Figure 1 and Figure 2).
  • the server includes a local server and a system server, and the local server is used for storing and managing user data, data feature database, and updating and maintenance of game software of brain cognitive toolset.
  • the system server is used for issuing a new version of the brain cognitive toolset game software to the local server, for obtaining detection data from the local server and updating the feature database.
  • the local server includes a user database
  • the user database is used to store data such as basic information of each user, test results, and dynamic status of cognitive abilities.
  • the local server is further configured to analyze (or briefly analyze) local brain cognitive function detection data.
  • system server is further configured to analyze (or deeply analyze) the acquired brain cognitive function detection data.
  • the server can be directly arranged on the terminal to achieve the purpose of off-net detection.
  • This system can perform tasks with multiple people and multiple terminals at the same time, and the whole system can be operated by means of commercial Internet, dedicated line or local area network and other channels.
  • the server is used to store, manage user data, and maintain version updates.
  • the terminal is used to display the content of the present invention to the user, and to generate user data through human-computer interaction.
  • Background management software is used to control system operation, process and maintain data, and provide data for analysis software.
  • Analytical software is used to systematically analyze and compare all relevant data and present the analytical results.
  • the present invention will establish a broad-spectrum large database for storing the user's original data and analyzed data, and store them in an anonymized form.
  • Eye trackers are used to capture eye movement signals, including saccade, microsaccade, smooth pursuit, fixation, vergence, nystagmus (OKN, Optokinetic nystagmus) and blinking (blink).
  • AR devices are used for the learning and experience of game usage prompts, as well as the realization of game scenes.
  • the eye tracker is used to monitor the user's eye movement in real time.
  • Motion-aware sensors are used to monitor indicators of athletic ability of the user's limbs.
  • the EEG acquisition device is used to monitor the user's EEG during the detection process.
  • the hardware part of the brain cognitive function detection system of the present invention is mainly composed of three components: a client device (display PC), a local server and a system server; for some external expansion devices such as eye trackers, EEGs, motion sensors, etc. , it is necessary to provide the host PC (host PC) of the external expansion device beside the client device.
  • the host of the external expansion device is generally a mobile or fixed computer or tablet, which is used to run the control and data receiving program of the external expansion device.
  • the data of the client device and the external expansion device are transferred to the local server for storage, and then the local analysis of the data begins.
  • the data will be simply classified and grouped according to the indicators in the local broad-spectrum feature database, and a simple report will be generated, which mainly includes the reference range of each score in the whole, such as: a certain item shows the response of the subject The speed is in the top 50%-60% of all subjects, and in the top 20%-30% in their age range (45-55 years old).
  • the corresponding labels are then given: when used in the hospital, it will show whether there is a risk of related diseases, as well as the number of the disease. These diseases require the assistance of doctors to check in the early stage of the product, and the diagnosis opinion will be given directly after the product matures in the later stage; During the selection, the indicators that the subjects are good at and job-hunting suggestions will be marked.
  • test data When used in the hospital, the test data will be regularly uploaded to the system server along with the doctor's diagnostic opinion for system analysis, and various parameter characteristics of various diseases will be analyzed according to the main test label, doctor's diagnostic opinion and other information, and the characteristics will be stored in the system.
  • Broad spectrum signature library When used in the hospital, the test data will be regularly uploaded to the system server along with the doctor's diagnostic opinion for system analysis, and various parameter characteristics of various diseases will be analyzed according to the main test label, doctor's diagnostic opinion and other information, and the characteristics will be stored in the system.
  • the subject data When used in other environments, the subject data will also be regularly uploaded to the system server for system analysis, which will be used to correlate with hospital data, establish long models, and find disease predictive indicators.
  • test data will generate a secondary report and push it to each test subject.
  • the test subject can log in to the relevant page through their own device to view it, and provide it to the doctor for reference during the follow-up visit.
  • the secondary report will describe the subjects' various indicators in a more professional and detailed manner, including the processed eye trajectory map, manual trajectory map, and motion path map.
  • the system server will be controlled and operated by the product company.
  • the system server and the local server can be combined and placed in each unit or organization, and each unit will maintain it by itself.
  • the product company provides technical support services.
  • the brain function training version will be released in the form of software, which can be installed and used on the user's own device, or additional extended devices can be added for practice.
  • the manufacturer provides the server for software update push, data collection and analysis. It is used to train detection items similar to the test version, improve operational proficiency and improve corresponding brain function indicators.
  • the item and difficulty of the task will be dynamically adjusted according to the performance of the subjects.
  • Different user groups use different combinations of game scenarios and different difficulty gradients. That is to say, the client software also provides a variety of difficulty gradient algorithms, and different user groups use different combinations of game scenarios and different difficulty gradients.
  • a test report is given to provide assistance for subsequent diagnosis and treatment.
  • the overall design is that a main task is connected with multiple small tasks. Each small task can measure multiple indicators to be tested at the same time. It provides users with an easy and suitable detection and training environment, and reflects various quantitative indicators of the user's brain cognitive function as truly, effectively and naturally as possible. The task process will also be adjusted according to the user's own characteristics to make the results more objective and routine.
  • the system will give the user's brain function indicator status, these indicators will prompt the user's brain cognitive deficit, and the probability of occurrence of a certain brain disease, and recommend to the user that specific game scenarios can be used to improve These cognitive levels of the brain can thus realize the docking from the detection module to the training module.
  • the game scene themes that can be used in the present invention include survival, treasure hunting, adventure, people finding, tracking, exploration, exploration, rescue, war, crossing, sailing, travel, daily life, and the like.
  • the game content selected for the test version will be slightly different, resulting in slightly different mission objectives, options and answers, and the optimal strategy for completing the mission and the random number of random numbers. Seeds etc will also vary.
  • the brain cognitive toolset game software can be used to collect behavioral data and test data for training and evaluating brain cognitive function.
  • the game version of the Brain Cognitive Toolset is interesting and easy to understand. By playing the game, users can test a number of cognitive ability indicators while playing the game.
  • the user When the user exits the game, they can check the user's current brain cognitive level, and enter the targeted brain cognitive function improvement module game according to the suggestions of the test results. Different combinations of brain cognitive function defects can enter different training games. .
  • the brain cognitive toolset game can adjust the difficulty of the next game task correspondingly according to the game task result of the detection object, so as to obtain a more accurate brain cognitive function detection result of the detection object.
  • the game duration of each main task of the brain cognitive toolset game is not particularly limited, and is typically 10 minutes to 0.5 hours.
  • n brain cognitive function test modules are embedded in the same game scene of the brain cognitive toolset game, where n is a positive integer greater than or equal to 3, and the brain cognitive function test modules are selected from the following group: memory Test module, sequence reversal ability test module, attention test module, image recognition ability test module, and face recognition ability test module.
  • the brain cognitive function test module may further include: inhibitory control ability test module, manual ability test module, language expression ability test module, auditory perception ability test module, reaction speed test module, flexibility test module, math ability test module, Text ideographic test module, planning ability test module, and spatial navigation ability test module.
  • the present invention will use a main task to connect multiple sub-tasks in a game-like manner, and each sub-task can simultaneously measure multiple indicators to be tested, which not only makes the user's training and testing coherent, but also improves the performance of training and testing.
  • we slowly immerse our in the designed scene provide users with an easy and suitable testing and training environment, and reflect various quantitative indicators of the user's brain cognitive function as truly, effectively and naturally as possible.
  • the task process will also be adjusted according to the user's own characteristics to make the results more objective and routine.
  • the system When the user completes the detection or training, the system will give the user's brain function indicator status, these indicators will prompt the user's brain cognitive deficit, and the probability of occurrence of a certain brain disease, and recommend to the user that specific game scenarios can be used to improve These cognitive levels of the brain can thus realize the docking from the detection module to the training module.
  • the game also includes more scenes to increase the appeal and interest and broaden the detection items.
  • the small tasks include chasing thieves, Stroop test, looking for gold coins, drawing lottery, recognizing faces, picking fruits, and avoiding crocodiles.
  • the main tasks include survival, treasure hunt, adventure, person-seeking, tracking, expedition, exploration, rescue, war, crossing, sailing, traveling, daily life, or a combination thereof.
  • FIG. 4 and FIG. 5 a representative scene design is shown in FIG. 4 and FIG. 5 .
  • the difficulty of the task and then select the type and parameters of the next task.
  • the initial task can be designed as a simple NPC dialogue or questionnaire and related multiple-choice questions, calculation questions, etc.
  • it is analyzed whether it conforms to the relevant disease characteristics or grouping characteristics. After all is completed, mark it as healthy or the corresponding disease and grouping of each item.
  • FIG. 6 shows a flow chart of main events occurring in the client, the local server and the system server in an embodiment for diagnosis in a hospital.
  • FIG. 7 shows a flow chart of the main events that occur between the client and the server in an embodiment where the mobile terminal is used for training.
  • FIG. 8 shows the main line task of the game software and a plurality of small tasks connected in series with it in one embodiment.
  • Figure 9 shows a schematic diagram of the small task of finding gold coins.
  • the scene is generated, many gold coins of different difficulty are generated and hidden in the appropriate position of the scene.
  • the user controls the activities of the simulated characters, if they notice a similar pattern of gold coins, they can switch to the search perspective to find the gold coins in the current perspective, and obtain the attention-related score according to the number of gold coins activated by the user's field of vision and the number of gold coins found. .
  • Figure 10 shows a schematic diagram of the square scene.
  • the theft scenario will be triggered, and then they need to complete the anti-pro task to hunt down the thief, and then complete the reversal task by recalling the path they traveled before and return to the police station to report the case.
  • multiple detections of brain cognitive function can be performed at one time, and detection data such as eye movement data, brain wave data, behavioral data, and motion capture data can be obtained.
  • test data can be analyzed (or briefly analyzed) on the local server to obtain preliminary brain cognitive function test results.
  • these detection data can be uploaded to the system server for further analysis (or in-depth analysis), so as to obtain more detailed brain cognitive function detection results (including a variety of broad-spectrum features).
  • the game scene of the brain cognitive function detection system of the present invention is interesting, the detection task time is short, and multiple levels of brain cognitive ability are simultaneously detected in the same scene;
  • the brain cognitive function detection system of the present invention adopts a variety of difficulty gradient algorithms, and the game scene combinations used by different user groups are different, and the difficulty gradients are also different, thereby making the brain cognitive function detection more effective and accurate;
  • the brain cognitive function detection system of the present invention can establish a dynamic cognitive ability detection model, save and analyze data in real time, and efficiently complete the monitoring work;
  • the brain cognitive function detection system of the present invention can complete the establishment of a large-capacity database, and save the original data of each client and the analyzed data results.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Pathology (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Physiology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

一种脑认知功能检测系统,包括:一服务器、一个或多个客户端设备、一个或多个外接扩展设备、一后台管理模块和一脑认知功能分析模块;服务器上预设有一脑认知工具集游戏软件,服务器被配置为存储和管理用户数据和数据特征库,以及更新、运行和维护脑认知工具集游戏软件;外接扩展设备被配置为采集待检测对象在玩游戏过程中的可用于评估脑认知功能的检测数据;脑认知功能检测系统具备客观的检测体系,并整合了多个检测模块,采取有趣味性的游戏的方式,为用户提供一个轻松适合的检测训练环境,最大限度的真实地有效反映出用户的脑认知功能的各项定量化的指标。

Description

脑认知功能检测系统 技术领域
本申请涉及医疗健康领域,特别涉及一种脑认知功能检测系统。
背景技术
大脑,作为人体神经系统最高级、最复杂器官,不仅控制了人的运动、感觉、语言,更在心理、情绪上占据了绝对的主导地位。当大脑产生器质性病变时,通常会引发显著的脑功能相关的行为症状或情感症状。然而,很多疾病却直接产生脑功能或情绪障碍,却始终无法找到确切的脑器质性病变证据,或者在疾病的早期还无法直接获得脑功能质性病变证据。那么在这样的情况下,影像学检查对于疾病诊断的帮助就有所限制,而人体行为、精神状态与疾病的对应性就变得至关重要。
长期以来,对于脑功能相关的一些疾病的诊断,主要依据的是手册或量表的评分以及医生的观察和经验性判断。以精神性疾病为例,通常常规的诊断流程包括向患者本人及患者家属询问病史、通过精神状况检查而由医务人员分析总结出精神症状,以及通过查体、实验室检查等方法对躯体健康状况进行系统性评估。然而最终的诊断往往基于医生对病史的了解以及精神症状的归纳总结及其与经验性手册和量表的比对,最后得出精神性疾病的诊断。
但是,这种诊断方法带有较大的主观性,而精神症状或脑功能障碍症状的表现在不同疾病中往往又有交叉性的表现、很多疾病指征存在互相重叠的现象,传统的检测和诊断方法相对单一,能反映的指标有限,对于特定人群的特定疾病的诊断往往具有多向性,而每个专家针对同一病症往往有不同的见解和不同的判断指标,从而导致了测试方法工具的不同。而若进行更为复杂的鉴别诊断实验,例如采用问答的形式,单调繁琐,交互功能体验差,容易给测试者带来疲劳感,检测结论依赖提问者的判断力和病人的自述内容较为主观,另外对一些依从性较差或在体力上无法胜任的患者而言,往往很难完成。所以经常因不同的医院或不同的医生诊断而得到不一致的结论,这增加了后续治疗方案的指导和实施的不可控性,从而影响相关疗效。
因此,本领域急需开发一种脑认知功能检测系统,该系统具备客观的检测体系,并整合了多个检测模块,采取有趣味性的游戏的方式,为用户提供一个轻松 适合的检测训练环境,最大限度的真实地有效反映出用户的脑认知功能的各项定量化的指标。
发明内容
本申请的目的在于提供一种脑认知功能检测系统,所述系统具备客观的检测体系,并整合了多个检测模块,采取有趣味性的游戏的方式,为用户提供一个轻松适合的检测训练环境,最大限度的真实地有效反映出用户的脑认知功能的各项定量化的指标。
本发明提供了一种脑认知功能检测系统,包括:
一服务器,所述服务器上预设有一脑认知工具集游戏软件,所述服务器被配置为存储和管理用户数据和数据特征库,以及更新、运行和维护脑认知工具集游戏软件;
一个或多个客户端设备,所述客户端设备被配置为执行来自所述服务器中的脑认知工具集游戏软件,
一个或多个外接扩展设备,所述外接扩展设备被配置为采集待检测对象在玩游戏过程中的可用于评估脑认知功能的检测数据;所述外接扩展设备包括选自下组:眼动仪、脑电采集设备、运动感知传感器、或其组合;
一后台管理模块,所述后台管理模块被配置为接收、处理和维护所述外接扩展设备所采集的可用于评估脑认知功能的检测数据;和
一脑认知功能分析模块,所述分析模块被配置为基于所述后台管理模块提供的检测数据,进行分析和对比,从而提供待检测对象的脑认知功能检测结果。
在另一优选例中,所述脑认知工具集游戏软件可用于收集训练和评估脑认知功能的行为学数据和测试数据。
在另一优选例中,所述后台管理模块,所述后台管理模块被配置为接收、处理和维护所述游戏软件收集的行为学数据及所述外接扩展设备所采集的可用于评估脑认知功能的检测数据。
在另一优选例中,在所述的游戏软件中,内嵌了用于测试脑认知功能的一个或多个游戏场景。
在另一优选例中,所述的客户端设备包括移动设备和/或固定设备。
在另一优选例中,所述的客户端设备选自下组:电脑、平板电脑和/或手机。
在另一优选例中,所述的客户端设备运行所述的游戏程序。
在另一优选例中,所述系统还包括一主机,所述主机与所述外接扩展设备通信连 接,并且被配置为运行、控制和管理所述外接扩展设备,并接收所述外接扩展设备的检测数据。
在另一优选例中,所述的主机还将接收的所述外接扩展设备的检测数据和游戏软件收集的行为学数据传输给所述的后台管理模块。
在另一优选例中,所述主机选自下组:电脑、平板电脑。
在另一优选例中,所述主机和客户端设备可为同一设备。
在另一优选例中,所述数据特征库包含选自下组的数据:脑认知功能的特征指标类型、特征指标的参数值、特征指标的检测值的参考数据、神经网络的类型、神经网络的特征(feature)、神经网络的权重(weight)、游戏任务分支条件、疾病和任务的对应关系。
在另一优选例中,所述的特征指标类型选自下组:认知控制能力、记忆力、序列反转能力、注意力、图像识别能力、面部识别能力、序列反转能力、抑制控制能力、手动能力、语言表达能力、听知觉能力、嗅觉感知能力和空间导航能力。
在另一优选例中,所述的检测数据包括:眼动数据、脑电波数据、行为学数据、运动捕捉数据、或其组合。
在另一优选例中,所述外接扩展设备还包括位置传感器、加速度传感器、VR设备、AR设备、嗅觉测试卡、EEG脑电采集设备。
在另一优选例中,所述外接扩展设备还包括肌电仪、运动平台。
在另一优选例中,所述眼动仪用于捕捉眼动信号,包括扫视(Saccade)、微眼动(Microsaccade)、平滑追踪(smooth pursuit)、注视(fixation)、聚集(vergence)、眼球震颤(OKN,Optokinetic nystagmus)和眨眼(blink)。
在另一优选例中,在所述脑认知工具集游戏的同一游戏场景中嵌入了n个脑认知功能测试模块,其中,n为大于等于3的正整数,所述脑认知功能测试模块选自下组:记忆力测试模块、序列反转能力测试模块、注意力测试模块、图像识别能力测试模块、面部识别能力测试模块。
在另一优选例中,所述脑认知功能测试模块还可包括:抑制控制能力测试模块、手动能力测试模块、语言表达能力测试模块、听知觉能力测试模块、反应速度测试模块、灵活性测试模块、数学能力测试模块、文字表意测试模块、计划能力测试模块、空间导航能力测试模块、嗅觉感知能力测试模块、和认知控制能力测试模块。
在另一优选例中,所述注意力模块包括分散注意、选择注意、时间控制和同步注意。
在另一优选例中,所述记忆力模块包括空间记忆、长时间记忆、工作记忆。
在另一优选例中,所述脑认知工具集游戏包括一个或多个主线任务,所述主线任务可任选地串接多个小任务。
在另一优选例中,每个小任务都能同时测出单个或多个待测目标。
在另一优选例中,所述小任务包括追捕小偷、Stroop test、找金币、抽奖、辨认人脸、摘水果、躲避鳄鱼。
在另一优选例中,所述主线任务包括求生、寻宝、冒险、寻人、追踪、探险、探索、救援、战争、穿越、航行、旅游、日常,或其组合。
在另一优选例中,所述脑认知工具集游戏每局主任务的游戏时长为10分钟到0.5小时。
在另一优选例中,所述脑认知工具集游戏可根据检测对象的游戏任务结果而相应的调整下一游戏任务的难度,从而获得检测对象的更加准确的脑认知功能检测结果。
在另一优选例中,按照游戏场景的主题分类,所述脑认知工具集游戏的游戏场景的主题选自下组:求生、寻宝、冒险、寻人、追踪、探险、探索、救援、战争、穿越、航行、旅游、日常,或其组合。
在另一优选例中,所述脑认知工具集游戏的类型选自下组:动作类、格斗类、冒险类、角色扮演、模拟游戏、战略游戏、射击类、竞速类、运动类、音乐游戏、益智游戏、沙盒式、消除类、跑酷类、飞行类、棋牌类、解谜类、体育类、音乐舞蹈类、养成类、策略与战棋类、桌面类、恶搞类、移植游戏,或其组合。
在另一优选例中,所述脑认知工具集游戏的游戏方式包括:单机游戏和联机游戏。
在另一优选例中,所述服务器包括:
本地服务器(或第一服务器),所述本地服务器用于存储、管理用户数据、数据特征库以及脑认知工具集游戏软件的更新和维护;和
系统服务器(或第二服务器),所述系统服务器用于向本地服务器发行新版本脑认知工具集游戏软件、用于从本地服务器获得检测数据以及更新特征数据库。
在另一优选例中,所述的本地服务器还被配置为分析(或简要分析)本地的脑认知功能检测数据。
在另一优选例中,所述的系统服务器还被配置为分析(或深入分析)所获得的脑认知功能检测数据。
在另一优选例中,所述的本地服务器和系统服务器可以合并或拆分。
在另一优选例中,所述本地服务器包括:
一存储模块,所述存储模块被配置为储存所述脑认知工具集游戏软件;
一用户数据库,所述用户数据库配置为存储选自下组的数据:待检测对象的基本信息、分组标记、测试结果、认知能力的动态状况数据;
一数据特征库,所述数据特征库用于储存数据特征;
一分析模块,所述分析模块用于对检测数据进行数据分析、辅助诊断和能力级别划分。
在另一优选例中,所述客户端包括:
一显示界面,所述显示界面被配置为显示脑认知工具集游戏软件界面;
一输入模块,所述输入模块被配置为获取待检测对象的个人资料、分组、疾病分类、检测数据;
一存储模块,所述存储模块被配置为储存所述脑认知工具集游戏软件、以及用户的数据;
一处理模块,所述处理模块被配置为读取并执行所述脑认知工具集游戏软件;
一发送模块,所述发送模块被配置为将获得的用户数据测试结果发送给所述服务器;
一接收模块,所述接收模块被配置为获取服务器的分析结果和所述脑认知工具集游戏软件的更新推送。
在另一优选例中,所述脑检测系统可用作脑功能训练。
在另一优选例中,所述脑检测系统可同时用作脑功能训练和脑功能检测。
在另一优选例中,所述的待检测对象包括:脑认知功能受损的对象、脑认知功能正常的对象、有脑认知相关疾病患病风险的对象。
应理解,在本发明范围内中,本发明的上述各技术特征和在下文(如实施例)中具体描述的各技术特征之间都可以互相组合,从而构成新的或优选的技术方案。限于篇幅,在此不再一一累述。
附图说明
图1显示了本发明一实施例的脑功能检测系统的一部分的连接示意图;
图2显示了本发明另一实施例的脑功能检测系统的一部分的连接示意图;
图3显示了本发明一实施例的脑功能检测场所的示意图;
图4显示了本发明的脑认知工具集游戏的待测疾病和对应脑功能的关系示意图;
图5显示了本发明的脑认知工具集游戏的一例疾病筛查的流程方案的分支示意图;
图6显示了本发明一实施例中对脑认知功能进行检测的流程示意图;
图7显示了本发明一实施例中对脑认知功能进行训练的流程示意图;
图8显示了本发明的一实施例中游戏软件的主线任务和与其串接的多个小任务;
图9显示了本发明的一实施例中脑认知工具集游戏的一个找金币小任务的示意图;
图10显示了本发明一实施例中脑认知工具集游戏的广场场景的示意图。
具体实施方式
本发明人经过广泛而深入的研究,通过大量的试验,首次开发一种脑认知功能检测系统,所述脑认知功能检测和训系统整合了多个检测模块,采取有趣味性的游戏的方式,为用户提供一个轻松适合的检测训练环境,最大限度的真实地有效反映出用户的脑认知功能的各项定量化的指标。本发明的脑认知工具集游戏由多个相互联系的游戏场景组成,每个场景都能同时反映出用户的多种脑认知指标,从而提高检测效率。并且当用户完成检测或训练后,系统将给出用户的脑功能指标状态,这些指标将提示用户的脑认知缺陷,以及某种脑疾病的发生概率,并且向用户推荐可以使用特定的游戏场景提升这些脑认知水平,从而实现从检测模块向训练模块的对接。
在以下的叙述中,为了使读者更好地理解本申请而提出了许多技术细节。但是,本领域的普通技术人员可以理解,即使没有这些技术细节和基于以下各实施方式的种种变化和修改,也可以实现本申请所要求保护的技术方案。
术语
如本文所使用的,“客户端设备”与“客户端”可互换使用。
术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。本专利的申 请文件中,如果提到根据某要素执行某行为,则是指至少根据该要素执行该行为的意思,其中包括了两种情况:仅根据该要素执行该行为、和根据该要素和其它要素执行该行为。多个、多次、多种等表达包括2个、2次、2种以及2个以上、2次以上、2种以上。
脑认知功能检测系统
本发明公开了一种脑认知功能检测系统,包括核心设备和扩展设备两部分。核心设备包括服务器、若干个用于检测的客户端、客户端软件即脑认知工具集游戏版本。
扩展设备包括AR设备、眼动仪、脑电采集设备、嗅觉测试卡和运动感知传感器等,用于在更多维度提供客观的用户数据,辅助检测分析。
在本发明中,所述服务器上预设有一脑认知工具集游戏软件,所述服务器被配置为存储和管理用户数据和数据特征库,以及更新、运行和维护脑认知工具集游戏软件;其中,图1和图2显示了客户端与服务器的连接关系示意图;
典型地,服务器包括本地服务器和系统服务器(参考图2),所述本地服务器用于存储、管理用户数据、数据特征库以及脑认知工具集游戏软件的更新和维护。
优选地,服务器可以被直接布置于客户端以达到脱网检测的目的,该系统可以多人多客户端同时进行任务,整套系统可以依托商业互联网、专线或者本地局域网等渠道运行。
本发明的脑认知功能检测系统将在同一场景同时检测出多项脑认知能力水平,脑认知功能检测系统主要测试的认知主要指标包括认知控制能力、记忆力、序列反转能力、注意力、图像识别能力、面部识别能力、抑制控制能力、手动能力、语言表达能力、听知觉能力、嗅觉感知能力和空间导航能力等。记忆力包括空间记忆、长时间记忆、工作记忆等。
注意力包括分散注意、选择注意、时间控制、同步注意等。场景内的每个小任务都将在用户不明显察觉的情况下同时检测多个待测指标,例如追捕小偷时同时测量了注意力、图像识别能力、反向操作、抑制操作、手动检测以及后续的人脸识别;无地图报案时测量了序列反转能力、空间记忆以及部分风险决策能力。
此外,本发明的脑认知功能检测系统可以在专用场所或非专用场所(例如用户的家庭)进行检测。
在图3中,还显示了一种专用的脑功能检测场所(或者房间设计)的示意图。 图中电脑1为客户端设备,电脑2为外接扩展设备的主机,电脑1和电脑2为网线连接;灰色区域为隔音暗室,即为主要用于测试脑电、眼动任务的被试区域。白色区域为主试区,主要用于测试运动等。
服务器
在本发明中,所述服务器上预设有一脑认知工具集游戏软件,所述服务器被配置为存储和管理用户数据和数据特征库,以及更新、运行和维护脑认知工具集游戏软件(图1和图2)。
典型地,服务器包括本地服务器和系统服务器,所述本地服务器用于存储、管理用户数据、数据特征库以及脑认知工具集游戏软件的更新和维护。
所述系统服务器用于向本地服务器发行新版本脑认知工具集游戏软件、用于从本地服务器获得检测数据以及更新特征数据库。
在本发明中,所述本地服务器包括用户数据库,所述用户数据库用于保存每个用户基本信息、测试结果、认知能力的动态状况等数据。
在另一优选例中,所述的本地服务器还被配置为分析(或简要分析)本地的脑认知功能检测数据。
在另一优选例中,所述的系统服务器还被配置为分析(或深入分析)所获得的脑认知功能检测数据。
在另一优选例中,服务器可以被直接布置于终端以达到脱网检测的目的。此系统可以多人多终端同时进行任务,整套系统可以依托商业互联网、专线或者本地局域网等渠道运行。服务器用于存储、管理用户数据以及版本更新维护等。终端用于向用户展示本发明的内容,以及人机交互产生用户数据。后台管理软件用于控制系统运行,处理、维护数据,为分析软件提供数据。分析软件用于系统性分析和对比所有相关数据,给出分析结果。
在服务器中,本发明将建立广谱的大数据库,用于存放用户的原始数据和分析后的数据,并以匿名化的形式储存。
在本发明中,可根据已有的动态认知能力检测模型及数据库中储存的数据,进一步分析数据,找出与脑认知功能密切相关的特征(signature feature),或与脑认知功能变化(如AD病变、PD病变)相关的特征(尤其是早期特征)(也可称为“广谱特征”),为进一步的开发和疾病归类提供理论基础。
本发明的脑认知功能检测系统包括硬件部分和软件部分,本发明的脑认知功 能检测系统也可用作本发明的脑认知功能的训练。
外接扩展设备
所述外接扩展设备包括眼动仪、运动传感器、位置传感器、加速度传感器、EEG脑电采集设备、VR设备、AR设备、嗅觉测试卡、EEG脑电采集设备等。扩展设备还可进一步包括肌电仪、运动平台等。检测对象可通过进一步接入拓展扩展设备帮助检测和分析脑功能的各项指标。
眼动仪用于捕捉眼动信号,包括扫视(Saccade)、微眼动(Microsaccade)、平滑追踪(smooth pursuit)、注视(fixation)、聚集(vergence)、眼球震颤(OKN,Optokinetic nystagmus)和眨眼(blink)。
其中,AR设备用于游戏使用提示的学习和体验,以及游戏场景的实现。眼动仪用于实时监控用户的眼动状况。运动感知传感器用于监视用户肢体的运动能力指标。脑电采集设备用于监测用户在检测过程中的脑电情况。
硬件部分
本发明的脑认知功能检测系统的硬件部分主要由三个组分构成:客户端设备(display PC)、本地服务器以及系统服务器;对于部分外接扩展设备如眼动仪、脑电、运动传感器等,需要在客户端设备旁一并提供外接扩展设备的主机(host PC)。
客户端设备可为可移动或固定的电脑、平板电脑或手机等,用于运行相应的游戏程序。
外接扩展设备的主机一般为移动或固定的电脑、平板电脑,用于运行外接扩展设备的控制和数据接受程序。
在每项游戏任务完成后客户端设备与外接扩展设备的数据被传入本地服务器储存,随即开始数据的本地分析。
本地分析时将根据本地广谱特征数据库中的指标对数据进行简单分类和分组,生成一份简易报表,主要包含各项成绩在全体中的参考区间,如:某项显示该名被试的反应速度在所有被试中位于前50%-60%,在其所在年龄区间(45-55岁)内位于前20%-30%。随后给出相应标签:在医院使用时会显示是否有相关疾病风险,以及疾病的编号,该些疾病在产品初期需要医生协助排查,在后期产品成熟后将直接给出诊断意见;在用于人才选拔时将标记该被试擅长的指标及就职建议等。
在医院使用时,被试数据将随医生的诊断意见定时上传至系统服务器进行系统分析,将根据主试标签、医生诊断意见等信息分析出各项疾病的各类参数特征,将特征存储于系统广谱特征库。
在其他环境使用时,被试数据也将定期上传至系统服务器进行系统分析,用于与医院数据关联,建立长模,找出疾病预示性指标。
广谱特征库用于储存经过总样本分析后,对于各类疾病或者各类分组的数据特征或分界线。系统广谱特征库中存储的各类疾病或分组特征经过人工审查后推送至各单位的本地广谱特征库。
分组包括不同年龄人群的能力划分,如某被试的数学能力在40-50年龄组的前10%;或不同职业人群的划分,如某被试的反应速度处在教师组的前20%-30%;或在所任职单位的划分,如某被试的记忆力处在某某公司前40%-50%。分组也包括各类标签的标准,如某被试在经过分析后被标记为04号疾病高概率风险、另一被试经分析后被标记为适合投资类职业等。
被试数据在系统服务器完成系统分析后将生成二次报告并推送给各被试,被试可以通过自己的设备登录相关页面查看,并在复诊时提供给医生进行参考。二次报告将更为专业和详细地描述被试各项指标,包括经处理后的眼动轨迹图、手动轨迹图、运动路径图等。
系统服务器将由该产品公司控制运行,对有保密需求的机构可将系统服务器与本地服务器合并放置于各单位、机构内,由各单位自行维护,该产品公司提供技术支持服务。
软件部分:
产品软件部分将包含两个主要功能:脑功能检测和脑功能训练。脑功能检测版本将包含硬件部分所述所有硬件,通过游戏的方式来同时检测多个待检指标,主要指标包括认知控制能力、记忆力、序列反转能力、注意力、图像识别能力、面部识别能力、抑制控制能力、手动能力、语言表达能力、听知觉能力、嗅觉感知能力和空间导航能力、认知控制能力等。
脑功能训练版本将以软件的形式进行发行,在用户自己的设备上安装使用,也可另行添加扩展设备进行练习,由生产方提供服务器进行软件的更新推送、数据收集和分析。用于训练测试版本类似的检测项目,提高操作熟练度并改善相应脑功能指标。
在软件运行过程中随着游戏任务的进行,任务的项目和难度将根据被试的表现进行动态调整。不同的用户群体所使用的游戏场景组合不同,难度梯度也不同。也就是说,客户端软件同时提供多样化的难度梯度算法,不同的用户群体所使用的游戏场景组合不同,难度梯度也不同。并在任务全部完成后给出检测报表,为后续的诊断治疗提供辅助。
总体设计上为一个主线任务串接多个小任务,每个小任务都能同时测多个待测指标,不但使用户的训练和测试拥有连贯性,而且在训练和测试过程中慢慢浸入设计的场景中,为用户提供一个轻松适合的检测训练环境,尽可能真实有效且自然地反映出用户的脑认知功能的各项定量化的指标。任务流程也将根据用户自身特性做相应调整,以使结果更为客观和日常化。当用户完成检测或训练后,系统将给出用户的脑功能指标状态,这些指标将提示用户的脑认知缺陷,以及某种脑疾病的发生概率,并且向用户推荐可以使用特定的游戏场景提升这些脑认知水平,从而实现从检测模块向训练模块的对接。
可用于本发明的游戏场景主题包括求生、寻宝、冒险、寻人、追踪、探险、探索、救援、战争、穿越、航行、旅游、日常等。
可用于本发明的游戏种类包括动作类、格斗类、冒险类、角色扮演、模拟游戏、战略游戏、射击类、竞速类、运动类、音乐游戏、益智游戏、沙盒式等、消除类、跑酷类、飞行类、棋牌类、解谜类、体育类、音乐舞蹈类、养成类、策略与战棋类、桌面类、教育类、恶搞类、移植游戏、其他类。
优选地,所述脑认知工具集游戏的游戏方式包括:单机游戏和联机游戏。
为保证测试的公正性和可靠性,测试用版本所选用的游戏内容用的游戏内容将略有区别,使得任务目标、选项答案等会有略微差异,完成任务的最优策略、随机数的随机种子等也将有所不同。
通过脑认知工具集游戏软件检测脑认知功能
在本发明中,脑认知工具集游戏软件可用于收集训练和评估脑认知功能的行为学数据和测试数据。脑认知工具集游戏版本具有趣味性强,简单易懂等特点,用户通过玩游戏的方式,在游戏的同时测试出多项认知能力的指标。
当用户退出游戏时可以查看用户的当前脑认知水平,并根据测试结果的建议进入有针对性脑认知功能提高模块游戏,不同的脑认知功能缺陷组合进入的训练游戏可以是不一样的。
针对特殊群体用户,将会推出有特色、有针对性的高性能测试游戏。
优选地,所述脑认知工具集游戏可根据检测对象的游戏任务结果而相应的调整下一游戏任务的难度,从而获得检测对象的更加准确的脑认知功能检测结果。
在本发明中,脑认知工具集游戏每局主任务的游戏时长没有特别限制,典型地为为10分钟到0.5小时。
在所述脑认知工具集游戏的同一游戏场景中嵌入了n个脑认知功能测试模块,其中,n为大于等于3的正整数,所述脑认知功能测试模块选自下组:记忆力测试模块、序列反转能力测试模块、注意力测试模块、图像识别能力测试模块、以及面部识别能力测试模块。
所述脑认知功能测试模块还可包括:抑制控制能力测试模块、手动能力测试模块、语言表达能力测试模块、听知觉能力测试模块、反应速度测试模块、灵活性测试模块、数学能力测试模块、文字表意测试模块、计划能力测试模块、和空间导航能力测试模块。
本发明将通过类似游戏的方式,用一个主线任务串接多个小任务,每个小任务都能同时测多个待测指标,不但使用户的训练和测试拥有连贯性,而且在训练和测试过程中慢慢浸入设计的场景中,为用户提供一个轻松适合的检测训练环境,尽可能真实有效且自然地反映出用户的脑认知功能的各项定量化的指标。任务流程也将根据用户自身特性做相应调整,以使结果更为客观和日常化。当用户完成检测或训练后,系统将给出用户的脑功能指标状态,这些指标将提示用户的脑认知缺陷,以及某种脑疾病的发生概率,并且向用户推荐可以使用特定的游戏场景提升这些脑认知水平,从而实现从检测模块向训练模块的对接。该游戏还包括更多场景增加吸引力和趣味性并扩宽检测项目。
所述小任务包括追捕小偷、Stroop test、找金币、抽奖、辨认人脸、摘水果、躲避鳄鱼。所述主任务包括求生、寻宝、冒险、寻人、追踪、探险、探索、救援、战争、穿越、航行、旅游、日常,或其组合。
在本发明中,一种代表性的场景设计如图4和图5所示。根据前一任务的完成结果进入特征库中匹配相应的疾病或分组,由匹配得的几种疾病或族群间的差异性确定下一任务的待检测参数,由前序任务的完成情况确定下一任务的难度,继而选定下一任务的种类和参数。初始任务可以设计为简单的NPC对话或者问卷及相关的选择题、计算题等。随后根据初始任务的表现分析是否符合相关疾病特征或分组特征,如若符合则进入相关任务分支;如果不符合则进入下一层级分支 筛查,以此类推。待全部完成后标记为健康或者各项对应的疾病与分组。
参考图6和图7分别给出了对脑认知功能进行检测的流程示意图和对脑认知功能进行训练的流程示意图。其中图6显示了一个在医院用于诊断的实施例中的客户端、本地服务器和系统服务器发生的主要事件流程图。图7显示了一个移动端用于训练的实施例中客户端和服务器发生的主要事件流程图。
在图8、图9和图10显示了本发明更具体的一个实施例中脑认知工具集游戏的示意图。其中图8显示了一个实施例中游戏软件的主线任务和与其串接的多个小任务。
图9显示了找金币小任务的示意图。在场景生成时会随着生成很多不同难度的金币隐藏在场景合适位置中。当用户控制模拟人物活动时,如果注意到金币类似的图案,可以切换进入搜索视角找出当前视角内的金币,根据用户的视野激活的金币数和其找到的金币数得出注意力相关的评分。
图10显示了广场场景的示意图。当玩家自由移动到此地会触发失窃情景,之后需要完成anti-pro任务追捕小偷,此后通过回忆之前走过的路径完成反转任务回到警察局报案。
通过图8、图9和图10所示的游戏软件,可以一次性地对脑认知功能进行多项检测,获得眼动数据、脑电波数据、行为学数据、运动捕捉数据等检测数据。
这些检测数据可以在本地服务器进行分析(或简要分析),从而获得初步的脑认知功能检测结果。
此外,这些检测数据可以被上传至系统服务器,并进一步分析(或深入分析),从而获得更详尽的脑认知功能检测结果(包括多种广谱特征)。
本发明的主要优点包括:
(a)本发明的脑认知功能检测系统的游戏场景有趣,检测任务时间短,同一场景同时检测出多项脑认知能力水平;
(b)本发明的脑认知功能检测系统采用多样化的难度梯度算法,不同的用户群体所使用的游戏场景组合不同,难度梯度也不同,从而使得脑认知功能检测更加有效和准确;
(c)本发明的脑认知功能检测系统能够建立动态的认知能力检测模型,实时保存并分析数据,高效的完成监测工作;
(d)本发明的脑认知功能检测系统能够完成大容量数据库的建立,保存每个客户的 原始数据和分析后的数据结果。
在本申请提及的所有文献都被认为是整体性地包括在本申请的公开内容中,以便在必要时可以作为修改的依据。此外应理解,在阅读了本申请的上述公开内容之后,本领域技术人员可以对本申请作各种改动或修改,这些等价形式同样落于本申请所要求保护的范围。

Claims (10)

  1. 一种脑认知功能检测系统,其特征在于,包括:
    一服务器,所述服务器上预设有一脑认知工具集游戏软件,所述服务器被配置为存储和管理用户数据和数据特征库,以及更新、运行和维护脑认知工具集游戏软件;
    一个或多个客户端设备,所述客户端设备被配置为执行来自所述服务器中的脑认知工具集游戏软件,
    一个或多个外接扩展设备,所述外接扩展设备被配置为采集待检测对象在玩游戏过程中的可用于评估脑认知功能的检测数据;所述外接扩展设备包括选自下组:眼动仪、脑电采集设备、运动感知传感器、或其组合;
    一后台管理模块,所述后台管理模块被配置为接收、处理和维护所述外接扩展设备所采集的可用于评估脑认知功能的检测数据;和
    一脑认知功能分析模块,所述分析模块被配置为基于所述后台管理模块提供的检测数据,进行分析和对比,从而提供待检测对象的脑认知功能检测结果。
  2. 如权利要求1所述的系统,其特征在于,所述数据特征库包含选自下组的数据:脑认知功能的特征指标类型、特征指标的参数值、特征指标的检测值的参考数据、神经网络的类型、神经网络的特征、神经网络的权重、游戏任务分支条件、疾病和任务的对应关系。
  3. 如权利要求2所述的系统,其特征在于,所述的特征指标类型选自下组:认知控制能力、记忆力、序列反转能力、注意力、图像识别能力、面部识别能力、序列反转能力、抑制控制能力、手动能力、语言表达能力、听知觉能力、嗅觉感知能力和空间导航能力。
  4. 如权利要求1所述的系统,其特征在于,在所述脑认知工具集游戏的同一游戏场景中嵌入了n个脑认知功能测试模块,其中,n为大于等于3的正整数,所述脑认知功能测试模块选自下组:记忆力测试模块、序列反转能力测试模块、注意力测试模块、图像识别能力测试模块、面部识别能力测试模块。
  5. 如权利要求4所述的系统,其特征在于,所述注意力模块包括分散注意、选择注意、时间控制和同步注意。
  6. 如权利要求4所述的系统,其特征在于,所述记忆力模块包括空间记忆、长时间记忆、工作记忆。
  7. 如权利要求1所述的系统,其特征在于,所述脑认知工具集游戏包括一个或多 个主线任务,所述主线任务可任选地串接多个小任务。
  8. 如权利要求1所述的系统,其特征在于,所述服务器包括:
    本地服务器(或第一服务器),所述本地服务器用于存储、管理用户数据、数据特征库以及脑认知工具集游戏软件的更新和维护;和
    系统服务器(或第二服务器),所述系统服务器用于向本地服务器发行新版本脑认知工具集游戏软件、用于从本地服务器获得检测数据以及更新特征数据库。
  9. 如权利要求8所述的系统,其特征在于,所述本地服务器包括:
    一存储模块,所述存储模块被配置为储存所述脑认知工具集游戏软件;
    一用户数据库,所述用户数据库配置为存储选自下组的数据:待检测对象的基本信息、分组标记、测试结果、认知能力的动态状况数据;
    一数据特征库,所述数据特征库用于储存数据特征;
    一分析模块,所述分析模块用于对检测数据进行数据分析、辅助诊断和能力级别划分。
  10. 如权利要求1所述的系统,其特征在于,所述客户端包括:
    一显示界面,所述显示界面被配置为显示脑认知工具集游戏软件界面;
    一输入模块,所述输入模块被配置为获取待检测对象的个人资料、分组、疾病分类、检测数据;
    一存储模块,所述存储模块被配置为储存所述脑认知工具集游戏软件、以及用户的数据;
    一处理模块,所述处理模块被配置为读取并执行所述脑认知工具集游戏软件;
    一发送模块,所述发送模块被配置为将获得的用户数据测试结果发送给所述服务器;
    一接收模块,所述接收模块被配置为获取服务器的分析结果和所述脑认知工具集游戏软件的更新推送。
PCT/CN2021/118615 2020-09-16 2021-09-15 脑认知功能检测系统 WO2022057840A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010975952.0 2020-09-16
CN202010975952.0A CN114259205A (zh) 2020-09-16 2020-09-16 脑认知功能检测系统

Publications (1)

Publication Number Publication Date
WO2022057840A1 true WO2022057840A1 (zh) 2022-03-24

Family

ID=80776444

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/118615 WO2022057840A1 (zh) 2020-09-16 2021-09-15 脑认知功能检测系统

Country Status (2)

Country Link
CN (1) CN114259205A (zh)
WO (1) WO2022057840A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116211253A (zh) * 2023-02-27 2023-06-06 国家康复辅具研究中心 老年人认知障碍筛查实验范式的系统及方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104605849A (zh) * 2015-01-14 2015-05-13 江正国 一种脑电生物反馈诊断治疗仪、系统及使用方法
CN105592798A (zh) * 2013-03-15 2016-05-18 塞罗拉公司 用于多模态生理刺激和脑健康的评估的系统及签名
CN106388785A (zh) * 2016-11-11 2017-02-15 武汉智普天创科技有限公司 基于vr和脑电信号采集的认知评估设备
WO2019103187A1 (ko) * 2017-11-23 2019-05-31 주식회사 아이메디신 뇌파를 통한 뇌 인지기능 평가 플랫폼 및 방법
CN111626420A (zh) * 2020-03-31 2020-09-04 杨阳 一种认知能力的自适应测评方法、测评系统及其使用方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109816213A (zh) * 2018-12-29 2019-05-28 前锦网络信息技术(上海)有限公司 一种基于认知的游戏化人才测评系统和方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105592798A (zh) * 2013-03-15 2016-05-18 塞罗拉公司 用于多模态生理刺激和脑健康的评估的系统及签名
CN104605849A (zh) * 2015-01-14 2015-05-13 江正国 一种脑电生物反馈诊断治疗仪、系统及使用方法
CN106388785A (zh) * 2016-11-11 2017-02-15 武汉智普天创科技有限公司 基于vr和脑电信号采集的认知评估设备
WO2019103187A1 (ko) * 2017-11-23 2019-05-31 주식회사 아이메디신 뇌파를 통한 뇌 인지기능 평가 플랫폼 및 방법
CN111626420A (zh) * 2020-03-31 2020-09-04 杨阳 一种认知能力的自适应测评方法、测评系统及其使用方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116211253A (zh) * 2023-02-27 2023-06-06 国家康复辅具研究中心 老年人认知障碍筛查实验范式的系统及方法

Also Published As

Publication number Publication date
CN114259205A (zh) 2022-04-01

Similar Documents

Publication Publication Date Title
US20220044824A1 (en) Systems and methods to assess cognitive function
Dey et al. Exploration of an EEG-based cognitively adaptive training system in virtual reality
Anstey et al. Interrelationships among biological markers of aging, health, activity, acculturation, and cognitive performance in late adulthood.
US10376197B2 (en) Diagnosing system for consciousness level measurement and method thereof
US20050216243A1 (en) Computer-simulated virtual reality environments for evaluation of neurobehavioral performance
KR100986109B1 (ko) 웹 서비스 기반의 인지능력 개발 시스템, 그 방법 및 이를기록한 기록매체
Zhu et al. Detecting emotional reactions to videos of depression
US11123002B1 (en) Brain matching
US20130172693A1 (en) Diagnosing system for consciousness level measurement and method thereof
Dhaouadi et al. A multimodal physiological-based stress recognition: Deep Learning models’ evaluation in gamers’ monitoring application
CN113974589B (zh) 多模态行为范式评估优化系统及认知能力评价方法
WO2022057840A1 (zh) 脑认知功能检测系统
Lampton et al. Human performance measurement in virtual environments
Słupińska et al. Planning an experiment in a virtual environment reality as a place of research on human behaviour using methods of neuroscience measurement–bibliometric analysis and methodological approach
Khedher et al. Predicting user learning performance from eye movements during interaction with a serious game
US10820851B2 (en) Diagnosing system for consciousness level measurement and method thereof
Bashir et al. Electroencephalogram (EEG) Signals for Modern Educational Research
Doyle et al. Modeled Wellness: How Perceived Supervisor Wellness Explains Supervisee Personal Wellness
CN114169808A (zh) 计算机实施的学习力评估方法、计算设备、介质和系统
Varinlioglu et al. » Affective Computing for Game User Research «
US20220167895A1 (en) Method and system for testing cognition by processing the reaction of a subject to stimuli
RU2787224C1 (ru) Способ оценки функционального состояния по показателям походки и/или кинематики движений и применение способа в сфере продвижения товаров и услуг
Ji et al. Diagnostic and rehabilitation system for Alzheimer’s disease based on virtual reality technology in rehabilitation rooms
Čertický et al. Modeling user experience in electronic entertainment using psychophysiological measurements
Schuh et al. Design of a decision-making task for a collaborative brain-computer interface system based on emotiv EEG

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21868662

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21868662

Country of ref document: EP

Kind code of ref document: A1