CN115562492A - Cognitive assessment training method and system based on virtual reality and eye movement - Google Patents
Cognitive assessment training method and system based on virtual reality and eye movement Download PDFInfo
- Publication number
- CN115562492A CN115562492A CN202211279151.6A CN202211279151A CN115562492A CN 115562492 A CN115562492 A CN 115562492A CN 202211279151 A CN202211279151 A CN 202211279151A CN 115562492 A CN115562492 A CN 115562492A
- Authority
- CN
- China
- Prior art keywords
- training
- user
- cognitive
- evaluation
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/70—Game security or game management aspects
- A63F13/79—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Computer Security & Cryptography (AREA)
- General Business, Economics & Management (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to the technical field of cognitive assessment, and particularly discloses a cognitive assessment training method and system based on virtual reality and eye movement. According to the method, a division structure is generated by carrying out division of target cognition; inputting the demographic information and cognitive scale evaluation data of a user; carrying out evaluation training, and recording eye movement track data of a user and various user performance data; calculating an evaluation result, and performing corresponding relation correspondence and weight assignment on the division structure to obtain an assignment structure; and generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme. The cognitive function assessment can be carried out by combining the biofeedback data of the eye movement with the behavior analysis data of the user in the game, so that the defect that the traditional scoring depends on subjective judgment is overcome; the system does not need to be supervised in the evaluation process, so that the labor cost is reduced; the evaluation process is short in duration, so that the time cost can be reduced; the evaluation for orientation ability and spatial perception is more realistic.
Description
Technical Field
The invention belongs to the technical field of cognitive assessment, and particularly relates to a cognitive assessment training method and system based on virtual reality and eye movement.
Background
In the prior art, a common cognitive assessment method cannot be assessed by an objective quantifiable method through a biofeedback device, or important cognitive dimensions such as orientation ability and spatial perception are not assessed in a non-VR environment, and the training content is not personalized on the basis of assessment of cognitive training effects by the devices by the existing cognitive training method based on VR and eye movement. For example: CN202111462457 discloses a VR targeted training system for cognitive impairment, which discloses some methods for how to perform cognitive training using virtual reality, but firstly, the method cannot quantitatively evaluate the training process and behavior performance of a user, further cannot evaluate the training effect of the user, and cannot adjust the training content and difficulty according to the performance of the user; CN202210356969 discloses a cognitive ability evaluation system based on virtual reality technology, which evaluates the cognitive function of a user by quantitative indexes, but the indexes are all based on the performance behavior of the user in a game, VR does not provide any data for evaluation and analysis in VR, and only indirectly reflects the spatial perception of the user as an immersive scene, and other three items are not related to VR, and the method only provides a method for cognitive evaluation in VR scene, but lacks a training intervention method; CN202111655593 discloses a cognitive rehabilitation training evaluation system and method, which, although eye movement is used for quantifiable cognitive function evaluation, the method does not relate to an algorithm for specifically evaluating cognitive function, and the description is limited to a single dimension of attention, and meanwhile, the evaluation and training cannot be performed on common cognitive functions such as spatial perception.
Disclosure of Invention
The embodiment of the invention aims to provide a cognitive assessment training method and system based on virtual reality and eye movement, and aims to solve the problems in the background technology.
In order to achieve the above object, the embodiments of the present invention provide the following technical solutions:
a cognitive assessment training method based on virtual reality and eye movement comprises the following steps:
different classification modes of neuropsychology are integrated, target cognition is divided, and a division structure is generated;
inputting demographic information and cognition scale evaluation data of a user;
carrying out evaluation training, and recording eye movement trajectory data and various user performance data of the user;
calculating an evaluation result according to the eye movement trajectory data and the plurality of user performance data, and performing corresponding relation correspondence and weight assignment on the division structure to obtain an assignment structure;
and generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme.
As a further limitation of the technical solution of the embodiment of the present invention, the entering of the demographic information and the cognitive scale evaluation data of the user specifically includes the following steps:
inputting the demographic information of the user, including name, age, gender, education level and occupation;
and inputting the past cognitive scale evaluation data of the user.
As a further limitation of the technical solution of the embodiment of the present invention, the performing the evaluation training and recording the eye movement trajectory data of the user and the various user performance data specifically includes the following steps:
performing evaluation training and recording of a first cognitive evaluation training game to obtain eye movement track data and first user performance data of a user;
performing evaluation training and recording of a second cognitive evaluation training game to obtain second user performance data of the user;
and performing evaluation training and recording of the third cognitive evaluation training game to obtain third user performance data of the user.
As a further limitation of the technical solution of the embodiment of the present invention, the calculating an evaluation result according to the eye movement trajectory data and the plurality of user performance data, and performing correspondence and weight assignment on the division structure to obtain an assignment structure specifically includes the following steps:
obtaining original scores corresponding to the games according to the eye movement track data, the first user performance data, the second user performance data and the third user performance data;
taking a plurality of users as samples, classifying the sample users according to the demographic information and the scores of the cognitive scale evaluation data, and evaluating to obtain a normal mode of an original evaluation result;
taking a normal model of a corresponding crowd for standardization processing aiming at the original score of a target user;
and setting corresponding weight values according to the corresponding association strengths of the three games to obtain an assignment structure.
As a further limitation of the technical solution of the embodiment of the present invention, the generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme specifically includes the following steps:
calculating a relevance score for each training game;
sorting according to the relevance score R of the game from big to small, and selecting a plurality of the top training contents as the training scheme of the next stage of the user;
setting different parameter gradients for each training game, and providing corresponding training parameters according to the cognitive level of the user;
new assessment scores are given according to the new training results, and the new training scheme is again given from the first step of personalized training.
As a further limitation of the technical solution of the embodiment of the present invention, the cognitive scale corresponding to the cognitive scale evaluation data may be: a simple intelligent mental state examination scale, a montreal cognitive assessment scale, a long valley chunky simple intelligent scale, a cognitive disorder self-rating scale, a clinical dementia rating scale, an alzheimer's disease rating scale-cognitive scoring scale, a numeric breadth-reversed back, a language fluency test, a wechsler numeric symbol test, a generalized anxiety scale, a hamilton depression scale, a depression self-rating scale, a Berg balance scale, a Fugl-Meyer balance scale, an ADL daily living capacity scale.
As a further limitation of the technical solution of the embodiment of the present invention, the formula of the normalization process is: s = a (X-M)/SD + B;
wherein, X is the original score of the user, M represents the average score of the sample, SD represents the standard deviation of the sample, and A and B are preset offset parameters.
As a further limitation of the technical solution of the embodiment of the present invention, the parameter gradient includes a difficulty level, a training duration, a moving speed of the internal article, and an appearance frequency.
A virtual reality and eye movement based cognitive assessment training system, the system comprising:
the data pre-inputting module is used for integrating different classification modes of neuropsychology to perform division of target cognition and generate a division structure; inputting demographic information and cognition scale evaluation data of a user;
the real-time interaction module is used for carrying out evaluation training and recording eye movement track data and various user performance data of the user; according to the training scheme, performing personalized training on the user;
the general computing equipment module is used for computing an evaluation result according to the eye movement track data and the various user performance data, and performing corresponding relation correspondence and weight assignment on the division structure to obtain an assignment structure; generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme;
the communication module is used for carrying out data communication transmission;
the storage module is used for storing data;
and the result display module is used for displaying the result.
Compared with the prior art, the invention has the beneficial effects that:
according to the embodiment of the invention, a division structure is generated by carrying out the division of target cognition; inputting the demographic information and cognitive scale evaluation data of a user; carrying out evaluation training, and recording eye movement track data of a user and various user performance data; calculating an evaluation result, and performing corresponding relation correspondence and weight assignment on the division structures to obtain an assignment structure; and generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme. The cognitive function assessment can be carried out by combining the biofeedback data of the eye movement with the behavior analysis data of the user in the game, so that the defect that the traditional scoring depends on subjective judgment is overcome; the system does not need to be supervised in the evaluation process, so that the labor cost is reduced; the evaluation process is short in duration, so that the time cost can be reduced; the evaluation for orientation ability and spatial perception is more realistic.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention.
Fig. 1 shows a flow chart of a method provided by an embodiment of the invention.
Fig. 2 is a diagram illustrating an application architecture of a system provided by an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It will be appreciated that, in one aspect, traditional cognitive assessment methods rely on classical cognitive scales as assessment tools, and although validated for many years on confidence, there are disadvantages including: (2) Part of scale items depend on subjective scoring of evaluators, and stability and objectivity cannot be guaranteed; (2) Time consumption is tedious, subjects are difficult to persist, and time cost is high; (3) The whole process needs evaluators to carry out one-to-one, and the labor cost is high; (4) Some cognitive functions cannot well explain real-world conditions such as orientation ability and spatial perception only by using a dose table. On the other hand, the conventional cognitive training has the following problems: (1) The one-to-one training is carried out depending on manpower, and huge manpower and time cost are consumed; (2) The training takes effect for a long time, the training content is repeated and boring, and the user is difficult to insist; (3) The same training scheme is often adopted for different users, or some personalized schemes are given only by depending on the subjective experience of instructors but lack scientific basis.
In order to solve the above problem, in the embodiments of the present invention, a partition structure is generated by performing partition of target cognition; inputting the demographic information and cognitive scale evaluation data of a user; carrying out evaluation training, and recording eye movement trajectory data and various user performance data of the user; calculating an evaluation result, and performing corresponding relation correspondence and weight assignment on the division structures to obtain an assignment structure; and generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme. The cognitive function assessment can be carried out by combining the biofeedback data of the eye movement with the behavior analysis data of the user in the game, so that the defect that the traditional scoring depends on subjective judgment is overcome; the system does not need to be supervised in the evaluation process, so that the labor cost is reduced; the evaluation process is short in duration, so that the time cost can be reduced; the evaluation for orientation ability and spatial perception is more realistic.
Fig. 1 shows a flow chart of a method provided by an embodiment of the invention.
Specifically, the cognitive assessment training method based on virtual reality and eye movement is characterized in that the management method specifically comprises the following steps:
s101, integrating different classification modes of neuropsychology, dividing target cognition and generating a division structure;
step S102, inputting user demographic information and cognition scale evaluation data;
step S103, carrying out evaluation training, and recording eye movement track data and various user performance data of the user;
step S104, calculating an evaluation result according to the eye movement track data and the various user performance data, and performing corresponding relation and weight assignment on the division structure to obtain an assignment structure;
and S105, generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme.
In the embodiment of the invention, cognitive division is carried out, different classification modes of neuropsychology are integrated, the target cognitive unit is divided into a primary unit and a secondary unit under the primary unit, and a division structure is generated.
In the embodiment of the invention, the entry of the demographic information and the cognitive scale evaluation data of the user is carried out, specifically: inputting the demographic information of the user, including name, age, gender, education level and occupation; inputting past cognitive scale evaluation data of a user, wherein the cognitive scale can be a simple intelligent mental state examination scale, a Montreal cognitive evaluation scale, a Changchuan simple intelligent scale, a cognitive disorder self-evaluation scale, a clinical dementia evaluation scale, an Alzheimer disease scoring scale-cognitive score scale, a digital breadth-inverted back, a language fluency test, a Wechsler digital symbol test, a generalized anxiety scale, a Hamilton depression scale, a depression self-evaluation scale, a Berg balance scale, a Fugl-Meyer balance scale and an ADL daily life capacity scale.
In the embodiment of the invention, evaluation training is carried out to enable a user to finish 3 cognitive evaluation training games, specifically:
the first cognitive assessment training game is that the airplanes fly in the air in a random route by sequentially generating airplanes, and a user needs to control the sighting device to continuously aim at the airplanes by eyes and control the game controller to shoot bullets to shoot the airplanes; in the process, some interference flyers such as flying birds can randomly appear, if eyes look at the interference flyers, the effective hit rate of a shooting airplane can be reduced, user performance and eye movement track data are recorded, and 5 data indexes including 'correct watching rate', 'anti-interference rate', 'track coincidence rate', 'transfer time' and 'destruction time' of a user are obtained by calculating a tie value;
the second cognitive assessment training game gives some calculation problems in sequence at the center of the screen, and simultaneously a number randomly appears at four corners, so that a user needs to use the surplus light to observe and remember the numbers at the corners, and if the user directly looks at the four corners with eyes, the middle calculation problem disappears. Then, the numbers in the corners disappear, and the user needs to answer the answers to the middle calculation questions and then answer the numbers in the previous corners. The system records the user performance, and obtains the total correct rate, the answer time, the counting correct rate and the counting question answer time of the user by calculating the average value;
and a third cognitive assessment training game, wherein the scene comprises a city first person perspective scene in a VR environment and a small map of an overhead perspective, and a task target is randomly given, such as going to a supermarket. A user needs to plan a route to the supermarket according to the small map and walk to the supermarket according to the route; after the task of going to the supermarket is finished, the returned task needs to be finished, and when the task of going to the supermarket is returned, the task of going to the supermarket needs to be returned along the original route according to various sign clues of the crossroads in the route of going to the supermarket. The system records the user performance, and obtains the length of the time-going route, the planning time of the time-going route, the accuracy rate of the return route and the judgment time of the return route of the user by calculating the average value.
In the embodiment of the invention, the evaluation result is calculated, each cognitive evaluation training game corresponds to different cognitive units, and the original score X corresponding to each game can be obtained according to the behavior of the user in the 3 evaluation training games; taking a plurality of users as samples, classifying the sample users according to the demographic information and the scores of the cognitive assessment scale, and assessing the samples to obtain a normal model of an original assessment result; aiming at the original score of the target user, taking the norm of the corresponding crowd for standardization processing, and according to the following method: s = a × (X-M)/SD + B, where X is the raw score of the user, M represents the sample average score, SD represents the standard deviation of the samples, and a and B are preset offset parameters. The preset offset parameter can be set according to an empirical value; setting corresponding weight values according to the association strength of the cognitive units corresponding to the 3 games, wherein the weight values can be set according to experience, so that the score of each secondary cognitive unit is
Wherein S is a calculation method of the user according to the corresponding cognitive unit in the evaluation gameAnd w is the correlation weight value of the cognitive unit corresponding to the game after the score is normalized.
In the embodiment of the invention, personalized training is carried out, and a personalized training scheme is generated according to an evaluation result obtained by a user in an evaluation training game, and the steps are as follows:
(1) Calculating a relevance score of each training game,
wherein C is the evaluation score of a certain secondary cognitive unit, n is the total number of the secondary cognitive units, w is the weight value of the game in the certain secondary cognitive unit, the example of the weight relationship is described in the calculation evaluation result, and the higher the relevance score is, the weaker cognitive unit of the user can be trained most by the training content of the game under the evaluation result of the user;
(2) Sorting according to the relevance score R of the game from big to small, and selecting a plurality of the top training contents as the personalized training scheme of the next stage of the user;
(3) Each training game is provided with different parameter gradients, the parameters comprise difficulty level, training duration, moving speed of internal articles, appearance frequency and the like, and corresponding training parameters are provided according to the cognitive level of the user, such as: dividing the game into 1-100 grades, giving 50 grades of difficulty if the score of the user is M (sample average score), giving 100 grades if the score is M +3SD, and giving 1 grade of difficulty if the score is M-3 SD;
(4) And giving a new cognitive unit evaluation score according to a new training result, and repeatedly giving a new training scheme from the first step of personalized training again.
Further, fig. 2 shows an application architecture diagram of the system provided in the embodiment of the present invention.
In another preferred embodiment, the present invention provides a cognitive assessment training system based on virtual reality and eye movement, the system comprising:
the data pre-inputting module is used for integrating different classification modes of neuropsychology to perform target cognition division and generate a division structure; inputting the demographic information and cognitive scale evaluation data of a user;
the real-time interaction module is used for carrying out evaluation training and recording eye movement track data and various user performance data of the user; according to the training scheme, performing personalized training on the user;
the general computing equipment module is used for computing an evaluation result according to the eye movement track data and the various user performance data, and performing corresponding relation correspondence and weight assignment on the division structure to obtain an assignment structure; generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme;
the communication module is used for carrying out data communication transmission;
the storage module is used for storing data;
and the result display module is used for displaying the result.
In the embodiment of the invention, the general computing equipment module gives interactive feedback in real time according to the eye movement and the game behavior of the user, so that cognitive training is carried out, and an evaluation result can be given according to the analysis of the data. The communication module and the storage module can be an internet architecture, and the data can be uploaded to a server through a remote communication protocol and stored at a server; or a local architecture, and the data result is directly stored in a local terminal device. The result display module comprises a result display function and can display results on various display terminals, such as a mobile phone, a tablet computer, a large screen display and the like.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of steps in various embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternatingly with other steps or at least a portion of sub-steps or stages of other steps.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above may be implemented by a computer program, which may be stored in a non-volatile computer readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (9)
1. A cognitive assessment training method based on virtual reality and eye movement is characterized in that the management method specifically comprises the following steps:
different classification modes of neuropsychology are integrated, target cognition is divided, and a division structure is generated;
inputting the demographic information and cognitive scale evaluation data of a user;
carrying out evaluation training, and recording eye movement trajectory data and various user performance data of the user;
calculating an evaluation result according to the eye movement trajectory data and the plurality of user performance data, and performing corresponding relation correspondence and weight assignment on the division structure to obtain an assignment structure;
and generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme.
2. The virtual reality and eye movement-based cognition assessment training method according to claim 1, wherein the entering of the user's demographic information and cognition scale assessment data specifically comprises the steps of:
inputting the demographic information of the user, including name, age, gender, education level and occupation;
and inputting the past cognitive scale evaluation data of the user.
3. The cognitive assessment training method based on virtual reality and eye movement according to claim 1, wherein the assessment training, recording the eye movement trajectory data and various user performance data of the user specifically comprises the following steps:
performing evaluation training and recording of a first cognitive evaluation training game to obtain eye movement track data and first user performance data of a user;
performing evaluation training and recording of a second cognitive evaluation training game to obtain second user performance data of the user;
and performing evaluation training and recording of the third cognitive evaluation training game to obtain third user performance data of the user.
4. The cognitive assessment training method based on virtual reality and eye movement according to claim 1, wherein the step of calculating an assessment result according to the eye movement trajectory data and a plurality of user performance data, and performing correspondence and weight assignment on the division structure to obtain an assignment structure specifically comprises the following steps:
obtaining original scores corresponding to the games according to the eye movement track data, the first user performance data, the second user performance data and the third user performance data;
taking a plurality of users as samples, classifying the sample users according to the demographic information and the scores of the cognitive scale evaluation data, and evaluating to obtain a normal mode of an original evaluation result;
taking a normal model of a corresponding crowd for standardization processing aiming at the original score of a target user;
and setting corresponding weight values according to the corresponding association strengths of the three games to obtain an assignment structure.
5. The cognitive assessment training method based on virtual reality and eye movement according to claim 1, wherein the training scheme is generated according to the assessment result, and the personalized training of the user according to the training scheme specifically comprises the following steps:
calculating a relevance score for each training game;
sorting according to the relevance score R of the game from big to small, and selecting a plurality of the top training contents as the training scheme of the next stage of the user;
setting different parameter gradients for each training game, and providing corresponding training parameters according to the cognitive level of the user;
new assessment scores are given according to the new training results, and a new training scenario is again given from the first step of personalized training repeatedly.
6. The virtual reality and eye movement-based cognition assessment training method according to claim 2, wherein the cognition scale corresponding to the cognition scale assessment data can be: a simple intelligent mental state examination scale, a montreal cognitive assessment scale, a long valley chunky simple intelligent scale, a cognitive disorder self-rating scale, a clinical dementia rating scale, an alzheimer's disease rating scale-cognitive scoring scale, a numeric breadth-reversed back, a language fluency test, a wechsler numeric symbol test, a generalized anxiety scale, a hamilton depression scale, a depression self-rating scale, a Berg balance scale, a Fugl-Meyer balance scale, an ADL daily living capacity scale.
7. The training method for cognitive assessment based on virtual reality and eye movement according to claim 4, wherein the formula of said normalization process is: s = a (X-M)/SD + B;
wherein, X is the original score of the user, M represents the average score of the sample, SD represents the standard deviation of the sample, and A and B are preset offset parameters.
8. The virtual reality and eye movement-based cognitive assessment training method according to claim 5, wherein said parameter gradients comprise difficulty level, training duration, moving speed of internal objects and frequency of occurrence.
9. A virtual reality and eye movement based cognitive assessment training system, the system comprising:
the data pre-inputting module is used for integrating different classification modes of neuropsychology to perform target cognition division and generate a division structure; inputting demographic information and cognition scale evaluation data of a user;
the real-time interaction module is used for carrying out evaluation training and recording eye movement track data and various user performance data of the user; according to the training scheme, performing personalized training on the user;
the general computing equipment module is used for computing an evaluation result according to the eye movement trajectory data and the various user performance data, and performing corresponding relation and weight assignment on the division structure to obtain an assignment structure; generating a training scheme according to the evaluation result, and performing personalized training on the user according to the training scheme;
the communication module is used for carrying out data communication transmission;
the storage module is used for storing data;
and the result display module is used for displaying the result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211279151.6A CN115562492A (en) | 2022-10-19 | 2022-10-19 | Cognitive assessment training method and system based on virtual reality and eye movement |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211279151.6A CN115562492A (en) | 2022-10-19 | 2022-10-19 | Cognitive assessment training method and system based on virtual reality and eye movement |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115562492A true CN115562492A (en) | 2023-01-03 |
Family
ID=84747467
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211279151.6A Pending CN115562492A (en) | 2022-10-19 | 2022-10-19 | Cognitive assessment training method and system based on virtual reality and eye movement |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115562492A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118016250A (en) * | 2024-04-09 | 2024-05-10 | 北京智精灵科技有限公司 | Mental disorder rehabilitation training system based on virtual person |
-
2022
- 2022-10-19 CN CN202211279151.6A patent/CN115562492A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118016250A (en) * | 2024-04-09 | 2024-05-10 | 北京智精灵科技有限公司 | Mental disorder rehabilitation training system based on virtual person |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107230174B (en) | Online interactive learning system and method based on network | |
| Allen-Meares et al. | Social work practice: Integrating qualitative and quantitative data collection techniques | |
| Di Gaspero et al. | The second international timetabling competition (ITC-2007): Curriculum-based course timetabling (track 3) | |
| Lan et al. | Behavior-Based Latent Variable Model for Learner Engagement. | |
| CN112184500A (en) | Extraclass learning tutoring system based on deep learning and knowledge graph and implementation method | |
| Liu et al. | Collaborative learning team formation: a cognitive modeling perspective | |
| CN113627779A (en) | Teaching management and quality evaluation system based on big data and AI technology | |
| EP4339855A1 (en) | Online and offline hybrid education method and system, electronic device and storage medium | |
| CN115691804A (en) | Social cognition assessment training system based on digital twin-neuron universe | |
| CN113010557A (en) | Method and system for randomly answering questions by using psychological evaluation system scale | |
| CN111553555A (en) | Training method, training device, computer equipment and storage medium | |
| CN114971425A (en) | Database information monitoring method, device, equipment and storage medium | |
| CN115562492A (en) | Cognitive assessment training method and system based on virtual reality and eye movement | |
| CN111667171A (en) | Big data-based group reading behavior analysis method, device, equipment and medium | |
| Fu et al. | A support vector regression-based prediction of students' school performance | |
| CN116992140A (en) | Teaching course online recommendation method and system applied to rehabilitation medicine department | |
| CN114090526B (en) | Cloud education resource management system | |
| CN116228475A (en) | Career planning practice method and device based on big data and electronic equipment | |
| KR101627397B1 (en) | System for providing related-word quiz service and Method thereof | |
| Chen et al. | Design of Assessment Judging Model for Physical Education Professional Skills Course Based on Convolutional Neural Network and Few‐Shot Learning | |
| CN108596461B (en) | Intelligent system and method for training effect evaluation | |
| CN111191914A (en) | Professional recommendation method and device, computer equipment and computer readable storage medium | |
| Boufera et al. | Development of an Adaptive Collaborative Serious Game Based on Learning Style, Using Trace and Agent Technology. | |
| CN112138396B (en) | Unmanned system simulation countermeasure-oriented intelligent body training method and system | |
| AU2021103999A4 (en) | Occupation recommendation method, apparatus, device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |