Cognitive level rehabilitation training system based on eye movement tracking technology
Technical Field
The invention relates to the field of testing, in particular to a cognitive level rehabilitation training system based on an eye movement tracking technology.
Background
Eye movement tracking means tracking the movement of an eyeball by measuring the position of the fixation point of the eye or the movement of the eyeball relative to the head.
Patent CN 101779960B discloses a system and method for testing cognitive ability value of stimulation information, wherein the method for testing cognitive ability includes collecting data of eye movement tracking stimulation information of a tested person, and then analyzing cognitive index value of the tested person. This method has several disadvantages: firstly, the method cannot evaluate specific cognitive abilities such as attention, memory, visual search ability, computing ability, language ability and the like; secondly, the method cannot quantitatively analyze specific cognitive abilities; in addition, because the stimulation performance in daily life is not fixed and constant, the cognitive level of the human eyes to the changed stimulation performance is also different, and at present, no test system based on the change of the cognitive ability reflected by the changed stimulation exists at home and abroad. Thirdly, the method only analyzes the cognitive ability and cannot perform guided training on the cognitive ability.
Disclosure of Invention
In order to solve the above problems, the present invention provides a cognitive level rehabilitation training system based on an eye movement tracking technology, which can quantitatively analyze 5 cognitive modules: attention, memory, visual search, calculation and reading; can realize targeted and efficient cognitive rehabilitation training.
In order to achieve the purpose, the invention adopts the following scheme:
a cognitive level rehabilitation training system based on an eye movement tracking technology comprises a cognitive task presenting module, an infrared eye movement tracking assembly, an eye movement data analyzing module, a test result feedback module and a stimulation mark guiding module;
the cognitive task presentation module is used for presenting an attention task, a visual search task, a memory task, a calculation task and a reading task to a tested person;
the infrared eye movement tracking component acquires eye movement data obtained by a tested person according to the cognitive task presentation module in real time and sends the eye movement data to the eye movement data analysis module;
the eye movement data analysis module adopts a human eye vision dynamic analysis method to evaluate the attention score, the search score, the memory score, the calculation score or the reading score of the tested person reflected by the attention task, the vision search task, the memory task, the calculation task or the reading task; and sending the result to the test result feedback module and the stimulation mark guide module; the method has the advantages that on one hand, results are fed back, and on the other hand, the stimulation mark guiding module conducts targeted guiding according to the test results.
The test result feedback module is used for feeding back the test result to the tested person;
the stimulation mark guiding module is used for guiding the eye movement processing of the tested person.
The attention task, the memory task, the visual search task, the calculation task and the reading task in the invention refer to a series of visual stimulus combinations which adopt different visual stimulus designs and respectively belong to the attention task, the memory task, the visual search task, the calculation task and the reading task.
Attention tasks include alertness, attention selection, and attention retention; the memory task comprises the following steps: working memory (space and objects) and long term memory (space and objects); visual search tasks include: an equal search and a series search; the computing tasks include: counting, vertical calculation and application problem calculation; the reading task comprises the following steps: words, sentences, and paragraphs.
The human eye visual dynamic analysis method is a conventional method, and is specifically disclosed in the text of "human eye dynamic visual characteristic analysis" and published in the text of "nature science edition of Shanghai university newspaper".
Further, the infrared eye tracking assembly comprises a power supply, an infrared tracker, a data transmission unit and a controller; the infrared tracker is connected with the controller, acquires eye movement data obtained by the measured person according to the cognitive task presentation module in real time, and is connected with the eye movement data analysis module through the data transmission unit.
Further, the stimulation mark guide module comprises intermittent presentation of marks, brightness change or color change.
Further, the mark in the stimulation mark guide module comprises a pattern, a character, a letter, a number or a sound.
Further, the eye movement data comprises a fixation point, fixation times, fixation duration, review times, eye jump amplitude, eye jump time and fixation track.
Further, the calculating the attention score of the subject comprises: when the attention task is a visual orientation task, determining a first attention score according to the distance between the gazing point position of the tested person and the current visual stimulation position, determining a second attention score according to the gazing times of the tested person, determining a third attention score according to the eye jump time of the tested person, determining a fourth attention score according to the eye jump amplitude of the tested person, and combining the first attention score, the second attention score, the third attention score and the fourth attention score to obtain the current attention score of the tested person.
The vision orientation task means that a tested person firstly watches the center of a certain presenting carrier, a series of changing symbols (letters or figures) appear on the periphery of the carrier, and when a visual stimulus appears, the tested person watches the visual stimulus at the fastest speed.
Further, the calculating the visual search score of the testee comprises: presenting a plurality of visual stimuli in a search task to a tested person, and determining a first visual search score according to the distance between the last gazing point position in a gazing track and a target visual stimulus position in the search task; determining a second score according to the total fixation duration of the tested person; determining a third searching score according to the gazing track of the tested person, and combining the first searching score, the second searching score and the third searching score; and obtaining the visual search score of the current testee.
Further, the calculating the memory score of the subject comprises: presenting a plurality of visual stimuli in a memory task to a tested person, wherein the visual stimuli are presented at different positions in sequence, and when the visual stimuli disappear, determining to memorize a first score according to the fact that the presentation sequence of the watching track of the tested person and the disappeared visual stimuli is inconsistent at a certain visual stimulus; determining and memorizing a second score according to the fixation duration of the tested person; combining the memorized first score and the memorized second score to obtain the memory score of the current testee; or presenting the target stimulation in the memory task to the testee, then eliminating the target stimulation, then presenting the target stimulation and other interference stimulation, determining a first memory score according to the elapsed time of the positioning target stimulation of the testee, determining a second memory score according to the watching track of the testee, and determining a third memory score according to the number of times of the look-back of the testee; and combining the first memorized score, the second memorized score and the third memorized score to obtain the memory score of the current testee.
Further, the calculating the calculation score of the subject includes: when the calculation task is vertical calculation, determining a first calculation score according to the gazing track of the measured person; determining a second calculation score according to the average fixation time, the fixation times and the review times of the testee; and combining the calculated first score and the calculated second score to obtain the calculated score of the current testee.
Further, the calculating the calculation score of the subject includes: when the calculation task is application problem calculation, a first calculation score is determined according to the total fixation time of the testee for the application problem solving keyword, a second calculation score is determined according to the fixation times of the testee for the application problem solving keyword, a third calculation score is determined according to the eye jump amplitude of the testee for the application problem solving keyword, a fourth calculation score is determined according to the return sight times of the testee for the application problem solving keyword, and the calculation of the first score, the calculation of the second score, the calculation of the third score and the calculation of the fourth score are combined to obtain the calculation score of the current testee.
Further, the calculating the reading score of the tested person comprises the following steps: determining a first reading score according to the watching duration of a tested person on a specific word, a sentence and a paragraph; and determining a reading second score according to the review times of the tested person for the specific vocabulary and the sentence, determining a reading third score according to the right eye jump amplitude of the tested person, determining a reading fourth score according to the total fixation duration of the tested person, and combining the reading first score, the reading second score, the reading third score and the reading fourth score to obtain the reading score of the current tested person.
The invention has the beneficial effects that:
(1) the invention can collect the eye movement data of the tested person, determine the attention score, the visual search score, the memory score, the calculation score or the reading score of the tested person, evaluate the cognitive characteristics and the level of the tested person by quantitatively analyzing the cognitive ability of the tested person, and has higher accuracy.
(2) The invention carries out the rehabilitation training guided by the prompt based on the difference of the cognitive abilities of the tested persons, and can be more targeted and have higher efficiency.
Drawings
FIG. 1 is a block diagram of the system of the present invention;
the specific implementation mode is as follows:
the invention is further described with reference to the following figures and examples.
Example 1:
FIG. 1 is a system block diagram of the present invention.
A cognitive level rehabilitation training system based on an eye movement tracking technology comprises a cognitive task presenting module, an infrared eye movement tracking assembly, an eye movement data analyzing module, a test result feedback module and a stimulation mark guiding module;
the cognitive task presentation module is used for presenting an attention task, a search task, a memory task, a calculation task or a reading task to the testee;
the infrared eye movement tracking component records eye movement data obtained by the fact that the detected person completes each task of the cognitive task presentation module in real time and sends the eye movement data to the eye movement data analysis module; the infrared tracker comprises a power supply, an infrared tracker, a data transmission unit and a controller; the infrared tracker is connected with the controller, acquires eye movement data obtained by the measured person according to the cognitive task presentation module in real time, and is connected with the eye movement data analysis module through the data transmission unit.
The eye movement data analysis module adopts a human eye vision dynamic analysis method to evaluate the attention score, the search score, the memory score, the calculation score or the reading score reflected by the attention task, the search task, the memory task, the calculation task or the reading task of the tested person; and sending the result to the test result feedback module and the stimulation guide module;
the test result feedback module is used for feeding back the test result to the tested person;
the stimulation mark guiding module is used for guiding the eye movement processing of the tested person.
The attention task may be a visual orientation task or an attention continuation task.
When the attention task is a visual orientation task, determining the first score of attention as A according to the distance between the gazing point position of the testee and the position of the current visual stimulation1Determining a second attention score A according to the fixation times of the subject2Determining the third fraction A of attention according to the eye jump time of the subject3Determining the fourth fraction A of attention according to the eye jump amplitude of the subject4Combining the first attention score, the second attention score, the third attention score and the fourth attention score to obtain the attention score A of the current testee1+ A2+ A3+ A4。
And when the attention task is an attention continuation task, determining an attention score A according to the distance between the gazing track of the tested person and the sequence position of the current visual stimulation.
Visual search tasks refer to the presentation of different symbols (letters, numbers, shapes, animals, plants, characters … …) on the screen that require the trainer to find a particular target.
Accordingly, the present invention for calculating the visual search score of the subject includes: presenting a plurality of visual stimuli in a search task to a tested person, and determining a first visual search score B according to the distance between the last gazing point position in a gazing track and a target visual stimulus position in the search task1(ii) a Determining and searching a second score B according to the total fixation duration of the testee2(ii) a Determining and searching a third score B according to the gazing track of the tested person3Combining the first search score, the second search score and the third search score; obtaining the visual search score B of the current testee1+ B2+ B3。
The memory task is divided into a recognization task and a recall task according to a memory ability testing method. And (3) reauthentication: (judging whether the stimulus presented by the next picture is the same as that of the previous picture (or the previous N pictures with increased difficulty), and adopting a memory method that a blank screen is presented after the picture is presented and the stimulus seen by the previous screen is required to be drawn by eye movement;
calculating the memory score of the subject comprises: and when the first visual stimulus disappears and the second visual stimulus appears, determining a memory score C according to whether a visual stimulus contour drawn by a watching track of the tested person to the second visual stimulus is the same as the first visual stimulus contour.
Calculating the memory score of the subject comprises: and presenting a plurality of visual stimuli in a memory task (recall task) to the tested person, presenting the visual stimuli in sequence, and determining a memory score C according to the comparison between the watching track of the tested person and the contour of the visual stimuli which disappears when the current visual stimuli disappears and the tested person faces a blank picture.
Calculating the memory score of the subject comprises: presenting multiple visual cues in memory task (spatial short-term memory) to a subjectAnd when the plurality of visual stimuli disappear, and the watching track of the tested person is inconsistent with the appearing sequence of the disappeared plurality of visual stimuli at a certain visual stimulus, determining to memorize the first score C1(ii) a Determining a second score C according to the gaze duration of the subject2(ii) a Combining the first memory score and the second memory score to obtain the memory score of the current testee, or presenting a target stimulus in a memory task to the testee, then the target stimulus disappears, then the target stimulus and other interference stimuli are presented, the first memory score is determined according to the elapsed time of positioning the target stimulus of the testee, the second memory score is determined according to the watching track of the testee, and the third memory score C is determined according to the number of times of looking back of the testee3(ii) a Combining the first memory score, the second memory score and the third memory score to obtain the memory score C of the current testee1+ C2+ C3。
The calculation tasks comprise counting, vertical calculation and application problem calculation.
And when the calculation task is counting, determining a calculation score D according to the gazing times, gazing time, backsight times, eye jump distance and gazing track of the measured person.
When the calculation task is vertical calculation, determining a first calculation score D according to the gazing track of the testee1(ii) a Determining a second calculation score D according to the average fixation time, fixation times and return times of the testee2(ii) a Combining the first score and the second score to obtain the score D of the current person to be measured1+ D2。
When the calculation task is application question calculation, determining a first calculation score D according to the total fixation time of the person to be measured for the keywords of the application question solution1Determining a second calculation score D according to the fixation times of the person to be tested for the keyword for solving the application problem2Determining a third calculation score D according to the eye jump amplitude of the subject for the keyword for solving the problem of the application problem3Determining a fourth calculation score D according to the review times of the testee for the keyword for solving the application problems4Combining the first score, the second score, the third score and the fourth score to obtain the score D of the current person to be measured1+ D2+ D3+D4。
Whether the first fixation position and fixation track reaction calculation strategy is an effective strategy or an optimal strategy; the average fixation time, fixation times and return times reflect the calculation speed.
Calculating the reading score of the subject comprises: determining a first reading score E according to the fixation duration of the person to be tested on a specific word, sentence and paragraph1(ii) a Determining a second reading score E according to the review times of the tested person for a specific word and sentence2Determining the third reading score E according to the rightward eye jump amplitude of the subject3Determining the reading fourth fraction E according to the total fixation duration of the subject4Combining the reading first score, the reading second score, the reading third score and the reading fourth score to obtain the reading score E of the current person to be tested1+ E2+ E3+E4。
According to different cognitive abilities of the testees, performing special cognitive ability training on the testees with lower cognitive ability scores, such as A in the attention scores of the testees1And if the score is lower than other scores, preferentially training the attention of the tested person, and adopting a shorter distance between the gazing point position and the position of the current visual stimulus when the training is started, and gradually increasing the distance to train the function in the attention of the tested person.
Example 2:
as an improvement to the above embodiments, we employ a stimulation mark guide module that includes intermittent presentation, changing brightness, or changing color of a mark, wherein the mark includes a pattern, text, letter, number, or sound; the beneficial effects are that can effectively guide to be measured person and train, the mode of suggestion is diversified, can all play good training effect to different measured persons.
Although the embodiments of the present invention have been described with reference to the accompanying drawings, it is not intended to limit the scope of the present invention, and it should be understood by those skilled in the art that various modifications and variations can be made without inventive efforts by those skilled in the art based on the technical solution of the present invention.