KR20180115866A - Improving cognitive ability, education and evaluation system based on Virtual Reality for early diagnosis of cognitive impairment - Google Patents

Abstract

The present invention relates to a system for improving, educating, and evaluating cognitive ability based on virtual reality for early diagnosis of cognitive impairment, which displays contents such as an image and a game as three-dimensional virtual reality image information, scores reaction information of a user through matching of operation information inputted with event information within the virtual reality, and is able to diagnose a disability index of the user in accordance with a score of the reaction information. The preset invention scores the reaction information of the user through matching of the operation information inputted with an event occurred within the three-dimensional virtual reality, and diagnoses the disability index of the user in accordance with the score of the reaction information, thereby capable of early diagnosing the cognitive impairment through actual behavior of the user.

Description

[0001] The present invention relates to a VR-based cognitive enhancement, education and evaluation system for early diagnosis of cognitive impairment,

The present invention relates to a cognitive capability enhancement, education and evaluation system for early diagnosis of cognitive disorders based on VR (Virtual Reality), and more particularly, VR for the early diagnosis of cognitive impairment, which can provide the user with diagnosis and recommendation contents according to the score of the reaction information, scoring the reaction information of the user through the matching of the event information and the input operation information in the virtual reality, Based cognitive ability enhancement, education and evaluation system.

Mild cognitive impairment refers to the pre-dementia stage in which memory and cognitive function is significantly lowered compared to age and education level, but does not interfere with life. Decreased memory is the main problem, but unlike major neuropsychiatric disorders, everyday life is relatively normal. In order to diagnose mild cognitive impairment, one must first ascertain whether the patient is a mild cognitive disorder syndrome. In other words, the patient or his / her family complain of cognitive dysfunction, and cognitive dysfunction should be proved through neuropsychological evaluation. In addition, there is no significant obstacle to the overall ability to perform daily activities, and the criteria for diagnosis of dementia should not be met. And the type of subtype of mild cognitive impairment, and if it is possible to identify the causative disease, it is necessary to confirm it by inspection.

To prevent mild cognitive impairment, proper management of hypertension, diabetes, etc. is necessary and it is necessary to maintain health by regular exercise. Even in the case of mild amnesia occurring in the elderly, efforts should be made to diagnose dementia early, while regularly visiting neurologists and receiving medical care.

Korean Pat. No. 10-1317040 (hereinafter referred to as "prior art") discloses a method for distinguishing a change pattern of a default mode network appearing from the progress of dementia by analyzing a default mode network of a normal person, a mild cognitive impairment patient, and a patient with Alzheimer's disease And a system. In the case of the prior literature, since the pattern of change of the functional connectivity of the default mode network according to the progress of dementia can be accurately discriminated, it is possible to diagnose the demented patient. However, the prior art is a technique to analyze mild cognitive impairment based on magnetic resonance imaging (MRI), and it is necessary to have a technique that can identify mild cognitive impairment easily and conveniently based on the patient's activities in daily life.

Korean Patent No. 10-1317040, entitled "METHOD AND SYSTEM FOR CLASSIFICATION OF FUNCTIONAL CHANGE FUNCTIONALITY MODELS OF DEFAULT MODE NETWORKS ACCORDING TO PROGNOSIS OF Mild cognitive impairment, Alzheimer's disease in normal persons, Registered on Feb. 20, 2013.

Disclosure of Invention Technical Problem [8] The present invention has been made to solve the above problems, and it is an object of the present invention to provide a method and system for scoring reaction information of a user through matching of an event generated in a 3D virtual reality and input operation information, It has its purpose.

In addition, the present invention has an object of extracting recommended content according to a disability index and providing it to a user.

In addition, the present invention aims at analyzing reaction information by evaluation factors, scoring reaction information for each evaluation factor, and diagnosing the user's disability index by characteristics and capabilities.

The VR-based cognitive capability enhancement, education, and evaluation system for early diagnosis of cognitive disorders according to the present invention is characterized in that the system includes at least one of a video, a game, a daily image, a database storing event information that can be generated in the content, A display unit that is worn on the head of the user and that displays the image information to the user, and a display unit that displays an image of the specific content selected by the user, An event generation unit for extracting event information from the database and generating the extracted event information in the image information, a user reaction generation unit for generating reaction information of the user by matching the operation information input through the at least one signal input apparatus with the evaluation event information, , Scoring the reaction information, It extracts a recommended content in accordance with the fault diagnosis unit, and the fault index for diagnosing disorders of the user index comprises providing recommendations call for service to the user.

The user reaction generating unit according to the present invention includes an evaluation factor extracting unit for extracting at least one evaluation factor assigned to the evaluation event and an evaluation factor analyzing unit for analyzing the reaction information for each evaluation factor.

The fault diagnosis unit according to the present invention scans the reaction information analyzed for each evaluation factor to diagnose the failure index of the user according to the characteristics and capabilities.

The present invention scans the reaction information of a user through matching of an event generated in a 3D virtual reality and input operation information, diagnoses a user's failure index according to the score of the reaction information, It is possible to diagnose the disorder early.

In addition, the present invention has an effect of improving the cognitive ability by extracting the recommended content according to the failure index and providing it to the user.

In addition, the present invention has the effect of diagnosing cognitive disorders in detail by analyzing reaction information according to evaluation factors, scoring reaction information for each evaluation factor, and diagnosing a user's disability index according to characteristics and capabilities.

1 is a block diagram of a VR-based cognitive capability enhancement, education and evaluation system according to the present invention.
FIG. 2 is a diagram illustrating an evaluation factor of event information according to the present invention.
FIG. 3 is an embodiment for explaining diagnosis of a user's disability index according to characteristics and capabilities according to reaction information for each evaluation factor according to the present invention.
FIG. 4 is a flowchart illustrating a method for improving cognitive ability, training, and evaluation based on VR according to the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

1 is a block diagram of a VR-based cognitive capability enhancement, education and evaluation system according to the present invention.

Referring to FIG. 1, the present invention is a database 100. The content conversion unit 200, the display unit 300, the event generating unit 400, the signal inputting unit 500, the user response generating unit 600, the fault diagnosis unit 700, and the recommended content providing unit 800 .

The date base 100 may include a content storage unit 110 for storing contents such as video, game, daily life, etc. and an event storage unit 120 for storing event information that can be generated in the content.

The content stored in the content storage unit 110 may be composed of content such as driving, exercise, growing a plant or an animal, consulting a complaint, video, game, or daily contents.

Among the contents stored in the contents storage unit 110, events such as destination information, person or object, signal system recognition, speed increase or the like may be generated in the 'driving' contents. The event information is classified into contents and stored in the event storage unit 120.

The content conversion unit 200 is an apparatus for converting a specific content selected by a user among contents stored in the content storage unit 110 into video information composed of a three-dimensional virtual reality. For example, when the content of 'plant growing' is selected by the user, the content conversion unit 200 generates image information in which plants are arranged in a three-dimensional virtual reality space. The three-dimensional virtual reality (VR) may be a real image or an image composed of computer graphics (CG). Therefore, users can indirectly experience situations that they can not directly experience in the real world due to spatial or physical constraints through Virtual Reality (VR) in a virtual environment (Cyberspace).

The display unit 300 is a device that is worn on the head of a user and displays image information to a user. Since the display unit 300 is composed of a stereoscopic HMD (Head Mounted Display) that is displayed on the user's head, the user can have a feeling that the user is actually in a three-dimensional virtual space.

The user can select one of the contents stored in the content storage unit 110 and receive the image information implemented as a virtual reality. Through this, the user can memorize or solve various events (human, animal, obstacle, etc.) artificially added to the real view, and can evaluate the response time and response method. In addition, it can be configured to provide a greenhouse, aquarium, and various other nursery spaces in a virtual reality to nurture virtual animals or plants, and the user can monitor user responses to feeding, plant or animal care, . In addition, a virtual office or a guide can be installed so that complaint handling, consultation, and conversation can be performed.

The content for diagnosing and training cognitive disorders through such virtual reality is not limited to the above example, and may be added or changed by the user.

Meanwhile, the display unit 300 of the present invention may include a microphone and a speaker to increase the reality of virtual reality.

The event generating unit 400 is an apparatus that extracts evaluation event information that can be generated in a specific content from the database 100 and generates the video information. As described above, in the case of the content of 'driving', various events may occur during operation. For example, the driving signal system can be changed from 'Green' to 'Red', and materials such as people, things and animals will be able to appear during driving. The event generation unit 400 extracts evaluation events such as a signal system, a material, and the like from the database 100.

On the other hand, the extracted evaluation event information is converted into image information so as to be output from the three-dimensional virtual reality by the content conversion unit 200, and is outputted as an image through the display unit 300. [

The signal input apparatus 500 is an apparatus for inputting operation information. The signal input device 500 may be a device capable of inputting specific information such as a pad, a mouse, a keyboard, a driving wheel, and the like.

The user reaction generating unit 600 is a device that generates reaction information of a user by matching operation information generated through the signal input device with evaluation event information. The user reaction generating unit 600 may include an evaluation factor extracting unit 610 and an evaluation factor analyzing unit 620.

The evaluation element extracting unit 610 is an apparatus for extracting at least one evaluation element given to an evaluation event. Hereinafter, the evaluation elements given to the evaluation event through the evaluation element extraction unit 610 will be described with reference to FIG.

FIG. 2 is a diagram illustrating an evaluation factor of event information according to the present invention.

Referring to FIG. 2, contents are stored as 'driving', 'growing plants and animals', 'complaints', etc., and event information is designated for each content. In the 'signal system recognition' event information of the 'driving' content, evaluation information of 'whether it is recognized', 'response time', and 'response method' is designated. In addition, the 'destination information inquiry' event information is assigned an evaluation factor of 'whether or not to store'.

As described above, even when the contents are the same, if the event information differs, it can be confirmed that the elements to be evaluated are designated differently from each other. The evaluation element can be specified according to the characteristics of the event information, and is not limited to the case of Fig.

The evaluation element analysis unit 620 is an apparatus for analyzing the reaction information of the evaluation event by evaluation element. Referring to FIG. 2, when the evaluation event is 'signal system recognition' of 'driving', the evaluation element analysis unit 620 analyzes the reaction information of the user for 'response time' and 'recognition'.

Referring again to FIG. 1, the failure diagnosis unit 700 scans the reaction information to diagnose a user's failure index. In addition, the failure diagnosis unit 700 scales the response information for each evaluation factor, and diagnoses the failure index of the user according to characteristics and capabilities.

Hereinafter, the diagnosis of the disability index for each evaluation element will be described in detail with reference to FIG. FIG. 3 is an embodiment for explaining diagnosis of a user's disability index according to characteristics and capabilities according to reaction information for each evaluation factor according to the present invention.

3 is a diagram for explaining a failure index for 'driving' contents. Referring to FIG. 3, the event information of the driving is composed of 'destination information question', 'object or person', and 'signal system recognition'. In addition, an evaluation element is specified in each event information of the 'destination information question', 'object or person', and 'signal system recognition'. The fault diagnosis unit 700 diagnoses the reaction score for each evaluation factor as in the embodiment of FIG.

Hereinafter, the reaction score for each evaluation factor will be described in more detail.

The event of 'destination information question' can be regarded as an element related to memory. Therefore, the fault diagnosis unit 700 scores the user response to the evaluation factor of 'whether or not to store' from the 'destination information inquiry' event information.

In the case of FIG. 3, the response score of 'memory' is 70%. Thus, the memory ability, which corresponds to 'memory', is diagnosed and a value of 0.84 is derived. The method of diagnosing characteristics and capabilities can be set by the user. FIG. 3 is an embodiment in which a diagnostic method of characteristics and capabilities is set up (response score * sqrt (weighted value) / 100).

The failure diagnosis unit 700 may further include a score calculation unit for calculating the reaction score, and a diagnosis unit for diagnosing the characteristics and the capability index. In addition, the manner of diagnosing characteristics and capabilities is not limited to the above example.

On the other hand, since the weights are set differently for each event information, even if the same response score is obtained, the characteristics and the capabilities of each event can be diagnosed differently.

Referring to FIG. 3, 'whether or not the person or object is' is a case where a weight of 2 is assigned to the concentration, a weight of 1 is assigned to the thinking power, and a weight of 1.5 is set to the space-time constructing ability. Therefore, 'whether or not' is 'person or thing' is the case where concentration is the most important characteristic, and the space-time constructing ability is the second and the thinking ability is the third. This weight can be designated by the user, and is not limited to the case of FIG.

On the other hand, 'awareness' of 'signal system recognition' is a weight of 1 for concentration, a weight of 1 for thinking, and a weight of 1.5 for space-time constructing ability. Therefore, 'recognition' of 'signal system recognition' is the most important characteristic of space - time composition ability, and concentration and thinking ability are designated as the second rank characteristic.

Even if the evaluation factors are the same through the above-mentioned weight values, there is an effect of accurately diagnosing the characteristics and capabilities according to 'event information'.

As shown in FIG. 3, the fault diagnosis unit 700 calculates an average value of the fault indices diagnosed on the basis of the event information, and diagnoses the fault indices according to characteristics and capabilities.

The recommended content providing unit 800 is a device for extracting recommended content according to the failure index and providing the extracted recommended content to a user. Referring to FIG. 3, it was diagnosed that the disability index of each of the characteristics and abilities was the highest. Therefore, the recommended content providing unit 800 provides the user with contents capable of improving the thinking power among the contents stored in the content storing unit 110. [

4 is a flowchart illustrating a method for improving cognitive ability, training, and evaluation based on VR according to the present invention. The description of the foregoing is omitted or simplified. The configuration of the VR-based cognitive capability enhancement, education and evaluation system of the present invention can be made clearer by the following description.

Referring to FIG. 4, contents to be provided by a user are selected (S100). The specific content selected by the user is converted by the content conversion unit 200 into video information composed of three-dimensional virtual reality (S200).

The image information of the three-dimensional virtual reality converted by the content conversion unit 200 is provided to the user through the display unit 300 (S300). The display unit 300 may be mounted on the head of the user so that the user can give a feeling that the user is actually in a three-dimensional virtual space.

The event generating unit 400 extracts evaluation event information that can be generated in the specific content from the database 100 (S400). The extracted evaluation event information is converted into image information of a three-dimensional virtual reality, and is outputted as an image through the display unit 300.

It is checked whether operation information is input to the signal input device 500 (S500). If the operation information is input to the signal input device 500, the user reaction generator 600 generates the reaction information of the user by matching the operation information with the evaluation event information (S600). The user reaction generating unit 600 extracts at least one evaluation element assigned to the evaluation event and analyzes the reaction information for each evaluation element. On the other hand, the operation information input to the signal input device 500 is converted into three-dimensional virtual reality image information and output to the display unit 300.

The failure diagnosis unit 700 quantifies the reaction information for each evaluation element through a score calculation unit for calculating a reaction score (S700). The fault diagnosis unit 700 calculates an average value of the fault indices diagnosed on the basis of the event information, and diagnoses the fault indices per element (S800).

When the per-component impairment index is diagnosed, the user selects whether to end the content use or to receive the recommended content (S900).

If the recommendation content provision is selected by the user, the recommended content provisioner 800 extracts the recommendation content according to the failure index and provides it to the user (S1000). Accordingly, the user can select a content to be used among the provided recommended contents.

By providing the recommended content according to the disability index, the cognitive disorder of the user can be improved.

An embodiment of the education and evaluation method according to the contents will be described with reference to the flow chart of Fig.

[Embodiment 1] Operation contents

When the operation content is selected by the user (S100), the content conversion unit 200 extracts the operation content from the database 100 to generate video information of a three-dimensional virtual reality (S200). The image information of the driving content generated by the content conversion unit 200 may be the appearance of the inner viewpoint of the automobile and the appearance of the outer viewpoint of the automobile such as the car bonnet or the rear of the automobile. The image information converted by the content conversion unit 200 is provided to the user through the display unit 300 (S300).

The event generating unit 400 generates an occurrence event that may occur during operation (S400). Occurrence events consist of events that can occur during operation such as signaling changes, pedestrian crossing, navigation, and so on. For example, if the occurrence event is a change in the signaling system, the event generating unit 400 converts the 'signaling system change' into image information composed of three-dimensional virtual reality. The three-dimensional virtual reality image information of 'signal system change' is outputted as an image through the display unit 300.

The user inputs operation information in response to the occurrence event (S500). For example, as the signaling system changes from "green" to "green", the user steps on the brakes. The 'break signal' input by the user becomes the operation information.

If the 'break signal' is input to the signal input apparatus 500, the user response generator 600 generates the response information of the user by matching the 'break signal' with 'change signal system' (S600). The three-dimensional virtual reality image information according to the 'break signal' input to the signal input device 500 is outputted as an image through the display unit 300.

The fault diagnosis unit 700 scales the reaction information for each evaluation element with respect to the 'break signal' (S700). Referring to FIG. 3, the signal system recognition can be classified into evaluation factors of 'recognition' and 'reaction time'. Therefore, the reaction information of the user regarding the recognition of the signal and the response time of the brake is numerically expressed.

The failure diagnosis unit 700 diagnoses the failure index for each of the characteristics and capabilities through the reaction score of 'recognition' and 'reaction time' (S800).

If the failure index for each of the characteristics and capabilities is diagnosed, the user selects whether to end the use of the content or to receive the recommended content (S900).

If the recommendation content provision is selected by the user, the recommended content provisioner 800 extracts the recommendation content according to the failure index and provides it to the user (S1000).

[Embodiment 2] Exercise contents

When 'Baseball' is selected from the exercise content (S100) by the user, the content conversion unit 200 extracts the baseball motion content from the database 100 to generate the image information of the 3D virtual reality (S200). The image information of the baseball motion content generated in the content conversion unit 200 may be a first person's point of view such as a batter's point holding a bat, a point of time of a pitcher, or a third person's point of view. The image information converted by the content conversion unit 200 is provided to the user through the display unit 300 (S300).

The event generator 400 generates an occurrence event that may occur during the baseball game (S400). Incidents may include a baseball strike, a baseball throw, a change in baseball, or an out-count change. For example, when the occurrence event is 'Baseball Inning Change', the event generator 400 converts the viewpoint of the user from the pitcher to the batter according to 'Baseball Inning Change'.

The user inputs operation information corresponding to the generated occurrence event (S500). For example, a user's point of view has changed from a pitcher to a batter in accordance with 'baseball innings change', and when a 'baseball throw' event occurs, the user wields the bat. The 'bat swing' input by the user is the operation information.

If the 'bat swing' is input to the signal input device 500, the user reaction generator 600 matches the 'bat swing' to 'baseball throw' to generate the reaction information of the user (S600). The three-dimensional virtual reality image information according to the 'bat swing' input to the signal input device 500 is output as an image through the display unit 300.

The fault diagnosis unit 700 scales the reaction information for each evaluation factor for the 'bat swing' (S700).

In the case of baseball, it is possible to judge the disability index, but the game element is strong content. Therefore, it is possible to score hits, outs and homeruns by scoring reaction information on 'recognition' and 'reaction time'. You can enjoy baseball games by combining hits, hits, and home runs into baseball roles.

The failure diagnosis unit 700 diagnoses the failure index for each of the characteristics and capabilities through the reaction score of 'recognition' and 'reaction time' (S800). For example, the response time of the bat swing can be used to diagnose the impairment index of concentration and space-time constructing ability.

If the failure index for each of the characteristics and capabilities is diagnosed, the user selects whether to end the use of the content or to receive the recommended content (S900).

If the recommendation content provision is selected by the user, the recommended content provisioner 800 extracts the recommendation content according to the failure index and provides it to the user (S1000).

[Example 3] Plant growth contents

When the plant growing content is selected by the user (S100), the content converting unit 200 extracts the plant growing content from the database 100 and generates image information of the three-dimensional virtual rendering (S200). The image information of the plant-growing content generated in the content conversion unit 200 may be the shape of a flower bed and a flower pot in which the plant grows. The image information converted by the content conversion unit 200 is provided to the user through the display unit 300 (S300).

The event generating unit 400 generates an event that can occur during plant growing (S400). An occurrence event may include an event such as an increase in the size of a plant, an opening, or a disease. For example, if the occurrence event is 'insect pests', the event generator 400 converts the death of the plant due to the pests and diseases into image information of the three-dimensional virtual reality. The 'test image of the plant' converted into the image information of the three-dimensional virtual reality is outputted as an image through the display unit 300.

The user inputs operation information in response to the occurrence event (S500). For example, a 'plant mortality' would allow the user to administer a permanent agent or to spray pesticides. The 'nutrient administration' input by the user is the operation information.

If 'nutrient administration' is input to the signal input device 500, the user reaction generator 600 generates response information of the user by matching the 'administration of nutrient' with 'testosterone of plant' (S600). In addition, the image information of the three-dimensional virtual reality according to 'nutrient administration' input to the signal input device 500 is output to the display unit 300.

The malfunction diagnosis unit 700 scales the response information of each evaluation factor for 'nutritional administration' (S700). Nutrient dosing scored response information on the factor of 'thinking'.

 The failure diagnosis unit 700 diagnoses the failure index for each of the characteristics and capabilities through the reaction score of 'thinking power' (S800).

If the failure index for each of the characteristics and capabilities is diagnosed, the user selects whether to end the use of the content or to receive the recommended content (S900).

If the recommendation content provision is selected by the user, the recommended content provisioner 800 extracts the recommendation content according to the failure index and provides it to the user (S1000).

100: Database 110: Content storage unit
120: Event storage unit 200: Content conversion unit
300: display unit 400: event generating unit
500: signal input apparatus 600: user reaction generating unit
610: Evaluation element extracting unit 620: Evaluation element analyzing unit
700: Failure Diagnosis Department 800: Recommended Content Offering

Claims (3)

A database for storing contents including at least one of video, game, and daily life, and event information that can be generated in the contents;
A content converter for converting a specific content selected by a user into video information composed of a three-dimensional virtual reality;
A display unit that is worn on the head of the user and displays the image information to the user;
An event generating unit for extracting evaluation event information that can occur in the specific content from the database and generating the extracted evaluation event information in the video information;
A user reaction generating unit for generating reaction information of the user by matching operation information inputted through at least one signal input device with the evaluation event information;
A fault diagnosis unit for scoring the reaction information to diagnose the user's fault index; And
And a recommendation content providing unit for providing the recommendation content to the user by extracting a recommendation content according to the failure index and providing the recommendation content to the user.
The method according to claim 1,
The user reaction generating unit
An evaluation element extracting unit that extracts at least one evaluation element assigned to the evaluation event; And
And an evaluation factor analysis unit for analyzing the response information by the evaluation factor. The system for improving cognitive ability, training and evaluation based on VR for early diagnosis of cognitive disorder.
3. The method of claim 2,
Wherein the malfunction diagnosis unit scans the reaction information analyzed for each evaluation factor to diagnose the malfunction index of the user according to the characteristics and the ability, and the VR-based cognitive ability enhancement training and evaluation system for early diagnosis of cognitive disorder.

Images