KR102426939B1 - User Customized Training System And Method For Improving Cognitive Using Cognitive Impairment Analysis By Virtual Reality Based Cognitive Game Score - Google Patents

Abstract

A customized cognitive improvement training system using a cognitive impairment analysis according to a virtual reality-based cognitive game score according to an embodiment of the present disclosure,
a virtual reality experience unit 100 through which a user can experience virtual reality contents; a data processing unit 200 that collects user data obtained from the virtual reality experience unit 100 and generates evaluation data for cognitive impairment analysis; Cognitive impairment analysis unit 300 for analyzing the degree of cognitive impairment of the user using the evaluation data generated by the data processing unit 200; and a customized training program application unit 400 that is linked with the cognitive impairment analysis unit 300 to apply a customized training program for improving the user's cognitive impairment to the virtual reality experience unit 100; including,
The cognitive disorder analysis unit 300 is a data conversion module 310 that converts the evaluation data generated by the data processing unit 200 into data for analysis of cognitive impairment and the data converted by the data conversion module 310 A customized cognitive improvement training system using a cognitive impairment analysis according to a score of a virtual reality-based cognitive game, characterized in that it includes a data analysis module 320 that analyzes the degree of cognitive impairment of the user based on it.

Description

User Customized Training System And Method For Improving Cognitive Using Cognitive Impairment Analysis By Virtual Reality Based Cognitive Game Score

The present specification relates to a cognitive improvement training system and method, and more particularly, to a cognitive improvement training system and method for applying a customized cognitive improvement training program to a user by analyzing cognitive impairment according to a virtual reality-based cognitive game score. it's about

Mild cognitive impairment refers to a preclinical stage of dementia in which memory and cognitive functions are significantly lowered compared to age and education level, but do not interfere with life. Memory deterioration appears to be the main problem, but unlike major neurocognitive disorders, daily life is relatively normal. In order to diagnose mild cognitive impairment, it is first necessary to determine whether the patient has mild cognitive impairment syndrome. That is, the patient himself or his family complains of cognitive dysfunction, and the cognitive dysfunction must be proven through neuropsychological evaluation. In addition, there is no obvious impairment in the overall ability to perform daily activities, and the diagnostic criteria for dementia must not be satisfied. After that, it is necessary to identify which subtype of mild cognitive impairment falls under, and if the cause of the disease can be identified, it is necessary to confirm it through testing.

In order to prevent mild cognitive impairment, it is necessary to properly manage high blood pressure and diabetes, and to maintain good health through regular exercise. Even with mild forgetfulness occurring in the elderly, it is necessary to regularly visit a neurologist and receive treatment to diagnose dementia at an early stage.

Accordingly, Korean Patent Registration No. 10-1317040 (hereinafter referred to as 'prior literature') is a method of distinguishing the pattern of changes in the default mode network that appears as dementia progresses by analyzing the default mode networks of normal people, patients with mild cognitive impairment, and Alzheimer's patients. and systems. In the case of the prior literature, since it is possible to accurately distinguish the pattern of changes in the functional connectivity of the default mode network according to the progression of dementia, it is possible to diagnose a patient with dementia. However, the prior literature is a technology for analyzing mild cognitive impairment based on magnetic resonance imaging (MRI), and there is a need for a technology that allows a patient to easily and conveniently identify mild cognitive impairment through a virtual reality-based cognitive game.

US 101317040 B1 US 1020180069947 A US 101022886 B1

A customized cognitive improvement training system and method using a cognitive impairment analysis according to a virtual reality-based cognitive game score according to the present disclosure was created to improve the conventional problems as described above, and it is simple through a game based on virtual reality. It is an object of the present invention to provide a cognitive improvement training system and method that quickly diagnoses cognitive impairment and provides a customized program for improving the user's cognitive impairment.

A customized cognitive improvement training system using cognitive impairment analysis according to a virtual reality-based cognitive game score according to the present disclosure for solving the above problems,

a virtual reality experience unit 100 through which a user can experience virtual reality contents; a data processing unit 200 that collects user data obtained from the virtual reality experience unit 100 and generates evaluation data for cognitive impairment analysis; Cognitive impairment analysis unit 300 for analyzing the degree of cognitive impairment of the user using the evaluation data generated by the data processing unit 200; and a customized training program application unit 400 that is linked with the cognitive impairment analysis unit 300 to apply a customized training program for improving the user's cognitive impairment to the virtual reality experience unit 100; including,

The cognitive impairment analysis unit 300 is a data conversion module 310 that converts the evaluation data generated by the data processing unit 200 into data for analysis of cognitive impairment and the data converted by the data conversion module 310 Based on the data analysis module 320 for analyzing the degree of cognitive impairment of the user may be configured to include.

In addition, the virtual reality experience unit 100 may be configured to include at least one game-based virtual reality content related to an integrated cognitive element.

In addition, the integrated cognitive element may be configured to include at least one of concentration, memory, executive function, motor control ability, language, and spatiotemporal function.

In addition, the data processing unit 200 quantifies each cognitive element domain based on the data collected by the data collection module 210 and the data collection module 210 for collecting the data obtained from the virtual reality experience unit 100 . It may be configured to include a data generation module 220 for generating the evaluated evaluation data.

In addition, the data processing unit 200 may be configured to further include a correction module 230 for correcting the evaluation data based on the user's personal information.

In addition, the data conversion module 310 is provided with big data about the cognitive impairment test and virtual reality content experience of multiple users with cognitive impairment,

The cognitive impairment test is characterized in that it comprises at least one of a Korean-Mini Mental Status Examination (K-MMSE), a Korean-Montreal Cognitive Assessment (K-MOCA), a Digit Span Test (DST), and a Digit Symbol Substitution Test (DSST). can be configured as

In addition, the brain wave analysis unit 500 that detects and analyzes EEG according to the user's activity and a monitoring unit 600 that can monitor the cognitive improvement training effect by interworking with the EEG analysis unit 500 is characterized in that it further comprises can be configured as

A customized cognitive improvement training method using cognitive impairment analysis according to the virtual reality-based cognitive game score according to the present disclosure,

Step (S100) for the user to experience the virtual reality content in the virtual reality experience unit; generating evaluation data for cognitive impairment analysis by collecting user data obtained from the virtual reality experience unit in the data processing unit (S200); Analyzing the degree of cognitive impairment of the user by using the generated evaluation data in the cognitive impairment analysis unit (S300); and applying a customized training program for the improvement of a user's cognitive impairment to the virtual reality experience unit in a customized training program application unit in conjunction with the cognitive impairment analysis unit (S400); It may be configured as comprising a.

In addition, the step S200,

collecting data obtained from the virtual reality experience unit 100 in the data collection module 210 (S210); Generating numerical evaluation data for each cognitive element domain based on the data collected by the data collection module 210 in the data generating module 220 (S220); and correcting the generated evaluation data in the correction module 230 based on the user's personal information (S230); It may be configured as comprising a.

In addition, the step S300,

Converting the evaluation data generated by the data processing unit 200 in the data conversion module 310 to data for analysis of cognitive impairment (S310); And analyzing the degree of cognitive impairment of the user based on the data converted by the data conversion module 310 in the data analysis module 320 (S320); It may be configured as comprising a.

In addition, after the step S400,

Detecting and analyzing the EEG according to the user's activity in the EEG analysis unit 500 (S500); And the step of monitoring the cognitive improvement training effect in the monitoring unit 600 in conjunction with the EEG analysis unit 500 (S600); It may be configured as characterized in that it further comprises.

Accordingly, the customized cognitive improvement training system and method using the cognitive impairment analysis according to the virtual reality-based cognitive game score according to the present disclosure has the advantage that the user can train at the desired time and place by using the virtual reality program, , it has the advantage that it can increase the training effect by improving the training immersion by inducing fun and interest using game-based contents.

In addition, it is possible to diagnose cognitive impairment early by scoring the user's reaction information by matching the event generated in the virtual reality with the input motion information, and analyzing the degree of cognitive impairment of the user according to the score of the reaction information. There is an advantage in that the cognitive improvement effect can be monitored in conjunction with the EEG by detecting and analyzing the EEG according to the user's cognitive improvement training.

1 is a conceptual diagram schematically showing a customized cognitive improvement training system using cognitive impairment analysis according to a virtual reality-based cognitive game score according to the present disclosure;
2 is a block diagram schematically showing the configuration of a virtual reality experience unit and a data processing unit according to the present disclosure;
3 is a block diagram schematically showing the configuration of a cognitive impairment analysis unit and a customized program application unit according to the present disclosure;
4 is a view showing an embodiment of virtual reality-based cognitive game content according to the present disclosure;
5 is a diagram illustrating an embodiment of a customized training program according to the present disclosure;
6 is a view showing an embodiment of a monitoring screen of cognitive improvement training according to the present disclosure;
7 is a flowchart for explaining a customized cognitive improvement training method using cognitive impairment analysis according to a virtual reality-based cognitive game score according to the present disclosure;
8 is a flowchart for explaining step S200 of FIG. 7;
9 is a flowchart for explaining step S300 of FIG. 7 .

Hereinafter, the technical spirit of the present invention will be described with reference to the drawings, which is for easier understanding, and the scope of the present invention is not limited thereto, and the present invention is only defined by the scope of the claims.

In describing the embodiment of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description will be omitted, and the same reference numerals refer to the same components throughout the specification. refers to the element.

1 is a conceptual diagram schematically showing a customized cognitive improvement training system using cognitive impairment analysis according to a virtual reality-based cognitive game score according to the present disclosure, and FIG. 2 is a schematic diagram showing the configuration of a virtual reality experience unit and a data processing unit according to the present disclosure 3 is a block diagram schematically illustrating the configuration of a cognitive disorder analysis unit and a customized program application unit according to the present disclosure, and FIG. 4 is a diagram showing an embodiment of virtual reality-based cognitive game contents according to the present disclosure; FIG. 5 is a diagram illustrating an embodiment of a customized training program according to the present disclosure, FIG. 6 is a diagram illustrating an embodiment of a monitoring screen for cognitive improvement training according to the present disclosure, and FIG. 7 is a virtual diagram according to the present disclosure according to the present disclosure A flowchart for explaining a customized cognitive improvement training method using a cognitive impairment analysis according to a reality-based cognitive game score, FIG. 8 is a flowchart for explaining step S200 of FIG. 7, FIG. 9 is a flowchart for explaining step S300 of FIG. to be.

<Customized cognitive improvement training system using cognitive impairment analysis according to virtual reality-based cognitive game score according to the present disclosure>

1 to 3 , the customized cognitive improvement training system using the cognitive impairment analysis according to the virtual reality-based cognitive game score according to the present disclosure is a virtual reality experience unit 100 , a data processing unit 200 , and a cognitive impairment analysis unit 300 and a customized training program application unit 400 may be included.

The virtual reality experience unit 100 allows a user to experience virtual reality content, and as shown in (a) of FIG. 2 , a content module 110 , a driving module 120 , a display module 130 , It may be configured to include a controller module 140 and a communication module 150 capable of sending and receiving data.

The content module 110 may be configured to include at least one or more game-based virtual reality content related to an integrated cognitive element, and the integrated cognitive element may include concentration, memory, executive function, motor control ability, language and spatiotemporal function. It may be configured as comprising at least one or more of.

For example, if the numbers from 1 to 25 are randomly arranged on the screen in the content related to attention and concentration, the user can guess using the controller module 110 in the order of the numbers, depending on the accuracy of the number sequence and the speed of matching. It can be configured in the form of obtaining score points.

In addition, the content related to memory may be configured in the form of first informing the user about the ingredients in the hamburger, and obtaining score points by selecting the same ingredients in order.

In addition, the contents related to the executive function are score points according to the selection of preparations (umbrella, raincoat, etc.) suitable for a specific situation (eg, rainy situation in August) and wearing clothes (short sleeves, shorts, etc.) in order It can be constructed in the form of obtaining

In addition, referring to FIG. 4 , the contents related to the execution function may be configured in a form in which point points are obtained by selecting the required item and quantity according to the mission given to the user from among various items on the screen.

In addition, referring to FIG. 4 , the contents related to the execution function may be configured in a form of obtaining points by depositing or withdrawing an exact amount of money according to a mission given to the user with respect to the ATM device on the screen.

In addition, the content related to the exercise control ability may be configured in the form of obtaining score points according to the number of hits and the time at which the beat is popped when the user hits the beat by giving the fun of being on the ground with respect to the gourd hanging at a predetermined position.

In addition, the content related to language and spatiotemporal functions is guided to find a way according to the auditory information provided to the user in the compartmentalized space (for example, move two spaces to the right, then go three spaces up, etc.) It can be configured in the form of obtaining score points.

The driving module 120 may be configured to drive the contents of the content module 110 , and it is preferable to use a desktop PC, a notebook PC, or a smart phone as the driving module 120 , but is not limited thereto, and will be described later. It may be configured integrally with the display module 130 to be used.

The display module 130 may be configured to visually implement virtual reality-based content by receiving data from the driving module 120 .

The display module 130 is preferably configured as a head mounted display (HMD) mounted on the user's head, but is not limited thereto, and may be configured in various ways to display image information.

The controller module 140 may be configured to operate the virtual reality-based content by sensing a user's movement.

As an example of such a controller module 140, a glove-type controller (not shown) that is worn on the user's hand and manipulates virtual reality-based content according to the user's hand movement will be described.

The glove-type controller may be specifically configured to include a hand motion sensing unit, a touch sensing unit, a tracking sensing unit, and a communication unit capable of exchanging data.

At least one hand motion sensing unit may be installed at a predetermined location to detect and recognize a user's hand motion, and the user's motion recognized by the hand motion detecting unit is reflected in the virtual reality-based content.

At least one touch sensing unit may be installed in a predetermined position to recognize a touch, and the tracking sensing unit may be configured to detect a three-dimensional movement trajectory and reflect it in virtual reality-based content.

Such a tracking sensing unit may include an IMU sensor, and may be configured such that direction and rotation data are linked together through the IMU sensor. Specifically, the IMU sensor may be composed of a 6-axis sensor composed of a gyroscope and an accelerometer, as well as a 9-axis sensor composed of a gyroscope, an accelerometer, and a geomagnetic sensor.

As another example of the controller module 140, a shoe-type controller (not shown) that is worn on the user's foot and manipulates virtual reality-based content according to the user's foot movement will be described.

The shoe-type controller may be specifically configured to include a foot position sensing unit, a floor pressure sensing unit, and a communication unit capable of exchanging data.

At least one foot position sensing unit is installed at a predetermined position and may be configured to detect the user's foot position, and the floor pressure sensing unit is installed at a predetermined position at least one or more to recognize that the foot is in contact with the ground. can be configured to

On the other hand, the controller module 140 is not limited to the aforementioned glove-type controller and shoe-type controller, and may be configured in various ways (such as a chair-type controller) as needed.

The data processing unit 200 is for generating evaluation data for cognitive impairment analysis by collecting the user's data obtained from the aforementioned virtual reality experience unit 100, as shown in (b) of FIG. It may be configured to include a collection module 210 , a data generation module 220 , and a communication module 240 capable of sending and receiving data.

The data collection module 210 may be configured to receive and store data obtained from the virtual reality experience unit 100,

The data generation module 220 may be configured to generate numerical evaluation data for each cognitive element domain based on the data stored in the data collection module 210 . As described above in the content module 110 , the cognitive element may include at least one of concentration, memory, executive function, motor control ability, language, and spatiotemporal function.

On the other hand, the data processing unit 200 may be configured to further include a correction module 230, the correction module 230 based on the user's personal information based on the evaluation data generated by the data generating module 220 can be configured to correct. For example, it may be configured to set the plus or minus points according to the gender, divide the age into predetermined sections to set the plus or minus points, so as to be corrected according to the age section to which the user's gender and age belong.

In addition, the correction module 230 may be configured to be corrected according to the section to which the user's data belongs by dividing the user's personal information and the average data of the same person into a predetermined section to set the subtraction points.

The cognitive impairment analysis unit 300 is to analyze the degree of cognitive impairment of the user by using the evaluation data generated by the data processing unit 200, as shown in FIG. 3 (a), the data conversion module 310 ), a data analysis module 320 and a communication module 330 capable of sending and receiving data.

The data conversion module 310 may be configured to receive the evaluation data generated by the data processing unit 200 and convert it into data for analysis of cognitive impairment.

This data conversion module 310 may be equipped with big data about the cognitive impairment test and virtual reality content experience of multiple users with cognitive impairment, such a cognitive impairment test is K-MMSE (Korean-Mini Mental Status Examination), It may be configured to include at least one of Korean-Montreal Cognitive Assessment (K-MOCA), Digit Span Test, and Digit Symbol Substitution Test (DSST).

The data analysis module 320 may be configured to analyze the degree of cognitive impairment of the user based on the data converted by the data conversion module 310 .

For example, when converted to K-MMSE data, based on a total score of 30 points, a score of 24 or higher is normal, a score of 20 or more and less than 24 is mild cognitive impairment, and a score of less than 20 is considered moderate cognitive impairment. can be configured to be analyzed.

In addition, when converted to K-MOCA data, a score of 23 or higher based on 23 points may be analyzed as normal, and a case of less than 23 points may be analyzed as cognitive impairment.

In addition, when converted to DST data, if the score of DF (Digit Forward)-DB (Digit Backward) is 3 or less, it may be normal, and if it is 4 or more, it may be analyzed as cognitive impairment.

In addition, when converted to DSST data, the average score data of users with mild cognitive impairment can be used as a cutoff criterion, and when the score is lower than this, it can be configured to be analyzed as cognitive impairment.

This data analysis module 320 may be configured to include an artificial neural network unit (not shown), wherein the artificial neural network unit extracts cognitive impairment analysis information and features of the converted data for the converted data for the cognitive disorder test in advance. It learns and analyzes the acquired feature map to output the degree of cognitive impairment for the conversion data of the user, and includes an autoencoder and a deep learning model unit.

The autoencoder generates a feature map that extracts features from a plurality of transformed data converted by the data conversion module 310, and the deep learning model unit is trained in advance with the feature map and cognitive disorder diagnosis information to make the feature map It may be configured to output the degree of cognitive impairment of the user using

In addition, the autoencoder includes an input layer, a hidden layer, and an output layer, wherein the hidden layer has less than three layers, and it can be configured to be calculated and controlled so that the root mean square deviation between the input layer and the output layer is minimized. .

On the other hand, the cognitive impairment analysis unit 300 is not limited to the above, and transmits the data converted in the data conversion module 310 to a separate related institution through the communication module 330, and Of course, it can also be configured as a method of analyzing the degree of cognitive impairment of a user by receiving feedback from an institution.

The customized program application unit 400 is interlocked with the cognitive impairment analysis unit 300 to apply a customized training program for improving the user's cognitive impairment to the virtual reality experience unit 100, as shown in FIG. 3(b). ) may be configured to include a training program module 410, a program selection module 420, a program application module 430, and a communication module 440 capable of exchanging data as shown in FIG.

The training program module 410 may include at least one program for improving the user's cognitive impairment.

The training program module 410 includes a brain-waking exercise program that awakens the brain senses by stimulating the brain surface and body, a virtual reality brain-filling program to fill the brain awakened by the brain-waking exercise, an intermediate rest program for tired brains and eyes, and It can be composed of including a brain healing program for brain activation by promoting blood circulation in the body.

Hereinafter, the brain-waking exercise program will be described in detail.

The brain-waking exercise program is a training program without a virtual reality device, and may be performed in the order of a head tapping process, a neck tapping process, a shoulder tapping process, an armpit tapping process, an arm tapping process, a side tapping process, and a belly tapping process.

The step of tapping the head is performed by sitting in an upright position on a chair, placing both hands on the head, and using fingers in front and side of the head. It can consist of a process of tapping lightly on the stomach and back.

The neck tapping process is performed in the right posture on the chair. Next, round your hands as if you were catching an egg, and then lightly tap the back of your neck.

The shoulder tapping process may consist of rounding the hand as if catching an egg, placing the hand on the opposite shoulder and tapping lightly, and then performing the other side as well.

The armpit tapping process may consist of extending one arm straight up, making a fist lightly to tap the opposite armpit, and then performing the other armpit tapping process.

The arm tapping process may consist of extending one arm forward, placing the opposite hand on the shoulder, and then lightly tapping the arm from the shoulder to the wrist to come down and then perform the other side as well.

The flank tapping process may include straightening the back and not in a correct posture, clenching a fist lightly and placing it on the flank, and then tapping lightly from top to bottom and from bottom to top.

The belly tapping process may consist of sitting with a straight back and sitting in an upright posture, then tapping slowly in a clockwise direction with both hands on top of each other, and then performing the reverse process in reverse.

Hereinafter, the brain filling program will be described.

The brain filling program is a training program by a virtual reality device, and may consist of a process of repeatedly executing virtual reality-based cognitive game contents capable of improving the user's insufficient cognitive elements.

For example, as shown in Fig. 5, in order to improve the user's memory and execution function, from among various items on the screen, content in the form of obtaining score points by selecting the required item and quantity according to the mission given to the user may be configured to repeatedly perform.

In addition, as shown in FIG. 5 , in order to improve cognitive and motor functions, content in the form of obtaining score points by selecting items and quantities required according to the mission given to the user from among various items on the screen was performed. Next, after a short break, the on-screen ATM device may be further configured to perform content in the form of obtaining points according to depositing or withdrawing the correct amount of money according to the mission given to the user.

Since such virtual reality-based cognitive game content has already been described in the virtual reality experience unit 100, it will be omitted.

Hereinafter, the intermediate rest program will be described in detail.

The intermediate rest program is a program for training without a virtual reality device, and may be performed in the order of a brain massage process, an eye massage process, an eye acupressure process, and an eye puffing process.

The brain massage process may consist of a process of sitting comfortably in a chair, placing both hands on the head, lightly pressing for 5 seconds as if acupressure on the front, upper, side, and back of the head, and repeating the raft.

The eye massage process may consist of a process of sitting comfortably in a chair, rubbing both palms on the eyes, and then turning the pupils left, right, up, down, clockwise and counterclockwise with the eyes closed. .

The eye acupressure process may consist of sitting comfortably in a chair, placing the second and third fingers on the eyes, and then lightly pressing the upper, lower, and lower eyebrows in a spiral from the inside to the outside.

The eye-raising process may include sitting comfortably in a chair, tightly closing the eyes for 5 seconds, and then opening the eyes for 5 seconds.

Hereinafter, the brain healing program will be described in detail.

The brain healing program is a program for training without a virtual reality device, and may be performed in the order of a neck stretching process, a shoulder stretching process, a wrist stretching process, a palm stretching process, and a finger stretching process.

The neck stretching process may consist of placing one hand lightly on the opposite side of the head, then tilting the neck to one side and pressing the head with a hand to stretch the muscles next to the neck, and then performing for 5 seconds on the side.

In addition, the neck stretching process may consist of putting both hands under the chin, then tilting the head back while pushing the hand as if lifting the chin, stopping when a feeling of extension is felt in the front of the neck and holding it for 5 seconds.

The shoulder stretching process may consist of sitting on a chair in an upright posture, placing both hands on the shoulder, and turning the shoulder from the inside to the outside as if drawing a circle.

In addition, the shoulder stretching process may consist of sitting in a straight posture with both arms extended, slowly raising both shoulders toward the ears as much as possible, maintaining the posture for about 5 seconds, and then lowering the shoulders.

The wrist stretching process may consist of a process of sitting on a chair in an upright posture, loosening the strength of the wrist and stretching the fingers, and then lightly brushing the wrist in an up and down direction.

The palm stretching process may consist of a process of straightening the waist and sitting on a chair in an upright posture, widening the chest and spreading both hands, and clasping the palms together.

The finger stretching process may consist of a process of sequentially folding and unfolding the fingers as if counting one two three, bending and pinning the knuckle of the fingertip, and repeating from the first finger to the fifth finger.

In addition, the finger stretching process may consist of a process in which the second and first fingers of both hands meet to form a square, and then turn the back of the palm to show the back of the hand and gradually ascend upward.

The program selection module 420 may be configured to select a customized program for improving the user's insufficient cognitive element based on the analysis result of the cognitive impairment analysis unit 300 .

The program application module 430 may be configured to apply the program selected by the program selection module 420 to the virtual reality experience unit 100 .

On the other hand, the customized cognitive improvement training system using the cognitive impairment analysis according to the virtual reality-based cognitive game score according to the present disclosure is an EEG analysis unit 500 and the EEG analysis unit 500 that detect and analyze EEG according to a user's activity. It may be configured to further include a monitoring unit 600 that can monitor the cognitive improvement training effect in conjunction with.

As shown in FIG. 6 , the monitoring unit 600 monitors the cognitive improvement effect for each cognitive element domain, monitors the user's training data compared to the average training data for each age, and monitors the training effect for continuous training by date. may be configured to be monitored.

Accordingly, the customized cognitive improvement training system using the cognitive impairment analysis according to the virtual reality-based cognitive game score according to the present disclosure has the advantage that the user can train at the desired time and place by using the virtual reality program, There is an advantage that the training effect can be increased by increasing the training immersion by generating fun and interest using the base contents.

In addition, it is possible to diagnose cognitive impairment early by scoring the user's reaction information by matching the event generated in the virtual reality with the input motion information, and analyzing the degree of cognitive impairment of the user according to the score of the reaction information. There is an advantage in that the cognitive improvement effect can be monitored in conjunction with the EEG by detecting and analyzing the EEG according to the user's cognitive improvement training.

<Customized cognitive improvement training method using cognitive impairment analysis according to virtual reality-based cognitive game score according to the present disclosure>

Referring to FIG. 7 , a customized cognitive improvement training method using a cognitive impairment analysis according to a virtual reality-based cognitive game score according to an embodiment of the present disclosure,

In the virtual reality experience unit 100, the user experiences the virtual reality content (S100);

generating evaluation data for cognitive impairment analysis by collecting user data obtained from the virtual reality experience unit in the data processing unit 200 (S200);

Analyzing the degree of cognitive impairment of the user by using the generated evaluation data in the cognitive impairment analysis unit 300 (S300); and

The step (S400) of applying a customized training program for the improvement of the user's cognitive impairment to the virtual reality experience unit 100 by interworking with the cognitive impairment analysis unit 300 in the customized training program application unit 400; It may be configured as comprising a.

On the other hand, in step S200, as shown in FIG. 8,

collecting data obtained from the virtual reality experience unit 100 in the data collection module 210 (S210);

Generating numerical evaluation data for each cognitive element domain based on the data collected by the data collection module 210 in the data generating module 220 (S220); and

Compensating the generated evaluation data in the correction module 230 based on the user's personal information (S230); It may be configured as comprising a.

In addition, as shown in FIG. 9, the step S300 is

Converting the evaluation data generated by the data processing unit 200 in the data conversion module 310 to data for analysis of cognitive impairment (S310); and

Analyzing the degree of cognitive impairment of the user based on the data converted by the data conversion module 310 in the data analysis module 320 (S320); It may be configured as comprising a.

In addition, the customized cognitive improvement training method using the cognitive impairment analysis according to the virtual reality-based cognitive game score according to an embodiment of the present disclosure,

After the step S400,

Detecting and analyzing the EEG according to the user's activity in the EEG analysis unit 500 (S500); And the step of monitoring the cognitive improvement training effect in the monitoring unit 600 in conjunction with the EEG analysis unit 500 (S600); It may be configured as characterized in that it further comprises.

Although described above with reference to the drawings according to the embodiment of the present disclosure, it is possible for those of ordinary skill in the art to make various applications, modifications and adaptations within the scope of the present invention based on the above contents. will be.

1000: Customized cognitive improvement training system using cognitive impairment analysis according to virtual reality-based cognitive game score according to the present disclosure
S1000: Customized cognitive improvement training method using cognitive impairment analysis according to virtual reality-based cognitive game score according to the present disclosure
100: virtual reality experience unit 110: content module
120: drive module 130: display module
140: controller module 150: communication module
200: data processing unit 210: data collection module
220: data generation module 230: correction module
240: communication module 300: cognitive impairment analysis unit
310: data conversion module 320: data analysis module
330: communication module 400: customized training program application unit
410: training program module 420: program selection module
430: program application module 440: communication module
500: EEG analysis unit 600: Monitoring unit

Claims (11)

a virtual reality experience unit 100 through which a user can experience virtual reality contents; a data processing unit 200 that collects user data obtained from the virtual reality experience unit 100 and generates evaluation data for cognitive impairment analysis; Cognitive impairment analysis unit 300 for analyzing the degree of cognitive impairment of the user using the evaluation data generated by the data processing unit 200; a customized training program application unit 400 interlocking with the cognitive impairment analysis unit 300 to apply a customized training program for improving the user's cognitive impairment to the virtual reality experience unit 100; EEG analysis unit 500 for detecting and analyzing EEG according to the user's activity; and a monitoring unit 600 that is interlocked with the EEG analysis unit 500 to monitor the cognitive improvement training effect; including,
The virtual reality experience unit 100 includes at least one game-based virtual reality content related to an integrated cognitive element,
The data processing unit 200 is a data collection module 210 that collects data obtained from the virtual reality experience unit 100 and a numerical evaluation for each cognitive element domain based on the data collected by the data collection module 210 . It characterized in that it comprises a data generating module 220 for generating data and a correction module 230 for correcting the evaluation data based on the user's personal information,
The correction module 230 sets the plus or minus points according to the gender, divides the age into predetermined sections, sets the plus or minus points, and performs primary correction according to the user's gender and age section to which the age belongs, and the user's personal information It is characterized in that by dividing the average data of the same person into a predetermined section based on the same and setting addition and subtraction points, secondary correction is performed according to the section to which the user's data belongs,
The cognitive disorder analysis unit 300 is a data conversion module 310 that converts the evaluation data generated by the data processing unit 200 into data for analysis of cognitive impairment and the data converted by the data conversion module 310 Includes a data analysis module 320 that analyzes the degree of cognitive impairment of the user based on,
The data analysis module 320 learns and analyzes the cognitive impairment analysis information for the transformation data for the cognitive impairment test in advance and the feature map from which the characteristics of the transformation data are extracted, and outputs the degree of cognitive impairment for the transformation data of the user. It is characterized in that, the autoencoder generates a feature map extracted from a plurality of transformed data converted by the data conversion module 310, and the feature map is trained in advance with the feature map and cognitive impairment diagnosis information, and the feature map is used A customized cognitive improvement training system using a cognitive impairment analysis according to a virtual reality-based cognitive game score, characterized in that it includes a deep learning model unit that outputs the degree of cognitive impairment of the user.
delete According to claim 1,
The integrated cognitive element is a customized cognitive improvement training system using a cognitive impairment analysis according to a score of a virtual reality-based cognitive game, characterized in that it includes at least one of attention concentration, memory, executive function, motor control ability, language and spatiotemporal function.
delete delete According to claim 1,
The data conversion module 310 is provided with big data related to the cognitive impairment test and virtual reality content experience of multiple users with cognitive impairment,
The cognitive impairment test is characterized in that it comprises at least one of a Korean-Mini Mental Status Examination (K-MMSE), a Korean-Montreal Cognitive Assessment (K-MOCA), a Digit Span Test (DST), and a Digit Symbol Substitution Test (DSST). A customized cognitive improvement training system using cognitive impairment analysis according to the virtual reality-based cognitive game score.
delete In the virtual reality experience unit 100, the user experiences the virtual reality content (S100); generating evaluation data for cognitive impairment analysis by collecting user data obtained from the virtual reality experience unit in the data processing unit 200 (S200); Analyzing the degree of cognitive impairment of the user by using the generated evaluation data in the cognitive impairment analysis unit 300 (S300); and applying a customized training program for improving the user's cognitive impairment to the virtual reality experience unit 100 by interworking with the cognitive impairment analysis unit 300 in the customized training program application unit 400 (S400); including,
The step S200 is,
collecting data obtained from the virtual reality experience unit 100 in the data collection module 210 (S210); Generating numerical evaluation data for each cognitive element domain based on the data collected by the data collection module 210 in the data generating module 220 (S220); and correcting the generated evaluation data in the correction module 230 based on the user's personal information (S230); including,
The step S230 is,
By setting the plus or minus points according to the gender, dividing the age into predetermined sections, setting the plus or minus points, the user's gender and age are first corrected according to the age section to which the user belongs, and the average data of the same person as the user's personal information is collected. It is characterized in that by dividing into a predetermined section as a reference, adding/decreasing points are set, and secondary correction is performed according to the section to which the user's data belongs,
The step S300 is,
Converting the evaluation data generated by the data processing unit 200 in the data conversion module 310 to data for analysis of cognitive impairment (S310); And analyzing the degree of cognitive impairment of the user based on the data converted by the data conversion module 310 in the data analysis module 320 (S320); Customized cognitive improvement training method using cognitive impairment analysis according to the virtual reality-based cognitive game score, characterized in that it comprises a.
delete delete 9. The method of claim 8,
After the step S400,
Detecting and analyzing the EEG according to the user's activity in the EEG analysis unit 500 (S500); And the step of monitoring the cognitive improvement training effect in the monitoring unit 600 in conjunction with the EEG analysis unit 500 (S600); Customized cognitive improvement training method using cognitive impairment analysis according to the virtual reality-based cognitive game score, characterized in that it further comprises.

Images