KR102131139B1 - Apparatus and method for training cognitive disability children - Google Patents

Abstract

The present invention relates to a cognitive training device and method for a child with cognitive impairment, and more particularly, to a cognitive training device and method for a child with cognitive impairment considering the physical function of the child with cognitive impairment. To this end, the cognitive training apparatus according to the present invention is a display for displaying a problem for the subject's cognitive training, a motion detection unit for recognizing the subject's motion, and selecting a problem for the subject's cognitive training and applied to the cognitive training Information input unit for inputting a set value, a physical user interface that a subject carries while performing cognitive training and outputs vibration or light, and for cognitive training displayed on the display based on an operation signal input from the motion detection unit And a control unit that determines whether a correct answer is given to the problem and outputs feedback from the display and the physical user interface according to the determination result.

Description

Apparatus and method for training cognitive disability children}

The present invention relates to a cognitive training device and method for a cognitive impaired child, and more particularly, to a cognitive training device and method for a cognitive impaired child that can increase the effect of cognitive training in consideration of the physical function of the cognitive impaired child. .

Children with cognitive impairment are difficult to independently structure and organize their own environment because it is difficult to perform everyday life independently, and there is a problem dealing with meaningful stimuli provided by the environment.

Cognitive rehabilitation is a learning process that activates these children's cognitive abilities. Through cognitive rehabilitation training, efforts and attempts to increase daily living activities and academic performance of children with cognitive disabilities are continuing.

Among them, the computer-based cognitive rehabilitation program is a software therapy tool that enhances cognitive function by repeatedly training cognitive disorders specifically reduced to patients with cognitive disabilities. Computer-based cognitive rehabilitation programs have several advantages over traditional cognitive rehabilitation methods such as paper-writing method, work method, and table method.

Conventional computer-based cognitive rehabilitation programs provide various cognitive training contents for children with cognitive disabilities, but mostly focus on improving cognitive abilities of children with cognitive disabilities, so they cannot consider the convenience of the subject during cognitive training.

In addition, children with cognitive disabilities are often distracted and difficult to concentrate. In the conventional computer-based cognitive training, there is a lack of a method to increase the effectiveness of cognitive training by allowing children with cognitive disabilities to focus on cognitive training.

Therefore, in cognitive training, there is a need to develop a device and method for children with cognitive disabilities that are physically uncomfortable to receive cognitive training conveniently and effectively in consideration of physical functions of children with cognitive disorders such as brain lesions.

Patent Publication No. 10-2013-0099457

The present invention was created to solve the above problems, and an object of the present invention is to enable a subject with cognitive impairment to receive cognitive training without feeling physical discomfort.

Another object of the present invention is to maximize the effectiveness of cognitive training by allowing subjects with cognitive disabilities to focus on cognitive training.

To this end, the cognitive training apparatus according to the present invention is a display for displaying a problem for the subject's cognitive training, a motion detection unit for recognizing the subject's motion, and selecting a problem for the subject's cognitive training and applied to the cognitive training Information input unit for inputting a set value, a physical user interface that a subject carries while performing cognitive training and outputs vibration or light, and for cognitive training displayed on the display based on an operation signal input from the motion detection unit And a control unit that determines whether a correct answer is given to the problem and outputs feedback from the display and the physical user interface according to the determination result.

In addition, the cognitive training method according to the present invention is a cognitive training method in a cognitive training device for a subject with cognitive impairment. When the cognitive training program is driven, displaying a type of cognitive training on the cognitive training game screen, and the cognitive training When the type of training is selected, receiving a setting value applied to each training, and recognizing whether the subject is correct for a problem for cognitive training by recognizing the motion of the subject and cognitive training game screen and physical use interface of the subject according to the determination result And outputting the feedback to.

As described above, the cognitive training apparatus and method according to the present invention can perform cognitive training and physical activity at the same time by performing cognitive training based on the behavior of a subject with cognitive impairment, thereby enhancing the effectiveness of cognitive training.

In addition, the present invention can adjust the correct answer position of the problem for cognitive training in consideration of the physical function of the subject, so that the subject having a physical paralysis due to brain lesion or the like can receive cognitive training without physical discomfort.

In addition, the present invention has an effect of allowing a subject to focus on cognitive training by providing focused induction feedback through a game screen or a physical user interface possessed by the subject when the reaction is slow when the subject receives cognitive training.

In addition, the present invention can provide a subject with a physical user interface in hand or wear it when receiving cognitive training, thereby providing a more stable feeling than a bare hand in cognitive training, and provides various feedbacks through the physical user interface according to game results. There is an effect that can increase the interest of the subject cognitive training.

1 is an internal configuration of a cognitive training apparatus according to the present invention.
Figure 2 is a flow chart of a cognitive training method according to the present invention.
3 is a diagram showing the types of cognitive training according to the present invention and the problems for each training.
4 is a view showing a setting value input screen applied to cognitive training according to the present invention.
5 is a view showing a focused induction screen according to the present invention.
6 is a view showing a feedback screen displayed at the end of cognitive training according to the present invention.
7 illustrates a physical user interface in accordance with the present invention.
8 shows feedback of a physical user interface in accordance with the present invention.
9 is a view showing an example of a cognitive training game screen according to the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. The configuration of the present invention and the effect of the action will be clearly understood through the following detailed description.

Figure 1 shows the internal configuration of a cognitive training device according to the present invention.

Referring to FIG. 1, the cognitive training device includes a display 1, a motion detection unit 2, an information input unit 3, a memory 4, a communication unit 5, a control unit 6, and a physical user interface ) (PUI) (7).

The display 1 displays a cognitive training game screen. The display 1 displays the type of cognitive training and the problem for cognitive training, and outputs feedback on the result of the subject's response. The display 1 may use an existing TV, LCD monitor, or the like, and may include a touch screen function.

The motion detector 2 recognizes the motion of the subject. The motion detection unit 2 includes an RGB camera and a depth camera. The motion detector 2 may recognize the motion of the subject using the image of the RGB camera and depth information of the depth camera.

In an embodiment of the present invention, using a 1940x1080 (Full HD, 30fps) RGB camera and a 512x424 infrared camera, the measurement range is 0.5 to 4.5m, the measurement angle is 70 degrees vertical, 60 degrees vertical, 26 joints are measured per person, up to 6 people simultaneously It has the measurement performance of measurement.

The information input unit 3 selects a type of cognitive training and a problem for cognitive training and inputs a setting value applied to the cognitive training game. The information input unit 3 includes a keyboard or mouse. If the display 1 includes a touch screen function, the information input unit 3 may be integrated into the display 1. In this case, the type and problem of cognitive training may be selected or a setting value may be input by touching the touch screen of the display 1 separately from the keyboard or mouse.

The storage unit 4 stores a program for a cognitive training game, and also stores various data in the cognitive training game. The cognitive training game program consists of a game for visualization and reasoning training, a game for attention and memory training, and a game for daily life training for cognitive training of the subject.

The communication unit 5 transmits a feedback signal generated during the cognitive training game to the physical user interface 6. The communication unit 5 may be connected to the physical user interface 6 by wire, but may be configured by a short-range communication module such as Bluetooth or Wi-Fi to be connected to the physical user interface 6 by wireless communication.

The physical user interface 6 outputs feedback during the cognitive training game. The physical user interface 6 is a physical tool that the subject can hold by hand or wear on the wrist. The physical user interface 6 may output vibration or light to the subject as feedback of the cognitive training game.

The control unit 7 is a part that controls the overall operation of the cognitive training apparatus according to the present invention.

The control unit 7 displays the cognitive training game screen on the display 1 by driving the program for the cognitive training game stored in the storage unit 4, analyzes the motion detection signal input from the motion detection unit 2, and operates the subject. Figure out.

In this way, the control unit 7 determines whether or not the correct answer to the problem displayed on the cognitive training game screen is based on the motion detection signal and outputs feedback to the display 1 and the physical user interface 6 according to the determination result. .

In addition, when the subject's motion is not detected for a predetermined time when the subject plays the cognitive training game, the control unit 7 may output the focused guidance feedback through the display 1 or the physical user interface 6.

In addition, when the cognitive training is finished, the controller 7 may allow various feedbacks to be output through the display 1 and the physical user interface 6 according to the correct answer rate.

Figure 2 shows the cognitive training process according to the present invention.

Cognitive training is training for subjects with cognitive disabilities, so each stage of the cognitive training process is conducted by a cognitive trainer or therapist. In addition, each step of cognitive training is performed through a cognitive training device.

Referring to FIG. 2, when the cognitive training program is driven, a login screen is first displayed, and the therapist performs login through pre-registered information for subject management (S10).

When you log in, the type of cognitive training is displayed on the initial screen. The therapist selects the type of cognitive training on the initial screen (S12).

3 shows the types of cognitive training according to the present invention and the cognitive training problems or tasks belonging to each type.

Referring to FIG. 3, the types of cognitive training can be largely divided into visualization and reasoning training, attention and memory training, and daily life training.

Visualization and reasoning training and attention and memory training are the basic training of children's cognitive development. On the other hand, daily life training is a form of performing tasks based on things that children can easily encounter at school or at home by mixing visualization and reasoning training with attention and memory training.

Visualization and reasoning training consists of three areas: picture finding, picture fitting, pattern and reasoning. Finding pictures is'Fit the color','Follow the sparrow!' There are two problems, such as'Puzzle Matching' and'Shadow Matching', etc., and pattern and reasoning are'Scissors and Rock,''What's Next?','What more? ?' There are three problems.

Attention and memory training consists of three problems: matching, avoiding obstacles, and remembering location.

Daily life training consists of three tasks: making a fruit cell, making a sandwich, and growing tomatoes.

The problems and challenges for cognitive training of the present invention are aimed at training eye-hand coordinates.

Specifically, the'Find Colors' and'Follow the Sparrows' in Finding Pictures, and'What's More?' for patterns and reasoning are for visual discrimination training. 'Puzzle Matching' of picture matching is for training of spatial relation. The'fit shadow' of picture matching is for training form constancy. The'rock-paper-scissors' of patterns and reasoning are for training the causal relation, and'what's next?' is for the training of the visual short term memory.

After the therapist selects the type of cognitive training, various setting values applied to the cognitive training game may be input (S14).

4 shows setting values applied to a cognitive training game.

The step setting is to set the difficulty level of each training. As shown in FIG. 3, there is a problem for each training, and each problem has a difficulty level of 1-5. The therapist can tailor the difficulty level of each problem to the subject's condition.

For example, if steps 1, 2, and 3 are checked in each step (1-5) of the step setup, problems belonging to the training progress to difficulty 1-3, and if all steps are checked, problems belonging to the training are difficulty. All progress from 1-5.

The button direction setting is to set the direction of the correct answer. For children with various paralysis symptoms, the position of the correct answer can be set to either right bias, left bias, or both. The therapist adjusts the orientation of the correct answer button according to the subject's condition.

For example, if'Right' of the button direction setting is checked, the direction of the correct answer button appears on the screen of the cognitive training game.

The concentration induction setting is to set a time (focused induction time) for outputting the concentration induction feedback so that the subject can continue to concentrate during cognitive training. If you do not set the concentration guidance, you can check'off'. When a specific time is checked in the concentration induction setting, if the subject's movement is not detected during the specific time during cognitive training, the concentration induction feedback is output.

For example, when the '10 seconds' of the concentration guidance setting is checked, if the subject's movement is not detected from the time the problem is output in the cognitive training process until 10 seconds have elapsed, the concentration guidance feedback may be output.

The timer setting is to set the training time. By setting the training time, you can evaluate how well you solved the problem within the set time. The step setting can be adjusted according to the timer setting. When cognitive training is performed regardless of the training time,'off' of the timer setting can be checked.

For example, if '720 seconds' of the timer setting is checked, the timer starts operating from the start message indicating the start of the problem and notifies the end of the training time after 720 seconds have elapsed.

As described above, after inputting the setting value applied to cognitive training to complete the game setting, a problem for cognitive training is selected (S16).

When the problem is selected and the start of the problem is entered, a cognitive training game proceeds (S18).

The subject sees the problem displayed on the cognitive training game screen and solves the problem.

In the cognitive training game screen, the number of selection items is at least 2 to 5 so that the subject can see at a glance.

In addition, in consideration of the physical motor function of the brain lesion child, the position of the selected item may be arranged at the bottom of the screen, and the gap between the selected items may be widened to prevent another selected item from being selected by inappropriate movement of the body.

9 shows a cognitive training game screen displaying a problem for cognitive training according to the present invention.

The screen shown in FIG. 9 is a color matching problem pertaining to visualization and inference training.

Referring to FIG. 9, a yellow balloon is displayed in the center, and the subject needs to select an item representing the same color and text as the yellow balloon from among the four selection items 10 to solve the problem. Here, the subject needs to select the third item containing the word'yellow' on a yellow background in order to answer the question correctly.

In FIG. 9, four selection items are displayed, but the number of selection items and the number of correct answer targets may be set differently according to the difficulty (1-5) of the corresponding problem.

For example, in difficulty 1, the number of buttons of the selected item is 2, the number of correct answer targets is 5, the number of button of the selected item is selected in difficulty 2, the number of correct answer targets is 7, the number of button of the selected item is selected in difficulty 3, the correct answer 9 goals, 3 buttons for the selected item in difficulty 4 (different colors and names of the buttons), 12 goals for correct answers, 4 buttons for selected items in difficulty 5 (different colors and names of the buttons) , The number of correct answers can be set to 15. When this example is applied, the screen shown in FIG. 9 is a problem with difficulty 5.

This difficulty setting is similarly applied to all the problems and problems mentioned in FIG. 3.

As the game progresses through the cognitive training game screen shown in FIG. 9, it is determined whether the game has ended (S20). The game ends when the problem ends up to the difficulty level you set.

During the game, subjects continue to solve problems. The subject looks at the screen of the cognitive training game and reaches out his hand by extending his arm in the direction indicated by the selection corresponding to the correct answer for the problem. At this time, the subject can solve the problem by holding or wearing a physical user interface.

The cognitive training apparatus recognizes the subject's motion through the motion recognition technology and determines whether a problem is correct.

If the subject's motion is not detected even after the concentration induction time set in the concentration induction setting elapses from the time when the problem is output, the cognitive training device may output the concentration induction feedback to the subject.

The focused guidance feedback may be output through a cognitive training game screen or a physical user interface.

5 shows that the intensive guidance feedback is output on the cognitive training game screen.

Referring to FIG. 5, a bear character appears on the cognitive training game screen and may output a comment'Let's do it quickly'. This comment is displayed on the screen and output through voice through a speaker, which can stimulate the subject visually and audibly.

In addition, the focused induction feedback may be output as a vibration through a physical user interface.

If the problem ends up to the set difficulty level, the cognitive training device finally outputs a result screen of the cognitive training game (S22).

Figure 6 shows the result feedback when the cognitive training is over.

The resulting feedback can be output in various ways based on the correct answer rate of the problem.

Referring to FIG. 6, the result feedbacks (12, 13, 14) may come out of three comments such as'good job','good job', and'try a little more' depending on the correct answer rate of the problem.

For example, in the second level of difficulty, when the number of correct answer targets is 7, if the number of correct answers is 6-7,'well done', if 4-5,'well done', and below 3,'try a little harder' As a result, feedback may be output.

7 shows a physical user interface according to the present invention.

Referring to FIG. 7, (a) is a wand type and is held in the hand, and (b) is worn on the wrist as a wrist watch type.

Wand-type and wrist-watch-type physical user interfaces 6 incorporate LEDs and vibration elements. Therefore, the physical user interface 6 can output light and vibration.

In addition, the physical user interface 6 is provided with a communication module for communicating with the communication unit 5 of the cognitive training device. In the case of wireless communication with the communication unit 5, the physical user interface 6 may include a short-range communication module such as Bluetooth or wi-fi.

8 shows feedback output from the physical user interface.

Referring to FIG. 8, the physical user interface outputs light and vibration as feedback stimuli.

The feedback method is varied by the temporal combination of vibration and light.

Feedback A is a method in which vibration is output for 500 ms (0.5 seconds) at a vibration intensity of 10.

The feedback B is a method in which vibration is output for 1000 ms (1 second) at a vibration intensity of 20.

The feedback C is a method in which vibration is output for 3000 ms (3 seconds) at a vibration intensity of 30.

The feedback D is a method in which vibration is output for 4000 ms (4 seconds) at a vibration intensity of 40, and the red light R flashes 4 times every 500 ms.

Feedback E is white light (R40, G40, B40), light blue light (R0, G10, B40), light green light (R0, G40, B40), yellow light (R40, G40, B0), pink light (R40, G10, B40) ) Flashes sequentially every 300 ms. That is, white light-light blue light-light green light-yellow light-pink light is sequentially output every 0.3 seconds to give the effect of changing various colors of light.

Feedback F is a method in which blue light is emitted for 3000 ms.

Feedback G is a method in which red light is emitted for 3000 ms.

As described above, when the feedback method is defined, feedback according to the game result and focused induction feedback may be defined as follows.

As a result feedback for the game, in the case of'good job' with high correct answer rate, feedback E is output 3 times, in the case of'good job' with the correct answer rate, feedback F is output, and in the case of'good work' with low correct answer rate Feedback G is output.

The game result feedback of the physical user interface is simultaneously output with the result feedback of the cognitive training game screen, thereby increasing the subject's game immersion and interest.

As the intensive induction feedback, the first step is a method in which feedback A is repeated 6 times in 5 second increments, the second step is a method in which feedback B is repeated 3 times in 10 second increments, and in step 3, feedback C is 2 in 10 second increments. It is a repeating method, and the fourth step is a method in which the feedback D is output once.

The concentration guidance feedback of the physical user interface is simultaneously output with the concentration guidance feedback of the cognitive training game screen, so that the subject's game concentration can be further increased.

If the subject's motion is not detected even after the concentration induction time has elapsed from the time when the problem for cognitive training has been output, the first stage of concentration induction feedback is output first, and there is no reaction of the subject even after the output of the first stage of concentration guidance feedback is finished. When the delay is 10 seconds, two-step intensive induction feedback is output. Similarly, when there is no subject's reaction continuously, after a 10 second delay, three-step concentration induction feedback and four-step concentration induction feedback may be sequentially output.

As described above, the focused induction feedback has a weak vibration and a short vibration time at the first output, but it is sequentially strengthened from the next step and the vibration time increases, thereby helping the subject to recognize the focused induction.

The above description is merely illustrative of the present invention, and various modifications may be made without departing from the technical spirit of the present invention by those skilled in the art to which the present invention pertains.

Therefore, the embodiments disclosed in the specification of the present invention are not intended to limit the present invention. The scope of the present invention should be interpreted by the following claims, and all technologies within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

1: display 2: motion detector
3: Information input unit 4: Storage unit
5: Communication unit 6: Physical user interface (PUI)
7: Control

Claims (10)

A display showing the problem for the subject's cognitive training,
A motion detection unit that recognizes the subject's motion,
An information input unit for selecting a problem for the subject's cognitive training and inputting a correct answer direction setting value so that the correct answer position of the problem for the cognitive training is a rightward bias, a leftward bias, or both balances considering the subject's physical function;
A physical user interface that the subject possesses during cognitive training and outputs vibration or light;
And a controller configured to determine whether a correct answer is given to a problem for cognitive training displayed on the display based on an operation signal input from the motion detection unit and to output feedback from the display and the physical user interface according to the determination result. Cognitive training device. delete In claim 1,
The information input unit is configured to input a concentration induction time setting value that causes feedback to be output from the display or the physical user interface if a subject's motion is not detected even after a certain period of time has elapsed from the time when the problem for cognitive training is output. Cognitive training device. In claim 3,
If the subject's motion is not detected even after the set concentration induction time has elapsed from the time when the problem for cognitive training is output, the controller causes the message for cognitive training concentration to be output through the display, and displays the physical user interface. Cognitive training device, characterized in that to output a predetermined number of vibrations at a constant cycle. In claim 1,
The control unit sequentially outputs light of two or more colors from the physical user interface at regular intervals based on the correct answer rate of the problem for cognitive training, or outputs a single color light corresponding to the correct answer rate from the physical user interface. Cognitive training device, characterized in that. A method of cognitive training in a cognitive training device for a subject with cognitive impairment,
When the cognitive training program is driven, displaying the type of cognitive training on the cognitive training game screen,
When the type of cognitive training is selected, as a setting value applied for each training, a correct answer direction setting value for inputting a right answer direction, a left bias, or both balances in consideration of the physical function of the subject for the cognitive training is input. Steps,
A method of cognitive training, comprising recognizing a subject's motion to determine whether a correct answer is given to a problem for cognitive training, and outputting feedback to a cognitive training game screen and a subject's physical user interface according to the determination result. delete In claim 6,
As a setting value applied for each training, a concentration induction time setting value that causes feedback to be output from the cognitive training game screen or the physical user interface when a subject's motion is not detected even after a certain time has elapsed from the time when a problem for cognitive training is output. Cognitive training method further comprising the step of receiving the input. In claim 8,
The outputting of the feedback may output a message for cognitive training concentration through the cognitive training game screen if the subject's motion is not detected even after the set concentration induction time has elapsed from the time when the problem for cognitive training is output. , A cognitive training method characterized by outputting a predetermined number of vibrations at a predetermined cycle through the physical user interface. In claim 6,
The step of outputting the feedback sequentially outputs light of two or more colors through the physical user interface at regular intervals based on the correct answer rate of the problem for cognitive training, or a single color corresponding to the correct answer rate through the physical user interface. Cognitive training method characterized in that it outputs light.

Images