KR20210070652A - System For Rehabilitation Training Using Network Game Type Virtual Reality Contents - Google Patents

Abstract

The present invention relates to a rehabilitation training system using network-type game-based VR content. The present invention as a technical idea for solving the above problems comprises: VR content (100) including a program related to cognitive rehabilitation training; a VR display unit (200) for providing a virtual reality screen to a user by driving the VR content (100); a VR controller (300) connected to the VR display unit (200) by wire or wirelessly to manipulate the VR content (100); and a central control unit (400) for monitoring by being connected to the VR display unit (200) by wire or wirelessly. A user wears the VR display unit (200) and the VR controller (300). When rehabilitation training is performed according to the VR content (100) implemented in the VR display unit (200), the rehabilitation training is monitored in the central control unit (400). When the rehabilitation training is finished, the training results are converted into a DB.

Description

{System For Rehabilitation Training Using Network Game Type Virtual Reality Contents}

The present disclosure relates to a rehabilitation training system, and more specifically, to a system in which a subject in need of cognitive rehabilitation training wears a VR display unit and a controller and performs rehabilitation training using network-type game-based VR contents.

Virtual reality is information created to indirectly experience situations that are difficult to directly experience in the real world due to physical and spatial constraints through interaction with the human sensory system in a virtual environment built using a computer. is the field of activity. When the systems that implement virtual reality provide a virtual environment in which the user's viewpoint and movement are realized, the change of the user's viewpoint or movement is generally performed in the virtual space or on behalf of the human body in the virtual reality space. experience the environment through beings who perform

Virtual and augmented reality experts and economists predict that this market will grow from $5.2 billion to $162 billion by 2020. It is also expected to be a promising technology that can lead the 4th industrial revolution along with artificial intelligence. In a virtual reality environment, interaction devices have been used to recognize various information of a user based on a sensor device for input. For example, as soon as the ball hits the golf club on the virtual screen, the spatial awareness motion sensor attached to the golf club immediately analyzes the user's swing angle and putting posture, and the analyzed user information is directly transmitted to the smartphone, and the user You can use the information to correct your posture.

However, an output device for generating feedback signals such as reaction force, tactile sensation, and stimulus information to the user and transmitting information in reverse is in its infancy. The growth potential of technology development applying this is great.

On the other hand, Korea entered an aging society in which the proportion of the population aged 65 and over accounted for 7.2% of the total in 2000, and is expected to reach a super-aging society (21% of the elderly population) by 2026. Accordingly, the importance of cognitive strengthening and cognitive rehabilitation training is increasing day by day.

Therefore, if VR (Virtual Reality) devices such as HMD (Head Mount Display) are loaded with content that helps cognitive reinforcement and cognitive rehabilitation, participants can individually complete the rehabilitation program at the desired time and place, so the rehabilitation treatment effect is very high. considered to be large.

KR 101915238 B1 KR 101944489 B1 KR 101881986 B1 KR 101777755 B1

The purpose of the rehabilitation training system using a network-type game-based VR content according to an embodiment of the present disclosure is to provide a rehabilitation training system in which a plurality of people who need rehabilitation training can participate together and complete a rehabilitation program using a VR device. There is this.

Rehabilitation training system using network-type game-based VR content according to an embodiment of the present disclosure for solving the above problems,

VR contents 100 including a program related to cognitive rehabilitation training; a VR display unit 200 for providing a virtual reality screen to a user by driving the VR contents 100; a VR controller 300 connected to the VR display unit 200 by wire or wirelessly to manipulate the VR contents 100; and a central control unit 400 for monitoring by being connected to the VR display unit 200 by wire or wirelessly; including,

When a user wears the VR display unit 200 and the VR controller 300 and performs rehabilitation training according to the VR contents 100 implemented in the VR display unit 200, the central control unit 400 displays the Rehabilitation training is monitored, and when the rehabilitation training is finished, the training result may be configured as DB.

In addition, the VR display unit 200 may be configured to include a VR content driving module 210 capable of driving the VR content 100 .

In addition, the VR controller 300 includes a tracking detection module 310 and a button input module 320,

The tracking detection module 310 detects the movement trajectory of the VR controller 300 and reflects it in the VR content 100, and the button input module 320 applies at least one input value to the VR content 100. It can be configured as a feature that can be reflected in.

In addition, the central control unit 400 may be configured to receive data from the VR display unit 200 and monitor it.

In addition, the central control unit 400 receives data from at least one or more of the VR display units 200 and interlocks them, and transmits the interlocked data to the VR display unit 200 to provide the VR contents 100 . It can be configured by reflecting in the.

Accordingly, the rehabilitation training system using a network-type game-based VR content according to an embodiment of the present disclosure has an advantage in that a user can perform rehabilitation training at a desired time and place by utilizing a virtual reality program.

In addition, compared to going to the hospital for rehabilitation treatment, there is an advantage that patients who are difficult to go to the hospital can do rehabilitation training at a low cost because it takes relatively less cost and time.

In addition, since a plurality of participants can use the rehabilitation program together, there is an advantage that the rehabilitation training effect can be improved by increasing the concentration compared to the existing rehabilitation training alone.

In addition, there is an advantage that cybersickness caused by using a VR device can be reduced by collecting specific EEG and detecting and taking action through EEG analysis.

1 is a conceptual diagram schematically showing a rehabilitation training system using a network-type game-based VR content according to the present disclosure.
2 is a block diagram schematically illustrating the configuration of VR content and a VR display unit according to the present disclosure.
3 is a block diagram schematically illustrating the configuration of a VR controller and a central control unit according to the present disclosure.
4 is a block diagram schematically illustrating the configuration of a motion sickness reducing unit according to the present disclosure.
5 is an embodiment of VR content according to the present disclosure.
6 is a diagram for describing in detail first content according to the present disclosure;
7 is a diagram for describing in detail second content according to the present disclosure;
8 is a diagram for describing third content according to the present disclosure.
9 is a diagram for describing in detail fourth content according to the present disclosure;
10 is an embodiment of a training result of VR content according to the present disclosure.
11 is a view for specifically explaining a rehabilitation training system using a network-type game-based VR content according to the present disclosure.

Hereinafter, although described with reference to the drawings according to an embodiment of the present invention, this is for easier understanding of the present invention, the scope of the present invention is not limited thereto, the present invention is defined by the scope of the claims will only be

In describing the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description will be omitted, and the same reference numerals refer to the same elements throughout the specification. do.

1 is a conceptual diagram schematically showing a rehabilitation training system using network-type game-based VR contents according to the present disclosure, FIG. 2 is a block diagram schematically showing the configuration of VR contents and a VR display unit according to the present disclosure, and FIG. 3 is the present disclosure A block diagram schematically showing the configuration of a VR controller and a central control unit according to FIG. 4 is a block diagram schematically illustrating the configuration of a motion sickness reducing unit according to the present disclosure, FIG. 5 is an embodiment of VR content according to the present disclosure, FIG. 6 is A diagram for specifically explaining the first content according to the present disclosure, FIG. 7 is a diagram for describing the second content according to the present disclosure in detail, and FIG. 8 is a diagram for describing the third content according to the present disclosure in detail Figure 9 is a diagram for explaining in detail the fourth content according to the present disclosure, Fig. 10 is an embodiment of a training result of VR content according to the present disclosure, and Fig. 11 is a network-type game-based VR content according to the present disclosure. It is a diagram for specifically explaining the rehabilitation training system used.

1 to 3, the rehabilitation training system using a network-type game-based VR content according to the present disclosure includes a VR content 100; VR display unit 200; VR controller 300; and a central control unit 400; It may be composed of

<VR content>

As shown in (a) of FIG. 2 , the VR content 100 is a program related to rehabilitation training using virtual reality, and includes a first content 110 , a second content 120 , a third content 130 and The fourth content 140 may be included.

The VR contents 100 are driven by the VR contents driving module 210 of the VR display unit 200, which will be described later, and implemented in the display module 220 of the VR display unit 200 to enhance cognition in a virtual environment. Rehabilitation training is characterized.

The VR content 100 has a feature that, unlike conventional content, a plurality of users can perform rehabilitation training together.

Hereinafter, the VR content 100 will be described with reference to FIGS. 5 to 10 .

5 is a view showing an embodiment of the VR content 100. In the VR content 100, a plurality of objects are moving on the screen with a sandy beach as a background. The user manipulates the VR controller 300, which will be described later, to hit a flying object, which is game-based content.

The VR contents 100 may be configured to minimize motion sickness of the user by applying a relatively simple background screen, and to improve the adaptability of the elderly and patients with mild cognitive impairment in the early stages through a scoring method according to a simple rule.

FIG. 6 is a diagram for describing the first content 110 in detail, and the first content 110 may be composed of a program having the easiest difficulty among the contents 110 , 120 , 130 , and 140 .

Referring to FIG. 6 , in the first content 110 , a crow-shaped object and a seagull-shaped object fly on the screen with a sandy beach as a background, and the user uses the VR controller 300 to be described later for a predetermined time. It is a game-based content that operates a hunting gun in the first content 110, and when the user hits a crow-shaped object, the score points increase, and when the user hits a seagull-shaped object, the score points decrease.

The user of the first content 110 distinguishes between a flying crow-shaped object and a seagull-shaped object, and operates the VR controller 300, which will be described later, to repeatedly hit the target object, thereby enhancing cognitive and cognitive rehabilitation training. get it

FIG. 7 is a diagram for describing the second content 120 in detail, and the second content 120 may be configured as a program having the second easiest difficulty among the contents 110 , 120 , 130 , and 140 . .

Referring to FIG. 7 , in the second content 120 , a crow-shaped object and a seagull-shaped object fly on the screen with a sandy beach as a background, and the user uses the VR controller 300 to be described later for a predetermined time. A hunting gun in the second content 120 is operated.

On the other hand, if the user hits a crow-shaped object, the score point rises, and if the user hits a chevron-shaped object, the score point falls. The method is the same as that of the first content 110, but additionally a golden crow-shaped object is provided, and the user If you hit a golden crow-shaped object, it is a game-based content that increases your score more than when you hit an existing crow-shaped object.

The user of the second content 120 distinguishes a flying crow-shaped object from a seagull-shaped object, and operates the VR controller 300 to be described later in consideration of the color of the crow-shaped object and repeatedly hits the target object. It has the effect of strengthening and cognitive rehabilitation training.

FIG. 8 is a diagram for describing the third content 130 in detail, and the third content 130 may be composed of a program having the second difficulty among the content 110 , 120 , 130 , and 140 . .

Referring to FIG. 8 , in the third content 130 , a crow-shaped object and a seagull-shaped object fly on the screen with a sandy beach as a background, and the user uses the VR controller 300 to be described later for a predetermined time. The hunting gun in the third content 130 is operated.

The third content 130 is provided with a UI that displays the objects that the user needs to hit with a gun in order, and the user classifies the objects in order based on the UI and hits them in order to increase the score points. is content.

For example, if a crow-shaped object, a crow-shaped object, and a seagull-shaped object are displayed in the UI in the order, the user manipulates the VR controller 300 to first hit the crow-shaped object, and then selects the crow-shaped object for the second time. If you hit it, and finally hit a seagull-shaped object, your score points will increase. On the other hand, whenever the user manipulates the gun to input firing, it may be configured to be displayed with a circle and an X as to whether the user hits the right target on the UI. This allows the user to immediately know whether the correct target has been hit.

The user of the third content 130 distinguishes between a flying crow-shaped object and a seagull-shaped object, operates the VR controller 300 to be described later, and repeatedly hits the target object in the order provided in the UI to enhance cognition, You will get the effect of cognitive rehabilitation training.

9 is a diagram for describing the fourth content 140 in detail, and the fourth content 140 may be composed of a program having the most difficulty among the contents 110 , 120 , 130 , and 140 . .

Referring to FIG. 9 , in the fourth content 140 , a crow-shaped object and a seagull-shaped object fly on the screen with a sandy beach in the background, and the user uses one hand for a predetermined time through the VR controller 300 to be described later. In the fourth content 140 , the hunting gun is operated, and with the other hand, the shield in the fourth content 140 is operated.

On the other hand, if the user hits a crow-shaped object, the score points increase, and if the user hits a chevron-shaped object, the score points decrease. The method is the same as that of the first content 110, but additionally, the crow-shaped object and the chevron-shaped object are sent to the user. Bird droppings fly, and when the user meets the flying bird droppings, the predetermined time is reduced. It is a game-based content in which the user acquires points by hitting a crow-shaped object while blocking the flying bird droppings with a shield for a predetermined time.

The user of the fourth content 140 distinguishes between a flying crow-shaped object and a seagull-shaped object, and operates the VR controller 300, which will be described later, to prevent bird droppings from facing the user while repeating hitting the target object to enhance awareness, You will get the effect of cognitive rehabilitation training.

Thereafter, the training result is provided on a screen as shown in FIG. 10 , and the user can check the record and end the content or continue the training.

Meanwhile, the above-described contents 110, 120, 130, and 140 have been described with a beach sand background, a crow-shaped object, and a seagull-shaped object, but are not limited thereto and may be configured to be variously changeable as needed.

<VR display unit>

As shown in (b) of FIG. 2 , the VR display unit 200 includes a VR content driving module 210 , a display module 220 , a motion detection module 230 , a speaker module 240 , and a communication module 250 . ) may be included.

The VR contents driving module 210 drives the above-described VR contents 100 and may include a storage unit capable of storing data of the VR contents 100 . Meanwhile, since the VR content 100 can be directly driven through the VR display unit 100, user's accessibility and convenience can be improved.

The VR contents driving module 210 may be configured to analyze the user's rehabilitation training DB to select and drive the contents 110, 120, 130, 140 for rehabilitation suitable for the user.

For example, the VR content driving module 210 classifies the rehabilitation training score point section based on the difficulty of the content 110, 120, 130, 140, and then, based on the user's rehabilitation training DB, The content of the section to which the average score point belongs may be configured to be driven.

The VR content 100 driven in this way may be implemented in the display module 220 to provide a virtual reality screen to the user.

The motion detection module 230 may be configured to detect the user's head movement and reflect the VR content 100 so that the VR content 100 changes the virtual reality environment according to the user's head movement.

The motion detection module 230 may include a noise removal unit for more precise detection. For example, the noise removal unit samples data including noise at predetermined time intervals, and compares the sampled data with data sampled immediately before that, and later when the difference between the values is within a predetermined range. It may be configured to adopt the sampled data, and to adopt the data sampled immediately before that when the difference between the values is out of a predetermined range.

Specifically, when the predetermined range is A, if the absolute value of the difference between the sampled data is smaller than A, the data sampled later is determined to be free of noise and adopted, but the absolute value of the difference between the sampled data is larger than A In this case, it may be configured to adopt the previously sampled data rather than determining that the data sampled later contains noise.

Meanwhile, the absolute value of the difference between the sampling time interval and the data may be changed, and noise may be removed by using a bandpass filter generally used in signal processing.

The speaker module 240 may be configured not only to provide the sound of the VR content 100 , but also to receive a signal from the central control unit 400 to be described later and provide an audible notification to the user.

Through the communication module 250, the VR display unit 200 may be configured to exchange data with a VR controller 300 and a central control unit 400 to be described later.

<VR Controller>

As shown in (a) of FIG. 3 , the VR controller 300 may include a tracking detection module 310 , a button input module 320 , a vibration module 330 , and a communication module 340 . .

The VR controller 300 may be connected to the aforementioned VR display unit 200 by wire or wirelessly, and may exchange data through the communication module 340 .

The tracking detection module 310 may be configured to detect a three-dimensional movement trajectory of the VR controller 300 and reflect it in the VR content 100 . The tracking detection module 310 may include the aforementioned noise removal unit for more precise detection.

The button input module 320 may be configured to reflect at least one input value to the VR content 100 . At least one such button input module 320 may be provided, and may be configured as a touch-type button input as well as a physical button input.

The vibration module 330 may be configured to provide a vibrotactile experience to the user according to a predetermined signal. For example, it may be configured to provide vibration when the user hits a target in the above-described VR content 100 .

Meanwhile, the VR controller 300 may further include a voice recognition module (not shown), and may be configured to recognize a predetermined voice signal to control the button input module 320 . For example, in the case of a user unfamiliar with button input, it can be configured to input an input value through voice recognition, whereby even a user unfamiliar with button use can be rehabilitated in various ways. There will be.

<Central Control Department>

As shown in (b) of FIG. 3 , the central control unit 400 may be configured to include a data storage module 410 , a VR content interworking module 420 , a monitoring module 430 and a communication module 440 . can

The central control unit 400 may be connected to the aforementioned VR display unit 200 by wire or wirelessly, and may exchange data through the communication module 440 .

The data storage module 410 may be configured such that data received through the communication module 440 is converted into a DB and stored.

The VR content interworking module 420 receives data from at least one VR display unit 200 and interlocks it, and transmits the linked data to the VR display unit 200 to reflect the data in the VR content 100 . It can be configured to be

The VR content interworking module 420 will be described in more detail with reference to FIG. 11 .

The VR contents interworking module 420 receives each of the score points obtained from the VR contents 100 from the VR display unit 200 of a plurality of users, and interlocks them to be displayed on a single screen, and transmits the linked data. It may be configured to be transmitted to the VR display unit 200 of each user and reflected in the VR content 100 . Accordingly, a plurality of users can participate in rehabilitation training together, and the score results according to the training are linked and displayed on the screen, thereby inducing a competitive spirit in the user, thereby further enhancing the rehabilitation training effect.

Meanwhile, data transmitted from the VR display unit 200 may be monitored by the monitoring module 430 . As shown in FIG. 11 , the manager may simultaneously monitor the rehabilitation training of a plurality of users.

<Sickness Reduction Unit>

On the other hand, the rehabilitation training system using the network-type game-based VR content according to the present disclosure may be configured to further include a motion sickness reducing unit 500 for reducing cybersickness.

As shown in FIG. 4 , the motion sickness reducing unit 500 may include an EEG sensing module 510 , an EEG analysis module 520 , a viewing angle adjustment module 530 , and a communication module 550 .

The motion sickness reducing unit 500 may be connected to the above-described VR display unit 200 and the above-mentioned central control unit 400 by wire or wirelessly, and may exchange data through the communication module 550 .

The EEG sensing module 510 detects the user's EEG and includes a plurality of electrodes attached to different positions of the user's head, and may be configured to receive EEG from the plurality of electrodes.

As the electrode used for the EEG measurement, an Ag-AgCl disk capable of accurately measuring even a slow voltage change is preferably used, but is not limited thereto.

Using these electrodes, EEG can be detected. In general, EEG frequencies are delta waves, theta waves, alpha waves, beta waves, and gamma waves. ), delta waves are signals with a frequency of 0.2 to 4 Hz, theta waves are signals with a frequency of 4 to 8 Hz, alpha waves are signals with a frequency of 8 to 12 Hz, beta waves are signals with a frequency of 12 to 30 Hz, and gamma waves are signals with a frequency of 30 Hz or higher.

Specifically, the delta wave is an EEG observed when a person is in deep sleep, and the theta wave is an EEG generated when one is concentrating on using information inside the brain or concentrating on solving a logical thinking problem. And alpha waves are generated when the mind is concentrated and the information inside the brain is utilized, beta waves are mainly generated when physically active or immersed in something, and gamma waves are when tension and active highly complex mental functions are performed. brain waves that occur.

On the other hand, since motion sickness is particularly related to alpha waves among EEG, the power spectrum is measured by extracting EEG in the alpha wave region from the received EEG, and the power spectrum density is calculated by converting the measured power spectrum into FFT (Fast Fourier Transform). do.

The brain wave detection module 510 includes a data pre-processing unit such as noise removal and signal amplification for more precise detection, and it is preferable to use an Emotive Epoc+ device as a data collection device, but is not limited thereto.

The EEG analysis module 520 may be configured to receive data from the aforementioned EEG detection module 510 and determine whether the user is motion sick.

The EEG analysis module 520 may have a reference value for each user in advance for determining whether a user using the VR display unit 200 is in a motion sickness state.

For example, the brain wave analysis module 520 can set the baseline power for each user so that the alpha wave when the user is using the VR content 100 can be compared with the alpha wave before the VR content 100 is used. .

Specifically, the EEG analysis module 520 may set the baseline power using the user's EEG measured in a state in which a preset reference image is output.

The reference image refers to an image in which a user cannot feel motion sickness even when using a virtual reality display device, and may be a still image or a fixed image.

That is, the EEG analysis module 520 receives data from the EEG detection module 510, compares the received data with a pre-measured baseline power, and calculates a power variation, and sets the calculated power variation in advance. It may be configured to determine whether the user is motion sick by comparison with a predetermined threshold section.

The viewing angle control module 530 is a VR content 100 implemented in the above-described VR display unit 200 to reduce the motion sickness state when the user is determined to be motion sick by the EEG analysis module 520 described above. may be configured to adjust the viewing angle of

Specifically, the viewing angle adjustment module 530 may be configured to reduce motion sickness by limiting the viewing angle of the VR content 100 implemented in the above-described VR display unit 200 .

On the other hand, the motion sickness reducing unit 500 may further include an alternative image reproducing module 540 to relieve the motion sickness of the user.

The alternative image reproducing module 540 may be configured to include a camera unit (not shown) connected to the above-described VR display unit 200 to photograph the outside.

The camera unit (not shown) may be connected to the outer peripheral surface of the VR display unit 200 so as to photograph the user's gaze direction when the user wears the VR display unit 200, whereby the camera unit (not shown) can be configured to shoot the same image that the user sees while not wearing the VR display unit 200 .

When the EEG analysis module 520 determines that the user is motion sick even by the above-described viewing angle adjustment module 530, the alternative image reproducing module 540 uses the camera unit (not shown) instead of the VR content 100. City) may be configured such that the image being photographed is provided by the VR display unit 200 . Accordingly, the user will be able to quickly get out of the motion sickness state with the same effect as not wearing the VR display unit 200 .

Accordingly, the rehabilitation training system using the network-type game-based VR content according to the embodiment of the present disclosure has the advantage that the user can perform rehabilitation training at the desired time and place by using the virtual reality program, and for rehabilitation treatment, the hospital It has the advantage of being able to do rehabilitation training at low cost even for patients who are difficult to go to the hospital because of the relatively low cost and time compared to going to the hospital.

In addition, as multiple participants can use the rehabilitation program together, there is an advantage that the rehabilitation training effect can be improved by increasing the concentration compared to the existing rehabilitation training alone. This has the advantage of reducing cybersickness caused by using VR devices.

Although described above with reference to the drawings according to the embodiment of the present disclosure, those skilled in the art to which the present invention pertains will be able to make various applications and modifications within the scope of the present invention based on the above content.

1000: Rehabilitation training system using network-type game-based VR contents according to the present disclosure
100: VR content 110: first content
120: second content 130: third content
140: fourth content 200: VR display unit
210: VR content driving module 220: display module
230: motion detection module 240: speaker module
250: communication module 300: VR controller
310: tracking detection module 320: button input module
330: vibration module 340: communication module
400: central control unit 410: data storage module
420: VR content interworking module 430: monitoring module
440: communication module 500: VR motion sickness reduction unit
510: EEG detection module 520: EEG analysis module
530: viewing angle control module 540: alternative image playback module
550: communication module

Claims (5)

VR contents 100 including a program related to cognitive rehabilitation training;
a VR display unit 200 for providing a virtual reality screen to a user by driving the VR contents 100;
a VR controller 300 connected to the VR display unit 200 by wire or wirelessly to manipulate the VR contents 100; and
a central control unit 400 for monitoring by being connected to the VR display unit 200 by wire or wirelessly; including,
When a user wears the VR display unit 200 and the VR controller 300 and performs rehabilitation training according to the VR content 100 implemented in the VR display unit 200, the central control unit 400 displays the Rehabilitation training system using a network-type game-based VR content, characterized in that the rehabilitation training is monitored, and when the rehabilitation training is finished, the training result is converted into a DB.
According to claim 1,
The VR display unit 200 is a network-type game-based rehabilitation training system using VR contents, characterized in that it includes a VR contents driving module 210 capable of driving the VR contents 100 .
According to claim 1,
The VR controller 300 includes a tracking detection module 310 and a button input module 320,
The tracking detection module 310 detects the movement trajectory of the VR controller 300 and reflects it in the VR content 100, and the button input module 320 applies at least one input value to the VR content 100. Rehabilitation training system using network-type game-based VR contents, characterized in that it can be reflected in
According to claim 1,
The central control unit 400 receives data from the VR display unit 200 and can monitor it. A rehabilitation training system using a network-type game-based VR content.
According to claim 1,
The central control unit 400 receives data from at least one or more of the VR display unit 200 and interlocks it, and transmits the interlocked data to the VR display unit 200 to reflect the data in the VR content 100 . Rehabilitation training system using network-type game-based VR contents, characterized in that

Images