KR102048546B1 - System and Method for rehabilitation training using Virtual reality device - Google Patents

Abstract

The present invention relates to a rehabilitation training system using a virtual reality, which comprises: a VR content (100) including a program related to a rehabilitation training using virtual reality; a control unit (200) for driving the VR content (100); a wearable sensor unit (300) connected to the control unit (200) in a wired or wireless manner, and recognizing a user behavior; and a VR display unit (400) connected to the control unit (200) and the wearable sensor unit (300) in a wired or wireless manner, receiving the VR content (100) from the control unit (200), and implementing the received VR content (100). A user wears the wearable sensor unit (300) and the VR display unit (400), and performs the rehabilitation training in accordance with the VR content (100) implemented in the VR display unit (400). A user rehabilitation behavior is recognized by the wearable sensor unit (300) to be reflected to the VR content (100), and a training result is databased when the rehabilitation training is terminated.

Description

Rehabilitation training system and method using virtual reality {System and Method for rehabilitation training using Virtual reality device}

The present invention relates to rehabilitation training, and more particularly, to a system and method in which a subject who needs rehabilitation training wears a VR display unit and a wearable sensor unit and performs rehabilitation training using VR content.

Virtual reality is information that makes it possible to indirectly experience situations that are difficult to directly experience in the real world due to physical and spatial constraints through interaction with the sensory system in the virtual environment built using a computer. It is an activity field. When the systems implementing the virtual reality provide a virtual environment in which the user's viewpoint and motion are realized, generally, the user's viewpoint or motion is actually changed in the virtual space or the human body is acted on behalf of the human body in the virtual reality space. Experience the environment through beings that perform.

Virtual and augmented reality experts and economists predict that the market will grow from $ 5.2 billion in 2016 to $ 162 billion in 2020. It is also expected to be a promising technology that can lead the fourth industrial revolution along with artificial intelligence. In the virtual reality environment, interaction devices have been used to recognize various information of a user based on an input sensor device. For example, as soon as the ball hits the golf club on the virtual screen, the space-aware motion sensor attached to the golf club analyzes the user's swing angle and putting posture, and the analyzed user information is sent directly to the smartphone. You can use the information to correct your posture.

However, an output device for generating feedback signals such as reaction force, tactile information, and stimulus information to the user and conveying the information in reverse is now in its infancy stage. There is a great growth potential for the development of this technology.

Various interface devices have been proposed for manipulating virtual objects existing in a virtual space that makes up virtual reality. However, the most effective way to manipulate objects in virtual space is to use hands directly. In the real world, it is much easier to grasp the characteristics or properties of an object if you can manipulate it in the same way that you manipulate it with your hands.

A glove-based method may be used as a method of configuring an interface with a virtual object based on the movement of a user's hand. The virtual gloves forming the human-computer interface need to track the bend angle of each joint of the finger as well as the position and orientation of the hand.

In the 1970s, at MIT, Polhemus tried to directly analyze hand gestures using a 3-SPACE magnetic tracker sensor. Since then, various techniques for tracking the position and the direction of the hand have been proposed, such as optical tracking, magnetic tracking and acoustic tracking.

Meanwhile, the technique of measuring the angle of the finger joint began to be studied in earnest in the 1980s, and various gloves-type interface devices were developed using the same. Developed in 1987, DataGlove has 10 bend sensors and is capable of measuring six degrees of freedom in the hand. DataGlove has a bend sensor on the back of the hand and a 3-SPACE magnetic tracker is used to measure position and orientation. Subsequently, Nintendo developed Power Glove®, a low-cost game controller for home video games, with a bend sensor for measuring the bend angle and an acoustic tracker for hand tracking. Developed in 1990, Immersion's CyberGlove® was the most sophisticated, accurate and easily worn armored device. CyberGlove® has 18 to 22 bend sensors on the back of the hand to measure finger bend angles. Recent developments in virtual gloves have been directed to strengthening three-dimensional application by hand in virtual space. Many of these devices employ a flex sensor or a bend sensor to measure the angle of the finger joint. The bending sensor is inexpensive compared to other sensors, and has an advantage of being hardly affected by changes in the surrounding environment. Therefore, the bending sensor has recently been widely used as a means for measuring bending information of a finger.

On the other hand, Korea entered into an aging society in which the proportion of the elderly population aged 65 or older reached 7.2% in 2000, and in 2018, aged society (14% of the population) and ultra-aging society (aged population 21) in 2026. Is expected to reach%). As a result, the importance of early treatment through rehabilitation programs for the elderly with hand paralysis is increasing day by day.

The cognitive rehabilitation program, now led by a rehabilitation therapist, is conducted for a long time (50 minutes) at a given place and time, which causes boredom and rejection among participants, limiting the effectiveness of the treatment, and allowing the therapists to work with patients one-on-one. Because of the rehabilitation process, labor costs are large on the hospital side.

As an alternative, if you are interested in VR (Virtual Reality) devices, such as HMD (Head Mount Display), and you are equipped with rehabilitation content that helps hand rehabilitation treatment, participants can take the rehabilitation program individually at any time and place. The rehabilitation effect is considered to be very large.

KR 101915238 B1 KR 101944489 B1 KR 101881986 B1 KR 101777755 B1

The present invention is to solve the above problems, by using the VR content, control unit, VR display unit and wearable sensor unit rehabilitation treatment so that participants can complete the rehabilitation program individually at the time and place desired by the participants To provide rehabilitation training systems and methods to assist

The present invention as a technical idea for solving the above problems,

VR content 100 including a program related to rehabilitation training using virtual reality; A control unit 200 in which the content 100 is driven; A wearable sensor unit 300 connected to the control unit 200 by wire or wirelessly and recognizing a user's behavior; And a VR display connected to the control unit 200 and the wearable sensor unit 300 by wire or wirelessly, receiving the VR content 100 from the control unit 200, and implementing the received VR content 100. Unit 400; Including,

A user wears the wearable sensor unit 300 and the VR display unit 400, performs rehabilitation training according to the VR content 100 implemented in the VR display unit 400, and attaches the wearable sensor unit 300 to the wearable sensor unit 300. The rehabilitation behavior of the user may be recognized and reflected in the VR content 100, and when the rehabilitation training is completed, the training result may be configured as a DB.

In addition, the wearable sensor unit 300,

A motion detection module 310 installed at least one predetermined position to detect movement of a palm and a finger; An angle sensing module 320 installed at least one predetermined position to measure a finger angle; And at least one touch sensing module 330 installed at a predetermined position to recognize a touch of a finger joint. It may be configured to include a.

In addition, the VR content 100,

There is a virtual rehabilitation therapist NPC to help the user rehabilitation training, at least one rehabilitation training operation is provided through the UI, the provided rehabilitation training operation and the user's implementation of the action recognized by the wearable sensor unit 300 It may be configured to provide feedback to the user by analyzing the degree of matching, and to store the training result as a DB.

In addition, as a rehabilitation training method using virtual reality,

Wearing a VR display unit and a wearable sensor unit; Executing VR content; Identifying a user and searching an existing rehabilitation training DB; Selecting a rehabilitation training course from free training, random training and recommended training; Identifying the effect of the selected training in the step of selecting the rehabilitation training course before the start of training; Rehabilitation training intensity is adjusted based on the existing rehabilitation training DB; Calibrating the wearable sensor unit according to a user's environment; The user performing rehabilitation training; Showing the result of the training after the training is finished; DB of the training results and transmitting to the control unit; Terminating the VR content; It may be configured to include a.

In the present invention, the wearable sensor unit using the virtual reality can be used to individually rehabilitation training at the time and place desired by the user, so it is relatively difficult to go to the hospital due to the relatively low cost and time compared to attending the hospital for rehabilitation treatment. They also have the advantage of being able to do rehabilitation at low cost.

In addition, the present invention has the advantage that the rehabilitation training can be performed in a more accurate posture to receive feedback on the rehabilitation training.

In addition, the present invention has the advantage that it is possible to detect and collect a specific brain wave and reduce VR motion sickness through brain wave analysis.

1 is a conceptual diagram schematically showing a rehabilitation training system using the present inventor virtual reality.
2 is a configuration diagram briefly showing the configuration of the controller.
3A is a diagram illustrating a motion sensor, a touch sensor, and a vibration module of the wearable sensor unit.
3B is a view for explaining an angle detection module of a wearable sensor unit.
FIG. 3C is an embodiment of information shown when the detailed table shown in FIG. 3B is clicked.
4A is an embodiment of a goniometer indicating the angle measured by the angle detection module of the wearable sensor unit.
4B is an embodiment illustrating an angle measured by an angle sensing module in VR content.
5 is a configuration diagram briefly illustrating a configuration of a VR display unit.
6A illustrates an embodiment of a start screen of VR content.
6B illustrates an embodiment in which a start screen NPC of a VR content and a virtual treatment room are applied.
6C illustrates a PLAY embodiment of VR content.
7 illustrates an embodiment of a training result of VR content.
8 is an embodiment of a user information interface of VR content.
9 is an example of various rehabilitation training operations used in VR content.
10 is a flowchart of a rehabilitation training method using virtual reality according to the present invention.

Hereinafter, although described with reference to the drawings according to an embodiment of the present invention, which is for easier understanding of the present invention, the scope of the present invention is not limited thereto, the present invention is defined by the scope of the claims It will be.

In describing the present invention, when it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted, and the same reference numerals refer to the same components throughout the specification. do.

1 is a conceptual diagram schematically showing a rehabilitation training system using a virtual reality of the present invention, Figure 2 is a schematic diagram showing the configuration of the control unit, Figure 3a is a view showing a motion sensor, a touch sensor, a vibration module of the wearable sensor unit, Figure 3b is a view for explaining the angle detection module of the wearable sensor unit, Figure 3c is an embodiment of the information that appears when clicking the detailed table shown in Figure 3b, Figure 4a shows the angle measured by the angle detection module of the wearable sensor unit An embodiment of the goniometer, FIG. 4B is an embodiment showing the angle measured by the angle sensing module in the VR content, FIG. 5 is a schematic view showing the configuration of the VR display unit, FIG. 6A is a start screen embodiment of the VR content, FIG. 6B is An embodiment in which a start screen NPC of a VR content and a virtual treatment room are applied, FIG. 6C illustrates a PLAY embodiment of VR content, FIG. 7 illustrates a training result of VR content, 8 is an embodiment of a user information interface of VR content, FIG. 9 is an example of various rehabilitation training operations used in VR content, and FIG. 10 is a flowchart of a rehabilitation training method using virtual reality according to the present invention.

1 to 10, rehabilitation training system and method using a virtual reality of the present invention is VR content 100; Control unit 200; Wearable sensor unit 300; VR display unit 400; It can be configured to include,

Wearing a VR display unit and a wearable sensor unit (S101); Executing the VR content (S102); Identifying a user and searching an existing rehabilitation training DB (S103); Selecting a rehabilitation training course among free training, random training, and recommended training (S104); Checking the effect of the training selected in the step S104 before starting the training (S105); Rehabilitation training intensity is adjusted based on the existing rehabilitation training DB (S106); Calibrating the wearable sensor unit according to a user's environment (S107); Step S108 of the user performing rehabilitation training; After the training step (S109) showing the training result; DB of the training results and transmitting to the control unit (S110); Terminating the VR content (S111); Characterized in that it comprises a.

<VR content>

VR content 100 is a program for rehabilitation training using virtual reality,

It is driven by the control unit 200 by reflecting the data of the wearable sensor unit 300 and the data of the VR display unit 400, and is implemented in the display module 410 of the VR display unit 400, the virtual rehabilitation Rehabilitation training with a therapist NPC.

Hereinafter, the VR content 100 will be described with reference to FIGS. 6 to 9.

FIG. 6A illustrates an embodiment of a start screen of the VR content 100, FIG. 6B illustrates an embodiment in which a virtual rehabilitation therapist NPC and a virtual treatment room of the VR content 100 are applied, and FIG. 6C illustrates a PLAY of the content 100. 7 is an embodiment illustrating a training result of the VR content 100, FIG. 8 is an embodiment of a user information interface of the VR content 100, and FIG. 9 is an embodiment of the VR content 100. Examples of various rehabilitation training operations used.

The VR content 100 has a virtual therapist NPC to help the user rehabilitation training, at least one rehabilitation training operation is provided through the UI, the provided rehabilitation training operation and the wearable sensor unit 300 is recognized Analyzing the degree of agreement of the user's implementation of motion, and provides the user with visual, auditory, tactile feedback according to the degree of agreement with the rehabilitation training operation, and stores the training results by DB.

When the VR content 100 starts, the user is confirmed and registered, and if the user is a registered user, the existing rehabilitation training DB is searched.

Thereafter, if the user selects a desired rehabilitation training course from free training, random training, and recommended training, as shown in FIG.

After that, if the registered user is fed back the rehabilitation training intensity based on the existing rehabilitation training DB is automatically adjusted.

6B or 6C, the virtual rehabilitation therapist NPC presents one or more operations used for rehabilitation training through the UI, and the user follows the operations provided through the UI.

The operations used for the rehabilitation training include the operations illustrated in FIG. 9.

Meanwhile, each sensing module of the wearable sensor unit 300 recognizes an operation performed by a user and reflects the same on the VR content 100, and the operation performed by the user is represented as a virtual image in the VR content 100. .

Thereafter, the degree of matching between the operation provided by the UI and the operation performed by the user is determined, and an acoustic notification is provided by the speaker module 430 of the VR display unit 400 according to the degree of matching, so that the user may correct the operation. Can be configured to receive feedback on.

In addition, the vibration module 340 of the wearable sensor unit 300 may provide a vibration tactile experience to the user according to the degree of matching, so that the user may receive feedback on the correct operation.

Thereafter, the training result is provided to the screen as shown in FIG. 7, and the user checks the record and terminates the content or continues the training.

The training result is converted into a DB and transmitted to and stored in the control unit 200.

To describe the VR content 100 in more detail,

The VR content 100 is a game type content that is trained while following various rehabilitation training operations presented by a virtual rehabilitation therapist NPC in a VR environment using the wearable sensor unit 300.

The VR content 100 provides a variety of rehabilitation training operation, the user can continue the rehabilitation training not bored, the user can expect the intensive rehabilitation effect by performing the necessary repetitive training.

In addition, during training, the degree of matching between the rehabilitation training operation provided through the UI and the user's implementation may be fed back through an audio notification operated by the speaker module 430 of the VR display 400.

In addition, during training, the degree of correspondence between the rehabilitation training motion provided through the UI and the user's implementation motion may be fed back through vibrations operated by the vibration module 340 of the wearable sensor unit 300.

In addition, after the training is completed, the training results are provided on a visual screen, and the training results are recorded as a DB, and the user can intuitively know the degree of improvement over time and where the training site is needed.

In addition, in conjunction with the wearable sensor unit 300 reflects the movement of the finger to the VR, through the virtual rehabilitation therapist NPC of a pleasing impression provides a feeling of receiving one-on-one rehabilitation treatment to the individual doctor in virtual reality, space And beyond the social environment can increase the satisfaction of rehabilitation training.

In addition, by using a wide field of view through the VR experience will be able to secure a variety of activities and cool vision at the same time, through the game effect through the score record management can maximize the effect of rehabilitation training.

In addition, rehabilitation training can be brought to the rehabilitation subjects by using the leaderboard utilizing the user DB, providing various game rewards through a mystery box, or providing time-space experiences through a virtual tour experience. The effect will be further improved.

In addition, for a more realistic virtual reality, it is possible to anatomically simulate the joints of each part of the body in preparation for the whole body device and to include a haptic function using electric stimulation feedback.

On the other hand, the VR content 100 is not limited to the above-described content, may include a variety of content for rehabilitation training.

<Control part>

As shown in FIG. 2, the controller 200 controls the VR content driving module 210, the communication module 220, the data storage module 230, the posture matching determination module 240, and the rehabilitation training intensity adjusting module 250. It may include.

The controller 200 drives the above-described VR content 100 through the VR content driving module 210, and is connected to the wearable sensor unit 300 and the VR display unit 400 to be described later by wire or wirelessly. Data may be exchanged through the communication module 220, and the received data may be stored in the data storage module 230.

To describe the control unit 200 in more detail,

The VR content driving module 210 may deeply run the rehabilitation DB of the user to select and drive the VR content 100 for rehabilitation training that is most suitable for the user.

For example, except for a program that the user easily follows, the VR content 100 may be configured to preferentially run a program that the user does not easily follow.

The VR content 100 driven as described above is transmitted to the VR display unit 400 through the communication module 220, and the VR content 100 is implemented in the display module 410 of the VR display unit 400. .

The controller 200 receives the data measured by the motion detection module 420 of the VR display unit 400 using the communication module 220 and reflects the data to the VR content 100. 100 is changed according to the movement of the VR display 400.

In addition, the control unit 200 receives the data on the user's implementation measured in the motion detection module 310, the angle detection module 320, the touch detection module 330 of the wearable sensor unit 300 The operations reflected on the VR content 100 and performed by the user are represented as virtual images in the VR content 100.

In addition, the control unit 200 receives data on the user's execution operation measured by the detection module of the wearable sensor unit 300, and based on the data, the posture matching determination module 240 is the VR content ( The degree of correspondence between the rehabilitation training action suggested by step 100 and the user's implementation action is determined.

In addition, the controller 200 expresses the degree of matching as a percentage and divides the signal into at least one or more sections, and sends different signals to the speaker module 430 of the VR display unit 400 according to the sections, respectively. Provide an audible notification, whereby the user can be configured to receive feedback on the correct rehabilitation training operation.

In addition, the controller 200 expresses the degree of matching as a percentage and divides the signal into at least one or more sections, and sends different signals to the vibration module 340 of the wearable sensor unit 300 according to the sections, respectively. Provide a vibratory tactile experience of intensity, whereby the user can be configured to receive feedback on correct rehabilitation training movements.

In addition, the control unit 200 receives the data including the training result of the VR content 100 and stores it in the data storage module 230, the rehabilitation training intensity control module 250 is based on the data rehabilitation Adjust the training intensity to suit your current user.

The controller 200 may further include an EEG analysis module 260 that analyzes the EEG of the user who is using the VR display 400.

Specifically, the control unit 200 receives the data measured by the brain wave detection module 440 of the VR display unit 400 and stores the data in the data storage module 230, the brain wave analysis module based on the data 260 may be configured to determine whether the user is sick.

In more detail, the EEG analysis module 260 may include a reference value for each user for determining whether a user who is using the VR display unit 400 is sick. .

For example, the EEG analysis module 260 may set baseline power for each user so that an alpha wave when the user is using the VR content 100 can be compared with an alpha wave before using the VR content 100. .

In more detail, the EEG analysis module 260 may set the baseline power using the EEG of the user measured in a state in which the preset reference image provided from the VR content 100 is output.

The reference image refers to an image in which a user cannot feel motion sickness even when the user uses the virtual reality display device. The reference image may be a still image or a fixed image.

The brain wave analysis module 260 receives data from the brain wave detection module 440 of the VR display unit 400 to be described later, and compares the received data with a previously measured baseline power to calculate a power change amount. The power change amount may be compared with a predetermined threshold section to determine in real time whether the user is sick.

In addition, the controller 200 receives data regarding an image captured by the camera module 450 of the VR display unit 400 and stores the data in the data storage module 230 and reflects the image data in VR content. can do.

For example, when the brain wave analysis module 260 determines that the current user is in motion sickness, the image captured by the camera module 450 is first provided in the VR content 100 so that the user may be out of motion sickness. It can be configured to.

In addition, when the brain wave analysis module 260 determines that the current user is sick, the view angle of the VR content 100 implemented in the VR display 400 may be changed.

<Wearable sensor part>

As shown in FIGS. 3A to 3B, the wearable sensor unit 300 includes a motion detection module 310, an angle detection module 320, a touch detection module 330, a vibration module 340, and a communication module (not shown). It may include.

The wearable sensor unit 300 may be connected to the control unit 200 and the VR display unit 400 to be described later by wire or wirelessly to exchange data through the communication module (not shown).

The user's behavior is recognized by the motion detection module 310, the angle detection module 320, and the touch detection module 330, and the vibration module 340 provides a vibration tactile experience to the user.

The motion detection module 310 is installed at least one at a predetermined position to detect the movement of the palm and fingers, the angle detection module 320 is installed at least one at a predetermined position to measure the finger angle, At least one touch sensing module 330 may be installed at a predetermined position and configured to recognize a touch of a finger joint.

To describe the sensing module in more detail,

The motion detection module 310 may be installed in each of the divided areas by dividing the joint area of the palm and the joint area of each finger.

The angle detection module 320 may be installed for each joint portion of each finger to detect the movement of each finger and measure the moving angle.

The touch sensing module 330 may be installed for each joint portion of each finger so that the touch sensing module 330 may recognize when touching the joint of each finger.

The vibration module 340 may be configured to provide at least one vibration tactile experience to a user to receive feedback on a rehabilitation training operation.

On the other hand, the detection module may include a noise removing unit for more precise detection.

For example, the noise removing unit samples a voltage including noise at predetermined time intervals, and when the difference between the values is within a predetermined range compared to the voltage sampled immediately before the sampled voltage, It may be configured to adopt the sampled voltage, and to adopt the voltage sampled immediately before the difference between the values is outside the predetermined range.

Specifically, in the case where the predetermined range is A, when the absolute value of the difference of the sampled voltage is smaller than A, the sampled voltage is later determined to be noiseless and adopted, but the absolute value of the difference of the sampled voltage is larger than A. In this case, the later sampled voltage may be configured to adopt the previously sampled voltage without determining that it contains noise.

On the other hand, the absolute value of the difference between the sampling time interval and the voltage can be changed, and the noise may be removed by using a bandpass filter generally used in signal processing.

3A to 4B illustrate an example of the wearable sensor unit 300, which will be described in more detail with reference to the wearable sensor unit 300.

Referring to FIG. 3A, the positions of the motion detection module 310, the touch detection module 330, and the vibration module 340 of the wearable sensor unit 300 may be known. Referring to FIGS. 3B and 3C, the The position of the angle detection module 320 of the wearable sensor unit 300 may be known.

Meanwhile, the positions of the motion detection module 310, the angle detection module 320, the touch detection module 330, and the vibration module 340 are not limited thereto and may be changed as necessary.

4A is an embodiment of the goniometer indicating the angle measured by the angle detection module 320, Figure 4B is an embodiment showing the angle measured by the angle detection sensor in the VR content (100).

By using the touch sensing module 330, a finger joint may be touched (clicked) so that the corresponding joint data is reflected in the protractor. Clicked joints can also be displayed in the UI. In this embodiment, it may be applied similarly to FIG. 3C when the detailed table of FIG. 3B is touched.

The user's implementation is recognized by the motion detection module 310, the angle detection module 320, and the touch detection module 330, and the data measured by the detection module is transmitted to the controller 200 to provide the VR. Reflected in the content 100, the actions performed by the user are represented as virtual images in the VR content 100.

On the other hand, the wearable sensor unit 300 may further include a driving module (not shown), it may be configured to move by a predetermined signal.

For example, when explaining the rehabilitation training operation to the user to configure the actual training movement by using a drive module (not shown) it will be possible to increase the rehabilitation training effect.

In addition, the wearable sensor unit 300 is not limited to the glove and may be configured to fit the site that requires rehabilitation training.

<VR display part>

As shown in FIG. 5, the VR display unit 400 may include a display module 410, a motion detection module 420, a speaker module 430, and a communication module 460.

The VR display unit 400 may be connected to the control unit 200 and the wearable sensor unit 300 by wire or wirelessly to exchange data through the communication module 460.

The VR display unit 400 receives the VR content 100 driven by the controller 200, and the received VR content 100 is implemented in the display module 410 and provided to the user.

The motion detection module 420 of the VR display unit 400 measures data by detecting a user's head movement, and the measured data is transmitted to the controller 200 to be reflected in the VR content 100. The VR content 100 may be configured to change the virtual reality environment according to the movement of the user.

On the other hand, the motion detection module 420 may be configured to include the noise removal unit described above for more precise motion detection.

The speaker module 430 of the VR display unit 400 not only provides the sound of the VR content 100, but also receives a signal from the control unit 200 and provides an audible notification to the user so that the user operates the rehabilitation training. It may be configured to receive feedback on.

In addition, the VR display unit 400 may further include an EEG detection module 440 for detecting the brain wave of the user and a camera module 450 for photographing the outside when the VR display 400 is worn.

To describe the EEG module 440 in more detail,

The EEG module 440 receives EEG from a plurality of electrodes attached to different positions of the user's head.

On the other hand, as the electrode used for the EEG measurement, it is preferable to use an Ag-AgCl disc capable of accurately measuring a slow voltage change, but is not limited thereto.

Electrodes can be detected using these electrodes, and in general, the frequency of the brain waves is delta wave, theta wave, alpha wave, beta wave, gamma wave. Delta waves are signals with a frequency of 0.2-4Hz, theta waves are signals with a frequency of 4-8Hz, alpha waves are signals with a frequency of 8-12Hz, beta waves are signals with a frequency of 12-30Hz, and gamma waves are signals with a frequency above 30Hz.

Specifically, delta waves are brain waves that are observed when you are in deep sleep, and theta waves are brain waves that occur when you concentrate on using the information inside your brain and concentrate on solving logical thinking problems. Alpha waves are brain waves that occur when people concentrate their minds and utilize information inside the brain. Beta waves are brain waves that occur mainly when they are physically active or when they are immersed in something. Gamma waves are when tension and active high-level mental functions are performed. It is an electroencephalogram that occurs.

On the other hand, motion sickness is related to alpha waves in particular among the EEG, so that the power spectrum is measured by extracting the EEG in the alpha wave region from the received EEG, and converting the measured power spectrum into a Fast Fourier Transform (FFT) to calculate the power spectral density. do.

The EEG detection module 440 includes a data preprocessing unit such as noise removal and signal amplification for more accurate detection, and preferably uses an Emotive Epoc + device as a data collection device, but is not limited thereto.

Data including the power spectral density calculated by the EEG detection module 440 is transmitted to the control unit 200, and whether the user is sick in the EEG analysis module 260 of the control unit 200 based on the transmitted data. Is judged.

The camera module 450 of the VR display unit 400 may be installed on an outer circumferential surface of the VR display unit 400 to photograph the user's gaze direction when the user wears the VR display unit 400.

As a result, the camera module 450 may be configured to capture an image as seen by a user without wearing the VR display 400.

<Rehabilitation Training Method Using Virtual Reality>

Hereinafter, a rehabilitation training method using virtual reality will be described with reference to FIG. 10.

As a basic flow of rehabilitation training method using virtual reality,

Wearing a VR display unit and a wearable sensor unit (S101);

Executing the VR content (S102);

Identifying a user and searching an existing rehabilitation training DB (S103);

Selecting a rehabilitation training course among free training, random training, and recommended training (S104);

Confirming the effect of the selected training in the step of selecting the rehabilitation training process before starting training (S105);

Rehabilitation training intensity is adjusted based on the existing rehabilitation training DB (S106);

Calibrating the wearable sensor unit according to a user's environment (S107);

Step S108 of the user performing rehabilitation training;

After the training step (S109) showing the training result;

DB of the training results and transmitting to the control unit (S110);

Terminating the VR content (S111); It may be made of.

To be more specific,

The user wears the wearable sensor unit 300 and the VR display unit 400 to execute the VR content 100.

When the VR content 100 starts, a virtual rehabilitation therapist NPC sits in front of the user screen.

If the user is not registered, the user is registered. If the user is already registered, the existing rehabilitation training DB is searched.

Thereafter, if the user selects a desired rehabilitation training course from free training, random training, and recommended training, as shown in FIG.

After that, if the registered user is fed back the rehabilitation training intensity based on the existing rehabilitation training DB is automatically adjusted.

After that, the user calibrates the wearable sensor unit 300 according to his environment.

The process of calibrating the wearable sensor unit 300 includes: spreading and keeping all fingers according to a program for calibrating a sensing module of the wearable sensor unit 300; Bending all of the fingers to clench and hold the fist; In the program, a step of checking whether the hand displayed in 3D and the user's hand moves in synchronization is performed.

6B or 6C, the virtual rehabilitation therapist NPC presents one or more operations used in the rehabilitation training illustrated in FIG. 9 through the UI, and the user follows the operations provided through the UI.

Meanwhile, the sensing module of the wearable sensor unit 300 recognizes an operation performed by a user and determines a degree of correspondence between an operation provided by the UI and an operation performed by the user.

In addition, the speaker module 430 of the VR display unit 400 may provide an audio notification according to the degree of matching, and the user may be configured to receive feedback on the correct operation.

In addition, the vibration module 340 of the wearable sensor unit 300 may be operated according to the matching degree to provide a vibration tactile experience to the user, and thus the user may be configured to receive feedback on the correct operation.

Accordingly, the user can know in real time whether the correct operation.

Thereafter, the training result is provided on the screen as shown in FIG. 7, the user checks the record, and the training result is made into a DB, which is transmitted to and stored in the control unit 200.

After that, the user ends the VR content 100 to finish the rehabilitation training using the virtual reality.

On the other hand, the VR content 100 can be configured to interact with other rehabilitation training small toys or small toys, thereby inducing a reward or directing to induce rehabilitation training.

In addition, when the VR content 100 is various, the step of configuring the deep rehabilitation DB of the user to deep learning, the step of selecting the VR content 100 for rehabilitation training that is most suitable for the user based on the deep learning data May include more.

Although described above with reference to the drawings according to an embodiment of the present invention, those of ordinary skill in the art will be able to perform various applications and modifications within the scope of the present invention based on the above contents.

1000: rehabilitation training system using a virtual reality according to the present invention
S1000: Rehabilitation training method using a virtual reality according to the present invention
100: VR content 200: control unit
210: VR content driving module 220: communication module
230: data storage module 240: posture match determination module
250: rehabilitation training intensity control module 260: EEG analysis module
300: wearable sensor unit 310: motion detection module
320: angle detection module 330: touch detection module
340: vibration module 400: VR display unit
410: display module 420: motion detection module
430: speaker module 440: brain wave detection module
450: camera module 460: communication module

Claims (4)

delete delete delete As a rehabilitation training method using virtual reality,
Wearing a VR display unit and a wearable sensor unit (S101);
Executing the VR content (S102);
Identifying a user and searching an existing rehabilitation training DB (S103);
Selecting a rehabilitation training course among free training, random training, and recommended training (S104);
Confirming the effect of the selected training in the step of selecting the rehabilitation training process before starting training (S105);
Rehabilitation training intensity is adjusted based on the existing rehabilitation training DB (S106);
Calibrating the wearable sensor unit according to a user's environment (S107);
Step S108 of the user performing rehabilitation training;
After the training step (S109) showing the training result;
DB of the training results and transmitting to the control unit (S110);
Terminating the VR content (S111); Rehabilitation training method using a virtual reality comprising a.

Images