KR102151494B1 - Active feedback virtual reality system for brain and physical health through user's activity - Google Patents

Abstract

The present invention relates to an active feedback virtual reality system for brain health and physical health through user activity, and an implementation method thereof, and more specifically, to an active feedback virtual reality system for brain health and physical health through user activity, which applies biometric information measured by a user in real time to adjust the difficulty of virtual reality content, and provides the virtual reality content that allows the user to avoid obstacles by creating an object and reach a target point, and to an implementation method of the active feedback virtual reality system.

Description

Active feedback virtual reality system for brain and physical health through user's activity}

The present invention relates to an active feedback virtual reality system and implementation method for brain health and physical health through user activity, and more particularly, to apply the biometric information measured by the user in real time to adjust the difficulty of virtual reality content. The present invention relates to an active feedback virtual reality system and implementation method for brain health and physical health through a user's activity that adjusts, creates an object, avoids obstacles, and provides virtual reality content reaching a target point.

Virtual Reality is a technology that achieves interaction between a user and a 3D virtual space created by a computer system, and the user feels immersive through the five senses (sight, hearing, smell, taste, and touch) of the human body in such a virtual space. It is a convergence technology that provides a sense of reality as if you feel and actually exist in that space. In the global virtual reality market, head mount displays dominate, and various types of virtual reality devices are emerging. Currently, the virtual reality market is growing centered on hardware (devices), but as related products spread, the influence of the platform that distributes contents and contents such as applications is expected to increase gradually.

In modern times, there are many cases where virtual reality systems can be experienced simply for the purpose of play and fun, such as VR (Virtual Reality) cafes in the virtual reality market. However, through the virtual reality system, content can be provided not only for the purpose of simply experiencing virtual reality for fun, but also for the treatment of users with mental disorders using virtual reality. Patients suffering from brain diseases such as dementia, ADHD, and depression are prone to lethargy. Virtual reality technology is not limited by space and time with only a simple device, and because virtual reality experience is possible anytime, anywhere, through this, it is possible to improve the user's motor function and helplessness according to the movement of the body. In addition, by providing various contents that can be calculated, memorized, and concentrated, it is possible to expect the effect of improving the memory and concentration of virtual reality system users using the brain, and biometric information such as brain waves and heartbeat of users experiencing virtual reality contents. By measuring in real time, the user's concentration and physical condition can be analyzed.

Therefore, by using such a virtual reality system, a study aimed at improving brain diseases such as depression by providing an environment in which users can concentrate and an activity target that can move their body through contents that may be of interest to the user has been conducted. .

The present invention relates to an active feedback virtual reality system and implementation method for brain health and physical health through user activity, and more particularly, to apply the biometric information measured by the user in real time to adjust the difficulty of virtual reality content. It aims to provide an active feedback virtual reality system and implementation method for brain health and physical health through user activities that provide virtual reality content that adjusts, creates objects, avoids obstacles, and reaches a target point. .

In order to solve the above problems, the present invention is an active feedback virtual reality system for brain health and physical health through a user's activity, wherein the virtual reality system is attached to the user's head and A sensor unit including an EEG measurement module for measuring EEG and a heart rate measurement module attached to a user's finger to measure a user's heart rate; A VR system unit that executes virtual reality content for the user to perform obstacle avoidance and derives an evaluation of the user's obstacle avoidance performance result; And an HMD module for receiving image and sound information of virtual reality content executed from the VR system unit and providing it to a user, wherein the VR system unit collects sensing information for receiving the brain wave and the heartbeat from the sensor unit. part; Obstacle avoiding content that adjusts the difficulty of the virtual reality content by applying the brain wave and the heartbeat of the user wearing the HMD module in real time, avoids obstacles by creating an object, and executes the virtual reality content reaching a target point It provides a virtual reality system including;

In one embodiment of the present invention, the obstacle avoiding content execution unit displays an obstacle that obstructs the user's walking on an execution screen of the virtual reality content, and generates the object or displays the displayed obstacle based on the user's input. Removed, the user's coordinates in the virtual reality space are composed of three-dimensional coordinates in the X, Y, and Z-axis directions, and the user's coordinates are changed based on the user's input to be located on the upper surface of the object created by the user. In addition, when the object is created or a given obstacle is destroyed according to the user's input, the score for the performance result can be changed.

In an embodiment of the present invention, the obstacle avoiding content execution unit includes a setting step of setting the number of obstacles; An execution step of executing content capable of experiencing virtual reality reaching a target point by performing obstacle avoidance; An ability adjusting step of varying at least one of a movement speed of a user and an object creation speed set in a virtual reality content based on the brain wave and the heart rate; A termination step of terminating execution of the content according to a user's input or a preset determination criterion may be performed.

In an embodiment of the present invention, the setting of the number of obstacles includes receiving a user's input for user information including height, weight, and age, and derives a target heart rate based on the user information and the heart rate. Step to do; Deriving an average heart rate based on the measured heart rate during a preset period while the user has performed virtual reality content for performing the obstacle avoidance in the past; Determining whether a user's target exercise amount is satisfied based on the target heart rate and the average heart rate; And setting the number of obstacles provided to the virtual reality content based on a predetermined criterion according to whether the target momentum is satisfied.

In one embodiment of the present invention, in the step of adjusting the ability, when the concentration degree derived based on the brain waves is maintained for a preset time, the preset movement speed of the user reaching the target point and the user's One or more of the generation speeds for the object generated based on the input may be increased.

In an embodiment of the present invention, in the step of adjusting the ability, the concentration is increased as the time for maintaining the preset reference based on the concentration derived based on the brain wave and the deviation of the heart rate increases, and The movement speed may be determined based on a movement speed calculation equation that increases as the deviation decreases.

In order to solve the above problems, an embodiment of the present invention is a method of implementing an active feedback virtual reality system for brain health and physical health through a user's activity, the implementation method comprising the user's head A sensor step including an EEG measurement step of measuring a user's EEG and a heart rate measurement step of being attached to a user's finger to measure a user's heart rate; A VR system step of executing virtual reality content in which a user can perform obstacle avoidance, and derives an evaluation of the user's obstacle avoidance performance result; And an HMD module step of receiving the image and sound information of the virtual reality content executed in the VR system step and providing it to the user through the HMD module, wherein the VR system step includes the brain waves and the brain waves from the sensor step. Sensing information collection step of receiving a heartbeat; Obstacle avoiding content that adjusts the difficulty of the virtual reality content by applying the brain wave and the heartbeat of the user wearing the HMD module in real time, avoids obstacles by creating an object, and executes the virtual reality content reaching a target point It provides a method of implementing a virtual reality system including; execution step.

According to an embodiment of the present invention, by providing virtual reality content that performs obstacle avoidance, it is possible to increase brain health and physical health by increasing memory and concentration of virtual reality system users and inducing physical activity. I can.

According to an embodiment of the present invention, a virtual reality content that avoids obstacles is provided to provide an environment in which the user can think directly, thereby enabling the brain of a user with a mental disorder to be activated to provide more effective treatment. It can exert the effect it can provide.

According to an embodiment of the present invention, by determining the user's state through biometric information such as brain waves and heartbeat of the virtual reality system user, and adjusting the difficulty of the content by providing appropriate feedback to the current user state, It can exert the effect of providing real content.

According to an embodiment of the present invention, while avoiding obstacles and reaching a target point, the user's ability in virtual reality content such as the user's movement speed and object creation speed is adjusted according to the body's stability based on the user's heartbeat. By doing so, the effect of improving the user's immersion can be exhibited.

According to an embodiment of the present invention, evaluation information using virtual reality content that reaches a target point while avoiding obstacles and biometric information during use are transmitted to the outside to provide an effect that can be used as user's treatment, treatment, and counseling data. Can be demonstrated.

1 schematically shows a user in an experience space of a virtual reality system according to an embodiment of the present invention and modules constituting a sensor unit worn on the user's body.
2 schematically shows the internal configuration of a virtual reality system according to an embodiment of the present invention.
3 schematically shows the internal configuration of a VR system unit according to an embodiment of the present invention.
4 schematically shows the steps of performing an obstacle avoiding content execution unit according to an embodiment of the present invention.
5 schematically illustrates a step of setting the number of obstacles performed by an obstacle avoiding content execution unit according to an embodiment of the present invention.
6 schematically shows a user's motion to reach a target point while avoiding obstacles in an experience space of a virtual reality system according to an embodiment of the present invention.
7 schematically shows a screen displayed in an HMD module provided by an obstacle avoiding content execution unit according to an embodiment of the present invention.
8 schematically shows a screen displayed in an HMD module provided by an obstacle avoiding content execution unit according to an embodiment of the present invention.
9 schematically illustrates an internal configuration of a computing device according to an embodiment of the present invention.

In the following, various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, a number of specific details are disclosed to aid in an overall understanding of one or more aspects. However, it will also be appreciated by those of ordinary skill in the art that this aspect(s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of one or more aspects. However, these aspects are exemplary and some of the various methods in the principles of the various aspects may be used, and the descriptions described are intended to include all such aspects and their equivalents.

Further, various aspects and features will be presented by a system that may include multiple devices, components and/or modules, and the like. It is also noted that various systems may include additional devices, components and/or modules, and/or may not include all of the devices, components, modules, etc. discussed in connection with the figures. It must be understood and recognized.

As used herein, “an embodiment,” “example,” “aspect,” “example,” and the like may not be construed as having any aspect or design described as being better or advantageous than other aspects or designs. . The terms'~part','component','module','system', and'interface' used below generally mean a computer-related entity, for example, hardware, hardware It can mean a combination of software and software, or software.

In addition, the terms "comprising" and/or "comprising" mean that the corresponding feature and/or element is present, but excludes the presence or addition of one or more other features, elements, and/or groups thereof. It should be understood as not.

In addition, terms including ordinal numbers such as first and second may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The term and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein including technical or scientific terms are commonly understood by those of ordinary skill in the art to which the present invention belongs. It has the same meaning as. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the embodiments of the present invention, an ideal or excessively formal meaning Is not interpreted as.

1 schematically shows a user in an experience space of a virtual reality system according to an embodiment of the present invention and modules constituting a sensor unit worn on the user's body.

The virtual reality system of the present invention includes a sensor unit 1000, a controller 1300, a VR system unit 3000, and an HMD module 2000, and a user performs a virtual reality avoiding obstacles provided through the virtual reality system. You can experience the content. In addition, it is possible to obtain the effect of improving concentration and memory through experience in the virtual space, and by inducing physical activity, it is possible to obtain the effect of improving physical exercise ability. As shown in FIG. 1, a user experiencing virtual reality through a virtual reality system may attach an EEG measurement module 1100 and a heart rate measurement module 1200 to his/her body, including a motion sensor module 1310 By holding the controller 1300 to perform virtual reality content experience, the user can input (for example, a button) as needed, and the motion of the user can be measured by the motion sensor module 1310 included in the controller 1300. I can.

The user's input and operation received through the controller 1300 are transmitted to the VR system unit 3000 and reflected in virtual reality content. As shown in FIG. 1, the user may recognize the movement of the HMD module 2000 and the controller 1300 according to the user's motion in the space where the base station 10 is installed to set the area of the virtual reality experience space.

The virtual reality content of the present invention provided in the environment as shown in FIG. 1 is a user with mental disorders such as post-traumatic stress disorder (PTSD), panic disorder, mild cognitive disorder, and attention deficit hyperactivity disorder (ADHD). By providing various contents that can move the body while avoiding obstacles and reaching the target point through experience in a virtual space where obstacle avoidance can be performed, users can think about how to avoid obstacles by themselves. And, such virtual reality content may be provided for the purpose of improving concentration and memory, and activating a body to find an object.

The mental disorders in the present invention are not limited to the types of mental disorders described above, such as post-traumatic stress disorder (PTSD), but are provided through a virtual reality system that can perform obstacle avoidance ranging from minor mental disorders to severe mental disorders. It can include all kinds of mental disorders that can obtain therapeutic effects through experiences in virtual spaces.

Hereinafter, the configuration of the virtual reality system will be described in more detail.

2 schematically shows the internal configuration of a virtual reality system according to an embodiment of the present invention.

The virtual reality system according to an embodiment of the present invention includes an EEG measurement module 1100 that is attached to the user's head to measure the user's EEG, and a heart rate measurement that is attached to the user's finger to measure the user's heart rate. A sensor unit 1000 including a module 1200; A controller 1300 including a motion sensor module 1310 capable of receiving a user's input and measuring a motion; Virtual reality executed from the VR system unit 3000, including; a VR system unit 3000 that executes virtual reality content in which a user can perform obstacle avoidance and derives an evaluation of the user’s obstacle avoidance performance result. It includes an HMD module 2000 that provides image and sound information of content to a user.

According to an embodiment of the present invention, as shown in FIG. 2, the VR system unit 3000 may be included in the HMD module 2000.

The EEG measurement module 1100 senses and measures EEG waves including delta waves, theta waves, alpha waves, beta waves, and gamma waves. The data on the brain waves can be transmitted in an open sound control format without passing through a specific storage medium, and can be transmitted to a computer through wireless communication including Bluetooth communication with other devices. Brain waves of different frequency bands have different characteristics, and based on this, the mental activity state of the user can be determined.

The heart rate measurement module 1200 may be attached to the user's finger to measure the user's heart rate. Information related to the heart rate, such as heart rate, pulse wave shape, heart rate per minute, heart rate sound presence, heart rate display, and heart rate interval display blood flow index, may be displayed on the heart rate measurement module 1200.

The user wears modules that measure the user's heart rate and brain waves and experiences virtual reality content, thereby providing virtual reality content whose difficulty is adjusted according to their mental and physical state based on biometric information such as their heart rate and brain waves. I can receive it.

Meanwhile, the virtual reality system includes a controller 1300 for manipulating virtual reality contents that perform obstacle avoidance. As shown in FIG. 1, by holding the controller 1300 in both hands and moving, the user can input operations and controls in virtual reality content and use VR content. The controller 1300 includes a motion sensor module 1310 capable of detecting movement, thereby detecting the movement of the user's hand, and including input tools such as buttons, dials, and touch sensors that the user can manipulate. Allows various inputs.

The VR system unit 3000 may execute a virtual reality content in which a user performs obstacle avoidance based on information input from the sensor unit 1000, and evaluates a result of the virtual reality content performing obstacle avoidance You can do it.

The HMD module 2000 is worn on the user's head, provides image and sound information of virtual reality content to the user, and allows the user to experience virtual reality.

In order to experience virtual reality performing obstacle avoidance, the user wears the HMD module 2000 in a manner of wearing glasses, and is provided by receiving image and sound information of virtual reality content through the HMD module 2000 It is possible to obtain a high degree of experience such as actually experiencing virtual reality contents that perform obstacle avoidance.

3 schematically shows the internal configuration of the VR system unit 3000 according to an embodiment of the present invention.

The VR system unit 3000 includes a sensing information collection unit 3100 for receiving brain waves and heartbeats from the sensor unit 1000, as shown in FIG. 3; And by applying the brainwave and the heartbeat of the user wearing the HMD module 2000 in real time to adjust the difficulty of the virtual reality content, create an object to avoid obstacles and execute the virtual reality content reaching the target point. An obstacle avoiding content execution unit 3200; And DB 3300.

Specifically, the sensing information collection unit 3100 receives the user's EEG and heartbeat measured from the sensor unit 1000 of the virtual reality system. The received brain wave and heartbeat of the user are then transmitted to the obstacle avoidance content execution unit 3200 and used as basic information for providing feedback to the virtual reality content experienced by the user.

The obstacle avoiding content execution unit 3200 adjusts the difficulty of the virtual reality content capable of performing obstacle avoidance based on the user's brainwave and heartbeat transmitted from the sensing information collecting unit 3100, and creates an object to detect the obstacle. Avoid and execute virtual reality content that reaches the target point. Specifically, the obstacle avoiding content execution unit 3200 displays an obstacle obstructing the user's walking on the execution screen of the virtual reality content, and generates the object or removes the displayed obstacle based on the user's input. can do. At this time, the user's coordinates in the virtual reality space are composed of three-dimensional coordinates in the X, Y, and Z-axis directions, and the user's coordinates are changed based on the user's input to be located on the upper surface of the object created by the user. To be able to do it. When the virtual reality content is executed, the user can reach the target point while avoiding the obstacle through activities such as jumping on the object by creating an object in order to overcome an obstacle higher than his or her height in a given virtual space. In addition, the obstacle avoiding content execution unit 3200 changes a score for an execution result when the object is created or a given obstacle is destroyed according to a user's input.

On the other hand, in the DB 3300 of the VR system unit 3000, as shown in FIG. 3, user information including the height, weight, and age of the user received input from the user, avoiding obstacles for the user's avoiding obstacles result. Biometric information including evaluation information and a user's brain wave and heart rate measured by the sensor unit 1000 may be stored. The user information, the obstacle avoidance evaluation information, and the biometric information are transmitted to a medical staff such as a doctor or counselor for the purpose of treatment and counseling for a user with a mental disorder, so that it can be used as treatment, treatment, and counseling data for the user. Can exert.

The VR system unit 3000 shown in FIG. 3 may further include other elements other than the illustrated elements, but for convenience, a virtual reality providing virtual reality content capable of performing obstacle avoidance according to embodiments of the present invention Only the components related to the system are shown.

Hereinafter, a detailed operation of the obstacle avoiding content execution unit 3200 will be described in more detail.

4 schematically shows the steps of performing the content execution unit 3200 to avoid obstacles according to an embodiment of the present invention.

As shown in FIG. 4 of the present invention, the obstacle avoiding content execution unit 3200 includes a setting step (S1000) of setting the number of obstacles; An execution step (S2000) of executing content capable of experiencing virtual reality reaching a target point while performing obstacle avoidance (S2000); An ability adjusting step (S3000) of varying one or more of a movement speed of a user and an object creation speed set in a virtual reality content based on the brain wave and the heart rate; A termination step (S4000) of terminating the execution of the content according to a user's input or a predetermined criterion is performed.

In the setting step (S1000), the obstacle avoiding content execution unit 3200 sets the number of obstacles to be provided to the virtual reality content capable of performing obstacle avoiding provided by the user. In an embodiment of the present invention, the number of obstacles may be set through user input. The user can arbitrarily input and set the number of obstacles to be avoided while going to the target point. Meanwhile, if the user does not arbitrarily input the number of obstacles, the number of obstacles may be set by the operation of the obstacle avoidance content execution unit 3200. When the user performs obstacle avoidance for the first time, virtual reality content may be provided by setting the number of obstacles based on the user's heartbeat measured by the sensor unit 1000 of the obstacle avoiding content execution unit 3200. For example, when the preset criterion is the number of obstacles provided when the heart rate is 150 bpm or more, the number of obstacles provided is 5, and when the heart rate is less than 150 bpm, the number of obstacles provided is 3, the user who attempts to perform the first stage Assuming that the current heart rate is 123 bpm, the obstacle avoiding content execution unit 3200 may execute virtual reality content by setting the number of obstacles to three. In this way, the number of obstacles to be provided to the user executing the first stage may be set according to a preset criterion based on the heartbeat. Thereafter, when the user reaches the target point in the first stage and then performs the next stage of obstacle avoidance, the obstacle avoidance content execution unit 3200 may set the number of obstacles by performing steps S100 to S140 to be described later. have.

Thereafter, when performing the next stage of obstacle avoiding, the obstacle avoiding content execution unit 3200 may set the number of obstacles by performing steps S100 to S130 to be described later.

In the execution step (S2000), the obstacle avoiding content execution unit 3200 executes content capable of experiencing virtual reality in which obstacle avoiding is performed according to the set number of obstacles. Through this, the user can experience the virtual reality of reaching the target point by creating an object to reach the target point, avoiding obstacles, avoiding obstacles, and destroying obstacles. Scores and performance results according to content use information including the number of times and time to reach the target point may be stored.

In the capability adjustment step (S3000), one or more of a movement speed of a user and an object creation speed set in the virtual reality content is changed based on the brain waves and heartbeat collected from the sensor unit 1000. After the virtual reality content is executed, the obstacle avoiding content execution unit 3200 may adjust the difficulty of the obstacle avoiding virtual reality content based on the user's brain wave and heartbeat. In an embodiment of the present invention, the degree of concentration during the virtual reality experience of the user may be derived based on the brain waves. The concentration may be derived based on brain waves including theta waves, alpha waves, beta waves, and gamma waves measured by the sensor unit 1000. Concentration can be derived based on activity stress indicating the user's anxiety or excitement, beta waves indicating immersion, alpha waves indicating stable states such as meditation or problem solving, and theta waves indicating shallow sleep or drowsiness. One or more of the movement speed of the user reaching the target point in the virtual reality space and the object creation speed may be varied according to whether the concentration level meets a predetermined criterion based on the concentration level derived as described above. Users who experience virtual reality content according to the motion of the obstacle content execution unit have a higher concentration in experiencing the content, and the more the stability of the body is restored, the movement speed in the virtual reality increases and the creation speed of the object increases. You can reach the target point in a faster time and get a higher score result.

In the end step (S4000), the obstacle avoiding content execution unit 3200 terminates the execution of the obstacle avoiding content according to a user input or a predetermined criterion. Execution of obstacle avoiding content is performed according to a predetermined criterion, such as when the user performing obstacle avoidance inputs to end the execution of obstacle avoidance virtual reality content, or when the user reaches a target point set in the content. You can quit.

The obstacle avoiding content execution unit 3200 may provide virtual reality content that reaches a target point while avoiding an obstacle through the HMD module 2000 by performing the above steps.

5 schematically illustrates a step of setting the number of obstacles performed by the obstacle avoiding content execution unit 3200 according to an embodiment of the present invention.

The obstacle avoiding content execution unit 3200 may set the number of obstacles to be provided in providing the user with virtual reality content that reaches the target point while avoiding the obstacle. When the user performs obstacle avoidance for the first time, the number of obstacles may be set according to a preset number based on the brain wave or a user input. Avoiding Obstacles When avoiding obstacles has not been performed before performing a new virtual reality content, a preset number of obstacles may be provided based on a concentration derived based on an EEG measured through the current sensor unit 1000. .

On the other hand, in the case of executing the obstacle avoiding virtual reality content previously, and then performing the obstacle avoiding virtual reality content as the next stage, the step of setting the number of obstacles performed by the obstacle avoiding content execution unit 3200 (S1000) is , Receiving a user's input for user information including height, weight and age, and deriving a target heart rate based on the user information and the heart rate; (S100) a virtual user performing the obstacle avoidance in the past While performing real content, deriving an average heart rate based on the measured heart rate during a preset period (S110); Determining whether the user's target exercise amount is satisfied based on the target heart rate and the average heart rate (S120); And setting (S130) the number of obstacles provided to the virtual reality content based on a predetermined criterion according to whether the target momentum is satisfied.

Specifically, in step S100, the obstacle avoiding content execution unit 3200 receives a user input for user information including height, weight, and age. Thereafter, a target heart rate is derived based on user information including height, weight, and age and the heart rate measured by the sensor unit 1000. Specifically, the obstacle avoiding content execution unit 3200 derives the maximum heart rate of the user based on the age input and received from the user. The maximum heart rate derivation equation is shown in the following derivation equation 1 (a). Thereafter, the extra heart rate is derived based on the derived maximum heart rate and the stable heart rate indicating the normal heart rate. The surplus heart rate derivation equation is shown in (b) of the derivation equation 1 below. Meanwhile, the obstacle avoidance content execution unit 3200 derives a BMI value based on the height and weight received input from the user, and derives an exercise target intensity based on the BMI value. The BMI value derivation formula is shown in (c) of the following derivation formula 1. The exercise target intensity derived according to the derived BMI value may be derived according to a preset criterion as shown in an example of Table 1 below. Thereafter, the obstacle avoiding content execution unit 3200 derives a target heart rate based on the stable heart rate, the derived spare heart rate, and the exercise target intensity. The target heart rate derivation equation is shown in (d) of the derivation equation 1 below.

[Draw Expression 1]

(a) HR _max (maximum heart rate) = 220-age

(b) HRR (free heart rate) = HR _max (maximum heart rate)-HR _rest (stable heart rate)

(c) BMI = weight (kg) / (height) ² (m)

(d) THR (target heart rate) = (HRR (free heart rate) * exercise target intensity (%)) + HR _rest (stable heart rate)

shame Rating Target intensity of exercise BMI <23 normal 75% 23 <BMI <25 Overweight 70% 25 <BMI <30 obesity 65% 30 <BMI <35 Severe obesity 60% 35 <BMI Super obesity 55%

An example of obtaining the target heart rate of the user of the obstacle avoiding content execution unit 3200 of the present invention is as follows.

[User information 1]

Height: 170cm, Weight: 55kg, Age: 25

Stable heart rate measured by the heart rate sensor module 63

Applying the preset criteria in Derivation Formula 1 and Table 1,

(a) HR _max (maximum heart rate) = 220-age = 220-25 = 195

(b) HRR (free heart rate) = HR _max (maximum heart rate)-HR _rest (stable heart rate) = 195-63 = 132

(c) BMI = weight (kg) / (height) ² (m) = 55 / (1.7) ² = 19.0311419??< 23

--> According to [Table 1], exercise target intensity = 75%

(d) (HRR (free heart rate) * exercise target intensity (%)) + HR _rest (stable heart rate) =

(132 * (3/4)) + 60 = 159

**User 1's target heart rate: 159 bpm

In this way, the obstacle avoidance content execution unit 3200 may derive a target heart rate based on user information including height, weight, and age and heart rate.

Thereafter, in step S110, the average heart rate is derived based on the measured heart rate during a preset period while the user avoids obstacles and performs virtual reality content reaching the target point in the past. While the user performs the obstacle avoidance virtual reality content in the previous stage, it is calculated by adding the heart rate measured from the sensor unit 1000 for a preset period, that is, the time required to derive the average heart rate, and the corresponding Through the average value divided by the time, the average heart rate while the user is performing obstacle avoidance can be derived.

Thereafter, in step S120, it is determined whether or not the user's target exercise amount is satisfied based on the target heart rate and the average heart rate derived in steps S100 and S110. Avoiding Obstacles in the Previous Stage If the user's average heart rate falls within the error range of the target heart rate while experiencing virtual reality, it is determined that the target momentum has been met, and the user's average heart rate falls outside the error range of the target heart rate, It is determined that the target momentum has not been met.

In step S130, the number of obstacles provided to the virtual reality content is set based on a preset criterion according to whether the target momentum determined in step S120 is satisfied. When the target momentum executed in the previous stage is satisfied, the obstacle avoiding content execution unit 3200 increases the number of obstacles in the next stage. In addition, when the target momentum executed in the previous stage is not satisfied, the number of obstacles in the next stage is reduced. Determine whether the user's exercise amount is appropriate according to the user's content execution result, increase the number of obstacles if it is determined that the target exercise amount is insufficient according to the preset criteria of the target heart rate, and if it is determined that the target exercise amount is exceeded, the obstacle The number of can be reduced.

In this way, the obstacle avoidance content execution unit 3200 determines a target exercise amount according to the user's target heart rate based on the user's heart rate, and provides feedback by adjusting the number of obstacles according to the user's individual content execution result. You can exert the effect you can.

6 and 7 schematically illustrate a motion of a user reaching a target point while avoiding an obstacle in an experience space of a virtual reality system according to an embodiment of the present invention.

After the virtual reality content is executed, the user can experience the virtual reality to reach the target point while avoiding obstacles. In the present invention, avoiding obstacles that can be experienced in a virtual space The virtual reality content can display a target point and an obstacle that obstructs the user's walking on the screen displayed through the HMD module 2000 worn by the user in the virtual experience space. And, based on the user's input, the object is generated or the displayed obstacle is removed. The user may avoid the obstacle displayed on the HMD module 2000 by jumping through the object to avoid a given obstacle or destroy the obstacle in order to reach the target point. The user's coordinates in the virtual reality space are composed of three-dimensional coordinates in the X, Y, and Z-axis directions, and the obstacle avoidance content execution unit 3200 is generated by the user by changing the user's coordinates based on the user's input. It can be positioned on the top surface of the object. When the object is generated or a given obstacle is destroyed according to a user's input while the user is performing obstacle avoidance, the score for the execution result may be changed.

As shown in FIG. 6, in the virtual reality content provided by the obstacle avoiding content execution unit 3200, a target point to be reached by the user, such as A or B, is set, and the user avoids the obstacle given in front of his or her eyes. You can reach targets such as A or B. In an embodiment of the present invention, as shown in (a) of FIG. 7, a user may create an object to avoid an obstacle of a degree lower than his or her height. Using the object, the user in the virtual reality space can be positioned on the upper surface of the object through jump input, and the obstacle avoidance content execution unit 3200 inputs the user's coordinates by the user (jumping in Fig. 7(a)) According to this, at least one of the X, Y and Z axis directions is changed so that it can be positioned on the upper surface of the object created by the user.

Meanwhile, in an embodiment of the present invention, as shown in FIG. 7B, the user can destroy the obstacle and remove it from the virtual reality content in order to reach the target point. The user can destroy an obstacle given in virtual reality through an input to destroy the obstacle, and the obstacle avoidance content execution unit 3200 is displayed on the screen provided by the HMD module 2000 based on the user's input. Remove obstacles. In addition, the obstacles provided by the obstacle avoidance content execution unit 3200 are divided into destructible and indestructible obstacles based on a user's input, and even when an input to destroy the obstacle is received from the user, the HMD module The indestructible message can be displayed through the HMD module 2000 without removing the obstacle displayed on the screen provided in (2000).

In this way, the obstacle avoiding content execution unit 3200 creates an object based on a user's input and moves the user's coordinates in three dimensions or provides virtual reality content in which a given obstacle is removed, and the user is set. When reaching the target point, a score for the performance result may be derived based on content usage information including the number of times the user creates objects, the number of times of destroying obstacles, and the time to reach the target point.

8 schematically illustrates a screen displayed by the HMD module 2000 provided by the obstacle avoiding content execution unit 3200 according to an embodiment of the present invention.

Specifically, FIG. 8 shows a screen displayed on the HMD module 2000 worn by the user by the obstacle avoidance content execution unit 3200. 8A shows a screen provided after a user starts executing an obstacle avoiding virtual reality content. After executing the content, the user checks his current position and target point in virtual reality through the map image shown in the upper right corner as shown in Fig. 8(a), and avoids the obstacles provided in the corresponding stage. You reach the point. Thereafter, the user may face an obstacle as shown in (b) of FIG. 8. The user must avoid obstacles faced to reach the memorized target point through the image provided at the beginning of the content, and can create an object to avoid the obstacle. The user can avoid obstacles by inputting motions on virtual reality content such as jumps on the created object.

On the other hand, the obstacle avoiding content execution unit 3200, after executing the obstacle avoiding virtual reality content, changes one or more of a preset user's movement speed and object creation speed on the virtual reality content based on the user's brainwave and heartbeat. Performs the ability control step (S3000). Specifically, in the ability control step (S3000), when the concentration level derived based on the brain waves is maintained for a preset time, based on the user's preset movement speed reaching the target point and the user's input. One or more of the generation speeds for the created object is increased. Thereafter, as the user experiences virtual reality, the sensor unit 1000 measures the user's EEG and heartbeat continuously measured in real time, and the obstacle avoidance content execution unit 3200 based on the measured EEG and heartbeat moves, Speed and object creation speed can be adjusted.

For example, assuming that the preset standard concentration value is 5 or more, and the preset time standard is 10 seconds or more, the concentration derived based on the user's EEG after the execution of the obstacle avoidance content is started is 5 or more. When maintained for 10 seconds, the obstacle avoiding content execution unit 3200 may increase the moving speed of the user. In addition, it is possible to increase the creation speed of objects created by users. In addition, in the ability control step (S3000), based on the concentration derived based on the brain wave and the deviation of the heartbeat, the concentration increases as the time for maintaining a preset reference increases, and the deviation of the heartbeat is small. The moving speed may be determined based on an equation for calculating the moving speed that increases as it increases. The formula for calculating the movement speed is shown below.

[Moving speed calculation formula]

Movement speed = k* (time maintaining the concentration of the preset standard / deviation of heart rate)

In the above movement speed calculation formula, k means a movement speed coefficient. Alternatively, in another embodiment of the present invention, the movement speed of the user in the virtual reality may be derived by the movement speed calculation formula of movement speed = k* (concentration/heart rate deviation). Accordingly, in the process of reaching the target point on the virtual reality content, even if the user inputs the same motion to avoid obstacles, the user can reach the coordinates closer to the target point for the same time period. By focusing on the user to reach the target point of the stage more quickly, the effect of improving the immersion of virtual reality content can be exerted.

On the other hand, in the ability control step (S3000) performed by the obstacle avoiding content execution unit 3200, depending on whether the deviation of the heart rate for a preset time and the concentration derived based on the brain wave meet a preset criterion. A map image representing a virtual reality space is displayed by overlapping the screen on which the virtual reality content is displayed. When the user's concentration and the deviation of the heart rate meet a preset criterion, the obstacle avoiding content execution unit 3200 displays the map image as shown in FIG. 8A again. Avoiding Obstacles The user was provided only at the beginning of execution of virtual reality content, and had to remember the target point and obstacles in the virtual reality, but the user's concentration and heart rate deviations were reduced by focusing on performing the content and finding physical stability. When meeting a preset criterion, the obstacle avoidance content execution unit 3200 provides the map image to the user again, and the user can obtain information on the target point and obstacle through the map image, and refer to this It can be done easily to avoid. On the map image, a target point, an obstacle, and a graphic element indicating coordinates of the user may be displayed.

In this way, the obstacle avoiding content execution unit 3200 determines the user's state through biometric information such as brain waves and heartbeat of the virtual reality system user, and adjusts the difficulty of the content by providing appropriate feedback to the current user state. By doing so, it is possible to exert an effect of providing user-customized virtual reality content.

9 exemplarily shows an internal configuration of a computing device that executes a method of implementing a virtual reality system for stabilizing emotions of a user according to an embodiment of the present invention.

The virtual reality providing method implemented by the virtual reality system for stabilizing user's emotion according to the above embodiment may be implemented by the computing device 11000 shown in FIG. 9. The VR system unit 3000 of FIG. 1 may include components of the computing device 11000 shown in FIG. 9.

9, the computing device 11000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, and an input/output subsystem ( I/Osubsystem) 11400, a power circuit 11500, and a communication circuit 11600 may be included at least. In this case, the computing device 11000 includes the sensor unit 1000, the VR system unit 3000, and the HMD module 2000, or the sensor unit 1000, by the input/output subsystem 11400, It may be connected to the VR system unit 3000 and the HMD module 2000.

The memory 11200 may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or nonvolatile memory. have. The memory 11200 may include a software module, an instruction set, or other various data necessary for the operation of the computing device 11000.

In this case, accessing the memory 11200 from another component such as the processor 11100 or the peripheral device interface 11300 may be controlled by the processor 11100.

The peripheral device interface 11300 may couple input and/or output peripheral devices of the computing device 11000 to the processor 11100 and the memory 11200. The processor 11100 may execute various functions for the computing device 11000 and process data by executing a software module or instruction set stored in the memory 11200.

The input/output subsystem 11400 may couple various input/output peripherals to the peripherals interface 11300. For example, the input/output subsystem 11400 may include a controller 1300 for coupling peripheral devices such as a monitor, a keyboard, a mouse, a printer, or a touch screen or a sensor to the peripheral device interface 11300 as needed. I can. According to another aspect, the input/output peripheral devices may be coupled to the peripheral device interface 11300 without going through the input/output subsystem 11400.

The power circuit 11500 may supply power to all or part of the components of the terminal. For example, the power circuit 11500 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator or power. It may contain any other components for creation, management, and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, the communication circuit 11600 may enable communication with other computing devices by transmitting and receiving an RF signal, also known as an electromagnetic signal, including an RF circuit, if necessary.

The embodiment of FIG. 9 is only an example of the computing device 11000, and the computing device 11000 omits some of the components shown in FIG. 9, further includes additional components not shown in FIG. 9, or 2 It can have a configuration or arrangement that combines two or more components. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. 9, and various communication methods (WiFi, 3G, LTE) in the communication circuit 1160 , Bluetooth, NFC, Zigbee, etc.) may include a circuit for RF communication. Components that can be included in the computing device 11000 may be implemented as hardware, software, or a combination of hardware and software including one or more signal processing or application-specific integrated circuits.

Methods according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded in a computer-readable medium. In particular, the program according to the present embodiment may be configured as a PC-based program or an application dedicated to a mobile terminal. An application to which the present invention is applied may be installed on a user terminal through a file provided by the file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file according to the request of the user terminal.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, such as one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to operate as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description by those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

Claims (7)

As an active feedback virtual reality system for brain health and physical health through user activity,
The virtual reality system includes: a sensor unit including an EEG measurement module attached to a user's head to measure a user's EEG and a heart rate measurement module attached to a user's finger to measure a user's heart rate; A VR system unit that executes virtual reality content for the user to perform obstacle avoidance and derives an evaluation of the user's obstacle avoidance performance result; And an HMD module for receiving image and sound information of virtual reality content executed from the VR system unit and providing it to a user,
The VR system unit,
A sensing information collection unit for receiving the brain wave and the heartbeat from the sensor unit;
Obstacle avoiding content that adjusts the difficulty of the virtual reality content by applying the brainwave and the heartbeat of the user wearing the HMD module in real time, avoids obstacles by creating an object, and executes the virtual reality content reaching a target point Including;
The obstacle avoiding content execution unit,
A setting step of setting the number of obstacles;
An execution step of executing content capable of experiencing virtual reality reaching a target point by performing obstacle avoidance;
An ability adjusting step of varying at least one of a movement speed of a user and an object creation speed set in a virtual reality content based on the brain wave and the heart rate;
Performing a termination step of terminating the execution of the content according to a user's input or a predetermined criterion, and
The step of setting the number of obstacles,
Receiving a user's input for user information including height, weight, and age, and deriving a target heart rate based on the user information and the heart rate;
Deriving an average heart rate based on the measured heart rate for a preset period while the user has performed virtual reality content for performing the obstacle avoidance in the past;
Determining whether a user's target exercise amount is satisfied based on the target heart rate and the average heart rate; And
Including, the step of setting the number of obstacles provided to the virtual reality content based on a predetermined criterion according to whether the target momentum is satisfied,
The target heart rate is,
It is derived based on the exercise target intensity derived based on the extra heart rate derived based on the heart rate and the age and the BMI value according to the height and the body weight,
The ability control step,
When the concentration degree derived based on the brain wave maintains a preset reference for a preset time, the preset movement speed of the user reaching the target point is increased,
Based on the concentration derived based on the EEG and the deviation of the heartbeat, the concentration increases as the time for maintaining a preset reference increases, and the movement speed calculation formula increases as the deviation of the heartbeat decreases. The moving speed is determined,
Displaying a map image representing a virtual reality space by overlapping the screen on which the virtual reality content is displayed according to whether the deviation of the heart rate for a preset time and the concentration derived based on the brain wave meet a preset criterion, Virtual reality system.
The method according to claim 1,
The obstacle avoiding content execution unit,
Display obstacles obstructing the user's walking on the execution screen of virtual reality content,
Creates the object based on the user's input or removes the displayed obstacle,
The user's coordinates in the virtual reality space are composed of three-dimensional coordinates in the X, Y and Z axis directions,
Based on the user's input, the user's coordinates are changed so that the user can position it on the upper surface of the created object,
A virtual reality system for changing a score for a performance result when the object is created or a given obstacle is destroyed according to a user's input.
delete delete delete delete As an implementation method of an active feedback virtual reality system for brain health and physical health through user activity,
The implementation method includes a sensor step including an EEG measurement step attached to the user's head to measure a user's EEG, and a heart rate measurement step attached to the user's finger to measure the user's heart rate; A VR system step of executing virtual reality content in which a user can perform obstacle avoidance, and derives an evaluation of the user's obstacle avoidance performance result; And an HMD module step of receiving, through an HMD module, image and sound information of virtual reality content executed in the VR system step, and providing it to a user.
The VR system step,
A sensing information collection step of receiving the brain wave and the heartbeat from the sensor step;
Obstacle avoiding content that adjusts the difficulty of the virtual reality content by applying the brainwave and the heartbeat of the user wearing the HMD module in real time, avoids obstacles by creating an object, and executes the virtual reality content reaching a target point Including;
The obstacle avoiding content execution step,
A setting step of setting the number of obstacles;
An execution step of executing content capable of experiencing virtual reality reaching a target point by performing obstacle avoidance;
An ability adjusting step of varying at least one of a movement speed of a user and an object creation speed set in a virtual reality content based on the brain wave and the heart rate;
Including; a termination step of terminating the execution of the content according to a user input or a predetermined criterion,
The step of setting the number of obstacles,
Receiving a user's input for user information including height, weight, and age, and deriving a target heart rate based on the user information and the heart rate;
Deriving an average heart rate based on the measured heart rate during a preset period while the user has performed virtual reality content for performing the obstacle avoidance in the past;
Determining whether a user's target exercise amount is satisfied based on the target heart rate and the average heart rate; And
Including, the step of setting the number of obstacles provided to the virtual reality content based on a predetermined criterion according to whether the target momentum is satisfied,
The target heart rate is,
It is derived based on the exercise target intensity derived based on the extra heart rate derived based on the heart rate and the age and the BMI value according to the height and the body weight,
The ability control step,
When the concentration degree derived based on the brain wave maintains a preset reference for a preset time, the preset movement speed of the user reaching the target point is increased,
Based on the concentration derived based on the brain waves and a movement speed calculation formula that increases as the time for maintaining the preset reference level increases, and increases as the deviation of the heart rate decreases, based on the deviation of the heart rate and the concentration derived based on the brain wave; The moving speed is determined,
Displaying a map image representing a virtual reality space by overlapping the screen on which the virtual reality content is displayed according to whether the deviation of the heart rate for a preset time and the concentration derived based on the brain wave meet a preset criterion, How to implement a virtual reality system.

Images