KR102151492B1 - Immersive feedback virtual reality system and method for brain health through user's concentration. - Google Patents

Abstract

The present invention relates to an immersive feedback virtual reality system for brain health through user′s concentration and an implementation method thereof, and more specifically, to an immersive feedback virtual reality system for brain health through user′s concentration, which adjusts the difficulty of virtual reality content by applying biometric information measured from a user in real time, and allows users to find treasure by outputting a sound that indicates the position of the hidden treasure, and an implementation method thereof.

Description

Immersive feedback virtual reality system and method for brain health through user's concentration.}

The present invention relates to an immersive feedback virtual reality system and implementation method for brain health through the user's concentration, and more particularly, to adjust the difficulty of virtual reality content by applying biometric information measured from the user in real time, and The present invention relates to an immersive feedback virtual reality system and implementation method for brain health through user concentration that outputs a sound indicating the location of a treasure and provides virtual reality content for the user to find the treasure.

Virtual Reality is a technology that achieves interaction between a user and a 3D virtual space created by a computer system, and the user feels immersive through the five senses (sight, hearing, smell, taste, and touch) of the human body in such a virtual space. It is a convergence technology that provides a sense of reality as if you feel and actually exist in that space. In the global virtual reality market, head mount displays dominate, and various types of virtual reality devices are emerging. Currently, the virtual reality market is growing centered on hardware (devices), but as related products spread, the influence of the platform that distributes contents and contents such as applications is expected to increase gradually.

In modern times, there are many cases where virtual reality systems can be experienced simply for the purpose of play and fun, such as VR (Virtual Reality) cafes in the virtual reality market. However, through the virtual reality system, content can be provided not only for the purpose of simply experiencing virtual reality for fun, but also for the treatment of users with mental disorders using virtual reality. Patients suffering from brain diseases such as dementia, ADHD, and depression are prone to lethargy. Virtual reality technology is not limited by space and time with only a simple device, and because virtual reality experience is possible anytime, anywhere, through this, it is possible to improve the user's motor function and helplessness according to the movement of the body. In addition, by providing various contents that can be calculated, memorized, and concentrated, it is possible to expect the effect of improving the memory and concentration of virtual reality system users using the brain, and biometric information such as brain waves and heartbeat of users experiencing virtual reality contents. By measuring in real time, the user's concentration and physical condition can be analyzed.

Therefore, by using such a virtual reality system, a study aimed at improving brain diseases such as depression by providing an environment in which users can concentrate and an activity target that can move their body through contents that may be of interest to the user has been conducted. .

The present invention relates to an immersive feedback virtual reality system and implementation method for brain health through the user's concentration, and more particularly, to adjust the difficulty of virtual reality content by applying biometric information measured from the user in real time, and An object of the present invention is to provide an immersive feedback virtual reality system and implementation method for brain health through the user's concentration, which outputs a sound indicating the location of a treasure and provides virtual reality content for the user to find the treasure.

In order to solve the above problems, the present invention is an immersive feedback virtual reality system for brain health through user's concentration, wherein the virtual reality system is attached to the user's head to measure the user's brain waves. A sensor unit including an EEG measurement module and a heart rate measurement module attached to a user's finger to measure a user's heart rate; A VR system unit that executes virtual reality contents in which a user can perform a treasure hunt and evaluates a result of the user's treasure hunt; And an HMD module for receiving image and sound information of virtual reality content executed from the VR system unit and providing it to a user, wherein the VR system unit collects sensing information for receiving the brain wave and the heartbeat from the sensor unit. part; A virtual reality content capable of performing a treasure hunt for adjusting the difficulty of the virtual reality content by applying the brainwave and the heartbeat of the user wearing the HMD module in real time, and outputting a sound based on the coordinates of the hidden treasure. It provides a virtual reality system including;

In an embodiment of the present invention, the treasure hunt content execution unit may differently output the loudness of the sound according to a preset reference based on a distance between the coordinates of the treasure and the coordinates of the user.

In one embodiment of the present invention, the treasure hunt content execution unit, setting the number of treasures; Executing content for experiencing virtual reality performing a treasure hunt; Providing a hint for a treasure hunt based on the brain wave and the heartbeat; And terminating execution of the content according to a user's input or a predetermined criterion.

In one embodiment of the present invention, the setting of the number of treasures includes receiving a user's input for user information including height, weight, and age, and derives a target heart rate based on the user information and the heart rate. Step to do; Deriving an average heart rate based on the measured heart rate during a preset section while the user has performed virtual reality content for performing the treasure hunt in the past; Determining whether a user's target exercise amount is satisfied based on the target heart rate and the average heart rate; And setting the number of treasures provided in the virtual reality content based on a predetermined criterion according to whether the target momentum is satisfied.

In an embodiment of the present invention, the providing of the hint includes, when the concentration degree derived based on the EEG is maintained for a preset time, while the virtual reality content is being performed in the HMD module, A direction object indicating the coordinates of the hidden treasure may be displayed by overlapping the screen on which the virtual reality content is displayed.

In an exemplary embodiment of the present invention, in the providing of the hint, the time at which the direction object is displayed may be changed according to whether the deviation of the heartbeat meets a preset criterion during a preset time.

In order to solve the above problems, an embodiment of the present invention is a method of implementing an immersive feedback virtual reality system for brain health through concentration of a user, wherein the implementation method is provided on the user's head. A sensor step including an EEG measurement step of being attached to measure a user's EEG and a heart rate measurement step of being attached to a user's finger to measure a user's heart rate; A VR system step of executing virtual reality contents in which a user can perform a treasure hunt and evaluating a result of the user's treasure hunt; And an HMD module step of receiving the image and sound information of the virtual reality content executed in the VR system step and providing it to the user through the HMD module, wherein the VR system step includes the brain waves and the brain waves from the sensor step. Sensing information collection step of receiving a heartbeat; A virtual reality content capable of performing a treasure hunt for adjusting the difficulty of the virtual reality content by applying the brainwave and the heartbeat of the user wearing the HMD module in real time, and outputting a sound based on the coordinates of the hidden treasure. It provides a method of implementing a virtual reality system including; executing the treasure hunt content execution step.

According to an embodiment of the present invention, by providing virtual reality content for performing a treasure hunt, it is possible to exert an effect of improving brain health by increasing memory and concentration of a virtual reality system user.

According to an embodiment of the present invention, by providing a virtual reality content for performing a treasure hunt to provide an environment in which a user can think directly, a more effective treatment by activating the brain by using the brain of a user with a mental disorder. It can exert the effect that can provide.

According to an embodiment of the present invention, by determining the user's state through biometric information such as brain waves and heartbeat of the virtual reality system user, and adjusting the difficulty of the content by providing appropriate feedback to the current user state, It can exert the effect of providing real content.

According to an embodiment of the present invention, while a treasure hunt is performed, a concentration level is derived based on a user's brain waves, and a hint related to a treasure hunt according to the concentration level is provided, thereby improving user's immersion.

According to an embodiment of the present invention, while performing a treasure hunt, the user's immersion is improved by adjusting the difficulty level by varying the time to display the direction object in the virtual reality content according to the stability of the body based on the user's heartbeat. Can exert.

According to an embodiment of the present invention, evaluation information using virtual reality content for performing a treasure hunt and biometric information during use may be transmitted to the outside, thereby exerting an effect that can be used as treatment, treatment, and counseling data for a user.

1 schematically shows a user in an experience space of a virtual reality system according to an embodiment of the present invention and modules constituting a sensor unit worn on the user's body.
2 schematically shows the internal configuration of a virtual reality system according to an embodiment of the present invention.
3 schematically shows the internal configuration of a VR system unit according to an embodiment of the present invention.
4 schematically shows a step of performing a treasure hunting content execution unit according to an embodiment of the present invention.
5 schematically illustrates a step of setting the number of treasures performed by a treasure hunting content execution unit according to an embodiment of the present invention.
6 schematically illustrates an operation of a user performing a treasure hunt according to an embodiment of the present invention.
7 schematically shows a screen displayed in an HMD module provided by a treasure hunt content execution unit according to an embodiment of the present invention.
8 schematically shows a screen displayed by an HMD module provided by a treasure hunt content execution unit according to an embodiment of the present invention.
9 schematically illustrates an internal configuration of a computing device according to an embodiment of the present invention.

In the following, various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, a number of specific details are disclosed to aid in an overall understanding of one or more aspects. However, it will also be appreciated by those of ordinary skill in the art that this aspect(s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of one or more aspects. However, these aspects are exemplary and some of the various methods in the principles of the various aspects may be used, and the descriptions described are intended to include all such aspects and their equivalents.

Further, various aspects and features will be presented by a system that may include multiple devices, components and/or modules, and the like. It is also noted that various systems may include additional devices, components and/or modules, and/or may not include all of the devices, components, modules, etc. discussed in connection with the figures. It must be understood and recognized.

As used herein, “an embodiment,” “example,” “aspect,” “example,” and the like may not be construed as having any aspect or design described as being better or advantageous than other aspects or designs. . The terms'~part','component','module','system', and'interface' used below generally mean a computer-related entity, for example, hardware, hardware It can mean a combination of software and software, or software.

In addition, the terms "comprising" and/or "comprising" mean that the corresponding feature and/or element is present, but excludes the presence or addition of one or more other features, elements, and/or groups thereof. It should be understood as not.

In addition, terms including ordinal numbers such as first and second may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The term and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein including technical or scientific terms are commonly understood by those of ordinary skill in the art to which the present invention belongs. It has the same meaning as. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the embodiments of the present invention, an ideal or excessively formal meaning Is not interpreted as.

1 schematically shows a user in an experience space of a virtual reality system according to an embodiment of the present invention and modules constituting a sensor unit worn on the user's body.

The virtual reality system of the present invention includes a sensor unit 1000, a controller 1300, a VR system unit 3000, and an HMD module 2000, and a user performs a treasure hunt provided through a virtual reality system. You can experience the content. In addition, it is possible to obtain the effect of improving concentration and memory through experience in a virtual space. As shown in FIG. 1, a user experiencing virtual reality through a virtual reality system may attach an EEG measurement module 1100 and a heart rate measurement module 1200 to his/her body, including a motion sensor module 1310 By holding the controller 1300 to perform virtual reality content experience, the user can input (for example, a button) as needed, and the motion of the user can be measured by the motion sensor module 1310 included in the controller 1300. I can.

The user's input and operation received through the controller 1300 are transmitted to the VR system unit 3000 and reflected in virtual reality content. As shown in FIG. 1, the user may recognize the movement of the HMD module 2000 and the controller 1300 according to the user's motion in the space where the base station 10 is installed to set the area of the virtual reality experience space.

The virtual reality content of the present invention provided in the environment as shown in FIG. 1 is a user with mental disorders such as post-traumatic stress disorder (PTSD), panic disorder, mild cognitive disorder, and attention deficit hyperactivity disorder (ADHD). By finding hidden objects through experiences in a virtual space where you can perform a treasure hunt, you can get the effect of improving concentration and memory by providing an opportunity to concentrate, and for the purpose of activating the body to find objects. May be provided.

Mental disorders in the present invention are not limited to the types of mental disorders described above, such as post-traumatic stress disorder (PTSD), and are provided through a virtual reality system that can perform treasure hunts ranging from minor mental disorders to severe mental disorders. It can include all kinds of mental disorders that can obtain therapeutic effects through experiences in virtual spaces.

Hereinafter, the configuration of the virtual reality system will be described in more detail.

2 schematically shows the internal configuration of a virtual reality system according to an embodiment of the present invention.

The present invention provides an immersive feedback virtual reality system for brain health through the user's concentration, an EEG measurement module 1100 that is attached to the user's head to measure the user's EEG, and the user's finger A sensor unit 1000 including a heart rate measurement module 1200 for measuring the heart rate of the patient; A controller 1300 including a motion sensor module 1310 capable of receiving a user's input and measuring a motion; And a VR system unit 3000 that executes virtual reality contents in which a user can perform a treasure hunt, and derives an evaluation of a result of performing a treasure hunt by the user. It includes an HMD module 2000 that provides video and sound information of real content to a user.

According to an embodiment of the present invention, as shown in FIG. 2, the VR system unit 3000 may be included in the HMD module 2000.

The EEG measurement module 1100 senses and measures EEG waves including delta waves, theta waves, alpha waves, beta waves, and gamma waves. The data on the brain waves can be transmitted in an open sound control format without passing through a specific storage medium, and can be transmitted to a computer through wireless communication including Bluetooth communication with other devices. Brain waves of different frequency bands have different characteristics, and based on this, the mental activity state of the user can be determined.

The heart rate measurement module 1200 may be attached to the user's finger to measure the user's heart rate. Information related to the heart rate, such as heart rate, pulse wave shape, heart rate per minute, heart rate sound presence, heart rate display, and heart rate interval display blood flow index, may be displayed on the heart rate measurement module 1200.

The user wears modules that measure the user's heart rate and brain waves and experiences virtual reality content, thereby providing virtual reality content whose difficulty is adjusted according to their mental and physical state based on biometric information such as their heart rate and brain waves. I can receive it.

Meanwhile, the virtual reality system includes a controller 1300 for manipulating virtual reality content that performs a treasure hunt. As shown in FIG. 1, by holding the controller 1300 in both hands and moving, the user can input operations and controls in virtual reality content and use VR content. The controller 1300 includes a motion sensor module 1310 capable of detecting movement, thereby detecting the movement of the user's hand, and including input tools such as buttons, dials, and touch sensors that the user can manipulate. Allows various inputs.

The VR system unit 3000 may execute virtual reality contents in which a user performs a treasure hunt based on information input from the sensor unit 1000, and evaluates the execution result of the virtual reality contents performing a treasure hunt. You can do it.

The HMD module 2000 is worn on the user's head, provides image and sound information of virtual reality content to the user, and allows the user to experience virtual reality.

In order to experience virtual reality performing a treasure hunt, the user wears the HMD module 2000 in a manner of wearing glasses, and is provided by receiving image and sound information of virtual reality contents through the HMD module 2000 It is possible to obtain a high level of experience, such as actually experiencing virtual reality content that performs a treasure hunt.

3 schematically shows the internal configuration of the VR system unit 3000 according to an embodiment of the present invention.

According to an embodiment of the present invention, the VR system unit 3000 that executes virtual reality content in which a user can perform a treasure hunt and evaluates a result of the user’s treasure hunt, is provided from the sensor unit 1000. A sensing information collection unit 3100 for receiving brain waves and heartbeat; And a virtual reality content capable of performing a treasure hunt that outputs sound based on the coordinates of the hidden treasure by adjusting the difficulty of the virtual reality content by applying the brainwave and heartbeat of the user wearing the HMD module 2000 in real time. A treasure hunt content execution unit 3200 to execute; And DB 3300.

Specifically, the sensing information collection unit 3100 receives the user's EEG and heartbeat measured from the sensor unit 1000 of the virtual reality system. The received brain wave and heartbeat of the user are then transmitted to the treasure hunt content execution unit 3200 and used as information that is the basis for providing feedback to the virtual reality content experienced by the user.

Treasure hunt content execution unit 3200, based on the user's brain waves and heartbeat transmitted from the sensing information collection unit 3100, adjusts the difficulty level of the virtual reality content that the user can perform the treasure hunt, and outputs a sound. The coordinates, that is, the location of the treasure provided to the user can be informed. Preferably, the treasure hunt content execution unit 3200 may differently output the loudness of the sound according to a preset reference based on the coordinates of the treasure and the distance between the coordinates of the user.

Meanwhile, in the DB 3300 of the VR system unit 3000, as shown in FIG. 3, user information including the height, weight, and age of the user input and received from the user, and the treasure hunt for the result of the user's treasure hunt. Biometric information including evaluation information and a user's brain wave and heart rate measured by the sensor unit 1000 may be stored. The user information, the treasure hunt evaluation information, and the biometric information are transmitted to a medical staff such as a doctor or counselor for the purpose of treatment and counseling for a user with a mental disorder, so that it can be used as treatment, treatment, and counseling data for the user. Can exert.

The VR system unit 3000 shown in FIG. 3 may further include other elements other than the illustrated elements, but for convenience, a virtual reality providing virtual reality content capable of performing a treasure hunt according to embodiments of the present invention Only the components related to the system are shown.

Hereinafter, a detailed operation of the treasure hunt content execution unit 3200 will be described in more detail.

4 schematically shows the steps of performing the treasure hunt content execution unit 3200 according to an embodiment of the present invention.

According to FIG. 4 of the present invention, the treasure hunt content execution unit 3200 includes: setting the number of treasures (S1000); Executing contents for experiencing virtual reality for performing a treasure hunt (S2000); Providing a hint for a treasure hunt based on the brain wave and the heartbeat (S3000); And terminating the execution of the content according to a user's input or a predetermined criterion (S4000).

In step S1000, the treasure hunt content execution unit 3200 sets the number of treasures to be provided to the virtual reality content for the user to perform the treasure hunt. In an embodiment of the present invention, the number of treasures may be set through user input. Users can randomly experience virtual reality and set the number of treasures to find. Meanwhile, if the user does not arbitrarily input the number of treasures, the number of treasures may be set through the operation of the treasure hunt content execution unit 3200. When a user performs a treasure hunt for the first time, the treasure hunt content execution unit 3200 may set and provide the number of treasures according to a preset criterion based on the user's heartbeat measured by the sensor unit 1000. . For example, when the preset criterion is the number of treasures provided when the heart rate is 150 bpm or more, the number of treasures provided is 5, and when the heart rate is less than 150 bpm, the number of treasures provided is 3, the user who attempts to perform the first stage Assuming that the current heart rate is 123 bpm, the treasure hunt content execution unit 3200 may execute virtual reality content by setting the number of treasures to three. In this way, the number of treasures to be provided to the user executing the first stage may be set according to a preset criterion based on a heartbeat. Thereafter, when the user completes the treasure hunt in the first stage and then performs the next stage of the treasure hunt, the treasure hunt content execution unit 3200 sets the number of treasures through steps S100 to S140 to be described later. I can.

In step S2000, the treasure hunt content execution unit 3200 executes contents capable of experiencing virtual reality in which a treasure hunt is performed according to the set number of treasures. Through this, the user can find the treasure in the virtual reality space where the treasure is hidden, and derive and store the score and performance result accordingly.

In step S3000, a hint for a treasure hunt is provided based on the brain waves and heartbeat collected from the sensor unit 1000. After the virtual reality content is executed, the treasure hunt content execution unit 3200 may adjust the difficulty of the treasure hunt virtual reality content based on the user's brainwave and heartbeat. In an embodiment of the present invention, the degree of concentration during the virtual reality experience of the user may be derived based on the brain waves. The EEG is a gamma wave indicating a state of anxiety or excitement of the user, a beta wave indicating a state of activity, stress, or immersion, an alpha wave indicating a stable state such as meditation or problem solving, the theta wave indicating a state of shallow sleep or drowsiness, and It may include a delta wave indicating a state of deep sleep. The beta wave and theta wave have a characteristic that indicates a value between 0 and 20 DB (3300) in the case of a general normal state of not being concentrated, and decreases to 0 DB (3300) or less when concentrated. As described above, the brain waves of different frequency bands have their respective characteristics, and the degree of concentration can be derived based on this. Based on the degree of concentration derived as described above, a hint may be provided to inform the user of the coordinates of the treasure visually as well as sound of the hidden treasure according to whether the concentration degree meets a preset criterion. In this way, the treasure hunt content execution unit 3200 may provide a hint for the treasure hunt to the user according to the degree of concentration derived based on the brain wave.

In step S4000, the treasure hunt content execution unit 3200 ends the execution of the treasure hunt content according to a user's input or a predetermined criterion. Treasure hunt content according to preset criteria, such as when a user performing a treasure hunt makes an input to end execution of the treasure hunt virtual reality content, or when the user has found all the treasures provided in the content. Can be terminated.

By performing the above steps, the treasure hunt content execution unit 3200 may provide virtual reality contents capable of performing a treasure hunt.

5 schematically shows a step of setting the number of treasures performed by the treasure hunt content execution unit 3200 according to an embodiment of the present invention.

As described above in the description of FIG. 4, the treasure hunt content execution unit 3200 may set the number of treasures to be provided when providing virtual reality contents for performing a treasure hunt to a user. When a user performs a treasure hunt for the first time, the number of treasures may be set according to a preset number based on the brain wave or a user input. For example, when the user performs the first stage of the treasure hunt, a preset number of treasures may be provided based on a concentration derived based on an EEG measured through the current sensor unit 1000.

On the other hand, in the case of executing the treasure hunt virtual reality content previously, and then performing the treasure hunt virtual reality content as the next stage, the step of setting the number of treasures performed by the treasure hunt content execution unit 3200 (S1000) is , Receiving a user input for user information including height, weight, and age, and deriving a target heart rate based on the user information and the heart rate; (S100) a virtual user performing the treasure hunt in the past While performing real content, deriving an average heart rate based on the measured heart rate during a preset period (S110); Determining whether the user's target exercise amount is satisfied based on the target heart rate and the average heart rate (S120); And setting the number of treasures provided to the virtual reality content based on a predetermined criterion according to whether the target momentum is satisfied (S130).

Specifically, in step S100, the treasure hunt content execution unit 3200 receives a user input for user information including height, weight, and age. Thereafter, a target heart rate is derived based on user information including height, weight, and age and the heart rate measured by the sensor unit 1000. Specifically, the treasure hunt content execution unit 3200 derives the maximum heart rate of the user based on the age input and received from the user. The maximum heart rate derivation equation is shown in the following derivation equation 1 (a). Thereafter, the extra heart rate is derived based on the derived maximum heart rate and the stable heart rate indicating the normal heart rate. The surplus heart rate derivation equation is shown in (b) of the derivation equation 1 below. Meanwhile, the treasure hunt content execution unit 3200 derives a BMI value based on the height and weight received input from the user, and derives an exercise target intensity based on the BMI value. The BMI value derivation formula is shown in (c) of the following derivation formula 1. The exercise target intensity derived according to the derived BMI value may be derived according to a preset criterion as shown in an example of Table 1 below. Thereafter, the treasure hunt content execution unit 3200 derives a target heart rate based on the stable heart rate, the derived spare heart rate, and the exercise target intensity. The target heart rate derivation equation is shown in (d) of the derivation equation 1 below.

[Draw Expression 1]

(a) HR _max (maximum heart rate) = 220-age

(b) HRR (free heart rate) = HR _max (maximum heart rate)-HR _rest (stable heart rate)

(c) BMI = weight (kg) / (height) ² (m)

(d) THR (target heart rate) = (HRR (free heart rate) * exercise target intensity (%)) + HR _rest (stable heart rate)

shame Rating Target intensity of exercise BMI <23 normal 75% 23 <BMI <25 Overweight 70% 25 <BMI <30 obesity 65% 30 <BMI <35 Severe obesity 60% 35 <BMI Super obesity 55%

An example of obtaining the target heart rate of the user of the treasure hunt content execution unit 3200 of the present invention is as follows.

[User information 1]

Height: 170cm, Weight: 55kg, Age: 25

Stable heart rate measured by the heart rate sensor module 63

Applying the preset criteria in Derivation Formula 1 and Table 1,

(a) HR _max (maximum heart rate) = 220-age = 220-25 = 195

(b) HRR (free heart rate) = HR _max (maximum heart rate)-HR _rest (stable heart rate) = 195-63 = 132

(c) BMI = weight (kg) / (height) ² (m) = 55 / (1.7) ² = 19.0311419??< 23

--> According to [Table 1], exercise target intensity = 75%

(d) (HRR (free heart rate) * exercise target intensity (%)) + HR _rest (stable heart rate) =

(132 * (3/4)) + 60 = 159

**User 1's target heart rate: 159 bpm

In this way, the treasure hunt content execution unit 3200 may derive a target heart rate based on user information including height, weight, and age and heart rate.

Thereafter, in step S110, an average heart rate is derived based on the measured heart rate during a preset section while the user has performed virtual reality content for performing a treasure hunt in the past. While the user is performing the treasure hunt virtual reality content in the previous stage, it is calculated by adding the heart rate measured from the sensor unit 1000 for a preset period, that is, the time required to derive the average heart rate. Through the average value divided by time, it is possible to derive the average heart rate during the treasure hunt by the user.

Thereafter, in step S120, it is determined whether or not the user's target exercise amount is satisfied based on the target heart rate and the average heart rate derived in steps S100 and S110. If the user's average heart rate falls within the error range of the target heart rate while experiencing the treasure hunt virtual reality in the previous stage, it is determined that the target momentum is satisfied, and the user's average heart rate falls outside the error range of the target heart rate, It is determined that the target momentum has not been met.

In step S130, the number of treasures provided to the virtual reality content is set based on a preset criterion according to whether the target momentum determined in step S120 is satisfied. When the target momentum executed in the previous stage is satisfied, the treasure hunt content execution unit 3200 increases the number of treasures in the next stage. Also, if the target momentum executed in the previous stage is not satisfied, the number of treasures in the next stage is reduced. Determine whether the user's exercise amount is appropriate according to the user's content execution result, increase the number of treasures if it is determined that the target exercise amount is insufficient according to the preset criteria of the target heart rate, and if it is determined that the target exercise amount is exceeded, treasure The number of can be reduced.

In this way, the treasure hunt content execution unit 3200 determines a target exercise amount according to the user's target heart rate based on the user's heart rate, and provides feedback by adjusting the number of treasures according to the user's individual content execution result. You can exert the effect you can.

6 schematically illustrates an operation of a user performing a treasure hunt according to an embodiment of the present invention.

In an embodiment of the present invention, after the virtual reality content for performing a treasure hunt is executed, a treasure may be found. In the present invention, the treasure hunt virtual reality content that can be experienced in a virtual space is based on the location of the treasure without displaying the shape of the treasure on the screen shown through the HMD module 2000 worn by the user in the virtual experience space. Thus, the sound can be output. As shown in FIG. 6, a user performing a treasure hunt may perform a treasure hunt based on the output of a different sound level according to a preset standard based on the coordinates of the treasure that are not visually visible and the distance between the coordinates of the user. I can. When the distance between the user's coordinates and the treasure's coordinates becomes close, a louder sound is output than before the distance gets closer, and when the distance between the user's coordinates and the treasure's coordinates becomes farther, the sound may be output less than before the distance increases. . The user can predict the location of the treasure and perform a treasure hunt based on the sound output according to the location of the treasure, rather than finding a treasure that can be visually confirmed by being displayed on the virtual reality content screen. Preferably, the treasure hunt content execution unit 3200 provides a virtual reality content for performing a treasure hunt to a user by outputting different loudness of the sound according to a preset criterion based on the coordinates of the treasure and the distance between the coordinates of the user. can do.

The treasure hunt content execution unit 3200 of the present invention, in executing virtual reality contents capable of performing a treasure hunt, the volume of sound according to a preset standard based on the coordinates of the provided treasure and the distance between the coordinates of the user Can be printed differently. The virtual reality content for performing a treasure hunt provided to a user may provide content in a form capable of grasping the location of the treasure based on sound without visually displaying the treasure when providing the treasure to the user. . For example, when the user executes the content, a sound of decibels is output based on a distance between the coordinates of the treasure hiding the treasure and the user's current coordinates. The user can determine the location of the treasure based on the sound output as described above, and move in a direction in which the treasure is considered to exist. Thereafter, when the coordinates of the user are changed through movement in the virtual reality space, the volume of the output sound is output differently as the distance between the coordinates of the hidden treasure and the coordinates of the user is changed. When the user is closer to the treasure, the sound is output louder than the previously output sound, the user determines that there is a treasure at a specific point, and makes an input to acquire the treasure through the controller 1300 In the case where the corresponding location is the location of the actual hidden treasure, it is recognized that the user has acquired the treasure and the score is counted. If there is no treasure at the corresponding location, the score is decreased.

In this way, the treasure hunt content execution unit 3200 outputs a louder sound as the distance between the coordinates of the treasure and the coordinates of the user becomes closer, and outputs a smaller sound as the distance between the coordinates of the treasure and the user's coordinates increases. I can. Through this, a user who experiences virtual reality performing a treasure hunt can exert an effect of improving concentration and immersion by focusing to determine the location of a hidden treasure in the process of finding a treasure depending on sound.

7 schematically shows a screen displayed by the HMD module 2000 provided by the treasure hunt content execution unit 3200 according to an embodiment of the present invention.

Specifically, FIG. 7 shows a virtual reality content screen from a user's perspective displayed and provided by the HMD module 2000 by the treasure hunt content execution unit 3200. 7A shows a screen displayed by the HMD module 2000 after the user starts executing the treasure hunt virtual reality content. As shown in (a) of FIG. 7, the user finds a treasure that is provided in a form that is not displayed on the virtual reality content execution screen and is not visually visible depending on the output sound. While searching for a treasure, virtual reality content usage information including a score according to the treasure hunt, a user's content usage time, and a user's real-time heartbeat measured by the sensor unit 1000 may be displayed together. 7B shows a screen showing a hidden treasure. Although the treasure is visually invisible on the screen shown to the user experiencing the actual virtual space (shown as a dotted line), the sound according to a preset standard based on the distance between the coordinates of the treasure and the coordinates of the user shown in Fig. 7(b) Is output and the user can determine that the treasure exists in the corresponding location depending on the sound. When the coordinates determined that there is a treasure are reached, the user can input to acquire the treasure through the controller 1300, and the treasure hunt content execution unit 3200 determines the acquisition of the treasure by receiving the user's input, and You can derive a score according to it. When the actual treasure is hidden in the coordinates of the virtual space where the user determines that there is a treasure, the score may be increased, and when there is no treasure in the coordinates of the virtual space where the user determines that the treasure is present, the score may be decreased. FIG. 7C shows a screen of virtual reality content provided through the HMD module 2000 when a user obtains a treasure through an input to obtain a treasure at a location where the user determines that there is a treasure. When a treasure is acquired according to a user's input, the treasure hunt content execution unit 3200 displays a treasure that has not been displayed on the screen provided to the user, appears and disappears, so that the user can recognize that the treasure has been found. Display. In addition, according to the acquisition of the treasure, the content usage information including the score according to the treasure hunt displayed on the screen is changed and displayed. In this way, the user performs a treasure hunt, and when the user finds and acquires all the treasures as many as the number of treasures provided in the corresponding stage, or when the user makes an input to stop the treasure hunt, the treasure hunt virtual reality content will end. I can.

8 schematically shows a display screen in the HMD module 2000 provided by the treasure hunt content execution unit 3200 according to an embodiment of the present invention.

Specifically, FIG. 8A shows a screen of virtual reality content from a user's perspective displayed and provided by the HMD module 2000 by the treasure hunt content execution unit 3200.

8(a) shows the treasure in FIG. 8(a) for easier understanding, but the shape of the treasure is not displayed to the user experiencing the actual virtual reality content, and the distance between the coordinates of the treasure and the user's coordinates You can find the treasure based on the sound output. On the other hand, the treasure hunt content execution unit 3200 may perform a step of providing a hint for a treasure hunt based on the user's brain waves and heartbeat measured in real time from the sensor unit 1000 after executing the virtual reality content. have. Preferably, the providing of the hint includes the coordinates of the hidden treasure while the virtual reality content is being performed in the HMD module 2000 when the concentration level derived based on the brain wave is maintained for a preset time. A directional object displaying a may be displayed by overlapping a screen on which virtual reality content is displayed. The treasure hunt content execution unit 3200 may derive a degree of concentration in real time based on the user's brain waves measured from the sensor unit 1000. Thereafter, when the derived concentration level maintains a preset criterion for a preset time, a hint about the treasure hunt may be provided to the user.

For example, if the concentration value of the preset criterion is 5 or more, and the preset time criterion for providing hints is 10 seconds, the concentration derived based on the user's EEG is maintained for 10 seconds. , The treasure hunt content execution unit 3200 may display a direction object indicating the location of the hidden treasure, as shown in FIG. 8B.

Meanwhile, the virtual reality content of the present invention may sequentially execute staged stages several times. The user can complete the execution of stages that are provided sequentially step by step. Preferably, the preset time in the step of providing the hint is longer than the first preset time in the previous step of the virtual reality content in the next step of the virtual reality content. When the user completes the stage of the treasure hunt content and executes the next stage, in order to be provided with a screen on which the direction object is displayed, a hint is provided by maintaining the concentration level for a longer time than the previous stage at the stage at the current stage. I can receive it. The preset time is longer than a preset first time for maintaining the concentration of the preset reference in the previous step than a preset second time for maintaining the concentration of the preset reference in the next step.

In addition, the treasure hunt content execution unit 3200, as shown in Figure 8 (b), when displaying the direction object on the HMD module 2000 worn by the user, measured by the sensor unit 1000 The time at which the direction object is displayed may be varied according to whether or not the deviation of the heart rate meets the preset criterion during a preset time based on the heart rate. For example, if a direction object is displayed on the virtual reality content screen based on the user's concentration, the user's mental state, which is the degree of concentration alone, is not used to determine the stable state, but also the physical stability state to display the direction object. I can. The user can perform the treasure hunt by receiving hints by concentrating on content execution and taking physical stability while performing the stages of the treasure hunt provided sequentially.

In this way, the treasure hunt content execution unit 3200 improves the user's immersion, memory and concentration by providing the difficulty level of the treasure hunt content suitable for the user's condition based on the brain waves and heartbeat measured by the user. Can be demonstrated.

9 schematically illustrates an internal configuration of a computing device according to an embodiment of the present invention.

The implementation method of the virtual reality system according to the above embodiment may be implemented by the computing device 11000 shown in FIG. 9. The VR system unit 3000 of FIG. 1 may include components of the computing device 11000 illustrated in FIG. 9.

9, the computing device 11000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, and an input/output subsystem (I). /Osubsystem) 11400, a power circuit 11500, and a communication circuit 11600 may be included at least. In this case, the computing device 11000 includes the sensor unit 1000, the VR system unit 3000, and the HMD module 2000, or the sensor unit 1000, by the input/output subsystem 11400, It may be connected to the VR system unit 3000 and the HMD module 2000.

The memory 11200 may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or nonvolatile memory. have. The memory 11200 may include a software module, an instruction set, or other various data necessary for the operation of the computing device 11000.

In this case, accessing the memory 11200 from another component such as the processor 11100 or the peripheral device interface 11300 may be controlled by the processor 11100.

The peripheral device interface 11300 may couple input and/or output peripheral devices of the computing device 11000 to the processor 11100 and the memory 11200. The processor 11100 may execute various functions for the computing device 11000 and process data by executing a software module or instruction set stored in the memory 11200.

The input/output subsystem 11400 may couple various input/output peripherals to the peripherals interface 11300. For example, the input/output subsystem 11400 may include a controller 1300 for coupling peripheral devices such as a monitor, a keyboard, a mouse, a printer, or a touch screen or a sensor to the peripheral device interface 11300 as needed. I can. According to another aspect, the input/output peripheral devices may be coupled to the peripheral device interface 11300 without going through the input/output subsystem 11400.

The power circuit 11500 may supply power to all or part of the components of the terminal. For example, the power circuit 11500 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator or power. It may contain any other components for creation, management, and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, the communication circuit 11600 may enable communication with other computing devices by transmitting and receiving an RF signal, also known as an electromagnetic signal, including an RF circuit, if necessary.

The embodiment of FIG. 9 is only an example of the computing device 11000, and the computing device 11000 omits some of the components shown in FIG. 9, further includes additional components not shown in FIG. 9, or 2 It can have a configuration or arrangement that combines two or more components. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. 9, and various communication methods (WiFi, 3G, LTE) are included in the communication circuit 1160. , Bluetooth, NFC, Zigbee, etc.) may include a circuit for RF communication. Components that can be included in the computing device 11000 may be implemented as hardware, software, or a combination of hardware and software including one or more signal processing or application-specific integrated circuits.

Methods according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded in a computer-readable medium. In particular, the program according to the present embodiment may be configured as a PC-based program or an application dedicated to a mobile terminal. An application to which the present invention is applied may be installed on a user terminal through a file provided by the file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file according to the request of the user terminal.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, such as one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to operate as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description by those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

Claims (7)

As an immersive feedback virtual reality system for brain health through user concentration,
The virtual reality system includes: a sensor unit including an EEG measurement module attached to a user's head to measure a user's EEG and a heart rate measurement module attached to a user's finger to measure a user's heart rate; A VR system unit that executes virtual reality contents in which a user can perform a treasure hunt and evaluates a result of the user's treasure hunt; And an HMD module for receiving image and sound information of virtual reality content executed from the VR system unit and providing it to a user,
The VR system unit,
A sensing information collection unit for receiving the brain wave and the heartbeat from the sensor unit;
A virtual reality content capable of performing a treasure hunt for adjusting the difficulty of the virtual reality content by applying the brainwave and the heartbeat of the user wearing the HMD module in real time, and outputting a sound based on the coordinates of the hidden treasure. Including; a treasure hunt content execution unit to execute,
The treasure hunt content execution unit,
Setting the number of treasures;
Executing content for experiencing virtual reality performing a treasure hunt;
Providing a hint for a treasure hunt based on the brain wave and the heartbeat; And
Terminating the execution of the content according to a user's input or a predetermined criterion; and
The step of setting the number of treasures,
Receiving a user's input for user information including height, weight, and age, and deriving a target heart rate based on the user information and the heart rate;
Deriving an average heart rate based on the measured heart rate during a preset section while the user has performed virtual reality content for performing the treasure hunt in the past;
Determining whether a user's target exercise amount is satisfied based on the target heart rate and the average heart rate; And
Including, the step of setting the number of treasures provided to the virtual reality content based on a predetermined criterion according to whether the target momentum is satisfied, and
The target heart rate is,
It is derived based on the exercise target intensity derived based on the extra heart rate derived based on the heart rate and the age and the BMI value according to the height and the body weight,
The step of providing the hint,
When the concentration degree derived based on the EEG is maintained for a preset time period, while the virtual reality content is being executed in the HMD module, the virtual reality content may display a direction object displaying the coordinates of the hidden treasure. It overlaps the displayed screen and displays it,
The virtual reality system for varying the time at which the direction object is displayed according to whether the deviation of the heartbeat meets a preset criterion during a preset time.
The method according to claim 1,
The treasure hunt content execution unit,
A virtual reality system for differently outputting the loudness of the sound according to a preset reference based on the distance between the coordinates of the treasure and the coordinates of the user.
delete delete delete delete As a method of implementing an immersive feedback virtual reality system for brain health through user's concentration,
The implementation method includes a sensor step including an EEG measurement step attached to the user's head to measure a user's EEG, and a heart rate measurement step attached to the user's finger to measure the user's heart rate; A VR system step of executing virtual reality contents in which a user can perform a treasure hunt and evaluating a result of the user's treasure hunt; And an HMD module step of receiving, through an HMD module, image and sound information of virtual reality content executed in the VR system step, and providing it to a user.
The VR system step,
A sensing information collection step of receiving the brain wave and the heartbeat from the sensor step;
A virtual reality content capable of performing a treasure hunt for adjusting the difficulty of the virtual reality content by applying the brainwave and the heartbeat of the user wearing the HMD module in real time, and outputting a sound based on the coordinates of the hidden treasure. Including; a treasure hunt content execution step of executing,
The treasure hunt content execution step,
Setting the number of treasures;
Executing content for experiencing virtual reality performing a treasure hunt;
Providing a hint for a treasure hunt based on the brain wave and the heartbeat; And
Including; terminating the execution of the content according to a user input or a predetermined criterion
The step of setting the number of treasures,
Receiving a user's input for user information including height, weight, and age, and deriving a target heart rate based on the user information and the heart rate;
Deriving an average heart rate based on the measured heart rate during a preset section while the user has performed virtual reality content for performing the treasure hunt in the past;
Determining whether a user's target exercise amount is satisfied based on the target heart rate and the average heart rate; And
Including, the step of setting the number of treasures provided to the virtual reality content based on a predetermined criterion according to whether the target momentum is satisfied, and
The target heart rate is,
It is derived based on the exercise target intensity derived based on the extra heart rate derived based on the heart rate and the age and the BMI value according to the height and the body weight,
The step of providing the hint,
When the concentration degree derived based on the EEG is maintained for a preset time period, while the virtual reality content is being executed in the HMD module, the virtual reality content may display a direction object displaying the coordinates of the hidden treasure. It overlaps the displayed screen and displays it,
A method of implementing a virtual reality system, wherein the time at which the direction object is displayed is varied according to whether the deviation of the heartbeat meets a preset criterion during a preset time.

Images