WO2023171875A1

WO2023171875A1 - Virtual reality system for preventing brain diseases and mental diseases on basis of complex sensors through communication-type rehabilitation and vocational program

Info

Publication number: WO2023171875A1
Application number: PCT/KR2022/017247
Authority: WO
Inventors: 조진수; 김정윤; 이다연
Original assignee: 가천대학교 산학협력단
Priority date: 2022-03-07
Filing date: 2022-11-04
Publication date: 2023-09-14
Also published as: KR102441307B1

Abstract

The present invention relates to a virtual reality system for preventing brain diseases and mental diseases on the basis of complex sensors through a communicative rehabilitation and occupational program. More specifically, the present invention relates to a virtual reality system for preventing brain diseases and mental diseases on the basis of complex sensors through communication-type rehabilitation and occupational programs, wherein brain wave, heart rate, and electromyography data of a user can be measured in real time while the user is indirectly experiencing snack cooking tasks in virtual reality content and at the same time, multiple users interact in a virtual reality space, whereby the user can be expected to improve in physical and mental health.

Description

Complex sensor-based brain disease and mental illness prevention virtual reality system through communicative rehabilitation and vocational programs

The present invention relates to a complex sensor-based virtual reality system for preventing brain disease and mental illness through a communicative rehabilitation and vocational program. More specifically, it measures the brain wave, heart rate, and electromyogram data of a user performing virtual reality content in real time. A complex sensor-based complex sensor-based program through a communicative rehabilitation and vocational program that allows users to indirectly experience the task of preparing snacks in virtual reality content and at the same time expects the effect of improving the user's physical and mental health as multiple users interact in the virtual reality space. This is about a virtual reality system for preventing brain disease and mental illness.

Virtual reality is a technology that creates interaction between users and a three-dimensional virtual space created by a computer system. Users can experience immersion through the five senses of the human body (sight, hearing, smell, taste, and touch) in this virtual space. It is a convergence technology that provides a sense of reality as if you were feeling and actually existing in that space. In modern times, there are many cases where you can experience virtual reality systems simply for the purpose of play and fun, such as in VR (Virtual Reality) cafes in the virtual reality market. For example, as outdoor activities are restricted due to the spread of the coronavirus, content that allows job experience activities at home or school using VR experience devices is being produced. Additionally, recently, with the advent of the untact era, demand for medical-related programs or non-face-to-face psychological counseling programs has been increasing, and programs to relieve mild depression have become necessary. In this way, the virtual reality system does not simply provide a virtual reality experience for fun, but can provide content for the purpose of treating users with mental disabilities using virtual reality.

Specifically, virtual reality technology is not limited by space and time with a simple device and allows users to experience virtual reality anytime, anywhere, so it is expected that users will be able to improve their motor skills and improve their lethargy by moving their bodies through it. You can.

As a result, virtual reality technology promotes active use of the brain and body by providing a variety of content that allows users to concentrate and perform activities, and measures biometric information such as brain waves and heart rate in real time when experiencing virtual reality content. You can analyze the user's concentration and physical condition. Therefore, there is a need for research aimed at improving the health of users by utilizing these virtual reality technologies to provide content that allows users to experience various experiences and at the same time induce mental and physical activities.

The present invention relates to a complex sensor-based virtual reality system for preventing brain disease and mental illness through a communicative rehabilitation and vocational program. More specifically, it measures the brain wave, heart rate, and electromyogram data of a user performing virtual reality content in real time. A complex sensor-based complex sensor-based program through a communicative rehabilitation and vocational program that allows users to indirectly experience the task of preparing snacks in virtual reality content and at the same time expects the effect of improving the user's physical and mental health as multiple users interact in the virtual reality space. The purpose is to provide a virtual reality system to prevent brain disease and mental illness.

In order to solve the above problems, in one embodiment of the present invention, it is a complex sensor-based virtual reality system for preventing brain diseases and mental disorders through a communicative rehabilitation and vocational program. A brain wave measurement module that is attached to the user's arm and measures the user's brain waves, a heart rate measurement module that is attached to the user's finger and measures the user's heart rate, and an electromyogram measurement module that is attached to a part of the body including the user's arm and measures the user's electromyogram A sensor unit including a module; The user memorizes the ingredients presented for a certain period of time, selects the ingredients used for cooking among the plurality of fish presented, and cooks a snack menu including tteokbokki, fried food, and sundae based on the selected ingredients. A VR system unit that executes virtual reality content that can analyze the user's concentration and activity status and derives an evaluation of the user's performance of the virtual reality content; And a HMD module that receives image and sound information of virtual reality content executed from the VR system unit and provides it to the user, wherein the VR system unit is a sensing unit that receives the brain wave, heart rate, and electromyography data from the sensor unit. Information Collection Department; The brain wave, heart rate, and electromyography data of the user wearing the HMD module are applied in real time to run virtual reality content that can perform snack cooking tasks in the virtual reality content, and the concentration and concentration of the user performing the virtual reality content a content execution unit that determines the activity status; a score calculation unit that calculates a score based on the user's virtual reality content performance results received from the content execution unit and calculates the score by assigning weight to the user based on immersion in the virtual reality content and amount of activity; and a social server generator that generates a social server through which a plurality of users performing the virtual reality content can access and interact with other users while cooperatively performing the virtual reality content.

In one embodiment of the present invention, the social server generator calculates matching reference values for age, height, and weight received from each of a plurality of users, and creates a social server that multiple users can access based on the matching reference values. can be created.

In one embodiment of the present invention, the content execution unit provides the user with focused content that memorizes ingredient information, order information, and recipe information and determines the user's concentration state based on the user's brain wave data, A memorization step of calculating a concentration score based on the user's concentration state; Provides active content that allows the user to perform snack cooking tasks, determines the user's activity state based on the movement of the controller operated by the user and the user's electromyography data, and based on the user's activity state Cooking step to calculate activity score; and a stabilization step of providing relaxation content for the user to relax, determining the user's stable state based on the user's heart rate data, and providing a final score calculated based on the concentration score and the activity score; can be performed.

In one embodiment of the present invention, the memorization step receives user information from the user, starts measuring the user's brain wave data, and determines whether the user enters a concentration state based on the user's brain wave data, A game preparation stage that determines the difficulty level of intensive content; A centralized content providing step of displaying centralized content to a user who maintains a focused state for more than a preset time, wherein the centralized content provides a plurality of images to the user in a random position and order. first focused content that displays and allows the user to memorize the order and location in which a plurality of images are displayed; a second focused content that presents a plurality of ingredients used in powder cooking to the user as images, and allows the user to select ingredients used in cooking from among the plurality of ingredients; and third focused content that memorizes order information including the customer's order order and order details, recipe information for dishes corresponding to the order information, and information on the order in which work is performed.

In one embodiment of the present invention, the score calculation unit performs an intensive score calculation step of calculating an intensive score for each user based on the concentration state of the user performing the intensive content, and in the memorization step, the user's concentration score is calculated. The standard for determining the user's concentration state based on brain wave data is to determine the user's concentration state when the type and frequency of the user's brain waves are measured for more than 3 seconds, which is a preset time of alpha waves with a frequency of 10 to 13 Hz, and When the user's brain wave type and frequency are measured as middle alpha waves with a frequency of 10 to 12 hz for more than 3 seconds, which is a preset time, the first concentration state is determined, and the user's brain wave type and frequency is a frequency of 12 to 13 hz. When an SMR wave with is measured for more than 3 seconds, which is a preset time, it can be determined to be in the second concentration state.

In one embodiment of the present invention, the concentration score includes: a comprehensive concentration score calculated based on the user's concentration maintenance time in the memorization step; and a second concentration score calculated based on the user's second concentration state maintenance time in the memorization step, and the method of calculating the concentration score is determined by adding the comprehensive concentration score and the second concentration score. However, it can be calculated by assigning a weight having a larger value than the comprehensive concentration score to the second concentration score.

In one embodiment of the present invention, the cooking step provides the user with ingredients and cooking tools used for snack cooking within virtual reality content for the user who has completed the memorization step, and provides the user with electromyography data of the user. Cooking preparation step to start measuring; And an active content providing step of providing the user with active content that allows the user to perform meal preparation tasks, and determining the user's activity state based on the movement of the controller operated by the user and the user's electromyography data. It can be included.

In one embodiment of the present invention, the score calculation unit performs an activity score calculation step of calculating an activity score for each user based on the activity state of the user performing the active content, and calculates the user's electromyography in the cooking step. The standard for determining the user's activity state based on data is that, if the user's EMG data change amount is 20 to 450 hz, the user is determined to be in an active state, and if the user's EMG data change amount is 20 to 235 hz, the user is determined to be in an active state. If the amount of change in the user's EMG data is 236 to 450 Hz, it can be determined as a second activity state.

In one embodiment of the present invention, the activity score includes: a comprehensive activity score calculated based on a comprehensive performance result for the active content performed by the user in the cooking step; Content for preparing vegetables and meat used in cooking, comprising: a first activity score calculated based on the user's performance results for the first activity type content whose activity requirement exceeds the first activity requirement; Content for manufacturing tteokbokki using prepared ingredients, a second activity score calculated based on the user's performance results for the second activity type content whose activity requirement is less than the first activity requirement and more than the second activity requirement; and a third activity score calculated based on the user's performance results for third activity type content whose activity requirement is less than the second activity requirement as content for frying fries, and the method of calculating the activity score includes the above. It is determined by adding up the comprehensive activity score, first activity score, second activity score, and third activity score, but reflects the activity demand and performance time for the content from which the first activity score, second activity score, and third activity score were calculated. Therefore, it can be decided by assigning different weights to each.

In one embodiment of the present invention, the stabilization step includes: a background movement step of moving the user who has completed the cooking step within the virtual reality content from the cooking room to a resting area; A relaxation content providing step of providing relaxation content that allows the user to relax, and determining that the user is in a stable state when the user's heart rate is 60 to 72; and a score providing step of adding up the concentration score and the activity score and calculating and providing a final score by reflecting the user's performance results of the virtual reality content.

In order to solve the above problems, in one embodiment of the present invention, a method of implementing a virtual reality system for preventing brain diseases and mental disorders based on a complex sensor through a communicative rehabilitation and vocational program, the method of implementing the virtual reality system includes the following: A sensor step including an EEG measurement step of measuring the user's EEG using an EEG measurement module, and an EMG measurement step of measuring the user's EMG using a heart rate measurement module; The user memorizes the ingredients presented for a certain period of time, selects the ingredients used for cooking among the plurality of fish presented, and cooks a snack menu including tteokbokki, fried food, and sundae based on the selected ingredients. A VR stage that executes virtual reality content that can analyze the user's concentration and activity state and derives an evaluation of the user's performance of the virtual reality content; And a HMD step of receiving the image and sound information of the virtual reality content executed in the VR step and providing it to the user, wherein the VR step includes sensing information that receives the brain wave, heart rate, and electromyography data in the sensor step. collection stage; By applying the brain wave, heart rate, and electromyography data of the user wearing the HMD module in real time, the virtual reality content capable of performing snack cooking tasks in the virtual reality content is executed, and the concentration and activity of the user performing the virtual reality content is performed. A content execution step that determines the status; A score calculation step of calculating a score based on the user's virtual reality content execution results received in the content execution step and calculating the score by assigning weight to the user based on the user's immersion in the virtual reality content and the amount of activity; And a social server creation step of creating a social server where a plurality of users performing the virtual reality content can access and interact with other users while collaborating on the virtual reality content. do.

In order to solve the above problems, in one embodiment of the present invention, a virtual reality system for preventing brain diseases and mental disorders based on a complex sensor through a communicative rehabilitation and vocational program performed on a computing device having one or more processors and one or more memories. A computer-readable medium for implementing, wherein the computer-readable medium stores instructions that cause a computing device to perform the following steps, wherein the following steps include measuring the user's brain waves by the brain wave measurement module. A sensor step including an electroencephalography (EEG) measurement step and an electromyography measurement step of measuring the user's electromyogram using a heart rate measurement module; The user memorizes the ingredients presented for a certain period of time, selects the ingredients used for cooking among the plurality of fish presented, and cooks a snack menu including tteokbokki, fried food, and sundae based on the selected ingredients. A VR stage that executes virtual reality content that can analyze the user's concentration and activity state and derives an evaluation of the user's performance of the virtual reality content; And a HMD step of receiving the image and sound information of the virtual reality content executed in the VR step and providing it to the user, wherein the VR step includes sensing information that receives the brain wave, heart rate, and electromyography data in the sensor step. collection stage; By applying the brain wave, heart rate, and electromyography data of the user wearing the HMD module in real time, the virtual reality content capable of performing snack cooking tasks in the virtual reality content is executed, and the concentration and activity of the user performing the virtual reality content is performed. A content execution step that determines the status; A score calculation step of calculating a score based on the user's virtual reality content execution results received in the content execution step and calculating the score by assigning weight to the user based on the user's immersion in the virtual reality content and the amount of activity; and a social server creation step of creating a social server where a plurality of users performing the virtual reality content can access and interact with other users while cooperatively performing the virtual reality content. .

According to an embodiment of the present invention, by providing users with virtual reality content that allows them to experience the task of cooking snacks, it improves physical and mental health by increasing the concentration of virtual reality system users and inducing physical activity while cooking snacks at the same time. It can have the effect of indirectly experiencing work.

According to one embodiment of the present invention, a user can improve his or her physical and mental health by accessing the same social server as other users of similar age, height, and weight, and cooperating with virtual reality content.

According to an embodiment of the present invention, content according to the user's current state is set and provided based on the user's biometric information such as brain waves, heart rate, and electromyogram, thereby achieving the effect of inducing the user's concentration and stability.

According to one embodiment of the present invention, a user can gain experience in the field of snack cooking by repeatedly experiencing the entire cooking process of the snack cooking task selected by the user.

According to one embodiment of the present invention, the user's state is determined through biometric information such as brain waves, heart rate, and electromyogram of the virtual reality system user, and the difficulty of the content is adjusted by providing appropriate feedback to the current user state, thereby customizing the user. It can be effective in providing virtual reality content.

According to one embodiment of the present invention, the user can improve concentration and improve brain health through memorization of order information and recipe information, and specifically measure the user's brain wave data to prevent diseases including dementia, stroke, and seizures. It can have a preventive effect.

According to one embodiment of the present invention, the user can move and improve physical health through physical movements for preparing and cooking food ingredients, and specifically measure the user's electromyography data to prevent arterial disease, low/high blood pressure, and myocardial disease. It can be effective in preventing diseases including infarction, pericarditis, and arrhythmia.

According to one embodiment of the present invention, tension and fatigue can be alleviated by taking a break after performing meal preparation tasks, and specifically by measuring the user's heart rate data, myasthenia gravis, progressive muscular dystrophy, polymyositis, and myasthenia gravis. It can be effective in preventing nerve/muscle diseases including atrophic axial sclerosis.

According to one embodiment of the present invention, user-specific evaluation information and biometric information derived during performance in virtual reality content can be transmitted to an external expert and used as the user's medical treatment, treatment, and counseling data.

Figure 1 schematically shows a user in the experience space of a virtual reality system according to an embodiment of the present invention and modules constituting a sensor unit worn on the user's body.

Figure 2 schematically shows the internal configuration of a virtual reality system according to an embodiment of the present invention.

Figure 3 schematically shows the internal configuration of the VR system unit according to an embodiment of the present invention.

Figure 4 schematically shows the steps performed by the content execution unit according to an embodiment of the present invention.

Figure 5 schematically shows a screen on which third centralized content is displayed on the HMD module in the centralized content provision step according to an embodiment of the present invention.

Figure 6 schematically shows a screen displayed on the HMD module in the stabilization phase according to an embodiment of the present invention.

Figure 7 schematically shows the operation of the score calculation unit according to an embodiment of the present invention.

Figure 8 shows a process in which a plurality of users access and perform virtual reality content by a social server generator according to an embodiment of the present invention.

Figure 9 schematically shows the internal configuration of a computing device according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to facilitate a general understanding of one or more aspects. However, it will also be appreciated by those skilled in the art that this aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain example aspects of one or more aspects. However, these aspects are illustrative and some of the various methods in the principles of the various aspects may be utilized, and the written description is intended to encompass all such aspects and their equivalents.

Additionally, various aspects and features may be presented by a system that may include multiple devices, components and/or modules, etc. It is also understood that various systems may include additional devices, components and/or modules, etc. and/or may not include all of the devices, components, modules, etc. discussed in connection with the drawings. It must be understood and recognized.

As used herein, “embodiments,” “examples,” “aspects,” “examples,” etc. may not be construed to mean that any aspect or design described is better or advantageous over other aspects or designs. . The terms '~part', 'component', 'module', 'system', 'interface', etc. used below generally refer to computer-related entities, such as hardware, hardware, etc. A combination of and software, it can mean software.

Additionally, the terms “comprise” and/or “comprising” mean that the feature and/or element is present, but exclude the presence or addition of one or more other features, elements and/or groups thereof. It should be understood as not doing so.

Additionally, terms including ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be named a second component, and similarly, the second component may also be named a first component without departing from the scope of the present invention. The term and/or includes any of a plurality of related stated items or a combination of a plurality of related stated items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are generally understood by those skilled in the art to which the present invention pertains. It has the same meaning as Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless clearly defined in the embodiments of the present invention, have an ideal or excessively formal meaning. It is not interpreted as

The virtual reality system of the present invention includes a sensor unit 1000, a controller 1400, a VR system unit 3000, and an HMD module 2000, and the user can experience the overall meal preparation process provided through the virtual reality system. You can experience virtual reality content. In addition, the effect of improving concentration and memory can be obtained through experience in virtual space, and users can obtain exercise effects through physical activities involved in the process of preparing and cooking food while experiencing virtual reality content. Additionally, users can perform virtual reality content on the same social server as other users with similar physical conditions such as age, height, and weight.

As shown in Figure 1, a user who experiences virtual reality through a virtual reality system can attach the brain wave measurement module 1100, heart rate measurement module 1200, and electromyography measurement module 1300 to his or her body, and the operation By possessing a controller 1400 including a sensor module 1410, you can make inputs (e.g., buttons, hand tracking) as needed when experiencing virtual reality content, and a motion sensor module included in the controller 1400 ( 1410), the user's movement can be measured. The user's input and actions received through the controller 1400 are transmitted to the VR system unit 3000 and reflected in the virtual reality content. As shown in FIG. 1, the user can recognize the movement of the HMD module 2000 and the controller 1400 according to the user's movements in the space where the base station that sets the area of the virtual reality experience space is installed.

The virtual reality content of the present invention provided in the environment as shown in Figure 1 is suitable for users with mental disorders such as post-traumatic stress disorder (PTSD), panic disorder, mild cognitive impairment, and attention deficit hyperactivity disorder (ADHD). Through an experience in a virtual space that provides virtual reality content, the user's concentration is encouraged and concentration improved through the mental activities involved in the process of memorizing ingredients, order information, and recipes, and the physical activities involved in the preparation and cooking process of ingredients. You can achieve an improvement effect and have the effect of relieving the feeling of helplessness.

Mental disorders in the present invention are not limited to the types of mental disorders described above such as post-traumatic stress disorder (PTSD), and range from mild mental disorders to severe mental disorders in the virtual space provided through the virtual reality system of the present invention. It can include all types of mental disorders that can benefit from treatment through experience.

Below, the configuration of the virtual reality system will be described in more detail.

As shown in Figure 2, it is a complex sensor-based manipulation and immersive virtual reality system through a communicative rehabilitation and vocational program. The virtual reality system is attached to the user's head and measures the user's brain waves. A sensor unit including an brain wave measurement module, a heart rate measurement module attached to the user's finger to measure the user's heart rate, and an electromyography measurement module attached to a part of the body including the user's arm to measure the user's electromyogram; The user memorizes the ingredients presented for a certain period of time, selects the ingredients used for cooking among the plurality of fish presented, and cooks a snack menu including tteokbokki, fried food, and sundae based on the selected ingredients. A VR system unit that executes virtual reality content that can analyze the user's concentration and activity status and derives an evaluation of the user's performance of the virtual reality content; and an HMD module that receives image and sound information of virtual reality content executed from the VR system unit and provides it to the user.

According to one embodiment of the present invention, as shown in FIG. 2, the VR system unit 3000 may be included in the HMD module 2000. Additionally, in another embodiment of the present invention, the controller 1400 including the motion sensor module 1410 may be included in the sensor unit 1000.

The brain wave measurement module 1100 senses and measures brain waves including delta waves, theta waves, alpha waves, beta waves, and gamma waves. The brain wave measurement module 1100 is preferably located on the user's forehead, and the brain wave data is transmitted in an open sound control format without going through a specific storage medium, and is transmitted to the computer through wireless communication, including Bluetooth communication, with other devices. It can be sent to . Brain waves in different frequency bands have different characteristics, and based on this, the user's mental activity state can be determined. In a mentally unstable state, the user's mental activity state can be determined based on beta or alpha waves, and in a stable state, the user's mental activity state can be determined based on alpha or theta waves. Preferably, the alpha wave includes SMR waves, middle alpha, and slow alpha, and the alpha wave can be an indicator for determining the user's concentration. If the user's brain waves are SMR waves, the user may be in a slightly concentrated state, and if the user's brain waves are middle alpha waves, the user may be in a stable and concentrated state. Additionally, if the user's brain waves are slow alpha, the user may be in a meditative state. Since brain waves in different frequency bands have different characteristics, the user's mental activity state can be determined based on this.

The heart rate measurement module 1200 is attached to the user's finger and can measure the user's heart rate. Information related to heart rate, including one or more of heart rate, pulse waveform, heart beats per minute, presence or absence of heartbeat sounds, heart rate and heart rate interval display, and blood flow index, may be displayed on the heart rate measurement module 1200.

The electromyogram measurement module 1300 can be mounted on the arm or elbow of the user's dominant hand to measure the user's electromyogram. Information that can determine the user's muscle movement, including one or more of muscle contraction, frequency, and activity, may be displayed on the electromyography measurement module 1300.

By wearing these modules that measure heart rate, brain waves, and electromyograms and experiencing virtual reality content, users can experience virtual reality content that is provided to users according to their mental and physical conditions based on biometric information including heart rate, brain waves, and electromyograms. You can receive virtual reality content that reflects the conditions of active content differently.

Meanwhile, the virtual reality system includes a controller 1400 for manipulating virtual reality content. As shown in FIG. 1, the user can use VR content by holding and moving the controller 1400 in both hands, inputting operations and controls in the virtual reality content. The controller 1400 includes a motion sensor module 1410 capable of detecting movement, thereby detecting the movement of the user's hand, and includes input tools such as buttons, dials, and touch sensors that the user can operate. Allows various inputs.

The VR system unit 3000 can execute virtual reality content that allows the user to experience overall snack cooking based on biometric information such as brain waves, heart rate, and electromyogram input from the sensor unit 1000, and performs virtual reality content. The results can be evaluated.

The HMD module 2000 is worn on the user's head and provides image and sound information of virtual reality content to the user and allows the user to experience virtual reality. The user wears the HMD module (2000) by wearing glasses to experience virtual reality that can perform snack cooking tasks, and receives image and sound information of virtual reality content through the HMD module (2000). You can experience a realistic experience as if you were actually experiencing the content provided in virtual reality.

As shown in Figure 3, the VR system unit includes a sensing information collection unit that receives the brain wave, heart rate, and electromyography data from the sensor unit; The brain wave, heart rate, and electromyography data of the user wearing the HMD module are applied in real time to run virtual reality content that can perform snack cooking tasks in the virtual reality content, and the concentration and concentration of the user performing the virtual reality content a content execution unit that determines the activity status; and a score calculation unit that calculates a score based on the user's virtual reality content performance results received from the content execution unit and calculates the score by assigning weight to the user based on immersion in the virtual reality content and amount of activity. A social server generator that generates a social server through which a plurality of users performing the virtual reality content can access and interact with other users while cooperatively performing the virtual reality content; And it may include a DB capable of storing information necessary for the above configuration.

Specifically, the sensing information collection unit 3100 receives biological signals including the user's brain waves, heart rate, and electromyogram measured from the sensor unit 1000 of the virtual reality system. The received user's biometric signals are transmitted to the content execution unit 3200 and used as basic information to provide feedback on the virtual reality content experienced by the user. The content execution unit 3200 may set different work environment conditions for virtual reality content experienced by the user based on the user's biometric signals transmitted from the sensing information collection unit 3100.

Preferably, the content execution unit 3200 determines the overall difficulty level of the intensive content and virtual reality content provided to the user based on the user's brain waves.

Thereafter, the content execution unit 3200 performs a memorization step (S100) of providing focused content to the user; A cooking step (S200) that provides active content to the user; Provides virtual reality content that can sequentially perform a stabilization step (S300) of providing relaxation content to the user.

The above process sets work environment conditions based on the user's biological signals, so that the user is provided with content of a level of difficulty suitable for him/her, and can improve both mental and physical health by increasing concentration and being active to obtain a high score. there is.

The score calculation unit 3300 calculates a score based on the user's content immersion and content performance results while the virtual reality content is running or has ended.

Preferably, the standard for calculating the score in the score calculation unit 3300 is determined by adding the concentration score according to the user's performance of the intensive content and the activity score according to the performance of the active content, and additionally, the user's virtual reality content The performance results can be further reflected and determined.

The social server creation unit 3400 creates a social server through which a plurality of users can communicate or interact, and the plurality of users can access the created social server and collaborate on virtual reality content with other users. Specifically, the virtual reality system receives physical information such as age, height, and weight for each of multiple users, and connects users with similar physical conditions to the same social server, allowing multiple users to interact and collaborate on virtual reality content. It can be done.

Meanwhile, as shown in FIG. 3, the DB 3500 of the VR system unit 3000 contains user information including user identification information, age, name, height, weight, etc. input from the user, and virtual reality content. As a result of the performance, evaluation information including criteria for calculating scores, and biometric information including the user's brain waves, heart rate, and electromyogram measured by the sensor unit 1000 may be stored.

User information stored in the DB (3500) can be used to determine the difficulty level of the virtual reality content, and the user information, performance results in the virtual reality content, and biometric information are used for the purpose of treatment and counseling of users with mental disorders. It can be delivered to medical staff such as doctors or counselors and used as the user's medical treatment, treatment and counseling data.

The VR system unit 3000 shown in FIG. 3 may further include elements other than those shown, but for convenience, it provides virtual reality content that allows users to experience snack food cooking tasks according to embodiments of the present invention. Only components related to the real system are displayed.

Below, specific operations of the content execution unit 3200 will be described in more detail.

The content execution unit provides the user with focused content that memorizes food ingredient information, order information, and recipe information, determines the user's concentration state based on the user's brain wave data, and focuses based on the user's concentration state. Memorization step of calculating scores; Provides active content that allows the user to perform snack cooking tasks, determines the user's activity state based on the movement of the controller operated by the user and the user's electromyography data, and based on the user's activity state Cooking step to calculate activity score; and a stabilization step of providing relaxation content for the user to relax, determining the user's stable state based on the user's heart rate data, and providing a final score calculated based on the concentration score and the activity score; can be performed.

The memorization step is a game that receives user information from the user, starts measuring the user's brain wave data, determines whether the user enters a concentration state based on the user's brain wave data, and determines the difficulty of the intensive content. Preparation stage; A centralized content providing step of displaying centralized content to a user who maintains a focused state for more than a preset time, wherein the centralized content provides a plurality of images to the user in a random position and order. first focused content that displays and allows the user to memorize the order and location in which a plurality of images are displayed; a second focused content that presents a plurality of ingredients used in powder cooking to the user as images, and allows the user to select ingredients used in cooking from among the plurality of ingredients; and third focused content that memorizes order information including the customer's order order and order details, recipe information for dishes corresponding to the order information, and information on the order in which work is performed.

The cooking step includes a cooking preparation step of providing ingredients and cooking tools used for snack cooking to the user who has completed the memorization step within virtual reality content and starting to measure the user's electromyography data; And an active content providing step of providing the user with active content that allows the user to perform meal preparation tasks, and determining the user's activity state based on the movement of the controller operated by the user and the user's electromyography data. It can be included.

Additionally, the active content may include a first active content of preparing vegetables and meat, a second active content of cooking tteokbokki using the prepared ingredients, and a third active content of frying fries.

The stabilization step includes a background movement step of moving the user who has completed the cooking step within the virtual reality content from the cooking room to a resting area; A relaxation content providing step of providing relaxation content that allows the user to relax, and determining that the user is in a stable state when the user's heart rate is 60 to 72; and a score providing step of adding up the concentration score and the activity score and calculating and providing a final score by reflecting the user's performance results of the virtual reality content.

To describe the performance steps of the virtual reality system according to an embodiment of the present invention in more detail, the virtual reality system of the present invention provides focused content to the user in the memorization step (S100) and provides focused content based on the user's brain waves. Determine.

Specifically, the memorization step (S100) is a step of receiving the user's information, preparing virtual reality content, and providing the user with content that needs to be memorized. It includes a game preparation step (S110) that determines whether to enter a concentrated state and the difficulty of the focused content, and a focused content provision step (S120) that provides focused content.

Preferably, the virtual reality system may receive user information including user identification information, age, name, height, weight, etc. from the user in the game preparation step (S110), and the user information may determine the difficulty level of the virtual reality content. It can be a standard for determining user status and calculating scores. For example, low-difficulty virtual reality content can be provided to users over 60 years of age, and high-difficulty virtual reality content can be provided to users under 25 years of age.

Additionally, in the game preparation stage (S110), the virtual reality system can determine whether the user has entered a concentration state based on the user's brain wave data and determine the difficulty of the virtual reality content based on the degree of immersion in the concentration state.

Specifically, when the type and frequency of the user's brain waves are measured as alpha waves with a frequency of 10 to 13 Hz for more than a preset time, the user is determined to be in a concentrated state and focused content can be provided.

Preferably, when the user's brain wave type and frequency are measured as middle alpha waves with a frequency of 10 to 12 Hz for more than a preset time, the user is determined to be in the first concentration state and intensive content with normal difficulty can be provided. , When the user's brain wave type and frequency are measured as SMR waves with a frequency of 12 to 13 Hz for more than a preset time, it is determined to be in a second concentration state and intensive content that is more difficult than the intensive content is provided to the user. You can.

As a result, the virtual reality system of the present invention determines the difficulty of intensive content based on immersion as well as whether the user enters a state of concentration, thereby enabling highly concentrated users to record high scores.

Subsequently, the virtual reality system can provide the user with intensive content having the level of difficulty determined in the game preparation step (S110). In the intensive content provision step (S120), the intensive content provided to the user is content that involves memorizing ingredient information, order information, and recipe information, and the user memorizes the intensive content to provide an overview of the overall snack cooking work. You can understand the process.

Preferably, the focused content includes: a first focused content that displays a plurality of texts in random positions and orders to the user, and in which the user memorizes the order and position in which the plurality of images are displayed; a second focused content that presents a plurality of ingredients used in powder cooking to the user as images, and allows the user to select ingredients used in cooking from among the plurality of ingredients; It may be configured to include third-focused content that memorizes order information including the customer's order order and order details, recipe information for dishes corresponding to the order information, and information on the order in which work is performed. .

As described above, in the focused content provision step (S120), focused content is provided to the user when the user is in a concentrated state based on the user's brain wave data. Additionally, the higher the user's concentration, the more intensive content of higher difficulty the user can receive, and the user can record a higher score through intensive content of higher difficulty.

As a result, in order for users to record high scores as a result of performing virtual reality content, it is necessary to immerse themselves in virtual reality content.

Specifically, the virtual reality system determines that the user is in a state of low concentration when the user's brain wave data corresponds to gamma waves or beta waves with a frequency of 13 Hz or more, or delta waves or theta waves with a frequency of 8 Hz or less. In this case, the user may not be provided with focused content.

Additionally, if the user's brain wave data corresponds to alpha waves with a frequency of 8 to 13 Hz, the user can be determined to be in a focused state and focused content can be provided.

Preferably, when the brain wave data corresponds to middle alpha waves with a frequency of 10 to 12 Hz, the user can be determined to be in the first concentration state and intensive content of medium difficulty can be provided, and the brain wave data is 12 to 12 Hz. If it corresponds to an SMR wave with a frequency of 13 Hz, the user can be determined to be in the second concentration state and intensive content of the highest difficulty level can be provided.

The user can obtain a comprehensive concentration score calculated based on the maintenance time of the concentration state and a second concentration score calculated based on the maintenance time of the second concentration state, which is more immersive than the concentration state. As mentioned above, it is desirable to assign a higher weight to the second intensive score than the comprehensive intensive score.

As a result, the virtual reality system of the present invention can determine the user's concentration state based on the type and frequency of the user's brain waves, and can induce the user to increase concentration on virtual reality content in order to record a high score. In this way, users can develop concentration and improve cognitive ability and brain health through the process of memorizing and concentrating on ingredient information, order information, and recipe information.

Meanwhile, the user's brainwave data measured in the memorization step (S100) may be displayed to the user or administrator. Specifically, the user's brain wave data collected through the brain wave measurement module 1100 may be converted into visual information and provided to the user or administrator. Preferably, the user provides information about the brain wave data as visual information, but displays only the area corresponding to the state of concentration, and applies a blur effect to the area corresponding to the state of low concentration or deletes the area. In addition, the area corresponding to the concentration state is displayed, but the area corresponding to the second concentration state in which the user's concentration level is high can be displayed in different colors or highlighted to increase visibility.

As a result, the user or administrator can easily determine whether the user is in a state of concentration and the degree of immersion. For example, the user can check data according to the state of concentration by placing the pointer that moves by manipulating the controller 1400 on the state confirmation layer (not shown) implemented in virtual reality content.

The cooking step (S200) is a cooking preparation that provides ingredients and cooking tools used for snack cooking to the user who has completed the memorization step within the virtual reality content and starts measuring the user's electromyography data. Step (S210); And an active content provision step (S220) that provides the user with active content that allows the user to perform snack cooking tasks and determines the user's activity state based on the movement of the controller operated by the user and the user's electromyography data. ); may include.

Specifically, in the cooking preparation step (S210), the user can prepare the ingredients and cooking tools necessary to perform the snack cooking task within the virtual reality content by manipulating the controller 1400.

Preferably, the user can bring the food ingredients stored in the food storage box to the kitchen counter, and the user can record a high score by accurately bringing the type and amount of food ingredients and preparing them at the designated location. For example, the user can select and retrieve the type and amount of ingredients such as 150g of rice cake, 200g of red pepper paste, and 300g of fish cake among the ingredients stored in the food storage box, and information about the ingredients can be retrieved from the focused content provided in the memorization step (S100), more Specifically, it is desirable to include it in the second focused content.

Next, by manipulating the controller 1400, the user can select and search for cooking utensils suitable for the dish to be cooked and bring them to the kitchen counter. Users can record high scores by bringing cooking utensils suitable for the dish they want to cook and preparing them in a designated location.

For example, the user can bring cooking utensils such as knives, spatulas, and cutting boards among the cooking utensils prepared on the kitchen counter, and it is desirable that information about the corresponding cooking utensils be included in the focused content provided in the memorization step (S100).

Next, the user can wash and prepare the ingredients corresponding to the dish to be cooked by manipulating the controller 1400. Users can record high scores by preparing prepared ingredients in an appropriate manner.

For example, the user can prepare for cooking by cutting or chopping ingredients such as rice cakes, red pepper paste, and fish cakes into appropriate sizes, and information about the cooking process is preferably included in the focused content provided in the memorization step (S100).

The user who has completed the cooking preparation step (S210) can perform the meal preparation task by performing the active content provision step (S220). Specifically, in the active content provision step (S220), the user cooks the snack dish to be cooked, such as tteokbokki, fried food, and sundae, according to the operation of the controller 1400, and cooks it in a designated cooking order and cooking method to achieve a high score. can be recorded.

In the cooking step (S200), the user can change or cook cooking utensils and ingredients by manipulating the controller 1400, and the user's movement and electromyography signals generated by cooking the dish are transmitted to the motion sensor module 1410 and It is measured by the electromyography measurement module 1300 and can serve as a standard for determining the user's activity status. Specifically, the higher the frequency according to the EMG change measured by the EMG measurement module 1300, the faster the user's movement detected by the motion sensor module 1410, and the longer the duration of the movement, the higher the user can record a score. there is.

Specifically, if the electromyography data according to the user's movement has a frequency of 450 hz or more or a frequency of 20 hz or less, the user can be classified as inactive and the user in that state should not perform the cooking step (S200). It may be judged as not present and a score may not be given. Additionally, if electromyography data according to the user's movement has a frequency of 20 to 450 Hz, the user can be classified as active. More specifically, if the EMG data has a frequency of 20 to 235 hz, the user can be determined to be in a first activity state maintaining weak activity, and if the EMG data has a frequency of 235 to 450 hz, the user can be determined to be in a first activity state maintaining weak activity. It can be identified as a second activity state that maintains strong activity.

As a result, the virtual reality system of the present invention can induce users with high activity levels to record high scores by measuring the amount of activity along with whether the user enters an active state.

Meanwhile, the activity score that the user can record in the cooking step (S200) can be determined based on the user's activity status, activity requirements for each step, and performance time of each step. Specifically, the higher the frequency according to the EMG change measured by the EMG measurement module 1300, the faster the user's movement detected by the motion sensor module 1410, and the longer the duration of the movement, the higher the user can record a score. there is.

Preferably, the activity score that can be recorded by the user in the cooking step (S200) can be determined by adding up the comprehensive activity score, the first activity score, the second activity score, and the third activity score.

The comprehensive activity score is a basic score for the performance results recorded by the user during the overall performance of the cooking step (S200), and the first activity score is for the performance results of the user who performed the first activity type content with the highest activity requirement. It can be calculated by assigning a weight with the highest value to the score, and the second activity score is a score for the performance results of a user who performed the second activity type content with a medium activity requirement, and is assigned a weight with a median value. The third activity score is a score for the performance results of a user performing third activity type content with low activity requirements and can be calculated by assigning a weight with a low value.

Meanwhile, the criteria for determining the user's movement and scoring in the cooking step (S200) may include the speed and duration of the movement measured by the motion sensor module 1410 of the controller 1400. Specifically, a score may be given to a user who performs the actions required in the cooking step (S200) for a preset time and a preset number of times.

For example, the first active content is content for preparing vegetables and meat used in cooking, and the user earns the first activity score by performing movements for 3 minutes and more than 30 times while performing the first active content. It can be recorded, and the second activity-type content is content that cooks tteokbokki using prepared ingredients, and the user calculates the second activity score by performing movements for 5 minutes and more than 50 times while performing the second activity-type content. The third activity content is frying content, and the user can record the third activity score by making movements for 1 minute and 10 times or more while performing the third activity content.

In this way, in the present invention, by varying the movement required for each active content, an accurate score for the user's activity state can be calculated.

As a result, the virtual reality system of the present invention can determine the activity state based on the user's electromyography data and the user's movements, and can encourage the user to actively participate in virtual reality content to record a high score. Users can improve their physical health by performing cooking tasks through physical activity and can feel emotional stability by gaining a sense of accomplishment in the process of completing a dish.

Meanwhile, the user's EMG data measured in the cooking step (S200) and data measuring the user's movements may be displayed to the user or manager. Specifically, data collected through the electromyography measurement module 1300 and the motion sensor module 1410 can be converted into visual information and provided to the user or administrator.

Preferably, when the user is active, the corresponding area can be displayed with a different color or highlighted to increase visibility, and when the user is inactive, a blur effect is applied to the corresponding area to increase visibility by the user or administrator. It is possible to easily determine whether a user has entered an active state. For example, the user can check data according to the activity status by placing a pointer that moves by manipulating the controller 1400 on a status confirmation layer (not shown) implemented in virtual reality content.

Meanwhile, as described above, in the present invention, a plurality of users can access a social server and cooperate in performing virtual reality content. Specifically, the user may perform the focused content and active content provided in the memorization step (S100) and the cooking step (S200) together with other users.

For example, active content may be composed of first active content, second active content, and third active content according to the order of meal preparation, and assign active content to individual multiple users. , Virtual reality content can be cooperatively performed by multiple users performing assigned content simultaneously. In the manner described above, in the present invention, a plurality of users can play virtual reality content together, thereby reducing the boredom caused by playing the content.

The stabilization step (S300) is a step of providing relaxation content to the user who has completed the cooking step (S200) and calculating and providing a score according to the results of performing the virtual reality content. A background movement step of moving the background of the virtual reality content ( S310); A relaxation stage (S320) providing relaxation content; It includes a score providing step (S330) of providing a score according to the performance of virtual reality content.

Specifically, the background movement step (S310) moves the background of the virtual reality content of the user who has completed the cooking step (S200), and the user can relax in the kitchen with the background of the virtual reality content before receiving the relaxation content. It can be changed to an appropriate location.

Preferably, the background information changed in the background movement step (S310) may include a beach, a forest, a home, etc., and the list is provided to the user in the game preparation step (S110) so that the user can select one or more backgrounds on which to relax. You can choose the information yourself.

The resting step (S320) is a step of providing relaxing content to the user who has completed the cooking step (S200). The user is provided with relaxing content and relieves physical tension as the muscles relax during the resting process. You can do it, and you can achieve emotional stability.

Specifically, the user is provided with a list of one or more furniture in which to rest, can rest in the selected furniture, and can determine the user's stable state based on the user's heart rate data measured by the heart rate measurement module 1200. there is. Preferably, the list of furniture where the user can relax may include a bed, sofa, massage chair, ondol, sunbed, etc., and the user can select one piece of furniture from the list of furniture through the controller 1400.

The standard for determining the user's stable state in the resting step (S320) is determined based on the user's heart rate data measured by the heart rate measurement module 1200 and can be reflected in the user information received in the game preparation step (S110). . Specifically, the criteria for determining the user's stable state may reflect the user's age, exercise intensity, content performance time, etc. For example, in the case of a user between the ages of 26 and 35, if the heart rate is between 73 and 76, the user can be determined to be in a normal state, and if the heart rate is below 72, the user can be determined to be in a stable state. In addition, as described above, the heart rate standard for determining a stable state may increase if the user is older, the intensity of exercise due to content performance is high, or the content performance time is long. This generally reflects the tendency for athletes with a high basal metabolic rate to have a low average heart rate, and for the elderly or people with little exercise experience to have a high average heart rate. When determining the user's stable state, user information is taken into consideration. This is to perform a very accurate diagnosis.

Meanwhile, the user's heart rate data measured in the resting phase (S320) may be displayed to the user or administrator. Specifically, heart rate data collected through the heart rate measurement module 1200 may be converted into visual information and provided to the user or administrator. Preferably, when the user is in a stable state, the corresponding area can be displayed in a different color or highlighted to increase visibility, and when the user is in an active state, a blur effect is applied to the corresponding area so that the user or administrator can It is possible to easily determine whether the user has entered a stable state. For example, the user can check data according to the stable state by placing a pointer that moves by manipulating the controller 1400 on a status confirmation layer (not shown) implemented in virtual reality content.

The score providing step (S330) provides the user with a score calculated according to the results of performing virtual reality content, and can be performed simultaneously with the rest step (S320). Specifically, the user can check the score obtained at each stage of virtual reality content, and the score can be determined based on the user's content performance results at each stage.

By checking scores based on concentration and activity status, users can quantitatively identify areas of mental and physical weakness and establish intensive training plans for those areas in the future.

Meanwhile, in the score provision step (S330), the score information can be converted into visual information and displayed to the user. Specifically, the area corresponding to the level in which the user recorded a low score can be displayed with different colors or by highlighting it to increase visibility. Preferably, the average scores of people of similar age or physical condition to the user are displayed together so that the user can clearly know the user's physical and mental condition. For example, the user can check the score according to the performance of the virtual reality content by placing the pointer moved by manipulating the controller 1400 on the score confirmation layer (not shown) implemented on the virtual reality content.

In this way, the virtual reality system of the present invention can determine the user's concentration and activity status based on the user's brain wave, heart rate, and electromyography data, and the user operates the controller 1400 to memorize order information, It is possible to prepare, cook, and rest food ingredients, and as a result, the user can focus and stabilize while performing virtual reality content, improving mental health and at the same time improving physical health through physical activity. can be demonstrated.

In one embodiment of the present invention, in the focused content provision step (S120), a plurality of images are displayed to the user in random positions and orders, and the user memorizes the order and position in which the plurality of images are displayed. type content; can be provided.

Specifically, the virtual reality system can display multiple images such as lions, pencils, books, and tissues to the user in random positions and orders. Preferably, the plurality of images can be displayed to the user in a way that they are displayed for a certain period of time (for example, 5 seconds) and then disappear, and the user must memorize the plurality of images displayed in this way.

Subsequently, after all images are displayed at least once, all images are presented to the user, and the user can perform content by selecting an image from among the presented images according to the position and order displayed in the previous step.

Specifically, the content can be performed in such a way that if the user selects an image with the correct location and order, the image disappears, and if not, the color of the image changes. The user can perform the first focused content by deleting all presented images.

In this way, the user can be immersed in the content in the process of performing the first intensive content, and the concentration score for the user can be calculated based on the user's brain wave data measured in the process.

Meanwhile, the number of images provided in the first active content and the time for which the images are displayed may be determined based on the degree of immersion in the concentration state. Specifically, the difficulty of the first active content may vary depending on the number of images provided in the first active content and the time at which the images are displayed, and as described above, this is the user's level of difficulty measured in the game preparation stage (S110). It may be determined based on brain wave data.

Preferably, as the user becomes more immersed in the virtual reality content, the difficulty of the content can be adjusted by increasing the number of images provided and decreasing the time the images are displayed.

In one embodiment of the present invention, in the intensive content provision step (S120), a plurality of ingredients used in snack cooking are presented to the user as images, and the user selects ingredients used in cooking from among the plurality of ingredients. type content can be provided.

Specifically, the virtual reality system presents the ingredients used in the snack cooking task in front of the user as images, and the user selects the ingredients for the snack menu he or she wants to cook among the plurality of images of the presented ingredients. Concentrated content can be performed.

For example, if a user wants to cook tteokbokki in virtual reality content, the user prepares the content by selecting only the ingredients used in snack cooking, such as rice cake, red pepper paste, green onion, fish cake, and water, among a plurality of ingredients used in snack cooking. It can be done.

Like the first intensive content described above, the user can immerse himself in the content during the process of performing the second intensive content, and the concentration score for the user can be calculated based on the user's brain wave data measured in the process. .

As shown in Figure 5, in the centralized content provision step (S120), order information including the customer's order order and order details, recipe information for the dish corresponding to the order information, and information on the order in which work is performed are provided. Third-party intensive content for memorization can be provided.

Specifically, as shown on the left of FIG. 5, the user enters a memorization state when the pointer by the controller 1400 operated by the user is not located at the initial position of the virtual reality content or on the interface that displays order information. And, the brain wave measurement module 1100 may start measuring the user's brain wave data. The virtual reality system can provide third-focused content including order information to users who maintain a focused state longer than a preset level.

In one embodiment of the present invention, the initial position of the pointer of the virtual reality content may be the center of the virtual reality content, and the pointer may be manipulated by the controller 1400 operated by the user. The user can receive third-focused content by maintaining concentration for more than a preset time and placing the pointer on the interface that displays the order information of the orderer. Additionally, if concentration cannot be maintained for more than a preset time in this step, the third focused content is not displayed to the user even if the user's pointer is located on the interface that displays the order information of the orderer.

The right side of Figure 5 is a screen that provides third-focused content to users who maintain concentration for more than a preset time. Specifically, by manipulating the controller 1400 to move the point, the user can select one person among a plurality of orderers and check the order information including the order information and recipe for that orderer.

As described above, users who maintain a long concentration state can record higher scores by being provided with third-focused content with high difficulty. Specifically, when the user's brain waves measured by the brain wave measurement module 1100 are measured as SMR waves with a frequency of 12 to 13 hz for more than 3 seconds, third focused content of high difficulty can be provided, and the brain wave measurement module ( 1100), when the user's brain waves are measured as middle alpha waves with a frequency of 10 to 12 Hz for more than 3 seconds, third intensive content of medium difficulty can be provided. In addition, when the user's brain waves measured by the brain wave measurement module 1100 do not remain focused for more than 3 seconds or have a frequency of more than 13 hz and less than 8 hz, the user is not provided with third-focused content. You can receive third-intensive content of the lowest or lowest level of difficulty.

The user who has performed the memorization step (S100) described above can continue to perform the cooking step (S200). Specifically, in the cooking step (S200), the user can perform the cooking step (S200) based on the focused content performed in the previous memorization step (S100) through the screen displayed through the HMD module (2000) worn by the user. there is.

The user can operate the controller 1400 to perform active content, and the user's movement and electromyography data can be measured by the motion sensor module 1410 and the electromyography measurement module 1300.

Specifically, in the cooking step (S200), the user can perform cooking tasks on virtual reality content by sequentially performing the cooking preparation step (S210) and the active content provision step (S220) as described above. Preferably, the user can record a high score by selecting and cooking appropriate ingredients and cooking tools at each stage and completing the dish in the order order included in the order information.

Users can improve their physical health through the physical activities involved in cooking food and at the same time gain experience in the overall restaurant industry. Specifically, the more physical activity a user engages in performing content, the higher the score can be recorded.

Preferably, a first activity score with a high weight can be recorded while performing a first activity type content with a high activity requirement, and a first activity score with a medium weight value can be recorded while performing a second activity type content with a medium activity requirement. 2 Activity scores can be recorded, and a 3rd activity score with a low weight can be recorded while performing 3rd activity type content with low activity requirements.

In one embodiment of the present invention, a high score is given to a user when the user's movements of chopping meat and vegetables are repeated for 5 minutes or more than 50 times, and a low score is given to a user whose movements are less than the corresponding time and number of times. can be assigned, and the standard for the score can be determined based on the user information received in the game preparation step (S110).

Preferably, a medium score can be given when the user's data measured by the electromyography measurement module 1300 and the motion sensor module 1410 has a frequency of 20 to 235 Hz and is repeated for more than 4 minutes, and the electromyography measurement The highest score can be assigned when the user's data measured by the module 1300 and the motion sensor module 1410 has a frequency of 235 to 450 Hz and is repeated for more than 5 minutes. As a result, users can be encouraged to maintain an active state by performing more physical activities in order to record high scores on virtual reality content.

The user who has performed the above-described cooking step (S200) can continue to perform the stabilizing step (S300). Figure 6 is a screen shown through the HMD module 2000 worn by the user in the stabilization phase (S300). The user who has completed the intensive content and active content can then perform the stabilization phase (S300) of resting. .

The user can operate the controller 1400 to select the background and furniture of the resting stage (S300), and the user's heart rate data can be measured by the heart rate measurement module 1200 during the resting process. Additionally, users can check the performance results and scores of performing virtual reality content while taking a break. Specifically, in the stabilization phase (S300), the user can take a break and end the virtual reality content by sequentially performing the background movement phase (S310), the rest phase (S320), and the score provision phase (S330) as described above.

As shown in (a) of FIG. 6, the user can operate the controller 1400 to relax in the background and furniture selected according to the user's preference. Specifically, the background provided to the user may include a forest, a beach, a home, etc., and the list of furniture on which the user can relax may include a bed, sofa, massage chair, ondol, sunbed, etc. As a result, by providing users with an optimal environment for relaxation, users can relieve mental and physical fatigue and relieve tension caused by performing virtual reality content.

Additionally, as shown in (b) of FIG. 6, the user can check the performance results and scores of performing virtual reality content. Specifically, users can check their physical and mental state by comparing their scores with users who have similar physical conditions, and can check the scores recorded at each stage and their concentration and activity status through visual information. Alternatively, users can check the scores of users who performed content together on social servers.

In this way, by intuitively displaying data according to the user's biosignals, concentration, and activity status on virtual reality content, the user can recognize his or her own condition and can exert the effect of helping the user to stabilize himself. .

In this way, the present invention applies all of the user's brain wave, heart rate, and electromyography data to create virtual reality content that allows users to experience snack cooking tasks, thereby achieving the effect of inducing the user's stability and concentration.

After all of the above-mentioned intensive content, active content, and stable content are terminated, the score calculation unit 3300 calculates a score based on the user's virtual reality content performance results received from the content execution unit, and immerses the user in the virtual reality content. A score can be calculated by assigning weight to the user based on degree and amount of activity.

Specifically, the final score for the user is determined by adding up the concentration score and the activity score, but the final score can be calculated by further reflecting the content memorization state, cooking order, cooking state, and content performance time.

As described above, the concentration score is a score calculated based on the user's concentration state immersion, and includes a comprehensive concentration score calculated based on the concentration state maintenance time and a second concentration score calculated based on the second concentration state maintenance time. It can be determined by adding up. Specifically, by calculating the concentration score in proportion to the maintenance time of the concentration state, users can be encouraged to remain in the concentration state for a long time, and by assigning a high weight to the second concentration state with a high degree of immersion in the concentration state, the user can participate in the content. It can encourage you to become more immersed.

The activity score is a score calculated based on the user's activity status and activity amount. A comprehensive activity score is calculated based on the comprehensive performance results for active content, and is calculated based on the user's performance results at stages with different activity requirements. It can be calculated by adding up the first activity score, second activity score, and third activity score.

Specifically, the first activity score is a score calculated while performing the first activity type content with high activity requirements, and the user performs the required actions in the process of preparing vegetables and meat for a preset time and more than a preset number of times, thereby receiving a high value weight. The first activity score having a By performing more than a preset number of times, a second activity score with a medium weight can be recorded, and the third activity score is a score calculated while performing third activity type content with low activity requirements, and the user A third activity score with a low weight can be recorded by performing the required action for a preset time and more than a preset number of times.

As a result, users can achieve a high concentration score by maintaining a state of concentration for a long time and immersing themselves deeply, and a high activity score by maintaining an active state for a long time and performing a lot of physical exercise.

Meanwhile, the score calculation unit 3300 can calculate the final score by further reflecting the memorization state of the intensive content, the cooking order, the cooking state of the dish, and the cooking time limit.

Specifically, the higher the level of completeness of the dish submitted in the cooking step (S200), the more points can be added if the user completes the dish within the cooking time limit. Additionally, scores can be deducted if the user uses incorrect ingredients or cooks in the wrong order.

In this way, in the present invention, the score for the performance of the virtual reality content is calculated, such as how immersed and active the user was in the content, memorization state, cooking order, cooking state, and whether the dish was completed within the time limit. More accurate evaluation and diagnosis can be performed.

In this way, the score calculation unit 3300 calculates a score based on biometric information such as the user's brain waves, heart rate, and electromyography data while executing virtual reality content, and reflects the user's content performance results. By calculating the final score, users can stabilize their mind and body, immerse themselves in content activities, and improve content participation in order to obtain a higher score.

The virtual reality system of the present invention is intended to improve physical and mental health and prevent various diseases such as dementia, stroke, and myocardial infarction by allowing users to perform virtual reality content in a virtual reality space. In order to expect this effect, the user needs to perform virtual reality content repeatedly, but if the same content is performed repeatedly, there is a risk that the user will easily lose interest and become bored.

Therefore, in the present invention, it is possible to improve user participation in virtual reality content by creating a social server that multiple users can access, interacting with users, and cooperating on content.

As shown in (a) of FIG. 8, the present invention creates a social server that multiple users can access, connects multiple users to the social server, and allows users to cooperate with each other to perform virtual reality content. You can.

Specifically, the social server generator 3400 can receive age, height, and weight from a plurality of individual users, and generate a matching reference value for each user. The matching reference value generated for each user is identical by matching similar users. You can connect to social servers.

In this way, in the present invention, by matching users of similar age and physical ability, the difficulty of virtual reality content performed by a plurality of users in cooperation can be adjusted so that it is not biased toward a specific user.

Meanwhile, in another embodiment of the present invention, the matching reference value for the user may be calculated by considering the user's disease information. Specifically, as described above, the present invention is intended to prevent various diseases such as dementia, stroke, and myocardial infarction, and the virtual reality system can receive medical history information about the user and calculate a matching standard value for it.

In this way, users can collaborate on virtual reality content with users suffering from the same disease and receive psychological comfort.

As shown in (b) of FIG. 8, multiple users connected to a social server can interact with each other or jointly perform content. Specifically, when a specific user performs the first active content of preparing vegetables and meat, another user performs the second active content of cooking tteokbokki, so that a plurality of users can perform the given content individually. .

Additionally, during this process, multiple users can communicate with other users and provide feedback to each other, thereby reducing boredom in the process of repeatedly performing content.

The method of implementing the virtual reality system according to the above embodiment can be implemented by the computing device 11000 shown in FIG. 9. The VR system unit 3000 of FIG. 2 may include components of the computing device 11000 shown in FIG. 9.

As shown in FIG. 9, the computing device 11000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, and an input/output subsystem ( It may include at least an I/O subsystem (11400), a power circuit (11500), and a communication circuit (11600). At this time, the computing device 11000 includes the sensor unit 1000, the VR system unit 3000, and the HMD module 2000, or the sensor unit 1000 by the input/output subsystem 11400, It can be connected to the VR system unit 3000 and the HMD module 2000.

The memory 11200 may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or non-volatile memory. . The memory 11200 may include software modules, instruction sets, or other various data necessary for the operation of the computing device 11000.

At this time, access to the memory 11200 from other components such as the processor 11100 or the peripheral device interface 11300 may be controlled by the processor 11100.

The peripheral interface 11300 may couple input and/or output peripherals of the computing device 11000 to the processor 11100 and the memory 11200. The processor 11100 may execute a software module or set of instructions stored in the memory 11200 to perform various functions for the computing device 11000 and process data.

The input/output subsystem can couple various input/output peripherals to the peripheral interface 11300. For example, the input/output subsystem may include a controller for coupling peripheral devices such as a monitor, keyboard, mouse, printer, or, if necessary, a touch screen or sensor to the peripheral device interface 11300. According to another aspect, input/output peripherals may be coupled to the peripheral interface 11300 without going through the input/output subsystem.

Power circuit 11500 may supply power to all or some of the terminal's components. For example, power circuit 11500 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or a power source. It may contain arbitrary other components for creation, management, and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, if necessary, the communication circuit 11600 may include an RF circuit to transmit and receive RF signals, also known as electromagnetic signals, to enable communication with other computing devices.

This embodiment of FIG. 9 is only an example of the computing device 11000, and the computing device 11000 omits some components shown in FIG. 9, further includes additional components not shown in FIG. 11, or 2 It may have a configuration or arrangement that combines more than one component. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. 9, and the communication circuit 11600 may be equipped with various communication methods (WiFi, 3G, LTE). , Bluetooth, NFC, Zigbee, etc.) may also include a circuit for RF communication. Components that can be included in the computing device 11000 may be implemented as hardware, software, or a combination of both hardware and software, including an integrated circuit specialized for one or more signal processing or applications.

Methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded on a computer-readable medium. In particular, the program according to this embodiment may be composed of a PC-based program or a mobile terminal-specific application. The application to which the present invention is applied can be installed on the computing device 11000 through a file provided by a file distribution system. As an example, the file distribution system may include a file transmission unit (not shown) that transmits the file according to a request from the computing device 11000.

The device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), etc. , may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used by any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. , or may be permanently or temporarily embodied in a transmitted signal wave. Software may be distributed over networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited examples and drawings, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent. Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims

It is a complex sensor-based virtual reality system for preventing brain disease and mental illness through communicative rehabilitation and vocational programs.

The virtual reality system includes a brain wave measurement module that is attached to the user's head and measures the user's brain waves, a heart rate measurement module that is attached to the user's finger and measures the user's heart rate, and a body part including the user's arm. A sensor unit including an electromyography measurement module that is attached to and measures the user's electromyogram; The user memorizes the ingredients presented for a certain period of time, selects the ingredients used for cooking among the plurality of fish presented, and cooks a snack menu including tteokbokki, fried food, and sundae based on the selected ingredients. A VR system unit that executes virtual reality content that can analyze the user's concentration and activity status and derives an evaluation of the user's performance of the virtual reality content; And a HMD module that receives image and sound information of virtual reality content executed from the VR system unit and provides it to the user,

The VR system department,

A sensing information collection unit that receives the brain wave, heart rate, and electromyography data from the sensor unit;

The brain wave, heart rate, and electromyography data of the user wearing the HMD module are applied in real time to run virtual reality content that can perform snack cooking tasks in the virtual reality content, and the concentration and concentration of the user performing the virtual reality content a content execution unit that determines the activity status;

a score calculation unit that calculates a score based on the user's virtual reality content performance results received from the content execution unit and calculates the score by assigning weight to the user based on immersion in the virtual reality content and amount of activity; and

A virtual reality system comprising; a social server generator that generates a social server through which a plurality of users performing the virtual reality content can access and interact with other users while cooperatively performing the virtual reality content.
In claim 1,

The social server creation unit,

A virtual reality system that calculates matching reference values for age, height, and weight received from each of a plurality of users, and creates a social server that multiple users can access based on the matching reference values.
In claim 1,

The content execution department,

Provides focused content that memorizes food ingredient information, order information, and recipe information to the user, determines the user's concentration state based on the user's brain wave data, and calculates a concentration score based on the user's concentration state. Memorization stage;

Provides active content that allows the user to perform snack cooking tasks, determines the user's activity state based on the movement of the controller operated by the user and the user's electromyography data, and based on the user's activity state Cooking step to calculate activity score; and

A stabilization step of providing relaxation content for the user to relax, determining the user's stable state based on the user's heart rate data, and providing a final score calculated based on the concentration score and the activity score; A virtual reality system that performs.
In claim 3,

The memorization step is,

A game preparation step of receiving user information from the user, starting to measure the user's brain wave data, determining whether the user enters a concentration state based on the user's brain wave data, and determining the difficulty level of the intensive content;

Including a focused content provision step of displaying focused content to a user who maintains a focused state for more than a preset time,

The concentrated content is,

First focused content that displays a plurality of images in random positions and order to the user, and in which the user memorizes the order and position in which the plurality of images are displayed;

a second focused content that presents a plurality of ingredients used in powder cooking to the user as images, and allows the user to select ingredients used in cooking from among the plurality of ingredients; and

A virtual reality system comprising: third focused content that memorizes order information including the customer's order order and order details, recipe information for dishes corresponding to the order information, and information on the order in which work is performed.
In claim 3,

The score calculation unit,

Performing a concentration score calculation step of calculating a concentration score for each user based on the concentration state of the user performing the intensive content,

The standard for determining the user's concentration state based on the user's brain wave data in the memorization step is,

When the user's brain wave type and frequency are measured as alpha waves with a frequency of 10 to 13 Hz for more than 3 seconds, which is a preset time, the user is determined to be in a concentrated state,

When the user's brain wave type and frequency are measured as middle alpha waves with a frequency of 10 to 12 Hz for more than 3 seconds, which is a preset time, the first concentration state is determined,

A virtual reality system that determines a second concentration state when the user's brain wave type and frequency are measured as SMR waves with a frequency of 12 to 13 Hz for more than 3 seconds, which is a preset time.
In claim 5,

The concentration score is,

A comprehensive concentration score calculated based on the user's concentration maintenance time in the memorization step; and

Includes a second concentration score calculated based on the user's second concentration state maintenance time in the memorization step,

The method of calculating the concentration score is,

A virtual reality system that is determined by adding up the comprehensive concentration score and the second concentration score, and is calculated by giving the second concentration score a weight having a value greater than the comprehensive concentration score.
In claim 3,

The cooking step is,

A cooking preparation step of providing ingredients and cooking tools used for snack cooking to the user who has completed the memorization step within virtual reality content and starting to measure the user's electromyography data; and

An active content providing step of providing the user with active content that allows the user to perform snack cooking tasks and determining the user's activity state based on the movement of the controller operated by the user and the user's electromyography data. A virtual reality system that does.
In claim 3,

The score calculation unit,

An activity score calculation step of calculating an activity score for each user based on the activity status of the user performing the active content;

The standard for determining the user's activity status based on the user's electromyography data in the cooking stage is,

If the amount of change in the user's electromyography data is 20 to 450 Hz, the user is determined to be in an active state,

If the amount of change in the user's electromyography data is 20 to 235 Hz, the first activity state is determined,

A virtual reality system that determines a second activity state when the user's electromyography data change amount is 236 to 450 Hz.
In claim 8,

The activity score is,

A comprehensive activity score calculated based on the overall performance results of the active content performed by the user in the cooking step;

Content for preparing vegetables and meat used in cooking, comprising: a first activity score calculated based on the user's performance results for the first activity type content whose activity requirement exceeds the first activity requirement;

Content for cooking tteokbokki using prepared ingredients, a second activity score calculated based on the user's performance results for the second activity type content whose activity requirement is less than the first activity requirement and more than the second activity requirement; and

As content for frying fries, it includes a third activity score calculated based on the user's performance results for third activity type content whose activity requirement is less than the second activity requirement,

The method of calculating the activity score is:

The above comprehensive activity score, 1st activity score, 2nd activity score, and 3rd activity score are combined to determine the activity requirement and performance time for the content from which the 1st activity score, 2nd activity score, and 3rd activity score were calculated. A virtual reality system that reflects the decision by assigning different weights to each.
In claim 3,

The stabilization stage is,

A background movement step of moving the user who has completed the cooking step within the virtual reality content from the cooking room to a resting area;

A relaxation content providing step of providing relaxation content that allows the user to relax, and determining that the user is in a stable state when the user's heart rate is 60 to 72; and

A virtual reality system including; a score providing step of adding up the concentration score and the activity score, calculating and providing a final score by reflecting the performance results of the user's virtual reality content.
As a method of implementing a virtual reality system for preventing brain disease and mental illness based on complex sensors through a communicative rehabilitation and vocational program,

The method of implementing the virtual reality system includes a sensor step including an EEG measurement step of measuring the user's EEG using an EEG measurement module and an EMG measurement step of measuring the user's EMG using a heart rate measurement module; The user memorizes the ingredients presented for a certain period of time, selects the ingredients used for cooking among the plurality of fish presented, and cooks a snack menu including tteokbokki, fried food, and sundae based on the selected ingredients. A VR stage that executes virtual reality content that can analyze the user's concentration and activity state and derives an evaluation of the user's performance of the virtual reality content; And an HMD step of receiving image and sound information of virtual reality content executed in the VR step and providing them to the user,

The VR stage is,

A sensing information collection step of receiving the brain wave, heart rate, and electromyogram data from the sensor step;

By applying the brain wave, heart rate, and electromyography data of the user wearing the HMD module in real time, the virtual reality content capable of performing snack cooking tasks in the virtual reality content is executed, and the concentration and activity of the user performing the virtual reality content is performed. A content execution step that determines the status;

A score calculation step of calculating a score based on the user's virtual reality content execution results received in the content execution step and calculating the score by assigning weight to the user based on the user's immersion in the virtual reality content and the amount of activity; and

A social server creation step of creating a social server where a plurality of users performing the virtual reality content can access and interact with other users while cooperatively performing the virtual reality content.
A computer-readable medium for implementing a virtual reality system for preventing brain diseases and mental disorders based on complex sensors through interactive rehabilitation and vocational programs performed on a computing device having one or more processors and one or more memories, the computer-readable medium The medium stores instructions that cause the computing device to perform the following steps, which include:

A sensor step including an EEG measurement step of measuring the user's EEG using an EEG measurement module, and an EMG measurement step of measuring the user's EMG using a heart rate measurement module; The user memorizes the ingredients presented for a certain period of time, selects the ingredients used for cooking among the plurality of fish presented, and cooks a snack menu including tteokbokki, fried food, and sundae based on the selected ingredients. A VR stage that executes virtual reality content that can analyze the user's concentration and activity state and derives an evaluation of the user's performance of the virtual reality content; And an HMD step of receiving image and sound information of virtual reality content executed in the VR step and providing them to the user,

The VR stage is,

A sensing information collection step of receiving the brain wave, heart rate, and electromyogram data from the sensor step;

By applying the brain wave, heart rate, and electromyography data of the user wearing the HMD module in real time, the virtual reality content capable of performing snack cooking tasks in the virtual reality content is executed, and the concentration and activity of the user performing the virtual reality content is performed. A content execution step that determines the status;

A score calculation step of calculating a score based on the user's virtual reality content execution results received in the content execution step and calculating the score by assigning weight to the user based on the user's immersion in the virtual reality content and the amount of activity; and

A social server creation step of creating a social server through which a plurality of users performing the virtual reality content can access and interact with other users while cooperatively performing the virtual reality content.