KR102432248B1 - System And Method For Generating An Avatar And Provides It To An External Metaverse Platform To Update The Avatar And Provide NFT For The Updated Avatar - Google Patents

Abstract

The present invention relates to a system and a method for generating and providing an avatar to an external metaverse platform to update the avatar, and providing an NFT for the updated avatar. The present invention relates to the method and the system for generating the avatar based on user information and providing the NFT for the avatar. The biometric information, activity information, and medical information of a user are received through a VR device, and based on the information, an avatar is generated in virtual reality. Avatar hash information about the avatar is generated, and NFT issuance is requested to an external blockchain network based on the avatar hash information. The NFT is received and provided.

Description

System And Method For Generating An Avatar And Provides It To An External Metaverse Platform To Update The Avatar And Provide NFT For The Updated Avatar}

A system and method for generating an avatar and providing it to an external metaverse platform to update the avatar and provide NFT for the updated avatar, receiving biometric information, activity information, and medical information of a user through a VR device and, based on this, an avatar can be created in virtual reality, the avatar can be provided to an external metaverse platform, and the avatar can be updated by receiving interaction information about the avatar from the metaverse platform, and the update Generates updated avatar hash information for the avatar, requests an external blockchain network to issue an NFT based on the updated avatar hash information, and generates an avatar that provides the NFT by receiving the NFT. It relates to a system and method for updating an avatar by providing it to the metaverse platform and providing an NFT for the updated avatar.

NFT stands for Non-Fungible Token and refers to non-fungible tokens. NFT proves the digital original and gives it the value of scarcity. An NFT is a digital file representing a specific asset, and each NFT has its own uniqueness, so it cannot be replaced with each other and exists on the blockchain. Since NFTs cannot be deleted or forged once created, they can authenticate the original and prove ownership of assets registered as NFTs. Due to the nature of the digital domain, unlimited copying and distribution of digital assets is possible, but by using NFT, scarcity value can be given to digital assets.

Virtual reality, which is used to create an avatar, is a technology that allows a user to experience a virtual space implemented on a computer by wearing an input/output device such as a head mounted display (HMD) device. It is a technology that allows you to experience a specific situation without temporal or spatial restrictions in the implemented virtual space. It was predicted that such virtual reality technology would be difficult to popularize in the near future due to the lack of expensive equipment and virtual reality content. It is also being re-examined.

Metaverse technology enables a four-dimensional virtual space-time that connects economic, social, cultural, and political activities through an avatar, a virtual self. The metaverse technology is a concept including virtual reality, augmented reality, mirror world, and lifelogging. These metaverse technologies are being used in conjunction with various technological fields such as games, education, shopping, medical care and tourism. Therefore, avatar creation is essential.

As a method for building a health care environment for user's health promotion, Korean Patent Application Laid-Open No. 10-2020-0022776 creates a 4D avatar for the user and induces the user to perform a specific operation without requiring the user to visit the hospital. A method for performing rehabilitation exercises has been suggested. However, the prior art simply estimates the user's movement information based on the user's joint information and generates a user avatar that can experience virtual reality. There is no disclosure on a method of generating and improving user immersion. In addition, the conventional techniques as described above do not provide an NFT for the created avatar.

Therefore, by creating an avatar similar to the user's appearance and body characteristics, providing information about the avatar to the metaverse platform, and interacting with the content provided within the metaverse platform, the avatar is optimized for the metaverse. There is a need to develop a system for updating an avatar, granting ownership of the updated avatar to a user of the updated avatar in the digital domain, and providing an NFT for recognition of scarcity.

Republic of Korea Patent Registration No. 10-1943585 (2019.01.23.) Republic of Korea Patent Publication No. 10-2130750 (2020.06.30.)

The present invention relates to a system and method for generating an avatar, providing it to an external metaverse platform, and updating the avatar. A user's biometric information, activity information, and medical information are received through a VR device, and virtual reality based on this information You can create an avatar inside, provide the avatar to an external metaverse platform, receive interaction information about the avatar from the metaverse platform to update the avatar, and update the avatar to the updated avatar. Generates city information, requests an external blockchain network to issue an NFT based on the updated avatar hash information, and generates an avatar that receives the NFT and provides the NFT, and provides the avatar to an external metaverse platform It relates to a system and method for updating an avatar and providing an NFT for an updated avatar.

In order to solve the above problems, an avatar is created and provided to an external metaverse platform to update the avatar, and NFT for the updated avatar is provided. HMD for providing and detecting the user's voice; a camera device that captures the user's appearance and derives image information of the user; an EEG which is attached to the user's head and measures the user's EEG; a pulse meter attached to the user's wrist to measure the user's pulse; and a motion sensing device for measuring the user's movement; a VR device comprising; a VR service unit that communicates with the VR device worn by the user, provides information about virtual reality to the VR device, generates an avatar of the user, and provides a plurality of virtual reality contents to the user; NFT by transmitting original avatar hash information including object information related to the unique properties of the avatar, input information related to the information input by the user, and original information related to the original state of the avatar to an external blockchain network. an original avatar NFT providing unit that requests generation and provides the generated NFT to the user; an avatar update unit that provides information about the avatar to an external metaverse platform, receives interaction information that a user has interacted with using the avatar on the external metaverse platform, and updates the avatar; and updated avatar hash information including object information related to unique attributes of the updated avatar, input information related to information input by the user, and update information related to current and previous version information of the updated avatar. an update avatar NFT providing unit that transmits a request to an external blockchain network to request NFT generation and provides to the user, wherein the VR service unit is available only to the user and provides the plurality of virtual reality contents A virtual reality realization unit that implements the virtual reality being; a VR communication unit that communicates with the VR device to exchange information; the user's biometric information received from the VR device; and a user information input unit for receiving user information including; and activity information and medical information received from the user's smartphone; an avatar generator generating an avatar of the user based on the user information in the virtual reality implemented by the virtual reality implementing unit; and a VR content providing unit capable of providing the plurality of contents to the avatar created in the virtual reality, and updating the appearance of the avatar whenever the avatar is performed. provides

In an embodiment of the present invention, the biometric information includes: image information input through the camera device; EEG information of the user measured by the EEG; and pulse information of the user measured by the pulse meter.

In an embodiment of the present invention, the updated avatar NFT providing unit includes: an updated avatar hash information generating step of generating updated avatar hash information by applying a hash function to the updated avatar information; an update avatar NFT generation request step of transmitting the updated avatar hash information to the external blockchain network to request NFT generation for the updated avatar; and an updated avatar NFT receiving step of receiving the NFT generated by the external blockchain network.

In an embodiment of the present invention, the version information includes a file created for the corresponding avatar version, a sequence number of the corresponding avatar version, a version name of the corresponding avatar version,

Includes the date and time when the corresponding avatar version was updated, multiple photos obtained from different angles for the corresponding version of the avatar, skin condition information of the corresponding version avatar, hair condition information, bone curvature, eye tilt and mouth shape Appearance characteristic information, aging information of the corresponding version of the avatar, and the moving speed of the corresponding version of the avatar may be included.

In an embodiment of the present invention, the updated avatar hash information includes object information, input information, and update information, and the object information includes identification information of a user who created the original avatar of the updated avatar, and the updated avatar. and a date and time when the original avatar of the avatar was created and the name of the updated original avatar of the avatar, wherein the input information includes the user's biometric information received by the VR device, activity information received by the user's smartphone, and medical treatment Receiving information including information and disease information based on the medical information including one or more medical history input by the user, wherein the update information is updated information corresponding to the order of the corresponding version whenever the avatar is updated is generated, and may include version information of the current version of the updated avatar and all previous version information of the updated avatar.

In an embodiment of the present invention, the avatar update unit includes an avatar information providing step of providing information about the avatar to an external metaverse platform; an interaction information receiving step of receiving interaction information corresponding to the avatar from the external metaverse platform; and extracting avatar-related information from the interaction information and updating the avatar based on the avatar-related information.

In an embodiment of the present invention, the avatar update unit includes an avatar information providing step of providing information about the avatar to an external metaverse platform; an interaction information receiving step of receiving interaction information corresponding to the avatar from the external metaverse platform; and extracting avatar-related information from the interaction information and updating the avatar based on the avatar-related information.

In one embodiment of the present invention, the avatar generating unit derives each appearance feature information from a plurality of the image information, and averages the derived plurality of appearance feature information to derive a character determination parameter in the form of a one-dimensional vector, , a basic appearance determining unit for determining a basic appearance of the avatar based on the character determination parameter; an aging information determining unit that inputs the biometric information into one or more artificial neural network models to determine aging information of the avatar, and adds a first graphic effect corresponding to the aging information to the basic appearance; a movement speed determiner for determining the movement speed of the avatar in a manner that increases the movement speed as the movement distance or number of steps increases, based on the movement distance or the number of steps for a preset time derived from the user's smartphone; and determining disease information of the avatar based on medical information including at least one medical history input by the user, and adding a second graphic effect corresponding to the disease information to the basic appearance to which the first graphic effect is added. It may include; a disease information determination unit.

In an embodiment of the present invention, the aging information determining unit includes: a first artificial neural network that receives image information received through the camera device and outputs first aging information; a second artificial neural network that receives the user's EEG information measured by the EEG and outputs second aging information; a third artificial neural network that receives the user's pulse information measured by the pulse meter and outputs third aging information; and a comprehensive determination module for deriving final aging information by summing the first aging information, the second aging information, and the third aging information.

In one embodiment of the present invention, the VR content providing unit, the first content system, which provides content for which the difficulty is determined based on the aging information of the user and can perform the user's cognitive ability and concentration strengthening training study; a second content providing unit for providing content for which difficulty is determined based on the activity information of the corresponding user, and for which the user's physical activity reinforcement training can be performed; a third content providing unit for providing content for which a type of content is determined based on the user's disease information and training for a body part or cognitive ability requiring rehabilitation training; The results of performing the contents provided by the first contents providing unit, the second contents providing unit, and the third contents providing unit, EEG information measured by the EEG measuring device during the execution period for the contents, and Based on the pulse information measured by the pulse meter, the aging information control unit for calculating one or more scores, and adjusting the aging information according to the one or more scores; and an avatar appearance update unit configured to update the appearance of the user's avatar by adjusting the first graphic effect according to the adjusted aging information by the aging information adjusting unit.

In one embodiment of the present invention, the first content provided to the user by the first content providing unit is content for strengthening the user's cognitive ability and concentration, including finding the wrong picture, arithmetic, and jigsaw puzzle; The second content provided to the user by the second content providing unit is content capable of performing the user's physical activity reinforcement training including walking, stretching and squats, and the third content providing unit provides the user with a training The third content provided is that the user performs intensive training on an injured body part or performs intensive training on cognitive ability enhancement including the user's memory, judgment, language ability, and ability to grasp space and time. It may be content for training the user in a weak field by performing the program.

In one embodiment of the present invention, the aging information control unit, concentration score calculation step of calculating an intensity score based on the user's EEG information measured while the user performs the first content; an activity score calculating step of calculating an activity score based on the user's pulse information and EMG information measured while the user performs the second content; an execution result score calculation step of calculating a first score, a second score, and a third score, respectively, based on the execution result of the first content, the execution result of the second content, and the execution result of the third content; and an aging information reduction step of reducing aging information based on the sum of the first score, the second score, the third score, the concentration score, and the activity score.

In order to solve the above problems, an avatar is created and provided to an external metaverse platform to update the avatar, and as a method of providing an NFT for an updated avatar implemented in a system that provides an NFT for the updated avatar, , The system includes: an HMD mounted to a user to provide images and sounds for virtual reality, and to sense the user's voice; a camera device that captures the user's appearance and derives image information of the user; an EEG which is attached to the user's head and measures the user's EEG; a pulse meter attached to the user's wrist to measure the user's pulse; and a motion sensing device for measuring the user's movement; a VR device comprising; a VR service unit that communicates with the VR device worn by the user, provides information about virtual reality to the VR device, generates an avatar of the user, and provides a plurality of virtual reality contents to the user; NFT by transmitting original avatar hash information including object information related to the unique properties of the avatar, input information related to the information input by the user, and original information related to the original state of the avatar to an external blockchain network. an original avatar NFT providing unit that requests generation and provides the generated NFT to the user; an avatar update unit that provides information about the avatar to an external metaverse platform, receives interaction information that a user has interacted with using the avatar on the external metaverse platform, and updates the avatar; and object information related to the unique attribute of the updated avatar, object information related to the unique attribute of the updated avatar, input information related to the information input by the user, and current version information and previous information of the updated avatar. An update avatar NFT provider that requests NFT generation by transmitting updated avatar hash information including update information related to version information to an external blockchain network, and provides the updated avatar NFT provider to the user; including, the method comprising: the VR A virtual reality implementation step of realizing, by the service unit, virtual reality that is available only to the user and provides a plurality of virtual reality contents; a VR communication step of communicating with the VR device and exchanging information by the VR service unit; the user's biometric information received from the VR device by the VR service unit; and a user information input step of receiving user information including; and activity information and medical information received from the user's smartphone; an avatar generating step of generating, by the VR service unit, an avatar of the user based on the user information in the virtual reality implemented by the virtual reality implementing unit; and a VR content providing step of providing, by the VR service unit, the plurality of contents to the avatar created in the virtual reality, and updating the appearance of the avatar each time this is performed. A method for providing an NFT is provided.

1 schematically shows the configuration of a system for generating an avatar and providing a plurality of contents in virtual reality according to an embodiment of the present invention.
2 schematically shows the configuration of a VR service unit according to an embodiment of the present invention.
3 schematically shows a VR device worn by a user using virtual reality and a configuration thereof according to an embodiment of the present invention.
4 schematically illustrates a process of deriving a plurality of appearance feature information for generating a user's avatar according to an embodiment of the present invention.
5 schematically illustrates an operation of an avatar generator according to an embodiment of the present invention.
6 schematically shows a detailed configuration of an aging information determining unit according to an embodiment of the present invention.
7 schematically illustrates an avatar of a user and a capability value of the avatar according to an embodiment of the present invention.
8 schematically shows the configuration of a VR content providing unit according to an embodiment of the present invention.
9 schematically shows the steps performed in the VR content unit according to an embodiment of the present invention.
10 schematically shows a step of reducing aging information according to an embodiment of the present invention.
11 schematically illustrates a process in which an appearance of an avatar is changed according to an embodiment of the present invention.
12 schematically illustrates an execution screen of a first content according to an embodiment of the present invention.
13 schematically illustrates a virtual reality interface shown to a user when an intensity score and an activity score are less than a first reference value according to an embodiment of the present invention.
14 schematically shows the steps performed by the avatar update unit according to an embodiment of the present invention.
15 schematically illustrates interaction information according to an embodiment of the present invention.
16 schematically illustrates an avatar update step based on aging information according to an embodiment of the present invention.
17 schematically illustrates an avatar update step based on a moving speed according to an embodiment of the present invention.
18 schematically illustrates an NFT including updated avatar hash information according to an embodiment of the present invention.
19 schematically shows the performing steps in the update avatar NFT providing unit according to an embodiment of the present invention.
20 schematically illustrates object information according to an embodiment of the present invention.
21 schematically shows input information according to an embodiment of the present invention.
22 schematically shows version information according to an embodiment of the present invention.
23 schematically shows update information according to an embodiment of the present invention.
24 exemplarily shows an internal configuration of a computing device according to an embodiment of the present invention.

In the following, various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of one or more aspects. However, it will also be recognized by one of ordinary skill in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain illustrative aspects of one or more aspects. These aspects are illustrative, however, and some of the various methods in principles of various aspects may be employed, and the descriptions set forth are intended to include all such aspects and their equivalents.

Further, various aspects and features will be presented by a system that may include a number of devices, components and/or modules, and the like. It is also noted that various systems may include additional apparatuses, components, and/or modules, etc. and/or may not include all of the apparatuses, components, modules, etc. discussed with respect to the drawings. must be understood and recognized.

As used herein, “embodiment”, “example”, “aspect”, “exemplary”, etc. may not be construed as an advantage or an advantage in any aspect or design described above over other aspects or designs. . The terms '~part', 'component', 'module', 'system', 'interface', etc. used below generally mean a computer-related entity, for example, hardware, hardware A combination of and software may mean software.

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements and/or groups thereof. should be understood as not

Also, terms including an ordinal number such as first, second, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are generally understood by those of ordinary skill in the art to which the present invention belongs. have the same meaning as Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in an embodiment of the present invention, an ideal or excessively formal meaning is not interpreted as

The virtual reality rehabilitation system performed in the social server of the present invention may be implemented in the form of generating an avatar that mimics the appearance and state of a user, and the user manipulates the avatar to perform a plurality of contents. Hereinafter, a system for generating an avatar in virtual reality for this purpose and providing a plurality of contents will be described.

1. A system that creates an avatar in virtual reality and provides multiple contents

1 schematically shows the configuration of a system for generating an avatar and providing a plurality of contents in virtual reality according to an embodiment of the present invention.

As shown in FIG. 1 , a system for generating an avatar in virtual reality and providing a plurality of contents, the system comprising: an HMD mounted to a user to provide images and sounds for virtual reality, and to sense the user's voice; a camera device that captures the user's appearance and derives image information of the user; an EEG which is attached to the user's head and measures the user's EEG; a pulse meter attached to the user's wrist to measure the user's pulse; a motion sensing device for measuring the user's movement; and an eye tracker for detecting the user's eye movement; a VR device 1000 including; and performing communication with the VR device 1000 worn by the user, providing information about virtual reality to the VR device 1000, and generating an avatar of the user to provide a plurality of virtual reality contents to the user and a VR service unit, wherein the VR service unit includes: a virtual reality implementation unit 2100 that is available only to the user and implements virtual reality in which the plurality of virtual reality contents are provided; a VR communication unit 2200 that communicates with the VR device 1000 to exchange information; the user's biometric information received from the VR device 1000; and a user information input unit 2300 for receiving user information including; and activity information and medical information received from the user's smartphone; an avatar generating unit 2400 for generating an avatar of the user based on the user information in the virtual reality implemented by the virtual reality implementing unit 2100; and a VR content providing unit 2500 capable of providing the plurality of contents to the avatar created in the virtual reality, and updating the appearance of the avatar whenever the avatar is performed. image information input through the device; EEG information of the user measured by the EEG; the user's pulse information measured by the pulse meter; and eye tracking information of the user measured with the eye tracker.

Schematically, the system for generating an avatar in virtual reality and providing a plurality of contents includes the VR device 1000 and the VR service unit, and the VR service unit is included in the computing system 10000 .

Specifically, the VR device 1000 includes one or more components that sense information that can determine the appearance and ability values of the avatar generated by the VR service unit by being mounted on the user or photographing the user's appearance, The components include, as described above, the HMD (Head Mounted Display), the camera device, the EEG, and the pulse meter; and the motion sensing device and the eye tracker. In addition, the VR device 1000 receives the user's biometric information including the image information sensed through each configuration of the VR device 1000, the brain wave information, the pulse information, and the eye tracking information. It can be forwarded to the VR service department. A more detailed description of the VR device 1000 will be described later with reference to FIG. 3 .

The biometric information sensed through the VR device 1000 is transmitted to the computing system 10000 . The VR service unit of the computing system 10000 implements virtual reality, generates an avatar of the user in the virtual reality based on the biometric information, and the user provides a plurality of contents through the avatar.

On the other hand, as an embodiment of the present invention, the computing system 10000, as shown in FIG. 1, can communicate with the social server 3000, and the user can use the avatar generated by the VR service unit. It is possible to communicate with one or more other users within the social server 3000 . In addition, as another embodiment of the present invention, the computing system 10000 may include an additional content unit 4000 that provides content other than the service provided by the VR service unit, preferably, in the virtual reality. A system for generating an avatar and providing a plurality of contents may include the social server 3000 and the additional contents unit 4000 at the same time.

2 schematically shows the configuration of a VR service unit according to an embodiment of the present invention.

As shown in FIG. 2 , the VR service unit includes: a virtual reality implementation unit 2100 that is available only to the user and implements virtual reality in which the plurality of virtual reality contents are provided; a VR communication unit 2200 that communicates with the VR device 1000 to exchange information; the user's biometric information received from the VR device 1000; and a user information input unit 2300 for receiving user information including; and activity information and medical information received from the user's smartphone; an avatar generating unit 2400 for generating an avatar of the user based on the user information in the virtual reality implemented by the virtual reality implementing unit 2100; and a VR content providing unit 2500 capable of providing the plurality of contents to the avatar generated in the virtual reality, and updating the appearance of the avatar whenever the avatar is performed.

Specifically, the virtual reality implementation unit 2100 may implement virtual reality in the computing system 10000 , and transmit information about the virtual reality to the user through the VR communication unit 2200 . The information on the virtual reality may include visual elements such as a virtual reality interface and display; and auditory elements such as sound effects, wherein the audiovisual elements may be delivered to the user through the HMD of the VR apparatus 1000 .

As described above, the VR communication unit 2200 transmits information on the virtual reality implemented by the virtual reality implementation unit 2100 to the user, and the motion information and the biometric information sensed by the VR device 1000 . is transmitted to the computing system 10000 . The motion information and the biometric information are used to create an avatar of the user or perform a plurality of contents in the virtual reality.

The biometric information received through the VR device 1000 is transmitted to the biometric information receiving unit 2310 of the user information input unit 2300 . Meanwhile, as shown in FIG. 2 , the user information input unit 2300 further includes an activity information receiving unit 2320 and a medical information receiving unit 2330 in addition to the biometric information receiving unit 2310 . Each of the activity information receiving unit 2320 and the medical information receiving unit 2330 receives the user's activity information and the user's medical information from the user's smartphone, respectively.

The activity information corresponds to an exercise record recorded in a preset cycle recorded on the user's smartphone, life information recorded in a preset cycle, etc. Include the amount and frequency of water, bedtime and wake-up time. According to an embodiment of the present invention, the activity information may be received through a wearable device capable of recording the activity information. In addition, the medical information includes information on one or more medical history input by the user, and as an embodiment of the present invention, may be generated using a medical record provided by a medical institution.

A plurality of image information generated by photographing the face image and body image of the user through the camera device of the VR device 1000 is received by the biometric information receiver 2310 through the VR communication unit 2200, and the avatar The generating unit 2400 generates the user's avatar in the virtual reality based on the plurality of image information.

The avatar generator 2400 includes a basic appearance determiner 2410 that determines the basic appearance of the avatar, and determines aging information of the user based on a plurality of image information and determines aging information that changes a part of the appearance of the avatar part 2420; a moving speed determining unit 2430 for determining the moving speed of the avatar based on the user's activity information; and a disease information determining unit 2440 that changes a part of the appearance of the avatar based on the medical information. That is, the avatar generator 2400 sets the appearance and capability of the avatar based on the user's biometric information, activity information, and medical information, and implements the avatar in the virtual reality.

The VR contents providing unit 2500 provides a plurality of contents to the avatar in the virtual reality. The plurality of contents may include contents capable of performing cognitive ability and concentration reinforcement training of the corresponding user; Content that can perform physical activity strengthening training for the user; and content capable of performing training on a body part or cognitive ability that requires rehabilitation for the user. A more detailed description of the VR content providing unit 2500 will be described later.

3 schematically illustrates a VR device 1000 worn by a user using virtual reality and a configuration thereof according to an embodiment of the present invention.

Schematically, Fig. 3(a) shows an embodiment in which the user wears the VR device 1000, and Fig. 3(b) shows the HMD 1100 mounted on the user's head. ) and the configuration of the EEG measuring device 1300 , and FIG. 3 ( c ) shows the configuration of the VR device 1000 .

As shown in FIG. 3 , the VR device 1000 includes: an HMD 1100 mounted to a user to provide images and sounds for virtual reality, and to sense the user's voice; a camera device 1200 for photographing the user's appearance to derive image information of the user; an EEG 1300 attached to the user's head to measure the user's EEG; a pulse meter 1400 attached to the user's wrist to measure the user's pulse; a motion sensing device 1500 for measuring the user's movement; and an eye tracker 1600 for detecting the user's eye movement.

Specifically, (a) of FIG. 3 corresponds to an embodiment in which the user wears the VR device 1000, and the camera device 1200 is not separately illustrated. The user preferably takes a face image and body shape image of the user through the camera device 1200 before the user mounts the VR device 1000 shown in FIG. The camera device 1200 may transmit the face image and the body shape image to the biometric information receiver 2310 .

As shown in (a) of FIG. 3 , the pulse meter 1400 may be attached to the user's wrist to measure the user's pulse. That is, the pulse meter 1400 may measure the user's pulse, which is one of the biometric information, and the measured user's pulse is input to the VR service unit to analyze the user's condition or to determine the user's pulse. It can be used for the purpose of allowing the user to smoothly perform content by grasping the psychology of the user, or it can be used to create content provided in virtual reality. Additionally, the pulse meter 1400 may include an EMG sensor to sense the user's pulse information and the user's EMG information and deliver it to the VR service.

As shown in FIG. 3A , the motion sensing device 1500 may measure the user's motion information in the preset space by measuring the user's movement in the preset space. The user's motion information measured in this way may be input to the VR service unit and may be used as a basis for determining a plurality of contents provided by the VR service unit, or may be used for the user to experience the plurality of contents.

The motion sensing device 1500 includes a sensor module capable of sensing movement in the preset space by holding each of the user's hands in both hands, as shown in FIG. 3A , and the present invention As an embodiment of , a sensor module capable of measuring the user's movement in the preset space as an image, such as an infrared sensor or a camcorder, may be included. Meanwhile, according to another embodiment of the present invention, the motion sensing device 1500 is attached to the user's body, such as an acceleration sensor or a gyro sensor, and senses the user's movement in the preset space. can do. Preferably, the preset space corresponds to a space provided with a position sensor module for measuring the coordinates of the motion sensing device 1500 .

3B shows a detailed configuration of the HMD 1100. As shown in FIG. As shown in (b) of FIG. 3, the HMD 1100 is connected to the EEG meter 1300, and the EEG meter 1300 can specify the user's EEG, which is one of the biometric information. . The user's brain waves measured in this way are input to the VR service unit and used for the purpose of analyzing the user's state or understanding the user's psychology to enable the user to smoothly perform content, or in virtual reality. It can be used to create content to be provided.

The HMD 1100 includes: a visual providing unit 1110 that provides a visual element for virtual reality to the user; an auditory providing unit 1120 for providing an auditory element for the virtual reality to the user; and a microphone unit (not shown) for detecting the user's voice.

The VR apparatus 1000 according to an embodiment of the present invention provides information on the virtual reality to the user through the visual providing unit 1110 and the auditory providing unit 1120 so that the user can view the virtual reality. The user's avatar implemented in the virtual reality moves or speaks by receiving the user's voice and behavior through the voice input unit and the motion sensing device 1500 to provide an experience as if existing in a virtual space. can enable you to

As shown in (b) of FIG. 3 , the visual providing unit 1110 provides visual information to provide a three-dimensional effect to both eyes of the user, and additionally, detects the user's eye movement. Includes an eye tracker (1600). In an embodiment of the present invention, the user's eye movement may be sensed and utilized for diagnosis of the user. In addition, it is preferable that the eye tracker 1600 is located on the edge of the time providing unit 1110 so as not to interfere with the time providing unit 1110 providing visual information to the user.

As shown in (c) of Figure 3, the VR device 1000, as described above, the HMD 1100, the camera device 1200, the EEG meter 1300, the pulse meter 1400 , the motion sensing device 1500 , and the eye tracker 1600 .

4 schematically shows the operation of the basic appearance determining unit 2410 according to an embodiment of the present invention.

As shown in FIG. 4 , the basic appearance determining unit 2410 derives respective appearance feature information from a plurality of the image information, and averages the derived plurality of appearance feature information to form a character in the form of a one-dimensional vector. A determination parameter is derived, and a basic appearance of the avatar is determined based on the character determination parameter.

Specifically, the VR service unit communicating with the VR device 1000 includes the avatar generating unit 2400, and the avatar generating unit 2400, as described above with reference to FIG. 2, includes the basic appearance determining unit. 2410 , the aging information determining unit 2420 , the moving speed determining unit 2430 , and the disease information determining unit 2440 . As shown in FIG. 4 , the basic appearance determining unit 2410 receives the user's image information input through the camera device 1200 of the VR device 1000 , and based on the user's image information Thus, a face image and a body shape image are extracted, and a plurality of external shape characteristic information is derived from the extracted face image and the body shape image.

The image information may be a dynamic image of the user including a change in facial expression capable of recognizing the user's emotion, or a plurality of static images of the user continuously recorded at a predetermined period. In particular, the image information should be interpreted in its broadest sense including having two or more image frames. Accordingly, the basic appearance determining unit 2410 classifies the received image information into a plurality of frames, and extracts a face image and a body image from each frame. Then, the appearance feature information can be derived based on the extracted face image. The appearance feature information includes feature information on unique characteristics that can recognize facial expressions, such as the inclination of the eyes, the inclination of the eyebrows, the shape of the mouth and the inclination of the mouth, and additionally, the user's skin condition information, hair condition, etc. information, and the degree of curvature of the skeleton.

On the other hand, FIG. 4 shows only the process of extracting the face image from the plurality of frames as an embodiment of the present invention, and the basic appearance determining unit 2410 is The body shape image may be extracted from a plurality of frames. In this case, preferably, the VR service unit may strictly determine the state of the user's skeleton by requesting various postures from the user.

5 schematically illustrates the operation of the avatar generator 2400 according to an embodiment of the present invention.

As shown in FIG. 5 , the avatar generating unit 2400 derives respective appearance feature information from a plurality of the image information, and averages the derived plurality of appearance feature information to obtain a character determination parameter in the form of a one-dimensional vector. a basic appearance determining unit 2410 for deriving and determining a basic appearance of the avatar based on the character determination parameter; an aging information determining unit 2420 for inputting the biometric information into one or more artificial neural network models to determine aging information of the avatar, and adding a first graphic effect corresponding to the aging information to the basic appearance; a movement speed determining unit 2430 for determining the movement speed of the avatar in a manner that increases the movement speed as the movement distance or number of steps increases, based on the movement distance or number of steps for a preset time derived from the user's smartphone; and determining disease information of the avatar based on medical information including at least one medical history input by the user, and adding a second graphic effect corresponding to the disease information to the basic appearance to which the first graphic effect is added. Including; disease information determination unit 2440;

The appearance feature information includes skin condition information of the user, hair condition information, and a degree of curvature of the skeleton.

Specifically, in the basic appearance determining unit 2410, as described above with reference to FIG. 4 , a plurality of pieces of appearance feature information of the user is derived, and the derived plurality of appearance feature information is averaged to determine a character in a one-dimensional vector form. parameters can be derived. The character determination parameter is a parameter for setting one or more appearance information of the avatar with respect to the basic appearance of the avatar. It is a parameter including the state of the hair, and additionally, as described above, it further includes characteristic information about the unique characteristics that can recognize facial expressions, such as the inclination of the eyes, the inclination of the eyebrows, the shape of the mouth and the inclination of the mouth. can do. The basic appearance determining unit 2410 may implement the basic appearance of the avatar similar to the face and body shape of an actual user in virtual reality through the character determination parameters as described above.

When the basic appearance of the avatar is determined by the basic appearance determining unit 2410, the aging information determining unit 2420 of the avatar generating unit 2400 determines the aging information of the user and reflects it in the appearance graphic of the avatar. do. The aging information determining unit 2420 includes one or more artificial neural networks, and by inputting the biometric information to each artificial neural network model, it is possible to determine the aging information of the user. When the aging information is determined, the aging information determining unit 2420 derives a first graphic effect corresponding to the aging information, and adds the first graphic effect to the basic appearance of the avatar. A more detailed description of the aging information determining unit 2420 will be described later.

The disease information determining unit 2440 adds a second graphic effect corresponding to the disease information to the basic appearance to which the first graphic effect is added. The disease information is generated based on the medical information received from the user's smartphone. The disease information determining unit 2440 receives the medical information through the medical information receiving unit 2330 and generates the disease information based on the medical information. Thereafter, a second graphic effect corresponding to the disease information is calculated. For example, a graphic effect in which the left shoulder is processed in red may be added to the avatar of a user with adhesive capsulitis on the left shoulder, or the avatar of a user suffering from rheumatoid arthritis in the right knee may have the right knee in red. Graphic effects can be added. Meanwhile, the disease information may affect not only the appearance of the avatar but also the ability values of the avatar, which will be described later. As such, the avatar generator 2400 implements the user's avatar in virtual reality based on the user's biometric information and disease information.

6 schematically shows a detailed configuration of the aging information determining unit 2420 according to an embodiment of the present invention.

As shown in FIG. 6 , the aging information determining unit 2420 includes: a first artificial neural network 2421 that receives image information received through the camera device 1200 and outputs first aging information; a second artificial neural network 2422 for receiving the EEG information of the user measured by the EEG measuring device 1300 and outputting second aging information; a third artificial neural network 2423 that receives the user's pulse information measured by the pulse meter 1400 and outputs third aging information; and a comprehensive determination module 2424 for deriving final aging information by summing the first aging information, the second aging information, and the third aging information.

Specifically, the aging information determining unit 2420 according to an embodiment of the present invention may determine the aging information of the user based on one or more of the user's image information, EEG information, and pulse information. At this time, the aging information determining unit 2420 may determine the aging information of the user by analyzing the user's image information, EEG information, and pulse information through one or more artificial neural networks.

As shown in FIG. 6 , the first artificial neural network 2421 to the third artificial neural network 2423 receive and analyze the user's image information, EEG information, and pulse information, respectively, and synthesize the analysis results. transmitted to the diagnosis module, and the comprehensive diagnosis module receives the analysis result, determines and outputs the aging information of the user. Based on the aging information output in this way, referring to the description of FIG. 5 , the aging information determining unit 2420 derives a first graphic effect corresponding to the aging information, and adds the first graphic effect to the basic appearance of the avatar. Add the first graphic effect.

The first artificial neural network 2421 analyzes the user's skin condition information, hair condition information, and the degree of curvature of the skeleton among the plurality of appearance feature information derived from the basic appearance determining unit 2410 to obtain first aging information. derive In addition, the VR service unit may analyze the aging information on the external aspect of the user based on the results of performing various postures requested by the user, and derive the first aging information through this.

The second artificial neural network 2422 derives second aging information by analyzing the EEG information derived from the EEG measuring device 1300 of the VR device 1000 . As an embodiment of the present invention, the second aging information is derived by analyzing the EEG information for the stability of the EEG and the concentration level of the user.

The third artificial neural network 2423 derives third aging information by analyzing the pulse information derived from the pulse meter 1400 of the VR device 1000 . The pulse information includes the user's pulse rate per minute, pulse regularity, and pulse pressure. The third artificial neural network 2423 may calculate the expected age and cardiovascular age of the user based on the pulse information.

The comprehensive determination module 2424 may calculate final aging information by summing the first aging information, the second aging information, and the third aging information. On the other hand, in the aging information, as an embodiment of the present invention, the aging information when the user's aging degree is the lowest is 1, and the aging information when the user's aging degree is the highest is 10. Or it can be derived as a level. Preferably, the comprehensive diagnosis module can be configured to automatically adjust how much weight to derive aging information with respect to the image information, EEG information, and pulse information, and learn about these weights. You can configure the model to do this.

In this way, the aging information determining unit 2420 calculates the final aging information, and selects a first graphic effect corresponding to the aging information among a plurality of first graphic effects stored in the computing system 10000 of the avatar. It can be added to the basic appearance.

7 schematically illustrates an avatar of a user and a capability value of the avatar according to an embodiment of the present invention.

As shown in FIG. 7 , the avatar generating unit 2400 increases the moving speed as the moving distance or number of steps increases based on the moving distance or number of steps for a preset time derived from the user's smartphone. and a moving speed determining unit 2430 for determining the moving speed of the avatar. Meanwhile, the ability values of the avatar shown in FIG. 7 are an embodiment of the present invention, and the actual ability values of the avatar according to the present invention are not limited to those shown in FIG. 7 .

Specifically, the avatar generating unit 2400 may set the capability value of the avatar based on the user's activity information and medical information received from the user's smartphone. As shown in FIG. 7 , the ability values of the avatar include movement speed, muscle mass, and cognitive ability of the avatar.

The moving speed of the avatar may be calculated based on the user's activity information and medical information. For example, data that the user walks an average of 3 km per day for 2 hours for a preset time is recorded in the user's smartphone, and the data may be transmitted to the computing system 10000 . The movement speed determiner 2430 may calculate the movement speed of the avatar based on the data. If, in the above example, exercise records for a preset time are not regularly input to the smart phone, or when data of walking a short distance for a long time is input to the smart phone, the moving speed determining unit 2430 is Through the data, the moving speed of the avatar can be set to be low, and vice versa, when a regular exercise record is input to the smart phone or a large amount of exercise is recorded in the smart phone, the moving speed determining unit 2430 may set the moving speed of the corresponding avatar to be high.

Also, the moving speed of the avatar may be determined by referring to the disease information generated based on the user's medical information. For example, when the user has a disease in the lower body, the movement speed of the avatar is set low, and the degree of the movement speed set low according to the severity of the disease is determined.

The avatar generator 2400 may determine the muscle mass of the avatar based on the user's medical information. As an embodiment of the present invention, the muscle mass of the avatar may be determined based on the user's actual body composition data included in the user's medical information. Referring to the description, the muscle mass of the avatar may be set through the EMG sensor included in the pulse meter 1400 .

By the avatar generator 2400, the cognitive ability of the avatar may be calculated based on the user's EEG information sensed by the EEG sensor 1300 mounted on the user. It may be calculated based on EEG information measured when performing a plurality of contents to be described later, and additionally, when the user performs the plurality of contents through the avatar, the EEG information; and the process and results of performing the plurality of contents.

8 schematically shows the configuration of a VR content providing unit 2500 according to an embodiment of the present invention.

As shown in FIG. 8 , the VR content providing unit 2500 provides content for which the difficulty level is determined based on the aging information of the user, and the user's cognitive ability and concentration reinforcement training can be performed. , a first content providing unit 2510; a second content providing unit 2520 for providing content for which difficulty is determined based on the activity information of the user and can perform physical activity reinforcement training for the user; A third content providing unit 2530 that determines the type of content based on the disease information of the user and provides content that can be trained on a body part requiring rehabilitation of the user or the user's cognitive ability ; As a result of performing content on the content provided by the first content providing unit 2510 , the second content providing unit 2520 , and the third content providing unit 2530 , during the content execution period, the Based on the EEG information measured by the EEG meter 1300, and the pulse information measured by the pulse meter 1400, aging information for calculating one or more scores and adjusting the aging information according to the one or more scores control unit 2540; and an avatar appearance update unit 2550 for updating the appearance of the user's avatar by adjusting the first graphic effect according to the adjusted aging information by the aging information adjusting unit 2540;

The first content provided to the user by the first content providing unit 2510 is content for enhancing the user's cognitive ability and concentration, including finding a wrong picture, arithmetic, and jigsaw puzzle, and the second content system The second content provided to the user in the study 2520 is content capable of performing the user's physical activity strengthening training including walking, stretching and squats, and the third content providing unit 2530 provides the user with the second content. The third content provided to the user performs intensive training on the injured body part or intensive training for cognitive ability enhancement including the user's memory, judgment, language ability, and ability to grasp space and time It corresponds to a content person for training the field in which the user is weak by performing .

Specifically, the first content provided to the user by the first content providing unit 2510 is content provided so that the user can adapt well to virtual reality, and the user is provided with a plurality of contents in virtual reality through the present invention. It may be provided as content for practice for performing the content of That is, the user may learn a method of manipulating the user's avatar in the virtual reality through the first content.

In addition, the VR content providing unit 2500 may evaluate the basic cognitive ability of the user and the concentration of the user by providing the first content to the user, and furthermore, the user may receive the first content By doing so, it is possible to enhance the user's cognitive ability and concentration. On the other hand, as an embodiment of the present invention, the user's immersion feeling can be improved by displaying the user's EEG information measured through the EEG meter 1300 as a separate interface in the virtual reality.

The second content provided to the user by the second content providing unit 2520 is content provided to strengthen the user's insufficient physical ability, and the user can learn how to operate the VR device 1000 through the first content. It corresponds to content that the learned user can perform through a predetermined physical activity. Since the user actually needs to use the user's body to perform the second content in the virtual reality, it is possible to exert the effect of performing physical activity for the user's disease treatment or rehabilitation training.

The VR content providing unit 2500 may evaluate the basic physical ability of the user by providing the second content to the user. The physical ability of the user evaluated at this time, as an embodiment of the present invention, is preferably referred to in determining the difficulty and type of the second content to be provided next.

The third content provided to the user by the third content providing unit 2530 is content provided to the user to strengthen a body part or cognitive ability that requires rehabilitation, and includes a waist, a leg, and an arm. Content that allows users with injuries or specific diseases to perform training to strengthen those body parts; Or, it corresponds to a content that can perform training to strengthen the user's memory, judgment, language ability, and the ability to grasp space and time, the user lacks the ability; corresponds to.

Meanwhile, the first to third contents described above each include one or more contents, and as an embodiment of the present invention, it is preferable to provide different contents to the user every day.

The aging information adjusting unit 2540 adjusts the aging information of the avatar based on data obtained by the user performing the first content, the second content, and the third content. The appearance update unit 2550 updates the appearance of the avatar by adjusting the first graphic effect according to the aging information adjusted by the aging information adjusting unit 2540 . A more detailed description of the operations of the aging information control unit 2540 and the avatar appearance update unit 2550 will be described later.

9 schematically shows the steps performed in the VR content unit according to an embodiment of the present invention, and FIG. 10 schematically shows the aging information reduction step according to an embodiment of the present invention.

As shown in FIGS. 9 to 10 , the aging information adjusting unit 2540 calculates an intensity score for calculating an intensity score based on the user's EEG information measured while the user performs the first content. step; an activity score calculating step of calculating an activity score based on the user's pulse information and EMG information measured while the user performs the second content; an execution result score calculation step of calculating a first score, a second score, and a third score, respectively, based on the execution result of the first content, the execution result of the second content, and the execution result of the third content; and an aging information reduction step of reducing aging information based on the sum of the first score, the second score, the third score, the concentration score, and the activity score;

The concentration score calculation step calculates a score by determining which waveform of the user's EEG received from the EEG meter 1300 is included among beta waves, theta waves, mid alpha waves, and SMR waves, but, of the user's EEG When the frequency corresponds to an SMR wave of 12 to 13 Hz or a mid-alpha wave having a frequency of 10 to 12 Hz, weight is given to calculate the concentration score, and the activity score calculation step includes: The amount of activity of the user is determined based on the deviation value of the user's pulse or the amount of EMG change received from the EMG sensor to calculate the amount of activity score, wherein the deviation value of the pulse is greater than or equal to a preset standard, or the amount of EMG change is 216 to 450 At Hz, weights are given to calculate the activity score.

Specifically, as shown in FIG. 9 , with reference to the description of FIG. 8 , the first content providing unit 2510 provides cognitive ability and concentration reinforcement training content to the user, and the second content providing unit 2520 provides physical activity reinforcement training contents to the user, and the third contents providing unit 2530 provides training contents for a body part or cognitive ability requiring rehabilitation training to the user.

The aging information control unit 2540 calculates a first score based on a result of the user performing the first content, and a second score based on a result of the user performing the second content , and a performance result score calculation step of calculating a third score based on the execution result of the user performing the third content is performed.

The aging information control unit 2540 performs an intensity score calculation step of calculating an intensity score based on the user's brain wave information measured through the brain wave meter 1300 while the user performs the first content, An activity score calculation step of calculating an activity score based on the user's pulse information and EMG information measured through the pulse meter 1400 while performing the second content is performed.

In one embodiment of the present invention, it is determined whether the user's brain wave is included in any of beta wave, theta wave, mid-alpha wave, and SMR wave in the concentration score calculation step, A concentration score may be calculated based on an intensity calculation formula that decreases as the beta wave and theta wave increase, and increases as the mid alpha wave and the SMR wave increase.

In addition, the aging information control unit 2540, the user's pulse information measured through the pulse meter 1400 while the user performs the second content and the EMG sensor included in the pulse meter 1400. The activity score calculation step of calculating an activity score score based on the user's EMG information measured through the Preferably, in the step of calculating the activity score, the activity score is calculated by assigning weights when the deviation value of the user's pulse is greater than or equal to a preset standard or the user's EMG variation is 216 to 450 Hz.

As shown in FIG. 10 , the aging information control unit 2540 includes the concentration score calculated through the concentration score calculation step, the activity amount score calculation step, and the performance result score calculation step, the activity amount score, and the An aging information reduction step of reducing the aging information of the user is performed based on the sum of the first score, the second score, and the third score.

The aging information reduced through the aging information reduction step is transmitted to the avatar appearance update unit 2550, and with reference to the description of FIG. 8, the avatar appearance update unit 2550 provides the first The appearance of the avatar can be updated by adjusting the graphic effect.

11 schematically illustrates a process in which an appearance of an avatar is changed according to an embodiment of the present invention.

Schematically, as shown in FIG. 11, the process of changing the appearance of the avatar according to the aging information adjusted through the aging information reduction step and the aging information reduction step shown in FIG. 10 is shown. On the other hand, the process shown in FIG. 11 is only illustrated in the process of calculating the first score among the performing result score calculation step for explanation, and in the performing result score calculating step and the aging information reduction step, as described above, , the first score, the second score, the third score, the concentration score, and the activity score are all calculated.

Specifically, after the user creates an avatar in virtual reality, the first content providing unit 2510 of the VR content providing unit 2500 provides the first content to the avatar (S100). The first content corresponds to content for reinforcing the user's cognitive ability and concentration, as described above. The user performs the first content through the avatar in the virtual reality (S200).

When the aging degree control unit receives the result of performing the first content by the avatar (S300), the aging level control unit calculates a first score based on the execution result (S400). carry out

The normal aging degree adjusting unit adjusts the aging information of the user with reference to the first score (S500). Preferably, in step S500, as described above, in addition to the first score, the first score, the second score, the third score, the concentration score, and the activity score Based on the user's aging information is adjusted.

The aging degree adjusting unit transmits the adjusted aging information to the avatar appearance update unit 2550 (S600), and the avatar appearance update unit 2550 adjusts the basic appearance of the avatar according to the received adjusted aging information. The applied first graphic effect is adjusted (S700). The first graphic effect is the aging among a plurality of first graphic effects pre-stored in the computing system 10000 based on the aging information calculated by the aging information determining unit 2420 with reference to the description of FIG. 6 . It corresponds to the first graphic effect corresponding to the aging information calculated by the information determination unit 2420, and when the avatar appearance update unit 2550 receives the adjusted aging information, the avatar appearance update unit 2550 returns the The appearance of the avatar may be changed to a graphic effect corresponding to the adjusted aging information among a plurality of first graphic effects pre-stored in the computing system 10000 ( S800 ).

12 schematically illustrates an execution screen of a first content according to an embodiment of the present invention.

Schematically, (a) of FIG. 12 shows an execution screen shown to the user when the first content is provided to the user, and (b) of FIG. 12 is after the user performs the first content , shows an execution screen in which the execution result is shown to the user. Meanwhile, FIG. 12 shows an execution screen of the first content shown to the user as an embodiment of the present invention, but also the execution screen of the second content, the third content, or a sudden content to be described later in FIG. An execution screen as shown in may be provided to the user through the HMD 1100 .

Specifically, as shown in FIG. 12 , the VR service unit may provide information to the user through a floating-interface. 12A illustrates an interface provided through the HMD 1100 mounted by the user when the first content is provided to the user by the first content providing unit 2510 . The user may select “yes” or “no” in the floating interface shown in FIG. 12 (a) by manipulating the VR device 1000, and when the user selects “yes”, the user The first content may be performed by manipulating the VR device 1000 mounted on the user.

When the user performs the first content, the execution result may be indicated to the user through a floating interface as shown in FIG. 12(b). Meanwhile, the execution result item shown in FIG. 12B is an embodiment of the present invention, and the execution result item may be different depending on the type of content. For example, when the content provided to the user is the walking content of the second content, walking time, distance, and moving speed may be specified in the floating interface as the execution result items.

13 schematically illustrates a virtual reality interface shown to a user when an intensity score and an activity score are less than a first reference value according to an embodiment of the present invention.

Schematically, FIG. 12(a) shows that the sharpness of an object existing in the virtual reality or the field of view of the avatar is adjusted, and FIG. 12(b) is an execution screen when unexpected content is provided to the user shows

As shown in FIG. 13 , the VR content providing unit 2500 provides an object existing in the virtual reality when the detailed sum of the concentration score and the activity score during a preset section is less than a preset first reference value. The first content providing unit 2510, the second content providing unit when the detailed sum of the concentration score and the activity score during a preset section is less than the first reference value. (2520) or by providing the unexpected content in the middle of the content being provided by the third content providing unit 2530, when the user performs the unexpected content, the clarity of the object or the avatar's view in the virtual reality return to default.

Specifically, the VR content providing unit 2500 determines that the concentration of the user has dropped when the detailed sum of the concentration score and the activity score during a preset section is calculated to be less than a preset first reference value, and , can be notified to the user in the following manner. As shown in the left drawing of FIG. 13 (a), the sharpness of an object existing in the virtual reality provided through the HMD 1100 mounted by the user is lowered, or in the right drawing of FIG. 13 (a). As shown, the view of the avatar can be adjusted through an opaque floating interface.

The VR content providing unit 2500 may provide the unexpected content to the user when the detailed summation value is calculated to be less than the first reference value. The sudden content is a content provided to the user in order for the user to improve concentration on the VR content, and preferably, like the first content, provides content with relatively easy difficulty.

As shown in (b) of FIG. 13, when the unexpected content is provided to the user, referring to the description of FIG. 12, like the first to third content, by providing a floating interface to virtual reality It is possible to provide the unexpected content to the user. When the detailed sum of the concentration score and the activity score calculated when the user performs the unexpected content is calculated to be greater than or equal to a preset first reference value, the sharpness of the object existing in the virtual reality is restored to the default value, and the opaque floating The interface disappears.

As an embodiment of the present invention, when the detailed sum of the concentration score and the activity score when performing the unexpected content is less than the first reference value, the VR content providing unit 2500 provides a floating interface recommending a break. can be provided to users.

2. A system that creates an avatar, provides it to an external metaverse platform, and updates the avatar

As described above, the system for generating the avatar of the present invention and providing it to the external metaverse platform 5000 and updating the avatar generates the avatar based on user information, and based on the performance result, concentration and activity amount according to the content performance. to update the appearance of the avatar. Meanwhile, the system for updating the avatar provides information about the avatar to an external metaverse platform 5000. Hereinafter, information on the avatar is provided to the external metaverse platform 5000 for interaction A system for receiving information and updating the avatar will be described in detail.

In order to provide an avatar to a user in the metaverse platform 5000, a method of providing a specific character is often used. However, when the metaverse platform 5000 is used as an avatar reflecting the user's information, the feeling of being in the metaverse platform 5000 may be more interesting. In addition, the avatar and the user can feel a sense of unity in the metaverse platform 5000 . Accordingly, a method for updating and providing an avatar suitable for the metaverse platform 5000 based on the avatar created in the present invention is presented.

14 schematically shows the steps performed by the avatar update unit according to an embodiment of the present invention.

As shown in FIG. 14 , information about the avatar is provided to an external metaverse platform 5000 , and interaction information that a user has interacted with using the avatar is received on the external metaverse platform 5000 . , an avatar update unit that performs an update on the avatar, wherein the avatar update unit provides information about the avatar to an external metaverse platform (5000), and uses the external metaverse platform (5000). an avatar information providing step (S900) of receiving interaction information that a user has interacted with using the avatar, updating the avatar, and providing information on the avatar to an external metaverse platform (5000); an interaction information receiving step (S920) of receiving interaction information corresponding to the avatar from the external metaverse platform (5000); and extracting avatar-related information from the interaction information and updating the avatar based on the avatar-related information (S930).

Specifically, the step of providing the avatar information is a step of providing information on the avatar created in the present invention to the outside. As described above, the avatar receives the user's biometric information, activity information, and medical information through the VR device and is generated based on it, and some or all of the information on the avatar is provided to the external metaverse platform 5000 . can do. The user's medical information reflected in the avatar may not be transmitted according to security.

Then, in the external metaverse platform 5000 that has received the avatar information, the user uses the avatar, and interaction information according to the user's avatar use is generated. Specifically, the interaction information may refer to information for updating an avatar according to the usage situation of the external metaverse platform 5000 , and may vary depending on services provided by the external metaverse platform 5000 . For example, interaction information when the external metaverse platform 5000 provides a medical service and when the metaverse platform 5000 provides a game may be different.

According to an embodiment of the present invention, the avatar used by the user in the external metaverse platform 5000 is the avatar created in the present invention or information about the avatar received by the external metaverse platform 5000 is reflected. It may correspond to an avatar provided by an external metaverse platform 5000 .

The computing system that has received the interaction information from the external metaverse platform 5000 performs an avatar update based on the interaction information. Specifically, the interaction information includes all information generated by the user using the avatar in the external metaverse platform 5000, so only information related to the avatar is extracted and used from the interaction information. The avatar may be updated based on the extracted interaction information related to the avatar. According to an embodiment of the present invention, the information related to the avatar in the interaction information may vary depending on the service provided by the external metaverse platform 5000 , so that the avatar matches the characteristics of the external metaverse platform 5000 . can have the effect of updating

Hereinafter, a case in which the external metaverse platform 5000 provides a game will be described.

15 schematically illustrates interaction information according to an embodiment of the present invention.

As shown in FIG. 15 , the interaction information is, when the game is provided on the external metaverse platform 5000, usage time, level-up information, the number of collected items, the number of items worn, the number of acquired skills, and quests. It may include the number of clears.

Specifically, all information generated while a user plays a game using an avatar in the external metaverse platform 5000 is stored as interaction information, and when the external metaverse platform 5000 provides a game, , time spent using the avatar by the user, level-up information about the level of the game by the user using the avatar, the number of items collected by the user using the avatar, the number of items worn by the user on the avatar, The number of acquired skills acquired for the avatar and the number of quest cleared by the user using the avatar in the quest in the external metaverse platform 5000 may be included in the interaction information, and from the interaction information to information related to the avatar Usage time, level-up information, the number of collected items, the number of worn items, the number of acquired skills, and the number of quest cleared may be extracted.

16 schematically illustrates an avatar update step (S930) based on aging information according to an embodiment of the present invention.

As shown in FIG. 16 , in the avatar update step S930, when the game is provided on the external metaverse platform 5000, the aging based on the level-up information, the number of collected items, and the number of quest cleared. The information may be adjusted, and the avatar may be updated with respect to the skin condition information, the hair condition information, the degree of curvature of the skeleton, the inclination of the eyes, and the shape of the mouth based on the aging information.

Specifically, in the present invention, aging information is generated based on some or all of the user's plurality of image information, the user's brain wave information, and the user's pulse information. In order to update the avatar suitable for the game provided by the external metaverse platform 5000, the aging information is adjusted based on some of the interaction information. Preferably, the information corresponding to the interaction information for controlling the aging information may be the level-up information, the number of items to be collected, and the number of clear quests.

The avatar is updated based on the aging information adjusted to fit the game provided by the external metaverse platform 5000 . All elements that can be expressed in the aging of the avatar can be updated, but preferably, the skin condition information, hair condition information, the degree of curvature of the skeleton, the inclination of the eyes, and the mouth shape of the avatar can be updated.

17 schematically illustrates an avatar update step (S930) based on a moving speed according to an embodiment of the present invention.

As shown in FIG. 17 , in the avatar update step ( S930 ), when the game is provided on the external metaverse platform 5000 , the movement speed is based on the use time, the number of acquired skills and the number of worn items. may be adjusted, and the avatar may be updated based on the movement speed.

Specifically, in the present invention, the movement speed of the avatar is determined in such a way that the movement speed increases as the movement distance or number of steps increases based on the movement distance or the number of steps for a preset time derived from the user's smartphone. In order to update the avatar suitable for the game provided by the external metaverse platform 5000, the moving speed is adjusted based on some of the interaction information. Preferably, the avatar is updated based on the use time, the number of acquired skills, and the number of worn items.

On the other hand, the movement speed adjusted based on the interaction information may increase the movement speed as the usage time increases and the number of acquired skills increases, and may decrease the movement speed as the number of worn items increases. Therefore, as shown in FIG. 17, the movement speed is increased by '3' than before, which is part or all of the use time increased, the number of acquired skills increased, or the number of worn items decreased. can mean

The ability value of the avatar shown in FIG. 17 is an embodiment of the present invention, and the actual ability value of the avatar according to the present invention is not limited to that shown in FIG. 17 .

3. A system that creates an avatar and provides it to an external metaverse platform to update the avatar and provide NFT for the updated avatar

The "blockchain network" referred to below is an embodiment of the present invention, and a private blockchain technology, which is a blockchain independently used by one institution; Alternatively, it is desirable to apply consortium blockchain technology, in which several institutions form a consortium and only authorized institutions can participate in the network. In this case, the "blockchain network" means the entire block chain using the above-mentioned private block chain technology or consortium block chain technology, or a plurality of nodes belonging to the block chain based on the private block chain technology or consortium block chain technology. means

On the other hand, as another embodiment of the present invention, the "blockchain network" can be a public blockchain technology that anyone can participate in the network, and in this case, the "blockchain network" referred to below is the public block It can mean a plurality of nodes belonging to a blockchain based on chain technology.

As described above, the system for generating an avatar of the present invention, providing it to an external metaverse platform, and updating the avatar creates the avatar based on user information, and generates the avatar based on the performance result, concentration and activity amount according to the content performance. Appearance can be updated, and the avatar is provided to an external metaverse platform to receive interaction information and update the avatar based on this. On the other hand, the system providing the NFT for the updated avatar requests generation of the NFT for the updated avatar based on the interaction information and provides the NFT. Hereinafter, the updated avatar hash information of the updated avatar is generated. and a system that provides NFT for the updated avatar by registering it in an external blockchain network will be described in detail.

When an avatar containing user information is created and the avatar is provided to an external metaverse platform, the problem of ownership of the avatar and the scarcity of the original avatar may be affected. When NFT is issued for the created avatar, the metaverse platform can authenticate the originality of the avatar, which is the user's asset, and prove ownership. On the other hand, if the NFT is issued for each updated avatar, the update history of the updated avatar cannot be known.

Accordingly, the present invention provides a method of providing an NFT including continuous update information for an updated avatar.

18 schematically illustrates an NFT including updated avatar hash information according to an embodiment of the present invention.

As shown in FIG. 18 , the original avatar hash information including object information related to the unique attribute of the avatar, input information related to the information input by the user, and original information related to the original state of the avatar is externally transmitted. may include; an original avatar NFT providing unit that transmits to a blockchain network of transmits updated avatar hash information including input information related to the information entered by the and an updated avatar NFT providing unit provided to the user, wherein the original avatar NFT providing unit includes: an avatar hash information generating step of generating avatar hash information by applying a hash function to the information on the avatar; an avatar NFT generation request step of requesting NFT generation for the avatar by transmitting the avatar hash information to the external blockchain network; and an avatar NFT receiving step of receiving the NFT issued by the external blockchain network.

Specifically, in order to generate a user's avatar, various types of information such as information about the user and information generated by the user are required. Among the various pieces of information, in generating the NFT of the avatar, the updated avatar hash information may correspond to information desired to be registered in the NFT and/or information for indicating the scarcity and ownership of the avatar.

The update avatar hash information may include object information, input information, and update information. The object information, the input information, and the update information may include a plurality of pieces of information, not single information. The object information may include information corresponding to information related to a unique attribute of the avatar, the input information may include information about a user input by a user, and the update information may include current avatar version information and All previous version information may be included. A detailed description of the update information will be provided later.

When an external blockchain network is requested to generate an NFT for the updated avatar, an NFT including the updated avatar hash information may be generated in an external blockchain network based on the updated avatar hash information. The NFT may include updated avatar hash information. Detailed steps will be described later.

In one embodiment of the present invention, information included in the updated avatar hash information may vary according to the purpose of the metaverse platform on which the corresponding avatar is provided. For example, when the corresponding avatar is provided to a metaverse platform that provides health care content, the updated avatar hash information may be generated by further including information related to the user's health condition.

The original avatar NFT provider according to an embodiment of the present invention may provide an NFT corresponding to an original avatar that is an original version before the avatar is updated, and the updated avatar NFT provider may provide an avatar after the first version (updated avatar). ) can provide NFT.

19 schematically shows the performing steps in the update avatar NFT providing unit according to an embodiment of the present invention.

As shown in FIG. 19 , the updated avatar NFT providing unit generates updated avatar hash information by applying a hash function to the updated avatar information to generate updated avatar hash information (S1110); an updated avatar NFT generation request step (S1120) of transmitting the updated avatar hash information to the external blockchain network to request NFT generation for the updated avatar; and an updated avatar NFT receiving step (S1140) of receiving the NFT generated by the external blockchain network.

Specifically, the updated avatar hash information generation step (S1110) is performed by applying a hash function to the information on the updated avatar generated in the present invention that can obtain a suitable effect by registering it in the NFT to generate the updated avatar hash information. This is the creation step. The updated avatar hash information is in a form transformed into a hash value through a hash function.

According to an embodiment of the present invention, the information on the updated avatar may include a plurality of pieces of information, each of which can be transformed into a hash value through a hash function, and the updated avatar hash information is the updated avatar. Each hash value of the information may be included. That is, the information on the updated avatar is classified according to the criteria, each of the information on the updated avatar of the same classification is transformed into a hash value through a hash function, and all of the information on the updated avatar of the same classification is combined through a hash function. A hash value including all information about the avatar is derived. That is, the updated information on the avatar has a Merkle tree format, and a hash value including all information on avatars of the same class means a Merkle root, and the updated hash information includes a plurality of Merkle roots. can For example, the updated information on the avatar may include object information, input information, and update information, and the object information may include identification information, a creation date and time, and an avatar name. Obtaining a hash value for each of the identification information, the generated date and time, and the avatar name, summing these three hash values to obtain a hash value of the object information, and the input information and the updated information in this way When a hash value is obtained for each of a plurality of pieces of information corresponding to the update information, the object information, the input information, and the update information each become a merkle root, and the three merkle roots can be derived as update avatar hash information.

According to another embodiment of the present invention, the updated information on the avatar may include a plurality of pieces of information, each of which can be transformed into a hash value through a hash function, and the updated avatar hash information is updated. The hash value may be a hash value transformed into a hash value through a hash function by summing the hash values of each information about the avatar. That is, the updated avatar information may have a merkle tree format, and the updated avatar hash information may correspond to a merkle root. For example, the updated information on the avatar may include object information, input information, and update information, and the object information may include identification information, a creation date and time, and an avatar name. Obtaining a hash value for each of the identification information, the generated date and time, and the avatar name, summing these three hash values to obtain a hash value of the object information, and the input information and the updated information in this way After obtaining a hash value for each of a plurality of pieces of information corresponding to the update information, the hash values for the input information and the update information may be obtained by summing the respective hash values. Subsequently, a hash value of the updated avatar hash information may be derived by summing the hash values for the object information, the input information, and the update information.

As described above, the avatar receives the user's biometric information, activity information, and medical information through the VR device, is generated based on the received biometric information, and is provided to an external metaverse platform to generate interaction information. The avatar is updated based on the interaction information, the updated avatar may include different information when compared to the original avatar, and some or all of the information included in the updated avatar is in the updated avatar hash information. included, and the updated avatar hash information may include object information, input information, and update information, and details of the updated avatar hash information will be described later.

Some or all of the plurality of pieces of information may be included in the updated avatar hash information, and the updated avatar hash information may include object information, input information, and update information. Details of the updated avatar hash information will be described later.

Next, after performing the update avatar NFT generation request step (S1120) of registering the updated avatar hash information to an external blockchain network and requesting NFT generation for the updated avatar, the data generated by the external blockchain network is generated. An avatar NFT receiving step (S1140) of receiving NFT is performed.

According to an embodiment of the present invention, the external block chain network does not mean a specific block chain network, but a block chain network that can generate NFTs such as Ethereum, Binance smart chain, Polkadot, and Tron. have.

In an embodiment of the present invention, NFT reception may mean a link or token URI of an NFT, and avatar hash information included in the NFT may mean metadata.

20 schematically illustrates object information according to an embodiment of the present invention.

20 , the updated avatar hash information includes object information, input information, and update information, and the object information includes identification information of a user who created the original avatar of the updated avatar, and the updated avatar. The date and time when the original avatar of the avatar was created and the name of the updated original avatar of the avatar may be included.

The computing system 10000 stores all information used while generating the avatar and all information used while updating the avatar, among which information to be registered in the NFT corresponds to the updated avatar hash information.

Specifically, the object information is included in the updated avatar hash information and is information related to the objective facts about the updated avatar. The object information may include user identification information, the date and time the original avatar was created before updating the avatar, and the avatar name of the original avatar before updating the avatar, and the identification information provides information used to create the original avatar. It is identification information including a name and contact information of a user, the generated date and time is the date and time when the original avatar is finally created using the user's information, and the avatar name is the name of the original avatar designated by the user.

21 schematically shows input information according to an embodiment of the present invention.

As shown in FIG. 21 , the input information includes the user's biometric information received with the VR device, received information including activity information and medical information received with the user's smartphone, and 1 inputted by the user. It may include disease information based on the medical information including the above medical history.

The computing system 10000 stores all information used while generating the avatar and all information used while updating the avatar, among which information to be registered in the NFT corresponds to the updated avatar hash information.

Specifically, the input information is included in the updated avatar hash information and is information related to information input by the user to generate the original avatar. The input information includes biometric information, reception information, and disease information. When the metaverse platform provides a game, the input information includes information corresponding to the avatar updated by the interaction information and information corresponding to the original avatar. It may be information that has not changed when comparing

The biometric information may include image information, brain wave information, pulse information, and eye tracking information, and is sensed through the VR device 1000 . The image information is received by photographing the user's face image and body shape image through a camera device, the EEG information is information obtained by measuring the user's EEG with an EEG measuring device, and the pulse information is measuring the user's pulse with a pulse meter. information, and the eye tracking information is information measured by the user's eye tracking measured with an eye tracker.

The reception information includes activity information and medical information, the activity information and the medical information are received from a user's smartphone, and the activity information can be collected through a wearable device connected to the smartphone, etc. It corresponds to an exercise record, life information, etc. corresponding to the user's activity, and may be recorded at a preset period. For example, it includes calories burned, exercise time, steps per day, steps per day, amount and number of water drinks per day, bedtime and wake time, and the like.

The disease information is determined based on medical information on one or more medical history input by a user, and as an embodiment of the present invention, the medical information may be generated using a medical record provided by a medical institution.

22 schematically shows version information according to an embodiment of the present invention.

As shown in FIG. 22 , the version information includes a generated file of the corresponding avatar version, the order number of the corresponding avatar version, the version name of the corresponding avatar version, the date and time the corresponding avatar version was updated, and different angles for the corresponding version of the avatar. a plurality of photos acquired with the avatar, skin condition information of the corresponding version of the avatar, hair condition information, the degree of curvature of the skeleton, appearance characteristic information including the inclination of the eyes and the shape of the mouth, aging information of the corresponding version of the avatar, and the corresponding version of the avatar may include the movement speed of

The computing system 10000 stores all information used while generating the avatar and all information used while updating the avatar, among which information to be registered in the NFT corresponds to the updated avatar hash information.

Specifically, the version information is included in the updated avatar hash information and is information related to the updated avatar corresponding to the time of generating the updated avatar. The version information includes a plurality of photos of the corresponding version avatar, appearance characteristic information of the corresponding version avatar, aging information of the corresponding version avatar, the moving speed of the corresponding version avatar, the generation file of the corresponding version avatar, the order number of the corresponding avatar version, and the corresponding avatar version may include a version name of the avatar and the date and time when the corresponding avatar version was updated, the plurality of photos are obtained at different angles with respect to the corresponding version of the avatar, and preferably, the plurality of photos are the corresponding version avatar reflecting user information. characteristics (eg, the face of the avatar, a portion in which graphic effects corresponding to disease information are visualized, a portion in which appearance characteristic information is visualized, etc.) are acquired.

In an embodiment of the present invention, the avatar of the corresponding version may mean an avatar updated from an avatar of a previous version, and the first previous version avatar may correspond to an original avatar that is initially created and not updated by the user.

The appearance feature information of the corresponding version is information updated from the appearance feature information of the previous version.

Specifically, the appearance characteristic information of the original avatar is derived from the face image and body shape image of the image information obtained from the user, and facial expressions such as eye tilt, mouth shape, mouth tilt, eyebrow tilt, etc. can be recognized. It may include characteristic information on intrinsic characteristics, skin condition information of the user, hair condition information, and the degree of curvature of the skeleton.

When the original avatar is updated to the corresponding version avatar based on the interaction information generated by performing the contents provided by the external metaverse platform, and the appearance characteristic information of the original avatar is updated based on the interaction information, the corresponding version avatar is Appearance characteristic information is derived, and the corresponding appearance characteristic information is included in the version information of the corresponding version avatar.

In addition, for the updated avatar other than the original avatar, the previous version avatar is updated to the corresponding version avatar based on the interaction information generated by performing the contents provided by the external metaverse platform, and the appearance characteristics of the previous version avatar When the information is updated based on the interaction information, appearance characteristic information corresponding to the corresponding version avatar is derived, and the corresponding appearance characteristic information is included in the version information of the corresponding version avatar.

The aging information of the corresponding version is information updated from the aging information of the previous version.

The aging information of the original avatar may be determined by inputting the biometric information in one or more artificial neural network models. Specifically, it is possible to derive the aging information of the original avatar by receiving the user's image information, EEG information, and pulse information, analyzing it through one or more artificial neural networks, and summing the results of each analysis.

When the original avatar is updated to the corresponding version avatar based on the interaction information generated by performing the content provided by the external metaverse platform, and the aging information of the original avatar is updated based on the interaction information, Aging information is derived, and the aging information is included in the version information of the corresponding version avatar.

In addition, for an updated avatar other than the original avatar, the previous version avatar is updated to the corresponding version avatar based on the interaction information generated by performing the contents provided by the external metaverse platform, and aging information of the previous version avatar is updated based on the interaction information, aging information corresponding to the corresponding version avatar is derived, and the aging information is included in the version information of the corresponding version avatar.

The moving speed of the corresponding version is information updated from the moving speed of the previous version.

The movement speed of the original avatar may be determined by increasing the movement speed as the movement distance or number of steps increases based on the movement distance or number of steps for a preset time derived from the user's smartphone, and based on the user's medical information The movement speed can be determined by referring to the generated disease information. For example, when the disease information corresponds to the lower body, the movement speed may be set low.

When the original avatar is updated to the corresponding version avatar based on the interaction information generated by performing the content provided by the external metaverse platform, and the movement speed of the original avatar is updated based on the interaction information, The movement speed is derived, and the movement speed is included in the version information of the corresponding version avatar.

In addition, for an updated avatar other than the original avatar, the previous version avatar is updated to the corresponding version avatar based on the interaction information generated by performing the contents provided by the external metaverse platform, and the movement speed of the previous version avatar is updated based on the interaction information, a movement speed corresponding to the corresponding version avatar is derived, and the corresponding movement speed is included in the version information of the corresponding version avatar.

According to an embodiment of the present invention, the generated file may be a 3D file in which the corresponding version avatar is stored, and may be a file having an extension in a format that can be implemented in the metaverse platform. The order number may be a number corresponding to the corresponding avatar version that continuously increases starting with the order number of the original avatar. The version name may be a name capable of expressing a corresponding version avatar different from the avatar name included in the object information. For example, the version name may be created by adding the order number of the corresponding version to the avatar name.

23 schematically shows update information according to an embodiment of the present invention.

As shown in FIG. 23 , the update information is generated every time the avatar is updated, and update information corresponding to the corresponding version number is generated, and includes version information of the current version and all previous version information of the updated avatar. can do.

Specifically, the updated avatar means an avatar updated based on interaction information, and an avatar of a current version is created by updating an avatar of a previous version. More specifically, the original avatar, which is the first non-updated avatar created by the user, is provided to the metaverse platform, generates interaction information using the content provided by the metaverse platform, and based on the interaction information, the original avatar is provided. You can update your avatar with UpdateAvatar #1. In addition, the update avatar #1 is provided on the metaverse platform to generate interaction information using the content provided by the metaverse platform, and the update avatar #1 can be updated to update avatar #2 based on the interaction information. have. Accordingly, the update avatar may be continuously updated from the original avatar to the updated avatar having the corresponding sequence number.

In another embodiment of the present invention, the avatar may be updated with a plurality of versions based on the previous version of the avatar. For example, when the updated avatar #1 is provided to a plurality of metaverse platforms, each interaction information is generated according to the content provided by each metaverse platform, and the updated avatar #1 is based on each interaction information. Then, it can be updated to update avatar #1-1, update avatar #1-2, etc.

The updated avatar includes the above-described object information, input information, and corresponding version information of the updated avatar, and the version information is included in update information having a sequence number of the corresponding version. Specifically, the version information and the update information are generated in the same order as the avatar whenever the avatar is updated, and the update information is generated by adding the current version information to the update information of the previous version. More specifically, the update information includes all version information of the previous version and current version information. For example, as shown in FIG. 23 , the version information of the updated avatar #2 is the version information #2, the update information of the updated avatar #2 is the update information #2, and the update information #2 is the update information #1 By adding version information #2 to , the update information #2 may include version information #1 and version information #2. Accordingly, the version information of the updated avatar #N may be version information #N, and the update information of the updated avatar #N is the update information #N, and may include version information #1 to version information #N.

24 exemplarily shows an internal configuration of a computing device according to an embodiment of the present invention.

24, the computing device 11000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, an input/output subsystem ( It may include at least an I/O subsystem) 11400 , a power circuit 11500 , and a communication circuit 11600 . At this time, the internal configuration of the computing device 11000 may include the computing system shown in FIG. 1 , or the computing device 11000 may correspond to an embodiment of the computing system shown in FIG. 1 , and the It may be connected to the VR service unit 2000 and the additional content unit 4000 by the /output subsystem 11400 . The processor 11100 may be configured in plurality, and may include the first processor module and the second processor module described above.

The memory 11200 may include, for example, high-speed random access memory, a magnetic disk, SRAM, DRAM, ROM, flash memory, or non-volatile memory. . The memory 11200 may include a software module, an instruction set, or other various data required for the operation of the computing device 11000 .

In this case, access to the memory 11200 from other components such as the processor 11100 or the peripheral device interface 11300 may be controlled by the processor 11100 .

Peripheral interface 11300 may couple input and/or output peripherals of computing device 11000 to processor 11100 and memory 11200 . The processor 11100 may execute a software module or an instruction set stored in the memory 11200 to perform various functions for the computing device 11000 and process data.

The input/output subsystem may couple various input/output peripherals to the peripheral interface 11300 . For example, the input/output subsystem may include a controller for coupling peripherals such as a monitor or keyboard, mouse, printer, or a touch screen or sensor as needed to the peripheral interface 11300 . According to another aspect, input/output peripherals may be coupled to peripheral interface 11300 without going through an input/output subsystem.

The power circuit 11500 may supply power to all or some of the components of the terminal. For example, the power circuit 11500 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or a power source. It may include any other components for creation, management, and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, if necessary, the communication circuit 11600 may transmit and receive an RF signal, also known as an electromagnetic signal, including an RF circuit, thereby enabling communication with other computing devices.

This embodiment of FIG. 24 is only an example of the computing device 11000, and the computing device 11000 may omit some components shown in FIG. 24 or further include additional components not shown in FIG. 24, or 2 It may have a configuration or arrangement that combines two or more components. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. 24 , and may include various communication methods (WiFi, 3G, LTE) in the communication circuit 11600 . , Bluetooth, NFC, Zigbee, etc.) may include a circuit for RF communication. Components that may be included in the computing device 11000 may be implemented in hardware, software, or a combination of both hardware and software including an integrated circuit specialized for one or more signal processing or applications.

Methods according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded in a computer-readable medium. In particular, the program according to the present embodiment may be configured as a PC-based program or an application dedicated to a mobile terminal. An application to which the present invention is applied may be installed in the computing device 11000 through a file provided by the file distribution system. For example, the file distribution system may include a file transfer unit (not shown) that transmits the file in response to a request of the computing device 11000 .

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, devices and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, may be implemented using one or more general purpose or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that may include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

Software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or device, to be interpreted by or to provide instructions or data to the processing device. , or may be permanently or temporarily embody in a transmitted signal wave. The software may be distributed over networked computing devices, so that it may be stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible from the above description by those skilled in the art. For example, the described techniques are performed in an order different from the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result. Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (12)

A system that generates an avatar and provides it to an external metaverse platform to update the avatar and provide NFT for the updated avatar,
an HMD mounted to a user to provide images and sounds for virtual reality, and to sense the user's voice; a camera device that captures the user's appearance and derives image information of the user; an EEG which is attached to the user's head and measures the user's EEG; a pulse meter attached to the user's wrist to measure the user's pulse; and a motion sensing device for measuring the user's movement; a VR device comprising;
a VR service unit that communicates with the VR device worn by the user, provides information about virtual reality to the VR device, generates an avatar of the user, and provides a plurality of virtual reality contents to the user;
NFT by transmitting original avatar hash information including object information related to the unique properties of the avatar, input information related to the information input by the user, and original information related to the original state of the avatar to an external blockchain network. an original avatar NFT providing unit that requests generation and provides the generated NFT to the user;
an avatar update unit that provides information about the avatar to an external metaverse platform, receives interaction information that a user has interacted with using the avatar on the external metaverse platform, and updates the avatar; and
updated avatar hash information including object information related to the unique properties of the updated avatar, input information related to the information input by the user, and update information related to the current version information and previous version information of the updated avatar Including; an update avatar NFT provider that requests NFT generation by transmitting to an external blockchain network, and provides to the user;
The VR service department,
a virtual reality implementation unit that is available only to the user and implements virtual reality in which the plurality of virtual reality contents are provided;
a VR communication unit that communicates with the VR device to exchange information;
image information received through the camera device received from the VR device; EEG information of the user measured by the EEG; and the user's pulse information measured by the pulse meter; including, user's biometric information; and a user information input unit for receiving user information including; and activity information and medical information received from the user's smartphone;
an avatar generator generating an avatar of the user based on the user information in the virtual reality implemented by the virtual reality implementing unit; and
and a VR content providing unit capable of providing the plurality of contents to the avatar generated in the virtual reality and updating the appearance of the avatar whenever the avatar is performed;
The avatar generating unit,
Each of the appearance characteristic information is derived from a plurality of the image information, and a character determination parameter in the form of a one-dimensional vector is derived by averaging the plurality of appearance characteristic information, and based on the character determination parameter, the basic appearance of the avatar Basic appearance determining unit to determine;
an aging information determining unit that determines aging information of the avatar by inputting it based on the biometric information, and adds a first graphic effect corresponding to the aging information to the basic appearance;
A disease in which disease information of an avatar is determined based on medical information including at least one medical history input by the user, and a second graphic effect corresponding to the disease information is added to the basic appearance to which the first graphic effect is added information decision unit; and
A method of increasing the movement speed as the movement distance or number of steps increases based on the movement distance or number of steps for a preset time derived from the user's smartphone, and lowering the movement speed when the disease information is a disease of the lower body and a movement speed determining unit that determines the movement speed of the avatar.
The aging information determining unit,
a first aging information unit for deriving first aging information including the user's skin condition information, hair condition information, and a degree of skeletal curvature from the image information input through the camera device;
a second aging information unit for deriving second aging information including the stability of the EEG and the concentration of the user from the EEG information of the user measured with the EEG;
a third aging information unit for deriving third aging information including the user's pulse rate per minute, pulse regularity, and pulse pressure from the user's pulse information measured by the pulse meter; and
Aging information including a summation score by assigning a score of 1 to 10 for each of the first aging information, the second aging information, and the third aging information, and adding each score and each score Including; a comprehensive judgment module to derive
The VR content providing unit,
A first content providing unit, the difficulty is determined based on the aging information of the user, and provides content that can perform the user's cognitive ability and concentration reinforcement training;
a second content providing unit for providing content for which difficulty is determined based on the activity information of the corresponding user, and for which the user's physical activity reinforcement training can be performed;
a third content providing unit for providing content for which a type of content is determined based on the user's disease information and training for a body part or cognitive ability requiring rehabilitation training;
The results of performing the contents provided by the first contents providing unit, the second contents providing unit, and the third contents providing unit, EEG information measured by the EEG measuring device during the execution period for the contents, and Based on the pulse information measured by the pulse meter, the aging information control unit for calculating one or more scores, and adjusting the aging information according to the one or more scores; and
A system for providing NFT for an updated avatar, comprising: an avatar appearance update unit configured to update the appearance of the user's avatar by adjusting the first graphic effect according to the aging information adjusted by the aging information adjustment unit .
delete The method according to claim 1,
The update avatar NFT provider,
an updated avatar hash information generating step of generating updated avatar hash information by applying a hash function to the updated avatar information;
an update avatar NFT generation request step of transmitting the updated avatar hash information to the external blockchain network to request NFT generation for the updated avatar; and
An updated avatar NFT receiving step of receiving the NFT generated by the external blockchain network; a system for providing an NFT for the updated avatar.
The method according to claim 1,
The version information is
The file created for the avatar version, the order number of the avatar version, the version name of the avatar version, the date and time the avatar version was updated, multiple photos obtained from different angles for the avatar version, the skin of the avatar version NFT for the updated avatar, including state information, hair state information, the degree of curvature of the skeleton, appearance feature information including eye inclination and mouth shape, aging information of the corresponding version of the avatar, and the moving speed of the corresponding version of the avatar system that provides
4. The method according to claim 3,
The update avatar hash information includes object information, input information and update information,
The object information is
identification information of a user who created the original avatar of the updated avatar, a date and time when the original avatar of the updated avatar was created, and a name of the original avatar of the updated avatar;
The input information is
The user's biometric information received by the VR device, received information including activity information and medical information received by the user's smartphone, and disease information based on the medical information including one or more medical history input by the user including,
The update information is
A system for providing an NFT for an updated avatar, wherein update information corresponding to a sequence number of a corresponding version is generated whenever an avatar is updated, and includes version information of the current version of the updated avatar and all previous version information of the updated avatar.
The method according to claim 1,
The avatar update unit,
an avatar information providing step of providing information about the avatar to an external metaverse platform;
an interaction information receiving step of receiving interaction information corresponding to the avatar from the external metaverse platform; and
and an avatar update step of extracting avatar-related information from the interaction information and updating the avatar based on the avatar-related information.
delete delete delete The method according to claim 1,
The first content provided to the user by the first content providing unit,
Content for enhancing the user's cognitive ability and concentration, including finding the wrong picture, arithmetic, and jigsaw puzzles,
The second content provided to the user by the second content providing unit,
Content that can perform the user's physical activity reinforcement training, including walking, stretching and squats,
The third content provided to the user by the third content providing unit,
A field in which the user is vulnerable by performing intensive training on the body part where the user is injured or performing intensive training on strengthening cognitive ability including the user's memory, judgment, language ability, and ability to understand time and space A system that provides NFTs for updated avatars, which are content for training .
The method according to claim 1,
The aging information control unit,
an intensity score calculation step of calculating an intensity score based on the user's brain wave information measured while the user performs the first content;
an activity score calculating step of calculating an activity score based on the user's pulse information and EMG information measured while the user performs the second content;
an execution result score calculation step of calculating a first score, a second score, and a third score, respectively, based on the execution result of the first content, the execution result of the second content, and the execution result of the third content; and
NFT for the updated avatar, performing an aging information reduction step of reducing aging information based on the sum of the first score, the second score, the third score, the concentration score, and the activity score system that provides
A method of providing an NFT for an updated avatar implemented in a system that generates an avatar and provides it to an external metaverse platform to update the avatar, and provides NFT for the updated avatar,
The system is
an HMD mounted to a user to provide images and sounds for virtual reality, and to sense the user's voice; a camera device that captures the user's appearance and derives image information of the user; an EEG which is attached to the user's head and measures the user's EEG; a pulse meter attached to the user's wrist to measure the user's pulse; and a motion sensing device for measuring the user's movement; a VR device comprising;
a VR service unit that communicates with the VR device worn by the user, provides information about virtual reality to the VR device, generates an avatar of the user, and provides a plurality of virtual reality contents to the user;
NFT by transmitting original avatar hash information including object information related to the unique properties of the avatar, input information related to the information input by the user, and original information related to the original state of the avatar to an external blockchain network. an original avatar NFT providing unit that requests generation and provides the generated NFT to the user;
an avatar update unit that provides information about the avatar to an external metaverse platform, receives interaction information that a user has interacted with using the avatar on the external metaverse platform, and updates the avatar; and
updated avatar hash information including object information related to the unique properties of the updated avatar, input information related to the information input by the user, and update information related to the current version information and previous version information of the updated avatar Including; an update avatar NFT provider that requests NFT generation by transmitting to an external blockchain network, and provides to the user;
The method is
a virtual reality implementation step of realizing, by the VR service unit, virtual reality available only to the user and provided with a plurality of virtual reality contents;
a VR communication step of communicating with the VR device and exchanging information by the VR service unit;
the user's biometric information received from the VR device by the VR service unit; and a user information input step of receiving user information including; and activity information and medical information received from the user's smartphone;
an avatar generation step of generating, by the VR service unit, an avatar of the user based on the user information in the virtual reality implemented by the virtual reality realization step; and
a VR content providing step of providing, by the VR service unit, the plurality of contents to the avatar created in the virtual reality, and updating the appearance of the avatar each time this is performed;
In the avatar creation step,
Each of the appearance characteristic information is derived from a plurality of the image information, and a character determination parameter in the form of a one-dimensional vector is derived by averaging the plurality of appearance characteristic information, and based on the character determination parameter, the basic appearance of the avatar Basic appearance determining step to determine;
an aging information determining step of determining aging information of the avatar by inputting it based on the biometric information, and adding a first graphic effect corresponding to the aging information to the basic appearance;
A disease in which disease information of an avatar is determined based on medical information including at least one medical history input by the user, and a second graphic effect corresponding to the disease information is added to the basic appearance to which the first graphic effect is added information determination step; and
A method of increasing the movement speed as the movement distance or number of steps increases based on the movement distance or number of steps for a preset time derived from the user's smartphone, and lowering the movement speed when the disease information is a disease of the lower body a moving speed determining step of determining the moving speed of the avatar with
The aging information determination step,
a first aging information step of deriving first aging information including the user's skin condition information, hair condition information, and a degree of skeletal curvature from the image information input through the camera device;
a second aging information step of deriving second aging information including the stability of the EEG and the concentration of the user from the EEG information of the user measured with the EEG;
a third aging information step of deriving third aging information including the user's pulse rate per minute, pulse regularity, and pulse pressure from the user's pulse information measured by the pulse meter; and
Aging information including a summation score by assigning a score of 1 to 10 for each of the first aging information, the second aging information, and the third aging information, and adding each score and each score Including; a comprehensive judgment module step to derive
The VR content providing step includes:
A first content providing step, wherein the level of difficulty is determined based on the aging information of the user, and providing content that can perform cognitive ability and concentration reinforcement training of the user;
a second content providing step of determining a difficulty level based on the activity information of the corresponding user and providing content capable of performing the user's physical activity reinforcement training;
a third content providing step of providing content in which a type of content is determined based on the disease information of the user and training for a body part or cognitive ability requiring rehabilitation training is performed;
The result of performing the contents provided in the first contents providing step, the second contents providing step, and the third contents providing step, EEG information measured by the EEG measuring device during the execution period for the contents, and An aging information control step of calculating one or more scores based on the pulse information measured by the pulse meter, and adjusting the aging information according to the one or more scores; and
An avatar appearance update step of updating the appearance of the user's avatar by adjusting the first graphic effect according to the adjusted aging information by the aging information adjustment step; .

Images