KR102597299B1 - System for providing metaverse lease service - Google Patents

Abstract

A metaverse rental service provision system is provided, and a user terminal requesting a lease for at least one space in the metaverse, a buyer terminal requesting a lease for at least one space in the metaverse, and a space in the metaverse from the user terminal. A receiving unit that receives rental requests, a rental announcement unit that attaches a sign for renting a space in the metaverse to the metaverse, and a lease between the user terminal and the buyer terminal when a request to rent at least one space is received from a buyer terminal. It includes a rental service providing server including a brokerage department.

Description

Metaverse rental service provision system {SYSTEM FOR PROVIDING METAVERSE LEASE SERVICE}

The present invention relates to a Metaverse rental service provision system, and provides a platform that induces recycling of resources by brokering the rental or sale of a pre-built Metaverse platform.

A variety of technologies such as extended reality (XR), digital twin, artificial intelligence (AI), Internet of Things (IoT), and blockchain can be used convergently to implement the Metaverse service platform. Extended reality is a technology that is an interface that connects the virtual world and the real world, and includes virtual convergence space and digital human creation technology. Virtual reality (VR). The development of technologies such as augmented reality (AR) and haptic and the increase in computing power are making the senses in the virtual world more realistic and increasing immersion. Digital twin is a technology that replicates and synchronizes systems in the real world to the virtual world to enable monitoring, simulation, and control. The key to digital twin is synchronization with actual data collected from IoT devices capable of sensing. Blockchain can be used in Metaverse to verify user identity, protect data privacy, and manage creative works and copyrighted works. An incentive mechanism using game theory has been developed based on blockchain to effectively manage resources between Metaverse service providers and users. It also happened.

At this time, services that provide the Metaverse platform or manage assets within the Metaverse were researched and developed. In relation to this, the prior art, Korea Patent Publication No. 2022-0146298 (published on November 1, 2022) and Korea Registered Patent No. In No. 10-2442347 (announced on September 8, 2022), a convergence economy service is supported so that the avatar set on the user terminal can engage in economic activities within the metaverse, and transaction information accompanying the transaction is provided as convergence information. It is configured to reflect the results of the avatar's transaction behavior in the convergence economy, calculates virtual value information for virtual assets using a value calculation model to manage assets for virtual objects in the metaverse, and manages and manages virtual assets. Configurations that mediate buying and selling are each disclosed.

However, in the former case, it is only a configuration that provides transaction information when the avatar engages in economic activities, and is not a configuration that deals with the Metaverse platform or service itself. In the latter case, it is also a configuration that calculates the virtual value of virtual assets in the Metaverse. However, it is not a structure that deals with the Metaverse platform or the service itself. A lot of time and manpower are required to build a Metaverse platform, but the possibility of reusing a Metaverse platform that is created one-time or is not used after being built is not discussed at all. Accordingly, research and development of a trading platform that can rent and lease the Metaverse platform is required.

One embodiment of the present invention is to broker a lease for at least one space in the Metaverse, so that a lease is requested from a user terminal, and when a lease is requested from a buyer terminal, the Metaverse platform is brokered between the user and the buyer. By allowing buyers to lease or purchase for a pre-set period, it increases the usability of the already established Metaverse platform and provides interoperability so that the development framework can be linked with compatibility across heterogeneous platforms or industrial applications. To provide an open Metaverse platform and to enable simultaneous participation of large-scale users in basic infrastructure technologies for Metaverse services such as communication networks, data storage, processing, and management, ultra-high-speed, ultra-low-latency 5G/6G networks, and intelligent distributed computing are required. It supports technological development such as A Metaverse rental service provision system can be provided that allows entities within the Metaverse platform to be recycled. However, the technical challenge that this embodiment aims to achieve is not limited to the technical challenges described above, and other technical challenges may exist.

As a technical means for achieving the above-described technical problem, one embodiment of the present invention includes a user terminal requesting a lease for at least one space in the metaverse, a buyer requesting a lease for at least one space in the metaverse A receiving unit that receives rental requests for space in the metaverse from terminals and user terminals, a rental announcement unit that attaches a sign for renting a space in the metaverse to the metaverse, and a request to rent at least one space from a buyer terminal. When receiving, it includes a rental service providing server that includes a brokerage unit that brokers the rental between the user terminal and the buyer terminal.

According to one of the above-described means for solving the problem of the present invention, when a rental request is received from a user terminal and a rental request is received from a purchaser terminal, so as to mediate the lease for at least one space of the metaverse, between the user and the purchaser It increases the usability of the existing Metaverse platform by allowing buyers to lease or purchase the Metaverse platform for a preset period of time, and provides interoperability so that the development framework can be linked with compatibility across heterogeneous platforms or industrial applications. By providing (Interoperability), an open Metaverse platform can be provided, and for the simultaneous participation of a large number of users in basic infrastructure technologies for Metaverse services such as communication networks and data storage, processing, and management, ultra-high-speed, ultra-low-latency 5G/ It supports the development of technologies such as 6G networks and intelligent distributed computing, provides cloud technology to flexibly use computing resources according to changes in user needs or demand, and analyzes the relationships between entities within the metaverse through large-scale graph data analysis. By establishing relationships, entities within each metaverse platform can be reused later.

Figure 1 is a diagram for explaining a metaverse rental service provision system according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a rental service providing server included in the system of FIG. 1.
Figures 3 and 4 are diagrams for explaining an embodiment in which the metaverse rental service according to an embodiment of the present invention is implemented.
Figure 5 is an operation flowchart to explain a method of providing a metaverse rental service according to an embodiment of the present invention.

Below, with reference to the attached drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily implement the present invention. However, the present invention may be implemented in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present invention in the drawings, parts that are not related to the description are omitted, and similar parts are given similar reference numerals throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected," but also the case where it is "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, this does not mean excluding other components unless specifically stated to the contrary, but may further include other components, and one or more other features. It should be understood that it does not exclude in advance the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The terms "about", "substantially", etc. used throughout the specification are used to mean at or close to that value when manufacturing and material tolerances inherent in the stated meaning are presented, and are used to enhance the understanding of the present invention. Precise or absolute figures are used to assist in preventing unscrupulous infringers from taking unfair advantage of stated disclosures. The term “step of” or “step of” as used throughout the specification of the present invention does not mean “step for.”

In this specification, 'part' includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Additionally, one unit may be realized using two or more pieces of hardware, and two or more units may be realized using one piece of hardware. Meanwhile, '~ part' is not limited to software or hardware, and '~ part' may be configured to reside in an addressable storage medium or may be configured to reproduce one or more processors. Therefore, as an example, '~ part' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables. The functions provided within the components and 'parts' may be combined into a smaller number of components and 'parts' or may be further separated into additional components and 'parts'. Additionally, components and 'parts' may be implemented to regenerate one or more CPUs within a device or a secure multimedia card.

In this specification, some of the operations or functions described as being performed by a terminal, apparatus, or device may instead be performed on a server connected to the terminal, apparatus, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal, apparatus, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal mean mapping or matching the terminal's unique number or personal identification information, which is identifying data of the terminal. It can be interpreted as

Hereinafter, the present invention will be described in detail with reference to the attached drawings.

Figure 1 is a diagram for explaining a metaverse rental service provision system according to an embodiment of the present invention. Referring to FIG. 1, the metaverse rental service providing system 1 may include at least one user terminal 100, a rental service providing server 300, and at least one buyer terminal 400. However, since the metaverse rental service providing system 1 of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1.

At this time, each component of FIG. 1 is generally connected through a network (Network, 200). For example, as shown in FIG. 1, at least one user terminal 100 may be connected to the rental service providing server 300 through the network 200. In addition, the rental service providing server 300 may be connected to at least one user terminal 100 and at least one purchaser terminal 400 through the network 200. Additionally, at least one purchaser terminal 400 may be connected to the rental service providing server 300 through the network 200.

Here, the network refers to a connection structure that allows information exchange between each node, such as a plurality of terminals and servers. Examples of such networks include a local area network (LAN) and a wide area network (WAN). Wide Area Network, Internet (WWW: World Wide Web), wired and wireless data communication network, telephone network, wired and wireless television communication network, etc. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), 5th Generation Partnership Project (5GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), and Wi-Fi. , Internet, LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), RF (Radio Frequency), Bluetooth network, NFC ( It includes, but is not limited to, Near-Field Communication (Near-Field Communication) network, satellite broadcasting network, analog broadcasting network, and DMB (Digital Multimedia Broadcasting) network.

In the following, the term at least one is defined as a term including singular and plural, and even if the term at least one does not exist, each component may exist in singular or plural, and may mean singular or plural. This should be self-explanatory. In addition, whether each component is provided in singular or plural form may be changed depending on the embodiment.

At least one user terminal 100 may be a terminal of a lessor or seller who wants to rent or sell at least one space in a pre-built metaverse using a web page, app page, program, or application related to the metaverse rental service. . At this time, the user terminal 100 may be the terminal of the designer who designed the metaverse. For example, the user terminal 100 may be a terminal that wants to rent space in the metaverse created on another platform, such as Zepeto or Gathertown Sandbox. To this end, the user terminal 100 uploads space images, space information, and prices to be rented to the rental service providing server 300, and when sales approval occurs in the rental service providing server 300, the user terminal 100 ) may be a terminal that receives a purchase request from the buyer terminal 400, selects a date and amount, receives payment, and delivers a space rental link.

Here, at least one user terminal 100 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc. At this time, at least one user terminal 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one user terminal 100 is, for example, a wireless communication device that guarantees portability and mobility, and includes navigation, personal communication system (PCS), global system for mobile communications (GSM), personal digital cellular (PDC), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) ) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

The rental service providing server 300 may be a server that provides a metaverse rental service web page, app page, program, or application. In addition, the rental service providing server 300 may be a server that receives a request for rent or sale of at least one space in the metaverse from the user terminal 100 and mediates the request. The rental service providing server 300 may be a server that receives a rental or purchase request from at least one buyer terminal 400 and mediates rental or sales. At this time, the rental service providing server 300 is a server that performs deletion, modification, addition, etc. of at least one component forming the metaverse when a custom request from the buyer terminal 400 exists and receives a fee for this. You can. The rental service providing server 300 receives the spatial image, spatial information, and price of the metaverse received from the user terminal 100, determines whether to approve the sale, and if the sale is approved, searches the buyer terminal 400. After payment, the date and amount to be rented are delivered to the user terminal 100, and the user terminal 100 is sent to the buyer terminal 400 for a contract confirmed through negotiation between the user terminal 100 and the buyer terminal 400. It may be a server that provides a space rental link, receives reviews and star ratings from the buyer terminal 400, and settles the remaining amount excluding the commission to the user terminal 100.

Here, the rental service providing server 300 may be implemented as a computer that can connect to a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc.

At least one buyer terminal 400 may be a terminal of a buyer who wants to rent or purchase at least one space in the metaverse using a web page, app page, program, or application related to the metaverse rental service. The buyer of the buyer terminal 400 may be a buyer who lacks capital or manpower to build a metaverse or does not have time to build a metaverse and needs a metaverse platform right away. At this time, the buyer terminal 400 may be a terminal that enters into a licensing agreement necessary for renting the metaverse platform by the rental service providing server 300 and sets the scope and period of use. If the buyer terminal 400 requests customization, the rental service providing server 300 may provide the customization service and charge a service fee for the same.

Here, at least one purchaser terminal 400 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a laptop equipped with a navigation system and a web browser, a desktop, a laptop, etc. At this time, at least one purchaser terminal 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one purchaser terminal 400 is, for example, a wireless communication device that guarantees portability and mobility, and includes navigation, personal communication system (PCS), global system for mobile communications (GSM), personal digital cellular (PDC), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) ) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smartpads, and tablet PCs.

Figure 2 is a block diagram for explaining the rental service providing server included in the system of Figure 1, and Figures 3 and 4 illustrate an embodiment in which the metaverse rental service according to an embodiment of the present invention is implemented. This is a drawing for

Referring to Figure 2, the rental service providing server 300 includes a receiving unit 310, a rental announcement unit 320, a mediation unit 330, a recycling promotion unit 340, a request reflection unit 350, and a search engine unit. (360), it may include a transaction inducement unit (370) and a licensing unit (380).

The rental service providing server 300 or another server (not shown) operating in conjunction with an embodiment of the present invention provides a metaverse rental service application to at least one user terminal 100 and at least one purchaser terminal 400. , when transmitting a program, app page, web page, etc., at least one user terminal 100 and at least one buyer terminal 400 install the metaverse rental service application, program, app page, web page, etc. You can open it. Additionally, a service program may be run on at least one user terminal 100 and at least one purchaser terminal 400 using a script executed in a web browser. Here, a web browser is a program that allows the use of web (WWW: World Wide Web) services and refers to a program that receives and displays hypertext written in HTML (Hyper Text Mark-up Language), for example, Netscape. , Explorer, Chrome, etc. Additionally, an application refers to an application on a terminal and includes, for example, an app running on a mobile terminal (smartphone).

Referring to FIG. 2, the receiving unit 310 may receive a rental request for space within the metaverse from the user terminal 100. The user terminal 100 may request to lease at least one space in the metaverse. The metaverse according to an embodiment of the present invention can be built so that each component is modularized and has interoperability even within heterogeneous platforms. For example, assuming that only the B area of A metaverse and the D area of C metaverse are leased, the A metaverse and C metaverse must be compatible to combine the B area and D area. Accordingly, the leased Metaverse platform and infrastructure may only receive open Metaverse designed for interoperability. Of course, it is not relevant if it is leased in itself, but based on the possibility of mixing metaverses in the future, it can be assumed that the following standards will be used.

For example, in the field of ultra-realistic media technology, standardization work on holograms, realistic content creation and compression technology, etc. is being carried out by IEC TC 110, ISO TC 172, JTC 1/SC 29, JTC 1/SC 24, Khronos Group, etc. -In the field of virtual world convergence and realistic technology, JTC 1/SC 24, JTC 1/SC 29, ITU-T SG 16, Khronos Group, etc., and in the field of convergence media delivery network technology, traditional 3GPP, IEEE, ITU-T, etc. In the Mobile and Wired Communications Standardization Organization, blockchain and distributed ledger technologies are supported by ISO TC 307, JTC 1/SC 27, ITU-T SG 17, SG 13, SG 16, etc., and NFT technology is used in Ethereum, in the real-virtual world. In the field of linkage and synchronization technology and digital twin technology, related standardization work is being promoted in JTC 1/SC 29 and IEEE 2888 group, and in the field of augmented and virtual reality device technology, IEEE 3079 and IEEE 2888 group.

<Standardization of Metaverse platform interconnection>

Promoting standardization for the Metaverse platform must first consider the direction of development and evolution of Metaverse technology and related industries. Based on the seven major evolution directions of metaverse technology analyzed previously and the standardization status analysis results for major element technologies, we look at metaverse that maximizes immersion, metaverse that enables collaborative communication, metaverse that produces and distributes digital assets, and intelligentization. Regarding the direction of evolution into a metaverse, it is necessary to strengthen activities in the existing standardization group in connection with recent research and development activities to advance the technology. Regarding the direction of evolution of the metaverse, which expands the experience of reality through avatars, the metaverse that allows complete interoperability between platforms, and the virtual-reality world convergence metaverse, active technology development is required first as the relevant technology is still insufficient and the standardization process is in the early stages. In addition, more active expansion of standardization activities, such as proposing new standardization tasks and establishing standardization groups, is required in connection with technology development work. In addition, as explained earlier, the Metaverse platform can be realized by integrating and interconnecting numerous technologies, not just a few element technologies, so it is necessary to provide basic standard technology for the interoperability of the Metaverse platform that applies and interconnects these various detailed element technologies. Prioritization of standardization work is required. In other words, basic standard technology is required to enable the Metaverse platform to be systematically linked by bundling element standard technologies being developed by each individual standard group.

Metaverse-related standardization work is already underway in various areas. A representative standardization organization is the Khronos Group. Established in 2000 under the leadership of ATI Technologies, Discreet, Evans & Sutherland, Intel, NVIDIA, Silicon Graphics (SGI), and Sun Microsystems, it is developing royalty-free open standards. glTF is a notable standard from the Khronos Group. there is. glTF (GL Transmission Format) is a file format that expresses 3D scenes and models and is based on the JSON standard. MPEG-V is a data definition standard that exchanges between the real world and the real world and the metaverse, and between the metaverse and the metaverse. The formal name of IEEE2888 is the Interfacing Cyber and Physical World Working Group, which promotes standards for the vocabulary, requirements, metrics, and data formats required for information exchange through application programming interfaces (APIs) and sensors between physical and virtual objects. Recently, the Metaverse Standard Forum was launched on June 21, 2022, and the forum aims to establish open standards for 3D graphics/AR/VR, etc. that make up the Metaverse. In Korea, the Electronics and Telecommunications Research Institute (ETRI) and the Korea Telecommunications Technology Association (TTA) recently began developing an ICT convergence standard framework in the metaverse field. In particular, TTA is also carrying out standardization activities such as IEEE2888 and MPEG-V through the Digital Virtualization Forum. Accordingly, in the case of existing metaverses, combinations can be performed through modularization, and in the case of metaverses to be leased, rental requests can be received only when standard protocols and frameworks are used.

The lease announcement unit 320 can attach a sign for renting space in the metaverse to the metaverse. At this time, when the buyer terminal 400 to rent the metaverse predicts and records the number of users, edge computing may be provided for this purpose. In a typical cloud VR operation process in a single-user environment, for example, user input and motion sensing data are detected within the client and transmitted to the edge server. The edge server processes VR content based on this input and then renders the user's viewport screen. The rendered result is encoded and sent to the client, and the client implements the content by playing it. An edge server is a server instance within a network that performs input signal processing, graphics rendering, and video encoding on behalf of clients. Since network delay must be minimized, it can operate physically and geographically close to the user.

The physical server in the network where the edge server operates is called an edge node. An edge node is either the network equipment itself or a physical machine directly connected to it, and can be considered the same as a network node. In this situation, from a network perspective, information such as computing and network resource requirements, network delay tolerance, and computing and networking load changes must be considered for a specific application, and the available computing resources of the edge node must also be considered. The edge server of a specific application is configured separately for each user, and the edge node on which the server will operate is determined to improve content and network performance indicators.

In contrast, metaverse content is generally multi-user. Looking at the process when multi-user content operates using cloud VR techniques, first, each user transmits their respective inputs and actions to the server, and these inputs generally affect the viewports between users. In existing online content, only the input signal is shared and processed individually by each client, but in cloud VR, the input of all adjacent users needs to be processed by a centralized server. In other words, each user's input is sent to the central server, where data is collected and then goes through an engine processing process. The results are then sent to the edge server associated with each user, rendered for each user's viewport, and then transmitted to the client. Additionally, latency-sensitive operations such as HMD motion processing may be simultaneously sent to the central server and edge server for processing. Motion data sent to the central server undergoes engine processing and is used to configure viewports for oneself and other users, while motion data sent to the edge server can be used for rapid viewport rendering according to HMD operation.

For example, a set consisting of two clients and one edge server is called VCN (Virtual Content Network) in this study. A VCN can consist of up to 4 clients and 1 edge server. Since the location of the client in the network is fixed, by specifying the operation location of the edge servers of each VCN, it is possible to not only reduce the latency of the VCN, but also reduce the traffic load of the entire network and balance computing resources. In order to place a VCN's edge server on an appropriate edge node, first, a candidate edge server placement site is obtained for each VCN. Candidates for deployment can be any node in the network, and candidates for deployment are sorted based on the expected network cost when deployed to a specific node. Second, the edge servers of all VCNs in the network are virtually placed on the highest priority candidate nodes. At this time, if the available computing resources of a specific node cannot meet the sum of the resource requirements of all edge servers that will enter that node, some of the VCN's edge servers are relocated to other nodes. Here, computing resources are abstracted into workload units to facilitate aggregation and comparison. In this way, all VCN's edge servers can be placed within the network while taking network and computing load into consideration together.

The expected traffic load for each candidate can be obtained using the client set that makes up the VCN and the traffic factor for each link of the VCN application. The traffic factor for each link refers to the traffic load required for each link on the network path between the edge server and the client. For each node in the set of all nodes in the network, the expected traffic load of the candidate node can be obtained as the product of the traffic factor and the sum of the shortest path between the node and each client. In other words, it means the traffic load expected to occur when the VCN's edge server is deployed on the node. The candidate nodes obtained in this way are sorted in ascending order based on the expected traffic load to form the VCN candidate list. In the same way, you can create individual candidate lists for all VCNs in the network.

In addition, an algorithm can be used to select VCN candidates by considering computing resources. It would be best to place an edge server on the best candidate node of all VCNs, but due to a lack of computing resources on a specific node, an edge server should be installed on that node. It may not be possible to place them all. The candidate node selection situation for each VCN is called a deployment plan, and is initially initialized with the best candidate node from all VCNs selected. However, if there is a node with excess resources, some of the edge servers scheduled to be deployed on that node must be replaced. The replacement node selection method can use W-VBP (Weighted Vector Bin Packing). The VBP-based replacement technique is a method of replacing the server with the largest difference between the node's resource composition ratio and the edge server's resource composition ratio. Because it is vector-based, there is no limit to the number of resources, and it minimizes the side effect of not being able to use other types of resources even if only some resources are depleted. If all candidates for a VCN to be replaced are depleted, the algorithm is considered to have ultimately failed. Therefore, the ratio of remaining candidates for each VCN can be considered as a weight to prevent a situation where only candidates for a specific VCN are continuously depleted.

The edge server with the largest result of multiplying the vector angle and weight, which is the result of VBP, is subject to replacement. The VCN whose edge servers are subject to replacement removes the currently selected candidate node and selects the next candidate node from its candidate list. Then, it checks again for the presence of excess nodes based on the current state. Algorithm failure may occur when the computing resource requirements of metaverse contents within the network approach or exceed the total available resources. This situation can be overcome by adding hardware or applying measures to reduce the level of offloading of content to edge computing.

When receiving a request to rent at least one space from the buyer terminal 400, the brokerage unit 330 may mediate a lease between the user terminal 100 and the buyer terminal 400. The buyer terminal 400 may request to rent at least one space in the metaverse. At this time, if user A has built a clothing shopping mall metaverse and buyer B rents the clothing shopping mall metaverse itself, they can rent it as a whole. Additionally, if Buyer B leases a store in one of the clothing shopping malls, he or she may rent only a portion of the store. In this case, user A may be a metaverse shopping mall operator, and buyer B may be a seller of a shopping mall.

<Creation of digital human based on metaverse>

Digital human creation technology can use volumetric capture-based 3D human modeling technology, single image-based 3D human modeling technology, and image synthesis-based human and spatial rendering technology. Volumetric capture-based 3D human modeling technology creates a human shape located in real space as a set of 3D pixels. Volumetric capture technology uses a large number of cameras to capture the visible shape as much as possible in the form of volume, that is, the shape and color in space as if an object occupies space in three-dimensional pixel units. For example, it could be Google's Relightables system, Restored Digital Human, Meta's Sociopticon system, Full-Body Codec Avatar, etc.

You can also use single image-based 3D human modeling technology, which can create a 3D face model and full body model using a single face photo. After inferring a person's posture from an input image, the posture is created and transformed with a standardized 3D human model, projected onto a 2D image, then a texture is created, and the created 3D model is rendered and compared again with the input image. method can be used. Image synthesis-based human rendering and spatial rendering technology can also generate human images with new facial expressions and postures using deep learning technology. Using GAN (Generative Adversarial Network), you can learn human facial expression images and create new facial expressions according to the input face shape of the person. Technologies for 3D Human Reconstruction, 3D Scene Reconstruction, etc. can also be used.

<Interaction with Metaverse Digital Humans>

Interaction technology can also be added to allow digital humans to operate in more diverse ways in the metaverse. Interaction can be divided into conversation interaction, behavioral interaction, and environmental interaction. Without interaction technology, digital humans only exist as digital objects depicting specific objects. Digital humans are expanded into AI avatars and may include technologies for natural emotional transmission. Conversational interaction uses intelligent virtual agent technology or conversational bot technology, for example, Microsoft's Power Virtual Agents, Google's DialogFlow, etc. In behavioral interaction, digital humans can convey various information and emotions to users through movements or facial expressions.

Behavioral interactions include verbal behavior and nonverbal behavior. Verbal behavior expresses direct movements such as mouth movements, and nonverbal behavior expresses gaze, eye blinks, facial expressions, head movements, and body movements. It can express actions such as movement. You can also use technology that automatically generates character behavior based on input sentences. For example, the University of Southern California's (USC) MultiSense technology recognizes smiles, facial expressions, gaze, and voice tremors. You can also use it. Environmental interaction can support interaction according to the surrounding environment in the XR space, and for this, occlusion and collision detection can be performed.

In order to recommend a metaverse desired by the buyer terminal 400, the recycling promotion unit 340 receives usage conditions including the size, type, style, design, and purpose of the desired metaverse from the buyer terminal 400, At least one metaverse similar to the terms of use can be recommended to the buyer terminal 400. For example, if various metaverses are uploaded to a brokerage platform, buyers must search and find the metaverse they want. If a condition requested by a buyer exists without going through this process, a search engine can be built to search and display the Metaverse platform with tags corresponding to the condition.

The request reflection unit 350 modularizes at least one component of the metaverse, requests addition, deletion, and modification of the component so that the request requested by the purchaser terminal 400 can be reflected, and fulfills the request. It can be assigned to at least one person in charge. For example, let's say the buyer likes all of User A's B metaverse platforms, but wants to change part C. At this time, if the development is done directly by the user, the metaverse can be modified by the user providing this service and the buyer paying for it, assuming that the developer belongs to User A.

The search engine unit 360 tags the metaverse with a tag for search and classification, including at least one component constituting the metaverse, and when searching by entering a keyword in the buyer terminal 400, the buyer terminal ( At least one metaverse with a tag similar to the keyword of 400) may be transmitted to the buyer terminal 400. At this time, a metaverse space suitable for the client may be recommended through at least one artificial intelligence algorithm. At this time, the artificial intelligence algorithm can use collaborative filtering for recommendation. At this time, in the case of collaborative filtering, a cold start problem inevitably occurs due to insufficient initial data. To solve this problem, in one embodiment of the present invention, collaborative filtering is implemented using CGAN (Conditional Generative Adversarial Network). It is possible to improve recommendation performance by resolving the scarcity problem that arises while simultaneously alleviating data imbalance that occurs in actual data. By using CGAN to generate virtual data similar to reality in an empty User-Item Matrix, high accuracy is expected when compared to learning only with the existing sparse matrix. In this process, the distribution of the minority class can be identified using the condition vector and data can be generated by reflecting its characteristics. Afterwards, collaborative filtering can be applied and hyperparameter tuning can contribute to maximizing the performance of the recommendation system. For comparison, traditional oversampling techniques such as SMOTE, BorderlineSMOTE, SVM-SMOTE, ADASYN and GAN can be used.

If the transaction induction unit 370 builds and owns a metaverse in the user terminal 100, it can register the metaverse as for sale and broker a transaction according to a rental request from the user terminal 100.

When a rental contract between the user terminal 100 and the buyer terminal 400 is concluded, the licensing unit 380 may grant the right to use or license the metaverse to the buyer terminal 400. For example, there is a metaverse platform A, and it can be decided whether to grant a license to use it to all B buyers, C buyers, and D buyers, or to grant a license to use it exclusively to B buyers. The price may be higher in the latter case than in the former. At this time, the licensing department 380 can apply and register rights such as design rights and copyrights on behalf of the design of the metaverse space. In addition, NFT (Non-Fungible Token) can be issued for the design of the metaverse space, and transactions for NFTs can also be conducted. Transactions for at least one item and design result within the metaverse may be brokered, for example, a licensing agreement between a designer and a client may be brokered.

Hereinafter, the operation process according to the configuration of the rental service providing server of FIG. 2 described above will be described in detail using FIGS. 3 and 4 as an example. However, it will be apparent that the embodiment is only one of various embodiments of the present invention and is not limited thereto.

The platform (tentative name, Metashare) according to an embodiment of the present invention is a brokerage platform, as described above, and can connect users and buyers. Users can upload rental costs, space images, space information, and detailed descriptions such as daily and hourly units, and buyers, who are clients, can select the space in the desired metaverse and receive a lease on the desired date, and the present invention The platform can mediate between the two parties.

Referring to FIG. 3, (a) when a rental request is made on the user terminal 100, a rental notice is posted, and a rental request is received from the purchaser terminal 400 as in (b), and rental conditions, usage fees, and whether modifications are possible are requested. Understand the conditions, etc. (c) Once the rental contract is concluded, the user or the platform of the present invention can reflect the request as in (d) and charge a brokerage fee and modification fee for it. The platform (Webconut) of the present invention, as shown in Figures 3b to 3d, is a platform for planning and building a metaverse. Since there are metaverse platforms that are not reused and discarded after much planning and construction, each asset or metaverse platform Alternatively, the internal area can be modularized and leased, thereby preventing waste of manpower and resources, and providing an intermediary platform that can recycle the constructed metaverse just as objects are recycled. Each floor can be rented as shown in FIGS. 4A to 4E, the entire building can be rented as shown in FIGS. 4F and 4G, or it can be rented by asset as shown in FIGS. 4H and 4I. As shown in Figures 4j to 4n, the metaverse itself using ZEPETO can be rented.

Matters that are not explained regarding the method of providing the metaverse rental service in FIGS. 2 to 4 are the same as those described previously regarding the method of providing the metaverse rental service through FIG. 1 or can be easily inferred from the content described below. Please omit the explanation.

FIG. 5 is a diagram illustrating a process in which data is transmitted and received between each component included in the metaverse rental service providing system of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of the process of transmitting and receiving data between each component will be described with reference to FIG. 5, but the present application is not limited to this embodiment, and the process shown in FIG. 5 according to the various embodiments described above It is obvious to those skilled in the art that the process of transmitting and receiving data can be changed.

Referring to FIG. 5, the rental service providing server receives a rental request for space in the metaverse from the user terminal (S5100).

In addition, the rental service providing server attaches a sign for renting a space in the metaverse to the metaverse (S5200), and when a request to rent at least one space is received from a buyer terminal, a lease is established between the user terminal and the buyer terminal. Mediation (S5300).

The sequence between the above-described steps (S5100 to S5300) is only an example and is not limited thereto. That is, the order between the above-described steps (S5100 to S5300) may change, and some of the steps may be executed simultaneously or deleted.

Matters that are not explained regarding the method of providing the metaverse rental service of FIG. 5 are the same as or can be easily inferred from the content explained about the method of providing the metaverse rental service through FIGS. 1 to 4, so hereinafter. Please omit the explanation.

The method of providing a metaverse rental service according to an embodiment described with reference to FIG. 5 may also be implemented in the form of a recording medium containing instructions executable by a computer, such as an application or program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and non-volatile media, removable and non-removable media. Additionally, computer-readable media may include all computer storage media. Computer storage media includes both volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data.

The method of providing a metaverse rental service according to an embodiment of the present invention described above can be executed by an application installed by default on the terminal (this may include programs included in the platform or operating system, etc., installed by default on the terminal), , It may be executed by an application (i.e., a program) installed directly on the master terminal by the user through an application providing server such as an application store server, a web server related to the application or the service. In this sense, the method of providing a metaverse rental service according to an embodiment of the present invention described above is implemented as an application (i.e., a program) installed by default in the terminal or directly installed by the user and readable by a computer such as in the terminal. It can be recorded on a recording medium.

The description of the present invention described above is for illustrative purposes, and those skilled in the art will understand that the present invention can be easily modified into other specific forms without changing the technical idea or essential features of the present invention. will be. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. For example, each component described as unitary may be implemented in a distributed manner, and similarly, components described as distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

Claims (6)

A user terminal requesting to rent at least one space in the metaverse;
A buyer terminal requesting to rent at least one space in the metaverse; and
A receiving unit that receives a rental request for a space in the metaverse from the user terminal, a rental announcement unit that attaches a sign for renting a space in the metaverse in the metaverse, and a rental announcement unit that attaches a sign for renting a space in the metaverse to the metaverse, When a rental request is made, it includes a rental service providing server including a brokerage department that brokers the rental between the user terminal and the buyer terminal,
The rental service providing server is,
In order to recommend a metaverse desired by the buyer terminal, usage conditions including the size, type, style, design, and purpose of the desired metaverse are set from the buyer terminal, and at least one metaverse similar to the usage conditions is set. Recycling promotion department recommended by buyer terminal;
Modularize at least one component of the metaverse, request the user of the user terminal to add, delete, and modify the component so that the request from the purchaser terminal is reflected, and meet the request at least A request reflection unit assigned to one person in charge of the terminal;
The metaverse is tagged with a tag for search and classification, including at least one component constituting the metaverse, and when searching by entering a keyword in the buyer terminal, a tag similar to the keyword of the buyer terminal is attached. a search engine unit that transmits at least one metaverse to the buyer terminal;
When the user terminal builds and owns the metaverse, a transaction induction unit that registers the metaverse for sale and brokers a transaction according to a rental request from the user terminal; and
A metaverse rental service providing system including a licensing unit that grants the right to use or license the metaverse to the purchaser terminal when a lease agreement for the at least one space is concluded between the user terminal and the purchaser terminal. delete delete delete delete delete

Images