KR20240002113A - Server, apparatus for implementing metaverse system based on natural economy - Google Patents

Abstract

The real economy-based metaverse system is launched. This system implements the metaverse by reflecting the requirements input from the client terminal, a display device equipped with an input unit for interaction with the user, and a client terminal for inputting requirements implemented in the metaverse, and inputs the information through the input unit. It includes a metaverse system implementation server that reflects the received information in the metaverse. By providing this system, the infrastructure of the real economy can be expanded and user convenience can be further improved.

Description

Real economy-based metaverse system implementation servers and devices {SERVER, APPARATUS FOR IMPLEMENTING METAVERSE SYSTEM BASED ON NATURAL ECONOMY}

This disclosure relates to real economy-based metaverse system implementation technology. More specifically, it concerns servers and devices that implement a metaverse system based on the real economy.

Metaverse is a compound word of 'meta', meaning virtuality and transcendence, and 'universe', meaning world and universe, and means a three-dimensional virtual world linked to reality.

Recently, as the global COVID-19 pandemic has prolonged, contact and movement between people has been restricted, and 5G communication networks that can transmit large amounts of information at high speed have been expanded, various forms of virtual worlds supporting lifestyle or game-type virtual worlds have been created. Metaverse services are emerging.

As such, since various economic entities carry out economic activities on the metaverse, a method for implementing the metaverse based on the real economy is needed.

Republic of Korea Patent No. 10-2423623 (Registration date: 2022.07.18.)

The problem that this disclosure aims to solve is a method of building a real economy-based metaverse environment using computer data transmission devices such as tablets, POS, kiosks, TVs, signage, wearable devices such as AR and VR, and hologram devices. It is about providing.

Another problem that this disclosure aims to solve is to provide a metaverse system that provides online and offline payments simultaneously.

The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below.

The real economy-based metaverse system to achieve the above-described technical tasks includes a client terminal for inputting requirements implemented in the metaverse; A display device having an input unit for interaction with a user; And it may include a metaverse system implementation server that implements the metaverse by reflecting the requirements input from the client terminal and reflects the information input through the input unit to the metaverse.

The display device displays items that can be provided offline and items that can be provided online, and when the item that can be provided offline is selected through the input unit, it provides relevant information to the client terminal so that the corresponding item is provided to the user. can do.

When an item that can be provided online is selected through the input unit, the display device may provide related information to the metaverse system implementation server so that the item is implemented on the metaverse.

The display device includes a camera; and a control unit.

When the user approaches within a predetermined distance, the control unit photographs the user's face using the camera, extracts face feature points of the eyes, nose, between the nose and lips, and the lip area from the captured face image, and extracts face feature points of the user's face from the pre-stored user's face. It may be configured to perform user authentication by measuring face feature points and similarity.

The display device may further include a sensing unit for user recognition, and the control unit tracks the user's motion through the camera and the sensing unit when the offline space where the user is located and the metaverse are set to be linked, and the control unit tracks the user's motion through the camera and the sensing unit. It may be configured to provide related information to the metaverse system implementation server so that the tracked user's motion is reflected on the metaverse.

The control unit may be configured to perform data exchange with the metaverse system implementation server only when a predetermined level of motion occurs.

The control unit updates the metaverse at a predetermined period through communication with the metaverse system implementation server when the mobile terminal owned by the user approaches within a predetermined range, and when the mobile terminal is placed outside the predetermined range, the control unit updates the metaverse at a predetermined period. It may be configured to not make any attempt to update the metaverse.

In addition, the method of operating a display device that communicates with a real economy-based metaverse system implementation server of the present disclosure is to display the implemented metaverse when a metaverse reflecting the requirements of a client terminal is implemented in the metaverse system implementation server. step; providing relevant information to the metaverse system implementation server so that information input through an input unit for user interaction is reflected in the implemented metaverse; Displaying items available offline and items available online; When an item that can be provided offline is selected through the input unit, providing related information to the client terminal so that the item is provided to the user; And when an item that can be provided online is selected through the input unit, it may include providing related information to the metaverse system implementation server so that the item is implemented on the metaverse.

The method of operating the display device includes: photographing the user's face using a camera when the user approaches within a predetermined distance; And it may further include extracting face feature points of the eyes, nose, nose and lips, and lip area from the captured face image, and performing user authentication by measuring similarity with pre-stored face feature points of the user.

A method of operating the display device includes tracking the user's motion through a camera and a sensing unit when the offline space where the user is located and the metaverse are set to be linked; And it may further include providing related information to the metaverse system implementation server so that the tracked user's motion is reflected on the metaverse.

The method of operating the display device may further include performing data exchange with the metaverse system implementation server only when a predetermined level of motion occurs.

In addition to this, a computer program stored in a computer-readable recording medium for execution to implement the present disclosure may be further provided.

In addition, a computer-readable recording medium recording a computer program for executing a method for implementing the present disclosure may be further provided.

According to the means for solving the above-described problem of the present disclosure, a metaverse environment built on the real economy can be provided, and a metaverse system based on the real economy that provides online and offline payments simultaneously is provided, thereby improving the infrastructure of the real economy. As it becomes larger, various user conveniences can be improved.

In addition, by providing an environment that can expand from the existing B2B (business to business) revenue management environment to B2C (business to customer) consumer revenue management, the boundaries between B2B and B2C are broken down and the economic concept itself is converged into the metaverse. phenomenon may occur.

The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned may be clearly understood by those skilled in the art from the description below.

1 is a diagram schematically illustrating a real economy-based metaverse system including the overall operating entities of the present disclosure;
Figure 2 is a block diagram showing the configuration of a display device communicating with a real economy-based metaverse system implementation server of the present disclosure;
3 is a sequence diagram showing a method of operating a display device that communicates with a metaverse system implementation server for implementing the commercialization model of the present disclosure;
4 is a diagram for explaining a user authentication method of a display device according to the present disclosure;
FIGS. 5(a) and 5(b) are diagrams for explaining an embodiment in which a user's offline movements are directly reflected on the display device according to the present disclosure;
Figures 6(a) and 6(b) are diagrams for explaining an embodiment in which a user's offline motion is reflected in the metaverse according to the present disclosure;
Figure 7 is a diagram for explaining an embodiment in which the display device of the present disclosure determines whether to share the metaverse according to the distance from the user terminal;
8 is a diagram for explaining a method of displaying a product in the metaverse using a client terminal of the present disclosure;
9(a) and 9(b) are diagrams for explaining an embodiment of performing offline payment and online payment according to the present disclosure;
10 is a relative sequence diagram showing a method of performing a payment process on the metaverse using the payment server of the present disclosure;
Figure 11 is a diagram to explain that various devices for implementing the metaverse system are linked with the metaverse system, and the core of the metaverse configuration is attributed to software.
Figures 12A to 12F are diagrams for explaining an embodiment of performing commercial activities on the metaverse and the metaverse according to the present disclosure.

Like reference numerals refer to like elements throughout this disclosure. The present disclosure does not describe all elements of the embodiments, and general content or overlapping content between the embodiments in the technical field to which the present disclosure pertains is omitted. The term 'unit, module, member, block' used in the specification may be implemented as software or hardware, and depending on the embodiment, a plurality of 'unit, module, member, block' may be implemented as a single component, or It is also possible for one 'part, module, member, or block' to include multiple components.

Throughout the specification, when a part is said to be “connected” to another part, this includes not only direct connection but also indirect connection, and indirect connection includes connection through a wireless communication network. do.

Additionally, when a part "includes" a certain component, this means that it may further include other components rather than excluding other components, unless specifically stated to the contrary.

Throughout the specification, when a member is said to be located “on” another member, this includes not only cases where a member is in contact with another member, but also cases where another member exists between the two members.

Terms such as first and second are used to distinguish one component from another component, and the components are not limited by the above-mentioned terms.

Singular expressions include plural expressions unless the context clearly makes an exception.

The identification code for each step is used for convenience of explanation. The identification code does not explain the order of each step, and each step may be performed differently from the specified order unless a specific order is clearly stated in the context. there is.

Hereinafter, the operating principle and embodiments of the present disclosure will be described with reference to the attached drawings.

Figure 1 is a diagram schematically illustrating a real economy-based metaverse system (1, hereinafter referred to as 'metaverse system') including the overall operating entities of the present disclosure.

The metaverse system (1) is a system that provides a metaverse service environment, including a display device (100) that displays the implemented metaverse, and a metaverse system implementation server (200) that implements the metaverse and provides it to various devices and devices. And it may include a client terminal 300 for inputting requirements implemented in the metaverse, a user (USER) on the user side (USS), and various terminals (400A, 400B) (400). However, devices for implementing the metaverse are not limited to the configuration described above, and include various terminals, devices, devices, POS devices, kiosks, digital signage, servers, clouds, and devices for VR/AR (Hibar, wearable devices, micro displays, hologram devices, etc.) can be linked with each other and used to implement the metaverse.

The display device 100 illustratively described herein may be implemented as a kiosk terminal or a POS terminal, but includes all various devices that can perform calculation processing and provide results to the user. For example, the display device 100 according to the present disclosure may include all of a computer, a server device, and a portable terminal, or may take the form of any one.

Here, the computer may include, for example, a laptop, desktop, laptop, tablet PC, slate PC, etc. equipped with a web browser.

The server device is a server that processes information by communicating with external devices and may include application servers, computing servers, database servers, file servers, game servers, mail servers, proxy servers, cloud-based servers, and web servers. You can.

The portable terminal is, for example, a wireless communication device that guarantees portability and mobility, such as PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), and PDA. (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminal, smart phone ), all types of handheld wireless communication devices, and wearable devices such as watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted-device (HMD). may include.

The metaverse system implementation server 200 is a subject that implements the metaverse according to various requirements, and includes application servers, computing servers, database servers, file servers, game servers, mail servers, proxy servers, cloud-based servers, and web servers. It may be implemented as such, but the embodiment is not limited to this.

The client terminal 300 can communicate with the display device 100. As an optional or additional embodiment, the client terminal 300 may communicate directly with the metaverse system implementation server 200.

The metaverse system implementation server 200 may provide the metaverse service to the user side (USS) through the display device 100, but depending on the embodiment, the metaverse system implementation server 200 may directly provide the user terminal 400A. , 400B) may provide services to (400).

Below, the configuration of the display device 100 that communicates with the metaverse system implementation server 200 will be described.

Figure 2 is a block diagram showing the configuration of the display device 100 that communicates with the real economy-based metaverse system implementation server 200 of the present disclosure.

The display device 100 shown in FIG. 2 may include a communication unit 110, an input unit 120, a sensing unit 130, a display 140, a memory 150, and a control unit 190. The components shown in FIG. 2 are not essential for implementing the display device 100 according to the present disclosure, so the display device 100 described herein has more or fewer components than the components listed above. It can have elements.

Among the components, the communication unit 110 may include one or more components that enable communication with an external device, for example, a broadcast reception module, a wired communication module, a wireless communication module, a short-range communication module, and location information. It may contain at least one of the modules.

The input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user, and includes at least one of at least one camera 121, at least one microphone, and a user input unit. It can contain one. Voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The user input unit is for receiving information from the user. When information is input through the user input unit, the control unit 190 can control the operation of the device to correspond to the input information. This user input unit uses hardware-type physical keys (e.g., buttons, dome switches, jog wheels, jog switches, etc. located on at least one of the front, back, and sides of the device) and software-type touch keys. It can be included. As an example, the touch key consists of a virtual key, soft key, or visual key displayed on a touch screen-type display through software processing, or is displayed on a touch screen type display other than the touch screen. It may be composed of a touch key placed in the part of . Meanwhile, the virtual key or visual key can be displayed on the touch screen in various forms, for example, graphic, text, icon, video or these. It can be made up of a combination of .

The sensing unit 130 senses at least one of the device's internal information, surrounding environment information surrounding the device, and user information, and generates a corresponding sensing signal. Based on these sensing signals, the control unit 190 may control the driving or operation of the device, or perform data processing, functions, or operations related to an application installed on the device.

As described above, the sensing unit 130 includes a proximity sensor, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and a gravity sensor (G- sensor, gyroscope sensor, motion sensor, RGB sensor, infrared sensor, fingerprint scan sensor, ultrasonic sensor, optical sensor ( An optical sensor (e.g., a camera), a microphone, an environmental sensor (e.g., including at least one of a barometer, a hygrometer, a thermometer, a radiation detection sensor, a heat detection sensor, and a gas detection sensor), a chemical sensor (e.g. , healthcare sensor, biometric sensor, etc.). Meanwhile, this device can utilize information sensed by at least two of these sensors by combining them.

The display 140 may display (output) information processed by the display device 100. For example, the display 140 displays execution screen information of an application program (eg, an application) running on the display device 100, or UI (User Interface) and GUI (Graphic User Interface) information according to such execution screen information. can be displayed.

The memory 150 can store data supporting various functions of the display device 100 and programs for the operation of the control unit, and input/output data (e.g., music files, still images, videos, etc.) can be stored, and a plurality of application programs (application programs or applications) running on the device, data for operation of the display device 100, and commands can be stored. At least some of these applications may be downloaded from an external server via wireless communication.

The memory 150 includes a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), and a multimedia card micro type. micro type), card type memory (e.g. SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), EEPROM (electrically erasable) It may include at least one type of storage medium among programmable read-only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. Additionally, the memory is separate from the device, but may be a database connected wired or wirelessly.

The control unit 190 includes a memory that stores data for an algorithm for controlling the operation of components within the display device 100 or a program that reproduces the algorithm, and at least one device that performs the above-described operation using the data stored in the memory. It can be implemented with a processor (not shown). At this time, the memory and processor may each be implemented as separate chips. Alternatively, the memory and processor may be implemented as a single chip.

In addition, the control unit 190 can control any one or a combination of a plurality of the above-described components in order to implement various embodiments according to the present disclosure described in FIGS. 3 to 11 below on the display device 100. You can.

At least one component may be added or deleted in response to the performance of the components shown in FIG. 2. Additionally, it will be easily understood by those skilled in the art that the mutual positions of the components may be changed in response to the performance or structure of the system.

Meanwhile, each component shown in FIG. 2 refers to software and/or hardware components such as Field Programmable Gate Array (FPGA) and Application Specific Integrated Circuit (ASIC).

FIG. 3 is a sequence diagram showing an operation method of the display device 100 communicating with the metaverse system implementation server 200 for implementing the commercialization model of the present disclosure, and FIG. 4 is a user diagram of the display device 100 according to the present disclosure. 5(a) and 5(b) are diagrams for explaining an authentication method, and FIGS. 5(a) and 5(b) are diagrams illustrating an embodiment in which a user's offline movement is directly reflected on the display device 100 according to the present disclosure, and FIG. 6(a) and FIG. 6(b) are diagrams to explain an embodiment in which a user's offline motion according to the present disclosure is reflected in the metaverse, and FIG. 7 shows a display device 100 according to the present disclosure showing a user terminal. This is a diagram to explain an embodiment of determining whether or not to share the metaverse according to the distance to (400). While explaining FIG. 3, FIGS. 4 to 7 will be referred to where necessary.

If the metaverse reflecting the requirements of the client terminal is implemented in the metaverse system implementation server, the control unit 190 of the display device 100 may display the implemented metaverse (S310, metaverse display step).

The control unit 190 may receive information about the metaverse space through the communication unit 110 and display the metaverse space and product items or service items located in the metaverse space.

After step S310 (metaverse display step), the control unit 190 provides relevant information to the server implementing the metaverse system so that the information entered through the input unit 120 for interaction with the user is reflected in the implemented metaverse. It can be done (S320, step of providing information to the metaverse system implementation server).

Afterwards, the control unit 190 can display items that can be provided offline and items that can be provided online (S330, item display step).

The display device 100 performs the role of a general kiosk or POS device, and when an item that can be provided offline is selected by a user operation, the control unit 190 displays products and/or services corresponding to the selected item offline. It can be provided to a client online, and in the case of items that can be provided online, a request can be made to the metaverse system implementation server 200 to be provided on the metaverse.

After step S330 (item display step), when an item that can be provided offline is selected through the input unit 120, the control unit 190 may provide relevant information to the client terminal so that the item is provided to the user (S340 , information provision step to the client terminal).

When an item that can be provided online is selected through the input unit 120, the control unit 190 may provide related information to the metaverse system implementation server 200 so that the item is implemented on the metaverse (S350, metaverse step of providing information to the system implementation server).

Referring to FIG. 4, when the user (USER) approaches within a predetermined distance, the control unit 190 can photograph the user's face using the camera 121.

The control unit 190 extracts face feature points of the eyes (410A), nose (410C), between the nose and lips (410B), and lips (410D) from the captured face image, and measures the similarity with the user's face feature points stored in advance. This allows user authentication to be performed.

Specifically, the control unit 190 measures the vertical distance of each part 410 (410A ~ 410D) of the user's (USER's) face and configures it into a matrix-based vector, and pre-stores the vertical distance of each part of the user's (USER's) face. By constructing the distance as a matrix-based vector, cosine similarity can be calculated using the scalar product and size between the two vectors.

If the cosine similarity is close to 1 by a predetermined amount, the control unit 190 may determine that the similarity between the two vectors is high, and may determine that user authentication is successful.

Referring to FIGS. 5(a) and 5(b), when the offline space where the user (USER) is located and the metaverse are set to be linked, the control unit 190 can track the user's motion through the camera and sensing unit. there is.

The control unit 190 may provide related information to the metaverse system implementation server 200 through the communication unit 110 so that the tracked user's motion is reflected on the metaverse.

If there is a user's movement in an offline space, the metaverse system implementation server 200 may reflect this in the metaverse and provide related information to the display device 100 so that the change is reflected in the display device 100. .

The control unit 190 can exchange data with the metaverse system implementation server 200 only when a predetermined level of motion occurs.

Based on preset standards, the control unit 190 triggers data exchange with the metaverse system implementation server 200 based on the movement distance, movement angle, movement time, etc. of the body part related to the specific motion even if motion occurs. motion can be determined.

If a predetermined level of motion is not generated, the control unit 190 may output a guide message to the user through the display 140, such as 'If you are performing a specific motion, please perform the motion more clearly.' there is.

As an optional or additional embodiment, the control unit 190 may postpone data exchange with the metaverse system implementation server 200 when network traffic is overloaded and even if a predetermined level of motion occurs.

Figures 6(a) and 6(b) are diagrams for explaining an embodiment in which a user's offline motion is reflected in the metaverse according to the present disclosure.

Referring to FIG. 6(a), the display device 100 can track the user's motion using the camera 121 and the sensing unit.

For example, when the user (U1) sits on the sofa (SF1) in an offline space, the control unit 190 can recognize and motion track the user (U1) using the camera 121/sensing unit and a calculation algorithm. .

When the display device 100 is linked to the metaverse system 1 and matches the avatar (U2) corresponding to the user (U1) on the metaverse, the control unit 190 controls the avatar (U2) on the metaverse. U2) can request the metaverse system implementation server 200, etc. to sit on the sofa (SF2).

As an optional or additional embodiment, the metaverse system 1 allows various contents in broadcasting, games, images, etc. to be linked on the metaverse, allowing operators to upload content and/or Data can be easily uploaded, modified, and managed in synchronization on the metaverse.

Referring to FIG. 7, when the mobile terminal 400 carried by the user approaches within a predetermined range, the control unit 190 may update the metaverse at a predetermined period through communication with the metaverse system implementation server 200. Here, The synchronization possible distance 610 may be within a predetermined range, but the embodiment is not limited thereto.

That is, the control unit 190 determines the distance at which the user is ready to use the metaverse as the synchronization possible distance 610, and can update the metaverse at a predetermined period as long as it is within the synchronization possible distance 610.

If the mobile terminal 400 is placed outside a predetermined range, the control unit 190 may not attempt to update the metaverse and displays a message such as 'To use the metaverse, please come forward beyond the specific line below.' It can be output through (140), and various configurations can be controlled so that a specific line is displayed on the floor.

Figure 8 is a diagram for explaining a method of displaying a product in the metaverse using the client terminal 300 of the present disclosure.

The client terminal 300 may request the metaverse system implementation server 200 to display a specific product on the metaverse. The metaverse system implementation server 200 may reflect a specific product in the metaverse, and the display device 100 may display the specific product in the reflected metaverse.

9(a) and 9(b) are diagrams for explaining an embodiment of performing offline payment and online payment according to the present disclosure.

Referring to FIG. 9(a), when a specific product is selected through user manipulation, the control unit 190 can perform offline payment and provide the specific product to the user offline. For example, the control unit 190 may request a service for providing a product (eg, coffee) from the client terminal.

Referring to FIG. 9(b), when a specific product is selected by user manipulation, the control unit 190 may request the metaverse system implementation server 200 to reflect the specific product on the metaverse. The metaverse system implementation server 200 performs payment on an online basis, the metaverse system implementation server 200 can reflect a specific product in the metaverse, and the display device 100 can display a specific product in the reflected metaverse. Can be printed.

Figure 10 is a relative sequence diagram showing a method of performing a payment process on the metaverse using the payment server of the present disclosure.

After receiving the order, the display device 100 provides payment information to the payment server 500 (S910), and the payment server 500 may provide payment information to the metaverse system implementation server 200 (S910). S920).

The metaverse system implementation server 200 may perform a payment process, reflect a specific product on the metaverse, and then output it on the metaverse on the display device 100 (S930).

FIG. 11 is a diagram illustrating various devices for implementing the metaverse system 1 according to the present disclosure, and various devices for implementing the metaverse system 1 are linked with the metaverse system 1. This is a drawing to explain that the core of the metaverse structure belongs to software.

Devices to implement the metaverse system (1) include smartphone (D1), tablet (D2), POS machine (D3), kiosk (D4), digital signage (D5), HMD (VAR1), and various VR/AR. The metaverse can be implemented by linking with devices such as VR/AR high bars, wearable devices, micro displays, and hologram providing devices, including devices (VAR2 to VAR6). Ultimately, the core of metaverse composition can be attributed to metaverse software (SW).

Meanwhile, when the control unit 190 of the display device 100 displays the metaverse space provided from the metaverse system implementation server through the display 140, it can display a product item or service item on the metaverse space.

The control unit 190 may receive information about the metaverse space through the communication unit 110 and display the metaverse space and product items or service items located in the metaverse space.

The control unit 190 can output various items in the metaverse space to the display 140 and wait for user input.

When a product or service item is selected by user manipulation, the control unit 190 may map the URL address entered by the user to the selected product or service item.

The control unit 190 may recognize the selection of a product item or service item through user manipulation (eg, input through a touch screen).

The control unit 190 may map an Internet URL address input through a user or a user terminal to a selected product or service item and store it in the memory 150.

To this end, the control unit 190 may provide a user interface that can perform URL registration/edit/delete/cancel, etc., and may map URL addresses corresponding to specific product items and/or service items according to user operations. You can edit the mapped content or delete the URL address corresponding to a specific item.

The control unit 190 may provide a user interface for mapping URL addresses corresponding to specific items.

Additionally, the control unit 190 may manage mapped information. For example, the control unit 190 may manage various URL addresses by mapping them to product items and/or service items located on the metaverse.

When the site corresponding to the URL address is accessed through the metaverse, the control unit 190 requests the metaverse system implementation server 200 to provide a predetermined reward to the user who maps the URL address to the selected product or service item. It may include steps.

When a product item is sold or a service item is sold or used, the control unit 190 may request the metaverse system implementation server to distribute profits to the operator that operates the metaverse system implementation server 200. Accordingly, in relation to product profits, a predetermined percentage of the amount may be provided to the operating company for customers who flow in through the Metaverse platform.

The control unit 190 can output a specific advertisement on the displayed metaverse according to the advertiser's request, and the advertising fee can be calculated based on the number of visitors, which can be determined by the metaverse system implementation server 200.

The metaverse system implementation server 200 actually implements the metaverse and can implement the commercialization model generated in the metaverse and provide it to various devices and/or devices, such as the communication unit and control unit of the display device 100 described above. It may include components that perform the role of.

The metaverse system implementation server 200 can provide various services for placing advertisements in the metaverse, can set the cost of advertising in the metaverse, and can sell or lease space in the metaverse. /Rental costs can be set.

The metaverse system implementation server 200 may provide information for displaying the metaverse to the display device 100.

The metaverse system implementation server 200 provides various information, including information about the space of the metaverse, information related to advertising, information about profits, information about real estate/movable assets on the metaverse, and information related to products and/or services. Information may be provided to the display device 100.

The metaverse system implementation server 200 may provide an advertiser's specific advertisement on a specific space of the metaverse.

The metaverse system implementation server 200 may visually display or audibly provide an advertiser's advertisement on the metaverse according to a contract with the advertiser (or a device related to the advertiser).

The metaverse system implementation server 200 may determine information about advertising costs and advertising revenue related to advertising in various ways.

The metaverse system implementation server 200 may calculate the first advertising cost based on the number of visitors who visit a specific space in the metaverse.

In an embodiment, the metaverse system implementation server 200 may calculate the first advertising cost using [Equation 1] below.

[Equation 1]

W1 (first advertising cost) = K1 * Cn1,

Here, K1 is a constant, C is the number of visitors, n1 may be a natural number greater than or equal to 1, and K1 and n1 may be determined by the metaverse system implementation server 200. K1 and n1 are constants, but can be changed based on the number of metaverse visitor sections. For example, when the number of visitors (C) is less than 1000, the numbers of K1 and n1 may be close to 1 within a certain range, but when the number of visitors (C) is more than 1000, the values of K1 and n1 may gradually increase. .

If the number of visitors decreases due to adjustment of K1 and n1, the metaverse system implementation server 200 may adjust the values of K1 and n1 again to a predetermined range.

The metaverse system implementation server 200 may calculate the second advertising cost based on the occupancy time of visitors who visit a specific space of the metaverse.

In an embodiment, the metaverse system implementation server 200 may calculate the second advertising cost using [Equation 2] below.

[Equation 2]

W2 (second advertising cost) = K2 * t ⁿ² ,

Here, K2 is a constant, t is the occupancy time, n2 may be a natural number of 2 or more, and K2 and n2 may be determined by the metaverse system implementation server 200. K1 and n2 are constants, but can be changed based on the number of metaverse visitor sections. For example, when the number of visitors (C) is less than 1000, the numbers of K1 and n2 may be close to 2 within a certain range, but when the number of visitors (C) is more than 1000, the values of K1 and n1 may gradually increase. .

Here, the metaverse system implementation server 200 may place more weight on the occupancy time that a visitor stays in a specific space than on the number of visitors (through n2 > n1). This is because customers who have stayed for a long time are more likely to purchase products or purchase/use services.

The metaverse system implementation server 200 can calculate the third advertising cost according to the area and output location of the advertisement displayed in a specific space of the metaverse.

The metaverse system implementation server 200 can calculate the third advertising cost using [Equation 3] below.

[Equation 3]

W3 (third advertising cost) = K3 * S + K4 * Q,

Here, K3 and K4 are constants, S is the occupied area, and Q may be a predetermined weight depending on the output location. K3 and K4 are constants, but can be changed based on the number of metaverse visitor sections.

Additionally, the value of Q can also be changed based on the number of metaverse visitor sections, and in the case of highly popular locations, the weight can be set high.

In this specification, it is explained that the metaverse system implementation server 200 sequentially calculates the first to third advertising costs, but depending on the implementation example, the first to third advertising costs may be calculated selectively.

In an embodiment, the metaverse system implementation server 200 may calculate the popularity of a specific space in the metaverse and calculate an admission fee based on the calculated popularity. Popularity can be determined based on the number of visitors, visitor occupancy time, etc.

In an embodiment, the metaverse system implementation server 200 can calculate the popularity of a space using [Equation 4] below.

[Equation 4]

P = K*C (number of visitors) * t ² /dt (unit time),

Here, K is a constant, and t may be the visitor's occupancy time.

The metaverse system implementation server 200 may calculate the visitor's admission fee based on the calculated popularity.

The metaverse system implementation server 200 can create metaverse space and sell and lease it.

In an embodiment, the metaverse system implementation server 200 may calculate space popularity using [Equation 5] below.

[Equation 5]

T = K*C(number of visitors)*t/dt(unit time),

Here, K is a constant, and t may be the visitor's occupancy time.

In an optional embodiment, the metaverse system implementation server 200 can calculate sale/lease costs by considering popularity and price index, and can discount rent as the lease period increases.

As an optional embodiment, the metaverse system implementation server 200 may set and provide different metaverse usage functions for the lessee and the lessor, and may restrict functions such as changing appearance, deleting URL, and exposing specific advertisements to the lessee.

In an optional embodiment, the metaverse system implementation server 200 may provide a portion of the rent of a portion of the sale to the operating company. The metaverse system implementation server 200 can change the ratio according to popularity. For example, the ratio could be K/popularity, and the higher the popularity, the lower the cost to the operator.

In an optional embodiment, the metaverse system implementation server 200 may link (link) the offline space and the metaverse space, and for this purpose, depth information may be used in the display device 100 through a stereo camera, lidar, etc. You can. In addition, the operator can provide a subscription system for Metaverse users, but the timing of implementation of the drive system may be determined depending on the number of visitors, visit occupancy time, popularity, etc.

Figures 12A to 12F are diagrams for explaining an embodiment of performing commercial activities on the metaverse and the metaverse according to the present disclosure.

When explaining these drawings, the display device 100 is taken as an example, but devices for implementing the metaverse according to the present disclosure are not limited to the above devices, and include various terminals, devices, force devices, kiosks, Devices for digital signage, servers, cloud, and VR/AR (Hibar, wearable devices, micro displays, hologram devices, etc.) can be linked to each other and used to implement Metaverse, and the core component of Metaverse is Metaverse software. It can result in:

The spaces of the metaverse can be diverse and endless, but examples include My Room (Figure 12a), Building (Figure 12b), (predetermined) space (Figure 12c), World (Figure 12d), and product/service provision space. (Figure 12e), a space for introduction/accumulation (Figure 12f), etc.

Referring to FIG. 12A, My Room may be a user's personal space, objects (eg, refrigerators, sofas, etc.) may be placed in the space, and URL addresses may be mapped to products and stored. In addition, an avatar (AU) corresponding to the user may be located in My Room. In the metaverse, an environment can be provided to improve the appearance of the avatar (AU), and clothing, meals, etc. necessary for the avatar's (AU) life can be provided. The costs may be covered by offline payments, but The example is not limited to this.

Referring to FIG. 12b, a building is an object implemented on the metaverse and can be the subject of commercial activities such as construction, sale, or rental, and a user who purchases a building may be required to pay the purchase cost to the operating company. Additionally, building purchasers can generate profit by renting out all or part of the building. Costs for rent/sales, etc. may be set differently depending on the awareness of the building, number of visitors/time, etc.

In addition, advertising space is placed in a specific part of the building (715), so that profit activities can be made by renting the area for advertising to various metaverse users, and an appropriate cost (e.g., 10%) can be paid to the operator. .

Referring to FIG. 12C, various products/services may be provided in the product/service provision space, can be purchased/used by avatars (AUs) on the metaverse, and costs may be incurred depending on purchase/use.

Referring to FIG. 12d, the metaverse advertising service can be provided in a designated external space other than the building. The space may be a famous historical site, a tourist attraction, etc., but the embodiment is not limited thereto.

Referring to FIG. 12e, various events can be held in a plaza-like world where a large number of users gather, and commercial activities to generate profits can be actively performed at the events and side events.

Referring to Figure 12f, the metaverse can provide a space where avatars on the metaverse can meet each other, and the personalities of the avatars can be set based on a specific tool, for example, the user's personality or the user's personality based on MBTI. After setting the desired personality, you can arrange introductions in the metaverse space and perform profit-making activities.

As seen, the Metaverse software is linked to all standard devices, Metaverse content can be uploaded and used uniformly, various modifications/management can be easily performed, and monetization activities can be performed.

The metaverse system implementation server 200 can analyze the commercialization model from an economic perspective and provide it to various devices (eg, display device 100).

The Metaverse system implementation server 200 can provide space reservation information, monthly rental revenue information, admission fee information, product revenue information, service revenue information, advertising revenue information, etc. on a daily/monthly/year basis according to the commercialization model of the Metaverse. there is.

Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium that stores instructions executable by a computer. Instructions may be stored in the form of program code, and when executed by a processor, may create program modules to perform operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.

Computer-readable recording media include all types of recording media storing instructions that can be decoded by a computer. For example, there may be read only memory (ROM), random access memory (RAM), magnetic tape, magnetic disk, flash memory, optical data storage device, etc.

As described above, the disclosed embodiments have been described with reference to the attached drawings. A person skilled in the art to which this disclosure pertains will understand that the present disclosure may be practiced in forms different from the disclosed embodiments without changing the technical idea or essential features of the present disclosure. The disclosed embodiments are illustrative and should not be construed as limiting.

Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium that stores instructions executable by a computer. Instructions may be stored in the form of program code, and when executed by a processor, may create program modules to perform operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.

Computer-readable recording media include all types of recording media storing instructions that can be decoded by a computer. For example, there may be read only memory (ROM), random access memory (RAM), magnetic tape, magnetic disk, flash memory, optical data storage device, etc.

As described above, the disclosed embodiments have been described with reference to the attached drawings. A person skilled in the art to which this disclosure pertains will understand that the present disclosure may be practiced in forms different from the disclosed embodiments without changing the technical idea or essential features of the present disclosure. The disclosed embodiments are illustrative and should not be construed as limiting.

100: display device,
200: Metaverse system implementation server.

Claims (10)

As a metaverse system based on the real economy,
A client terminal for entering requirements implemented in the metaverse;
A display device having an input unit for interaction with a user; and
It includes a metaverse system implementation server that implements the metaverse by reflecting the requirements input from the client terminal and reflects the information input through the input unit to the metaverse,
The display device is,
Displays items that can be provided offline and items that can be provided online,
When an item that can be provided offline is selected through the input unit, relevant information is provided to the client terminal so that the item is provided to the user,
When an item that can be provided online is selected through the input unit, a real economy-based metaverse system configured to provide related information to the metaverse system implementation server so that the item is implemented on the metaverse. According to paragraph 1,
The display device is,
camera; and
Includes a control unit,
The control unit,
When the user approaches within a predetermined distance, the user's face is photographed using the camera, facial feature points of the eyes, nose, between the nose and lips, and the lip area are extracted from the captured face image, and the similarity with the user's face feature points stored in advance is extracted. A real economy-based metaverse system configured to perform user authentication by measuring . According to paragraph 2,
The display device further includes a sensing unit for user recognition,
The control unit,
When the offline space where the user is located and the metaverse are set to be linked, the user's motion is tracked through the camera and the sensing unit,
A real economy-based metaverse system configured to provide related information to the metaverse system implementation server so that the tracked user's motion is reflected on the metaverse. According to paragraph 3,
The control unit,
A real economy-based metaverse system configured to perform data exchange with the metaverse system implementation server only when a predetermined level of motion occurs. According to paragraph 4,
The control unit,
When the mobile terminal owned by the user approaches within a predetermined range, the metaverse is updated at a predetermined period through communication with the metaverse system implementation server,
A real economy-based metaverse system configured to not perform an attempt to update the metaverse when the mobile terminal is placed outside a predetermined range. As a method of operating a display device that communicates with a real economy-based metaverse system implementation server,
When a metaverse reflecting the requirements of a client terminal is implemented in the metaverse system implementation server, displaying the implemented metaverse;
providing relevant information to the metaverse system implementation server so that information input through an input unit for user interaction is reflected in the implemented metaverse;
Displaying items available offline and items available online;
When an item that can be provided offline is selected through the input unit, providing related information to the client terminal so that the item is provided to the user; and
When an item that can be provided online is selected through the input unit, a method of operating a display device comprising providing related information to the metaverse system implementation server so that the item is implemented on the metaverse. According to clause 6,
When the user approaches within a predetermined distance, photographing the user's face using a camera; and
A method of operating a display device further comprising the step of extracting face feature points of the eyes, nose, nose and lips, and lip area from the captured face image, and performing user authentication by measuring similarity to pre-stored face feature points of the user. . In clause 7,
When the offline space where the user is located and the metaverse are set to be linked, tracking the user's motion through a camera and a sensing unit; and
A method of operating a display device, further comprising providing related information to the metaverse system implementation server so that the tracked user's motion is reflected on the metaverse. According to clause 8,
A method of operating a display device, further comprising performing data exchange with the metaverse system implementation server only when a predetermined level of motion occurs. A program stored in a computer-readable recording medium for executing a method of operating a display device that communicates with the real economy-based metaverse system implementation server of any one of claims 6 to 9.

Images