WO2023128134A1

WO2023128134A1 - Apparatus and method for accessing object-based metaverse

Info

Publication number: WO2023128134A1
Application number: PCT/KR2022/013491
Authority: WO
Inventors: 김판종; 명배영; 윤진혁; 유성훈; 송희섭
Original assignee: 머지리티 주식회사
Priority date: 2022-01-03
Filing date: 2022-09-07
Publication date: 2023-07-06

Abstract

A method by which a server provides an object-based metaverse service, according to an embodiment of the present disclosure, comprises the steps of: receiving a first access message including first image information; extracting a first identification element from the first image information; determining whether or not a first metaverse corresponding to a first object has been generated; if the first metaverse has already been generated, providing a first user terminal with an access address via which a connection to the first metaverse is made; if the first metaverse has not been generated, providing the first user terminal with information regarding a generation condition of the first metaverse; and if the generation condition of the first metaverse satisfies a predetermined level, providing the first user terminal with information indicating that the first metaverse is scheduled to be generated.

Description

Apparatus and method for accessing object-based metaverse

The present invention relates to metaverse technology, and more particularly, to a device or method for accessing a metaverse through objects.

Recently, virtual reality, augmented reality, and mixed reality technologies applying computer graphics technology are developing. At this time, virtual reality technology refers to a technology that uses a computer to build a virtual space that does not exist in the real world and then makes the virtual space feel like reality, and augmented reality or mixed reality technology is a computer-generated space on top of the real world. It refers to a technology that adds information and expresses it, that is, a technology that allows interaction with users in real time by combining the real world and the virtual world. Among them, augmented reality and mixed reality technologies are utilized in conjunction with technologies in various fields (eg, broadcasting technology, medical technology, game technology, etc.). When the weather map in front of a weather caster who makes a weather forecast on TV changes naturally, or when an advertisement image that does not exist in a stadium is inserted and transmitted on the screen as if it actually exists in the stadium in sports broadcasting, augmented reality is an augmented reality in the field of broadcasting technology. This is a prime example of how technology is being used. In particular, these augmented reality and mixed reality technologies are implemented and provided as various application services with the advent of smart phones. As a representative service that provides augmented reality or mixed reality to users, there is a meta-verse. This metaverse is a combination of 'Meta', which means processing and abstraction, and 'Universe', which means the real world, and means a three-dimensional virtual world. Metaverse is a concept that is more advanced than the term virtual reality environment, and provides an augmented reality environment in which virtual worlds such as the web and the Internet are absorbed into the real world. In this regard, Korea Patent Publication No. 2009-0053183 provides real-time groupware service, Context Awareness (CA), in a metaverse-based network environment so that users can experience real-life through avatars and personal communities. We are disclosing a service technology that makes you feel immersive and allows you to do various activities like real life in cyberspace.

However, the metaverse service providing technologies for providing users with conventional augmented reality or mixed reality disclosed in Korea Patent Publication No. 2009-0053183 etc. induce users to access the metaverse through a specific object. There is a limitation that it does not provide technology for

An object of the present invention is to connect a plurality of users to one metaverse through a specific thing.

According to an embodiment of the present disclosure, a method for providing a thing-based metaverse service by a server includes receiving a first access message including first image information of a first object photographed by a first user terminal. ; extracting a first identification element for identifying the first object from the first image information; determining whether a first metaverse corresponding to the first thing is generated from a pre-stored object-based metaverse list by analyzing the first identification element; If the first metaverse is already created, providing the first user terminal with an access address connected to the first metaverse; If the first metaverse is not generated, providing information about the creation condition of the first metaverse to the first user terminal - the degree of achievement of the creation condition is changed according to the reception of the first access message -; providing information that the first metaverse is scheduled to be created to the first user terminal when the condition for generating the first metaverse meets a predetermined level; If the first metaverse is created, allocating assets subordinate to the first metaverse to the first user terminal; receiving a display message matched to the assigned asset from the first user terminal; Receiving a second access message including second image information of a second object photographed by a second user terminal; extracting a second identification element for identifying the second object from the second image information; comparing the first identification element with the second identification element, and providing an access address connected to the first metaverse to the second user terminal when the first object and the second object satisfy an identity criterion; and providing information related to the first metaverse including a display message to the second user terminal when the second user terminal requests access to the first metaverse through the access address. .

In addition, the generation condition is to receive a request for generating a metaverse corresponding to image information about a thing from a plurality of user terminals a predetermined number of times or more, and the thing for the image information is based on the identity with respect to the first thing. may be an object that satisfies

In addition, the step of allocating an asset subordinate to the first metaverse may include: giving priority to the purchase of the asset to the first user terminal before generating the first metaverse; receiving subscription information corresponding to the priority from the first user terminal; determining a first asset to be allocated to the first user terminal based on the subscription request; and allocating the first asset to the first user terminal.

In addition, the time interval before generating the first metaverse is the first interval corresponding to the time interval from when the creation condition is achieved until the first metaverse is generated and the first access message is received. A second interval corresponding to a time interval from then until the creation condition is achieved, and the priority for the allocation of the asset of the first user terminal is the time point at which subscription information corresponding to the priority is received. In the case of the second interval, the time point at which subscription information corresponding to the priority is received may be set higher than that in the case of the first interval.

In addition, the priority for the allocation of the asset of the first user terminal is the right for the first user terminal to purchase or use the asset at a predetermined initial amount, and the subscription information is the payment for the initial amount contains information

In addition, the first identification element or the second identification element is identification information related to at least one of a brand, type, and design of the first object or the second object, and the first identification element and the second identification element if includes a plurality of identification elements, determining whether the identity criterion is satisfied for each identification element; and determining that the first object and the second object are the same based on an identical identification element satisfying the identity criterion among the plurality of identification elements, wherein the brand is selected from the first image information or It is determined by at least one of letters, numbers, symbols, and logos extracted from the second image information, and the type is the first object or the second object extracted from the first image information or the second image information. Determined by matching with a pre-stored database based on the appearance or layout of, and the design is the color and texture of the first object or the second object extracted from the first image information or the second image information , size and shape may be determined by at least one.

In addition, the step of determining that the first object and the second object are the same based on the same identification element that satisfies the identity criterion may include the first object and the second object when the number of identical identification elements is greater than or equal to a predetermined number. 2 determining that objects are the same; Alternatively, an identification element related to the brand is determined as an essential element, and an identification element related to the type or design is determined as an optional element, and when the essential element satisfies the identity condition, the first object and the second object are determined. It involves determining that things are the same.

In addition, the generation condition is that a fund corresponding to a thing obtained from a plurality of user terminals reaches a predetermined amount, and the thing corresponding to the fund satisfies an identity criterion with respect to the first thing. can be a thing

In addition, the generated first metaverse is a virtual space including a virtual structure generated based on first image information corresponding to the first object, and the virtual structure is the first user terminal or the second metaverse. A user of a user terminal may be configured to access the first metaverse and interact in the virtual space.

In addition, determining whether the determined first metaverse assigns different rights according to whether a user of the first user terminal is an owner of the first thing; transmitting purchase information request information indicating that the user of the first user terminal is the owner of the first thing to the first user terminal when it is determined that different rights are allocated; and providing first authorization information for a first authority to the first user terminal when purchase authentication information corresponding to the purchase information request information is received from the first user terminal.

The method further includes providing second permission grant information for a second permission related to a second metaverse corresponding to a thing similar to the first thing to the first user terminal, wherein the second permission comprises: Permission to allow a first user terminal to access a first metaverse corresponding to the first thing and perform an interaction related to the second metaverse, and the similar thing is a first metaverse related to the brand of the thing. It may be an object that satisfies a probability index equal to or greater than a predetermined threshold with respect to identity with the first object based on the information, the second information related to the type of the object, and the third information related to the design of the object.

A server providing a thing-based metaverse service according to another embodiment of the present disclosure includes a communication unit; storage unit; and at least one processor operatively connected to at least one of the communication unit and the storage unit, wherein the at least one processor includes first image information of a first object photographed by a first user terminal. Receiving a first access message; extracting a first identification element for identifying the first object from the first image information; determining whether a first metaverse corresponding to the first thing is generated from a pre-stored object-based metaverse list by analyzing the first identification element; If the first metaverse is already created, providing the first user terminal with an access address connected to the first metaverse; If the first metaverse is not generated, providing information about the creation condition of the first metaverse to the first user terminal - the degree of achievement of the creation condition is changed according to the reception of the first access message -; providing information that the first metaverse is scheduled to be created to the first user terminal when the condition for generating the first metaverse meets a predetermined level; If the first metaverse is created, allocating assets subordinate to the first metaverse to the first user terminal; receiving a display message matched to the assigned asset from the first user terminal; Receiving a second access message including second image information of a second object photographed by a second user terminal; extracting a second identification element for identifying the second object from the second image information; comparing the first identification element with the second identification element, and providing an access address connected to the first metaverse to the second user terminal when the first object and the second object satisfy an identity criterion; and when the second user terminal requests access to the first metaverse through the access address, providing the second user terminal with related information of the first metaverse including a display message. can be configured.

The object-based metaverse access device of the present invention has the advantage of improving metaverse accessibility by generating a metaverse corresponding to a specific thing and inducing users to access it.

1 illustrates configurations of a user terminal and a server according to an embodiment of the present disclosure.

2 illustrates operations of a user terminal and a server according to an embodiment of the present disclosure.

3 illustrates an object identification element according to an embodiment of the present disclosure.

4 illustrates an operation of extracting an object from image information according to an embodiment of the present disclosure.

5 illustrates an operation of determining a metaverse from things according to an embodiment of the present disclosure.

6 illustrates a user interface of a user terminal according to an embodiment of the present disclosure.

7 is a flowchart illustrating the operation of a server according to an embodiment of the present disclosure.

8 is a flowchart of operations of a server for generating a metaverse according to an embodiment of the present disclosure.

9 illustrates information transmission between a server and a user terminal according to an embodiment of the present disclosure.

10 illustrates assets allocated in the metaverse according to an embodiment of the present disclosure.

11 illustrates another example of information transmission between a server and a user terminal according to an embodiment of the present disclosure.

12 illustrates an example in which a user terminal allocates different rights according to objects according to an embodiment of the present disclosure.

13 illustrates a user interface of a user terminal according to an embodiment of the present disclosure.

Hereinafter, the embodiments disclosed in this specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are given the same reference numerals regardless of reference numerals, and redundant description thereof will be omitted. In addition, in describing the embodiments disclosed in this specification, if it is determined that a detailed description of a related known technology may obscure the gist of the embodiment disclosed in this specification, the detailed description thereof will be omitted.

Terms including ordinal numbers, such as first and second, may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another.

Singular expressions include plural expressions unless the context clearly dictates otherwise.

In this application, each step described can be performed regardless of the listed order, except for the case where it must be performed in the listed order due to a special causal relationship.

In this application, terms such as "comprise" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Hereinafter, the present invention will be described with reference to the accompanying drawings.

Referring to FIG. 1 , the user terminal 110 and the server 130 may transmit or receive signals or data to each other through a wireless communication network.

The user terminal may include a camera unit 111 , a communication unit 113 and a processor 115 . For example, the user terminal may be a smart phone or a wireless communication device that the user carries or possesses.

The camera unit 111 may be provided outside the user terminal and configured to directly obtain visual data about an object. The camera unit may obtain visual information of an object existing within a range of a predetermined angle of view and convert or reprocess it into a static image or a dynamic image. For example, the camera unit may be a camera installed in a user's smart phone, and may create a photo or video file by photographing or recording surrounding objects. The camera unit may be electrically connected to other elements of the user terminal to transmit visual information about an acquired object.

The communication unit 113 may transmit visual information of an object acquired by the camera unit or data (eg, a photo or video file) generated by reprocessing or converting the visual information to the server. The communication unit may transmit the control command or data generated by the processor to the server independently or combined with or separated from the visual image of the object.

The processor 115 may process, analyze, or transform visual information obtained through the camera unit to convert the visual information into data, and extract an object identification element from the visual information based on a predetermined model. Also, the processor may generate a control command based on visual information or pre-stored information, and transmit the control command to the server through the communication unit.

The server 130 may generate a message based on a signal or data received from a user terminal or pre-stored information, and may provide the generated message to the user terminal. In addition, based on the signal or data received from the user terminal, a corresponding metaverse may be generated or a command allowing access to the generated metaverse may be generated. Information related to the metaverse generated by the server may be provided to at least one user terminal.

Referring to FIG. 2 , a system for accessing a thing-based metaverse may include one server, a plurality of user terminals, and a plurality of things. Here, a plurality of objects may correspond to a plurality of user terminals.

In FIG. 2 , a plurality of objects may be objects having the same social transaction value. For example, it may refer to an object that is recognized as the same in terms of transaction because elements such as brand, size, shape, and price are the same. More specifically, objects with a capacity of 200ml as an a-type cola can sold by 's company' can be recognized as the same object even if there is some difference in expiration date or external appearance.

In FIG. 2 , the plurality of user terminals may be user terminals carried or manipulated by different users. For example, the first user terminal 210a may be owned by A located in Seoul, and the second user terminal 210b may be owned by B located in Cheongju.

Each user terminal may obtain image information for each object at the same time or at different time points. For example, a user possessing each user terminal may photograph or record each object through a camera provided in the user terminal. After that, each user terminal may transmit corresponding image information to the server. At this time, the operation of transmitting the image information to the server may be understood as an operation of transmitting a message including the user's intention to access a specific metaverse.

An operation of transmitting such a message may be performed simultaneously or in a different order by a plurality of user terminals.

For example, the first user terminal 210a may photograph the first object 250a placed on the table and transmit image information on the first object to the server. In addition, the second user terminal 210b may photograph the second object 250b in the refrigerator and transmit image information of the second object to the server.

The server may receive a message from the user terminal and analyze image information included in the received message to determine or create a metaverse corresponding to the object.

In one example, the operation of determining the metaverse by the server may be performed through an operation of determining an object-metaverse relationship corresponding to an identification element obtained by analyzing image information and a metaverse list stored in advance. there is.

Prior to the operation of determining or generating the metaverse by the server, an operation of determining the identity of each thing may be performed. For example, the server may extract an identification element from each image information corresponding to the first object and the second object and determine whether they are identical according to a predetermined criterion. When the server determines that the first thing and the second thing are identical, the metaverse corresponding to the first thing and the metaverse corresponding to the second thing may be determined to be the same metaverse.

Accordingly, when the metaverse of the first thing has already been determined, the metaverse of the second thing determined to be the same as the first thing according to the identity determination may be the same as the metaverse of the first thing.

Referring to FIG. 3 , image information corresponding to a plurality of different objects including a first object, a second object, and a third object may include at least one identification element.

The identification element may be necessary information for specifying an object from image information. Specifying a thing may mean defining the thing to an extent sufficient to determine whether the thing is the same as another thing in terms of transaction. Here, the identification element includes at least one of the type of object, brand, quantitative information, price, and design, and the object may be specified by a combination of the identification elements.

For example, the server may extract at least one identifiable identification element from the first image information corresponding to the first object. More specifically, the server may identify that the first object is a type of 'beverage can' by comparing the 'shape or layout' of the object displayed on the first image information with a previously stored database. In addition, the server compares the 'surface information' of the object shown on the first image information with the previously stored database, and the type of the first object is 'Cola', the capacity is '300ml', and the brand is a product of 'C company' it can be determined that

The server compares the determined identification element with a pre-stored object information list, and may specify that the first object corresponding to the first image information is 'a 300ml Coke can released by company c'. The identification element of the first image may be 'c company' corresponding to the brand, '300ml' corresponding to the capacity, and 'cola can' corresponding to the type.

Here, an identification element for a brand indicating a source of an object may be referred to as a first identification element.

The type of object may be determined through the shape of the object, quality printed on the surface of the object, component information, or color, and an identification element for the type may be referred to as a second identification element.

An identification factor related to a price, capacity, release date, etc. of a thing may be referred to as a third identification element.

The server may mutually compare the first to third identification elements in order to determine the identity of the thing specified from the identification element of the image information and the thing included in the pre-stored object information list. In this case, a priority order may exist between the first identification element and the third identification element. For example, in the determination of identity, the first identification factor has the highest weight, and the priority may be lowered in the order of the second identification element and the third identification element.

For example, the first identification element may be set to have a higher priority than the other identification elements. In this case, even if the third identification factor matches between the specified thing and the thing on the thing information list, if the first identification element is different, it can be regarded that they are not the same thing. Therefore, in this case, the server preferentially selects objects corresponding to the object matching the first identification element among the identification elements of the specified thing from the object information list, and compares the remaining identification elements between the selected objects and the specified thing. can

In addition, the server may identify the 'designed band pattern' displayed on one side of the surface of the object displayed on the first image information and use it to specify the object.

In another example, the server may extract at least one identifiable identification element from the second image information corresponding to the second object. More specifically, the server may identify that the second object is a type of 'drink can' by comparing the 'shape or layout' of the object displayed on the second image information with a previously stored database. In addition, the server compares the 'surface information' of the object displayed on the second image information with the previously stored database, and determines that the type of the second object is 'Cola can', the capacity is '200ml', and the brand is 'c company'. product can be determined.

The server compares the determined identification element with a pre-stored object information list, and may specify that the second object corresponding to the second image information is 'a 300ml Coke can released by company c'.

The server may determine whether the first object and the second object are identical by comparing identification elements of the first object and the second object specified through the first image information and the second image information. In this case, it can be confirmed that all other identification elements are identical except for '200ml' and '300ml', which are the capacities of the object. The server considers the priority of the identification elements, and since only the third identification element (identification element regarding capacity) having the lowest priority is different, the first thing and the second thing may be determined as the same thing or a similar thing. there is.

In another example, the server may extract at least one identifiable identification element from the third image information corresponding to the third object. More specifically, the server may identify that the third object is a type of 'beverage plastic bottle' by comparing the 'shape or layout' of the object displayed on the third image information with a previously stored database. In addition, the server compares the 'surface information' of the object shown on the third image information with the previously stored database, and determines that the type of the third object is 'Cola Pat', the capacity is '500ml', and the brand is 'c company'. product can be determined.

The server may compare the determined identification element with a pre-stored object information list, and may specify that the third object corresponding to the third image information is 'a 500ml cola pad released by company c'.

The server may compare identification elements of the first and third objects specified through the first image information and the third image information to determine whether the first object and the third object are identical. In this case, the identification elements '200ml' and '300ml' for the capacity of the thing are different, the identification elements for the type of the thing, 'Cola can' and 'Cola pad' are different, and the identification element for the brand of the thing is different. It can be confirmed that it is the same as 'c company'. The server considers the priority among the identification elements, so that the first identification element (identification element for brand) having the highest priority is the same, but the second identification element (identification element for type) having the second highest priority ) are different, the first object and the third object may be determined as similar or different objects.

Referring to FIG. 4 , the server may acquire image information from a user terminal and perform a predetermined process step by step to extract an object.

Although the operation of FIG. 4 is illustrated as an operation of a server, it is also possible for a user terminal generating image information of an object to perform the operations of FIG. 4 based on at least one of a control command received from the server or a pre-stored database. . At this time, the operation of the user terminal may be performed through an application connected to the server and installed in the user terminal.

The server may extract an identification element from image information acquired from the user terminal. The identification factor may be determined according to pre-stored judgment criteria. For example, the server may apply a criterion corresponding thereto to extract an identification factor for the type, brand, design, description, and the like of the object. More specifically, the server may acquire information about an appearance or layout of an object represented on image information in order to extract an identification element for the type of object, and determine the type of object through the acquired information. In addition, the server may acquire image or text information displayed on the surface of the object represented on the image information to extract an identification factor for the brand of the object, and determine the brand of the object through the acquired image or text information. An operation of extracting an identification element corresponding to a design or description of an object may also be performed by referring to visual information expressed in image information.

The server may determine four identification elements to be used in order to specify the object (x) corresponding to the image information (x). For example, it may be determined to use a first identification element for the type of thing, a second identification element for the brand of the thing, a third identification element for the design of the thing, and a fourth identification element for the description of the thing.

When the server determines to specify an object through the above four identification elements, each identification element may be extracted according to a criterion corresponding to each identification element. For example, in order to extract the first identification element, the appearance and layout of the object appearing on the image information are used, and to extract the second identification element, a brand logo or company name displayed on the surface of the object appearing on the image information is used. available.

When each identification element is determined by applying each criterion, the server may specify an object by comparing the determined identification element with a pre-stored database. The pre-stored database may be referred to as an identification element DB. The identification element DB may include various information according to the type of each identification element. For example, when the type of thing that is the determined identification factor is 'Cola', the server selects 'Cola' from 'Cider', 'Beer', 'Water', and 'Cola' among various types of things included in the identification factor DB. ' can be selected. In addition, when the brand of the thing, which is the determined identification factor, is 'c company', the server selects 'c company' from 'c company', 'd company', and 'y company', which are brands of various things included in the identification factor DB. You can choose. The same selection method can be applied to the design and description of objects.

An operation of determining identity between the determined identification element and the identification element included in the identification element DB may be performed, and this may be the same as the operation of determining identity to be described later.

Referring to FIG. 5 , the server may obtain a specific thing through the process of FIG. 4 and determine a metaverse corresponding to the thing by referring to the acquired thing and a pre-stored metaverse list.

The metaverse list includes information about correspondence between things and the metaverse. For example, when thing a is determined, the server may confirm that a metaverse corresponding to thing a is a metaverse or that there is no metaverse corresponding to thing a through the metaverse list. When there is a request from a user terminal for creating or accessing a metaverse, the server may first specify a thing and check whether a metaverse corresponding to the specified thing exists through a metaverse list. Accordingly, the server may perform an operation related to access or creation when a metaverse corresponding to a specified thing exists, and may transmit a feedback message to a user terminal when it does not exist.

The metaverse list may include, for example, n pieces of metaverse information. More specifically, the metaverse list may include a total of n pieces of metaverse information including a betaverse, b metaverse, and the like. Each of the n pieces of metaverse information may also include information on what objects correspond to a specific metaverse. Accordingly, when the thing determined according to the process of FIG. 4 is x thing, the server may determine whether x metaverse exists as a metaverse corresponding to x thing in the metaverse list. If the server identifies an x metaverse that is a metaverse corresponding to x things, the server may perform an operation to check whether the x metaverse is generated.

Referring to FIG. 6 , a user terminal may display a feedback message corresponding to an operation of extracting an identification element and an operation of determining a metaverse by a server through a user interface.

A feedback message corresponding to the operation of extracting the identification element by the server may be output through the first interface 631 .

The server may transmit information on the extracted identification element to the user terminal so that the user terminal displays the extracted identification information on the display of the user terminal. The user of the user terminal determines whether the identification element extracted by the server is correct, and if correct, inputs 'confirm' on the display screen of the user terminal, and if not correct, inputs 'extract again'.

That is, although the user transmits image information about 'Coke of 200ml capacity released by company c' through the user terminal, the identification elements output on the first interface are 'company c', 'soy sauce', and '200ml'. In this case, since the server incorrectly recognizes the object, the user may input the information to the user terminal so that the server extracts the identification element again. Although not shown in the first interface, more preferably, 'check' the erroneously extracted identification element and re-extract the identification element only for the checked identification element, or the user directly inputs the correct identification element to the user terminal. can be entered.

A feedback message corresponding to the operation of determining the metaverse by the server may be output through the second interface 633 .

The server may transmit information on the determined metaverse to the user terminal so that the user terminal displays the determined metaverse on the display of the user terminal.

The second interface may be arbitrarily divided into a first area 633a and a second area 633b. At this time, a metaverse determined to correspond to the image information transmitted by the user terminal may be displayed in the first area, and a metaverse similar to the determined metaverse may be displayed in the second area.

A user of a user terminal may acquire permission to access within a limited range to a metaverse that satisfies a certain range of similarity, in addition to a metaverse corresponding to an object captured by the user. In this case, the user can access the similar metaverse by 'selecting' at least one similar metaverse in the second area and inputting 'confirm'. Accordingly, the user can freely access a metaverse or a metaverse similar to the metaverse corresponding to the object photographed by the user through his/her user terminal.

In step 701, the server receives a first access message including first image information of a first object photographed by a first user terminal.

The first image information may be photo or video information generated by photographing the appearance of the first object by a camera installed in the first user terminal. The first access message may be a message including a user of the first user terminal intending to access the metaverse corresponding to the first thing.

Including the first image information in the first access message means that the first image information is packaged and transmitted in the form of a first access message, or that the first access message and the first image information are transmitted together. can do. More specifically, the first user terminal is operatively connected to the server, and the connection between the server and the first user terminal may be made through an application installed in the first user terminal.

In this case, after the user generates first image information by photographing the first object through the application, a request for access to the metaverse corresponding to the first image information may be transmitted through the user interface of the application. , 'request' may be understood as an operation of transmitting a first access message including first image information.

In step 703, the server extracts a first identification element for identifying a first object from the first image information.

The server may analyze the first image information and extract at least one identification element to determine an object corresponding to the first image information. At this time, at least one identification element may be element information for specifying a thing. That is, a plurality of first identification elements may exist. Also, the operation of extracting the first identification element may apply the operation of extracting the identification element included in the process of FIG. 4 .

In step 705, the server analyzes the first identification element to determine whether a first metaverse corresponding to a first thing is generated from among pre-stored object-based metaverse lists.

More specifically, the server may determine a first metaverse corresponding to a first thing in the metaverse list by analyzing the first identification element. At this time, the determining operation included in the process of FIG. 5 may be applied to the operation of determining the first metaverse.

Then, the server may determine whether the determined first metaverse has already been created. If the server determines that the first metaverse has already been created, the server performs the operation of step 707, and if it determines that the first metaverse has not yet been created, the server performs the operation of step 723. can

In step 707, when the first metaverse is not generated, the server provides information on the first metaverse creation condition to the first user terminal.

The first metaverse creation condition may be one of metaverse creation conditions. The metaverse creation condition may be a condition determined for a thing as a necessary condition in order for the server to create a metaverse. For example, in order to generate a metaverse for a specific thing, it may be required that an access message including image information on a specific thing be acquired a predetermined number of times or more. In this case, the condition for generating the metaverse is 'to receive an access message n times or more'. The access message may include a case where it is received from a plurality of different user terminals or received multiple times from one user terminal with different accounts.

Regarding the metaverse generation condition, in addition to the number of times access messages are received, it may be required that funds of a predetermined amount or more be achieved, that access messages be received at a predetermined frequency or more, and the like.

When the first metaverse has not been generated, the server may determine that a condition for generating the first metaverse has not yet been achieved. Thereafter, the server may transmit information on the creation condition of the first metaverse to indirectly inform the first user terminal that access is impossible because the first metaverse has not yet been created. For example, 'n access messages are required to create the first metaverse', 'm access messages have been received so far', and the access message transmitted by the first user terminal corresponds to the lth access message' information can be provided.

In step 709, when the condition for generating the first metaverse meets a predetermined level, the server provides information that the first metaverse is scheduled to be created to the first user terminal.

When the condition for generating the metaverse is met, the server may transmit related information to the first user terminal even before generating the first metaverse. That is, it may be notified that all conditions for generating the first metaverse have been met and that the creation of the first metaverse is imminent.

Thereafter, the server may receive a subscription request for assets related to the first metaverse from the first user terminal. That is, assets available to a plurality of users in the first metaverse can be generally purchased or used after the metaverse is created, but for user terminals that have transmitted an access message before the metaverse is created, the server can be used before the metaverse is created. However, the 'right to pre-purchase' related assets can be assigned. The server may transmit an approval message or a rejection message for the 'subscription request' to the first user terminal.

In step 711, when the first metaverse is created, the server allocates assets subordinate to the first metaverse to the first user terminal.

When the first metaverse is created, the server may grant a user accessing the first metaverse the right to purchase or use assets subordinate to the first metaverse. If there is a 'subscription' for purchasing or using assets subordinate to the first metaverse before the first metaverse is created, the server allocates assets related to the 'subscription' to the user terminal that requested the 'subscription' can do. The server may transmit a confirmation message to the user terminal that has allocated the asset.

In step 713, the server receives a display message matched to the allocated asset from the first user terminal.

The first user terminal may mark an asset subordinate to the first metaverse as its own asset to indicate that it is its own asset. At this time, the 'display action' may be performed through the first metaverse. For example, you can post 'promotional text' about your name, company, product, etc. on your 'land' accessible through the first metaverse. The first user terminal may include information related to a display behavior of its own assets in a display message and transmit the server to the server. The display message may include information about 'what kind of information will be displayed', 'how long it will be displayed', 'how long it will be displayed', etc. in the asset allocated to the first user terminal. For example, if the user using the first user terminal is a business that sells a specific product, the first user may include 'a link to purchase a product at a low price' in the display message in the form of a 'signboard'. It can include information that allows it to be displayed in its own land on the first metaverse.

In step 715, the server receives a second access message including second image information of a second object captured by the second user terminal.

The second user terminal may be a different terminal from the first user terminal. When the second user terminal and the first user terminal are the same terminal, accounts for the user to access the server through the corresponding terminal may be different. The second object, second image information, and second access message are the same as or similar to the first object, second image information, and third access message of step 701, but may be generated at different times.

In step 717, the server extracts a second identification element for identifying a second object from the second image information.

The extraction operation of step 717 may be substantially the same as the operation of extracting the first identification element in step 703 .

In step 719, the server compares the first identification element and the second identification element, and if the first thing and the second thing satisfy the identity criterion, the server provides the second user terminal with an access address connected to the first metaverse. .

When the first identification element and the second identification element are plural, the server compares the respective identification elements to determine whether they are identical.

For example, when the first identification element is classified as 1a, 1b, and 1c and the second identification element is classified as 2a, 2b, and 2c, the server compares 1a and 2a, compares 1b and 2b, and 1c and 2c are compared to determine whether they are identical. More specifically, the server may determine that 1a-2a are identical, 1b-2b are not identical, and 1c-2c are identical. At this time, the server may determine a weight based on priority for each item, and determine whether the first identification element and the second identification element are identical by applying the determined weight. For example, when 1a-2a has a very high weight and 1b-2b and 1c-2c have low weights, and 1a-2a is the same, the other two items are not considered, and the first identification element and the second identification element are can be determined as the same.

In another example, when a plurality of items exist for an identification element and a predetermined number or more items are identical, the first identification element and the second identification element may be determined to be identical to each other.

Among the plurality of items for the identification element, when the first item is the brand of the thing, the second item is the type of the thing, and the third item is the design of the thing, the first item corresponding to the brand of the thing is set as an essential element, , the remaining second and third items can be set as selection elements. In this case, if the identity of the essential elements is satisfied, the identity of the optional elements may not be considered or may be considered with a low weight.

According to the identity criterion, when it is determined that the second identification element is the same as the first identification element, the server provides an access address for accessing the first metaverse to the second user terminal in the same way as the first user terminal. can do.

The second user terminal may access the first metaverse through the access address. In another example, the server may transmit a unique code for accessing the first metaverse to the second user terminal instead of the access address.

In step 721, when the second user terminal requests access to the first metaverse through the access address, the server provides related information of the first metaverse including a display message to the second user terminal.

When the second user terminal accesses the first metaverse through the received access address, the user using the second user terminal can view the display message on the first metaverse. More specifically, the user of the second user terminal can check promotional text of the first user displayed in the assets of the first metaverse.

In step 723, when the first metaverse has already been created, the server provides the first user terminal with an access address connected to the first metaverse.

At the time when the server receives the access message, if the first metaverse has already been created, the server may provide an access address to the first user terminal that has transmitted the access message. At this time, the access address provided may be the same as or similar to the access address provided in step 719 . The first user terminal may access the first metaverse through the received access address.

In step 801, the server receives a subsequent access message from the user terminal.

The subsequent access message is an access message received after receiving an access message from another user terminal, and may be a message including image information about a specific object.

In step 803, the server determines whether the image information included in the subsequent access message and the image information included in the previously received access message are identical.

The server may analyze the image information included in the access message and extract an identification element from the image information. Then, based on the extracted identification element, it is determined whether the access message received first and the subsequent access message are identical. Whether or not they are identical may be determined according to the aforementioned identity criterion. If the identity criterion is not satisfied, the server may perform the operation of step 801.

In step 805, if it is determined to be the same, the server adds the number of times of reception of the access message.

When the server determines that the subsequent access message and the previously received access message are the same, the server may add the number of receptions related to the generation condition of the access message.

For example, if the condition for creating a metaverse corresponding to the first access message and subsequent access messages is 'n access messages will be received', and the number of access messages received so far is m, the server The number of received access messages is m+1, and it can be determined that n-(m+1) access messages are required to satisfy the metaverse creation condition.

In step 807, the server determines whether the metaverse generation condition is achieved.

The server may determine whether the metaverse creation condition is met or not, and determine the number of access messages required to satisfy the creation condition.

In step 809, if the metaverse generation condition is satisfied, the server notifies the user terminal that metaverse generation is scheduled. The above operation may be the same as or similar to that of step 711 .

In step 811, the server creates a metaverse for subsequent access messages.

The metaverse for the subsequent access message may be the same as or similar to the metaverse corresponding to the previously received access message.

The user terminal may transmit image information about an object to the server. More specifically, by transmitting an access message including image information, the server may be requested to generate or access a metaverse corresponding to an object.

The server receives the image information and determines whether a metaverse corresponding to the image information has already been created. In addition, if the metaverse has already been created, an access address that can access the metaverse is assigned to the user terminal, and if it has not yet been created, condition information for generating the metaverse can be transmitted.

Thereafter, the server may determine whether the metaverse creation condition is satisfied, and if the metaverse creation condition is satisfied, information about the scheduled creation of the metaverse may be transmitted to the user terminal.

Afterwards, the server creates a corresponding metaverse and allocates assets subordinate to the created metaverse to user terminals. At this time, the asset allocation operation may be performed based on the 'subscription request' received from the user terminal before or after satisfying the metaverse creation condition.

Then, the user terminal may transmit a display message including display information about the allocated asset to the server.

In one example, land corresponding to an asset subordinate to the metaverse may be configured in a grid pattern. For convenience, the grid-type land of FIG. 10 may be defined according to horizontal and vertical positions. For example, the location of a land located 4 cells to the left and 7 cells above the reference point at the bottom left can be defined as (4, 7). At this time, the server displays a first mark 1011 on the land to indicate that the first area 1010 located at (4, 7) is the land of the first user according to the display information included in the display message. can

Similarly, the server may display a second mark 1021 on the land to indicate that the second area 1020 located at (6, 5) is the land of the second user, according to the display information included in the display message. there is.

In addition, the server determines that the third zone 1030 located at (7, 2), (7, 3), (8, 2), and (8, 3) is the third user according to the display information included in the display message. A third mark 1031 may be displayed on the land to indicate that it is land. More specifically, the third display may include a promotional phrase indicating that a product promoted or sold by a third user in the corresponding metaverse is currently on sale.

Referring to FIG. 11, the time interval before the metaverse is created can be divided into two intervals based on the time when the server confirms that the metaverse creation conditions have been met.

More specifically, the first interval may be defined as the time from when the server receives the first access message for a specific thing to the time when the server determines that the metaverse creation condition for the specific thing has been achieved.

In addition, the second interval may be determined from the point at which the server determines that the metaverse creation condition for a specific thing has been achieved to the point at which the server creates the corresponding metaverse.

In this case, the user terminal that transmitted the access message in the first interval may be a terminal that directly contributed to the achievement of the metaverse creation condition. In this case, the server may grant the first authority to the user terminal that has transmitted the access message in the first interval.

In addition, the second authority may be granted to the user terminal transmitting the access message in the second interval.

In one embodiment, the first authority may have a higher authority than the second authority within the corresponding metaverse. For example, a user of a user terminal to which a first authority is granted may preferentially purchase or use an asset within the corresponding metaverse. A user of a user terminal endowed with the second authority may purchase or use an asset within the metaverse, but may have to pay a higher amount or wait a longer time.

A user terminal that transmits an access message after the second interval may be granted a lower authority than the second authority. For example, a user of a user terminal without both the first authority and the second authority may access a corresponding metaverse to use or view a service for a certain limited time, and may not be able to purchase an asset.

When a plurality of things exist, the relationship between each object may be classified into an identical relationship, a similar relationship, and a dissimilar relationship. As a criterion for determining identity and similarity, the aforementioned identity criterion may be applied.

Referring to FIG. 12 , a relationship between a plurality of objects may be divided into an identical area 1230 and a similar area 1250, and an area not included in both areas may be referred to as a non-similar area 1270.

For example, the first object 1231 and the second object 1233 may be included in the same area 1230 . Also, the third object 1251 and the fourth object 1253 may be included in the similar area 1250 . Also, the fifth object 1271 may be included in the dissimilar region 1270 .

A criterion for determining whether the objects are the same, similar, or dissimilar may be objects included in the same area, that is, a first object and a second object.

For example, the first object may be identical in relation to the second object, similar in relation to the third and fourth objects, and dissimilar in relation to the fifth object. In addition, it is unknown whether the third object and the fourth object are the same or similar.

In this case, image information for each object may be acquired through a user terminal and transmitted to a server. The server may extract an identification element from image information and determine identity to determine whether or not a corresponding object is related to any metaverse.

When the server receives image information on the first object and the second object, the first object and the second object are different objects, but are the same object according to the identity criterion of FIG. The same metaverse can be determined for different user terminals that have transmitted image information.

That is, both the first user terminal and the second user terminal that have transmitted image information on the first object and the second object may access the same metaverse and have the same authority.

The server, even for the third user terminal that has transmitted the image information of the third object in a similar relationship but not within the range of identity, the metaverse corresponding to the first object (hereinafter referred to as 'first metaverse') within a limited range. You can grant permission to access. For example, a third user terminal that has transmitted image information of a third object accesses a metaverse (hereinafter referred to as 'third metaverse') corresponding to the third thing, and connects to the first metaverse and You can interact or move to the first metaverse. In addition, users of the first metaverse and users of the third metaverse may meet or communicate with each other within a limited space or limited time.

However, since the fifth user terminal corresponding to the fifth thing is a terminal for a thing that has a dissimilar relationship with the first user terminal, it cannot access the first metaverse or cannot access the third or fourth thing. It may be granted lower authority than the user terminal for the user terminal.

Referring to FIG. 13 , the server may allocate different rights according to whether the user terminal is a purchaser of the thing 1350 .

When the first user is a purchaser of the object 1350 and the second user is a person who has not purchased the object but only photographed the first object, the server may distinguish the first user from the second user.

The server may output an interface for confirming whether the user is a purchaser through an application dynamically connected to the user terminal.

For example, before a user photographs an object and transmits image information of the object to the server, the application may output a screen confirming whether the corresponding user is a purchaser. When the first user expresses that he is a buyer by applying an input to the corresponding screen, the first user terminal 1330a displays a first screen for confirming whether the first user participates as a buyer in the metaverse corresponding to the thing ( 1331a) can be output. When the first user inputs 'confirm', the first user terminal may output the second screen 1333a to obtain an authentication code or the like for confirming that the user is a purchaser. The first user can prove that he or she is a purchaser by entering an authentication code or the like, and the server checks the purchaser authentication code included in the access message received from the first user terminal, and in response thereto, sends the second user terminal to the first user terminal. Authorizations different from those of the user terminal may be granted.

Similarly, when the second user expresses that he or she is a visitor by applying an input to the corresponding screen, the second user terminal 1330b displays a third screen that confirms whether the second user participates in the metaverse corresponding to the object as a visitor. A screen 1331b can be output. When the second user inputs 'Confirm', the second user terminal may transmit an access message to the server without an authentication code for the purchaser. The server may confirm that there is no authentication code of the purchaser in the access message, and may grant the second user terminal a different authority than the first user terminal.

The technical features disclosed in each embodiment of the present invention are not limited to the corresponding embodiment, and unless incompatible with each other, the technical features disclosed in each embodiment may be merged and applied to other embodiments.

Therefore, in each embodiment, each technical feature is mainly described, but each technical feature may be merged and applied to each other unless incompatible with each other.

The present invention is not limited to the above-described embodiments and accompanying drawings, and various modifications and variations will be possible from the viewpoint of those skilled in the art to which the present invention belongs. Therefore, the scope of the present invention should be defined by not only the claims of this specification but also those equivalent to these claims.

Claims

In the method for a server to provide a thing-based metaverse service,

Receiving a first access message including first image information of a first object photographed by a first user terminal;

extracting a first identification element for identifying the first object from the first image information;

determining whether a first metaverse corresponding to the first thing is generated from a pre-stored object-based metaverse list by analyzing the first identification element;

If the first metaverse is already created, providing the first user terminal with an access address connected to the first metaverse;

If the first metaverse is not generated, providing information about the creation condition of the first metaverse to the first user terminal - the degree of achievement of the creation condition is changed according to the reception of the first access message -;

providing information that the first metaverse is scheduled to be created to the first user terminal when the condition for generating the first metaverse meets a predetermined level;

If the first metaverse is created, allocating assets subordinate to the first metaverse to the first user terminal;

receiving a display message matched to the assigned asset from the first user terminal;

Receiving a second access message including second image information of a second object photographed by a second user terminal;

extracting a second identification element for identifying the second object from the second image information;

comparing the first identification element with the second identification element, and providing an access address connected to the first metaverse to the second user terminal when the first object and the second object satisfy an identity criterion; and

When the second user terminal requests access to the first metaverse through the access address, providing the second user terminal with related information of the first metaverse including a display message

A method of providing object-based metaverse services.
According to claim 1,

The production conditions are,

Receiving a metaverse generation request corresponding to image information about an object from a plurality of user terminals a predetermined number of times or more,

The object of the image information is an object that satisfies the identity criterion with respect to the first object.

A method of providing object-based metaverse services.
According to claim 1,

The step of allocating assets subordinate to the first metaverse,

Prior to generating the first metaverse, giving the first user terminal priority for purchasing the asset;

receiving subscription information corresponding to the priority from the first user terminal;

determining a first asset to be allocated to the first user terminal based on the subscription request; and

Further comprising allocating the first asset to the first user terminal,

A method of providing object-based metaverse services.
According to claim 3,

The time interval before generating the first metaverse,

A first interval corresponding to a time interval from when the creation condition is achieved to before generating the first metaverse, and

A second interval corresponding to a time interval from when the first access message is received until the generation condition is achieved,

The priority for the allocation of the asset of the first user terminal is,

When the time of receiving the subscription information corresponding to the priority is the second interval, the time of receiving the subscription information corresponding to the priority is set higher than that of the first interval,

A method of providing object-based metaverse services.
According to claim 3,

The priority for the allocation of the asset of the first user terminal is,

The first user terminal is authorized to purchase or use the asset at a predetermined initial amount,

The subscription information is

Including payment information for the initial amount,

A method of providing object-based metaverse services.
According to claim 1,

The first identification element or the second identification element is identification information related to at least one of the brand, type, and design of the first or second object,

if the first identification element and the second identification element include a plurality of identification elements, determining whether the identity criterion is satisfied for each identification element; and

Further comprising determining that the first object and the second object are the same based on an identical identification element satisfying the identity criterion among the plurality of identification elements;

The brand is determined by at least one of letters, numbers, symbols, and logos extracted from the first image information or the second image information,

The type is determined by matching with a pre-stored database based on an appearance or layout of the first object or the second object extracted from the first image information or the second image information,

The design is determined by at least one of the color, texture, size, and shape of the first object or the second object extracted from the first image information or the second image information,

A method of providing object-based metaverse services.
According to claim 6,

The step of determining that the first object and the second object are the same based on the same identification element that satisfies the identity criterion,

determining that the first object and the second object are identical when the number of identical identification elements is greater than or equal to a predetermined number; or

When an identification element related to the brand is determined as an essential element and an identification element related to the type or design is determined as an optional element, and the essential element satisfies the identity condition, the first object and the second object are determined. Including the step of determining that is the same,

A method of providing object-based metaverse services.
According to claim 1,

The production conditions are,

Funds obtained from a plurality of user terminals and corresponding to objects reach a predetermined amount,

The object corresponding to the fund is an object that satisfies the identity criterion with respect to the first thing,

A method of providing object-based metaverse services.
According to claim 1,

The generated first metaverse,

A virtual space including a virtual structure generated based on first image information corresponding to the first object;

The virtual structure is configured so that the user of the first user terminal or the second user terminal accesses the first metaverse and interacts in the virtual space.

A method of providing object-based metaverse services.
According to claim 1,

determining whether the determined first metaverse allocates different rights according to whether a user of the first user terminal is an owner of the first thing;

transmitting purchase information request information indicating that the user of the first user terminal is the owner of the first thing to the first user terminal when it is determined that different rights are allocated; and

When receiving purchase authentication information corresponding to the purchase information request information from the first user terminal, providing first authorization information for a first authority to the first user terminal Further comprising,

A method of providing object-based metaverse services.
According to claim 1,

Further comprising providing second permission grant information for a second permission related to a second metaverse corresponding to a thing similar to the first thing to the first user terminal,

The second authority,

Permission to allow the first user terminal to access the first metaverse corresponding to the first thing and perform interactions related to the second metaverse;

The similar thing has a probability index equal to or greater than a predetermined threshold for identity with the first thing based on first information related to the brand of the thing, second information related to the type of the thing, and third information related to the design of the thing. a thing that satisfies,

A method of providing object-based metaverse services.
In a server that provides a thing-based metaverse service,

communications department;

storage unit; and

It includes at least one processor operatively connected to at least one of the communication unit and the storage unit;

The at least one processor,

Receiving a first access message including first image information of a first object photographed by a first user terminal;

extracting a first identification element for identifying the first object from the first image information;

determining whether a first metaverse corresponding to the first thing is generated from a pre-stored object-based metaverse list by analyzing the first identification element;

If the first metaverse is already created, providing the first user terminal with an access address connected to the first metaverse;

If the first metaverse is not generated, providing information about the creation condition of the first metaverse to the first user terminal - the degree of achievement of the creation condition is changed according to the reception of the first access message -;

providing information that the first metaverse is scheduled to be created to the first user terminal when the condition for generating the first metaverse meets a predetermined level;

If the first metaverse is created, allocating assets subordinate to the first metaverse to the first user terminal;

receiving a display message matched to the assigned asset from the first user terminal;

Receiving a second access message including second image information of a second object photographed by a second user terminal;

extracting a second identification element for identifying the second object from the second image information;

comparing the first identification element with the second identification element, and providing an access address connected to the first metaverse to the second user terminal when the first object and the second object satisfy an identity criterion; and

When the second user terminal requests access to the first metaverse through the access address, configured to perform a step of providing related information of the first metaverse including a display message to the second user terminal felled,

A server that provides object-based metaverse services.