KR20230157862A - Method for providing augmented reality service with non-fungible token content - Google Patents

Abstract

According to some embodiments of the present disclosure, a method for providing an augmented reality service using non-fungible token (NFT) content performed by a computing device including at least one processor is disclosed. The method for providing the augmented reality service includes acquiring at least one first NFT including a modeling file generated based on the appearance of a specific user; Containing at least one object related to at least one first modeling file included in the at least one first NFT and at least one content related to at least one second NFT that is confirmed to be owned by a user of the computing device Constructing a library; displaying the configured library in a first area; In response to a user input in the first area selecting a first object from among at least one object included in the library, displaying the first object in a second area; And in response to a user input in the first area that selects first content among at least one content included in the library, displaying the first content so that the first content is overlaid on the first object. It can be included.

Description

Method for providing augmented reality service using non-fungible token content {METHOD FOR PROVIDING AUGMENTED REALITY SERVICE WITH NON-FUNGIBLE TOKEN CONTENT}

This disclosure relates to a method for providing an augmented reality service, and specifically relates to a method for providing an augmented reality service using non-fungible token content.

Non-Fungible Token (NFT) is a type of token issued on a blockchain network and has a limited issuance amount, so unlike general cryptocurrency tokens, it is non-fungible. As described above, NFTs are non-substitutable and rare. Against this background, NFT is being used as a means of guaranteeing irreplaceable ownership of digital art, in-game goods, music files, etc.

Marketplaces for trading NFTs are emerging. However, the absence of a service that can utilize NFT content is a factor that reduces the motivation to own NFT.

In addition, because the ownership of NFTs is stored in the on-chain area of the blockchain, and the content files are stored in storage outside the blockchain, it is a cumbersome task to individually verify the actual ownership of the content for the user or the user's acquaintances.

Therefore, in order for NFT transactions to become more active, service provision technology that can easily utilize NFT content while meeting the needs of using NFT content is required.

Republic of Korea Open Patent 10-2022-0011385

This disclosure was developed in response to the above-described background technology, and seeks to provide a method for providing an augmented reality service that can utilize NFT content.

The technical problems of the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below.

According to an embodiment of the present disclosure to solve the problems described above, an augmented reality service using non-fungible token (NFT) content performed by a computing device including at least one processor is provided. A method for doing so is disclosed. The method for providing the augmented reality service includes acquiring at least one first NFT including a modeling file generated based on the appearance of a specific user; Containing at least one object related to at least one first modeling file included in the at least one first NFT and at least one content related to at least one second NFT that is confirmed to be owned by a user of the computing device Constructing a library; displaying the configured library in a first area; In response to a user input in the first area selecting a first object from among at least one object included in the library, displaying the first object in a second area; and displaying the first content so that the first content is overlaid on the first object in response to a user input in the first area for selecting first content among at least one content included in the library. may include.

In addition, the step of acquiring at least one first NFT including a modeling file generated based on the appearance of the specific user is, in response to an input from the user of the computing device, a blockchain mainnet or Accessing at least one of the first marketplaces that provide transaction history information of the blockchain mainnet; Searching for the at least one first NFT in at least one of the blockchain mainnet or the first marketplace; And transferring ownership of the retrieved at least one first NFT to a virtual wallet associated with the user, thereby acquiring the at least one first NFT; may include.

In addition, the step of acquiring at least one first NFT including a modeling file generated based on the appearance of the specific user, in response to an input from the user of the computing device, is generated based on the appearance of the specific user. accessing a second marketplace providing modeling files; Obtaining the at least one first modeling file from the second marketplace; issuing the at least one first NFT including the at least one first modeling file using a blockchain mainnet; And acquiring the at least one first NFT issued; may include.

In addition, the step of acquiring at least one first NFT including a modeling file generated based on the appearance of the specific user, in response to an input from the user of the computing device, is generated based on the appearance of the specific user. Accessing a third marketplace that provides image files; generating the at least one first modeling file using at least one first image file obtained from the third marketplace; issuing the at least one first NFT including the at least one first modeling file using a blockchain mainnet; And acquiring the at least one first NFT issued; may include.

In addition, at least one object related to at least one first modeling file included in the at least one first NFT and at least one content related to at least one second NFT confirmed to be owned by a user of the computing device The step of configuring a library comprising: accessing a metadata storage location of the at least one first NFT to obtain the at least one first modeling file associated with the at least one first NFT - the at least one The first metadata of the first NFT includes the name of the at least one first modeling file associated with the at least one first NFT, a modeling file description indicating the type of the at least one first modeling file, and the at least one first modeling file. 1 Contains at least one of the storage locations for modeling files -; generating at least one object using the at least one first modeling file; and configuring the library to include the at least one object. may include.

In addition, the step of accessing the metadata storage location of the at least one first NFT to obtain the at least one first modeling file related to the at least one first NFT, the first of the at least one first NFT Obtaining at least one first modeling file corresponding to the at least one first NFT based on at least one of metadata or a URL stored in the first metadata of the at least one first NFT; may include.

In addition, at least one object related to at least one first modeling file included in the at least one first NFT and at least one content related to at least one second NFT confirmed to be owned by a user of the computing device The step of configuring a library including: accessing at least one of a blockchain mainnet or a first marketplace that provides transaction history information of the blockchain mainnet and determining the at least one second NFT; Accessing the metadata storage location of the at least one second NFT to obtain at least one content related to the at least one second NFT - the second metadata of the at least one second NFT is the at least one Containing at least one of the name of at least one content related to the second NFT, a content description indicating the type of at least one content, and a storage location of at least one content data; and configuring the library to include the at least one content. may include.

In addition, the step of accessing the metadata storage location of the at least one second NFT to obtain at least one content related to the at least one second NFT includes the second metadata of the at least one second NFT or the Obtaining at least one content corresponding to the at least one second NFT based on at least one of the URLs stored in the second metadata of the at least one second NFT; may include.

In addition, in response to a user input in the first area for selecting a first object among at least one object included in the library, displaying the first object in the second area may include photographing the user, creating a second object related to the user; displaying the created second object in the second area; and displaying the first object so that the first object is overlaid on the second object in response to a user input for selecting the first object in the first area. may include.

Additionally, the first object may be displayed overlaid on the second object in such a way that the angle or size is determined by tracking the position of the second object displayed in the second area.

Additionally, in response to a user input in the first area for selecting first content among at least one content included in the library, displaying the first content so that the first content is overlaid on the first object. Determining the type of the first content based on second metadata of the at least one second NFT related to the first content corresponding to the user input; Based on the type of the first content, determining a third area in the first object where the first content is overlaid; and overlaying and displaying the first content on the determined third area. may include.

In addition, based on the type of the first content, the step of determining a third area in the first object where the first content is overlaid is based on a database in which body parts corresponding to the type of content are mapped, determining a first body part corresponding to the type of first content; determining a second body part corresponding to the first body part in the first object; and determining an area including the second body part as the third area. may include.

Additionally, the step of overlaying and displaying the first content on the determined third area includes determining an area of the second body part included in the third area; determining a size of the first content based on an area of the second body part; and overlaying and displaying the first content on the third area based on the determined size of the first content. may include.

Additionally, in response to a user input in the first area for selecting first content among at least one content included in the library, displaying the first content so that the first content is overlaid on the first object. is, generating a third object based on the first content - the third object is created as a three-dimensional image -; and displaying the created third object by overlaying it on the first object. may include.

Additionally, the third object may be displayed overlaid on the first object in such a way that its angle or size is determined by tracking the position of the first object displayed in the second area.

Additionally, a computing device for providing an augmented reality service, acquiring at least one first NFT including a modeling file created based on the appearance of a specific user, and at least one NFT included in the at least one first NFT A control unit configured to configure a library including at least one content related to at least one object related to the first modeling file and at least one second NFT that is confirmed to be owned by the user of the computing device; and displaying the library configured under the control of the control unit in a first area, and selecting the first object among at least one object included in the library in response to a user input in the first area. displaying in a second area, and in response to a user input in the first area selecting first content among at least one content included in the library, such that the first content is overlaid on the first object 1 A display unit that displays content; may include.

The technical solutions obtainable from this disclosure are not limited to the solutions mentioned above, and other solutions not mentioned above will be clearly apparent to those skilled in the art from the description below. It will be understandable.

According to some embodiments of the present disclosure, it is possible to provide a method for providing an augmented reality service in which content that can confirm ownership of a user is displayed.

The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. .

Various aspects will now be described with reference to the drawings, where like reference numerals are used to collectively refer to like elements. In the following examples, for purposes of explanation, numerous specific details are set forth to provide a comprehensive understanding of one or more aspects. However, it will be clear that such aspect(s) may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form to facilitate describing one or more aspects.
1 illustrates an example system for performing a method for providing augmented reality services according to some embodiments of the present disclosure.
FIG. 2 is a flowchart illustrating an example of a method by which a computing device displays content according to some embodiments of the present disclosure.
FIG. 3 is a flowchart illustrating an example of a method for a computing device to acquire at least one first NFT according to some embodiments of the present disclosure.
FIG. 4 is a flowchart illustrating another example of a method for a computing device to acquire at least one first NFT according to some embodiments of the present disclosure.
FIG. 5 is a flowchart illustrating an example of a method by which a computing device configures a library according to some embodiments of the present disclosure.
FIG. 6 is a flowchart illustrating an example of a method by which a computing device displays a first object according to some embodiments of the present disclosure.
FIG. 7 is a flowchart illustrating an example of a method by which a computing device displays first content according to some embodiments of the present disclosure.
FIG. 8 is a diagram illustrating an example of a user interface displayed on a display unit according to some embodiments of the present disclosure.

Since the present invention can make various changes and have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all changes, equivalents, and substitutes included in the spirit and technical scope of the present invention. While describing each drawing, similar reference numerals are used for similar components.

Terms such as first, second, A, B, etc. may be used to describe various components, but the components should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be named a second component, and similarly, the second component may also be named a first component without departing from the scope of the present invention. The term and/or includes any of a plurality of related stated items or a combination of a plurality of related stated items.

When a component is said to be "connected" or "connected" to another component, it is understood that it may be directly connected to or connected to the other component, but that other components may exist in between. It should be. On the other hand, when it is mentioned that a component is “directly connected” or “directly connected” to another component, it should be understood that there are no other components in between.

The terms used in this application are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the present application, should not be interpreted in an ideal or excessively formal sense. No.

In the present disclosure, a computing device can obtain a modeling file generated based on the appearance of a specific user. Specifically, the computing device may acquire a first NFT (Non-Fungible Token) including at least one modeling file. Here, NFT may be a virtual token issued on a blockchain network. NFT can be used to indicate uniqueness, originality, or ownership by containing an address pointing to a digital file in a token. The computing device can obtain the modeling file through an address pointing to the digital file. The computing device may display objects related to the acquired modeling file on the display unit. Additionally, the computing device may determine content associated with the second NFT that is confirmed to be owned by the user. The computing device may display content so that the content is overlaid on the object being displayed through the display unit. Here, overlaying can be understood to mean that content is displayed overlapping the screen on which the object is displayed. Users can use augmented reality services by overlaying and displaying content on objects created using modeling files. Hereinafter, a method for a computing device to provide an augmented reality service will be described through FIGS. 1 to 8.

1 illustrates an example system for performing a method for providing augmented reality services according to some embodiments of the present disclosure.

Referring to FIG. 1 , the computing device 100 may include a control unit 110, a storage unit 120, a communication unit 130, a display unit 140, and a photographing unit 150. However, the above-described components are not essential for implementing the computing device 100, so the computing device 100 may have more or less components than the components listed above.

Computing device 100 may include typical computer hardware (e.g., a computer processor, memory, storage, input and output devices, and other components of a traditional computing device; electronic communication devices such as routers, switches, etc.; network A combination of electronic information storage systems (such as network-attached storage (NAS) and storage area network (SAN)) and computer software (i.e., instructions that cause a computing device to function in a certain way) The desired system performance can be achieved by using . For example, the computing device 100 is a personal computer (PC), notebook (note book), mobile terminal, smart phone, tablet PC, etc. owned by the user. It can include all types of terminals that can connect to wired/wireless networks. Alternatively, computing device 100 may include any type of computer system or computer device, such as a microprocessor, digital processor, device controller, and user terminal.

The control unit 110 can typically process the overall operation of the computing device 100. The control unit 110 processes signals, data, information, etc. input or output through the components of the computing device 100 or runs an application program stored in the storage unit 120 to provide appropriate information or functions to the user. It can be handled.

The control unit 110 may be composed of one or more cores, such as a central processing unit (CPU), general purpose graphics processing unit (GPGPU), and tensor processing unit (TPU). It may include a processor for data analysis.

In the present disclosure, the control unit 110 may acquire at least one first NFT including a modeling file generated based on the appearance of a specific user. Here, NFT may be a virtual token issued on a blockchain network. NFT can be used to indicate uniqueness, originality, or ownership by containing an address pointing to a digital file in a token. The control unit 110 operates a blockchain mainnet 300 or a marketplace 400 that provides transaction history information of the blockchain mainnet 300 in response to input from the user of the computing device 100. You can obtain at least one first NFT by accessing at least one of them. When at least one first NFT is acquired, the control unit 110 may create a first object using at least one first modeling file included in the at least one first NFT. The modeling file may be a file that expresses the appearance of a specific user in 3D. A specific user may be, for example, a celebrity, actor, singer, or influencer. A modeling file may be a file that anthropomorphizes the appearance of a specific animal and expresses it in 3D. For example, a modeling file may be a file that anthropomorphizes and models animals such as cats, dogs, elephants, or lions. For convenience of explanation, modeling files and content are described in different terms, but modeling files can also be understood as content included in NFT. The first object created using at least one first modeling file may express the external appearance of a specific user. The control unit 110 may provide an augmented reality service by displaying the first object on the screen displayed through the display unit 140.

In the present disclosure, the control unit 110 may display a library including objects related to NFT in the first area of the screen displayed through the display unit 140. The library may be an interface that provides appropriate functions/information to the user by modularizing information such as NFT-related modeling files, modeling preview files, descriptions related to modeling files, or names of modeling files. In order to display the library, the control unit 110 may configure a library that includes a first object related to at least one first NFT that is confirmed to be owned by the user. By having the control unit 110 build a library of modeling files whose ownership has been confirmed by NFT in advance, the process for service users to apply NFT content to the augmented reality service can be made simple and easy. In addition, when the user uses NFT content for an augmented reality service by performing the library building procedure in advance by the control unit 110, other people can verify that the ownership of the user's augmented reality content has been verified by NFT without a separate verification process. Trustworthy. Hereinafter, an example of a method in which the control unit 110 according to the present disclosure provides an augmented reality service related to at least one first NFT will be described with reference to FIG. 2.

Storage unit 120 may include memory and/or persistent storage media. Memory is a flash memory type, hard disk type, multimedia card micro type, card type memory (e.g. SD or XD memory, etc.), and RAM (Random Access). Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk, optical disk It may include at least one type of storage medium.

The communication unit 130 is located between the computing device 100 and the communication system, between the computing device 100 and the server 200, between the computing device 100 and the blockchain mainnet 300, and between the computing device 100 and the marketplace. It may include one or more modules that enable communication between 400 or between computing device 100 and network 500.

The display unit 140 may display (output) information (or at least one content) processed by the computing device 100. For example, the display unit 140 may display execution screen information of an application program running on the computing device 100, or UI (User Interface) and GUI (Graphic User Interface) information according to this actual screen information. . In the present disclosure, the display unit 140 may display an augmented reality image generated through the control unit 110.

The photographing unit 150 may include one or more cameras. Image frames processed by the photographing unit 150 may be stored in the storage unit 120 or displayed on the display unit 140.

Server 200 may include any type of computer system or computer device, such as, for example, a microprocessor, mainframe computer, digital processor, portable device, or device controller.

Server 200 may include typical computer hardware (e.g., a device that may include a computer processor, memory, storage, input and output devices, and other components of a traditional computing device; electronic communications devices such as routers, switches, etc.; network attachments) A combination of electronic information storage systems (such as network-attached storage (NAS) and storage area network (SAN)) and computer software (i.e., instructions that cause a computing device to function in a particular way). This can be used to achieve desired system performance.

In the present disclosure, the server 200 may configure a library containing modeling files related to NFT. The server 200 may deliver the configured library based on a signal received from the computing device 100.

The blockchain mainnet 300 may be a network that launches and operates a blockchain project. The blockchain mainnet 300 is composed of an unspecified number of nodes and can record transactions and verify them by the blockchain protocol. The blockchain mainnet 300 can issue tokens according to a predetermined protocol and record and verify transactions regarding token ownership. In Figure 1, a single blockchain mainnet 300 is shown for convenience, but the embodiment is not limited thereto. The computing device 100 can communicate with a plurality of different types of blockchain mainnets 300. Each blockchain mainnet 300 can be operated by a blockchain protocol that supports NFT. Blockchain protocols that support NFT include Ethereum, WAX, FLOW, and Binance Smart Chain, but embodiments are not limited thereto.

NFTs can be issued according to protocols such as Ethereum, WAX, and FLOW Binance Smart Chain mentioned above. The amount of NFT issued may be limited. For example, the issuance quantity of NFT may be 1. However, the embodiment is not limited thereto. The issuance quantity of NFT may be a number greater than 1. The issuance volume of NFTs may be significantly smaller than that of fungible tokens.

The marketplace 400 may be a platform that relays transactions of NFTs, content, or data. Computing device 100 may communicate with multiple marketplaces. As an example, the marketplace 400 in the present disclosure may include a first marketplace relaying NFT transactions, a second marketplace relaying modeling file transactions, or a third marketplace relaying image file transactions. there is.

The first marketplace provides an NFT transaction relay function and can store NFT transaction transactions that have been verified by blockchain. Examples of the first marketplace include OpenSea, Rarible, Nifty Gateway, and SuperRare, but the embodiment is not limited thereto. The computing device 100 may access the first marketplace under control from the user to acquire at least one NFT including a modeling file.

The second marketplace may provide a relay function for modeling files. The computing device 100 may acquire a modeling file by accessing the second marketplace under control from the user.

A third marketplace may provide a relay function for image files. The computing device 100 may acquire an image file by accessing a third marketplace under control from the user.

Depending on the embodiment, the NFT transaction relay function, modeling file relay function, and image file relay function may be performed through one marketplace.

The network 500 may be a closed network such as a Local Area Network (LAN) or a Wide Area Network (WAN), or an open network such as the Internet. The Internet uses the TCP/IP protocol and several services existing at its upper layer, namely HTTP (HyperText Transfer Protocol), Telnet, FTP (File Transfer Protocol), DNS (Domain Name System), SMTP (Simple Mail Transfer Protocol), and SNMP ( It refers to a worldwide open computer network structure that provides Simple Network Management Protocol (NFS), Network File Service (NFS), and Network Information Service (NIS). Hereinafter, a method by which the computing device 100 provides an augmented reality service will be described.

FIG. 2 is a flowchart illustrating an example of a method by which a computing device displays content according to some embodiments of the present disclosure.

Referring to FIG. 2, the control unit 110 of the computing device 100 may acquire at least one first NFT including a modeling file generated based on the appearance of a specific user (S110). Here, acquiring at least one first NFT can also be understood as transferring ownership of at least one first NFT to a virtual wallet associated with the user. A virtual wallet can be understood as a wallet that stores virtual assets such as NFTs.

Specifically, the control unit 110 may connect to at least one of the blockchain mainnet 300 or the first marketplace that provides transaction history information of the blockchain mainnet 300 in response to input from the user. The control unit 110 acquires at least one first NFT by transferring ownership of the at least one first NFT to a virtual wallet associated with the user through at least one of the connected blockchain mainnet 300 or the first marketplace. can do. Hereinafter, an example of a method by which the control unit 110 acquires at least one first NFT from the blockchain mainnet or the first marketplace will be described with reference to FIG. 3.

According to some embodiments of the present disclosure, an NFT containing a modeling file desired by the user may not exist. In this case, the control unit 110 may access a second marketplace that provides modeling files created based on the appearance of a specific user under the control of the user. The control unit 110 may obtain at least one first modeling file from the second marketplace. The control unit 110 may obtain at least one first NFT by issuing at least one first NFT including at least one first modeling file through the blockchain mainnet 300. According to one embodiment, the control unit 110 may display a library including objects related to NFT in the first area. A plurality of objects displayed in the library may be composed of objects using NFT that are confirmed to be owned by the user. Accordingly, when at least one first modeling file is acquired, the control unit 110 may issue at least one first NFT including at least one first modeling file. Accordingly, a library can be constructed using NFTs whose ownership has been confirmed by the user in the control unit 110. Hereinafter, an example of a method by which the control unit 110 issues an NFT using a modeling file will be described with reference to FIG. 4.

According to one embodiment, the computing device 100 may previously store the first modeling file created by the user. In this case, the control unit 110 can obtain at least one first NFT by issuing at least one first NFT including at least one first modeling file through the blockchain mainnet 300.

According to one embodiment, the control unit 110 may configure the library to include NFT content for which the user's ownership has not been confirmed. In other words, the control unit 110 may configure the library to include NFT content owned by users other than the user of the computing device 100. In this case, the control unit 110 may form a library by assigning an identification tag to identify the NFT content owned by another user to the content. Accordingly, the user can distinguish between content he or she owns and content he or she does not own.

The control unit 110 controls at least one object related to at least one first modeling file included in at least one first NFT and at least one object related to at least one second NFT that is confirmed to be owned by the user of the computing device 100. You can configure a library containing one content (S120). Here, being confirmed as owned by the user can be understood to mean that the final ownership of at least one second NFT exists in the virtual wallet owned by the user.

Specifically, the control unit 110 may access at least one of the blockchain mainnet 300 or the first marketplace that provides transaction history information of the blockchain mainnet 300 based on input from the user. The control unit 110 may perform a search for transactions that have been verified in the blockchain mainnet 300. As another example, the control unit 110 may access the block explorer and perform a search for transactions that have been verified on the blockchain mainnet 300. As another example, the control unit 110 may connect to the first marketplace that relays NFT transactions and records transaction history to perform a search for transactions that have been verified on the blockchain mainnet 300. The control unit 110 may determine at least one first NFT and at least one second NFT in which the virtual wallet address associated with the user is recorded as the final owner.

When at least one first NFT and at least one second NFT are determined, the control unit 110 may obtain information related to the at least one first NFT and at least one second NFT. Information related to at least one first NFT and at least one second NFT may include an NFT token ID or metadata storage address. Here, metadata may be data that provides information related to modeling files, data, or content related to at least one first NFT and at least one second NFT.

For example, the first metadata associated with the at least one first NFT may include the name of the at least one first modeling file associated with the at least one first NFT, a modeling file description indicating the type of the at least one first modeling file, and It may include at least one of the storage locations of at least one first modeling file. The modeling file description may indicate the type of at least one first modeling file. For example, the modeling file description may be information indicating the type of modeling file included in at least one first NFT, such as a modeling file expressing the appearance of a user or a modeling file created by anthropomorphizing an animal. The storage location of the modeling file may be information indicating the location where at least one first modeling file is stored. The first metadata and first modeling file, etc. may be stored in the off-chain area. For example, the first metadata and the first modeling file may be stored in IPFS (InterPlanetary File System), cloud storage, etc., but the embodiment is not limited thereto. Depending on the embodiment, the first metadata may directly include a first modeling file, a first modeling preview file, or the like.

The second metadata associated with the at least one second NFT may include the name of at least one content associated with the at least one second NFT, a content description indicating the type of the at least one content, or a storage location of the at least one content data. You can. The content description may indicate at least one type of content. For example, the content description may be information indicating the type of content included in at least one second NFT, such as whether it is clothes, glasses, a ring, or an accessory. The storage location of content data may be information indicating the location where the content is stored. Depending on the embodiment, the second metadata may directly include a content file, a preview content file, etc. Secondary metadata and content files, etc. may be stored in the off-chain area. For example, the second metadata and content files may be stored in IPFS, cloud storage, etc., but the embodiment is not limited thereto. Depending on the embodiment, the second metadata may directly include a content file, a content preview file, etc.

The control unit 110 may access the first metadata storage location of the at least one first NFT to obtain at least one first modeling file related to the at least one first NFT. The control unit 110 may access the second metadata storage location of the at least one second NFT to obtain at least one content related to the at least one second NFT. As an example, the control unit 110 may generate a first NFT corresponding to at least one first NFT based on at least one of the first metadata of the at least one first NFT or the URL stored in the first metadata of the at least one first NFT. 1 You can obtain a modeling file. As another example, the control unit 110 corresponds to at least one second NFT based on at least one of the second metadata of the at least one second NFT or the URL stored in the second metadata of the at least one second NFT. Content can be obtained.

When at least one first modeling file is acquired, the control unit 110 may create at least one object related to the at least one first modeling file. When at least one content is acquired, the control unit 110 may create a third object using the at least one content. The control unit 110 may configure the library to include the first object and the third object. Hereinafter, an example of how the control unit 110 configures the library will be described with reference to FIG. 5.

When a library is configured, the display unit 140 may display the configured library in the first area under the control of the control unit 110 (S130). The first area may be an area of the screen displayed through the display unit 140.

The library includes modularized information such as at least one first modeling file related to at least one first NFT, a modeling preview file, a description related to at least one first modeling file, or the name of the modeling file to provide functions/information appropriate for the user. It may be an interface that provides. The library may be an interface that provides appropriate functions/information to the user by modularizing information such as a content file, content preview file, content-related description, or content name of content related to at least one second NFT. Contents related to at least one object and at least one second NFT related to at least one first modeling file may be displayed in the library. For convenience of explanation, FIG. 8 may be referred to.

Referring to (a) of FIG. 8, the control unit 110 can configure a library item including at least one object and at least one content. Here, a library item can be understood as a sub-concept of a library. Alternatively, a library item may be a unit with lower granularity than the library. The control unit 110 may configure a first library item 1441 including at least one object and first content 145 among at least one content. The control unit 110 may configure a second library item 1442 that includes at least one content or at least one object different from the first content 145. The control unit 110 may configure the library 144 including a first library item 1441 and a second library item 1442. The control unit 110 may display the configured library 144 on the first area 141 of the display unit 140. Hereinafter, an embodiment of the library 144 will be described again with reference to FIG. 8.

Referring again to FIG. 2, the control unit 110 may display the first object in the second area in response to a user input in the first area for selecting the first object among at least one object included in the library. (S140). Here, the second area may be the entire screen displayed through the display unit 140. Alternatively, the second area may be at least a portion of the entire area of the display unit 140.

The user input in the first area may be an input for selecting the first object included in the library item displayed in the first area. Alternatively, the user input in the first area may be an input for selecting a library item displayed in the first area. The control unit 110 may display the first object in the second area based on a user input for selecting the first object.

According to some embodiments of the present disclosure, the control unit 110 may be displaying the second object prior to displaying the first object. The second object may be an object created by photographing a user. In this case, the control unit 110 may display the first object so that the first object is overlaid on the second object in response to a user input for selecting the first object in the first area. Here, overlaying can be understood to mean that the first object is displayed overlapping the screen where the second object is displayed.

According to one embodiment, the first object may be displayed overlaid on the second object in such a way that the angle or size is determined by tracking the position of the second object displayed in the second area. Accordingly, the user can project the image of a specific user onto his or her image displayed on the computing device 100. Additionally, by displaying a specific user's appearance projected onto one's own appearance, the desire to replicate the appearance of a specific user using augmented reality can be satisfied. Hereinafter, an example of a method by which the control unit 110 displays the first object so that the first object is overlaid on the second object will be described with reference to FIG. 6.

Meanwhile, the control unit 110 may display the first content so that the first content is overlaid on the first object in response to a user input in the first area for selecting the first content among at least one content included in the library. There is (S150).

For example, the user input in the first area may be an input for selecting the first content included in the library item displayed in the first area. The control unit 110 may display the first content by overlaying it on the first object based on a user input for selecting the first content.

Specifically, the first content may be content related to glasses. The first content may be a digital image file for the glasses. Alternatively, the first content may be a 3D modeling file for glasses. As the first content related to glasses is selected by the user, the controller 110 may determine an area in the first object where the glasses will be worn. For example, since glasses are worn on a person's eyes, when first content related to glasses is selected, the controller 110 may determine that the area related to the user's eyes in the first object is the area where the first content is displayed. there is. The control unit 110 may display the first content in the determined area.

As another example, the user input in the first area may be an input that drags and drops the first content from the first area to the second area where the first object is displayed. Here, the drag and drop input may be an input in which the user moves an object to another location while clicking on it in the user interface environment. The control unit 110 may display the first content by overlaying it on the first object based on a drag and drop input from the user. For example, the first content may be a 3D modeling file for a bracelet. The user can drag the first content and drop it on the desired location. The control unit 110 may display the first content in an area determined by the user.

According to some embodiments of the present disclosure, when the first content is determined in response to a user input in the first area, the control unit 110 may create a third object based on the first content. Here, the third object may be a 3D image. Alternatively, the third object may be an object created by performing 3D modeling on the first content. Accordingly, when the control unit 110 displays the third object by overlaying it on the first object, the third object is displayed by overlaying the first object in such a way that the angle or size is determined by tracking the position of the first object. You can.

For example, the first content may be content related to glasses. The control unit 110 may generate a third object, which is a 3D glasses image, based on the first content. When the control unit 110 displays the third object by overlaying it on the first object, the third object may be displayed in such a way that it is worn on the user's face included in the first object. When the direction in which the user's face is facing changes, the angle of the third object may change by tracking the direction in which the face is facing in the first object. When the user's face moves away from the photographing unit 150, the size of the first object may decrease. In this case, the third object may be reduced based on the size of the first object. Hereinafter, an example of a method by which the control unit 110 displays a third object such that the third object is overlaid on the first object will be described with reference to FIG. 7 .

According to the above-described configuration, the computing device 100 can provide an augmented reality service by displaying objects and content related to at least one NFT. Accordingly, the user's friends or acquaintances can trust that the augmented reality image displayed on the computing device 100 was implemented using NFT content without a separate verification process. In other words, the user's friends or acquaintances can trust that the user owns the augmented reality image displayed on the computing device 100. In order to further maximize the above-described effect, the computing device 100 may share augmented reality images or NFT content implemented using NFT content to other computing devices of other users. Here, sharing the augmented reality image with another computing device of another user may be understood as causing the augmented reality image displayed on the display unit 140 to be displayed on the display unit of the other computing device. For example, the computing device 100 may transmit an augmented reality image to another computing device through the communication unit 130, thereby causing the augmented reality image generated by the computing device 100 to be displayed on the display unit.

Meanwhile, according to some embodiments of the present disclosure, the computing device 100 may acquire at least one first NFT by transferring ownership of the at least one first NFT to a virtual wallet associated with the user. Hereinafter, an example of a method by which the computing device 100 according to the present disclosure acquires at least one first NFT will be described with reference to FIG. 3.

FIG. 3 is a flowchart illustrating an example of a method for a computing device to acquire at least one first NFT according to some embodiments of the present disclosure.

Referring to FIG. 3, the control unit 110 of the computing device 100 provides the blockchain mainnet 300 or the first market transaction history information of the blockchain mainnet 300 in response to input from the user. You can access at least one of the places (S111). The first marketplace may be a platform that relays NFT transactions.

The control unit 110 may search for at least one first NFT in at least one of the blockchain mainnet 300 or the first marketplace (S112).

Specifically, the control unit 110 may perform a search for transactions that have been verified in the blockchain mainnet 300 based on input from the user. As another example, the control unit 110 may access the block explorer and perform a search for transactions that have been verified on the blockchain mainnet 300. As another example, the control unit 110 may connect to the first marketplace that relays NFT transactions and records transaction history to perform a search for transactions that have been verified on the blockchain mainnet 300. Based on the search result of the transaction, the control unit 110 may search for at least one first NFT in which the virtual wallet address of a user other than the user of the computing device 100 is recorded as the final owner.

The control unit 110 may acquire at least one first NFT by transferring ownership of the searched at least one first NFT to a virtual wallet associated with the user (S113).

For example, the control unit 110 transfers a tradable token stored in the user's virtual wallet to the virtual wallet address of another user recorded as the final owner of the at least one first NFT, thereby Transactions can be carried out. The control unit 110 may acquire at least one first NFT for which the transaction has been completed.

Meanwhile, according to some embodiments of the present disclosure, an NFT containing a modeling file desired by the user may not exist in the blockchain mainnet 300 or the first marketplace. In this case, the computing device 100 may obtain the modeling file desired by the user through the second marketplace. Computing device 100 may issue at least one first NFT using the obtained modeling file. Hereinafter, another example of a method by which the computing device 100 according to the present disclosure acquires at least one first NFT will be described with reference to FIG. 4.

FIG. 4 is a flowchart illustrating another example of a method for a computing device to acquire at least one first NFT according to some embodiments of the present disclosure.

Referring to FIG. 4, the control unit 110 of the computing device 100 may access a second marketplace that provides a modeling file generated based on the appearance of a specific user in response to an input from the user (S210). . The second marketplace may be a platform that relays transactions of modeling files.

The control unit 110 may obtain at least one first modeling file from the second marketplace (S220).

The control unit 110 may issue at least one first NFT including at least one first modeling file using the blockchain mainnet 300 (S230). The control unit 110 may issue at least one first NFT to include at least one first modeling file or an address pointing to at least one first modeling file.

The control unit 110 may acquire at least one first issued NFT (S240).

For example, the control unit 110 may search for at least one first NFT that has been issued on the blockchain mainnet 300. The control unit 110 may acquire at least one searched first NFT. For another example, the control unit 110 may search for at least one first NFT by accessing the block explorer and performing a search for transactions that have been verified on the blockchain mainnet 300. As another example, the control unit 110 connects to the first marketplace that relays NFT transactions and records transaction history and performs a search for verified transactions, thereby searching for at least one first NFT. . According to one embodiment, the first marketplace and the second marketplace may be implemented as one entity. In this case, the control unit 110 may connect to a marketplace implemented as a single entity and perform the operations of acquiring a modeling file and issuing an NFT at the same time.

Meanwhile, according to some embodiments of the present disclosure, the second marketplace may not provide the modeling file that the user wants. In this case, the control unit 110 may connect to a third marketplace that provides image files created based on the appearance of a specific user in response to input from the user. Here, the image file may be a 2D image or photo file. The control unit 110 may generate at least one first modeling file using at least one first image file obtained from a third marketplace. The control unit 110 may issue at least one first NFT including at least one first modeling file using the blockchain mainnet 300. The control unit 110 may issue at least one first NFT to include at least one first modeling file or an address pointing to at least one first modeling file. The control unit 110 may acquire at least one issued first NFT.

According to one embodiment, the computing device 100 may previously store the first modeling file created by the user. In this case, the control unit 110 can obtain at least one first NFT by issuing at least one first NFT including at least one first modeling file through the blockchain mainnet 300.

According to the above-described configuration, the computing device 100 provides modeling generated based on a specific user desired by the user even if the NFT containing the modeling file desired by the user does not exist in the blockchain mainnet 300 or the first marketplace. At least one first NFT can be obtained using a file or image file. Accordingly, the user can use an augmented reality service that provides a modeling file created based on the appearance of a specific user desired by the user.

Meanwhile, according to some embodiments of the present disclosure, the computing device 100 may create at least one object using at least one first modeling file. The computing device 100 may configure the library to include at least one object. Hereinafter, an example of a method by which the computing device 100 according to the present disclosure configures a library will be described with reference to FIG. 5.

FIG. 5 is a flowchart illustrating an example of a method by which a computing device configures a library according to some embodiments of the present disclosure.

Referring to Figure 5, the control unit 110 of the computing device 100 may access the metadata storage location of the at least one first NFT to obtain at least one first modeling file related to the at least one first NFT. There is (S121).

Specifically, the control unit 110 is based on at least one of the first metadata of the at least one first NFT or the URL stored in the first metadata of the at least one first NFT. One first modeling file can be obtained.

The first metadata of the at least one first NFT includes the name of at least one first modeling file associated with the at least one first NFT, a modeling preview file, a modeling file description indicating the type of the at least one first modeling file, and It may include at least one of the storage locations of at least one first modeling file.

The modeling preview file may mean an image that allows you to check at least one first modeling file, even if the entire at least one first modeling file is not loaded. The modeling file description may indicate the type of at least one first modeling file. For example, the modeling file description may be information indicating the type of modeling file included in at least one first NFT, such as a modeling file expressing the appearance of a user or a modeling file created by anthropomorphizing an animal. The storage location of the modeling file may be information indicating the location where at least one first modeling file is stored. Depending on the embodiment, the first metadata may directly include a first modeling file, a first modeling preview file, or the like.

The control unit 110 may create at least one object using at least one first modeling file (S122). The control unit 110 may configure the library to include at least one object (S123).

According to one embodiment, at least one object created by the control unit 110 using at least one first modeling file may be a preview object. The control unit 110 may configure the library to include a preview object created using at least one first modeling file. The control unit 110 may create the first object in response to a user interaction of selecting the first object in the first area where the library is displayed. And, the control unit 110 may display the created first object in the second area.

According to some embodiments of the present disclosure, the control unit 110 may configure library items according to the type of each of the at least one first modeling file, based on the first metadata of the at least one first NFT. Here, a library item can be understood as a sub-concept of a library. Alternatively, a library item may be a unit with a lower granularity than the library. For example, a first library item included in a library may include a first object. A second library item included in the library may include a second object that is different from the first object.

For example, the control unit 110 may configure a first library item including a plurality of objects related to an actor. The control unit 110 may configure a second library item including a plurality of objects related to the singer. The control unit 110 may configure a third library item including a plurality of objects related to animals. The control unit 110 may configure a library including a first library item, a second library item, and a third library item.

According to one embodiment, the library may include at least one content related to at least one second NFT that is confirmed to be owned by the user of computing device 100.

Specifically, the control unit 110 may determine at least one second NFT by accessing at least one of the blockchain mainnet 300 or the first marketplace that provides transaction history information of the blockchain mainnet.

For example, the control unit 110 may perform a search for transactions that have been verified on the blockchain mainnet 300. As another example, the control unit 110 may access the block explorer and perform a search for transactions that have been verified on the blockchain mainnet 300. As another example, the control unit 110 may connect to the first marketplace that relays NFT transactions and records transaction history to perform a search for transactions that have been verified on the blockchain mainnet 300. Based on the transaction search result, the control unit 110 may search for at least one second NFT in which the virtual wallet address of the user of the computing device 100 is recorded as the final owner.

The control unit 110 may access the metadata storage location of at least one second NFT to obtain at least one content related to at least one second NFT. The control unit 110 displays at least one content corresponding to at least one second NFT based on at least one of the second metadata of the at least one second NFT or the URL stored in the second metadata of the at least one second NFT. can be obtained.

The second metadata of the at least one second NFT includes at least one of the name of at least one content associated with the at least one second NFT, a content description indicating the type of the at least one content, and a storage location of the at least one content data. It can be included. Depending on the embodiment, the second metadata may directly include at least one content file, at least one content preview file, etc. The control unit 110 may configure the library to include at least one acquired content.

According to one embodiment, the control unit 110 may configure the library to include at least one content preview file. The control unit 110 may display the first content in the second area in response to a user interaction of selecting a content preview file in the first area where the library is displayed.

Meanwhile, according to some embodiments of the present disclosure, the computing device 100 may display the first object such that the first object related to at least one first modeling file is overlaid on the second object created by photographing the user. . Hereinafter, a method of displaying a first object by a computing device according to the present disclosure will be described with reference to FIG. 6.

FIG. 6 is a flowchart illustrating an example of a method by which a computing device displays a first object according to some embodiments of the present disclosure.

Referring to FIG. 6, the control unit 110 of the computing device 100 may capture a user and create a second object related to the user (S151).

Specifically, the control unit 110 can photograph the user through the photographing unit 150. The control unit 110 may create a second object using the captured image of the user. The second object may be a three-dimensional image. Alternatively, the second object may be an object created by performing 3D modeling on the first content.

The display unit 140 may display the second object created under the control of the control unit 110 in the second area (S152). The control unit 110 may display the first object so that the first object is overlaid on the second object in response to a user input for selecting the first object in the first area (S153).

The user input in the first area may be an input for selecting the first object included in the library item displayed in the first area. The control unit 110 may display the first object by overlaying it on the second object based on a user input for selecting the first object.

Specifically, the second object may be an object created based on the user's appearance. The first object may be an object created based on the appearance of a specific user. As the first object related to the appearance of a specific user is selected by the user, the control unit 110 may determine an area in the second area where the first object will be displayed. For example, since the first object is an object related to the appearance of a specific user, the control unit 110 may determine that the area where the second object is displayed is the area where the first object is displayed. The control unit 110 may display the first object in the determined area.

As another example, the user input in the first area may be an input for dragging and dropping the first object from the first area to the second area. The control unit 110 may display the first object by overlaying the second object based on a drag and drop input from the user.

According to one embodiment, when the user input is an input that drags the first object and drops it so that at least part of it overlaps with the second object, the control unit 110 may display the first object by overlaying it on the second object. there is. If the user input is an input for dragging the first object and dropping it in an area where the second object is not displayed so as not to overlap the second object, the control unit 110 may display the first object separately from the second object.

According to one embodiment, the first object may be displayed overlaid on the second object in such a way that the angle or size is determined by tracking the position of the second object displayed in the second area.

For example, the second object may be an object created by photographing a user. When the direction in which the user's face or body is facing changes, the angle of the first object may be changed by tracking the direction in which the user's face or body is facing in the second object. For another example, when the user moves away from the photographing unit 150, the size of the second object may decrease. In this case, the first object may be reduced based on the size of the second object. For another example, the second object may be an object created using only a part of the user's body. In this case, the control unit 110 may create the first object to correspond to a part of the user's body. Additionally, the control unit 110 may display the first object to track the location of the second object representing a part of the body.

According to the above-described configuration, the computing device 100 may display the first object so that the first object is overlaid on the second object in response to a user input for selecting the first object in the first area. Accordingly, the user can project the image of a specific user onto his or her image displayed on the computing device 100. Accordingly, the desire to replicate the appearance of a specific user can be satisfied using augmented reality.

Meanwhile, according to some embodiments of the present disclosure, the computing device 100 may display the first content so that the first content is overlaid on the first object. Hereinafter, an example of a method by which the computing device 100 according to the present disclosure displays first content will be described with reference to FIG. 7.

FIG. 7 is a flowchart illustrating an example of a method by which a computing device displays first content according to some embodiments of the present disclosure.

Referring to FIG. 7, the control unit 110 of the computing device 100 may determine the type of the first content based on the second metadata of at least one second NFT related to the first content corresponding to the user input. There is (S310).

Specifically, the first content may be content related to at least one second NFT that is confirmed to be owned by the user. The control unit 110 may determine the type of first content based on the second metadata of at least one second NFT. For example, the control unit 110 may determine a type indicating whether the first content is clothes or glasses.

The control unit 110 may determine a third area where the first content is overlaid in the first object based on the type of the first content (S320). Here, the third area may be an area included in the second area. The third area may be at least a partial area within the second area. The third area may be included in the area where the first object is displayed.

For example, if the type of first content is glasses, the first content may need to be displayed in an area where eyes exist in the first object related to the appearance of a specific user. For another example, when the type of first content is a top, the first content may need to be displayed in an area where the upper body of the first object exists. For another example, when the type of first content is an earring, the first content may need to be displayed in an area where ears exist in the first object. Even though the type of first content is glasses, if the first content is displayed in the area where the upper body of the first object is displayed, the user may not be able to accurately see what the first content looks like when worn on the user. there is. Accordingly, the control unit 110 may determine the third area based on the type of first content.

According to some embodiments of the present disclosure, the storage unit 120 may store a database or table in which body parts corresponding to types of content are mapped. The controller 110 may determine the first body part corresponding to the type of first content based on a database in which body parts corresponding to the type of content are mapped. For example, the control unit 110 may determine that the type of first content is glasses, based on the second metadata of the first content. The control unit 110 may determine that the body part corresponding to the glasses is the eye based on a database in which body parts corresponding to the type of content are mapped.

The controller 110 may determine a second body part corresponding to the first body part in the first object. For example, the control unit 110 may determine the user's eyes from the first object displayed in the second area. Depending on the embodiment, the controller 110 may determine a second body part corresponding to the first body part in the first object through a neural network model learned to determine body parts from objects related to users. The neural network model may be a network model based on Convolutional Neural Networks (CNN), Artificial Neural Network (ANN), Deep Neural Network (DNN), or Recurrent Neural Network (RNN). The neural network model may be a model that outputs a second body part corresponding to the first body part in the first object when information about the first body part is input. Hereinafter, since conventional techniques can be used for the method of recognizing an object using a neural network model, detailed description will be omitted. The controller 110 may determine an area including the second body part as the third area.

The display unit 140 may display the first content by overlaying it on the third area determined under the control of the control unit 110 (S330).

According to some embodiments of the present disclosure, the controller 110 may determine the area of the second body part included in the third area. For example, if the type of first content is determined to be tops, the controller 110 may determine the upper body as the second body part in the first object and determine the area including the upper body as the third area. The control unit 110 may determine the area of the upper body within the third area. For another example, when the type of first content is determined to be bottoms, the controller 110 may determine the user's lower body as the second body part in the first object. The controller 110 may determine the area of the second body part. The controller 110 may determine a third area including the lower body based on the determined area.

The controller 110 may determine the size of the first content based on the area of the second body part. For example, the controller 110 may determine the size of the first content to correspond to the area of the second body part.

The control unit 110 may display the first content by overlaying it on the third area based on the determined size of the first content. For example, the size of the first content may be preset in the second metadata of at least one second NFT related to the first content. However, if the first content is displayed by overlaying the first object at a preset size, the user may not be able to accurately see what the first content will look like when worn on the user. Accordingly, the control unit 110 may enlarge or reduce the size of the first content based on the determined size of the first content. The control unit 110 may display the enlarged or reduced size of the first content by overlaying it on the third area. Accordingly, the user can accurately check what the first content will look like when worn on the user.

According to some embodiments of the present disclosure, the display unit 140 may display a first object, a second object created based on the first content, a library, etc. Hereinafter, an example of a user interface displayed on the display unit 140 will be described with reference to FIG. 8.

FIG. 8 is a diagram illustrating an example of a user interface displayed on a display unit according to some embodiments of the present disclosure.

Referring to (a) of FIG. 8, the display unit 140 may include a first area 141 and a second area 142.

The first area 141 may be at least a portion of the area included in the second area 142 . The first area 141 may be an area where the library 144 is displayed.

The second area 142 may be the entire area of the display unit 140. Depending on the embodiment, the second area 142 may be at least a partial area of the display unit 140. The second area 142 may be an area where the first object 143 created using a modeling file of a specific user is displayed.

The first object 143 may be an object created using a modeling file created based on the appearance of a specific user. The first object 143 may be displayed by being overlaid on a second object created by photographing the user of the computing device 100.

Library 144 may include at least one library item. The library 144 may include a first library item 1441 and a second library item 1432. The user can select a specific item from among the items included in the library 144 through user interaction with the first area 141. The user can change the displayed library items through a sliding interaction on the first area 141.

For example, at least a portion of the first library item 1441 and the second library item 1442 may be displayed in the first area 141. The user can display the second library item 1442 through the interaction of sliding the first library item 1441 from one area within the first area 141 to the right area.

For another example, referring to (b) of FIG. 8, at least a portion of the first library item 1441 and the third library item 1443 may be displayed in the first area 141. The user can cause the third library item 1443 to be displayed through the interaction of sliding the first library item 1441 from one area within the first area 141 to the left area.

The first library item 1441 may include first content 145. The first content 145 displayed in the first library item 1441 may be preview content. Here, the preview content may mean an image that allows the first content 145 to be confirmed even if the entire file related to the first content 145 is not loaded.

The third object 146 may be an object created based on the first content 145. The third object 146 may be a three-dimensional image or modeling file created based on the first content 145. The control unit 110 may display the third object 146 by overlaying it on the first object 143 based on the input from the user in the first area 141. Depending on the embodiment, the third object 146 may be displayed overlaid on the first object 143 in such a way that the angle or size is determined by tracking the position of the first object 143.

For example, in (a) of FIG. 8 , as the user looks straight ahead, the first object 143 may display a face. The third object 146 may be displayed in a way that it is worn on the user's face. Referring to (b) of FIG. 8, as the user looks to the right (or left), the first object 143 may be displayed on the side of the face. The third object 146 may be displayed in such a way that its angle changes by tracking the position of the first object 143 whose side is displayed.

According to some embodiments of the present disclosure, the control unit 110 may share the augmented reality image displayed on the display unit 140 to another computing device of another user through the communication unit 130. Here, sharing the augmented reality image with another computing device of another user may be understood as causing the augmented reality image displayed on the display unit 140 to be displayed on the display unit of the other computing device. The augmented reality image displayed on the display unit 140 may be generated based on content related to an NFT that is confirmed to have ownership by the user of the computing device 100. Accordingly, when another user of another computing device receives an augmented reality image shared from the computing device 100, the other user can trust that the user has ownership of the NFT of contents included in the augmented reality image. According to one embodiment, when sharing an augmented reality image with another computing device, the control unit 110 displays an annotation that the third object 146 is an object created based on content related to an NFT owned by the user. can do. If the annotation is not displayed on the third object 146 created by the control unit 110, other users who have shared the augmented reality image may determine which of the contents included in the augmented reality image are displayed by the computing device 100. You may not be able to recognize whether it is a created object. For example, the first object 143 related to a specific user displayed on the display unit 140 may be displayed with the third object 146 overlaid on it. The user may be wearing actual clothes rather than objects created based on NFT-related content. When another user of another computing device shares the augmented reality image, in addition to the third object 146, the clothes worn by the user are also mistaken as objects created using content related to the NFT owned by the user of the computing device 100. can do. Accordingly, when sharing an augmented reality image, the control unit 110 may display an annotation on the third object 146.

According to some embodiments of the present disclosure, when the third object 146 is displayed, the user may perform an interaction to manipulate the third object 146.

For example, the user may move his hand close to the third object 146 to manipulate the third object 146. Accordingly, a fourth object related to the user's hand may be displayed in the first area 141. When the fourth object is displayed in the second area 142, the control unit 110 may give priority to interactions related to the fourth object. For example, as the user looks straight ahead in (a) of FIG. 8, the first object 143 may display a face. The third object 146 may be displayed in a way that it is worn on the user's face. Afterwards, the user can perform an interaction to manipulate the third object 146. The control unit 110 may move the position of the third object 146 in response to user interaction. For example, the user may perform an interaction to remove the third object 146. In this case, the control unit 110 may control the third object 146 to move while being held in the user's hand. Thereafter, as the user looks to the right (or left), the first object 143 may be displayed on the side of the face. The controller 110 may determine whether the fourth object is displayed in the second area 142. When the control unit 110 determines that the fourth object is displayed in the second area 142, the third object 146 does not track the position of the first object 143 whose side is displayed, and the fourth object 146 can be controlled to track.

As described above with reference to FIGS. 1 to 8, the computing device 100 can provide an augmented reality service by overlaying and displaying content related to at least one NFT that is confirmed to be owned by the user on an object related to the user. . Accordingly, the user's friends or acquaintances can trust that the augmented reality image displayed on the computing device 100 was implemented using NFT content without a separate verification process. Depending on the embodiment, the computing device 100 may share the augmented reality image or NFT content to another computing device of another user in order to further maximize the above-described effect.

The description of the presented embodiments is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments without departing from the scope of the disclosure. Thus, the present disclosure is not limited to the embodiments presented herein but is to be interpreted in the broadest scope consistent with the principles and novel features presented herein.

Claims (16)

A method for providing an augmented reality service using non-fungible token (NFT) content performed by a computing device including at least one processor,
Obtaining at least one first NFT including a modeling file created based on the appearance of a specific user;
Containing at least one object related to at least one first modeling file included in the at least one first NFT and at least one content related to at least one second NFT that is confirmed to be owned by a user of the computing device Constructing a library;
displaying the configured library in a first area;
In response to a user input in the first area selecting a first object from among at least one object included in the library, displaying the first object in a second area; and
In response to a user input in the first area for selecting first content among at least one content included in the library, displaying the first content so that the first content is overlaid on the first object;
Including,
method.
According to claim 1,
The step of acquiring at least one first NFT containing a modeling file created based on the appearance of the specific user,
In response to input from a user of the computing device, accessing at least one of a blockchain mainnet or a first marketplace providing transaction history information of the blockchain mainnet;
Searching for the at least one first NFT in at least one of the blockchain mainnet or the first marketplace; and
Obtaining the at least one first NFT by transferring ownership of the retrieved at least one first NFT to a virtual wallet associated with the user;
Including,
method.
According to claim 1,
The step of acquiring at least one first NFT containing a modeling file created based on the appearance of the specific user,
In response to input from a user of the computing device, accessing a second marketplace that provides a modeling file generated based on the appearance of a specific user;
Obtaining the at least one first modeling file from the second marketplace;
issuing the at least one first NFT including the at least one first modeling file using a blockchain mainnet; and
Obtaining the at least one first NFT issued;
Including,
method.
According to claim 1,
The step of acquiring at least one first NFT containing a modeling file created based on the appearance of the specific user,
In response to input from a user of the computing device, accessing a third marketplace that provides image files generated based on the physical appearance of a specific user;
generating the at least one first modeling file using at least one first image file obtained from the third marketplace;
issuing the at least one first NFT including the at least one first modeling file using a blockchain mainnet; and
Obtaining the at least one first NFT issued;
Including,
method.
According to claim 1,
Containing at least one object related to at least one first modeling file included in the at least one first NFT and at least one content related to at least one second NFT that is confirmed to be owned by a user of the computing device The steps to construct a library are:
Accessing the metadata storage location of the at least one first NFT to obtain the at least one first modeling file associated with the at least one first NFT - the first metadata of the at least one first NFT includes At least one of a name of the at least one first modeling file associated with the at least one first NFT, a modeling file description indicating a type of the at least one first modeling file, and a storage location of the at least one first modeling file Contains -;
generating at least one object using the at least one first modeling file; and
configuring the library to include the at least one object;
Including,
method.
According to claim 5,
The step of accessing the metadata storage location of the at least one first NFT to obtain the at least one first modeling file related to the at least one first NFT,
At least one first modeling corresponding to the at least one first NFT based on at least one of the first metadata of the at least one first NFT or the URL stored in the first metadata of the at least one first NFT Obtaining a file;
Including,
method.
According to claim 1,
Containing at least one object related to at least one first modeling file included in the at least one first NFT and at least one content related to at least one second NFT that is confirmed to be owned by a user of the computing device The steps to construct a library are:
Accessing at least one of a blockchain mainnet or a first marketplace that provides transaction history information of the blockchain mainnet to determine the at least one second NFT;
Accessing the metadata storage location of the at least one second NFT to obtain at least one content related to the at least one second NFT - the second metadata of the at least one second NFT is the at least one Containing at least one of the name of at least one content related to the second NFT, a content description indicating the type of at least one content, and a storage location of at least one content data; and
configuring the library to include the at least one content;
Including,
method.
According to claim 7,
The step of accessing the metadata storage location of the at least one second NFT to obtain at least one content related to the at least one second NFT,
Obtaining at least one content corresponding to the at least one second NFT based on at least one of the second metadata of the at least one second NFT or the URL stored in the second metadata of the at least one second NFT steps;
Including,
method.
According to claim 1,
In response to a user input in the first area for selecting a first object among at least one object included in the library, displaying the first object in the second area includes:
capturing the user and creating a second object related to the user;
displaying the created second object in the second area; and
In response to a user input for selecting the first object in the first area, displaying the first object so that the first object is overlaid on the second object;
Including,
method.
According to clause 9,
The first object is,
Displayed overlaid on the second object in such a way that the angle or size is determined by tracking the position of the second object displayed in the second area,
method.
According to claim 1,
In response to a user input in the first area for selecting first content among at least one content included in the library, displaying the first content so that the first content is overlaid on the first object,
Based on second metadata of the at least one second NFT related to the first content corresponding to the user input, determining the type of the first content;
Based on the type of the first content, determining a third area in the first object where the first content is overlaid; and
Overlaying and displaying the first content on the determined third area;
Including,
method.
According to claim 11,
Based on the type of the first content, determining a third area in the first object where the first content is overlaid includes:
determining a first body part corresponding to the type of first content based on a database in which body parts corresponding to the type of content are mapped;
determining a second body part corresponding to the first body part in the first object; and
determining an area including the second body part as the third area;
Including,
method.
According to claim 12,
The step of overlaying and displaying the first content on the determined third area includes:
determining an area of the second body part included in the third region;
determining a size of the first content based on an area of the second body part; and
Based on the determined size of the first content, overlaying and displaying the first content on the third area;
Including,
method.
According to claim 1,
In response to a user input in the first area for selecting first content among at least one content included in the library, displaying the first content so that the first content is overlaid on the first object,
generating a third object based on the first content, wherein the third object is created as a three-dimensional image; and
Overlaying and displaying the created third object on the first object;
Including,
method,
According to claim 14,
The third object is,
Displayed overlaid on the first object in such a way that the angle or size is determined by tracking the position of the first object displayed in the second area,
method.
A computing device for providing augmented reality services,
Obtaining at least one first NFT including a modeling file created based on the appearance of a specific user, and at least one object related to the at least one first modeling file included in the at least one first NFT and the computing A control unit configured to configure a library containing at least one content related to at least one second NFT that is confirmed to be owned by the user of the device; and
The library configured under the control of the control unit is displayed in a first area, and the first object is selected in response to a user input in the first area for selecting a first object among at least one object included in the library. displaying in a second area, and in response to a user input in the first area selecting a first content among at least one content included in the library, so that the first content is overlaid on the first object A display unit that displays content;
Including,
Computing device.