KR20230152309A - System for providing augmented reality based on AR Non-fungible token contents and method thereof - Google Patents

Abstract

The present invention discloses an augmented reality system and method based on AR NFT content. That is, the present invention displays AR NFT content through a web page provided by the landing URL included in the QR code when scanning a QR code on the terminal, and performs a preset mission through the AR NFT content according to user control. By receiving rewards based on mission performance, users can be more interested and use it in corporate promotional marketing to increase the usability of AR NFT content, thereby increasing the value of possession through the various uses of NFT.

Description

AR NFT content-based augmented reality system and method {System for providing augmented reality based on AR Non-fungible token contents and method thereof}

The present invention relates to an augmented reality system and method based on AR NFT content. In particular, when scanning a QR code on a terminal, AR NFT content is displayed through a web page provided by a landing URL included in the QR code, It relates to an augmented reality system and method based on AR NFT content that performs a preset mission through AR NFT content under user control and receives rewards according to mission performance.

Augmented Reality (AR) refers to the process of combining or increasing computer-generated useful information by superimposing it on the image when showing videos and photos through computer programming.

This augmented reality technology is being applied in various technological fields.

Korean Patent No. 10-1569905 [Title: Method of providing integrated management service for cultural and artistic creations reflecting the needs of the requester]

The purpose of the present invention is to display AR NFT content through a web page provided by the landing URL included in the QR code when scanning a QR code on the terminal, and perform a preset mission through the AR NFT content under user control. The purpose is to provide an augmented reality system and method based on AR NFT content that receives rewards according to mission performance.

The AR NFT content-based augmented reality method according to an embodiment of the present invention includes the steps of obtaining image information including a QR code by a terminal through a camera unit configured in the terminal; Recognizing, by the terminal, a QR code included in the acquired image information; Accessing, by the terminal, a landing URL included in the recognized QR code; and displaying, by the terminal, a web page transmitted from the connected landing URL.

As an example related to the present invention, the web page includes AR NFT content related to the QR code, and can be applied to the viewfinder screen displayed on the terminal to display the AR NFT content as an augmented reality image.

As an example related to the present invention, the web page has a program applied to perform one or more preset functions running in a browser or web view, information for connecting a browser or web view installed in the terminal, and information configured in the terminal. It may include at least one of information for acquiring still images or moving images by driving the camera unit, and information for obtaining location information of the terminal by driving the GPS receiver configured in the terminal.

As an example related to the present invention, the step of displaying the web page includes, when accessing the landing URL from the terminal, a hash corresponding to the landing URL by linking with a blockchain server by a server that manages the landing URL. The process of checking a value; A process of collecting the AR NFT content distributed and stored in one or more IPFS in relation to the confirmed hash value by the server in conjunction with a plurality of IPFS; A process of transmitting, by the server, the web page containing the collected AR NFT content to the terminal; And it may include a process of displaying the web page transmitted from the connected landing URL by the terminal.

As an example related to the present invention, it may further include obtaining a still image or video including the AR NFT content using at least one of WebRTC, WebGL, and WebVR on the web page.

As an example related to the present invention, when the location information of the terminal is included in a preset event area based on the location information of the terminal provided to the server according to the landing URL access from the terminal, it is sent by the terminal, from the server. Displaying the provided mission information on one side of the web page where AR NFT content is displayed; When the terminal performs a mission function according to mission information displayed on the terminal, authenticating, by the terminal, in conjunction with the server, the mission performance performed by the terminal; Displaying, by the terminal, mission performance result information provided from the server according to mission performance; And when the mission is normally performed in the terminal, it may further include receiving a preset reward from the server by the terminal.

As an example related to the present invention, the mission information includes the terminal's location information and personal information provision consent function, an affiliated store code recognition function, a beacon recognition function within the affiliated store, a Wi-Fi recognition function within the affiliated store, a QR code recognition function within the affiliated store, and an affiliated store and It may include at least one of the related receipt recognition functions.

The AR NFT content-based augmented reality system according to an embodiment of the present invention acquires image information including a QR code through a camera unit configured in the terminal, recognizes the QR code included in the obtained image information, and The terminal accesses a landing URL included in a QR code and displays a web page transmitted from the connected landing URL; And it may include a server that transmits the web page to the terminal that accesses the landing URL.

The present invention displays AR NFT content through a web page provided by a landing URL included in the QR code when a QR code is scanned on a terminal, and performs a preset mission through the AR NFT content according to user control, By receiving rewards according to mission performance, there is an effect of arousing user interest and increasing the usability of AR NFT content by using it in corporate promotional marketing, thereby increasing the value of possession through various uses of NFT.

Figure 1 is a block diagram showing the configuration of an augmented reality system based on AR NFT content according to an embodiment of the present invention.
Figure 2 is a flowchart showing an augmented reality method based on AR NFT content according to an embodiment of the present invention.
Figures 3 and 4 show examples of screens of a terminal according to an embodiment of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention, unless specifically defined in a different sense in the present invention, should be interpreted as meanings generally understood by those skilled in the art in the technical field to which the present invention pertains, and are not overly comprehensive. It should not be interpreted in a literal or excessively reduced sense. Additionally, if the technical terms used in the present invention are incorrect technical terms that do not accurately express the idea of the present invention, they should be replaced with technical terms that can be correctly understood by those skilled in the art. In addition, general terms used in the present invention should be interpreted according to the definition in the dictionary or according to the context, and should not be interpreted in an excessively reduced sense.

Additionally, as used in the present invention, singular expressions include plural expressions unless the context clearly dictates otherwise. In the present invention, terms such as “consists of” or “comprises” should not be construed as necessarily including all of the various components or steps described in the invention, and some of the components or steps may not be included. It may be possible, or it should be interpreted as being able to further include additional components or steps.

Additionally, terms containing ordinal numbers, such as first, second, etc., used in the present invention may be used to describe constituent elements, but the constituent elements should not be limited by the terms. Terms are used only to distinguish one component from another. For example, a first component may be named a second component without departing from the scope of the present invention, and similarly, the second component may also be named a first component.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the attached drawings. However, identical or similar components will be assigned the same reference numbers regardless of the reference numerals, and duplicate descriptions thereof will be omitted.

Additionally, when describing the present invention, if it is determined that a detailed description of related known technologies may obscure the gist of the present invention, the detailed description will be omitted. In addition, it should be noted that the attached drawings are only intended to facilitate easy understanding of the spirit of the present invention, and should not be construed as limiting the spirit of the present invention by the attached drawings.

Figure 1 is a block diagram showing the configuration of an augmented reality system 10 based on AR NFT content according to an embodiment of the present invention.

As shown in FIG. 1, the AR NFT content-based augmented reality system 10 consists of a terminal 100, a server 200, a plurality of IPFSs 300, and a blockchain server 400. Not all of the components of the augmented reality system 10 shown in FIG. 1 are essential components, and the augmented reality system 10 may be implemented with more components than those shown in FIG. 1, or fewer components than those shown in FIG. The augmented reality system 10 may also be implemented by components.

The terminal 100 is a smart phone, a portable terminal, a mobile terminal, a foldable terminal, a personal digital assistant (PDA), and a portable multimedia (PMP). Player terminal, telematics terminal, navigation terminal, personal computer, laptop computer, Slate PC, Tablet PC, ultrabook, wearable device Device (e.g., smartwatch, smart glass, HMD (Head Mounted Display), etc.), Wibro terminal, IPTV (Internet Protocol Television) terminal, smart TV, digital broadcasting It can be applied to various terminals such as terminals, AVN (Audio Video Navigation) terminals, A/V (Audio/Video) systems, flexible terminals, digital signage devices, and kiosks (KIOSK).

The server 200, the plurality of IPFS 300, and the blockchain server 400 may be implemented in the form of a web server, database server, proxy server, etc. In addition, the server 200, the plurality of IPFSs 300, and the blockchain server 400 include a network load balancing mechanism, or the corresponding server 200, the plurality of IPFSs 300, and the blockchain server 400. ) may be installed and implemented as a computerized system. Additionally, the network may be an http network, a private line, an intranet, or any other network. Furthermore, the connection between the terminal 100, the server 200, the plurality of IPFS 300, and the blockchain server 400 can be connected to a secure network to prevent data from being attacked by any hacker or other third party. . In addition, the server 200, the plurality of IPFS 300, and the blockchain server 400 may include a plurality of database servers, and these database servers may be connected to any type of network, including a distributed database server architecture. It can be implemented in a way that it is separately connected to the server 200 through .

The terminal 100, the server 200, the plurality of IPFS 300, and the blockchain server 400 each include a communication unit (not shown) for performing communication functions with other terminals, various information, and programs. A storage unit (not shown) for storing (or application), a display unit (not shown) for displaying various information and program execution results, and an audio output unit for outputting audio information corresponding to the various information and program execution results. (not shown), and a control unit (not shown) for controlling various components and functions of each terminal.

The terminal 100 communicates with the server 200, the plurality of IPFSs 300, the blockchain server 400, etc. At this time, the terminal 100 recognizes a QR code including a random landing URL, then accesses the landing URL included in the recognized QR code and accesses the AR NFT content (or AR content) through a web page related to the landing URL. It may be a terminal owned by a user who wants to use /VR content/MR content/realistic content.

Additionally, the terminal 100 acquires (or photographs) image information including a QR code through a camera unit (not shown) configured in the terminal 100. At this time, the QR code is provided in the form of a sticker, print, or image, and is configured (or attached/formed/printed) on one side of the packaging paper packaging the product, or directly configured (or attached/formed/printed) on one side of the product. /printed), printed (or attached/configured/formed) on a separate printing paper, or in the form of an image file, and includes information about the landing URL (or landing page).

In this way, the QR code can be configured as a landing URL to induce access to the landing URL in order to summon AR NFT content related to the QR code and perform various functions without installing a separate app.

Additionally, the terminal 100 may obtain the image information including the QR code through a dedicated app pre-installed on the terminal 100. Here, the dedicated app includes Naver app and Kakao app that are widely used, and the app may include a scanning function (or QR code recognition/scanning function).

In this way, the acquisition of image information including the QR code can be performed through a camera unit configured in the terminal 100 or through the scan function of a dedicated app pre-installed on the terminal 100.

Additionally, the terminal 100 recognizes (or verifies) the QR code included in the acquired (or captured) image information.

Additionally, the terminal 100 accesses the landing URL included in the recognized (or confirmed) QR code. At this time, when accessing the landing URL from the terminal 100, the terminal 100 sends the identification information of the terminal 100, real-time location information of the terminal 100, etc. to the server 200 that operates the landing URL. ) is provided (or transmitted) to. In addition, in relation to the terminal 100 accessing the landing URL, the server 200 provides identification information of the terminal 100, location information of the terminal 100 (including, for example, GPS location information, etc.), Collect and manage date and time information at the time of connection. Additionally, the identification information of the terminal 100 includes MDN (Mobile Directory Number), mobile IP, mobile MAC, SIM (subscriber identity module) card unique information, serial number, etc.

At this time, the terminal 100 displays a guidance window to confirm whether to access the landing URL included in the recognized (or confirmed) QR code.

That is, the terminal 100 displays the information window in the form of a pop-up on the screen (or viewfinder screen) displayed on the terminal 100 in order to check whether to access the landing URL included in the recognized QR code. Display.

In addition, when the preset confirmation menu (or connection menu) displayed on one side of the information window in the terminal 100 is selected, the terminal 100 enters the landing URL included in the recognized (or confirmed) QR code. You can also connect.

Additionally, the terminal 100 displays a web page transmitted from the connected landing URL. At this time, the web page includes AR NFT content related to the QR code (or landing URL corresponding to the QR code), and is applied to the viewfinder screen displayed on the terminal 100, augmented reality video (or The AR NFT content is displayed as a mixed reality video.

That is, when the terminal 100 accesses the landing URL, the terminal 100 receives the web page transmitted from the connected landing URL. Here, the web page is a program (or web app) that performs one or more preset functions running in a browser or web view, such as WebRTC (Web Real-Time Communication), WebGL (Web Graphics Library), WebVR, and WebAR. etc. are applied, information (or control information/control signal) for connecting (or running) the browser or web view installed by default on the terminal 100, and still image or It includes information for acquiring a video, information for acquiring location information of the terminal 100 by driving a GPS receiver (not shown) configured in the terminal 100, etc. Additionally, the program (or web app) may be a program (or web app) running on the browser or the web view (including, for example, Samsung browser, Chrome browser, Safari browser, Naver built-in browser, WeChat built-in browser, etc.).

Additionally, the terminal 100 displays the web page including the received AR NFT content.

That is, the terminal 100 applies (or reflects) the viewfinder screen displayed on the corresponding terminal 100 to the web page, and the AR NFT content included in the web page is displayed on the viewfinder screen that is confirmed in real time. Displays an augmented reality image (or mixed reality image) to which is applied.

In addition, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to acquire a still image or video including the corresponding AR NFT content using resources on the OS of the terminal 100. (or take pictures)

That is, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to open the browser (or viewfinder) as the user of the terminal 100 adjusts the direction of the terminal 100. Obtain a still image or video containing the image (or screen) confirmed through the AR NFT content.

In addition, the terminal 100 may perform an enlargement function, a zoom-out function, a rotation function, etc. for the corresponding AR NFT content according to the user touch (or user input/selection/control) of the terminal 100. Here, the zoom-in or zoom-out function for the AR NFT content may be performed according to the user's touch gestures, including “pinch” and the like.

Here, the “pinch” refers to an action in which the user moves two fingers in different directions while touching the screen. It is a gesture for enlarging (Pinch Open) or reducing (Pinch Close) an object (e.g., the AR NFT content above) or a page, and the enlargement or reduction value is determined depending on the distance between the two fingers.

Additionally, the terminal 100 may link with the server 200 and a social media server (not shown) to upload the obtained still image or video to a social media account related to the terminal 100.

In addition, the terminal 100 is linked with the server 200, and the acquired still image or video is stored in another terminal (not shown) owned by family members, friends, coworkers, etc. related to the user of the terminal 100. You can share (or provide/transmit) with.

In addition, the terminal 100 shares address information (or URL information) about the web page in the form of a short/long message, Kakao Talk, Naver's band chat window, etc., so that other users can also share the corresponding AR NFT content. You can also configure it so that you can check the web page to which it has been applied. At this time, if the location of other users is located in an event area preset in relation to the web page, the other users can also perform the mission function described below.

In addition, an event area (or event space) in which the location information of the terminal 100 is preset based on the location information of the terminal 100 provided to the server 200 upon connection to the landing URL from the terminal 100 /location), the terminal 100 displays the mission information provided from the server 200 on one side of the corresponding web page where the AR NFT content is displayed. At this time, the terminal 100 displays an icon (or object) indicating the presence of mission information on one side of the web page where the AR NFT content is displayed, and when the icon is selected, the entire screen of the web page , the mission information may be displayed on some screens, pop-up screens, etc. Here, the mission information includes the location information of the corresponding terminal 100 and the consent function to provide personal information (including, for example, gender, age group, region of residence, etc.), the affiliated store code recognition function, the beacon recognition function within the affiliated store, and the Wi-Fi recognition function within the affiliated store. , QR code recognition function within the affiliated store, receipt recognition function related to the affiliated store, etc.

In addition, when the terminal 100 (or a user possessing the terminal 100) performs a mission function according to the mission information displayed on the terminal 100, the terminal 100 is connected to the server 200. In conjunction with , the mission performed by the corresponding terminal 100 (or a user possessing the corresponding terminal 100) is authenticated (or authentication is performed). At this time, the terminal 100 is linked with the server 200 to select a preset menu (or button/item) displayed on the terminal 100 in real time in relation to the location where the terminal 100 is located. In this case, product information and/or service information provided by the affiliated store corresponding to the location may be displayed.

Here, if the mission is a function of agreeing to the provision of location information and personal information (including, for example, gender, age group, region of residence, etc.) of the terminal 100, the terminal 100 operates according to the user selection of the terminal 100. The location information of the relevant terminal 100, information on acceptance of consent to provide personal information, location information of the terminal 100, identification information of the relevant terminal 100, and the mission information are transmitted to the server 200.

In addition, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to the previously transmitted location information of the terminal 100 and personal information provision consent acceptance information, and the Displays (or outputs) information indicating that the received mission has been successful.

In addition, when the mission is an affiliated store code recognition function, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to add an additional message containing an affiliated store code provided at the affiliated store where the terminal 100 is located. Image information is acquired, and the acquired additional image information, location information of the terminal 100, identification information of the terminal 100, mission information, etc. are transmitted to the server 200.

If the mission fails, the terminal 100 receives information indicating that the mission has failed, transmitted from the server 200 in response to previously transmitted additional video information, etc., and indicates that the received mission has failed. Display (or output) information.

If the mission is successful, the terminal 100 receives information indicating that the mission has been successful, transmitted from the server 200 in response to previously transmitted additional video information, etc., and indicates that the received mission has been successful. Display (or output) information.

In addition, when the mission is a beacon recognition function within an affiliated store, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to place (or configure) one side of the affiliated store where the terminal 100 is located. / formed) perform a wireless communication connection with a beacon (not shown) to obtain unique identification information of the beacon, unique identification information of the obtained beacon, location information of the terminal 100, and information of the terminal 100. Identification information, mission information, etc. are transmitted to the server 200.

If the mission fails, the terminal 100 receives information indicating that the mission has failed, transmitted from the server 200 in response to the unique identification information of the previously transmitted beacon, and the received mission has failed. Displays (or outputs) information indicating that

If the mission is successful, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to the unique identification information of the previously transmitted beacon, and the received mission has been successful. Displays (or outputs) information indicating that

In addition, when the mission is a Wi-Fi recognition function within an affiliated store, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page, / formed) perform a wireless communication connection with an access point (Access Point) to obtain unique identification information of the access point, unique identification information of the obtained access point, location information of the terminal 100, and the terminal ( 100)'s identification information, the mission information, etc. are transmitted to the server 200.

If the mission fails, the terminal 100 receives information indicating that the mission has failed, transmitted from the server 200 in response to the previously transmitted unique identification information of the access point, and fails the received mission. Displays (or outputs) information indicating the status.

If the mission is successful, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to the previously transmitted unique identification information of the access point, and the terminal 100 has successfully completed the received mission. Displays (or outputs) information indicating the status.

In addition, when the mission is a QR code recognition function within an affiliated store, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to include a QR code provided at the affiliated store where the terminal 100 is located. acquires other additional video information, and transmits the acquired additional video information, location information of the terminal 100, identification information of the terminal 100, and the mission information to the server 200.

If the mission fails, the terminal 100 receives information indicating that the mission has failed, transmitted from the server 200 in response to other additional video information previously transmitted, and indicates that the received mission has failed. Displays (or outputs) the information it represents.

If the mission is successful, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to other additional video information transmitted previously, and indicates that the received mission has been successful. Displays (or outputs) the information it represents.

In addition, when the mission is a receipt recognition function related to an affiliated store, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to receive (or has been issued by) the affiliated store where the terminal 100 is located. /provided) Receipt information (including, for example, paper receipts, online/text receipts, etc.) is obtained, and the obtained receipt information, location information of the terminal 100, identification information of the terminal 100, and the mission information etc. are transmitted to the server 200.

If the mission fails, the terminal 100 receives information indicating that the mission has failed, transmitted from the server 200 in response to previously transmitted receipt information, etc., and information indicating that the received mission has failed. Displays (or outputs) .

If the mission is successful, the terminal 100 receives information indicating that the mission has been successful, transmitted from the server 200 in response to previously transmitted receipt information, etc., and information indicating that the received mission has been successful. Displays (or outputs) .

In this way, the terminal 100 receives mission performance result information (or mission performance authentication result) provided from the server 200 according to mission performance, and displays (or outputs) the received mission performance result information. .

In addition, when the terminal 100 successfully performs the mission (or succeeds in the mission), the terminal 100 receives a preset reward from the server 200.

In this way, the terminal 100 recognizes the QR code provided in a specific store visited by the user holding the terminal 100, receives and displays a web page through the recognized QR code, and displays the web page included in the web page. Various functions can be performed through AR NFT content, and if a preset mission is performed and successful, a corresponding reward (or reward) can be provided.

The server 200 communicates with the terminal 100, the plurality of IPFSs 300, the blockchain server 400, etc.

In addition, the server 200 operates an NFT platform (not shown) itself or is linked to an independently operated NFT platform.

In addition, a customer who purchases an NFT corresponding to digital art (or digital content/digital art creation/digital work) provided by the NFT platform uploads the NFT he or she purchased to the server 200 through a preset app. In this case, the server 200 generates AR NFT content related to the uploaded NFT. Here, the AR NFT content is related to any digital art possessed by the owner (or the customer) with ownership, and may be AR content (or MR content/realistic content) created in response to the digital art.

In the embodiment of the present invention, it is mainly explained that the AR NFT content is created in relation to any digital art owned by the owner, but it is not limited to this, and the AR NFT content is in the form of a file owned by the owner ( It may be digital art itself (including, for example, still images, moving images, etc.).

In addition, an affiliated store terminal (or other terminal) (not shown) owned by the owner of the NFT is linked with the server 200, through a dedicated app and/or website provided by the server 200. A user registers as a member to receive NFT registration functions, ownership management functions, etc., and registers personal information, etc. in the server 200. At this time, the personal information includes ID, email address, password (or password), name, gender, date of birth, contact information, address, etc.

Additionally, the affiliated store terminal may register as a user to the server 200 using SNS account information or mobile messenger account information registered by the user of the affiliated store terminal. Here, the SNS account may be information related to Facebook, Twitter, Kakao Story, Naver, PAYCO, etc. In addition, the mobile messenger account contains information related to KakaoTalk, Line, Viber, WeChat, Whatsapp, Telegram, Snapchat, etc. You can.

In addition, when performing the membership registration process, the affiliated store terminal must complete the authentication function through an identity authentication method (including mobile phone, credit card, i-PIN, etc.) to normally complete the membership registration process for the server 200. You can.

In addition, after membership registration is completed, the affiliated store terminal installs a dedicated app (or application/application/specific app) provided by the server 200 in order to use the service provided by the server 200. Install it on At this time, the dedicated app may be an app for performing NFT registration functions, ownership management functions, etc.

Additionally, the affiliated store terminal executes a dedicated app pre-installed on the affiliated store terminal and displays an app execution result screen according to the dedicated app execution. At this time, the app execution result screen includes a registration menu (or button/item) to register information about the NFT you own, a My Gallery menu to provide a list of the NFT you currently own, and a menu to check ownership change information. It includes a menu to manage past holdings, a search menu to search for NFTs held by other users, and a settings menu to set up dedicated app functions. Here, the affiliated store terminal has registered as a member of the server 200 that provides the dedicated app, and logs in when running the dedicated app using the ID and password according to membership registration, a barcode or QR code containing the ID, etc. By performing the procedure, one or more functions of the corresponding dedicated app (including, for example, NFT registration function, ownership management function, etc.) can be performed. At this time, the NFT is used in virtual reality, augmented reality, mixed reality, metaverse, etc. In addition, the metaverse is a compound word of meta, meaning virtual and transcendent, and universe, meaning world and universe, and represents an online space where social and economic activities take place one step further than virtual reality.

In addition, when a preset registration menu is selected on the app execution result screen displayed on the affiliated store terminal, the affiliated store terminal displays a registration screen for registering information about the NFT owned by the user of the affiliated store terminal. Here, the registration screen includes information input items for the NFT to be registered, information input items for proving ownership, confirmation items for registering the entered information on the server 200, etc. In addition, information input items for the NFT, information input items for proving ownership of the NFT, etc. may be managed as metadata at a later date.

In this way, the server 200 manages information related to NFTs owned by any customer.

In addition, when transmitting an NFT owned by the customer to the server 200 through the affiliated store terminal, the server 200 stores the NFT in a specific IPFS (300) randomly selected from among a plurality of IPFS (300). The generated AR NFT content, metadata (including, for example, metadata related to the NFT, metadata related to the AR NFT content, etc.), identification information of the affiliated store terminal, etc. are transmitted. Here, the meta data (or meta information) is related to digital art (or digital work) corresponding to AR NFT content related to the corresponding QR code, and includes the name of the owner of the digital art, documents proving ownership, date of acquisition of ownership, It includes the share ratio based on ownership acquisition, purchase amount, owner information, last sale price, last sale date and time, etc.

In addition, the server 200 provides a hash value (or a hash value corresponding to the NFT/AR NFT content) transmitted from the specific IPFS 300 in response to the transmitted NFT, AR NFT content, etc., and identification of the affiliated store terminal. Receive information, etc.

Additionally, the server 200 generates a QR code related to the received hash value, the NFT, the AR NFT content, etc., and manages the generated QR code. At this time, the QR code includes information about the landing URL, etc.

Additionally, the server 200 transmits the received hash value, the QR code, identification information of the affiliated store terminal, block storage request information, etc. to the blockchain server 400.

In addition, the server 200 receives transaction processing results transmitted from the blockchain server 400 in response to the previously transmitted hash value, etc., and identification information of the affiliated store terminal. Here, the transaction processing result (or blockchain block storage result) includes block hash value (block hash), block number (block number), recipient information (to), transaction hash value (transaction hash), etc.

In addition, the server 200 links with the affiliated store terminal that registers the NFT, and registers mission information related to the store (or affiliated store) that the customer of the affiliated store terminal wishes to promote.

In addition, when the terminal 100 accesses a landing URL managed by the server 200, the server 200 links with the blockchain server 400 to check the hash value corresponding to the landing URL. .

In addition, the server 200, in conjunction with the plurality of IPFSs 300, collects the AR NFT content, the metadata, etc. distributed and stored in one or more IPFSs 300 in relation to the confirmed hash value. Here, the AR NFT content is related to any digital art possessed by the owner with ownership, and may be AR content (or MR content/realistic content) created in response to the digital art.

That is, the server 200, in conjunction with the plurality of IPFSs 300, collects a plurality of sub-files distributed and stored in one or more IPFSs 300 in relation to the confirmed hash value. Here, when the original file is divided into multiple files, the sub-file represents an individual file divided into multiple files.

Additionally, the server 200 combines the collected plurality of sub-files to generate one original file corresponding to the confirmed hash value. Here, the original file includes the AR NFT content, etc.

At this time, if a plurality of sub-files related to the confirmed hash value are not collected through interworking between the server 200 and the plurality of IPFS 300, the server 200 collects the files related to the confirmed hash value. Information indicating that the device does not exist in the IPFS 300 may be transmitted to the terminal 100.

Additionally, the server 200 transmits the web page containing the collected AR NFT content, etc. to the terminal 100. Here, the web page has WebRTC (, WebGL, WebVR, WebAR, etc.) applied, which is a program (or web app) for performing one or more preset functions running in a browser or web view, and the corresponding terminal 100 Information (or control information/control signal) for connecting (or running) a browser or web view installed by default in the terminal (100), information for obtaining a still image or video by driving the camera unit configured in the terminal (100), ) includes information for obtaining location information of the terminal 100 by driving a GPS receiver (not shown) configured in the terminal 100. In addition, the program (or web app) is a program (or It may be a web app) (including, for example, Samsung browser, Chrome browser, Safari browser, Naver built-in browser, WeChat built-in browser, etc.).

In addition, the server 200 determines whether the location information of the terminal 100 is included in one or more preset event areas (or event spaces/locations) based on the received location information of the terminal 100. Judge (or confirm).

If the determination result (or the confirmation result) is that the location information of the terminal 100 is not included in the event area, the server 200 collects the location information of the terminal 100 in real time, The process of determining whether the collected location information of the terminal 100 is included in the one or more event areas is repeatedly performed.

In addition, as a result of the determination (or the confirmation result), if the location information of the terminal 100 is included in the event area (or a specific event area among the one or more event areas), the server 200 Preset mission information corresponding to the event area is confirmed, and the confirmed mission information is transmitted (or provided) to the terminal 100. Here, the mission information includes the location information of the corresponding terminal 100 and the consent function to provide personal information (including, for example, gender, age group, region of residence, etc.), the affiliated store code recognition function, the beacon recognition function within the affiliated store, and the Wi-Fi recognition function within the affiliated store. , QR code recognition function within the affiliated store, receipt recognition function related to the affiliated store, etc.

In addition, when the terminal 100 (or a user possessing the terminal 100) performs a mission function according to the mission information displayed on the terminal 100, the server 200 In conjunction with this, the mission performed by the corresponding terminal 100 (or a user possessing the corresponding terminal 100) is authenticated (or authentication is performed).

Here, if the mission is a function of agreeing to provide location information and personal information (including, for example, gender, age group, region of residence, etc.) of the terminal 100, the server 200 provides the corresponding terminal transmitted from the terminal 100. It receives location information of 100, information on acceptance of consent to provide personal information, location information of the terminal 100, identification information of the terminal 100, and mission information.

In addition, the server 200 determines the location of the terminal 100 based on the received location information of the terminal 100, personal information provision consent acceptance information, location information of the terminal 100, and mission information. Information and personal information related to the relevant mission information is provided (or transmitted) to the affiliated store terminal.

Accordingly, the affiliated store terminal provides a customized promotional function (including, for example, issuance of coupons, etc.) to the user of the terminal 100 based on the location information and personal information of the terminal 100 provided from the server 200. It can be done.

Additionally, the server 200 transmits information indicating that the mission has been successful to the terminal 100.

In addition, when the mission is an affiliated store code recognition function, the server 200 includes additional image information transmitted from the terminal 100, location information of the terminal 100, identification information of the terminal 100, and the mission information. Receive etc.

In addition, the server 200 recognizes (or verifies) the affiliated store code included in the additional video information based on the received additional video information, the location information of the terminal 100, the mission information, etc., and performs the recognition. It is checked whether the received affiliated store code matches the previously set affiliated store code in response to the mission information.

As a result of the confirmation, if the recognized affiliated store code and the preset affiliated store code corresponding to the mission information do not match, the server 200 transmits information indicating that the mission has failed to the terminal 100.

In addition, as a result of the confirmation, if the recognized affiliated store code matches the preset affiliated store code corresponding to the mission information, the server 200 transmits information indicating that the mission has been successful to the terminal 100. .

In addition, when the mission is a beacon recognition function within an affiliated store, the server 200 includes unique identification information of the beacon transmitted from the terminal 100, location information of the terminal 100, identification information of the terminal 100, Receive the above mission information, etc.

In addition, the server 200 is based on the unique identification information of the received beacon, the location information of the terminal 100, the mission information, etc., and the unique identification information of the beacon is set in advance with an affiliated store corresponding to the mission information. Check whether it matches the unique identification information of the specific beacon involved.

As a result of the confirmation, if the unique identification information of the beacon and the unique identification information of the specific beacon related to the preset affiliated store corresponding to the mission information do not match, the server 200 provides information indicating that the mission has failed. Transmitted to terminal 100.

In addition, as a result of the confirmation, if the unique identification information of the beacon and the unique identification information of the specific beacon related to the preset affiliated store corresponding to the mission information match, the server 200 provides information indicating that the mission has been successful. Transmitted to the terminal 100.

In addition, when the mission is a Wi-Fi recognition function within an affiliated store, the server 200 includes unique identification information of the access point transmitted from the terminal 100, location information of the terminal 100, and identification information of the terminal 100. , receives the above mission information, etc.

In addition, the server 200 sets the unique identification information of the access point in advance based on the received unique identification information of the access point, the location information of the terminal 100, the mission information, etc. Check whether it matches the unique identification information of a specific access point related to the affiliated store.

As a result of the confirmation, if the unique identification information of the access point and the unique identification information of a specific access point related to an affiliated store preset in response to the mission information do not match, information indicating that the server 200 has failed the mission. is transmitted to the terminal 100.

In addition, as a result of the confirmation, if the unique identification information of the access point and the unique identification information of the specific access point related to the affiliated store preset in response to the mission information match, the server 200 indicates that the mission has been successful. Information is transmitted to the terminal 100.

In addition, when the mission is a QR code recognition function within an affiliated store, the server 200 may include other additional image information transmitted from the terminal 100, location information of the terminal 100, identification information of the terminal 100, Receive the above mission information, etc.

In addition, the server 200 recognizes (or verifies) the QR code included in the other additional video information based on the received other additional video information, the location information of the terminal 100, the mission information, etc., It is checked whether the recognized QR code matches a preset QR code corresponding to the mission information.

As a result of the confirmation, if the recognized QR code and the preset QR code corresponding to the mission information do not match, the server 200 transmits information indicating that the mission has failed to the terminal 100.

In addition, as a result of the confirmation, if the recognized QR code matches the preset QR code corresponding to the mission information, the server 200 transmits information indicating that the mission has been successful to the terminal 100. .

In addition, when the mission is a receipt recognition function related to an affiliated store, the server 200 includes receipt information transmitted from the terminal 100, location information of the terminal 100, identification information of the terminal 100, and the mission. Receive information, etc.

In addition, the server 200 stores affiliated store information (e.g., affiliated store code, affiliated store name, affiliated store address, (including the affiliated store phone number, etc.) is recognized (or confirmed), and it is checked whether the recognized affiliated store information matches preset affiliated store information corresponding to the mission information.

As a result of the confirmation, if the recognized affiliated store information and the preset affiliated store information corresponding to the mission information do not match, the server 200 transmits information indicating that the mission has failed to the terminal 100.

In addition, as a result of the confirmation, if the recognized affiliated store information and the preset affiliated store information corresponding to the mission information match, the server 200 transmits information indicating that the mission has been successful to the terminal 100. .

Additionally, when the terminal 100 successfully performs the mission (or succeeds in the mission), the server 200 provides a preset reward to the terminal 100. At this time, the server 200 may also provide a reward to the owner (or the owner's account) who actually owns the NFT related to the digital art corresponding to the AR NFT content.

In this way, when the terminal 100 is located in an event area preset based on the location information of the terminal 100 collected in real time through a web page provided to the terminal 100, the server 200 Preset mission information corresponding to the corresponding event area can be provided to the terminal 100, and rewards according to mission performance can be provided to the terminal 100 in conjunction with the terminal 100.

The IPFS (Inter Planetary File System: Distributed File System) 300 communicates with the terminal 100, the server 200, the blockchain server 400, etc. At this time, the IPFS (300) is composed of a plurality, and the plurality of IPFS (300) are configured to interoperate with each other. Here, the IPFS 300 is a protocol for sharing large files or data in a P2P (peer-to-peer) manner such as Napster or Torrent, and is a network for sharing and storing data in a distributed file system.

Additionally, the IPFS 300 uses a content-address to identify each file in a global namespace connecting all computer devices (not shown).

In other words, the IPFS 300 exchanges objects in a Git repository like a BitTorrent Swarm.

In addition, the IPFS (300) uses a distributed hash table, combines a self-certifying namespace and an incentivized block exchange method, and has a single point of failure (SPOF). Therefore, there is no need for trust between nodes.

In addition, the IPFS (300) has a different unique hash value depending on the content of the data, and uses this hash value to find the content (or file/subfile) distributed and stored in the plurality of IPFS (300), and The data can be divided into small pieces, retrieved at high speed, and then combined into one. At this time, the hash table is stored as a pair (key, value), and since many distributed nodes store this information, users can store and retrieve data at a faster rate compared to the HTTP method.

In addition, the specific IPFS 300 selected from the server 200 is the NFT, the AR NFT content, and the metadata (e.g., metadata related to the NFT, the AR NFT content, and (including related metadata, etc.), identification information of the affiliated store terminal, etc.

In addition, the specific IPFS (300) generates a hash value based on the received NFT, the AR NFT content, the metadata, etc.

Additionally, the specific IPFS 300 transmits the generated hash value, identification information of the other terminal, etc. to the server 200.

In addition, the specific IPFS (300) is linked with a plurality of other IPFS (300) (or the remaining IPFS (300) excluding the specific IPFS (300) among the plurality of IPFS (300), such as the NFT and the AR NFT. Distributed storage (or management) of content, metadata, etc.

In addition, the plurality of IPFS (300) is linked with the server (200), and the AR NFT content (or partitioned) distributed and stored in the plurality of IPFS (300) in relation to the hash value requested by the server (200) A plurality of sub-AR NFT contents), the metadata (or a plurality of divided sub-metadata), etc. are provided to the server 200.

In this way, the plurality of IPFS 300 distributes and stores AR NFT content, metadata, etc. provided by the server 200, and distributes the distributedly stored AR NFT content, metadata, etc. at the request of the server 200. It can be provided to the server 200.

The blockchain server 400 communicates with the terminal 100, the server 200, the plurality of IPFSs 300, etc. At this time, the blockchain server 400 may be a server that provides blockchain blocks. Here, the blockchain is a distributed computing environment based on a public blockchain or a private blockchain, and may be open source software that can build applications with smart contracts.

Additionally, the blockchain server 400 receives the hash value, the QR code, identification information of the affiliated store terminal, block storage request information, etc. transmitted from the server 200.

Additionally, the blockchain server 400 stores the received hash value, the QR code, and identification information of the affiliated store terminal in a block. At this time, the blockchain server 400 uses a preset consensus algorithm method (for example, POA (Proof of Authority), POW (Proof of Work: By applying a smart contract (including proof of work, etc.), the received hash value, the QR code, identification information of the affiliated store terminal, etc. may be stored in the block. Here, in the POA, the confirmed management entity generates blocks in order (or registered accounts generate blocks in sequence), so resource consumption and block creation time are reduced compared to the POW. At this time, the blockchain server 400 can be configured as a private network to maintain speed and confidentiality. Additionally, the smart contract is a promise placed on the blockchain that adds code to the transaction to take a specific action when certain conditions are met.

Additionally, the blockchain server 400 transmits transaction processing results, identification information of the affiliated store terminal, etc. to the server 200. Here, the transaction processing result (or blockchain block storage result) includes block hash value, block number, recipient information, transaction hash value, etc.

In addition, when accessing the corresponding landing URL from the terminal 100, the blockchain server 400 links with the server 200 and provides a hash value corresponding to the landing URL to the server 200. .

In this way, when the QR code is scanned on the terminal, AR NFT content is displayed through a web page provided by the landing URL included in the QR code, and a preset mission is performed through the AR NFT content according to user control, You can receive rewards based on mission accomplishment.

Hereinafter, the AR NFT content-based augmented reality method according to the present invention will be described in detail with reference to FIGS. 1 to 4.

Figure 2 is a flowchart showing an augmented reality method based on AR NFT content according to an embodiment of the present invention.

First, the terminal 100 acquires (or photographs) image information including a QR code through a camera unit (not shown) configured in the terminal 100. At this time, the QR code is provided in the form of a sticker, print, or image, and is configured (or attached/formed/printed) on one side of the packaging paper packaging the product, or directly configured (or attached/formed/printed) on one side of the product. It is in a state of being printed, printed (or attached/configured/formed) on a separate printing paper, or in the form of an image file, and includes information about the landing URL (or landing page).

In this way, the QR code can be configured as a landing URL to induce access to the landing URL in order to summon AR NFT content related to the QR code and perform various functions without installing a separate app.

Additionally, the terminal 100 may obtain the image information including the QR code through a dedicated app pre-installed on the terminal 100. Here, the dedicated app includes Naver app and Kakao app that are widely used, and the app may include a scanning function (or QR code recognition/scanning function).

In this way, the acquisition of image information including the QR code can be performed through a camera unit configured in the terminal 100 or through the scan function of a dedicated app pre-installed on the terminal 100.

For example, as shown in FIG. 3, the first terminal 100 acquires first image information 310 including the first QR code in the form of a printed matter configured in a POP holder (S210).

Thereafter, the terminal 100 recognizes (or confirms) the QR code included in the acquired (or captured) image information.

Additionally, the terminal 100 accesses the landing URL included in the recognized (or confirmed) QR code. At this time, when accessing the landing URL from the terminal 100, the terminal 100 sends the identification information of the terminal 100, real-time location information of the terminal 100, etc. to the server 200 that operates the landing URL. ) is provided (or transmitted) to. In addition, in relation to the terminal 100 accessing the landing URL, the server 200 provides identification information of the terminal 100, location information of the terminal 100 (including, for example, GPS location information, etc.), Collect and manage date and time information at the time of connection. Additionally, the identification information of the terminal 100 includes MDN, mobile IP, mobile MAC, SIM (subscriber identification module) card unique information, serial number, etc.

At this time, the terminal 100 displays a guidance window to confirm whether to access the landing URL included in the recognized (or confirmed) QR code.

That is, the terminal 100 displays the information window in the form of a pop-up on the screen (or viewfinder screen) displayed on the terminal 100 in order to check whether to access the landing URL included in the recognized QR code. Display.

In addition, when the preset confirmation menu (or connection menu) displayed on one side of the information window in the terminal 100 is selected, the terminal 100 enters the landing URL included in the recognized (or confirmed) QR code. You can also connect.

As an example, the first terminal recognizes the first QR code included in the obtained first image information.

In addition, the first terminal checks whether to access the first landing URL (for example, https://www.testabcde.co.kr) included in the recognized first QR code. A first guide window is displayed on one side of the viewfinder screen displayed in .

Additionally, when the preset confirmation menu displayed on one side of the first information window is touched, the first terminal accesses the first landing URL.

Additionally, upon accessing the first landing URL, the first terminal transmits identification information of the first terminal, location information of the first terminal, etc. to the server 200 that manages the first landing URL. (S220).

Afterwards, the terminal 100 displays a web page transmitted from the connected landing URL. At this time, the web page includes AR NFT content related to the QR code (or landing URL corresponding to the QR code), and is applied to the viewfinder screen displayed on the terminal 100, augmented reality video (or The AR NFT content is displayed as a mixed reality video.

That is, when the terminal 100 accesses the landing URL, the server 200 links with the blockchain server 400 to check the hash value corresponding to the landing URL.

In addition, the server 200 works in conjunction with a plurality of IPFSs 300 to collect the AR NFT content, the metadata, etc. distributed and stored in one or more IPFSs 300 in relation to the confirmed hash value. Here, the AR NFT content is related to any digital art possessed by the owner with ownership, and may be AR content (or MR content/realistic content) created in response to the digital art.

Additionally, the server 200 transmits the web page containing the collected AR NFT content, etc. to the terminal 100.

Additionally, the terminal 100 receives the web page transmitted from the connected landing URL. Here, the web page has WebRTC, WebGL, WebVR, WebAR, etc., which are programs (or web apps) for performing one or more preset functions running in a browser or web view, applied to the corresponding terminal 100. Information (or control information/control signal) for connecting (or running) a basically installed browser or web view, information for acquiring a still image or video by driving the camera unit configured in the corresponding terminal 100, and the corresponding terminal 100 It includes information for obtaining location information of the corresponding terminal 100 by driving a GPS receiver (not shown) configured in . Additionally, the program (or web app) may be a program (or web app) running on the browser or the web view (including, for example, Samsung browser, Chrome browser, Safari browser, Naver built-in browser, WeChat built-in browser, etc.).

Additionally, the terminal 100 displays the web page including the received AR NFT content.

That is, the terminal 100 applies (or reflects) the viewfinder screen displayed on the corresponding terminal 100 to the web page, and the AR NFT content included in the web page is displayed on the viewfinder screen that is confirmed in real time. Displays the augmented reality image to which is applied.

For example, when the first terminal accesses the first landing URL, the server 200 works in conjunction with the blockchain server 400 to check the first hash value corresponding to the first landing URL.

In addition, the server 200 works in conjunction with the plurality of IPFS 300 to store first IPFS metadata and first AR NFT content distributedly stored in the plurality of IPFS 300 in relation to the confirmed first hash value. Collect etc.

Additionally, the server 200 transmits a first web page including the collected first AR NFT content to the first terminal.

Additionally, the first terminal receives the first web page transmitted from the connected first landing URL.

Additionally, as shown in FIG. 4, the first terminal displays a first web page 410 including the received first AR NFT content (eg, Mcat AR) (S230).

Thereafter, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to acquire a still image or video including the corresponding AR NFT content using resources on the OS of the terminal 100. (or take pictures)

That is, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to open the browser (or viewfinder) as the user of the terminal 100 adjusts the direction of the terminal 100. Obtain a still image or video containing the image (or screen) confirmed through the AR NFT content.

In addition, the terminal 100 may perform an enlargement function, a zoom-out function, a rotation function, etc. for the corresponding AR NFT content according to the user touch (or user input/selection/control) of the terminal 100. Here, the zoom-in or zoom-out function for the AR NFT content may be performed according to the user's touch gestures, including “pinch” and the like.

Additionally, the terminal 100 may link with the server 200 and a social media server (not shown) to upload the obtained still image or video to a social media account related to the terminal 100.

In addition, the terminal 100 is linked with the server 200, and the acquired still image or video is stored in another terminal (not shown) owned by family members, friends, coworkers, etc. related to the user of the terminal 100. You can share (or provide/transmit) with.

As an example, the first terminal moves the location of the first AR NFT content based on WebRTC camera control on the first web page 410, and then the user of the first terminal and the first AR NFT Second image information including content is acquired (S240).

In addition, an event area (or event space) in which the location information of the terminal 100 is preset based on the location information of the terminal 100 provided to the server 200 upon connection to the landing URL from the terminal 100 /location), the terminal 100 displays the mission information provided from the server 200 on one side of the corresponding web page where the AR NFT content is displayed. At this time, the terminal 100 displays an icon (or object) indicating the presence of mission information on one side of the web page where the AR NFT content is displayed, and when the icon is selected, the entire screen of the web page , the mission information may be displayed on some screens, pop-up screens, etc. Here, the mission information includes the location information of the corresponding terminal 100 and the consent function to provide personal information (including, for example, gender, age group, region of residence, etc.), the affiliated store code recognition function, the beacon recognition function within the affiliated store, and the Wi-Fi recognition function within the affiliated store. , QR code recognition function within the affiliated store, receipt recognition function related to the affiliated store, etc.

As an example, when the location information of the first terminal is within a third location area related to a preset third affiliated store, the first terminal receives third mission information transmitted from the server 200, and the received The third mission information is displayed on one side of the first web page where the first AR NFT content is displayed. Here, the third mission information may be a third QR code recognition function provided in the third affiliated store (S250).

Thereafter, when the terminal 100 (or a user possessing the terminal 100) performs a mission function according to the mission information displayed on the terminal 100, the terminal 100 is connected to the server 200. In conjunction with , the mission performed by the corresponding terminal 100 (or a user possessing the corresponding terminal 100) is authenticated (or authentication is performed).

Here, if the mission is a function of agreeing to the provision of location information and personal information (including, for example, gender, age group, region of residence, etc.) of the terminal 100, the terminal 100 operates according to the user selection of the terminal 100. The location information of the relevant terminal 100, information on acceptance of consent to provide personal information, location information of the terminal 100, identification information of the relevant terminal 100, and the mission information are transmitted to the server 200.

In addition, the server 200 includes location information of the terminal 100 transmitted from the terminal 100, consent acceptance information to provide personal information, location information of the terminal 100, identification information of the terminal 100, Receive the above mission information, etc.

In addition, the server 200 determines the location of the terminal 100 based on the received location information of the terminal 100, personal information provision consent acceptance information, location information of the terminal 100, and mission information. Information and personal information are provided (or transmitted) to affiliated store terminals related to the relevant mission information.

Accordingly, the affiliated store terminal provides a customized promotional function (including, for example, issuance of coupons, etc.) to the user of the terminal 100 based on the location information and personal information of the terminal 100 provided from the server 200. It can be done.

Additionally, the server 200 transmits information indicating that the mission has been successful to the terminal 100.

In addition, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to the previously transmitted location information of the terminal 100 and personal information provision consent acceptance information, and the Displays (or outputs) information indicating that the received mission has been successful.

In addition, when the mission is an affiliated store code recognition function, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to add an additional message containing an affiliated store code provided at the affiliated store where the terminal 100 is located. Image information is acquired, and the acquired additional image information, location information of the terminal 100, identification information of the terminal 100, mission information, etc. are transmitted to the server 200.

Additionally, the server 200 receives additional video information transmitted from the terminal 100, location information of the terminal 100, identification information of the terminal 100, and the mission information.

In addition, the server 200 recognizes (or verifies) the affiliated store code included in the additional video information based on the received additional video information, the location information of the terminal 100, the mission information, etc., and performs the recognition. It is checked whether the received affiliated store code matches the previously set affiliated store code in response to the mission information.

As a result of the confirmation, if the recognized affiliated store code and the preset affiliated store code corresponding to the mission information do not match, the server 200 transmits information indicating that the mission has failed to the terminal 100.

In addition, the terminal 100 receives information indicating that the corresponding mission transmitted from the server 200 has failed in response to previously transmitted additional video information, etc., and displays information indicating that the received mission has failed. (or print).

In addition, as a result of the confirmation, if the recognized affiliated store code matches the preset affiliated store code corresponding to the mission information, the server 200 transmits information indicating that the mission has been successful to the terminal 100. .

In addition, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to previously transmitted additional video information, etc., and displays information indicating that the received mission has been successful. (or print).

In addition, when the mission is a beacon recognition function within an affiliated store, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to place (or configure) one side of the affiliated store where the terminal 100 is located. / formed) perform a wireless communication connection with a beacon (not shown) to obtain unique identification information of the beacon, unique identification information of the obtained beacon, location information of the terminal 100, and information of the terminal 100. Identification information, mission information, etc. are transmitted to the server 200.

Additionally, the server 200 receives unique identification information of the beacon transmitted from the terminal 100, location information of the terminal 100, identification information of the terminal 100, and the mission information.

In addition, the server 200 is based on the unique identification information of the received beacon, the location information of the terminal 100, the mission information, etc., and the unique identification information of the beacon is set in advance with an affiliated store corresponding to the mission information. Check whether it matches the unique identification information of the specific beacon involved.

As a result of the confirmation, if the unique identification information of the beacon and the unique identification information of the specific beacon related to the preset affiliated store corresponding to the mission information do not match, the server 200 provides information indicating that the mission has failed. Transmitted to terminal 100.

In addition, the terminal 100 receives information indicating that the mission has failed, which is transmitted from the server 200 in response to the unique identification information of the previously transmitted beacon, and information indicating that the received mission has failed. Displays (or outputs) .

In addition, as a result of the confirmation, if the unique identification information of the beacon and the unique identification information of the specific beacon related to the preset affiliated store corresponding to the mission information match, the server 200 provides information indicating that the mission has been successful. Transmitted to the terminal 100.

In addition, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to the unique identification information of the previously transmitted beacon, and information indicating that the received mission has been successful. Displays (or outputs) .

In addition, when the mission is a Wi-Fi recognition function within an affiliated store, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page, / formed) perform a wireless communication connection with an access point (Access Point) to obtain unique identification information of the access point, unique identification information of the obtained access point, location information of the terminal 100, and the terminal ( 100)'s identification information, the mission information, etc. are transmitted to the server 200.

Additionally, the server 200 receives unique identification information of the access point, location information of the terminal 100, identification information of the terminal 100, and mission information transmitted from the terminal 100.

In addition, the server 200 sets the unique identification information of the access point in advance based on the received unique identification information of the access point, the location information of the terminal 100, the mission information, etc. Check whether it matches the unique identification information of a specific access point related to the affiliated store.

As a result of the confirmation, if the unique identification information of the access point and the unique identification information of a specific access point related to an affiliated store preset in response to the mission information do not match, information indicating that the server 200 has failed the mission. is transmitted to the terminal 100.

In addition, the terminal 100 receives information indicating that the mission has failed, transmitted from the server 200 in response to the previously transmitted unique identification information of the access point, and indicates that the received mission has failed. Display (or output) information.

In addition, as a result of the confirmation, if the unique identification information of the access point and the unique identification information of the specific access point related to the affiliated store preset in response to the mission information match, the server 200 indicates that the mission has been successful. Information is transmitted to the terminal 100.

In addition, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to the previously transmitted unique identification information of the access point, and indicates that the received mission has been successful. Display (or output) information.

In addition, when the mission is a QR code recognition function within an affiliated store, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to include a QR code provided at the affiliated store where the terminal 100 is located. acquires other additional video information, and transmits the acquired additional video information, location information of the terminal 100, identification information of the terminal 100, and the mission information to the server 200.

Additionally, the server 200 receives other additional video information transmitted from the terminal 100, location information of the terminal 100, identification information of the terminal 100, and the mission information.

In addition, the server 200 recognizes (or verifies) the QR code included in the other additional video information based on the received other additional video information, the location information of the terminal 100, the mission information, etc., It is checked whether the recognized QR code matches a preset QR code corresponding to the mission information.

As a result of the confirmation, if the recognized QR code and the preset QR code corresponding to the mission information do not match, the server 200 transmits information indicating that the mission has failed to the terminal 100.

In addition, the terminal 100 receives information indicating that the mission has failed, transmitted from the server 200 in response to other additional video information transmitted previously, and receives information indicating that the received mission has failed. Display (or output).

In addition, as a result of the confirmation, if the recognized QR code matches the preset QR code corresponding to the mission information, the server 200 transmits information indicating that the mission has been successful to the terminal 100. .

In addition, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to other additional video information transmitted previously, and receives information indicating that the received mission has been successful. Display (or output).

In addition, when the mission is a receipt recognition function related to an affiliated store, the terminal 100 uses at least one of WebRTC, WebGL, and WebVR on the web page to receive (or has been issued by) the affiliated store where the terminal 100 is located. /provided) Receipt information (including, for example, paper receipts, online/text receipts, etc.) is obtained, and the obtained receipt information, location information of the terminal 100, identification information of the terminal 100, and the mission information etc. are transmitted to the server 200.

Additionally, the server 200 receives receipt information transmitted from the terminal 100, location information of the terminal 100, identification information of the terminal 100, and the mission information.

In addition, the server 200 stores affiliated store information (e.g., affiliated store code, affiliated store name, affiliated store address, (including the affiliated store phone number, etc.) is recognized (or confirmed), and it is checked whether the recognized affiliated store information matches preset affiliated store information corresponding to the mission information.

As a result of the confirmation, if the recognized affiliated store information and the preset affiliated store information corresponding to the mission information do not match, the server 200 transmits information indicating that the mission has failed to the terminal 100.

In addition, the terminal 100 receives information indicating that the mission has failed, transmitted from the server 200 in response to previously transmitted receipt information, etc., and displays information indicating that the received mission has failed ( or output).

In addition, as a result of the confirmation, if the recognized affiliated store information and the preset affiliated store information corresponding to the mission information match, the server 200 transmits information indicating that the mission has been successful to the terminal 100. .

In addition, the terminal 100 receives information indicating that the mission has been successfully transmitted from the server 200 in response to previously transmitted receipt information, etc., and displays information indicating that the received mission has been successful ( or output).

In this way, the terminal 100 receives mission performance result information (or mission performance authentication result) provided from the server 200 according to mission performance, and displays (or outputs) the received mission performance result information. .

In addition, when the terminal 100 successfully performs the mission (or succeeds in the mission), the terminal 100 receives a preset reward from the server 200. At this time, the server 200 may also provide a reward to the owner (or the owner's account) who actually owns the NFT related to the digital art corresponding to the AR NFT content.

As an example, the first terminal uses WebRTC on the first web page to acquire third image information including a third QR code provided at the counter of the third affiliated store where the first terminal is located, and the acquisition The third image information, identification information of the first terminal, and third mission information are transmitted to the server 200.

Additionally, the server 200 receives the third image information, identification information of the first terminal, and third mission information transmitted from the first terminal.

Additionally, the server 200 recognizes the received third image information, the third mission information, etc. by the third QR code included in the third image information.

In addition, the server 200 uses a preset reference QR code (or information included in the reference QR code) corresponding to the recognized third QR code (or information included in the third QR code) and the third mission information. Check whether the information) matches.

As a result of the confirmation, when the recognized third QR code matches the reference QR code preset corresponding to the third mission information, the server 200 succeeds in the third mission corresponding to the third mission information. Information indicating that the third mission is successful, third reward information (including, for example, a 5% discount coupon, etc.) according to the success of the third mission, etc. are transmitted to the first terminal.

In addition, in response to the previously transmitted third image information, etc., the first terminal provides information indicating that the third mission corresponding to the third mission information transmitted from the server 200 has been succeeded, and the third mission is successful. receiving third reward information (including, for example, a 5% discount coupon, etc.), information indicating that the third mission corresponding to the received third mission information has been succeeded, and third reward information according to the success of the third mission. 3 Reward information (including, for example, a 5% discount coupon, etc.) is displayed (S260).

As described above, an embodiment of the present invention displays AR NFT content through a web page provided by a landing URL included in the QR code when scanning a QR code on the terminal, and AR NFT content according to user control. By performing pre-set missions and receiving rewards based on mission performance, users are encouraged to engage, and by using it in the company's promotional marketing, the utility of AR NFT content is increased, increasing the value of possession through the various uses of NFT. It can be raised.

The above-described content can be modified and modified by anyone skilled in the art without departing from the essential characteristics of the present invention. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but are for illustrative purposes, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope should be construed as being included in the scope of rights of the present invention.

10: AR NFT content-based augmented reality system
100: terminal 200: server
300: Multiple IPFS 400: Blockchain server

Claims (8)

Obtaining image information including a QR code by a terminal through a camera unit configured in the terminal;
Recognizing, by the terminal, a QR code included in the acquired image information;
Accessing, by the terminal, a landing URL included in the recognized QR code; and
AR NFT content-based augmented reality method including the step of displaying a web page transmitted from the connected landing URL by the terminal. According to claim 1,
The above web page is,
An augmented reality method based on AR NFT content, which includes AR NFT content related to the QR code and is applied to a viewfinder screen displayed on the terminal to display the AR NFT content as an augmented reality image. According to claim 1,
The above web page is,
A program is applied to perform one or more preset functions running in a browser or web view, information for connecting a browser or web view installed in the terminal, and information for acquiring still images or moving images by driving the camera unit configured in the terminal. An AR NFT content-based augmented reality method comprising at least one of information and information for obtaining location information of the terminal by driving a GPS receiver configured in the terminal. According to claim 1,
The step of displaying the web page is,
When accessing the landing URL from the terminal, a server managing the landing URL links with a blockchain server to check a hash value corresponding to the landing URL;
A process of collecting the AR NFT content distributed and stored in one or more IPFS in relation to the confirmed hash value by the server in conjunction with a plurality of IPFS;
A process of transmitting, by the server, the web page containing the collected AR NFT content to the terminal; and
An augmented reality method based on AR NFT content, comprising a process of displaying the web page transmitted from the connected landing URL by the terminal. According to claim 1,
An augmented reality method based on AR NFT content, further comprising the step of obtaining a still image or video including the AR NFT content using at least one of WebRTC, WebGL, and WebVR on the web page. According to claim 1,
When the location information of the terminal is included in a preset event area based on the location information of the terminal provided to the server according to the landing URL access from the terminal, the mission information provided from the server is AR NFT displaying content on one side of the web page where it is being displayed;
When the terminal performs a mission function according to mission information displayed on the terminal, authenticating, by the terminal, in conjunction with the server, the mission performance performed by the terminal;
Displaying, by the terminal, mission performance result information provided from the server according to mission performance; and
An augmented reality method based on AR NFT content, further comprising receiving a preset reward from the server by the terminal when the mission is normally performed in the terminal. According to claim 6,
The above mission information is,
Characterized by including at least one of the location information and personal information provision consent function of the terminal, an affiliated store code recognition function, a beacon recognition function within the affiliated store, a Wi-Fi recognition function within the affiliated store, a QR code recognition function within the affiliated store, and a receipt recognition function related to the affiliated store. AR NFT content-based augmented reality method. Obtain image information including a QR code through a camera unit configured in the terminal, recognize the QR code included in the acquired image information, access the landing URL included in the recognized QR code, and access the connected landing URL. The terminal displays a web page transmitted from; and
An AR NFT content-based augmented reality system including a server that transmits the web page to the terminal accessing the landing URL.

Images