KR102388442B1 - Apparatus for Augmented Reality-based Metaverse Service and Driving Method Thereof - Google Patents

Abstract

The present invention relates to an augmented reality-based metabus service device and a driving method of the device. The augmented reality-based metaverse service device according to an embodiment of the present invention may include: a communication interface unit that provides an augmented reality (AR) screen when a user terminal device located in an arbitrary place requests a service, and provides promotional information for entering a metaverse space at a designated location on the AR screen; and a control unit for registering address information and publicity information for entry into the metaverse space by giving a buyer of a purchaser terminal device the right to use the designated location, and making a guidance to the metaverse space linked to (pre-)selected publicity information on the basis of (pre-)registered address information, when promotional information on the user terminal device is selected.

Description

Apparatus for Augmented Reality-based Metaverse Service and Driving Method Thereof

The present invention relates to an augmented reality-based metaverse service apparatus and a method of driving the apparatus, and more particularly, to allow entry into the metaverse space through an icon displayed on an augmented reality screen, and to be used as an icon. It relates to an augmented reality-based metaverse service device capable of viewing augmented reality content (eg, ARshow), and to shoot and share augmented reality content with friends in the background, and a method of driving the device.

Augmented Reality (AR) is a technology that superimposes virtual objects on the real world that users see with their eyes. It is also called Mixed Reality (MR) because the real world and the virtual world with additional information are combined in real time and displayed as a single image. Augmented reality, a concept that complements the real world with a virtual world, uses a virtual environment created with computer graphics, but the main character is the real environment. Computer graphics serve to provide additional information necessary for the real environment. This means that the distinction between the real environment and the virtual screen is blurred by overlapping the 3D virtual image on the actual image the user is viewing.

Virtual reality technology immerses the user in the virtual environment, making it impossible to see the real environment. However, augmented reality technology, in which the real environment and virtual objects are mixed, allows the user to see the real environment, providing better realism and additional information. For example, if you illuminate the surroundings with a smartphone camera, information such as the location and phone number of a nearby store is displayed in a stereoscopic image.

marked

There is a demand for a method that can maximize the advertising effect using such augmented reality technology, and as non-face-to-face services have recently been in the spotlight, various businesses using it are urgently required.

Korean Patent Publication No. 10-1282292 (2013.06.28) Korean Patent Publication No. 10-2020-0033064 (2020.03.27) Korean Patent Publication No. 10-2020-0076446 (2020.06.29)

An embodiment of the present invention allows, for example, to enter the metaverse space through an icon displayed on the augmented reality screen, to view augmented reality content used as an icon, and to shoot with friends in the background of the augmented reality content, An object of the present invention is to provide an augmented reality-based metaverse service device for sharing and a method of driving the device.

The augmented reality-based metaverse service apparatus according to an embodiment of the present invention provides an augmented reality (AR) screen upon a service request from a user terminal device located at an arbitrary location, and a metaverse space at a specified location on the augmented reality screen. A communication interface unit that provides publicity information for admission to the user terminal, and the purchaser of the terminal device grants the right to use the designated location to the purchaser to register the address information and the promotional information for entering the metaverse space, the user terminal and a controller for guiding to a metaverse space linked to the selected promotional information based on the registered address information when the promotional information on the device is selected.

The control unit, when there is a request for registration to be given the right to use the designated location on the augmented reality screen from the purchaser terminal device, control to display on the screen by distinguishing the color of the designated location that can be registered and the pre-registered designated location can do.

The control unit may check whether payment is made for each period with respect to the registered address information, and expose promotional information for entering the metaverse screen on the augmented reality screen when it is within an effective period.

When the end of the payment period for the registered address information is imminent, the control unit may give priority to the previously registered purchaser and notify the extension registration.

The control unit, when the purchaser who has been given the right to use the specified location on the augmented reality screen transfers the specified position to another purchaser, provides promotional information for entering the metaverse space of the other purchaser to the augmented reality screen can be exposed on the

The controller may expose augmented reality show content implemented in the form of an icon or a video registered by the purchaser as the promotional information.

The controller may display a camera button on the screen so that when the augmented reality show content is exposed, a photo can be taken with the augmented reality show content as a background.

In addition, in the method of driving the augmented reality-based metaverse service apparatus according to an embodiment of the present invention, the communication interface unit provides an augmented reality (AR) screen when a service is requested from a user terminal device located at an arbitrary place, and the augmented reality (AR) screen is provided. providing publicity information for entering the metaverse space at a designated location on a real screen; and registering the promotional information, and guiding to a metaverse space linked to the selected promotional information based on the registered address information when the promotional information on the user terminal device is selected.

According to an embodiment of the present invention, users who consume content may experience various content non-face-to-face through link information (or publicity information) linked to a specific region or place, for example, AR advertisement information.

In addition, according to an embodiment of the present invention, from the point of view of an operator who operates a service, it is possible to easily generate profits even in a non-face-to-face situation.

Furthermore, an embodiment of the present invention can provide a service of a new concept by using the virtual space provided by the social platform as a concept of ownership and allowing it to be transacted.

1 is a diagram illustrating an AR-based metaverse service system according to an embodiment of the present invention;
2 and 3 are diagrams for explaining a shooting operation made in the background of augmented reality content (ARshow);
4 to 6 are diagrams for explaining a process for the purchaser of the purchaser terminal device of FIG. 1 to be assigned an arbitrary location on the augmented reality screen;
7 is a view for explaining a method of giving a unique identifier (address) on the augmented reality screen;
8 is a block diagram illustrating a detailed structure of the AR-based metaverse service device of FIG. 1;
9 is a flowchart showing a driving process of the AR-based metaverse service device of FIG. 1;
10 to 13 are diagrams for explaining a metaverse space template provided by the AR-based metaverse service apparatus of FIG. 1 .

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

1 is a diagram illustrating an AR-based metaverse service system according to an embodiment of the present invention, FIGS. 2 and 3 are diagrams for explaining a photographing operation made in the background of augmented reality content, and FIGS. 4 to 6 are FIG. 1 A diagram for explaining a process for a purchaser of a terminal device to be assigned an arbitrary location on an augmented reality screen, and FIG. 7 is a view for explaining a method of giving a unique identifier (address) on the augmented reality screen.

As shown in FIG. 1 , the AR-based metaverse service system 90 according to the embodiment of the present invention includes a user terminal device 100 , a purchaser terminal device 110 , a communication network 120 , and an AR-based metaverse service device. 130 and some or all of the third-party device 140 .

Here, “including some or all” means that some components such as the third-party device 140 are omitted to configure the AR-based metaverse service system 90 or configure the AR-based metaverse service device 130 . It means that some or all of the components can be configured by being integrated into a network device (eg, a wireless switching device, etc.) constituting the communication network 120, and includes all of them to help a sufficient understanding of the invention Explain.

The user terminal device 100 uses the AR service and the metaverse service provided by the AR-based metaverse service device 130 via the communication network 120 of FIG. 1 . For example, the user terminal device 100 executes an application (hereinafter referred to as an app) for using a service according to an embodiment of the present invention, such as a smartphone, and then projects the camera to the surrounding area in the form of augmented reality (AR). Link information for promoting one's own virtual space, for example, advertisement information, etc. is displayed on When selecting advertisement information or link information, it is possible to move to a virtual space linked to the advertisement information or link information. Here, the virtual space may be a metaverse space.

Of course, in the embodiment of the present invention, even if it is not in this form of illuminating the surroundings with a camera at a specific place, even when entering a search keyword for a specific area into the search box on a smartphone, desktop computer, laptop computer, tablet PC, smartphone, etc. Company information or advertisement information can be searched in a manner similar to the above. For example, an advertisement of a company included in a specific area (e.g., within a 200m radius from where the user terminal device is located) and company information or advertisement information in an area outside the radius (R) can be separated and displayed on the screen. There will be. Here, company information or advertisement information may be referred to as publicity information or an icon in an embodiment of the present invention.

It is assumed that the user of the user terminal device 100 executes an app in a specific area (eg, Gangnam Station Exit 1) and then illuminates the surrounding area with a camera. In this case, promotional information such as advertisement information set by the user of the purchaser terminal device 110 within a radius of 200 m based on the user's location is displayed in augmented reality on the screen. Here, the promotional information displayed in augmented reality may be shown on the screen at intervals of 20m in the case of pre-registered information to which the right to use is granted. Of course, since this interval can be automatically adjusted for good visibility depending on the screen size (eg, 7 inches, 10 inches, etc.) of a smartphone, etc., it will not be particularly limited to any one form in the embodiment of the present invention. . If the normal augmented reality is to display restaurant information related to the region in augmented reality on the screen in this step, in the embodiment of the present invention, promotional information such as advertisement information for guiding to a virtual space in a non-face-to-face manner; Alternatively, link information is displayed on the screen.

The advertisement information displayed on the screen of the user terminal device 100 may be displayed in the form of an icon, but as shown in FIGS. 2 and 3 , the augmented reality contents 200 are implemented in the form of a moving picture, so that the AR show ( ARshow). In this way, when implemented in the form of an AR show, as shown in FIG. 3, the user places a friend in a specific area, takes a picture with the corresponding augmented reality screen as the background, and shares the photographed picture on SNS. action can be performed. Of course, when the user terminal device 100 performs an augmented reality operation, a camera button (or a photographing button) 210 for camera photographing may be displayed on the screen together as shown in FIG. 2 on the screen, and also the photographed picture A share button 310 for sharing via SNS may be displayed. Since the SNS sharing may be made through a separate process after storing the photo in the memory, the embodiment of the present invention will not be limited to any one form.

2 (a) to (c) shows that the augmented reality content playback starts, the more button is pressed to automatically switch to the camera button 210, and then automatically switches to the previous button again. An icon may be displayed on the augmented reality screen as in (a) of FIG. 2 , and when the augmented reality content reproduction starts, the augmented reality content 200 may be reproduced and appear at the location where the augmented reality content 200 is registered. . Accordingly, for example, after having a friend stand in the corresponding position, it is possible to take a picture against the background of the augmented reality screen. As shown in (a) of FIG. 3 , an authentication shot of a friend may be created by taking a photo. In addition, after shooting, various operations such as saving ( 300 ), sharing ( 310 ), and deleting ( 320 ) may be performed in an album disposed at the bottom of the screen.

The purchaser terminal device 110 includes various devices such as a PC-based desktop computer, a laptop computer, a mobile-based tablet PC, a smart phone, and a wearable device worn on the wrist. The purchaser terminal device 110 connects to the AR-based metaverse service device 130 and advertises its virtual space, for example, the metaverse space, in a specific area, for example, a central commercial zone, or a station area based on AR or keywords. carry out Of course, the purchaser terminal device 110 can register its own metaverse space, which has been made in advance, in the form of a domain address. can provide For example, by selecting one of various types of templates provided by the AR-based metaverse service device 130 , metaverse content may be created and edited according to its request. For the template, an operation for creating a homepage of an individual or a company may be representative, and in addition, an operation for creating and editing a gallery such as an exhibition of works may be performed.

The purchaser terminal device 110 uses the template itself, of course, although it is not specifically limited thereto, it can further set various additional information in order to promote its virtual space in the service according to the embodiment of the present invention. . For example, although the actual virtual space (eg, the address of the service server) is located in the province, when AR-based publicity is selected by selecting Gangnam Station in Seoul, the user selects Gangnam Station and registers his/her virtual space. In other words, it is given permission to use the location. The purchaser terminal device 110 may set up a pincette publicity method that allows promotion of its own virtual space to be performed only in a designated place such as Gangnam Station, and a floating publicity method that is not fixed to a specific area or place. there is. The floating publicity method may be a method in which the AR-based metaverse service device 130 analyzes the characteristics of a specific place and automatically sets the promotion to be performed at a specific location randomly according to a preset rule or service policy based on the analysis result. there is. According to the market principle, buyers recognize a location that is judged to be a good commercial area offline, and select the location online to promote it.

Furthermore, the purchaser's terminal device 110 may be freely transferable in the case of a virtual space produced by the purchaser, or a location allocated to it or a part thereof. For example, the purchaser terminal device 110 transfers to a point (eg, a 20m point) in a specific area that is assigned to promote its own virtual space in the AR-based metaverse service device 130 , that is, given the right to use it. In the case of request, the transaction information may be displayed on the main screen when the service is accessed through the purchaser terminal device 110 . In an embodiment of the present invention, it is preferable to trade a virtual space, but it will not be particularly limited thereto.

The purchaser terminal device 110 accesses the AR-based metaverse service device 130 and performs a registration procedure to promote its virtual space in a specific area. 4 to 6 show this. When the purchaser terminal device 110 requests registration, as shown in FIG. 4 , on the screen, a mark is displayed so that publicity can be performed every 20 m in a specific area. On the screen, a blue dot indicates that promotion is possible at the location, and a red dot indicates that promotion is not available at that location. In other words, it shows that other buyers are already promoting the location.

The purchaser of the purchaser terminal device 110 proceeds with payment to promote his/her virtual space, for example, at the location 000aa008 in FIG. 4 . Payment can be made on an annual basis. For example, select one of 1 year, 2 year, 3 year, and 5 year and request registration. In addition, the purchaser terminal device 110 selects among 1 year, 2 years, 3 years, and 5 year units for each registration period when registering the location selected by the purchaser, pays the corresponding payment amount, and creates a desired metaverse space within the validity period You are given access to an online web client that can create, edit, upload, and delete various contents. In some cases, the operator may set the operation policy so that the user can register the location for free.

The communication network 120 includes both wired and wireless communication networks. For example, a wired/wireless Internet network may be used or interlocked as the communication network 120 . Here, the wired network includes an Internet network such as a cable network or a public telephone network (PSTN), and the wireless communication network includes CDMA, WCDMA, GSM, Evolved Packet Core (EPC), Long Term Evolution (LTE), Wibro network, etc. is meant to include Of course, the communication network 120 according to the embodiment of the present invention is not limited thereto, and may be used, for example, in a cloud computing network under a cloud computing environment, a 5G network, and the like. For example, when the communication network 120 is a wired communication network, the access point in the communication network 120 can connect to a switching center of a telephone company, etc., but in the case of a wireless communication network, it accesses the SGSN or GGSN (Gateway GPRS Support Node) operated by the communication company to transmit data. Data can be processed by accessing various repeaters such as a BTS (Base Transsive Station), NodeB, and e-NodeB.

The communication network 120 may include an access point. Here, the access point includes a small base station, such as a femto or pico base station, which is often installed in a building. Femto or pico base stations are classified according to the maximum number of connection to the user terminal device 100 or the purchaser terminal device 110, etc., in terms of the classification of a small base station. Of course, the access point may include a short-distance communication module for performing short-distance communication such as Zigbee and Wi-Fi with the user terminal device 100 or the purchaser terminal device 110 . The access point may use TCP/IP or Real-Time Streaming Protocol (RTSP) for wireless communication. Here, short-distance communication may be performed in various standards such as Bluetooth, Zigbee, infrared, radio frequency (RF) such as ultra high frequency (UHF) and very high frequency (VHF), and ultra-wideband communication (UWB) in addition to Wi-Fi. Accordingly, the access point extracts the location of the data packet, designates the best communication path for the extracted location, and forwards the data packet to the next device, for example, the AR-based metaverse service device 130 along the designated communication path. there is. The access point may share several lines in a general network environment, and includes, for example, a router, a repeater, and a repeater.

AR-based metaverse service device 130 allows users to create a 3D virtual metaverse space at a specific point on an app screen that implements the real world in augmented reality. Choose to register online. For example, in the case of a distance of 1m in the south direction from Exit 1 of Gangnam Station, an icon is created at the corresponding point on the augmented reality screen to promote publicity. 7 shows that a unique identifier (address) can be assigned to a location based on latitude and longitude by maintaining a distance of 20 m between each other. Accordingly, for example, the purchaser of the purchaser terminal device 110 of FIG. 1 performs a process for registering the virtual space built by him/herself in a specific area or in a specific zone or branch of the area online. Accordingly, when the user of the user terminal device 100 visits a specific area and executes the app, an icon for entering the virtual space registered by the purchaser, that is, the metaverse space, is displayed on the augmented reality screen. Of course, such an icon can also be augmented reality content in the form of a video.

For example, the AR-based metaverse service device 130 divides map data of a region such as Gangnam Station in a grid form or in a triangular form as in FIG. Allows the bus space to be registered. The location can be managed in the form of latitude and longitude information or GPS information. For example, when the user arrives at Exit 1 of Gangnam Station and executes the app according to the embodiment of the present invention, the AR-based metaverse service device 130 is based on the location of the user terminal device 100 . While displaying an augmented reality screen in a radius of 200 m, an icon registered by buyers is displayed every 20 m. An icon in the form of a promotional text and augmented reality content in the form of a video may be displayed together on one screen. This is at the discretion of the Buyer.

In addition, when the user of the user terminal device 100 selects a specific icon on the augmented reality screen, in order to enter the virtual space of the metaverse registered by the purchaser, the AR-based metaverse service device 130 provides a unique domain address, etc. Register the identifier in the corresponding location. That is, it can be viewed as a link. Accordingly, when a metaverse screen is realized by being connected to the buyer's web server through the corresponding domain address, or a metaverse space is created using a template provided by the AR-based metaverse service device 130, the AR-based metaverse service By accessing the device 130, a metaverse screen built by the purchaser may be implemented. This metaverse space can be the homepage of an individual or company, or it can be a blog built by a fan club of a famous singer.

In the AR-based metaverse service device 130, the purchaser of the purchaser terminal device 110 selects a specific point and registers his/her metaverse space so that the previously registered user can preferentially extend registration at any time before the expiration of the validity period. and provides an alarm about the extension registration before it ends. In addition, if extension registration is not completed by the end of the validity period, the location is automatically switched so that other users can register the location. guide you Of course, the color conversion has been exemplified, but it is possible to inform buyers that registration is possible in various forms, such as guiding through text.

In addition, the AR-based metaverse service device 130 can be transferred at any time if an agreement is reached with another purchaser at a price desired by the purchaser within the validity period. In other words, it is possible to generate profits by taking a good position on the augmented reality screen and transferring it to another buyer. The AR-based metaverse service device 130 may change previously provided information under the management of an administrator when there is a transfer.

In addition, the AR-based metaverse service device 130 allows general users to view augmented reality content uploaded to the metaverse unique identifier location registered by the purchaser online through a mobile app, and A camera function button at the bottom is temporarily automatically created, allowing you to shoot augmented reality content on the fly. A camera function button is automatically created so that you can choose to take a photo or video when shooting, and a button is formed on the screen so that you can take an authentication shot with a friend against the background of augmented reality content. Furthermore, it is also possible to save or delete the captured thumbnail in the album, and to share it through SNS such as Instagram, Facebook, and TikTok. When the augmented reality content playback is finished, the general user may press the play button to play the augmented reality content again, and when the exit button is pressed, the camera function button disappears from the bottom of the user terminal device 100 and is converted to the original button of the app make it possible

The third-party device 140 includes a manager device such as a computer and a server that manages the service of the AR-based metaverse service device 130 . In addition, the third-party device 140 may include a computer or server of a developer that develops and provides a service program provided by the AR-based metaverse service device 130 . For example, the manager device can access the AR-based metaverse service device 130 with the manager menu address information to register announcements to notify users or buyers, and perform various operations to provide services smoothly. can do.

In summary, an embodiment of the present invention is a space where users can create a 3D virtual (VR) metaverse world by designating a location on an app screen that implements the real world in augmented reality (AR). The type can be used in almost all fields related to daily life and business, and users who are active on the platform to acquire various treasures are naturally exposed and users can enjoy the publicity effect that they visit. Therefore, if it is opened in a location where as many users as possible, it will have a better publicity effect. It is fixed as a latitude and longitude position on the earth, and it is distinguished and displayed in the form of a unique identifier address. Created as a 3D virtual metaverse based on addresses, users can visit regardless of where they are in the world, and users who are close to where they are located have the privilege to take and share authentication shots with AR show's augmented reality show content. do.

Depending on the activity of users, the value of a specific location may appear differently. For example, places like Times Square in Manhattan, New York, and Leicester Square in London's West End are popular with advertisers because they are an area visited by a large number of floating populations every day, and the frequency of exposure is because users are active due to the rich treasures it creates. It will also increase, and automatically these local addresses will have a high value. It is difficult to expect the existing homepage to be exposed to users without a separate means of publicity and advertisement, but when linked to the system according to an embodiment of the present invention, natural publicity effects exposed to users can be expected as well as 3D virtual meta Easy to upgrade to bus space. Users can experience and share various functions, communicate with messengers, as well as become a creator and earn money by making and selling used items. In addition, you can receive various services from character guide curators and Butlers equipped with deep learning artificial intelligence (AI).

As mentioned above, the metaverse space is decorated with galleries or museums to display artwork, sound sources, NFT contents, etc., and showrooms, public relations centers, educational institutions, mission centers, etc. can be decorated with In particular, for users who own NFT digital contents, when the NFT gallery is opened in the dome, digital files are safely stored and NFT contents are displayed and promoted to many users around the world as a showcase to increase the value of NFT contents. It will be of great significance. This is because, if continuously exposed and promoted to many users through the NFT gallery, the expected effect on the increase in the value of NFT contents possessed in the future can be significantly increased. It can also be used as a space for various promotional marketing campaigns such as new product launch events, election campaigns, and surveys. In addition, it is good to use it as a personal broadcasting station or community hall for YouTuber influencers, MCN broadcasters, bloggers, etc. In addition, by utilizing the streaming service function for the entertainment business, it is possible to provide services such as arena, concert halls, fan clubs, and live commerce, which are optimized for the non-face-to-face era. Through the privacy setting function that allows only invited users to visit, it can be made into a private gallery, memorial, research center, etc.

Regarding the unique identifier (address), any location on the earth can be registered as an address, but duplicate registration of previously registered address locations is not possible, and each address can be registered with a distance of at least 20m apart. All addresses are fixed with latitude and longitude positions and are displayed in the form of a unique address code (e.g. 123XXXX123). Just like domain address registration, addresses are registered in units of 1 year, 2 years, 3 years, 5 years, etc. and can be extended before the expiration date. . The registration fee is eg USD 18.00 per year and discounts for 2 years (5%), 3 years (10%) and 5 years (15%) are available for multi-year registrations. The registered address can be used by changing it to a name that can be used as it is (e.g. @brownburger) as a name such as a business name or a brand name instead of the dome address code.

In terms of interworking, it is designed to create synergy with the existing IT infrastructure through an engine that can be easily connected to all IT-related contents. For example, all related contents such as website linkage and YouTube MCN link can be accessed in one place, providing convenience to users and effective publicity effect for dome operators. In the case of an external app, it can be used conveniently as if it were a separate internal app by linking the API through the provided SDK.

Also, looking at the characteristics, various metaverse platform services are provided that allow all users to operate in a virtual space that is connected or separated from the real world without space and time restrictions. Different from existing services, we pursue not only easy UI/UX, but also metaverse from a first-person view, aiming for an app that can be enjoyed easily without unnecessary preparation or wasting time in using the app, focusing on teens and 20s Users of all ages, not just generations, will be able to have and develop a platform where they can easily participate and work in the metaverse world.

8 is a block diagram illustrating a detailed structure of the AR-based metaverse service apparatus of FIG. 1 .

As shown in FIG. 8 , the AR-based metaverse service device 130 of FIG. 1 according to an embodiment of the present invention includes a communication interface unit 800 , a control unit 810 , an AR-based metaverse unit 820 , and storage. part or all of part 830 .

Herein, “including some or all” means that some components such as the storage unit 830 are omitted to configure the AR-based metaverse service device 130 or some components such as the AR-based metaverse unit 820 . It means that the element can be configured by being integrated with other elements such as the control unit 810, and it will be described as including all elements to help a sufficient understanding of the invention.

The communication interface unit 800 communicates with the user terminal device 100 , the purchaser terminal device 110 , and the third-party device 140 through the communication network 120 of FIG. 1 , respectively. In the process of performing communication, the communication interface unit 800 may perform operations such as modulation/demodulation, muxing/demuxing, encoding/decoding, and scaling for converting resolution, which are obvious to those skilled in the art, and therefore no longer A description is omitted.

The communication interface unit 800 provides a service screen for realizing an augmented reality screen when an app is executed, for example, in response to a service request from the user terminal device 100 . For example, based on the location of the user terminal device 100 and sensing a signal such as a gyro sensor or an acceleration sensor to recognize a direction, it is possible to provide an augmented reality screen in the direction the camera illuminates. For example, when the user of the user terminal device 100 illuminates the camera, an image included in the camera is acquired, and an augmented reality screen corresponding thereto is implemented.

In addition, the communication interface unit 800 performs an operation for registering promotional information for promoting the virtual space of the purchaser at a specific point on the augmented reality screen according to the service request of the purchaser terminal device 110 . Here, the promotional information may be an icon, but may be augmented reality content in the form of a video called an AR show. Of course, these icons or the contents of the AR show can be registered when the buyer is assigned the point through purchase. As described above, the communication interface unit 800 may perform an operation for registering the purchaser terminal device 110 and the metaverse virtual space to be displayed on the augmented reality screen.

The control unit 810 is in charge of overall control operations of the communication interface unit 800, the AR-based metaverse unit 820, and the storage unit 830 of FIG. 8 constituting the AR-based metaverse service device 130 of FIG. 1 . do. When there is a service request from the user terminal device 100 , the controller 810 controls the AR-based metaverse unit 820 to provide an augmented reality screen. Of course, through the augmented reality screen, publicity information (eg icons, AR show contents, etc.) of the metaverse virtual space registered by buyers at a specific point is also provided.

In addition, the controller 810 guides the AR-based metaverse unit 820 to a virtual space such as a metaverse on the augmented reality screen representing a specific area such as Gangnam Station in the purchaser terminal device 110 of FIG. 1 , for example. An operation is performed to set promotional information for this purpose. This, of course, is not regionally based and can transcend regions. In other words, the buyer can freely select the area he wants to promote his virtual space in and promote it. In this regard, it has already been previously described with reference to FIG. 4 .

The AR-based metaverse unit 820 provides the augmented reality service in response to a service request from the user terminal device 100 while simultaneously providing the metaverse service. The AR-based metaverse unit 820 provides various types of promotional information, such as a promotional text for entering the metaverse space on the augmented reality screen when there is an augmented reality service request according to the execution of the app from the user terminal device 100 , for example. to display Of course, such promotional information may be provided by the purchasers of the purchaser terminal device 110 paying and registering in advance. Buyers can have various types of promotional information displayed on a specific location on the augmented reality screen, and simply display promotional text (eg, business name, etc.) can be freely registered and changed to be displayed.

When the purchaser purchases a specific location on the augmented reality screen, since address information such as a domain address is registered so that he or she can enter the metaverse space he has made previously, the AR-based metaverse unit 820 is the When the user selects specific promotional information on the augmented reality screen, he or she enters the metaverse virtual space of the buyer based on the linked address information. Of course, such a metaverse virtual space can be a space created by a famous singer's fan club, or in the case of a company, it can be a website. The AR-based metaverse unit 820 may be involved in providing such a service.

In addition, the AR-based metaverse unit 820 activates and shows a button for automatic switching of the camera button at the bottom of the screen so that the augmented reality content of the AR show can be played when the augmented reality screen is provided to the user terminal device 100 Through this, the photo is taken using the augmented reality screen. For example, when the content of an AR show is displayed on the screen, a picture is taken with the augmented reality screen as a background image by photographing a friend together. In addition, a share button is also provided so that the photo can be shared through social media.

The storage unit 830 temporarily stores various types of data under the control of the controller 810 . For example, when the purchaser terminal device 110 purchases a specific point on the augmented reality screen, the storage unit 830 temporarily stores purchase information under the control of the control unit 810 and then calls the AR-based metaverse unit 820 . provided with The AR-based metaverse unit 820 may request storage from the control unit 810 so that the information is generated in a specified format using the corresponding information and then systematically classified and managed in the DB 130a of FIG. 1 . Even in this process, the storage unit 830 may temporarily store data of a corresponding specified format.

In addition to the above, the communication interface unit 800, the control unit 810, the AR-based metaverse unit 820, and the storage unit 830 of FIG. 8 can perform various operations, and other details have been sufficiently described above. I would like to replace them with those.

The communication interface unit 800, the control unit 810, the AR-based metaverse unit 820, and the storage unit 830 of FIG. 8 according to an embodiment of the present invention are composed of hardware modules physically separated from each other, but each module may store software for performing the above operation therein and execute it. However, since the software is a set of software modules, and each module can be formed of hardware, it will not be particularly limited to the configuration of software or hardware. For example, the storage unit 830 may be hardware, storage (storage) or memory (memory). However, since it is possible to store information in software (repository), it will not be particularly limited to the above.

Meanwhile, as another embodiment of the present invention, the control unit 810 may include a CPU and a memory, and may be formed as a single chip. The CPU includes a control circuit, an arithmetic unit (ALU), a command interpreter and a registry, and the memory may include a RAM. The control circuit performs a control operation, the operation unit performs an operation operation of binary bit information, and the instruction interpretation unit converts a high-level language into a machine language and a machine language into a high-level language, including an interpreter or compiler. , the registry may be involved in software data storage. According to the above configuration, for example, at the beginning of the operation of the AR-based metaverse service device 130, a program stored in the AR-based metaverse unit 820 is copied, loaded into a memory, that is, a RAM, and then executed to obtain data. It is possible to quickly increase the operation processing speed.

9 is a flowchart illustrating a driving process of the AR-based metaverse service device of FIG. 1 .

Referring to FIG. 9 together with FIG. 1 for convenience of explanation, the AR-based metaverse service device 130 of FIG. 1 provides an augmented reality (AR) screen upon a service request from the user terminal device 100 located at an arbitrary location. , together with promotional information for entering the metaverse space at a designated location on the augmented reality screen (S900). Here, the promotional information includes icons or AR show contents.

In addition, the AR-based metaverse service device 130 grants the right to use a designated location according to the request of the purchaser terminal device 110 to enter address information and promotional information (eg, icon, AR show) for entering the metaverse space. contents, etc.) and, when promotional information of the user terminal device 100 is selected, guided to the metaverse space linked to the promotional information selected by the user based on the registered address information (S910).

In addition to the above, the AR-based metaverse service device 130 of FIG. 1 can perform various operations, and since other details have been sufficiently described above, those contents will be replaced.

10 to 13 are diagrams for explaining a metaverse space template provided by the AR-based metaverse service apparatus of FIG. 1 .

For convenience of explanation, referring to FIGS. 10 to 13 together with FIG. 1 , the AR-based metaverse service device 130 of FIG. 1 allows the purchaser of the purchaser terminal device 110 of FIG. 1 to use a specific point on the augmented reality screen. It is possible to create a virtual space of the metaverse together with the purchase of the corresponding branch. For example, the template-based service may be provided free of charge, but the service may be provided in various forms, such as providing a free service to long-term customers of three years or more.

The AR-based metaverse service device 130 of FIG. 1 provides a template for creating a metaverse space, so that buyers can select a metaverse space template type online and use tools such as functional selection and editing to easily implement a 3D virtual metaverse space on the platform.

After the purchaser selects the type of metaverse space template suitable for the purchaser's use online, the 3D virtual metaverse space can be easily implemented on the platform by selecting the necessary functions from the function list and editing them.

10 shows a process of selecting a type of metaverse space online. Templates can be classified according to the service type of the metaverse space. In selecting the template type of the metaverse space online, the buyer selects a gallery, museum, showroom for business operators, publicity center, educational institution, mission center and new product launch event, election campaign, survey to display digital artwork, sound source, and NFT content. A space for research, a personal broadcasting station or community hall for YouTubers, influencers, MCN broadcasters, and bloggers, an arena performance hall for online performances, a fan club, a one-person broadcasting station, a space for live commerce, a private space with privacy setting function A gallery, a research institute, a memorial hall, etc. may be provided.

11 also shows a state of selecting a function online. When a buyer selects a list of functions suitable for the purchaser's use online, a hall for display or exhibition, an arena for a performance or streaming video, an image + URL for a link, and an API for connecting an external app You can select the necessary functions from the linked SDK, notifications, SNS links, Performance Schedule, TicketBox for ticket sales, and images for uploading images. If such a function is selected, it can be seen that the function is automatically set when the metaverse space is finally created.

12 shows a state in which a design, a logo, a color, and the like are selected online. In decorating the 3D virtual metaverse space online, the buyer is provided with an editing tool that allows the buyer to select and edit the desired design, logo, color, etc.

13 shows an online import function selection. When a buyer decorates a 3D virtual metaverse space online, the buyer can easily complete another metaverse space by calling the same function or design from a metaverse space in another location in the platform that the buyer has. Import) function.

The AR-based metaverse service device 130 of FIG. 1 according to an embodiment of the present invention has the effect of linking an individual or a company to an icon on the augmented reality screen by linking a metaverse space previously made by an external developer to an icon on the augmented reality screen to promote the company. However, as shown in FIGS. 10 to 13 , by providing a template to an individual or a company to automatically create a desired metaverse space according to a user's request, service efficiency can be increased.

On the other hand, even though it has been described that all components constituting the embodiment of the present invention are combined or operated in combination, the present invention is not necessarily limited to this embodiment. That is, within the scope of the object of the present invention, all the components may operate by selectively combining one or more. In addition, all of the components may be implemented as one independent hardware, but a part or all of each component is selectively combined to perform some or all of the combined functions in one or a plurality of hardware program modules It may be implemented as a computer program having Codes and code segments constituting the computer program can be easily deduced by those skilled in the art of the present invention. Such a computer program is stored in a computer-readable non-transitory computer readable media, read and executed by the computer, thereby implementing an embodiment of the present invention.

Here, the non-transitory readable recording medium refers to a medium that stores data semi-permanently and can be read by a device, not a medium that stores data for a short moment, such as a register, cache, memory, etc. . Specifically, the above-described programs may be provided by being stored in a non-transitory readable recording medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and it is common in the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims. Various modifications may be made by those having the knowledge of, of course, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

100: user terminal device 110: buyer terminal device
120: communication network 130: AR-based metaverse service device
140: third-party device 210: camera button
300: album save button (or save) 310: share button (or share)
320: delete button (or delete) 800: communication interface unit
810: control unit 820: AR-based metaverse unit
830: storage

Claims (8)

a communication interface unit that provides an augmented reality (AR) screen upon a service request from a user terminal device located at an arbitrary location, and provides promotional information for entering the metaverse space at a designated location on the augmented reality screen; and
By granting the purchaser of the purchaser terminal device the right to use the designated location, address information for entering the metaverse space and the promotional information are registered, and the registered address information is stored when the promotional information on the user terminal device is selected. A control unit for guiding to a metaverse space linked to the selected promotional information based on the basis; including,
The control unit, when there is a request for registration to be given the right to use the designated location on the augmented reality screen from the purchaser terminal device, control to display on the screen by distinguishing the color of the designated location that can be registered and the pre-registered designated location Augmented reality-based metaverse service device. delete a communication interface unit that provides an augmented reality (AR) screen upon a service request from a user terminal device located at an arbitrary location, and provides promotional information for entering the metaverse space at a designated location on the augmented reality screen; and
By granting the purchaser of the purchaser terminal device the right to use the designated location, address information for entering the metaverse space and the promotional information are registered, and the registered address information is stored when the promotional information on the user terminal device is selected. A control unit for guiding to a metaverse space linked to the selected promotional information based on the basis; including,
The control unit, the augmented reality-based metaverse service device for exposing publicity information for entering the metaverse space on the augmented reality screen when it is within the validity period by checking whether payment is made by period for the registered address information. 4. The method of claim 3,
The control unit, augmented reality-based metaverse service device for notifying the extension registration by giving priority to the previously registered purchaser when the end of the payment period for the registered address information is imminent. The method of claim 1,
The control unit, when the purchaser who has been given the right to use the specified location on the augmented reality screen transfers the specified position to another purchaser, provides promotional information for entering the metaverse space of the other purchaser to the augmented reality screen Augmented reality-based metaverse service device that exposes images. a communication interface unit that provides an augmented reality (AR) screen upon a service request from a user terminal device located at an arbitrary location, and provides promotional information for entering the metaverse space at a designated location on the augmented reality screen; and
By granting the purchaser of the purchaser terminal device the right to use the designated location, address information for entering the metaverse space and the promotional information are registered, and the registered address information is stored when the promotional information on the user terminal device is selected. A control unit for guiding to a metaverse space linked to the selected promotional information based on the basis; including,
The control unit exposes augmented reality show content implemented in the form of an icon or a video registered by the purchaser as the promotional information,
The control unit, when the augmented reality show content is exposed, augmented reality-based metaverse service device for displaying a camera button on the screen so that the photo can be taken with the augmented reality show content as a background. delete providing, by a communication interface unit, an augmented reality (AR) screen upon a service request from a user terminal device located at an arbitrary location, and providing promotional information for entering the metaverse space at a designated location on the augmented reality screen;
The control unit grants the purchaser of the purchaser terminal device the right to use the designated location to register the address information and the promotional information for entering the metaverse space, and when the promotional information on the user terminal device is selected, the registered address information guiding to a metaverse space linked to the selected promotional information based on address information; and
When there is a registration request for the control unit to be granted the right to use the specified position on the augmented reality screen from the purchaser terminal device, control to display the color of the registered specified position and the registered specified position separately on the screen step to;
A method of driving an augmented reality-based metaverse service device comprising:

Images