KR20220028322A - Apparatus for Providing Mixed Reality-based Content Service and Driving Method Thereof, and Computer-readable Recording Medium - Google Patents

Abstract

The present invention relates to a mixed reality (MR)-based content service apparatus to enable users to experience various content in a non-face-to-face manner, an operation method thereof, and a computer-readable recording medium for the same. According to an embodiment of the present invention, the MR-based content service apparatus comprises: a storage unit matching and storing address information for visiting and viewing various content of first users in virtual space and link information set by the first users on the basis of augmented reality (AR) in an arbitrary area to access the address information; and a control unit displaying the link information set in the arbitrary area on a screen of a user terminal device in AR when the arbitrary area is detected by the user terminal devices of second users, and guiding the second users to a virtual space (VR) matching the selected link information when at least one of the link information displayed in the AR is selected.

Description

Mixed reality-based content service device, driving method thereof, and computer-readable recording medium

The present invention relates to a mixed reality-based content service apparatus, a method of driving the apparatus, and a computer-readable recording medium, and more particularly, to a user in an arbitrary area freely setting link information such as advertisements based on augmented reality, and through this To a mixed reality-based content service apparatus and method of driving the apparatus, and a computer-readable recording medium for providing a content service for individuals or companies by enabling a visit to a virtual space (cyberspace).

Augmented Reality (AR) is a technology that superimposes virtual objects on the real world that users see with their eyes. It is also called Mixed Reality (MR) because the real world and the virtual world with additional information are combined in real time and displayed as a single image. Augmented reality, a concept that complements the real world with the virtual world, uses a virtual environment created with computer graphics, but the main character is the real environment. Computer graphics serve to provide additional information necessary for the real environment. This means that the distinction between the real environment and the virtual screen is blurred by overlapping the 3D virtual image on the actual image the user is viewing.

Virtual reality technology immerses the user in the virtual environment, making it impossible to see the real environment. However, augmented reality technology, in which the real environment and virtual objects are mixed, allows users to see the real environment, providing better realism and additional information. For example, if you illuminate the surroundings with a smartphone camera, information such as the location and phone number of a nearby store is displayed as a stereoscopic image.

marked

There is a need for a method that can maximize the advertising effect using such augmented reality technology, and as non-face-to-face service has recently been in the spotlight, various businesses using it are urgently required.

Korean Patent Publication No. 10-1282292 (2013.06.28) Korean Patent Publication No. 10-2020-0033064 (2020.03.27) Korean Patent Publication No. 10-2020-0076446 (2020.06.29)

An embodiment of the present invention provides a mixed reality-based content service device for providing individual or corporate content services by enabling users to freely set link information such as advertisements based on augmented reality in an arbitrary area, and to visit a virtual space through this, and An object of the present invention is to provide a method of driving the device and a computer-readable recording medium.

In the mixed reality-based content service apparatus according to an embodiment of the present invention, address information for visiting and viewing content generated by first users in a virtual space, and the first users in an arbitrary area to access the address information A storage unit that matches and stores link information set based on augmented reality (AR), and when the arbitrary area is detected by the user terminal device of second users, link information set in the arbitrary area is stored in the user terminal device and a control unit for displaying on the screen in augmented reality and guiding to the virtual space matching the selected link information when at least one of the link information displayed in the augmented reality is selected.

The controller may provide a content template for production of the content to the user terminal device of the first users.

The controller may classify a general zone and a prime zone according to regional characteristics of the arbitrary region, and limit the amount of link information that can be set in the prime zone.

The controller may allow the transaction of the virtual space when there is a request for transfer and transfer between users for the virtual space.

The control unit may display a virtual space connection state on different graphic screens when the second user is within a designated radius R and when it is outside the designated radius based on the location information of the user terminal device of the second user.

When entering the virtual space by selecting the link information, the control unit may provide an artificial intelligence (AI) character assistant for guiding the entered virtual space.

The controller may automatically create a messenger conversation channel between the first user and the second user based on the address information of the virtual space and the link information of the arbitrary region.

The controller may set advertisement information of the virtual space having an address outside the arbitrary area as the link information.

In addition, in the method of driving a mixed reality-based content service apparatus according to an embodiment of the present invention, the storage unit includes address information for visiting and viewing content generated by first users in a virtual space, and accessing the address information. Matching and storing link information set by the first users in an area based on augmented reality with each other, and when the control unit detects the arbitrary area in the user terminal device of the second users, the link set in the arbitrary area and displaying the information in augmented reality on the screen of the user terminal device, and guiding to the virtual space matching the selected link information when at least one of the link information displayed in the augmented reality is selected.

The guiding may include providing a content template for production of the content to the user terminal devices of the first users.

The step of guiding may include classifying a general zone and a prime zone according to regional characteristics of the arbitrary region, and limiting the amount of the link information that can be set in the prime zone.

In the step of guiding, when there is a request for transfer and transfer between users for the virtual space, the transaction of the virtual space may be permitted.

The step of guiding may include displaying a state of being connected to the virtual space on different graphic screens when it is within a designated radius (R) and when it is outside the designated radius based on the location information of the user terminal device of the second user. may include

The guiding may include providing an artificial intelligence (AI) character helper that guides the entered virtual space when the user enters the virtual space by selecting the link information.

The step of guiding may include automatically generating a messenger conversation channel between the first user and the second user based on the address information of the virtual space and the link information of the arbitrary area.

The step of guiding may include setting advertisement information of the virtual space having an address outside the arbitrary area as the link information.

On the other hand, a computer-readable recording medium according to an embodiment of the present invention is a computer-readable recording medium including a program for executing a method of driving a mixed reality-based content service apparatus, and the method of driving a mixed reality-based content service apparatus includes: , address information for visiting and viewing content generated by first users in a virtual space, and link information set by the first users based on augmented reality in an arbitrary area to access the address information by matching each other and storing and when the arbitrary area is detected by the user terminal device of the second users, the link information set in the arbitrary area is displayed in augmented reality on the screen of the user terminal device, and among the link information displayed in the augmented reality When at least one is selected, the step of guiding to the virtual space matching the selected link information is executed.

According to an embodiment of the present invention, users who consume content will be able to experience various content non-face-to-face through link information linked to a specific region or place, for example, AR advertisement information.

In addition, according to an embodiment of the present invention, from the perspective of the manager who operates the service, it will be possible to easily generate profits even in a non-face-to-face situation.

Furthermore, the embodiment of the present invention will be able to provide a service of a new concept by using the virtual space provided by the social platform as a concept of ownership and allowing it to be transacted.

1 is a view showing a mixed reality-based content service system according to an embodiment of the present invention;
2 to 6 are diagrams for explaining various services of the system of FIG. 1;
7 is a diagram illustrating a detailed structure of the mixed reality-based content service device of FIG. 1;
8 and 9 are diagrams for explaining the operation process of the content engine of FIG. 7;
10 is a block diagram illustrating another structure of the mixed reality-based content service device of FIG. 1, and
11 is a flowchart illustrating a driving process of the mixed reality-based content service device of FIG. 1 .

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

1 is a diagram illustrating a mixed reality-based content service system according to an embodiment of the present invention, and FIGS. 2 to 6 are diagrams for explaining various services of the system of FIG. 1 .

As shown in FIG. 1 , a mixed reality-based content service system 90 according to an embodiment of the present invention is a part of a user terminal device 100 , a communication network 110 , and a mixed reality (MR)-based content service device 120 . or all inclusive.

Here, "including some or all" means that some components such as the communication network 110 are omitted so that the user terminal device 100 and the MR-based content service device 120 perform direct (eg, P2P) communication or , which means that some or all of the components constituting the MR-based content service device 120 can be integrated into a network device (eg, a wireless switching device, etc.) constituting the communication network 110, and the like, In order to help a sufficient understanding of the invention, it will be described as including everything.

The user terminal device 100 may access the MR-based content service device 120 via the communication network 110 to use the service according to the embodiment of the present invention. For example, the user terminal device 100 executes an application (hereinafter, referred to as an app) according to an embodiment of the present invention, such as a smartphone, and then illuminates the camera to the surrounding area to promote its virtual space in the corresponding area in the form of augmented reality. Link information for, for example, advertisement information is displayed, and, of course, the advertisement information displayed on the screen may be independent of the area where the camera is lit, and when the user selects advertisement information or link information displayed on the screen, the advertisement information or You can move to the virtual space linked to the link information.

Of course, in the embodiment of the present invention, even if it is not in this form, company information or Advertising information may be retrieved. For example, an advertisement of a company included in a specific area (e.g., within a 200m radius from where the user terminal device is located) and company information or advertisement information in an area outside the radius (R) can be separated and displayed on the screen. There will be.

The user terminal device 100 according to an embodiment of the present invention provides a user terminal device for advertising their virtual space based on AR or keywords in a specific area, for example, a central commercial zone, or a station area, and a user for using the service. It can be classified as a terminal device. Of course, the user terminal device of the content producer who sets the service may be the user terminal device of the consumer who consumes the service in another aspect, and vice versa. Therefore, in the embodiment of the present invention, the producer and the consumer of the content will not be separately distinguished. However, if there is a need to make a special distinction, the terms are divided into terms such as producer (or seller) user terminal device (hereinafter, first user terminal device) or consumer (or purchaser) user terminal device (hereinafter, second user terminal device). can be explained

The first user terminal device may access the MR-based content service device 120 and perform a setting operation for promoting the virtual space. For example, by selecting one of various types of templates provided by the MR-based content service device 120 , content may be created and edited according to its request. Typically, an operation for creating a homepage of an individual or a company may be representative of the template, and an operation for creating and editing a gallery such as an exhibition of works may be performed in addition.

In addition, the first user terminal device may further set various additional information in order to promote its own virtual space in the service according to the embodiment of the present invention, although it is not specifically limited thereto by using the template. there is. For example, although the actual virtual space is located in a rural area, when you select Gangnam Station in Seoul to promote AR based, you select Gangnam Station and register your virtual space. In addition, the setting can be made by dividing it into a free general zone and a paid prime zone. In addition, in the first user terminal device, the setting of a pincette publicity method in which publicity for its own virtual space is performed only in a designated place such as Gangnam Station and a floating publicity method that is not fixed to a specific area or place are to be set. may be

Furthermore, the first user terminal device may be freely transferable in the case of a virtual space produced by the first user terminal device, a prime zone allocated to the first user terminal device, or a part thereof. For example, when the first user terminal device requests transfer of a prime zone of a specific region allocated for promoting its virtual space in the MR-based content service device 120 , the transaction information is transmitted to the user terminal device 100 ), it may be displayed on the main screen when accessing the service. In an embodiment of the present invention, it is preferable to trade a virtual space, but it will not be particularly limited thereto.

The content consumer's second user terminal device may use the service in the form shown in FIGS. 2 to 6 . For example, when accessing the MR-based content service device 120 of FIG. 1 by executing an app according to an embodiment of the present invention, a screen as shown in FIG. 2 may be displayed on the screen of the user terminal device. Shows your radius area based on your location. The radius may be freely changed according to the intention of the service manager or program designer, but 200 m may be preset in the embodiment of the present invention.

3 shows a service screen (eg, Arena) for describing an interface that users visit by executing an app through the second user terminal device. An asterisk 300 and the like may be displayed at the top of the service screen. An asterisk 300 indicates whether it is a preferred arena. In addition, link information 310 set in a specific region, for example, advertisement information, may be displayed at the bottom thereof. Furthermore, when the user selects the swiping button 330 of the left and right arrows, a swiping operation may be possible.

More specifically, it is assumed that the user of the second user terminal device executes the app in a specific area as shown in FIG. 4 and then illuminates the surrounding area with the camera. In this case, promotional information, such as advertisement information, set by the user of the first user terminal device within a 200 m radius of the user's location is displayed in augmented reality on the screen. If the normal augmented reality is to display restaurant information related to the region in augmented reality on the screen in this step, in the embodiment of the present invention, promotional information such as advertisement information for guiding to a virtual space in a non-face-to-face manner; Alternatively, link information is displayed on the screen.

In (a) and (b) of FIG. 4, when the user selects the augmented reality type promotional information displayed on the second user terminal device, when entering the virtual space within 200 m and in the virtual space of the area outside 200 m It shows that different types of graphics are displayed on the screen when entering. Of course, the address of the virtual space here may mean the address of a service server that provides a service, but may also be the address of a manager or a company that provides a service.

FIG. 5 shows the operations of FIGS. 4 (a) and (b) in more detail. For example, it is assumed that the user of the second user terminal device selects an icon for visiting the gallery from the promotional information displayed on the screen. And, suppose that the operator who operates the gallery does not deviate from the designated radius and the case that it deviates from the designated radius. If it does not deviate from the designated radius, the user is guided directly to the main screen of the virtual space as shown in FIG. 5 (a) on the screen of the second user terminal device. (eg Toka) may be displayed on the screen. In addition, if 'Entrance' is selected to enter the gallery, content built in the gallery can be viewed. The virtual space visit is implemented in a form in which the user directly enters the virtual space whether it is a real map or a space movement (eg, a jump method).

In addition, as shown in (b) of FIG. 5, when a company or service server providing a gallery is out of a designated radius based on the location of the second user terminal device, the user responds to the promotional information displayed on the screen. When an icon is selected, various notification (or pop-up) screens may be provided along with graphics of a jumping operation, and after this process, the main screen of the gallery may be displayed on the screen of the second user terminal device. Jump means space movement, and it shows that online space movement is possible regardless of distance by teleporting to a virtual space located at a distance. Since the subsequent process is the same as in FIG. 5A , further description is omitted.

In this way, the consumer's own terminal, that is, the second user terminal device, who consumes the content in a non-face-to-face manner, may display promotional information for accessing virtual spaces nationwide or around the world based on augmented reality on the screen, Through this, it becomes possible to access various types of virtual space beyond time and space. Of course, this is because a specific area is set as the promotion zone in the first user terminal device of the producer who operates the virtual space. Accordingly, American companies can also generate revenue by designating and promoting Gangnam Station through the service according to an embodiment of the present invention, and also in the case of Korean companies, they designate New York, especially Manhattan, to create their own virtual space. By promoting the company based on virtual reality, it becomes possible to promote the company beyond time and space. Of course, when visiting a virtual space beyond time and space, it is preferable that the service be provided in the language of the country. , the embodiment of the present invention will not be particularly limited to any one form. Of course, it is possible to provide a service based on the selected language by allowing the user to select a desired language in the process.

In FIG. 6 , instead of guiding the gallery as in FIG. 5 , an ad kit icon or advertisement is displayed. For example, the service may be provided by exposing an advertisement when the ad kit icon is selected, and accumulating cash points when the advertisement is viewed. As described above, users of the second user terminal device can visit virtual spaces created by various companies based on augmented reality.

The communication network 110 includes both wired and wireless communication networks. For example, a wired/wireless Internet network may be used as the communication network 110 or may be interlocked. Here, the wired network includes an Internet network such as a cable network or a public telephone network (PSTN), and the wireless communication network includes CDMA, WCDMA, GSM, Evolved Packet Core (EPC), Long Term Evolution (LTE), and Wibro networks. meaning to include Of course, the communication network 110 according to the embodiment of the present invention is not limited thereto, and may be used as an access network of a next-generation mobile communication system, for example, a cloud computing network under a cloud computing environment, a 5G network, and the like. For example, when the communication network 110 is a wired communication network, the access point in the communication network 110 can connect to a switching center of a telephone company, etc., but in the case of a wireless communication network, it accesses the SGSN or GGSN (Gateway GPRS Support Node) operated by the communication company to transmit data. or by connecting to various repeaters such as Base Station Transmission (BTS), NodeB, and e-NodeB to process data.

The communication network 110 may include an access point. Here, the access point includes a small base station, such as a femto or pico base station, which is often installed in a building. Here, the femto or pico base station is classified according to the maximum number of user terminal devices 100 and the like that can be connected to the small base station. Of course, the access point may include a short-distance communication module for performing short-distance communication such as Zigbee and Wi-Fi with the user terminal device 100 and the like. The access point may use TCP/IP or Real-Time Streaming Protocol (RTSP) for wireless communication. Here, the short-distance communication may be performed in various standards such as Bluetooth, Zigbee, infrared, radio frequency (RF) such as ultra high frequency (UHF) and very high frequency (VHF) and ultra-wideband communication (UWB) in addition to Wi-Fi. Accordingly, the access point can extract the location of the data packet, designate the best communication path for the extracted location, and deliver the data packet to the next device, for example, the MR-based content service device 120 along the designated communication path. The access point may share several lines in a general network environment, and includes, for example, a router, a repeater, and a repeater.

The MR-based content service device 120 corresponds to a social platform that shares a user's various contents with other users through an app, for example, using mixed reality technology. For example, the MR-based content service device 120 produces and edits the content desired by the user of the first user terminal device using the content template, distributes the desired number of content anywhere in the virtual space based on the mixed reality technology, and distributes the desired content to the second user. In the case of short distance, other users of the terminal device can visit directly by tapping through the real map through the real map, and in the case of a long distance, they can move through space, that is, visit by jumping, and share content, regardless of distance. In other words, it can be seen that an individual or company that owns a virtual space performs a process for registering the virtual space they have built in a specific area or in a specific zone of the area online.

The MR-based content service device 120 may provide a service by dividing, for example, a free general zone and a paid prime zone. For example, in the case of a major commercial area, it can be operated as a prime zone, and if you want to promote your virtual space in the commercial area based on AR, you can add a fee. Of course, the prime zone as well as the general zone can limit the number of virtual spaces that can be set. Of course, the limited quantity of this operation may vary depending on the shape of the screen, but it is preferable to limit the quantity in order to increase the visibility of the promotional information displayed on the screen based on augmented reality. For example, the quantity that can be displayed on the screen may be changed according to the type of the user terminal device 100 accessing the service (eg, a terminal with a 7-inch screen and a terminal with a screen of 10 people, etc.). For example, when accessing a service from a smartphone, resolution conversion is performed, but the service can be provided in a form that reduces the quantity. Of course, when access is made through a tablet PC at the same location, a larger number of promotional information may be displayed on the screen based on the model.

In addition, the MR-based content service device 120 enables a conversation with a user related to the promotional information displayed on the screen based on AR, that is, an individual or a company promoting a virtual space, through a conversation channel, that is, a messenger. In other words, when a user creates and edits a desired content using a content template, he or she can set the desired virtual space region and use the messaging service through the messenger creation function that is automatically created with other users in the region. and through this, it is possible to maximize the efficiency of content sharing. Whereas existing messengers can connect by inputting a phone number to connect with other users, in the embodiment of the present invention, online access can be made to users with different users just by being in a virtual space, and through this, that you can do activities.

Furthermore, when the MR-based content service device 120 exposes promotional information to a zone of a specific region, for example, a prime zone using tweezers, the operator of the corresponding virtual space may perform a transaction with respect to the corresponding location. Of course, in the embodiment of the present invention, it is preferable to set up to trade the virtual space, but the quantity of the prime zone may be sold. That is, in the case of exposing the virtual space through the method of receiving the zone for sale, the transfer of the zone is allowed, for example, in the case of a user exposing promotional information related to the virtual space in the corresponding zone using tweezers. When a zone transfer is requested, the MR-based content service device 120 may close the transaction. That is, the ownership of the corresponding zone can be transferred, and when the ownership is transferred, the data of the DB 120a can be updated. For such transfer and acquisition transactions, the virtual space, the zone where the promotion of the virtual space is made, and a part of the prime zone may be the target of the transaction.

In addition, the MR-based content service device 120 does not allocate to the prime zone in a specific region for a fee, but provides the number of members who subscribe to the service according to the embodiment of the present invention, that is, users who make many friends, in the prime zone. You can also grant permission to expose the promotional text of your own virtual space. Of course, it may be possible to transfer the prime zone allocated in this way. For example, when 100 friends sign up for a service, one quantity that can be promoted in a specific prime zone is allocated. Since it can be allocated in various forms, the embodiment of the present invention will not be limited to any one form.

As a result of the above configuration, according to the embodiment of the present invention, the user can produce and edit content on the fly in producing and editing desired content using a content template, as well as immediately executing and exposing the content to the virtual world. Since it has the characteristics of an ultra-short-term execution platform that can be implemented, it can be very excellent in the media execution method with existing offline as well as online media in terms of functional aspects such as marketing, publicity, and advertising through it. Therefore, in the embodiment of the present invention, when a user produces and edits desired content using a content template, basic functions such as design, function options, link, and sharing for content production, as well as marketing, publicity, advertisement, etc. It will be able to provide a variety of production tools that can be deployed.

7 is a diagram illustrating a detailed structure of the mixed reality-based content service apparatus of FIG. 1 , and FIGS. 8 and 9 are diagrams for explaining an operation process of the content engine of FIG. 7 .

As shown in FIG. 7 , the mixed reality-based content service device 120 according to an embodiment of the present invention may include a content engine 700 and a graphic processing unit 710 .

In other words, if the content engine 700 is in charge of a backend such as the DB 120a of FIG. 1 , the graphic processing unit 710 may be in charge of a front end such as the user terminal device 100 of FIG. 1 .

The content engine 700 may be included in or operated in conjunction with a control unit such as a CPU, MPU, or GPU. As shown in FIG. 8, the content engine 700 sets a plurality of zones 800 for AR-based publicity for users' virtual space, sets information on this, and stores the information in the DB 120a of FIG. can Of course, here, the radius for each zone 800 may be preset to 200 m, but the embodiment of the present invention will not specifically limit this. 8 shows 12 configurable zones in New York. One of the 12 zones could include Manhattan, New York's central commercial district.

As described above, for example, when a user visits a specific area and requests promotional information based on augmented reality using the user terminal device 100, when promotional information out of a specified radius is selected, for example, space movement through a jump operation Graphics can be implemented to make it happen.

In FIG. 9 , a plurality of commercial areas are designated in Manhattan, New York, and icons 900 of promotional information set in the corresponding commercial areas are shown. In other words, after the content engine 700 matches and stores the promotional information with the location of the commercial area, if it is determined that the location information of the user terminal device 100 is located in the corresponding prime zone when requesting a service, within a radius of 200 m will display promotional information on the screen based on AR.

The graphic processing unit 710 of FIG. 7 displays promotional information (or link information) in AR form on the screen of the user terminal device 100, and is linked to the selected promotional information when one piece of promotional information displayed on the screen is selected. A screen for guiding to a virtual space in which there is a location may be provided to the user terminal device 100 . On the screen of each virtual space, an entry button 713 for entering the contents of the virtual space, a menu button 711 for viewing the current or all programs, and a character assistant equipped with artificial intelligence for guiding the virtual space (eg, : Toka) 712, a swiping button 714 for performing a swiping operation, a ticket box 715 in which a user can view a price or use a coin to buy a ticket, etc. are displayed on the screen of the user terminal device 100 can make it happen

10 is a block diagram illustrating another structure of the mixed reality-based content service apparatus of FIG. 1 .

As shown in FIG. 10 , the mixed reality-based content service device 120 ′ of FIG. 1 according to another embodiment of the present invention includes a communication interface unit 1000 , a control unit 1010 , an MR-based content processing unit 1020 and Some or all of the storage unit 1030 is included.

Here, “including some or all” means that some components such as the storage unit 1030 are omitted to configure the mixed reality-based content service device 120 ′ or some components such as the MR-based content processing unit 1020 . It means that it can be configured by being integrated with other components such as the control unit 1010, and it will be described as including all in order to help a sufficient understanding of the invention.

The communication interface unit 1000 communicates with the user terminal device 100 via the communication network 110 of FIG. 1 . In the process of performing communication, the communication interface unit 1000 may perform scaling operations such as modulation/demodulation, encoding/decoding, muxing/demuxing, and resolution conversion, which are obvious to those skilled in the art, and thus further description will be omitted.

The communication interface unit 1000 communicates with the first user terminal device of the content producer, and performs an operation for promoting its own virtual space based on augmented reality. To this end, a template for generating content may be provided under the control of the controller 1010 and an operation for editing the generated content may be performed. Of course, the embodiment of the present invention will not specifically limit the use of the template.

In addition, the communication interface unit 1000 may display and provide the established AR-based promotional information on the service screen when a service request is received from the content consumer's second user terminal device, and the promotional information is selected on the provided service screen. When it becomes available, it can guide you to the virtual space linked to the corresponding promotional information. That is, it is possible to provide a screen related to the virtual space and service the contents of the virtual space according to a user's request.

The controller 1010 is in charge of overall control operations of the communication interface unit 1000, the MR-based content processing unit 1020, and the storage unit 1030 constituting the mixed reality-based content service device 120' of FIG. In other words, the control unit 1010 sets a zone in a specific area or place in connection with the MR-based content processing unit 1020, and sets the promotional information set in the zone to be displayed on the user terminal device 100 based on AR, When specific promotional information is selected, an operation of guiding to a virtual space linked to the promotional information is performed.

In addition, the control unit 1010 can perform various operations in connection with the MR-based content processing unit 1020, representatively to visit the virtual space by tapping through the real map in the case of a short distance, and in the case of a distance Allows users to visit virtual space by moving regardless of space can do. For more detailed information, continue looking through the MR-based content processing unit 1020 .

The MR-based content processing unit 1020 performs various operations of the service according to the embodiment of the present invention. In other words, the MR-based content processing unit 1020 sets a zone that can be promoted online for a specific region of the country or around the world, where the zone can be an area or a zone, which can be used as a concept smaller than the region or place. can For example, as shown in FIG. 8 , a total of 12 configurable zones may exist in New York. Accordingly, it is possible to provide a service only for a corresponding settable zone. Of course, the MR-based content processing unit 1020 may perform various additional operations under the control of the administrator, such as additionally creating a configurable zone, deleting an existing zone, or creating a new zone.

In addition, the MR-based content processing unit 1020 may divide a total of 12 specific zones into a general zone and a prime zone to provide different services. E.g. In the case of a general zone, it can be provided or provided free of charge. On the other hand, in the case of the prime zone, which is a major commercial area, it can be provided for a fee or can be used by users who have signed up many friends for the service according to an embodiment of the present invention. It is also possible to provide services for a fee or by combining the number of friends. Therefore, it can be seen that the MR-based content processing unit 1020 grants a right, that is, a qualification, to promote its own virtual space in the corresponding prime zone. This right can be made in the same form as if the sale right is granted offline. In other words, it makes trading possible. Of course, in relation to such a sale, if the service is available for one year, the service can be made in various forms, such as allowing the sale to be made within the allowable period, and in the embodiment of the present invention, a prime that can promote a virtual space A transaction can be made against the zone. Of course, in the embodiment of the present invention, it is preferable to provide a service for trading in a virtual space, but as described above, a transaction may be possible with respect to a zone.

The MR-based content processing unit 1020 limits the number of virtual spaces that can be promoted in the same zone. This is because the user's visualization is taken into account. For example, viewing a lot of promotional information set in a specific zone based on AR on a smartphone having a small screen may give fatigue. Therefore, in consideration of visualization, the quantity is limited so that only an appropriate level of promotional information is displayed. For example, if a rating is set in the promotional information, it may be possible to use it. Of course, this can be done selectively any number of times depending on the model of the user terminal device 100, and the limited quantity may vary depending on the type of screen design. I won't.

In addition, the MR-based content processing unit 1020 is provided on the service screen in different forms depending on whether promotional information corresponding to a short distance within a radius of 200 m is selected or promotional information from a distance is selected. The screen can be implemented to have the same feeling as it is being made. In addition, the MR-based content processing unit 1020 may implement a service so that when visiting each virtual space, a guide of the virtual space can be received through a character assistant called Toka. The character assistant is equipped with artificial intelligence. Here, the installation of artificial intelligence means that the character assistant does not operate according to the information set based on a rule, but guides the virtual space based on deep learning through learning, so if there is no learned information, the user's behavior The virtual space will be guided to the user in various ways, such as predicting, etc.

In addition, when the MR-based content processing unit 1020 visits a virtual space of a country using a different language, it may select a language and provide a service translated into the corresponding language. This may allow the automatic translation service to be performed based on the country of the location where the service is accessed, but may allow the translation service to be performed only when the user requests it. Since the translation service may be provided as described above, the embodiment of the present invention will not be specifically limited to any one form.

Furthermore, the MR-based content processing unit 1020 may set an area for a desired virtual space to use a messaging service through a messenger, that is, a conversation channel automatically created with users within the area. Through this, the efficiency of content sharing can be maximized. In other words, the messenger service is made based on the set area.

The storage unit 1030 may temporarily designate information or data to be processed under the control of the control unit 1010 and then output it. Here, since information and data are used interchangeably in practice, the concept of the term will not be particularly limited. However, in the case of image processing, pixel data for realizing a screen and coding information for use in coding may be classified as additional information, but it will not be particularly limited thereto. For example, the storage unit 1030 stores data in a specified format generated by the MR-based content processing unit 1020 under the control of the control unit 1010, and then provides it to the DB 120a of FIG. 1 to update the data. can make it go away

Meanwhile, as another embodiment of the present invention, the control unit 1010 may include a CPU and a memory, and may be formed as a single chip. The CPU includes a control circuit, an arithmetic unit (ALU), an instruction interpreter and a registry, and the memory may include a RAM. The control circuit performs a control operation, the operation unit performs an operation operation of binary bit information, and the instruction interpretation unit converts a high-level language into a machine language and a machine language into a high-level language, including an interpreter or compiler. , the registry may be involved in software data storage. According to the above configuration, for example, the program stored in the MR-based content processing unit 1020 is copied at the beginning of the operation of the mixed reality-based content service device 120' of FIG. By executing it, it is possible to quickly increase the data operation processing speed.

11 is a flowchart illustrating a driving process of the mixed reality-based content service device of FIG. 1 .

11 together with FIG. 1 for convenience of explanation, the mixed reality-based content service device 120 according to an embodiment of the present invention includes address information for visiting and viewing content generated by first users in a virtual space; In order to access the address information, link information set by the first users based on augmented reality in an arbitrary area is matched and stored (S1100). This step S1100 may correspond to a data building operation.

For example, an individual or company who wants to promote a virtual space in a specific area can access the service, select the area to promote, and apply for the service by dividing the general zone and the prime zone in the process of doing so. To users, for example, promotion information of a virtual space is exposed on the screen of the user terminal device 100 through the execution of an augmented reality type app to a user who has visited the corresponding area.

In addition, the mixed reality-based content service device 120 displays link information set in an arbitrary region in augmented reality on the screen of the user terminal device when an arbitrary region is detected in the user terminal device of the second users, and is displayed in augmented reality When at least one piece of link information is selected, it guides to a virtual space matching the selected link information (S1110).

In addition to the above, the mixed reality-based content service device 120 according to an embodiment of the present invention can perform various operations, and since other details have been sufficiently described above, they will be replaced with the contents.

On the other hand, even though it has been described that all components constituting the embodiment of the present invention operate by being combined or combined into one, the present invention is not necessarily limited to this embodiment. That is, within the scope of the object of the present invention, all the components may operate by selectively combining one or more. In addition, although all the components may be implemented as one independent hardware, some or all of the components are selectively combined to perform some or all of the functions of the combined hardware in one or a plurality of hardware program modules It may be implemented as a computer program having Codes and code segments constituting the computer program can be easily deduced by those skilled in the art of the present invention. Such a computer program is stored in a computer-readable non-transitory computer readable media, read and executed by the computer, thereby implementing an embodiment of the present invention.

Here, the non-transitory readable recording medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short moment, such as a register, cache, memory, etc. . Specifically, the above-described programs may be provided by being stored in a non-transitory readable recording medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and it is common in the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims. Various modifications may be made by those having the knowledge of, of course, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

100: user terminal device 110: communication network
120: MR-based content service device 700: content engine (part)
710: graphic processing unit 1000: communication interface unit
1010: control unit 1020: MR-based content processing unit
1030: storage

Claims (17)

Address information for visiting and viewing content generated by first users in a virtual space and link information set by the first users in an arbitrary area based on augmented reality (AR) to access the address information are matched with each other. a storage unit for storing; and
When the arbitrary area is detected by the user terminal device of the second users, link information set in the arbitrary area is displayed in augmented reality on the screen of the user terminal device, and at least one of the link information displayed in the augmented reality is displayed. a control unit that guides to the virtual space matching the selected link information when selected;
A mixed reality-based content service device that includes. The method of claim 1,
The control unit, a mixed reality-based content service device for providing a content template for the production of the content to the user terminal device of the first users. The method of claim 1,
The controller divides a general zone and a prime zone according to regional characteristics of the arbitrary region, and limits the amount of the link information settable in the prime zone, a mixed reality-based content service device. The method of claim 1,
The control unit, a mixed reality-based content service device that allows the transaction of the virtual space when there is a request for transfer and transfer between users for the virtual space. The method of claim 1,
The control unit, based on the location information of the user terminal device of the second user, is a mixed reality-based mixed reality that displays a state of being connected to a virtual space with different graphic screens when it is within a specified radius (R) and when it is outside the specified radius content service device. The method of claim 1,
The control unit, when entering the virtual space by selecting the link information, a mixed reality-based content service device for providing an artificial intelligence (AI) character assistant to guide the entered virtual space. The method of claim 1,
The controller is configured to automatically create a messenger conversation channel between the first user and the second user based on the address information of the virtual space and the link information of the arbitrary region. The method of claim 1,
The control unit, as the link information, a mixed reality-based content service device for setting the advertisement information of the virtual space having an address outside the arbitrary area. The storage unit matches address information for visiting and viewing content generated by first users in a virtual space, and link information set by the first users in an arbitrary area based on augmented reality in order to access the address information. saving; and
When the arbitrary region is sensed by the user terminal device of the second users, the control unit displays link information set in the arbitrary region in augmented reality on the screen of the user terminal device, and among the link information displayed in the augmented reality guiding to the virtual space matching the selected link information when at least one is selected;
A method of driving a mixed reality-based content service device, including 10. The method of claim 9,
The guiding step is
and providing a content template for production of the content to the user terminal devices of the first users. 10. The method of claim 9,
The guiding step is
and classifying a general zone and a prime zone according to regional characteristics of the arbitrary region, and limiting the amount of link information that can be set in the prime zone. 10. The method of claim 9,
The guiding step is
A method of driving a mixed reality-based content service device that allows a transaction in the virtual space when there is a request for transfer and transfer between users for the virtual space. 10. The method of claim 9,
The guiding step is
Based on the location information of the second user's user terminal device, when it is within a specified radius (R) and when it is outside the specified radius, the mixed reality-based comprising the step of displaying the state of being connected to the virtual space on different graphic screens A method of driving a content service device. 10. The method of claim 9,
The guiding step is
and providing an artificial intelligence (AI) character assistant to guide the entered virtual space when entering the virtual space by selecting the link information. 10. The method of claim 9,
The guiding step is
and automatically generating a messenger conversation channel between the first user and the second user based on the address information of the virtual space and the link information of the arbitrary region. 10. The method of claim 9,
The guiding step is
and setting advertisement information of the virtual space having an address outside the arbitrary area as the link information. A computer-readable recording medium including a program for executing a method of driving a mixed reality-based content service apparatus, comprising:
The driving method of the mixed reality-based content service device is,
Matching and storing address information for visiting and viewing content generated by first users in a virtual space and link information set by the first users in an arbitrary area based on augmented reality to access the address information ; and
When the arbitrary area is detected by the user terminal device of the second users, link information set in the arbitrary area is displayed in augmented reality on the screen of the user terminal device, and at least one of the link information displayed in the augmented reality is displayed. guiding to the virtual space matching the selected link information when selected;
A computer-readable recording medium that executes.

Images