KR20200033064A - Platform service system for providing MR graphics support contents and Drive method of the same - Google Patents

Abstract

Disclosed is a mixed reality (MR) technique, and more particularly, to a platform service system for providing MR graphic support content and a driving method thereof. According to an embodiment of the present invention, the platform service system for providing MR graphic support content, when taking a video or taking a photograph in photo lines provided in tourist spots, and the like by using an MR camera of a communication terminal for playing an MR image, identifies the GPS position information recognized from the photo line and performs one-to-one custom focusing on an actual screen displayed in the MR camera and any one selected from a plurality of virtual reality (VR)/augmented reality (AR)/MR panorama videos and a plurality of VR/AR/MR images provided from a management server to simultaneously display the same through a display window of the communication terminal for playing an MR image.

Description

Platform service system for providing MR graphics support contents and driving method of the same

The present invention relates to a mixed reality technology, in particular, when using the MR camera of the MR video communication communication terminal to enter the photoline area provided in a tourist destination, etc., to take a video or picture, GPS position information recognized from the photoline area Upon grasping, the VR (Virtual Reality) / AR (Augmented Reality) / MR (Mixed Reality) video and VR / AR / MR image provided from the management server are 1: 1 aligned with the actual screen displayed by the MR camera, and then MR video The present invention relates to a platform service system for providing MR graphic-supported content that is simultaneously displayed through a display window of a communication terminal for play and a driving method thereof.

Terminals such as personal computers, notebooks, and mobile phones may be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function for taking a picture or video through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some terminals include additional functions for playing games, and some terminals are implemented as multimedia devices. Moreover, recent terminals can receive a broadcast or multicast signal and watch a video or television program.

In general, a terminal may be divided into a mobile terminal (mobile / portable terminal) and a stationary terminal (mobile terminal) depending on whether it is mobile. Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

As the function is diversified, such a terminal is a multimedia player having multiple functions, such as taking a picture or a video, playing music or a video file, receiving a game, or broadcasting. Is being implemented.

To support and increase the function of such a terminal, it may be considered to improve the structural part and / or software part of the terminal.

Mobile terminals that have swept the world since a few years ago are changing the lifestyle of consumers, including the propensity to consume tablet PCs. As such, IT devices are closely related to our daily lives. In the meantime, it is because anyone can easily use the new technology that can be seen in movies.

One of the representative new technologies is Augmented Reality (AR).

However, not many people are confused with Virtual Reality (VR) and Augmented Reality. Virtual reality uses virtual images rather than reality (object), background, and environment, whereas Augmented Reality (AR) is a technology that displays a 3D virtual image as a single image by overlaying it with a real image or background. to be.

In addition, augmented reality is also called mixed reality (Mixed Reality, MR), augmented reality was introduced to the world for the first time by adding virtual images to airplane assembly processes around 1990 by airplane manufacturer Boeing.

Augmented reality and virtual reality seem to be similar to each other, but they are clearly divided according to whether the subject is virtual or real. As a computer game, for example, in a virtual reality fighting game, a character on behalf of me confronts a virtual enemy in a virtual space, but an augmented reality fighting game is a form in which I in reality compete with a virtual enemy in a real space.

Therefore, augmented reality has a feature that is superior to reality than virtual reality. In addition, virtual reality is generally used only in special environments such as the movie or video field, but augmented reality is currently popularized to be widely used by the general public.

For example, map search and location search through the Internet are also included in augmented reality in a broad sense. However, since a computer is difficult to use while on the move, augmented reality technology for portable devices such as the mobile terminal 100 and a tablet PC is receiving attention.

Augmented Reality (AR) is a technology that superimposes a virtual image on the real world that a user sees, and it is also called Mixed Reality (MR) because it shows a virtual world with additional information in the real world as a single image. .

Recently, as functions of a portable terminal are diversified, augmented reality technology has been developed to combine virtual information with an image input through a camera and provide it to a user. For example, after acquiring location information through a GPS receiver in the portable terminal, a function for acquiring virtual information corresponding to the location of the portable terminal and combining it with an input image is provided to a user. However, since this augmented reality function provides virtual information corresponding to the location of the portable terminal, the virtual information may be information not related to the input image of the portable terminal.

Of course, recently, a technique in which a portable terminal transmits information of an object included in an input image to a server and then downloads the result from the server and provides it to a user is provided. For example, after transmitting the information about the print book to the server, after transmitting the appearance, image and price of the technology or product for downloading the digital content for the print book from the server to the server, the product from the server A technique for downloading information about is provided.

However, these technologies have a disadvantage in that they are difficult to apply to other objects because the target object and use are limited to one.

Korean Patent Application No.: 1020150095848 Korean Patent Application No.: 1020160140725 Korean Patent Application No.: 1020110111857 Korean Patent Application No.: 1020170099051

The platform service system for providing MR graphic support contents and its driving method of the present invention have been devised to solve the problems of the prior art, and the first object of the present invention is to use the MR camera of the communication terminal for MR image play. If you want to take a video or take a picture by entering the photo line area provided in a travel destination, etc., grasp the GPS location information recognized from the photo line area, and provide multiple VR (Virtual Reality) / AR (Augmented Reality) / MR (MR) provided from the management server. Mixed Reality), one-on-one focused focusing on a selected one of a plurality of VR / AR / MR images and a real screen from the MR camera, and then simultaneously displaying it through the display window of the communication terminal for MR video play. , Communication between users using authentication shots (pictures, videos) at domestic and foreign tourist spots, events, events, etc. Through my placing in the yard and the open market hwaham portal focused fits multiple MR reality on the world market is to establish a beachhead in the new business Tues deserves a 4 car industry.

In addition, the second object of the present invention is to find a way to utilize big data such as multiple VR (Virtual Reality) / AR (Augmented Reality) / MR (Mixed Reality) videos and multiple VR / AR / MR images. , MR / AR / VR reality technology can be easily used by the general public as a popularized content, while maximizing the use rate of the more advanced platform and maximizing the expectation of the profit generation of related companies and interested in the 4th industry The goal is to make a leap forward as a developed country that will lead the 4th industry that can preoccupy the world market by preparing a breakthrough turning point that can encourage the development of many related companies.

The present invention for achieving the above object includes the following configuration.

That is, the platform service system for providing MR graphic support contents according to an embodiment of the present invention enters a photoline area prepared for a tourist destination, a tour site, an academic conference hall, a memorial hall, a museum, a festival hall, a restaurant, and photographs a video using an MR camera Or, if you want to take a picture, the pre-installed MR (Mixed Reality) graphic support content is automatically driven to automatically transmit the GPS location information recognized from the photoline area to the wired / wireless communication network, and multiple VR (Virtual Reality) / AR ( Of the Augmented Reality) / MR (Mixed Reality) videos and multiple VR / AR / MR images, one of the highest priority selected by 1: 1 matching with the GPS location information in advance is matched with the actual screen displayed on the MR camera Control the MR camera's video shooting or photo shooting operation with the MR graphics supported content to be displayed simultaneously. A communication terminal for MR imaging play; And extracting the selected one from a plurality of VR / AR / MR videos and a plurality of VR / AR / MR images stored in a VLDB (Very Large Database) by receiving the GPS location information in real time through the wired / wireless communication network. It delivers the graphic contents in real time, and when receiving replacement commands for the selected one other than the selected one from the MR video play communication terminal, the multiple VR / AR / MR videos and multiple VR / AR / MR And a management server that calls the other selected one randomly assigned in the next order of the highest priority among the images and delivers it in real time to the MR graphic support content.

In addition, the method of driving the platform service system for providing MR graphic support contents according to an embodiment of the present invention is a communication line for MR video play, a photo line prepared for a tourist destination, a visit, a conference hall, a memorial hall, a museum, a festival hall, and a restaurant. If you want to enter a region to take a video or take a picture using an MR camera, automatically driving the preinstalled MR (Mixed Reality) graphic support content and automatically transmitting GPS location information recognized from the photoline area to the wired or wireless communication network. ; The management server receives the GPS location information in real time through the wired / wireless communication network and extracts the selected one from a plurality of VR / AR / MR videos and a plurality of VR / AR / MR images stored on a Very Large Database (VLDB). Delivering in real time to the MR graphic support content; The MR video play communication terminal performs 1: 1 matching with the GPS location information in advance among multiple VR (Virtual Reality) / AR (Augmented Reality) / MR (Mixed Reality) videos and multiple VR / AR / MR images Controlling a video recording or photographing operation of the MR camera with the MR graphics-supported content such that any selected one of the highest priority placed is aligned with the actual screen displayed by the MR camera and displayed simultaneously; And when the management server receives a replacement command for the selected one other than the selected one from the MR video play communication terminal, the highest priority among the plurality of VR / AR / MR videos and the plurality of VR / AR / MR images. And calling the other selected one randomly assigned in the next order of ranking to deliver the MR graphic-supported content in real time.

The platform service system for providing MR graphic support contents of the present invention and its driving method are to use the MR camera of the MR video play communication terminal to enter a photoline area provided in a tourist destination or the like to take a video or take a picture, a photoline By grasping the GPS location information recognized from the area, and selecting any one of a number of panoramic videos and virtual VR / AR / MR images in the form of multiple virtual reality (VR) / augmented reality (AR) / mixed reality (MR) provided from the management server A community between users who use authentication shots (pictures, videos) at domestic and foreign tourist destinations, events, and events by focusing the actual screen displayed on the MR camera 1: 1 and then simultaneously displaying it through the display window of the communication terminal for MR video play. Combining Madang with an open market to bring MR reality-oriented portal site to the global market Through this, it gives the first effect to prepare a bridgehead for new commercialization suitable for the fourth industry.

In addition, the present invention is to find a way to utilize big data such as multiple VR (Virtual Reality) / AR (Augmented Reality) / MR (Mixed Reality) videos and multiple VR / AR / MR images, MR / AR / VR reality technology can be easily used by the general public as a popularized content, and by maximizing the utilization rate of the more advanced platform, it inspires expectations for the profit generation of related companies and many related companies interested in the 4th industry. It provides a second turning point to make a leap forward as a developed country that will lead the 4th industry that can dominate the world market by establishing a breakthrough turning point to encourage technology development.

1 is a diagram illustrating a platform service system for providing MR graphic support content according to an embodiment of the present invention.
2 is another diagram showing a platform service system for providing MR graphic support contents according to an embodiment of the present invention.
FIG. 3 is an actual photograph of a state in which the MR reality is implemented through a display window by driving the MR graphic support content mounted in the platform service system for providing MR graphic support content according to an embodiment of the present invention.
4 is a flowchart illustrating a method of driving a platform service system for providing MR graphic support contents according to an embodiment of the present invention.

[Example]

Hereinafter, with reference to the accompanying drawings, an embodiment of the present invention will be described in detail.

1 is a diagram illustrating a platform service system for providing MR graphic support content according to an embodiment of the present invention.

Referring to FIG. 1, the platform service system 1000 for providing MR graphic support contents enters a video line area 160 provided in a tourist destination or the like by using the MR camera 300 of the communication terminal 100 for MR video play, or a video or In order to take a picture, the VR (Virtual Reality) / AR (Augmented Reality) / MR (Mixed Reality) video 170 provided from the management server 200 as the GPS location information recognized from the photoline area 160 is grasped ) Or VR / AR / MR image 170 is focused 1: 1 with the actual screen displayed on the MR camera 300, and then simultaneously displayed through the display window of the communication terminal 100 for MR image play. , MR communication terminal for video play 100 and a management server 200.

As can be seen in FIG. 3, the MR image communication communication terminal 100 enters the MR camera 300 in the photoline area 160 prepared for tourist destinations, field trips, academic conferences, memorials, museums, festivals, and restaurants. If you want to take a video or take a picture by using it, the pre-installed MR (Mixed Reality) graphic support content 150 is automatically driven to automatically transmit the GPS location information recognized from the photoline area 160 to the wired or wireless communication network.

The communication terminal 100 for MR video play includes GPS location information among a plurality of Virtual Reality (VR) / Augmented Reality (AR) / Mixed Reality (MR) video 170 and a plurality of VR / AR / MR images 170. MR camera (300) so that any one of the highest-priority selected one-to-one matching (ex: a video or image of a whale jumping up to the surface and jumping ) is aligned with the actual screen displayed on the MR camera 300 and displayed simultaneously. ) Is controlled by the MR graphic support content 150 for video or photo shooting.

Here, the MR graphic support content 150 according to an embodiment of the present invention is a 2D, 3D self-produced AR (Augmented Reality) image, a VR (Virtual Reality) image, or an MR image in which an AR image and a VR image are mixed and viewed. Is received from the management server 200, and overlaps with the actual screen.

That is, the MR graphic support content 150 includes a virtual reality image medium 170, an augmented reality image medium 170, or a mixed reality image medium 170 overlapping the real screen and the real screen shot through the MR camera 300. The 2D, 3D high-definition graphic state is supported in real time to be displayed through the display window of the MR video play communication terminal 100.

The MR graphic support content 150 is a GPS among a plurality of VR / AR / MR videos and a plurality of VR / AR / MR images from the management server 200 when a visited area or a visited place in which a photoline area exists is pre-registered. It is possible to download and store any number of random ones that match 1: 1 with location information.

In another embodiment, the MR graphic support content 150 of the present invention is connected to a wired / wireless communication network with aerial location information of the drone 400 floating around the photoline area 160 as shown through FIG. 2. Transfer to the management server 200.

The MR graphic support content 150 includes at least one selected VR / AR / MR video 170 and at least one selected VR / AR / MR image 170 in which the aerial location information is matched 1: 1 in advance, and the drone The drone image 180 that is actually photographed or being photographed using the 400 is overlapped.

The MR graphic support content 150 externally displays the drone type virtual reality image medium, the drone type augmented reality image medium, or the drone type mixed reality image medium regenerated due to the overlap using the MR camera 300.

The management server 200 receives GPS location information in real time through a wired / wireless communication network, and stores a number of VR / AR / MR videos 170 and a number of VR / AR / MR stored on a Very Large Database (VLDB) 250. The selected one of the images 170 is extracted and transmitted to the MR graphic support content 150 in real time.

When the management server 200 receives a replacement command for one selected other than the one selected from the communication terminal 100 for MR video play, a plurality of VR / AR / MR videos 170 and a plurality of VR / AR / MR The other selected one randomly assigned in the following order of the highest priority among the images 170 is called and transmitted to the MR graphic support content 150 in real time.

Management server 200 of the public terminal, public enterprises, private enterprises, a number of promotional phrases, advertisement phrases, notification phrases, event phrases, or other selected ones that have been requested by the MR video play communication terminal 100 of the Transmit according to the approval.

 When the MR server 200 does not approve the MR video play communication terminal 100, the management server 200 separately transmits a selected one including a plurality of promotional phrases, advertisement phrases, notification phrases, and event phrases.

The management server 200 provides an online voucher for the communication terminal 100 for MR video play that has been approved, supports communication fee, supports real-time update of MR graphic support content 150, and discounts on admission fees charged at the visited area or at the place of visit , Grants exemption benefits.

Although described above with reference to the preferred embodiments of the present invention, those skilled in the art may variously modify and change the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. You can understand that you can. (Dr. Seong-Hyun Seo, Technical Support)

1000: MR graphic support platform service system for contents provision
100: MR video play communication terminal 200: management server
300: MR camera 400: drone
150: MR graphic support contents

Claims (8)

If you want to take a video or take a picture using an MR camera in a photoline area prepared for tourist destinations, field trips, academic conferences, memorial halls, museums, festivals, and restaurants, automatically install the pre-installed MR (Mixed Reality) graphic support contents Drive to automatically transmit the GPS location information recognized from the photoline area to the wired / wireless communication network, and among multiple VR (Virtual Reality) / AR (Augmented Reality) / MR (Mixed Reality) videos and multiple VR / AR / MR images The MR graphics support the video shooting or photo shooting operation of the MR camera so that the selected one of the highest priority that has been matched 1: 1 with the GPS location information is focused and displayed simultaneously with the actual screen displayed on the MR camera. MR video play communication terminal controlled by content; And
The MR graphic is extracted by extracting the selected one of a plurality of VR / AR / MR videos and a plurality of VR / AR / MR images stored in a VLDB (Very Large Database) in real time by receiving the GPS location information through the wired / wireless communication network. When delivering replacement contents for the selected one other than the selected one from the communication terminal for playing the MR image in real time and transmitting the supported content in real time, the plurality of VR / AR / MR videos and multiple VR / AR / MR images A platform service system for providing MR graphic-supported content, including a management server that calls the other selected one randomly assigned in the next order of the highest priority and delivers the MR-graphically supported content in real time.
According to claim 1, The MR graphics support content,
MR graphics support characterized by overlapping the self-made 2D, 3D AR (Augmented Reality) image, VR (Virtual Reality) image, or the MR image seen by mixing the AR image and VR image so that it overlaps the real screen. Platform service system for content provision.
According to claim 1, The MR graphics support content,
Realizing the virtual reality image medium, augmented reality image medium or mixed reality image medium regenerated by overlapping with the real screen through the MR camera,
When pre-registering a visited area or a visited place where the photoline area exists, 1: 1 matching with the GPS location information among the multiple VR / AR / MR videos and multiple VR / AR / MR images from the management server A platform service system for providing MR graphic-supported content, wherein a plurality of random ones can be downloaded and stored.
According to claim 1, The MR graphics support content,
The aerial location information on which the drone is floating is transmitted to a management server pre-connected to the wired / wireless communication network based on the vicinity of the photoline area.
Overlap the at least one selected VR / AR / MR video and at least one selected VR / AR / MR image, which are 1: 1 matched with the aerial location information in advance, and a drone image actually taken or shot using the drone A platform service system for providing MR graphic-supported content, characterized by letting it.
According to claim 4, The MR graphics support content,
A platform service system for providing MR graphics-supported content, characterized by externally displaying a drone type virtual reality image medium, a drone type augmented reality image medium, or a drone type mixed reality image medium regenerated due to the overlap using the MR camera.
The method of claim 1, wherein the management server,
Transmitting the selected one or the other selected one including a plurality of promotional phrases, advertisement phrases, notification phrases, and event phrases requested by public institutions, public corporations, and private enterprises according to the approval of the communication terminal for MR video play, ,
When the communication terminal for MR video play is disapproved, the platform for providing MR graphic support content, characterized in that the selected one or the other selected one including the plurality of promotional phrases, advertisement phrases, notification phrases, and event phrases are separately transmitted. Service system.
The method of claim 6, wherein the management server,
Characterized in that it provides an online voucher, communication fee support, real-time update of the MR graphic-supported content, discounts on admission fees charged at a visited area or a visited place, and exemption benefits for a communication terminal for MR video play determined by the approval. A platform service system for providing MR graphic support contents.
If the communication terminal for MR video play enters the photoline area prepared for tourist destinations, field trips, academic conferences, memorials, museums, festivals, and restaurants, if you want to take videos or take photos using the MR camera, the pre-installed MR (Mixed Reality) automatically driving graphic-supported content to automatically transmit GPS location information recognized from the photoline area to a wired or wireless communication network;
The management server receives the GPS location information in real time through the wired / wireless communication network and extracts the selected one from a plurality of VR / AR / MR videos and a plurality of VR / AR / MR images stored on a Very Large Database (VLDB). Delivering in real time to the MR graphic support content;
The MR video play communication terminal performs 1: 1 matching with the GPS location information in advance among multiple VR (Virtual Reality) / AR (Augmented Reality) / MR (Mixed Reality) videos and multiple VR / AR / MR images Controlling a video recording or photographing operation of the MR camera with the MR graphics-supported content such that any selected one of the highest priority placed is aligned with the actual screen displayed by the MR camera and displayed simultaneously; And
When the management server receives a replacement command for the selected one other than the selected one from the communication terminal for playing the MR image, the highest priority among the multiple VR / AR / MR videos and multiple VR / AR / MR images And invoking the other selected one randomly assigned in the following order to deliver the MR graphic-supported content in real time.

Images