KR102492985B1 - A digital theme park implementation system that provides a digital twin-based metaverse - Google Patents

Abstract

The present invention aims to implement a digital theme park which provides a plurality of pieces of digital content including a metaverse space to visitors, and relates to a digital theme park implementation system which provides a digital twin-based metaverse, the digital theme park implementation system comprising: a metaverse providing unit for providing a metaverse space which connects on-site visitors and online visitors; and a media façade providing unit which provides a media façade which interacts with visitors. The metaverse providing unit provides digital content, in which traces of the online visitors are exposed to the on-site visitors, and provides the metaverse space which is connected with the online visitors through a metaverse experience device that can be used by the on-site visitors.

Description

A digital theme park implementation system that provides a digital twin-based metaverse}

The present invention relates to a digital theme park implementation system that provides a digital twin-based metaverse, and more particularly, to a digital theme park implementation technology for providing various digital contents including a metaverse.

Recently, interest and demand for technologies related to the metaverse are increasing, and accordingly, development to apply the metaverse to various fields in real life is being actively conducted. Representatively, the game industry aims to disseminate new content that allows users located in remote locations to enjoy cooperative games using the metaverse space.

On the other hand, even if the metaverse environment is created for any purpose, it may take a long time to implement a metaverse environment in which activities in the virtual space are perfectly synchronized with reality, and even if the implementation is successful, there are various limitations in the reality where there is substance. Therefore, there is a problem that is difficult to maintain for a long time, so the need for a metaverse environment in which anyone can participate at any time while being implemented with a high degree of completion is emerging.

Accordingly, the inventor of the present invention has completed the present invention after long research and development through trial and error in order to solve such problems.

In order to solve the problems described above, the present invention provides various digital contents including a metaverse space, and aims to implement a digital theme park in which anyone can continuously participate without time and space limitations if they want to experience. .

In addition, in order to solve the above problems, the present invention creates a virtual projection surface in a virtual space, looks at the virtual projection surface, and renders using a viewing point created at a position corresponding to the viewer's viewing position. An object of the present invention is to provide a device that performs rendering optimized for a spectator's point of view in a specific location in order to provide ultra-realistic content.

One aspect of the present invention for solving the above problems is to implement a digital theme park that provides a plurality of digital contents including a metaverse to visitors,

A metaverse provision unit for providing a metaverse space that links on-site and online visitors; and

A media facade providing unit that provides a media facade that interacts with the audience;

The metaverse providing unit,

It is possible to provide on-site visitors with digital content that exposes the traces of online visitors, and provide a metaverse space that is linked to online visitors through metaverse experience devices available to on-site visitors.

In a preferred embodiment, the metaverse providing unit,

A trace object that can check the movement of online visitors participating in the metaverse in real time can be provided in the real space where the metaverse space is implemented.

In a preferred embodiment, the metaverse providing unit,

By providing a metaverse space where coordinate mapping has been performed to realize the real space of the digital theme park and the virtual space accessible from outside the digital theme park at the same ratio, online visitors accessed through the virtual space are realized in the same size and shape as the real thing. virtual object to be experienced.

In a preferred embodiment, the media facade providing unit,

When the on-site visitor approaches the provided media facade or is positioned on the media facade, images constituting the media facade may be changed in real time based on location information of the on-site visitor.

In a preferred embodiment, the metaverse providing unit and the media facade providing unit,

Providing digital content to the exhibition space of the digital theme park through image projection,

A projected image may be provided from a rendering device that implements the digital content as ultra-realistic content based on the viewpoint of an on-site visitor located in the exhibition space.

In a preferred embodiment, the rendering execution device,

As performing image rendering through a separately implemented virtual space,

an exhibition object creation unit that creates a three-dimensional exhibition object in a virtual space;

a photographing object creation unit generating a photographing object for photographing an exhibition object at a specific location in a virtual space;

a virtual projection surface generating unit generating a virtual projection surface on which a scene captured by a photographing object is output in a virtual space;

a viewing viewpoint generating unit generating a viewing viewpoint looking at a virtual projection surface in a virtual space;

a rendering unit that remodels an exhibition object based on the set viewing viewpoint;

a location information receiving unit receiving location information of visitors located in the exhibition space; and

A projection image transmission unit for transmitting a scene captured by the shooting object to an image projection device in an exhibition space in real time;

The rendering unit,

A reference projection image to be provided to the viewer is received from the photographing object, and the exhibition object is remodeled so that an exhibition object having a sense of identity with the exhibition object appearing in the reference projection image is output when looking at the virtual projection surface at the viewing point of view. can do.

The present invention provides various digital contents including the metaverse space, and if you want to experience it, you can implement a digital theme park in which anyone can continuously participate without time and space restrictions.

Since the present invention can create a digital theme park using digital contents implemented as projection images, it does not require a large or multiple display devices, and has an effect of creating a digital theme park at low cost.

The present invention has an effect of enabling ultra-realistic content to be implemented with a high level of perfection by using a projection image that is not distorted according to the viewer's point of view.

The present invention has an effect of performing rendering of an exhibition object in real time based on a viewer's point of view.

1 and 2 are block diagrams showing the configuration of a digital theme park implementation system that provides a digital twin-based metaverse according to the present invention.
3 to 5 are reference diagrams for explaining digital contents provided in a digital theme park implemented according to the present invention.
6 is a reference diagram for explaining ultra-realistic content provided through rendering using a conventional perspective projection technique.
7 is a configuration diagram for explaining a rendering system according to the present invention.
8 and 9 are block diagrams showing the configuration of a rendering apparatus according to the present invention.
10 and 11 are reference views illustrating scenes captured by a capturing object according to the present invention.
12 is a reference diagram for explaining an example of generating a virtual projection surface according to the present invention.

In describing the present invention, a detailed description thereof will be omitted if it is determined that a related known function may unnecessarily obscure the subject matter of the present invention as it is obvious to those skilled in the art.

1 and 2 are block diagrams showing the configuration of a digital theme park implementation system 200 (hereinafter referred to as an implementation system) that provides a digital twin-based metaverse according to the present invention.

First, referring to FIG. 1 , the implementation system 200 includes a metaverse providing unit 210 and a media facade providing unit 220 . The metaverse providing unit 210 and the media facade providing unit 220 can be said to be the main body that creates various digital contents provided to visitors in the digital theme park.

Also, referring to FIG. 2 , the implementation system 200 may further include a rendering device 100 . The rendering apparatus 100 provides the projected image on which the rendering has been performed to the metaverse providing unit 210 and the media facade providing unit 220, so that the metaverse providing unit 210 and the media facade providing unit 220 can achieve the image It allows users to create their own digital content through a projection device.

That is, the metaverse providing unit 210 and the media facade providing unit 220 may provide digital contents to the exhibition space of the digital theme park through image projection, and specifically, digital contents from the rendering device 100. by generating digital content by receiving projection images to realize hyper-realistic content based on the viewpoint of on-site visitors located in the exhibition space, ultimately providing digital content with the characteristics of ultra-realistic content to on-site visitors. do.

The metaverse providing unit 210 may provide a metaverse space in which on-site visitors and online visitors are interlocked. Specifically, the metaverse providing unit 210 provides digital content in which traces of online visitors are exposed to on-site visitors, and provides a metaverse space that is linked to online visitors through metaverse experience devices available to on-site visitors.

According to a preferred embodiment of the present invention, the metaverse providing unit 210 may provide a trace object that can check the movement of online spectators participating in the metaverse in real time to the real space where the metaverse space is implemented. In this regard, FIG. 3 is a reference diagram for explaining a part of digital content provided according to an embodiment of the present invention.

Referring to FIG. 3 , trace objects provided to the real space by the metaverse providing unit 210 may be checked. In addition, online visitors who access the metaverse online can visit the metaverse space provided in the exhibition space of the digital theme park, and can move within the metaverse space. The trace objects of online visitors moving within the metaverse space can be created through the above-described image projection device and directly exposed to on-site visitors, and on-site visitors who visit the metaverse space in reality can use their smartphones or AR provided by the digital theme park. Through devices, etc., you can directly check the avatars of online visitors who have visited the metaverse space. In addition, a part of the metabus space may be provided with a space where on-site and online visitors can communicate with each other. Specifically, the metaverse providing unit 210 may include a hologram generating device, and through the hologram generating device, it is possible to implement online spectators to face-to-face visitors. Conversely, online spectators will be able to face on-site spectators in the metaverse space through virtual space.

In addition, the metaverse providing unit 210 provides a metaverse space in which coordinate mapping has been performed to implement the real space of the digital theme park and the virtual space accessible from outside the digital theme park at the same ratio, thereby providing an online access through the virtual space. Visitors can experience a virtual object implemented in the same size and shape as the real thing. In this regard, FIG. 4 is a reference diagram for explaining a metaverse game that is part of digital content provided according to an embodiment of the present invention.

Figure 4 is an example of the case of implementing a metabus game by implementing Daejeon Expo Science Park as a digital theme park. A part of the metaverse space may be provided with a game space in which a metaverse game can be played as shown in FIG. 4 . The on-site spectators located in the game space can play the metaverse game in which the environment is synchronized through AR devices, and the online spectators participating in the game can play the virtual space implemented in the same ratio as the actual game space.

Here, according to a preferred embodiment of the present invention, the metaverse providing unit 210 and the media facade providing unit 220 may provide different digital contents to on-site visitors based on real time. Specifically, digital content including metaverse games can be provided through AR devices until the digital theme park or metaverse space is darkened. In addition, when the digital theme park or metaverse space is darkened, digital content is provided using an image projection device so that on-site visitors can enjoy digital content including metaverse games while watching the projected image projected on the structure of the digital theme park. can do.

The media facade providing unit 220 may provide a media facade that interacts with the audience. Here, media façade refers to a kind of digital content that provides various images by either attaching LEDs to a space that is easy to expose, such as the outer wall of a building, to make it look like a large screen, or projecting images.

According to a preferred embodiment of the present invention, the media facade providing unit 220 configures the media facade based on the location information of the on-site visitor when the on-site visitor approaches the provided media facade or is located on the media facade. The video can be changed in real time. In this regard, FIG. 5 is a reference diagram for explaining a media facade, which is a part of digital content provided according to an embodiment of the present invention.

5 shows a media façade implemented in the plaza of the digital theme park and provided to on-site visitors. Here, the media facade itself is implemented in reality, but online visitors to the digital theme park through the virtual space can also be provided with digital contents implemented identically to the media facade in reality in the virtual space. In addition, the media facade provided to the viewer may be provided as digital content representing the characteristics of ultra-realistic content through the rendering apparatus 100 described below.

Below, the rendering apparatus 100 for providing the rendered projection image to the metaverse providing unit 210 and the media facade providing unit 220 will be described.

6 is a reference diagram for explaining ultra-realistic content provided through rendering using a conventional perspective projection technique.

Referring to FIG. 6, when rendering is performed using a conventional perspective projection technique, rendering is optimized at a specific point in time, and when viewing a projected image, which is immersive content, the perspective and shape of an object are normally displayed without being distorted. there is. This method can be appropriately used when constructing realistic content by projecting an image between real structures installed in an exhibition space, as shown in FIG. 6(A). Since the viewer located between the above-mentioned actual structures watches the realistic content from a position within the range where the projected image is distorted and cannot be seen, it is possible to view the normal realistic content without discomfort as shown in FIG. 6(B). However, when realistic content is configured by applying this method in an exhibition space where a wider space is allowed for visitors, the projected image is distorted depending on the viewer's point of view, so the realistic content is not provided as intended. There is a problem with not being able to.

7 is a configuration diagram for explaining a rendering system according to the present invention.

Referring to FIG. 7 , the rendering system according to the present invention includes a terminal 10, an image projection device 20, and a device 100 that performs rendering optimized for a viewer's viewpoint at a specific location to provide ultra-realistic content ( Hereinafter referred to as a rendering execution device).

The terminal 10 is a device for transmitting the viewer's location information to the rendering device 100, and includes, for example, a smartphone carried by the viewer, a tag that performs a function of transmitting location information, and Other devices performing equivalent functions may be included. In general, each visitor has one terminal 10, and when there are a plurality of visitors located in the exhibition space, location information of a plurality of visitors may be transmitted to the rendering device 100.

The rendering apparatus 100 according to the present invention performs a rendering operation to represent an exhibition object implemented in 3D in a virtual space as a 2D plane based on the visitor location information transmitted from the terminal 10, and the result of the rendering operation The projection image may be provided to the image projection device 20 installed in the exhibition space. Here, when the ultra-realistic content provided to the viewer consists of multiple projected images, installation of a plurality of image projection devices (20-1, 20-2, 20-3...) may be required, and rendering is performed. The device 100 may also provide different projection images by performing rendering suitable for each image projection device 20 .

8 and 9 are block diagrams showing the configuration of the rendering apparatus 100 according to the present invention.

Referring to FIG. 8 , the rendering apparatus 100 according to the present invention includes an exhibition object generator 110, a photographing object generator 120, a virtual projection surface generator 130, a viewing viewpoint generator 140, and It is configured to include a rendering unit 150 . Also, referring to FIG. 9 , the rendering apparatus 100 according to an embodiment of the present invention may further include a location information receiver 160 and a projection image transmitter 170.

The exhibition object creation unit 110 may create a 3D exhibition object in a virtual space. Here, the exhibition object may be created based on exhibition object data directly input from the user terminal to the rendering apparatus 100 . In addition, the exhibition object is a virtual object constituting a projected image projected on an exhibition space to implement ultra-realistic content, and does not mean only a specific object, but may mean all virtual objects modeled on the virtual space. For example, (B) of FIG. 6 shows an actual projected image, and includes an exhibition object composed of a rock structure, implemented weather, and the ground.

The capturing object creation unit 120 may create a capturing object for capturing an exhibition object at a specific location in the virtual space. The photographing object is created for the purpose of photographing the projected image itself to be projected onto the exhibition space, and it is possible to determine which projected image to project into the exhibition space according to the position of the photographed object that is changed based on a user input. In this regard, FIGS. 10 and 11 are reference views illustrating a scene captured by the capturing object 121 according to the present invention. Referring to FIGS. 10 and 11, (A) is a third-person view of a photographing object 121 photographing exhibition objects 111-1, 111-2, and 111-3 implemented in a virtual space. (B) shows a scene captured from the viewpoint of the photographing object 121 (ie, a projection image provided to the exhibition space). Comparing FIGS. 10 and 11 , as the photographing position of the photographing object 121 changes, the positions and shapes of the photographed exhibition objects 111-1, 111-2, and 111-3 also change.

The virtual projection surface generating unit 130 may generate a virtual projection surface on which a scene captured by a photographing object is output in a virtual space. The virtual projection surface is for checking the distortion state of the projection image, which may appear distorted according to the position of the viewer located in the exhibition space, and correcting the distortion by remodeling the exhibition object according to the checked result.

In one embodiment, the virtual projection surface may be created in a separate virtual space in which a coordinate system is configured to correspond to the exhibition space. Specifically, a virtual space in which the above-described exhibition object and photographing object are implemented may be defined as a first virtual space, and a virtual space in which a virtual projection surface is implemented may be defined as a second virtual space. In this regard, FIG. 7 is a reference diagram for explaining an example of generating a virtual projection surface 131 according to the present invention.

Referring to FIG. 12, (B) of FIG. 12 is a second virtual space in which a virtual projection surface 131 is created, and in the second virtual space, a scene (projected image) output on the virtual projection surface 131 is actually displayed. An exhibition auxiliary object ((B) of FIG. 12) capable of simulating a situation when projected on an exhibition space may be implemented. As in the example of FIG. 1 described above, realistic content using an image projection method may be configured like a real structure provided in an exhibition space, and the exhibition auxiliary object plays the same role as the real structure in a second virtual space, Allows the user to simulate the ultra-realistic content to be provided to the audience before displaying it (see FIG. 12(A)). As described above, since the coordinate system of the second virtual space is configured to correspond to the actual exhibition space, there is an advantage in that the exhibition auxiliary object and the virtual projection surface 131 can be implemented and simulated in the same ratio as the actual size.

In one embodiment, the virtual projection surface generating unit 130 may implement and apply a texture to the virtual projection surface to be created. Specifically, the image projection surface of the exhibition space on which the projected image is projected may exhibit a specific texture to realize ultra-realistic content, and this texture can also be applied in virtual space to simulate the projected image. For example, when an exhibition object including a ground made of sand or gravel is photographed in a state in which the texture of the virtual projection surface is implemented and applied as a rough texture, a more realistic projection image can be provided.

The viewing viewpoint generating unit 140 may create a viewing viewpoint looking at a virtual projection surface in a virtual space. The viewing point is to check what kind of distortion occurs compared to the projected image to be displayed when looking at the virtual projection surface from a specific position in the virtual space. According to the above-described embodiment, as the virtual projection surface is created in the second virtual space, the viewing viewpoint is also created in the second virtual space. In addition, since the viewpoint of viewing is created on the second virtual space in which the coordinate system is configured to correspond to the actual exhibition space, distortion when viewing the projected image constituting the ultra-realistic content from the viewer's position in the actual exhibition space can be confirmed. let it be The distortion confirmed through the above process is corrected through the rendering unit 150, and details thereof will be described later.

According to a preferred embodiment of the present invention, the viewing viewpoint generation unit 140 creates a viewing viewpoint at virtual space coordinates (second virtual space coordinates) corresponding to the position of the visitor located in the exhibition space, and creates a viewing viewpoint in the virtual space (second virtual space coordinates). The viewing point created in the virtual space) is moved in real time based on the location information of the viewer located in the exhibition space. Accordingly, even if the viewer moves within the exhibition space, a projection image corrected in real time based on the movement position can be provided to the exhibition space.

In addition, when a plurality of visitors are located in the exhibition space, the viewing viewpoint generation unit 140 may generate a viewing viewpoint based on average location information calculated for the crowd of visitors. Specifically, in the case where several visitors watch a projection image at their respective locations in the same exhibition space, it is difficult to provide a perfectly calibrated projection image for each viewer. Therefore, a method of generating a viewing point by calculating an average position for the clustered spectators can be applied.

The rendering unit 150 may remodel the exhibition object based on the set viewing viewpoint. Here, the rendering unit 150 receives a reference projection image to be provided to the viewer from the photographing object, and has a sense of identity with the exhibition object appearing in the reference projection image when looking at the virtual projection surface at the generated viewing point. The exhibition object may be remodeled so that the exhibition object is output. Here, remodeling of an exhibition object whose distortion is confirmed on the virtual projection surface according to the location of the viewing point is performed based on information about the exhibition object appearing in the reference projection image. The exhibition object information may include contrast, color, location, and shape information of the exhibition object.

In one embodiment, the rendering unit 150 may perform remodeling that changes at least one of the position, shape, and color of the exhibition object using an off-axis projection method, and through this, in particular, the projection image It is possible to remove the sense of heterogeneity of the viewer's projected image by correcting the sense of perspective.

As a result, after the exhibition object remodeling is performed by the rendering unit 150, the distorted exhibition object appears on the scene captured by the shooting object or on the virtual projection surface, and the projected image including the exhibition object is distorted according to the viewing point of view. It is provided in this exhibition space to realize ultra-realistic content.

The location information receiving unit 160 may receive location information of visitors located in the exhibition space. For example, location information may be directly received from the terminal 10 (see FIG. 7) through wireless communication, and location information of a spectator may be received from a separately provided location information collection device.

The projected image transmission unit 170 may transmit the scene captured by the object to the image projection device 20 (see FIG. 7) in the exhibition space in real time. In summary, the process from receiving the location information of the visitor to generating and moving the viewing point, rendering, and transmitting the shooting scene (projection image) to the image projection device 20 is performed in real time, providing ultra-realistic content in the exhibition space. to be implemented.

It is apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the characteristics of the present invention. Accordingly, the above detailed description should not be construed as limiting in all respects and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (6)

It is intended to implement a digital theme park that provides a plurality of digital contents including the metaverse to visitors,
A metaverse provision unit for providing a metaverse space that links on-site and online visitors; and
Including; a media facade providing unit that provides a media facade that interacts with on-site visitors,
The metaverse providing unit,
It is characterized by providing on-site visitors with digital content that exposes the traces of online visitors and providing a metaverse space that is linked to online visitors through metaverse experience devices available to on-site visitors.
The metaverse providing unit and the media facade providing unit,
Providing digital content to the exhibition space of the digital theme park through image projection,
Receive a projected image from a rendering device that implements the digital content as ultra-realistic content based on the point of view of an on-site visitor located in the exhibition space;
The rendering execution device,
As performing image rendering through a separately implemented virtual space,
an exhibition object creation unit that creates a three-dimensional exhibition object in a virtual space;
a photographing object creation unit generating a photographing object for photographing an exhibition object at a specific location in a virtual space;
a virtual projection surface generating unit generating a virtual projection surface on which a scene captured by a photographing object is output in a virtual space;
a viewing viewpoint generating unit generating a viewing viewpoint looking at a virtual projection surface in a virtual space;
a rendering unit that remodels an exhibition object based on the generated viewing viewpoint;
a location information receiving unit for receiving location information of visitors located in the exhibition space; and
A projection image transmission unit for transmitting a scene captured by the shooting object to an image projection device in an exhibition space in real time;
The rendering unit,
A reference projection image to be provided to the viewer is received from the photographing object, and the exhibition object is remodeled so that an exhibition object having a sense of identity with the exhibition object appearing in the reference projection image is output when looking at the virtual projection surface at the viewing point of view. to do,
A digital theme park implementation system that provides a digital twin-based metaverse. According to claim 1,
The metaverse providing unit,
It is characterized by providing a trace object that can check the movement of online visitors participating in the metaverse in real time to the real space where the metaverse space is implemented.
A digital theme park implementation system that provides a digital twin-based metaverse. According to claim 1,
The metaverse providing unit,
By providing a metaverse space where coordinate mapping has been performed to realize the real space of the digital theme park and the virtual space accessible from outside the digital theme park at the same ratio, online visitors accessed through the virtual space are realized in the same size and shape as the real thing. Characterized in enabling the experience of the virtual object that has been created,
A digital theme park implementation system that provides a digital twin-based metaverse. According to claim 1,
The media facade providing unit,
Characterized in that, when the on-site visitor approaches the provided media facade or is located on the media facade, the image constituting the media facade is changed in real time based on the location information of the on-site visitor.
A digital theme park implementation system that provides a digital twin-based metaverse. delete delete

Images