KR102492989B1 - A digital theme park simulation device that provides a digital twin-based metaverse - Google Patents

Abstract

The present invention relates to a digital theme park simulation device for providing a digital twin-based metaverse, which is to perform a digital theme park virtual simulation that provides a plurality of pieces of digital content including a metaverse to visitors. The digital theme park simulation device comprises: a modeling unit for creating a virtual model for a digital theme park and a digital content creation device in a virtual space; a projection mapping unit for performing pre-visualization of digital content provided to visitors through an exhibition space in the digital theme park; and a scenario simulation unit for creating a scenario for each digital content provided by the digital theme park and performing a simulation based on the created scenario and the virtual model.

Description

A digital theme park simulation device that provides a digital twin-based metaverse

The present invention relates to a digital theme park simulation device providing a digital twin-based metaverse, and more particularly, to a digital content simulation technology capable of simulating digital content provided by a digital theme park using a virtual space. will be.

Recently, interest and demand for technologies related to the metaverse are increasing, and accordingly, development to apply the metaverse to various fields in real life is being actively conducted. Representatively, the game industry aims to disseminate new content that allows users located in remote locations to enjoy cooperative games using the metaverse space.

On the other hand, even if the metaverse environment is created for any purpose, it may take a long time to implement a metaverse environment in which activities in the virtual space are perfectly synchronized with reality, and even if the implementation is successful, there are various limitations in the reality where there is substance. Therefore, there is a problem that is difficult to maintain for a long time, so it can be said that there is a need for a digital cultural space that is implemented with a high degree of completion and that anyone can participate at any time.

In addition, in order to create a digital cultural space that provides digital contents, not only difficulties arise due to the development of the metaverse environment, but also problems related to equipment and costs put into the real space, so implementation of facilities and scenarios for providing digital contents It is necessary to precede the simulation that makes the back go smoothly.

Accordingly, the inventor of the present invention has completed the present invention after long research and development through trial and error in order to solve such problems.

In order to solve the problems described above, the present invention is a digital theme park that provides a digital twin-based metaverse that can pre-visualize digital content provided in the digital theme park and perform scenarios applied to each digital content in advance. It is an object of the present invention to provide a simulation execution device.

One aspect of the present invention for solving the above problems is to perform a virtual simulation of a digital theme park that provides a plurality of digital contents including a metaverse to visitors,

a modeling unit for generating a virtual model for a digital theme park and a digital content generating device in a virtual space;

A projection mapping unit that performs pre-visualization of digital content provided to visitors through an exhibition space in a digital theme park; and

A scenario simulation unit for generating scenarios for each digital content provided by the digital theme park and performing simulation based on the generated scenarios and virtual models.

In a preferred embodiment, the modeling unit,

A virtual model for the exhibition space, an image projection surface for generating digital content in the exhibition space, and an image projection device may be created.

In a preferred embodiment, the projection mapping unit,

Projection mapping can be performed using the image projection surface and the image projection device created as a virtual model, and a user interface for visualizing and outputting the projection mapping process can be provided to the user terminal.

In a preferred embodiment, the scenario simulation unit,

A scenario simulation is performed on the pre-visualized digital content so that the digital content provided to the audience can be checked through the user terminal according to the progress of the scenario.

In a preferred embodiment, the projection mapping unit,

A projection image necessary for pre-visualization of the digital content may be provided from a rendering device that implements the digital content as ultra-realistic content based on the viewpoint of an on-site visitor located in the exhibition space.

In a preferred embodiment, the rendering execution device,

As performing image rendering through a separately implemented virtual space,

an exhibition object creation unit that creates a three-dimensional exhibition object in a virtual space;

a photographing object creation unit generating a photographing object for photographing an exhibition object at a specific location in a virtual space;

a virtual projection surface generating unit generating a virtual projection surface on which a scene captured by a photographing object is output in a virtual space;

a viewing viewpoint generating unit generating a viewing viewpoint looking at a virtual projection surface in a virtual space; and

A rendering unit for remodeling an exhibition object based on the set viewing point of view;

The rendering unit,

A reference projection image to be provided to the viewer is received from the photographing object, and the exhibition object is remodeled so that an exhibition object having a sense of identity with the exhibition object appearing in the reference projection image is output when looking at the virtual projection surface at the viewing point of view. can do.

The present invention has an advantage of pre-visualizing digital content provided in a digital theme park and performing scenarios applied to each digital content in advance.

The present invention has the effect of minimizing the time and cost required to create a digital theme park later by implementing digital contents provided through the structure and exhibition space of each exhibition space included in the digital theme park in advance in a virtual space. .

The present invention has an effect of enabling ultra-realistic content to be implemented with a high level of perfection by using a projection image that is not distorted according to the viewer's point of view.

The present invention has an effect of performing rendering of an exhibition object in real time based on a viewer's point of view.

1 and 2 are block diagrams showing the configuration of a digital theme park simulation device providing a digital twin-based metaverse according to the present invention.
3 to 5 are reference diagrams for explaining a simulation process of digital content provided in a digital theme park.
6 is a reference diagram for explaining ultra-realistic content provided through rendering using a conventional perspective projection technique.
7 is a configuration diagram for explaining a rendering system according to the present invention.
8 and 9 are block diagrams showing the configuration of a rendering apparatus according to the present invention.
10 and 11 are reference views illustrating scenes captured by a capturing object according to the present invention.
12 is a reference diagram for explaining an example of generating a virtual projection surface according to the present invention.

In describing the present invention, a detailed description thereof will be omitted if it is determined that a related known function may unnecessarily obscure the subject matter of the present invention as it is obvious to those skilled in the art.

1 and 2 are block diagrams showing the configuration of a simulation performing device 300 (hereinafter referred to as a simulation performing device) of a digital theme park that provides a digital twin-based metaverse according to the present invention.

First, referring to FIG. 1 , a simulation device 300 includes a modeling unit 310, a projection mapping unit 320, and a scenario simulation unit 330, and provides a user interface to the user terminal 30. And, simulation may be performed based on a user input through a user interface provided to the user terminal 30 .

In addition, referring to FIG. 2 , the simulation performing device 300 may further include a rendering performing device 100 for providing a rendered projection image to the projection mapping unit 320, and organic interaction between each component may occur. The part about the relationship is explained below.

The modeling unit 310 may create a virtual model for a digital theme park and a digital content generating device in a virtual space. Specifically, the modeling unit 310 is a virtual model for an exhibition space where digital content is displayed in a digital theme park, an image projection surface for generating digital content in the exhibition space, an image projection device, lighting, special effect devices, sound devices, and the like. can create In this regard, FIGS. 3 and 4 are reference diagrams for explaining a simulation process of digital content provided in a digital theme park.

3 and 4, an exhibition space (floor surface) for providing digital contents in a digital theme park is modeled, and on the modeled exhibition space, an image projection surface for implementing digital contents in a real exhibition space. (See FIG. 3 ) and an image projection device (see FIG. 4 ) for projecting an image onto an image projection surface can be seen modeled.

The projection mapping unit 320 may perform preliminary visualization of digital content provided to visitors through an exhibition space in a digital theme park. Specifically, the projection mapping unit 320 may perform projection mapping using the image projection surface and the image projection device created as a virtual model, and may provide a user interface for visualizing and outputting the projection mapping process to the user terminal. . 3 and 4 mentioned above show a user interface provided to a user terminal, and a user can set various options for each virtual model and implement digital content in a virtual space through the user interface.

According to a preferred embodiment of the present invention, the projection mapping unit 320 can change the area of the exhibition space, set the shape and position of the image projection surface, and set the position and number of image projection devices. Specifically, the image projection Options such as the device's image projection area, image projection direction, resolution, blending area, keystone, and brightness can also be set.

In addition, according to a preferred embodiment of the present invention, the projection mapping unit 320 sets lighting options consisting of lighting type, lighting position, lighting angle, lighting color, lighting color temperature, and lighting brightness for lighting implemented as a virtual model. possible.

In addition, according to a preferred embodiment of the present invention, the projection mapping unit 320 may provide a user interface capable of setting detailed options for the image projection device to the user terminal. Specifically, the user may select the brand or model name of the image projection device to be used to create digital content through the user interface provided to the user terminal, including the size, brightness, power consumption, weight, and keystone range of the image projection device. Detailed options can be set. In addition, the user may be provided with information about image brightness and image projection range calculated based on the lens focus of the image projection device and the image projection distance through the provided user interface. Here, the information on the image brightness and the image projection range provided to the user may be provided in an intuitive layout in a specific part of the user interface.

5 shows an example of implementing an exhibition space where digital contents are provided and an exhibition space in a virtual space through spaces and devices created with the above-described virtual model. Referring to FIG. 5, it can be understood that (A) represents an exhibition space and digital content implemented in a virtual space, and (B) represents a real exhibition space that can be created later using the pre-visualized (A). there is.

In addition, the projection mapping unit 320 performs projection necessary to perform pre-visualization of the digital content from the rendering device 100, which implements the digital content as ultra-realistic content based on the viewpoint of the on-site visitor located in the exhibition space. video can be provided. Here, the rendering performance device 100 is a device that performs image rendering through a separately implemented virtual space, and performs image rendering using a virtual projection surface created in the separately implemented virtual space and a viewing point, A projection image based on the viewpoint of can be generated. In addition, specific details of the rendering apparatus 100 will be described later.

The scenario simulation unit 330 may generate a scenario for each digital content provided by the digital theme park and perform a simulation based on the generated scenario and virtual model. Specifically, the scenario simulation unit 330 performs a scenario simulation on the pre-visualized digital content so that the viewer can check the digital content provided to the viewer through the user terminal according to the progress of the scenario.

According to a preferred embodiment of the present invention, the scenario simulation unit 330 not only simulates scenarios for digital content to which single or multiple projection images are applied, but also simulates multi-projection mapping in which some areas overlap, and projects images implemented as holograms. It is possible to perform simulation of digital contents using . As another example, a simulation according to a change in option setting values of lighting generated by a virtual model may be performed, and a prediction simulation according to application of a laser effect and a fog effect provided through a special effect device may also be performed.

Also, according to a preferred embodiment of the present invention, the scenario simulation unit 330 may set a viewing point in the virtual space before performing scenario simulation on the pre-visualized digital content. Here, the viewing point may refer to a position where on-site visitors watch digital content in the exhibition space, and since the viewing point is created in a virtual exhibition space created at the same ratio as the reality, the digital content to be seen by the audience is created. It can be checked in advance, and as a result of the check, if settings need to be changed, the completeness of the scenario can be improved by changing the settings of the image projection device and the image projection surface through the projection mapping unit. In addition, the viewing viewpoint may be created based on a user input through a user interface, and when the projection image provided from the rendering device 100 is used for projection mapping, the rendering device 100 may perform the image rendering in advance. Information about the created viewing point can also be received and used.

Below, the rendering apparatus 100 for providing a rendered projection image to the projection mapping unit 320 will be described.

6 is a reference diagram for explaining ultra-realistic content provided through rendering using a conventional perspective projection technique.

Referring to FIG. 6, when rendering is performed using a conventional perspective projection technique, rendering is optimized at a specific point in time, and when viewing a projected image, which is immersive content, the perspective and shape of an object are normally displayed without being distorted. there is. This method can be appropriately used when constructing realistic content by projecting an image between real structures installed in an exhibition space, as shown in FIG. 6(A). Since the viewer located between the above-mentioned actual structures watches the realistic content from a position within the range where the projected image is distorted and cannot be seen, it is possible to view the normal realistic content without discomfort as shown in FIG. 6(B). However, when realistic content is configured by applying this method in an exhibition space where a wider space is allowed for visitors, the projected image is distorted depending on the viewer's point of view, so the realistic content is not provided as intended. There is a problem with not being able to.

7 is a configuration diagram for explaining a rendering system according to the present invention.

Referring to FIG. 7 , the rendering system according to the present invention includes a terminal 10, an image projection device 20, and a device 100 that performs rendering optimized for a viewer's viewpoint at a specific location to provide ultra-realistic content ( Hereinafter referred to as a rendering execution device).

The terminal 10 is a device for transmitting the viewer's location information to the rendering device 100, and includes, for example, a smartphone carried by the viewer, a tag that performs a function of transmitting location information, and Other devices performing equivalent functions may be included. In general, each visitor has one terminal 10, and when there are a plurality of visitors located in the exhibition space, location information of a plurality of visitors may be transmitted to the rendering device 100.

The rendering apparatus 100 according to the present invention performs a rendering operation to represent an exhibition object implemented in 3D in a virtual space as a 2D plane based on the visitor location information transmitted from the terminal 10, and the result of the rendering operation The projection image may be provided to the image projection device 20 installed in the exhibition space. Here, when the ultra-realistic content provided to the viewer consists of multiple projected images, installation of a plurality of image projection devices (20-1, 20-2, 20-3...) may be required, and rendering is performed. The device 100 may also provide different projection images by performing rendering suitable for each image projection device 20 .

8 and 9 are block diagrams showing the configuration of the rendering apparatus 100 according to the present invention.

Referring to FIG. 8 , the rendering apparatus 100 according to the present invention includes an exhibition object generator 110, a photographing object generator 120, a virtual projection surface generator 130, a viewing viewpoint generator 140, and It is configured to include a rendering unit 150 . Also, referring to FIG. 9 , the rendering apparatus 100 according to an embodiment of the present invention may further include a location information receiver 160 and a projection image transmitter 170.

The exhibition object creation unit 110 may create a 3D exhibition object in a virtual space. Here, the exhibition object may be created based on exhibition object data directly input from the user terminal to the rendering apparatus 100 . In addition, the exhibition object is a virtual object constituting a projected image projected on an exhibition space to implement ultra-realistic content, and does not mean only a specific object, but may mean all virtual objects modeled on the virtual space. For example, (B) of FIG. 6 shows an actual projected image, and includes an exhibition object composed of a rock structure, implemented weather, and the ground.

The capturing object creation unit 120 may create a capturing object for capturing an exhibition object at a specific location in the virtual space. The photographing object is created for the purpose of photographing the projected image itself to be projected onto the exhibition space, and it is possible to determine which projected image to project into the exhibition space according to the position of the photographed object that is changed based on a user input. In this regard, FIGS. 10 and 11 are reference views illustrating a scene captured by the capturing object 121 according to the present invention. Referring to FIGS. 10 and 11, (A) is a third-person view of a photographing object 121 photographing exhibition objects 111-1, 111-2, and 111-3 implemented in a virtual space. (B) shows a scene captured from the viewpoint of the photographing object 121 (ie, a projection image provided to the exhibition space). Comparing FIGS. 10 and 11 , as the photographing position of the photographing object 121 changes, the positions and shapes of the photographed exhibition objects 111-1, 111-2, and 111-3 also change.

The virtual projection surface generating unit 130 may generate a virtual projection surface on which a scene captured by a photographing object is output in a virtual space. The virtual projection surface is for checking the distortion state of the projection image, which may appear distorted according to the position of the viewer located in the exhibition space, and correcting the distortion by remodeling the exhibition object according to the checked result.

In one embodiment, the virtual projection surface may be created in a separate virtual space in which a coordinate system is configured to correspond to the exhibition space. Specifically, a virtual space in which the above-described exhibition object and photographing object are implemented may be defined as a first virtual space, and a virtual space in which a virtual projection surface is implemented may be defined as a second virtual space. In this regard, FIG. 7 is a reference diagram for explaining an example of generating a virtual projection surface 131 according to the present invention.

Referring to FIG. 12, (B) of FIG. 12 is a second virtual space in which a virtual projection surface 131 is created, and in the second virtual space, a scene (projected image) output on the virtual projection surface 131 is actually displayed. An exhibition auxiliary object ((B) of FIG. 12) capable of simulating a situation when projected on an exhibition space may be implemented. As in the example of FIG. 1 described above, realistic content using an image projection method may be configured like a real structure provided in an exhibition space, and the exhibition auxiliary object plays the same role as the real structure in a second virtual space, Allows the user to simulate the ultra-realistic content to be provided to the audience before displaying it (see FIG. 12(A)). As described above, since the coordinate system of the second virtual space is configured to correspond to the actual exhibition space, there is an advantage in that the exhibition auxiliary object and the virtual projection surface 131 can be implemented and simulated in the same ratio as the actual size.

In one embodiment, the virtual projection surface generating unit 130 may implement and apply a texture to the virtual projection surface to be created. Specifically, the image projection surface of the exhibition space on which the projected image is projected may exhibit a specific texture to realize ultra-realistic content, and this texture can also be applied in virtual space to simulate the projected image. For example, when an exhibition object including a ground made of sand or gravel is photographed in a state in which the texture of the virtual projection surface is implemented and applied as a rough texture, a more realistic projection image can be provided.

The viewing viewpoint generating unit 140 may create a viewing viewpoint looking at a virtual projection surface in a virtual space. The viewing point is to check what kind of distortion occurs compared to the projected image to be displayed when the virtual projection surface is viewed from a specific position in the virtual space. According to the above-described embodiment, as the virtual projection surface is created in the second virtual space, the viewing viewpoint is also created in the second virtual space. In addition, since the viewpoint of viewing is created on the second virtual space in which the coordinate system is configured to correspond to the actual exhibition space, it is possible to check the distortion when viewing the projected image constituting the ultra-realistic content from the viewer's position in the actual exhibition space. let it be The distortion confirmed through the above process is corrected through the rendering unit 150, and details thereof will be described later.

According to a preferred embodiment of the present invention, the viewing viewpoint generation unit 140 creates a viewing viewpoint at virtual space coordinates (second virtual space coordinates) corresponding to the position of the visitor located in the exhibition space, and creates a viewing viewpoint in the virtual space (second virtual space coordinates). The viewing point created in the virtual space) is moved in real time based on the location information of the viewer located in the exhibition space. Accordingly, even if the viewer moves within the exhibition space, a projection image corrected in real time based on the movement position can be provided to the exhibition space.

In addition, when a plurality of visitors are located in the exhibition space, the viewing viewpoint generation unit 140 may generate a viewing viewpoint based on average location information calculated for the crowd of visitors. Specifically, in the case where several visitors watch a projection image at their respective locations in the same exhibition space, it is difficult to provide a perfectly calibrated projection image for each viewer. Therefore, a method of generating a viewing point by calculating an average position for the clustered spectators can be applied.

The rendering unit 150 may remodel the exhibition object based on the set viewing viewpoint. Here, the rendering unit 150 receives a reference projection image to be provided to the viewer from the photographing object, and has a sense of identity with the exhibition object appearing in the reference projection image when looking at the virtual projection surface at the generated viewing point. The exhibition object may be remodeled so that the exhibition object is output. Here, remodeling of an exhibition object whose distortion is confirmed on the virtual projection surface according to the location of the viewing point is performed based on information about the exhibition object appearing in the reference projection image. The exhibition object information may include contrast, color, location, and shape information of the exhibition object.

In one embodiment, the rendering unit 150 may perform remodeling that changes at least one of the position, shape, and color of the exhibition object using an off-axis projection method, and through this, in particular, the projection image It is possible to remove the sense of heterogeneity of the viewer's projected image by correcting the sense of perspective.

As a result, after the exhibition object remodeling is performed by the rendering unit 150, the distorted exhibition object appears on the scene captured by the shooting object or on the virtual projection surface, and the projected image including the exhibition object is distorted according to the viewing point of view. It is provided in this exhibition space to realize ultra-realistic content.

The location information receiving unit 160 may receive location information of visitors located in the exhibition space. For example, location information may be directly received from the terminal 10 (see FIG. 7) through wireless communication, and location information of a spectator may be received from a separately provided location information collecting device.

The projected image transmission unit 170 may transmit the scene captured by the object to the image projection device 20 (see FIG. 7) in the exhibition space in real time. In summary, the process from receiving the location information of the visitor to generating and moving the viewing point, rendering, and transmitting the shooting scene (projection image) to the image projection device 20 is performed in real time, providing ultra-realistic content in the exhibition space. to be implemented.

It is apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the characteristics of the present invention. Accordingly, the above detailed description should not be construed as limiting in all respects and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (6)

As for performing a virtual simulation of a digital theme park that provides a plurality of digital contents including a metaverse to visitors,
a modeling unit for generating a virtual model for a digital theme park and a digital content generating device in a virtual space;
A projection mapping unit that performs pre-visualization of digital content provided to visitors through an exhibition space in a digital theme park; and
It is characterized by including a scenario simulation unit that generates a scenario for each digital content provided by the digital theme park and performs a simulation based on the generated scenario and virtual model,
The projection mapping unit,
Receive a projected image necessary for pre-visualization of digital content from a rendering device that implements digital content as ultra-realistic content based on the viewpoint of an on-site visitor located in the exhibition space;
The rendering execution device,
As performing image rendering through a separately implemented virtual space,
an exhibition object creation unit that creates a three-dimensional exhibition object in a virtual space;
a photographing object creation unit generating a photographing object for photographing an exhibition object at a specific location in a virtual space;
a virtual projection surface generating unit generating a virtual projection surface on which a scene captured by a photographing object is output in a virtual space;
a viewing viewpoint generating unit generating a viewing viewpoint looking at a virtual projection surface in a virtual space; and
A rendering unit for remodeling an exhibition object based on the generated viewing point of view;
The rendering unit,
A reference projection image to be provided to the viewer is received from the photographing object, and the exhibition object is remodeled so that an exhibition object having a sense of identity with the exhibition object appearing in the reference projection image is output when looking at the virtual projection surface at the viewing point of view. to do,
A simulation device for a digital theme park that provides a digital twin-based metaverse. According to claim 1,
The modeling unit,
Characterized in that creating a virtual model for the exhibition space, an image projection surface and an image projection device for generating digital content in the exhibition space,
A simulation device for a digital theme park that provides a digital twin-based metaverse. According to claim 2,
The projection mapping unit,
Characterized in that projection mapping can be performed using the image projection surface and the image projection device created as a virtual model, and a user interface for visualizing and outputting the projection mapping process is provided to the user terminal.
A simulation device for a digital theme park that provides a digital twin-based metaverse. According to claim 1,
The scenario simulation unit,
Characterized in that, by performing a scenario simulation for the pre-visualized digital content, the digital content provided to the audience according to the progress of the scenario can be checked through a user terminal,
A simulation device for a digital theme park that provides a digital twin-based metaverse. delete delete

Images