KR20230094803A - method of processing metadata of attributes of digital props for video contents generation in virtual production - Google Patents

Abstract

The present invention encodes, stores, and manages meta information for each property (e.g., material, color, shape, use, installation location, shooting environment, shooting location, etc.) for a plurality of digital props, and when newly producing video content, It is about property meta information processing technology of digital props for producing video contents based on virtual production that effectively finds digital props to be used and provides digital props to be rendered integrated with virtual backgrounds and digital actors through 3D modeling tools. According to the present invention, by structuring and processing attribute meta information for digital props, there is an advantage in that digital props can be effectively found and rendered integrally in the video content production process through computer graphic software processing. In addition, according to the present invention, digital props can be effectively reused in producing video contents, thereby reducing the production period and production cost of video contents. In addition, according to the present invention, digital props can be integrated into video contents through computer graphic software processing, thereby enabling a non-face-to-face production environment for video contents.

Description

Method of processing metadata of attributes of digital props for video contents generation in virtual production based on virtual production {method of processing metadata of attributes of digital props for video contents generation in virtual production}

The present invention generally relates to a technology in which a computer device processes attribute meta information of digital props used for video content in order to effectively store and manage them.

In particular, the present invention encodes and stores and manages meta information for each property (eg, material, color, shape, use, installation location, shooting environment, shooting location, etc.) for a plurality of digital props, and when creating new video content, the video Processing property meta information of digital props for the production of video contents based on virtual production that effectively finds digital props to be used for content and provides so that digital props can be rendered integrated with virtual backgrounds and virtual actors (digital actors) through 3D modeling tools It's about technology.

In general, when producing video contents (eg, dramas, advertisements, movies, etc.), outdoor location shooting or studio shooting is performed. In the case of outdoor location shooting, there are a lot of difficult things, including location selection, and a large-scale manpower mobilization is required, so the cost burden is very high. Accordingly, studio shooting is used in many cases, and in a conventional studio shooting environment, shooting is performed in a state where a background is decorated and various props are placed around the background.

In this way, physical props are used in the conventional video content production environment, which has several disadvantages. Art production costs are incurred for leasing, production, and management of real props, and a long production period is required for each stage and tool, such as pre-visualization-production-post-production, and can only be used once in explosion scenes.

In addition, in a digital studio environment, virtual backgrounds and real props cannot be linked, so you can only create recorded content, and you want to increase added value by using real props used in popular content as digital content (e.g., as a game item). It is disadvantageous in terms of time and cost because it requires a manual analog/digital conversion process (if you want to launch or trade NFTs).

Republic of Korea Patent Publication No. 10-2019-0041385 (2019.04.22) "Smart props for grid-based virtual reality rides" Republic of Korea Patent Publication No. 10-2000-0058546 (2000.10.05) "System and method for providing props information of digital video through computer network"

An object of the present invention is to provide a technology for a computer device to process attribute meta information of digital props generally used for video contents in order to effectively store and manage them.

In particular, the purpose of the present invention is to encode, store, and manage meta information by property (eg, material, color, shape, use, installation location, shooting environment, shooting location, etc.) for a number of digital props, and when creating new video content. The property meta information processing technology of digital props for the production of video contents based on virtual production, which effectively finds digital props to be used for the video contents and provides so that digital props can be rendered integrated with virtual backgrounds and digital actors through 3D modeling tools. is to provide

On the other hand, the problem of the present invention is not limited to these matters, and other problems can be understood from the description of this specification.

In order to achieve the above object, the present invention proposes a method for a computer device to process attribute meta information for a plurality of digital props in order to produce video contents based on virtual production.

A method for processing attribute meta information of digital props for video content production based on virtual production according to the present invention includes: a first step of generating a plurality of digital props by binding digital prop data and attribute meta information; A second step of database management of a plurality of digital props; A third step of setting required props and required attribute information for video content production in the virtual production platform; a fourth step of searching for one or more digital props from a database based on a matching between a required prop item and required attribute information and attribute meta information; A fifth step of integrally rendering the digital props obtained from the database according to the lighting direction and shooting direction of the digital studio based on the corresponding attribute meta information as a result of the above search; A sixth step of inserting the rendered digital prop into video content in the virtual production platform;

A first step in the present invention includes setting a plurality of property items for digital props; Digitally converting a real prop by photographing it with a camera; It may be configured to include; setting meta information on the property item to correspond to the material and color of the real prop, and the lighting angle and shooting angle for camera shooting.

At this time, in the fourth step, it may be configured to search for a plurality of digital props having attribute meta information in which the lighting angle and the photographing angle are matched within a preset threshold range.

In the present invention, the first step may include setting a plurality of property items for digital props; generating data of a plurality of digital props by a computer graphic processing unit; Setting meta information for attribute items for each of a plurality of digital props by a computer graphics processor;

On the other hand, the computer program according to the present invention is stored in a non-volatile storage medium in order to execute the method of processing attribute meta information of digital props for producing video contents based on virtual production in a computer.

According to the present invention, by structuring and processing attribute meta information for digital props, there is an advantage in that digital props can be effectively found and rendered integrally in the video content production process through computer graphic software processing.

In addition, according to the present invention, digital props can be effectively reused in producing video contents, thereby reducing the production period and production cost of video contents.

In addition, according to the present invention, digital props can be integrated into video contents through computer graphic software processing, thereby enabling a non-face-to-face production environment for video contents.

[Fig. 1] is a diagram conceptually showing a virtual production-based video content production process to which the present invention is applied.
[Fig. 2] is a diagram showing an example of code allocation for attribute meta information of digital props in the present invention.
[Fig. 3] is a diagram showing the concept of trading and reusing digital props using attribute meta information in the present invention.
[Fig. 4] is a diagram showing the entire process of a method for processing attribute meta information of digital props according to the present invention.
[Fig. 5] is a diagram showing a first embodiment of a process of generating digital props in the present invention.
[Fig. 6] is a diagram showing a second embodiment of a process of generating digital props in the present invention.

Hereinafter, the present invention will be described in detail with reference to the drawings.

[Fig. 1] is a diagram conceptually illustrating a virtual production-based video content production process to which the present invention is applied.

Referring to FIG. 1, first, digital props are produced and stored and managed, and the storage management system of these digital props is interlocked with a virtual production platform for video contents, and video contents are produced based on this virtual production. In the present invention, editing and sharing technology for attribute information of digital props is used in the video content production process.

In the present invention, when a digital prop is produced, attribute meta information is encoded and bound together with data of the digital prop. At this time, the digital props may be produced from the beginning with computer graphic software or may be made by digitally converting real props. This attribute meta information is used for search, combination, and computer processing in the video production process. Through this, it is possible to build a collaboration platform based on digital properties between virtual production and digital prop production for virtual object combination and virtual object transformation rendering.

In the present invention, virtual production is a technology for generating video content by utilizing virtual backgrounds (based on LED video walls), virtual actors (digital actors), and virtual special effects (e.g., fluid simulation) that replace traditional video elements. means platform. Referring to FIG. 1, when digital props are produced and managed in the form of digital data (graphic data), the virtual production platform utilizes these digital props in the process of producing video content. Virtual production can mean a digital studio or a metaverse virtual studio. The digital studio displays a background image on a high-resolution LED panel (LED wall) and takes pictures of actors acting in front of it with a camera to produce video content. Metaverse Virtual Studio creates a metaverse virtual world using computer graphics technology.

In the present invention, digital props are made into unit parts and used for video content production. That is, a number of digital props are made in advance and stored in the form of a database, and digital props are searched for and used as needed in the process of producing video contents in virtual production. Compared to using conventional physical props, using digital props provides several advantages. That is, digital props (digital virtual object-based props) are inexpensive to produce, have a short production period, and are suitable for combining and reusing multiple digital props according to their properties. In addition, due to the nature of digital props, it is effective in directing dangerous situations such as explosions, is advantageous in a non-face-to-face production environment, and is effective in interactive production based on real-time linkage with virtual backgrounds or digital actors in a digital studio environment. In addition, since there is no analog/digital conversion cost, it is very suitable for launching as a metaverse or game item or trading NFT.

[Fig. 2] is a diagram showing an example of code allocation for attribute meta information of digital props in the present invention.

In the present invention, when a real prop is digitally converted or a digital prop is produced from the beginning by computer graphics software, various properties of the corresponding graphic prop are encoded as meta information. In the case of a digital prop produced by photographing a real prop, for example, the material (raw material), color (color), shape (three-dimensional form), use, installation location, shooting environment (illumination level, lighting angle, shooting angle, Reflection amount, indoor/outdoor, etc.), shooting location (IP address), etc. can be set as attributes, and meta information can be encoded for each of these attributes. Taking the photographing environment as an example among attribute information, video photographing information of real props in real (physical) space is expressed as attribute meta information of digital props in the virtual world.

This attribute meta-information can be used to search for digital props in the process of producing video contents, or can be used to combine and use several digital props like Lego blocks. At this time, it is preferable that the computer graphic software (visualization engine) utilize attribute meta information when combining one or a plurality of digital props with other parts in the image. In a digital studio, while tracking the location of a shooting camera, a stereoscopic background image and digital props suitable for the point of view should be rendered in real time and displayed on a virtual background (LED wall). At this time, the visualization engine (eg, Unreal Engine, Unity Engine) performs rendering in a sense of unity by considering the lighting direction and shooting direction of the digital studio. In the metaverse virtual studio, backgrounds, digital props, objects, characters, etc. are built in the virtual space, and producers access the metaverse using operating instruments (keyboards, joysticks, VR machines, etc.) and perform video content production and utilization. At this time, the visualization engine renders the background, digital props, objects, characters, etc. with a sense of unity in consideration of the virtual lighting direction and shooting direction. When the visualization engine performs rendering processing on digital props, property meta information of the corresponding digital props is usefully considered.

[Fig. 3] is a diagram showing the concept of trading and reusing digital props using attribute meta information in the present invention.

Referring to FIG. 3, several digital prop producers register their digital props. At this time, attribute meta information as shown in FIG. 2 is bound to each digital prop, and information for identifying who produced the digital prop and who has the right, such as biometric information, is also registered. 3 shows an example of using biometric information, and as a digital prop is registered using biometric information, it is connected to a digital prop usage management server via a biometric authentication server.

Attribute meta information is used to search for digital props to produce video contents in a virtual production environment and to select and bring digital prop data suitable for oneself. Bring multiple digital prop data from the virtual production terminal to the digital prop usage management server and utilize them in the virtual production platform. At this time, it is possible to distinguish digital props that can be matched with each other using attribute meta information, and the visualization engine renders the data of these digital props in a sense of unity within the video content in consideration of the lighting direction and shooting direction of the digital studio.

At this time, the virtual production terminal uses biometric information in the transaction process of digital props. It tries to trade digital props by inputting biometric information, and achieves biometric authentication-based transactions through cooperative operation between the FIDO authentication server and the biometric authentication server. If such biometric authentication is successful, the digital prop usage management server inputs and manages the information of the transaction party in the internal database and downloads the digital prop data to the virtual production terminal. Through this configuration, transactions of digital props (digital goods) can be activated.

[Fig. 4] is a diagram showing the entire process of a method for processing attribute meta information of digital props according to the present invention.

The present invention includes a series of processes in which a computer device utilizes and processes attribute meta information for a plurality of digital props in order to produce video contents based on virtual production.

Steps S110 and S120: First, a plurality of digital props are created by binding digital prop data and property meta information. The concept of binding digital prop data and attribute meta information has been described above with reference to [Fig. 1], and two embodiments of generating digital props will be described later with reference to [Figs. 5] and [Fig. 6]. A plurality of digital props generated in this way are managed in a database by a digital prop usage management server.

Steps (S130, S140): Required props and required attribute information for video content production are set in a virtual production platform (eg, digital studio, metaverse virtual studio). That is, information about what kind of props are needed in the corresponding video content (eg, musical instruments, flowerpots, dogs, televisions, etc.) and what properties each of these props should have is set. At this time, the required attribute information can be set as shown in [Fig. 2].

Then, one or more digital props are searched and obtained from the database based on the matching between the required props set in the virtual production platform and the required attribute information and the attribute meta information. For example, in [Fig. 3], the virtual production terminal brought 5 digital props from the digital prop usage management server. At this time, when a plurality of digital props matching the required props exist in the database, it is preferable to search for digital props whose required attribute information matches within a preset threshold range. At this time, if there is one digital prop matching the required prop item in the database, it is preferable to first retrieve and import the digital prop, and then process the graphic with a visualization engine. Such a configuration is preferable because the graphic processing result through the visualization engine is better when the required attribute information is matched to some extent.

Steps (S150, S160): Based on the corresponding attribute meta information, one or more digital props obtained from the database through the above search are rendered integrally by the visualization engine according to the lighting direction and shooting direction of the digital studio, and processed on the virtual production platform. Insert the rendered digital props into the video content.

[FIG. 5] is a diagram showing a first embodiment of the process of generating digital props in the present invention, that is, step S110 of [FIG. 4].

Step (S210): First, a plurality of property items for digital props are set. As described above with reference to [Figure 2], the material (raw material), color (color), shape (three-dimensional form), use, installation location, shooting environment (illumination level, lighting angle, shooting angle, reflection amount, indoor and outdoor, etc. ), shooting location (IP address), etc. can be set as properties.

Step (S220): Next, as described above with reference to [Figs. 1] and [Fig. 2], real props are photographed by a camera (photographed by a digital camera) in physical space and converted into digital data.

Step (S230): Next, meta information about the property item is set to correspond to the material and color of the real prop, and the lighting angle and shooting angle for the camera shooting environment.

[FIG. 6] is a diagram showing a second embodiment of the process of generating digital props in the present invention, that is, step S110 of [FIG. 4].

Step (S310): A plurality of property items for digital props are set. The property items described above with reference to [Fig. 2] may be used, or they may be set differently by reflecting the characteristics of digital prop production through computer graphic work.

Step (S320): Next, a computer graphic processing unit generally implemented in the form of computer graphic software generates data of a plurality of digital props through a series of graphic processing processes.

Step (S330): Then, the computer graphic processing unit sets meta information for the plurality of property items set in step (S310) for each of the plurality of digital props.

On the other hand, the present invention can be implemented in the form of computer readable codes on a computer readable non-volatile recording medium. As such non-volatile recording media, there are various types of storage devices, such as hard disks, SSDs, CD-ROMs, NAS, magnetic tapes, web disks, and cloud disks. and can be implemented in a form that is executed. In addition, the present invention may be implemented in the form of a computer program stored in a medium in order to execute a specific procedure in combination with hardware.

Claims (5)

As a method for a computer device to process attribute meta information for a plurality of digital props for virtual production-based video content production,
A first step of generating a plurality of digital props by binding digital prop data and property meta information;
a second step of managing a database of the plurality of digital props;
A third step of setting required props and required attribute information for video content production in the virtual production platform;
a fourth step of searching for one or more digital props from a database based on a matching between the required prop item and required attribute information and the attribute meta information;
a fifth step of integrally rendering the digital props acquired from the database as a result of the search according to the lighting direction and shooting direction of the digital studio based on the corresponding attribute meta information;
A sixth step of inserting the rendered digital prop into video content in a virtual production platform;
A method for processing attribute meta information of digital props for producing video contents based on virtual production, which is composed of.
The method of claim 1,
The first step is
setting a plurality of property items for digital props;
Digitally converting a real prop by photographing it with a camera;
setting meta information about the property item to correspond to the material and color of the real prop, and the lighting angle and shooting angle for the camera shooting;
A method for processing attribute meta information of digital props for producing video contents based on virtual production, characterized in that it comprises a.
The method of claim 2,
In the fourth step, a plurality of digital props having attribute meta information in which the lighting angle and the shooting angle are matched within a preset threshold range are configured to be searched. Meta information processing method.
The method of claim 1,
The first step is
setting a plurality of property items for digital props;
generating data of a plurality of digital props by a computer graphic processing unit;
setting meta information for the property item for each of the plurality of digital props by the computer graphic processing unit;
A method for processing attribute meta information of digital props for producing video contents based on virtual production, characterized in that it comprises a.
A computer program stored in a storage medium to execute the method for processing attribute meta information of digital props for producing virtual production-based video contents according to any one of claims 1 to 4 in a computer.

Images