KR20100062822A - System for cooperative digital image production - Google Patents

Abstract

PURPOSE: A collaborative image production management device is provided to remarkably reduce the bottleneck phenomenon through algorithm parallelization and data parallelization using various hardware resources and personalized parallel computing environment. CONSTITUTION: A call connection interface(120) calls a node which is selected by an administrator among a plurality of nodes(101-106). A data storage/processor(140) stores data processed at the called node to a resource database(130). The data storage/processor shares each data processed in the nodes with the nodes. According to the request of an administrator, a resource fetching part(150) displays the saved data to the display part(170). By using the saved data, a final result generator(160) generates a final product.

Description

Collaborative video production management device {SYSTEM FOR COOPERATIVE DIGITAL IMAGE PRODUCTION}

The present invention relates to image production. More particularly, when performing ultra-high-capacity and high-quality image production, image production steps causing major bottlenecks are performed by using nodes connected through a communication network, thereby improving final image quality. The present invention relates to a collaborative video production management apparatus that can shorten a video production period.

The present invention is derived from the research conducted as part of the IT growth engine technology development project of the Ministry of Knowledge Economy and the Ministry of Information and Telecommunications Research and Development.

In film and commercial production, post-production can be likened to the process of dressing new clothes so that a complete film can be produced based on the film shot in a stage called post-production. In this post-production, only a sufficient working period and careful working environment can guarantee the final film.

In terms of production, the detailed steps of post-production are as follows. (1) Films taken on-site are taken to the lab immediately after shooting and undergo the development process. In the past, the negative film was developed, and then, in order to reduce costs, a 16mm reduction print was used to check and edit the photographed state. These negative phenomena are mainly edited using computer editing software, so they go through the "telecine" process immediately after the negative phenomena. Sometimes the print is checked to check the condition of the film by checking the lighting or other technical conditions, but this is not the case.

The order of film development is as follows. Once filmed on raw film, its latent image is developed. This results in a film that consists of the complementary colors of natural colors that we commonly see, called "negative films" or "negatives." This negative film is printed on other films and usually produces the right color that we can see in the theater. This process is usually like printing a film on photo paper and getting the right image. This printed film is called "positive film" or "positive".

Recently, post-production digitizes raw film and converts it into a video image immediately after the negative development, without the positive development. The next step is to perform telecine work, which is an operation with an apparatus that converts information of a film into video tape by optically forming an image from a film by a special prism. In the telecine process, the head that reads the timecode accurately reads the date, timecode, key number, etc. recorded on the film. Those who have been converted into video images through telecine work go into editing work at the same time. The editor selects an OK cut based on the field records and immediately edits the sequence. At the end of the shooting, the director and the editorial staff will make final edits, and the computer graphics or optical work will be put out before the final editing work.

Optical work refers to a process of optical processing required for photographed film. During the editing process using computer graphics software, the part of the effect is found in the negative film and optically processed to create a new negative film with the effect. What is used in the final negative editing is to use negative film with these effects. In addition, the scenes using CG go through a similar process. After scanning the original negative film where the CG effect needs to be found and scanning the computer, the film is printed out to make a new negative film with the effect. The resulting negative film will be used for final editing in the same way as for optical work. After optical work, negative editing, recording and optical recording are performed. After that, the exposure or color correction of the final edited film is performed to produce the final print, and the printing operation is performed according to the color correction value obtained through the color correction operation.

Looking at the above CG special effects in detail, the processing of the real-world shooting results, scanning, noise removal, stabilization, and then linking the live-action shot and the CG digital environment. Perform the matchmove step. Afterwards, the animation step that creates motion on the modeled object in the real CG digital environment, the shading step that applies the texture of the object surface, the lighting step that sets the digital lighting for the scene, the rendering step that draws the CG image, and the rendering step After the compositing step of compositing the image, the final film is output.

In general, obtaining a high quality image rendering image requires a large number of shading, lighting, and rendering steps, which limits processing in a single system. In particular, the rendering step is a task that requires the most processing time, there is a limit to process in a single system has a problem that it is difficult to expect high performance improvement and short production time.

The present invention shortens the image production time by working together through multiple personalized parallel working environments for shading, writing, rendering, and compositing steps, which are the main bottlenecks of CG image production, through a broadband communication network.

In addition, the present invention performs essential steps in creating bottlenecked CG images, such as shading writing and rendering, when a digital image production is performed through a single central processing system in multiple personalized parallel environments through a common interface and broadband network. This improves the processing speed.

An apparatus for managing collaborative video production according to the present invention is connected to a plurality of nodes through a communication network, a call connection interface for calling a node selected by an administrator among the plurality of nodes, and a call connection interface called through the call connection interface. A data storage and processing unit which receives data processed by a node and stores the data in a resource database and shares each data processed by the plurality of nodes to the plurality of nodes, and data stored in the resource database at the request of an administrator The resource call unit for displaying the display unit, and the final result generation unit for generating a final result using the data stored in the resource database.

In addition, the apparatus for managing collaborative video production according to the present invention is connected to a plurality of nodes through a communication network, and a call connection interface for calling a node selected by an administrator among the plurality of nodes, and through the call connection interface. Receives data processed by the called node and stores it in the resource database, extracts data from the resource database according to a request of any node among the plurality of nodes, and provides the same to the node through the call connection interface. A data storage and processing unit, a resource calling unit for displaying data stored in the resource database on a display unit at the request of an administrator, and a final result generating unit generating a final result using the data stored in the resource database.

The present invention computes shading, lighting, and rendering that cause bottlenecks in a single central system image production environment using various hardware resources and personalized parallel computing environments (multicore CPUs, GPUs, dedicated SIMD hardware). Through parallelism and data parallelism, the bottleneck can be significantly reduced, and the parallelism property can be determined at execution time to control the calls to various hardware resources to increase parallelism and provide fast processing speed.

Therefore, the broadband collaborative digital image production system can be quickly and easily performed in the field of design visualization, interactive ray tracing, etc., and is programmable because the user can control it through the shader program. It also provides flexibility.

Hereinafter, the operating principle of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. The following terms are defined in consideration of the functions of the present invention, and may be changed according to the intentions or customs of the user, the operator, and the like. Therefore, the definition should be made based on the contents throughout the specification.

The present invention provides a multicore central processing unit (CPU), high speed, through a common interface for bottleneck essential operations, such as random number generation, Monte Carlo integration, etc., when global lighting based rendering is performed through a single central processing unit. The processing speed is improved by performing a graphics processing device, dedicated SIMD (Single Instruction Multiple Data, hereinafter referred to as 'SIMD') hardware, or the like.

1 is a block diagram showing an overall system for collaboration-based image production management according to the present invention, a modeling node 101 for creating geometric information of an object in an image scene, and an animation node 102 for setting an object's movement. ), A shading node 103 for shading for realistic texture, a lighting node 104 for setting lighting in a scene, a rendering node 105 for rendering a set scene, and outputted through rendering A compositing node 106 for synthesizing the images and an image production management apparatus 107 connected to the nodes through a communication network to interwork the nodes. Here, the communication network may be a broadband wired or wireless communication network.

The modeling node 101 of the present invention is connected to the image production management apparatus 100 through the communication network to generate geometric information about an object in an image scene based on the photorealistic processing data.

The animation node 102 is connected to the image production management apparatus 100 through a communication network to set an animation for the object based on the live-action processing data.

The shading node 103 is connected to the image production management apparatus 100 through a communication network to perform a shading operation for expressing a realistic texture of an object based on the actual processing data.

The lighting node 104 is connected to the image production management apparatus 100 through a communication network to set lighting in the image scene.

The rendering node 105 is connected to the image production management apparatus 100 through a communication network to perform rendering of an image scene.

The compositing node 106 is connected to the image production management apparatus 100 through a communication network to synthesize images output from the rendering node 105.

Each of the nodes 101, 102, 103, 104, 105, and 106 may be a personal computer or a terminal suitable for image processing. That is, as shown in FIG. Data received from the image production management apparatus 100 by the core central processing unit 200, the graphics processing unit 210 equipped with the programmable shader processor, and the multicore central processing unit 200 and the graphics processing unit 210. Personal computer or a terminal device including a dedicated single command plural data (SIMD) type hardware 220 for processing the generated data and a communication interface 240 for interworking with the image production management apparatus 100 through a communication network. Can be.

The video production management apparatus 100 may include a live action processor 110, a call connection interface 120, a resource database 130, a data storage and processor 140, a resource caller 150, a final result generator 160, and The display unit 170 is included.

The real-time processor 110 processes the photorealistic photographing result to generate the photorealistic processing data. Here, the process of processing the photorealistic photographing result may include scanning, noise removal, stabilization, color correction, and match move.

The call connection interface 120 is connected to a plurality of nodes, such as modeling node 101, animation node 102, shading node 103, lighting node 104, rendering node 105, and compositing node (eg, through a communication network). 106 and the video production management apparatus 100, and call the at least one node selected by the administrator of the plurality of nodes (101, 102, 103, 104, 105, 106), and then performs due diligence processing on the called node Send the data.

The data storage and processing unit 140 receives data processed by the node called through the call connection interface 110 and stores the data in the resource database 130. The plurality of nodes 101, 102, 103, 104, 105, Each data processed in 106 is shared. Examples of the data processed by the nodes 101, 102, 103, 104, 105, and 106 include geometry information about the object, animation setting result, shading result, lighting result, rendering result, and rendering result. Combined results, and the like, the data storage and processing unit 140 receives each processed data and stores it in the resource database 130.

Here, the call process of the node and the data reception and data reception of the processing unit 140 are performed in parallel, that is, when the generation of the geometric information on the object in the photographed live image scene is called, the modeling node 101 is called. When the animation setting for the object is required, data is transmitted from the modeling node 101 or the animation node 102 after calling the animation node 102.

On the other hand, when the compositing node 106 is called, the rendering result data is received through the call of the rendering node 105 and then transmitted to the compositing node 106 (rendering node 105 and composite). By sharing between the nodes 106, the data obtained by synthesizing the rendering result data received from the rendering node 105 may be received and stored in the resource database 130.

In addition, the data storage and processing unit 140 receives data processed by the node called through the call connection interface 110 and stores the data in the resource database 130, and at the request of any node, the resource database 130. The data is extracted and transmitted to any node through the call connection interface 110.

As such, the call connection interface 110 selects and calls a corresponding node according to a manager's work request, and the data storage and processing unit 140 retrieves data necessary for the called node from the resource database 130 and then calls it. The data processed by each node can be shared by sending it to each node or connecting each node.

The resource caller 150 may store the result data stored in the resource database 130 at the request of an administrator, for example, geometric information generated by the modeling node 101, animation results generated by the animation node 102, and shading node ( After the shading operation result of 103, the lighting operation result of the lighting node 104, the rendering operation result of the rendering node 105, and the synthesis result of the image of the compositing node 106 are extracted, the manager requests the data. It is displayed on the display unit 170.

The final result generator 160 generates the final result using the data stored in the resource database 130.

According to an exemplary embodiment of the present invention, shading, lighting, rendering, animation, modeling, image compositing, and the like are performed in different nodes, and the result is collected by the image production management apparatus 100, and then the final image is captured. Although described as an example of generating, only shading, writing, rendering, and compositing operations may be performed at each node connected through a communication network, and the remaining operations may be performed by the image production management apparatus 100. That is, the lighting work, shading work, and rendering work are processed using each node connected to the image production management apparatus 100, and the processing result (intermediate result) is shared with each node using the image production management apparatus 100. By doing so, work processing time can be shortened. For example, when the composition of the rendering result image is required, the compositing node 106 receives the rendering result image generated by the rendering node 105 through the image production management apparatus 100 and then synthesizes the image to manage the production of the image. To the device 100.

As described above, according to the present invention, a task required for producing an image is performed using a plurality of distributed nodes, that is, nodes for a specific task, and then collected in the image production management apparatus 100, and the final result data is based on the result. Each node may be connected to each other through the image production management apparatus 100, and the processing data (intermediate result) of each node may be shared to shorten the final result and the image production period. For example, the production of a film or an advertisement video has three stages of preproduction, production, and postproduction. The operation of the postproduction stage is assigned to a plurality of nodes connected to the call connection interface 110, thereby producing an image. Not only can you minimize the duration of the steps, but you can also reduce manufacturing costs.

The present invention has been limited to the embodiments of the present invention, but it is obvious that the technology of the present invention can be easily modified by those skilled in the art. Such modified embodiments should be included in the technical spirit described in the claims of the present invention.

1 is a block diagram showing the overall configuration for collaborative video production management according to an embodiment of the present invention,

2 is a block diagram illustrating an internal configuration of each node for collaborative video production management according to an embodiment of the present invention.

Description of the Related Art

100: image production management device 101: modeling node

102: animation node 103: lighting node

104: shading node 105: rendering node

106: compositing node 110: live action processing unit

120: call connection interface 130: resource database

140: data storage and processing unit 150: resource call unit

160: final result generation unit 170: display unit

Claims (5)

A call connection interface that connects to a plurality of nodes through a communication network and calls a node selected by an administrator among the plurality of nodes; A data storage and processing unit receiving data processed by a node called through the call connection interface and storing the processed data in a resource database, and sharing each data processed by the plurality of nodes to the plurality of nodes; A resource caller for displaying data stored in the resource database on a display unit at the request of an administrator; Final result generation unit for generating a final result using the data stored in the resource database Collaborative video production management device comprising a. A call connection interface that connects to a plurality of nodes through a communication network and calls a node selected by an administrator among the plurality of nodes; Receives data processed by a node called through the call connection interface and stores the data in a resource database, extracts data from the resource database according to a request of any one of the plurality of nodes, and then uses the call connection interface to extract the data. A data storage and processing unit provided to the arbitrary nodes; A resource caller for displaying data stored in the resource database on a display unit at the request of an administrator; Final result generation unit for generating a final result using the data stored in the resource database Collaborative video production management device comprising a. The method according to claim 1 or 2, The collaborative video production management device, A modeling node connected through the communication network to generate geometric information about an object in an image scene; An animation node connected through the communication network to set an animation for the object; A shading node connected through the communication network to perform a shading operation for expressing realistic texture of the object; A lighting node connected through the communication network to set lighting in the video scene; A rendering node connected through the communication network to render the image scene; And compositing nodes configured to synthesize images output from the rendering node through the communication network and through the call communication interface. The method according to claim 1 or 2, Each of the nodes, A multicore central processing unit having at least one core in one processor, A graphics processing unit with a programmable shader processor, Dedicated single instruction multiple data type hardware for processing said real-time processing data with said multicore central processing unit and graphics processing unit to generate said result data; And a terminal device including a communication interface for interworking with the collaborative video production management device through the communication network. The method according to claim 1 or 2, And the communication network is a wired or wireless communication network.

Images