JP2006221489A - Cg animation manufacturing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To progress a manufacturing operation without performing correction by using animation type picture conte for providing all information at the time of manufacturing CG animation. <P>SOLUTION: Animation type picture conte 2 including all information necessary for the manufacturing of CG animation is prepared. A 3D animation 4 moving characters is prepared according to character input instruction information and information related with camera works. A changed background 5 is prepared according to the background input instruction information and the information related with the camera works. Also, words, music and sound effects are inputted according to the input instruction information. In addition to visual effects (VFX) or the like, they are combined so that a composite image 6 can be prepared. The composite image 6 is subject to rendering according to light beam status information, and obtained as a completed video, and the rough CG animation of animation type picture conte 2 is replaced with the completed video, and obtained as a completed workpiece. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a CG animation production system, and more particularly to a system for producing a CG animation according to instruction information of a moving picture storyboard.

  Conventionally, when producing a cell animation, the procedure shown in FIG. 5 has been performed. First, make a plan and write a script. Draw storyboards based on the script. Draw the background and characters in the cell drawing according to the storyboard. After shooting and synthesizing these, dialogue, music and sound effects are added. When producing CG animation, basically it was made in the same way as movie and cell animation.

  Since such a method is inefficient, it has been proposed at an early stage to create a storyboard with a computer. For example, it has been proposed that hand-drawn storyboards are taken into a computer and the image of the finished work is presented by a presentation program. In this method, still images are displayed in sequence, but a method for expressing a moving image by simulating the background and the characters and moving the still image sprite screen separately has been devised. In addition, it has become possible to present a video close to the final image by making the movement of the characters fine and giving the background a perspective.

  These methods are generally called animatics, and are used as pilot videos composed of moving images. Animatics is used not only as a CG animation but also as a moving storyboard for ordinary movie production. Before actual filming begins, Animatics visualizes in advance what the scene will look like. Even if the director adds, cuts, or changes a scene, it can be executed at low cost. Not only directors, but also actors, film editors, special effects engineers and other staff use animatics.

  Also in the production of animation, a moving storyboard is created by simple CG animation and used as a guideline for subsequent production work. This is used both to present the entire flow and to present a partial video. This simple CG moving storyboard can be created relatively easily using a simple CG creation program and video authoring system. You can try. In addition, various methods have been used to efficiently produce CG animations using computers. The following are some examples of conventional animation production methods.

  The “animation creation method” disclosed in Patent Document 1 creates an animation that can move smoothly even when distributed through a communication network with a low data transmission speed, such as the Internet or a cellular phone network, and can be played back by a device with low processing capability. Is the method. Create storyboards based on the scenario. Determine the parts needed to build an animation. Create each part with vector data. Combine each part to create a key frame. When creating each part with vector data, unnecessary data is deleted to reduce the data of each part.

  This is a system for generating a moving image by estimating a three-dimensional posture of a virtual person from a two-dimensional line drawing drawn on a “person moving image creating system” storyboard disclosed in Patent Document 2. As shown in FIG. 6, a three-dimensional posture is automatically estimated from a two-dimensional line drawing described on a storyboard. Then, it is possible to estimate and generate a continuous three-dimensional motion from a storyboard of intermittent motion described on a storyboard using sample motions accumulated in advance. In addition, by adding a function that describes the context on the time axis to the storyboard, it is possible to express the timing of dialogue between a plurality of virtual persons. Furthermore, by sharing a storyboard among multiple CG animators, it becomes possible to support collaborative work at the time of CG creation.

  “Post-production support software” disclosed in Non-Patent Document 1 is software that manages and supports operations such as composition and special effects in video production. As shown in FIG. 7, the visual effect (VFX) work elements for each cut are made into a database. A worksheet with a layer function makes it possible to confirm the effect in advance (animatics display).

  The video editing system disclosed in Non-Patent Document 2 edits a movie in which drama film shooting, special effects material shooting, and full digital shooting for CG composition are mixed based on a digital storyboard. System. All storyboards are scanned and captured by the video editing system prior to shooting. For each cut, various elements such as information about whether it is special effects or CG and progress management information are added and saved. Using animatics, for every scene that needs to be composited, images of the completed scene are produced in advance using CG animation. Editing is performed prior to shooting, and a moving picture is created with a configuration close to the finished product based on the temporary material, resulting in the digital storyboard shown in FIG. The part after shooting is replaced with temporary material. Illustrations of composite scenes in digital storyboards will be replaced by CG animations in sequence.

Japanese Patent Laid-Open No. 2002-63588 JP 2003-58906 JP http://www.dcaj.org/bigbang/mmca/index.html http://www.apple.com/pro/film/lolerei/index.html

  However, the conventional moving storyboard has the following problems. That is, since the conventional moving storyboard does not present the specs of the finished image, there are many unconfirmed portions, and the next operation cannot be executed depending on this. We must always try and make productions by repeating trial and error. In addition, since the necessary information is not sufficiently incorporated, it is necessary to proceed with the creation of CG while adding creations with reference to other data.

  The object of the present invention is to solve the above-mentioned conventional problems, and in the production of CG animation, by using a moving picture-type storyboard that presents all information, the production work can basically proceed without correction. That is.

  In order to solve the above-described problems, in the present invention, a CG animation production system includes a moving picture type storyboard creating means for creating a moving picture type storyboard that includes all information necessary for producing a CG animation, and a moving picture type storyboard Background input means for inputting the background based on the background input instruction information, character input means for inputting a character based on the character input instruction information of the moving picture storyboard, and dialogue input instruction information of the moving picture storyboard Dialogue input means for inputting a dialogue based on, music input means for inputting music based on the music input instruction information of the moving picture storyboard, and input of the sound effect based on the sound effect input instruction information of the moving picture storyboard Sound effect input means, composition means for synthesizing video and audio according to the structure of the moving picture-type storyboard, and rendering into the synthesized video according to information about the light beam state of the moving-picture-style storyboard And a rendering means for applying the image.

  The animated storyboard includes information about camera work, the background input means includes means for creating a background image changed according to the information about camera work, and the character input means includes information about camera work. With a means to create a video with characters changing according to

  In addition, means for setting background input instruction information, means for setting character input instruction information, means for setting dialogue input instruction information, means for setting music input instruction information, in the moving picture storyboard generating means, Means for setting sound effect input instruction information, means for setting information relating to camera work, and means for setting information relating to the light beam state

  With the above-described configuration, in the production of CG animation, it is possible to efficiently perform the production work without making basic corrections using a moving picture-type storyboard that presents all information.

  Hereinafter, the best mode for carrying out the present invention will be described in detail with reference to FIGS.

  The embodiment of the present invention creates a movie type storyboard that includes all the information necessary for the production of CG animation, and based on the input instruction information of the movie type storyboard, the background, characters, dialogue, music, and sound effects This is a CG animation production system that inputs and composes, and renders the composite image based on the ray state information.

  FIG. 1 is a conceptual diagram of a production procedure by a CG animation production system in an embodiment of the present invention. In FIG. 1, a storyboard 1 is a hand-drawn storyboard. The animated storyboard 2 is a storyboard using rough CG animation. The time data sheet 3 is a time table attached to the moving picture storyboard. The 3D animation 4 is a three-dimensional animation such as a character created with polygons. Background 5 is a background image created as a still image. The composite image 6 is an image obtained by combining the 3D animation and the background.

  FIG. 2 is a detailed view of the production procedure by the CG animation production system in the embodiment of the present invention. In FIG. 2, a database 7 is a database that stores moving picture storyboard data and related data. Any general-purpose database connected to the network may be used as long as it can search and store a large amount of video data at high speed.

  FIG. 3 is a functional block diagram of the moving picture type storyboard creating apparatus. In FIG. 3, background input instruction information setting means 16 is means for setting background input instruction information relating to the background scene and color. The character input instruction information setting means 17 is means for setting character input instruction information regarding characters, animals, vehicles, and the like. The camera work information setting means 18 is means for setting information relating to the position and movement of the camera (viewpoint). The light ray state information setting means 19 is a means for setting information relating to the light ray state, such as how the light strikes from what direction. The dialogue input instruction information setting means 20 is a means for setting dialogue input instruction information relating to the content and timing of the dialogue of the characters. The music input instruction information setting means 21 is a means for setting music input instruction information relating to the music title and timing of BGM and the like. The sound effect input instruction information setting means 22 is a means for setting sound effect input instruction information regarding the type and timing of the sound effect. The communication means 23 is means for communicating with a database, a server, etc. via a network. The network 30 is a communication line such as a LAN or the Internet. The server 40 is one or a plurality of processing devices that execute image processing and the like. The client 50 is a terminal of each staff member who uses a database or a server.

  FIG. 4 is a functional block diagram of the CG animation production system. In FIG. 4, a moving picture type storyboard creating device 8 is a device for creating a moving picture type storyboard that includes all information necessary for producing a CG animation. The background input means 9 is a means for inputting a background based on background input instruction information of a moving picture type storyboard. The character input means 10 is means for inputting a character based on the character input instruction information of the moving picture storyboard. The dialogue input means 11 is a means for inputting dialogue based on dialogue input instruction information of a moving picture storyboard. The music input means 12 is means for inputting music based on the music input instruction information of the moving picture type storyboard. The sound effect input means 13 is a means for inputting a sound effect based on the sound effect input instruction information of the moving picture type storyboard. The synthesizing means 14 is a means for synthesizing video and audio in accordance with the configuration of the moving picture type storyboard. The rendering means 15 is a means for rendering the composite video according to the information on the light ray state of the moving picture type storyboard. Each of these means is realized as a client-server system interconnected by a network.

  The operation of the CG animation production system in the embodiment of the present invention configured as described above will be described. First, an outline of the operation will be described with reference to FIG. First, storyboard 1 is created according to the plan and scenario. This is the same as the conventional method. Based on the storyboard 1, a movie-style storyboard 2 is created that includes all the information necessary to produce a CG animation. This includes all necessary information such as the time data sheet 3.

  Based on the background input instruction information of the animated storyboard 2, a CG image of the background 5 video is created and input. Based on the character input instruction information, a CG image of the 3D animation 4 of the character is created and input. A line is input based on the line input instruction information. Music is input based on the music input instruction information. A sound effect is input based on the sound effect input instruction information. These are synthesized by adding visual effects (VFX) or the like to create a composite image 6. Rendering is performed on the composite image 6 to obtain a completed video. Replace the rough CG animation of the animated storyboard 2 with the completed video.

  Next, an operation procedure will be described with reference to FIG. The storyboard 1 is captured by the scanner and stored in the database 7. At the same time, input all the information necessary for the production of CG animation as detailed instructions. Instructions related to manual work are entered in text and drawings. When working with a computer, input instructions as much as possible with digital information available directly on the computer. Since these are integrally stored in the database 7, they can be referred to in a desired format.

  Create rough CG animation based on storyboard 1 data. A two-dimensional animation or a rough 3D animation expressed by rough polygons may be used. This can be created using a simple CG animation creation program. All necessary information including the three-dimensional movement of the person is set as the character input instruction information. Information is set in the same manner for moving objects such as animals and vehicles as well as people. All characters are included in the characters. Information relating to camera work is also set in the moving picture storyboard 2.

  As the dialogue input instruction information, information that indicates when a dialogue starts and ends is set. Necessary information such as start / end timing, tempo, and sound level is set as the music input instruction information. Necessary information such as the type of sound effect, start / end timing, and sound level is set as sound effect input instruction information. Other necessary instruction information is also visualized if it can be visualized. For example, dialogue instructions are also displayed on the screen so that they can be understood. You may enable it to output with synthetic voice according to a movie. This can also be easily created with an authoring program. For video and audio, time information is specified in detail. Provide visual effects as much as possible.

  A 3D animation 4 is created based on an instruction from the animated storyboard 2. Create a varied background according to the camerawork information. All moving objects such as characters, animals, and vehicles are expressed in 3D animation. The background video is superimposed on the video of characters, etc., and pattern and texture data are given to add visual effects and synthesize. Finally, rendering is performed by a ray tracing method or the like according to the 3D data and the ray information. Combine the video part with dialogue and music. Synthesis of speech parts such as dialogue can be performed at any stage.

  The operation of the moving picture type storyboard creating apparatus will be described with reference to FIG. Background input instruction information setting means 16 sets background input instruction information for each scene. That is, an image of a rough sketch is used as a background original and is captured by a scanner or the like. It may be created directly on a computer. The light state information setting means 19 sets information regarding the light state for the background original image. Further, camera work is determined, and camera work information setting means 18 sets camera work information. The background image is changed according to the camera work information, and the background video is input. That is, an image that is panned, zoomed, tilted, or the like is set according to the height, direction, angle of view, and the like of the camera. For the light beam state, only data is set and it is not reflected in the image.

  All information necessary for panning, zooming, and tilting, such as camera height, direction, angle of view, and focal length, are set. This information can be input directly as data, or the camera position can be input as data while changing the image on the screen in the same manner as in 3D-CAD. If the camera work information is stored as digital data, it can be used as it is by inputting it into a program for the next work. As background input instruction information, an original background image is input in accordance with camera work information. That is, an image that has been panned, zoomed, tilted, or the like is set according to the height, direction, and angle of view of the camera. The original background image may be an image of a rough sketch or an image created with simple drawing software.

  Character input instruction information is set by the character input instruction information setting means 17. That is, original images of characters, animals, and vehicles are taken in, and a two-dimensional motion image is generated as a two-dimensional image. This is replaced with a 3D image composed of rough polygons. Furthermore, three-dimensional data of the positions of the characters is set. A photographed video is generated from the three-dimensional data according to the camera work information. This 3D image is replaced with a 2D image. The light beam state is not reflected in the image.

  The dialogue input instruction information setting means 20 sets dialogue input instruction information. Set information that indicates when the dialogue begins and ends. Display the instruction of the dialogue so that it can be seen on the screen. You may enable it to output with synthetic voice according to a movie. The music input instruction information setting means 21 sets music input instruction information. Set necessary information such as start / end timing, tempo, and sound level. Sound effect input instruction information setting means 22 sets sound effect input instruction information. Set necessary information such as sound effect type, start / end timing, and sound level.

  Provide visual effects as much as possible. What is possible only by selecting a default operation and setting parameters, such as fade-in, fade-out, overlap, wipe, rotation, enlargement, and reduction, is set with digital data. Edit the composite of these, excluding details and unfinished parts, and make the shape close to the finished shape. Since this data is stored in a common database 7, all staff such as animators and composers can refer to and update the data.

  In these processes, the database 7 and the server 40 are accessed via the communication means 23 and the network 30 as necessary to acquire necessary data and request the server 40 for image processing and the like. Further, the created data is stored in the database 7.

  The operation of the CG animation production system will be described with reference to FIG. The moving picture type storyboard creating device 8 creates a moving picture type storyboard that includes all the information necessary for producing the CG animation. Basically, all processing can be executed based on the explicit instruction of the moving picture type storyboard 2 and the omitted implicit default value. However, it is possible to modify details and to create a detailed operation by changing the indicated value or the default value. If necessary data is prepared in advance, it is possible to automatically generate a CG image only by inputting the instruction data of the moving picture type storyboard 2 into the CG creation program.

  The background input means 9 inputs the background based on the background input instruction information of the moving picture storyboard. Create a varied background according to the camerawork information. A simple one uses one or more two-dimensional background images. For complicated objects, background object data arranged three-dimensionally is used. These images are used as background images, which are taken by a virtual camera in a three-dimensional virtual space according to information relating to camera work.

  The character input means 10 inputs a character based on the character input instruction information of the animated storyboard. First, create a CG animation with only the motion information of the characters. That is, 3D data in which a character is moved is created using data created three-dimensionally using a wire or a skeleton. A video obtained by virtually capturing the image according to information relating to camera work is created. It is given flesh by giving external data such as a person model. Furthermore, the detailed composition is determined and the video data of the characters moving in the three-dimensional virtual space is completed.

  The dialogue input means 11 inputs dialogue based on dialogue input instruction information of the moving picture storyboard. The music input means 12 inputs music based on the music input instruction information of the moving picture storyboard. The sound effect input means 13 inputs the sound effect based on the sound effect input instruction information of the moving picture type storyboard. These can be input simply by referring to the animated storyboard.

  The synthesizing means 14 synthesizes video and audio according to the structure of the moving picture type storyboard. The background video is superimposed on the video of characters, etc., and pattern and texture data are given to add visual effects and synthesize. The rendering means 15 renders the composite video according to the information on the light ray state of the moving picture storyboard. Rendering is performed by the ray tracing method or the like according to the 3D data and the ray information, and the moving image portion is completed.

  In this way, the animated storyboard is a useful tool for CG animation production staff, especially directors. With a video-type storyboard that can present moving images that are much closer to the finished form than the storyboard, the director in charge can check his / her own image, and can accurately grasp the excess or deficiency of expression, mistakes and contradictions. When the animated storyboard is completed, all the basic corrections have been taken in, so there will be no basic corrections in the subsequent work.

  Creators of animators, fine art designers, and composers can confirm the intention of directing in the “movie state” using the animated storyboard. Since the production intention can be grasped correctly, each creator can quickly start the creative work to be done. By sharing video storyboard data online, all creators and production managers can check the progress of production work at any time. The production period can be shortened and the rework work due to inadequate communication can also be reduced. Furthermore, since all processes are recorded accurately, know-how for CG animation production can be easily accumulated and improved.

  As described above, in the embodiment of the present invention, the CG animation production system creates a movie type storyboard including all information necessary for production of CG animation, and based on the input instruction information of the movie type storyboard, the background The characters, dialogue, music, and sound effects are input and synthesized, and the composite image is rendered based on the light state information, so that the production can proceed without any basic correction.

  The CG animation production system of the present invention is optimal as a moving picture storyboard creation system for CG animation production. It can also be used for cell animation and movie production.

It is a conceptual diagram of the CG animation production system in the Example of this invention. It is detail drawing of the production procedure by the CG animation production system in the Example of this invention. It is a functional block diagram of the moving picture type storyboard creation device of the CG animation production system in the embodiment of the present invention. It is a functional block diagram of the CG animation production system in the Example of this invention. It is a flowchart which shows the production procedure of the conventional cell animation. It is a conceptual diagram which shows the conventional person moving image production system. It is a figure which shows the screen of the conventional post-production support software. It is a figure which shows the screen which edits a movie using a digital storyboard in the conventional video editing system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Storyboard 2 Animation type storyboard 3 Time data sheet 4 3D animation 5 Background 6 Composite image 7 Database 8 Animation type storyboard creation apparatus 9 Background input means
10 Character input method
11 Dialogue input means
12 Music input means
13 Sound effect input means
14 Synthesis means
15 Rendering means
16 Background input instruction information setting means
17 Character input instruction information setting means
18 Camera work information setting method
19 Ray state information setting means
20 Dialog input instruction information setting means
21 Music input instruction information setting means
22 Sound effect input instruction information setting means
23 Communication means
30 network
40 servers
50 clients

Claims (4)

Movie type storyboard creating means for creating a movie type storyboard including all information necessary for production of CG animation, background input means for inputting a background based on background input instruction information of the movie type storyboard, and movie type picture Character input means for inputting a character based on the character input instruction information of the storyboard, line input means for inputting a dialogue based on the dialogue input instruction information of the movie-type storyboard, and music input instruction of the movie-type storyboard A music input unit that inputs music based on information, a sound effect input unit that inputs sound effects based on sound effect input instruction information of a moving picture type storyboard, and a video and a sound are synthesized according to the configuration of the moving picture type storyboard CG animation comprising: synthesis means; and rendering means for rendering the synthesized video in accordance with the information on the light ray state of the moving picture storyboard. Production system. The moving picture type storyboard includes information relating to camera work, the background input means includes means for creating a background image changed according to information relating to camera work, and the character input means appears according to information relating to camera work. 2. The CG animation production system according to claim 1, further comprising means for creating an image in which a person is changed. The moving picture type storyboard creating means includes means for setting background input instruction information, means for setting character input instruction information, means for setting dialogue input instruction information, means for setting music input instruction information, 2. The CG animation production system according to claim 1, further comprising means for setting sound effect input instruction information, means for setting information relating to camera work, and means for setting information relating to a light beam state. A moving picture type storyboard creating apparatus for creating a moving picture type storyboard that includes all information necessary for production of CG animation, a means for setting background input instruction information, a means for setting character input instruction information, and a dialogue Means for setting input instruction information; means for setting music input instruction information; means for setting sound effect input instruction information; means for setting information relating to camera work; and means for setting information relating to a light beam state An animation type storyboard creation device characterized by comprising.

Images