KR20060040118A - Method and appartus for producing customized three dimensional animation and system for distributing thereof - Google Patents

Abstract

According to the present invention, a full three-dimensional animation is provided by forming a three-dimensional model from a two-dimensional source for a real person and replacing the newly formed three-dimensional model with a character face of the original animation. These custom 3D animations are prepared for background animations and 3D standard face models, 3D standardized models from 2D sources, animated and rendered to form mask sources and background animations. And post-processing to synthesize mask sources to complete custom animations and transform media.

Description

METHOD AND APPARTUS FOR PRODUCING CUSTOMIZED THREE DIMENSIONAL ANIMATION AND SYSTEM FOR DISTRIBUTING THEREOF

1 is a view schematically showing a process of ordering, producing and distributing customized animations according to the present invention.

2 is a view schematically showing each step of producing a custom animation according to the present invention.

3 is a view schematically showing a process of standardizing a two-dimensional source in three dimensions according to the present invention with an actual image.

4 is a view schematically showing the entire process of producing a customized three-dimensional animation according to the present invention with a real image.

5 is a hardware block diagram for producing a custom three-dimensional animation according to the present invention.

<Description of main parts of reference numerals>

10: image processing unit 11: graphics processing unit

12: mapping processing unit 13: animation processing unit

14: rendering processing unit 20: memory                 

30: CPU 40: voice processing unit

50: video synthesis unit

The present invention relates to a method and apparatus for producing custom 3D animation and a distribution system thereof, and more particularly, to a method and apparatus for producing and distributing custom 3D animation provided with a source from a 2D photo, etc. It's about the system.

Animation can be defined as the act of giving a soul or a spirit to a lifeless thing. In other words, animation refers to a technology or technique in which a person does not have life and is personified according to the creator's intention and is created through a video medium such as film or VTR. In addition, animation includes a video technology that captures a single picture or movement of an object frame by frame and shows the effect as if it were alive. Furthermore, all video language and video technologies for time, motion, and light are collectively referred to. In addition, it generally refers to TV cartoons or cartoon movies implemented in the video medium.

These animations represent a story that takes place in a virtual world that is different from the real one. Fun and realistic expressions that are different from dramas or movies limited to the real thing can be made possible. The characteristics of these animations are particularly well-suited to children's emotions, and they are actually used for entertainment, play or education at home or kindergarten.

While animation alone is a good entertainment or educational resource, if the protagonist of the animation becomes “my”, the suction power of the animation will increase further. For example, if the face of my daughter “○○○” is the main character in the snow-white animation, we will be drawn into the animation as if she became Snow White. .

Conventionally, there is a technique of producing and distributing an animation by replacing a face of a real person in the face of a character in animation, but in the two-dimensional animation, only a picture of a real person in a still image is replaced without changing the expression.

Animation production methods are divided into traditional cell animation methods and digital animation methods. Because cell animation draws the whole process by hand, it takes a long time to produce, and there is a limit to expressing three-dimensional and three-dimensional space. For example, Walt Disney's Snow White and the Little Mermaid are analogue works of traditional cell animation. Digital animation is a way of processing graphics with binary code using computer, which is divided into 2D animation and 3D animation. Both methods use interpolation, an inbit win method that automatically creates the intermediate process by specifying the beginning and end of the character's actions. The beginning and the end of the operation are referred to as key frames, respectively, as operation frames that become keys. The two-dimensional animation mainly uses to compensate for the drawbacks of the traditional cell animation, that is, redrawing every frame and lengthening the production period.

3D animation is characterized in that the character and the background on which the character appears, such as to express the three-dimensional information to implement it graphically. Therefore, the three-dimensional expression of the object can be expressed more similar to the real thing. In addition, it is possible to view the implemented movement from various angles, so that the correction and supplementation of the scene are performed in real time. Therefore, the 3D animation production method is suitable for the expression of characters that can feel real.

Therefore, there is a need for a method and apparatus for implementing an animation by directly setting the main character of the animation as a person and replacing a face of a character with a face of a real person in an animation in which a three-dimensional reality is realized.

The present invention is to create a custom three-dimensional animation, in particular to form a three-dimensional model from the two-dimensional source of the real person, and to replace the newly formed three-dimensional model with the character face of the original animation to implement a full three-dimensional animation The purpose.

In order to achieve the above object, a preparation process for producing a background animation and a 3D standard face model, a production process for forming a mask source by forming a 3D standardized model from a 2D source, performing an animation process and a rendering process, and It includes post-processing to synthesize background animations and mask sources to complete custom animations and transform media. Details of each process will be described later.                         

In addition, the present invention aims to immediately reflect the movement of the character in order to implement a full three-dimensional animation and to enable fast rendering.

In order to achieve the above object, in the present invention, the background animation and the mask animation, that is, the mask part to be replaced by the face of the real person are separated and the rendering process is performed to enable the fast rendering process.

In addition, the present invention aims to electronically implement a series of processes for receiving a custom 3D animation production order from a customer, and producing and distributing a custom 3D animation to a customer according to the present invention.

Custom 3D animation production and distribution system to achieve the above object includes a customer terminal for requesting the customer to create a custom 3D animation, and an animation production computer for performing 3D animation production according to the order, When a customer orders a custom 3D animation production by specifying a 2D source and original animation, the production computer that receives this forms a 3D standardized model from the 2D source and forms a mask source through mapping, animation, and rendering. You then complete the process of compositing the background animation and mask source to complete the creation of your custom 3D animation. It then involves a series of steps to send the completed animation to the client.

Hereinafter, the configuration of the present invention will be described in detail with reference to the accompanying drawings.                     

1 is a view schematically showing a process of ordering, producing and distributing customized animations according to the present invention. According to FIG. 1, a customer provides a two-dimensional source while ordering a custom animation and specifies the desired one animation. In the present invention, a case of using a photograph as a two-dimensional source will be described, but includes an image file captured by a digital camera and the like. An animation production computer creates an animation and stores it in a recording medium such as a video or a CD and delivers it to the customer offline, or sends the completed animation file to the customer online.

2 is a view schematically showing each step of producing a custom animation according to the present invention. This process is described in detail by dividing this into preparation, production, and post-processing.

Preparation process

(1) background animation

-. Create a background animation. In the background animation, the face part is replaced with a display model representing the eyes, nose and mouth.

-. Make a sound source.

-. Complete the animation except for the face.

(2) mask preparation (to form a three-dimensional standardized model)

-. Dozens (eg 30) of faces are synthesized and normalized. This is to prevent a lot of error even when a two-dimensional source having a face shape of some type is input.                     

-. Create a standardized three-dimensional face model based on a standardized two-dimensional face photograph. This will be the standard model for eye, nose and mouth positions and facial contours.

-. The 3D face model generated by the standardization work is put in a pre-made background and synchronized. It also embodies the look and lip sync that go well with the sound source. This means matching the motion sync to the display model, matching the positions of the pre-processed eyes, nose and mouth.

Production process

-. Take an order from a customer. Then, the customer is provided with a two-dimensional source, for example, a photo, to be animated.

-. Modify the two-dimensional source so that the standardization work is consistent with the preceding framework. This is accomplished by matching the positions of the eyes, nose and mouth of the two-dimensional source with the positions of the eyes, nose and mouth of the preceding frame.

-. A face part is separated from a pre-made background animation to insert, or map, a 3D standardized model. The face part of the character in the pre-made background animation is completed by mapping a 3D standardized model of the customer (order) to an unfinished part existing as 3D data.

-. Render the mapped model. At this time, the background is processed in black and only the face is rendered, so that rendering is possible in near real time. A "sequenced alpha mask source image" is obtained with the face part white and the background part black.                     

Post-processing

-. Upload and render an alphaized sequence file over a pre-created background. The background image is projected onto the black part of the mask, resulting in an exact match between the background and the face.

-. The animation of the orderer's face appears in the prepared sound source and the prepared background image.

-. Convert the media to the desired format. Video, mobile images, CDs, DVDs can be produced.

In detail, the process of forming the 3D standardized model in the above preparation process may include four types of standard forms, for example, a basic form, a dry form, a chubby form, and an elongated form. Then, for each standard, the size, color tone, and alignment method are selected. In particular, determine the best location for eyes, nose and mouth. This standard model is stored in memory, and when a two-dimensional source is provided from a customer, it is determined which standard type the source provides and selects and applies the standard type.

In addition, when the mapping / animation / rendering process is described in detail in the production process, the process of separating the face part of the background animation prepared in advance and inserting the 3D standardized model reflecting the orderer's face into the face part is the mapping process. Since the face part was made into a frame (a display model representing eyes, nose, and mouth) when producing the background animation, mapping is achieved by inserting a three-dimensional normalized model into the face part of the background animation. The model thus mapped becomes the new model. Then, the new model performs the animation process according to the motion sequence of the original animation so that the original model's movement can be realized in the original animation such as closing or opening eyes, smiling face, crying face, and talking face. do. In this case, rendering is not performed for the entire animation, but only for the face part, so that quick rendering is possible. The rendered image thus becomes a mask source for compositing with the background image. Finally, the process of synthesizing the background image of the original animation and the new model is completed to create a custom animation.

3 is a view schematically showing a process of standardizing a two-dimensional source in three dimensions according to the present invention with an actual image. There is a two-dimensional source in the upper right of Figure 3, based on it, the corresponding standard type is selected from among the standard types prepared in advance to perform the three-dimensional processing. Therefore, in the two-dimensional source, only the face of one face, for example, the front face can be seen, but after the three-dimensional processing, the side view, the head slightly raised, the prone figure, etc. are possible.

4 is a view schematically showing the entire process of producing a customized three-dimensional animation according to the present invention with a real image. The original animation is Snow White, and the two-dimensional source is the front face of a girl in A. The result of the three-dimensional normalization of the two-dimensional source is an image expressed in B, and a combination of the background animation of the original animation expressed in C by masking it is expressed in E.

5 is a hardware block diagram for producing a custom three-dimensional animation according to the present invention. The background animation produced in preparation and the 3D standard face model are stored in the memory 20. The image processing unit related to custom 3D animation production according to the present invention includes a graphic processing unit 11, a mapping processing unit 12, an animation processing unit 13, and a rendering processing unit 14. When the 2D source is input from the customer, the graphic processor 11 selects a corresponding face model from the standard face models previously stored in the memory and applies the 2D source to the selected face model. The mapping processor 12 separates the face part from the background animation and maps the 3D normalized model to the separated face part. The animation processor 13 animate the mapped three-dimensional standardized model (ie, a new model) to operate according to the motion sequence of the entire animation. In the animation process, a sound source prepared in advance acts as a sync sync. The rendering processing unit 14 then performs a rendering process. The model that has been rendered is called a mask source. Since the rendering process is limited to the face part, the rendering process time is greatly reduced.

The image synthesizer 50 synthesizes a background animation and a mask source. In this case, the sound source prepared in advance acts as a synch sync.

According to the present invention, since the actual person appears in the animation, the customer who views it can feel more direct satisfaction. Therefore, the entertainment or educational effect is much larger than the normal animation.

While the present invention has been described with reference to the preferred embodiments, those skilled in the art will understand that the present invention may be modified without departing from the spirit and scope of the invention. For example, in the present embodiment, the background animation in which the face part of the character is processed as the display model is described as being separately used. However, the present invention may also be applied to animation when the face part of the character is completed. In this embodiment, the animation processing is performed on a 3D standardized model on which a 2D source corresponding to a real person is coated. However, the animation processing is performed on a standard face model before the 2D source is applied. can do. In the present embodiment, the case where there is only one character is described, but a family animation in which a plurality of characters such as mom, dad and I appear can be produced.

Claims (6)

In the custom 3D animation production device, A memory for storing a prepared 3D standard face model and a pre-made background animation, An image processor which receives a two-dimensional source in which a face of a real person is expressed and forms a three-dimensional mask source; An image synthesizer for synthesizing the 3D mask source generated by the image processor and a pre-made background animation. Custom 3D animation production device comprising a. The method of claim 1, The image processor, A graphic processor configured to receive the 2D source and form a 3D standardized model by selecting and applying a corresponding face model from the 3D face model stored in the memory; An animation processing unit for implementing the motion of the animation using the three-dimensional face model or the three-dimensional standardized model Custom 3D animation production apparatus comprising a. The method of claim 2, The image processing unit may further include a rendering processor configured to render the processed 3D standardized model or the background animation. In how to create a custom three-dimensional animation, Preparing and saving a 3D standard face model and background animation in advance, Forming a 3D mask source by receiving a 2D source in which a face of a real person is expressed; Synthesizing the 3D mask source with a pre-made background animation Custom 3D animation production method comprising a. The method of claim 4, wherein The three-dimensional mask source forming step, Forming a 3D standardized model by selecting and applying a corresponding face model from a previously stored 3D standard face model by receiving the 2D source; Implementing an animation motion using the 3D face model or the 3D normalized model Custom 3D animation production method that includes. The method of claim 5, And rendering the animated three-dimensional normalized model or background animation.

Images