KR100322618B1 - Method and apparatus for generating digital moving pictures - Google Patents

Abstract

The present invention provides a digital moving picture generation method and apparatus for predicting object movement between original pictures using image recognition and processing techniques in the process of producing original animations, and thereby automatically generating a moving picture corresponding to the request of the producer. To this end, the present invention, the background / object separation block for separating the background image and the object from the original image using a segmentation technique for the image input in various forms; A background storage memory block for storing a background screen separated by a background / object separation block; A grouping block for grouping related parts on the basis of change and movement of color / contrast for the object separated from the background / object separation block; A modeling block for mathematically modeling the movement of the object when the object recognition and grouping process is completed; A moving picture generation and interpolation block for generating and inserting a moving picture to be inserted between original pictures; An image synthesizing block for synthesizing the moving image interpolated by the moving image generation and interpolation block and the background screen stored in the background storage memory block and outputting the entire image screen; Production of animation using a computer by including a control block for generating various control signals for controlling the operation of the grouping block and modeling block, the moving picture generation and the interpolation block based on the operation signal input from the user through the external operation signal input means. This can dramatically reduce the time and cost of the process.

Description

METHOD AND APPARATUS FOR GENERATING DIGITAL MOVING PICTURES

The present invention relates to a digital moving picture generating apparatus, and more particularly, to a digital moving picture generating method and apparatus capable of automatically generating and displaying moving pictures according to a user's request by predicting object movement between original pictures.

In general, a fairy tale represents a process between original painting and coloring, and if the original depicts a vertex of movement for each scene's linkage, the fairy tale complements the movement that the original seeks, with more detailed connection between the vertices and the vertices. It means to complete. In other words, the process of assimilation is a process of dividing the original and the original picture and bridging the vertices of the motion.

On the other hand, in recent years, two-dimensional or three-dimensional animation film production industry using computer graphics technology has been activated. This animation production process is a complex work of creating a work of art using rapidly developed computer processing technology.

And most of the animation production process is based on the story development of the script, the original picture is first created around the characters of the work, the fairy tale between the original pictures is created and inserted, the cells of each screen are colored, and the background and sound are mixed with it. The final work is completed.

In the animation production process, the above-described production of the original picture was generally performed by human hand, and thus there was an uneconomical problem requiring much time and manpower.

Accordingly, the present invention is to solve the above-described problems of the prior art, using the image recognition and processing techniques in the process of producing the original animation to predict the movement of the object between the original painting and thereby to correspond to the needs of the producer It is an object of the present invention to provide a method and apparatus for generating a digital moving picture which can automatically generate the.

According to an aspect of the present invention, there is provided a digital moving picture generation apparatus, which is configured to divide a background image and an object from an original image using an image segmentation technique. Object separation block; A background storage memory block for storing the background screen separated by the background / object separation block; A grouping block for grouping related portions on the basis of a change in color / contrast and movement of the object separated from the background / object separation block; A modeling block for mathematically modeling the movement of the object when the recognition and grouping process of the object is completed; A moving picture generation and interpolation block for generating and inserting a moving picture to be inserted between the original pictures; An image synthesizing block for synthesizing the moving image interpolated by the moving image generation and interpolation block and the background screen stored in the background storage memory block and outputting an entire image screen; A digital moving picture including a control block for generating various control signals for controlling operations of the grouping block, the modeling block, the moving picture generation, and the interpolation block based on an operation signal input from the user through an external operation signal input means. Provides a generating device.

In accordance with another aspect of the present invention, there is provided a method of generating a digital moving picture, wherein an input image inputted in various forms is separated from an original image using an image segmentation technique. A first step of storing the separated background screen in a memory means; A second step of grouping related parts with respect to the separated object based on a change or movement of color / contrast; A third step of mathematically modeling the movement of the object when grouping of the object is completed; Generating a moving picture according to time according to a modeling result of the object and inserting the generated moving picture; And a fifth step of synthesizing the interpolated moving picture and the background screen stored in the memory means and outputting the entire video screen.

1 is a block diagram showing the configuration of a digital moving picture generating apparatus according to a preferred embodiment of the present invention;

2 is a view illustrating a process in which an object and a background screen are separated from an original for generating a moving picture according to the present invention;

3 is a view illustrating a grouping process of objects for generating a moving picture according to the present invention;

4 is a view illustrating a grouping process of another object for generating a moving picture according to the present invention;

5a to 5d are diagrams for explaining a linear motion form of an object during a moving picture generation process according to the present invention;

6 is a view illustrating a modeling process of an object having a nonlinear motion during a moving picture generation process according to the present invention;

7A and 7B are diagrams for explaining a process of interpolating a video generated during the video creation according to the present invention;

8 is a diagram for explaining a process of estimating a motion based on a database during a moving picture generation process according to the present invention;

<Description of the code | symbol about the principal part of drawing>

110: background / object separation block 120: background storage memory block

130: grouping block 140: modeling block

150: animation generation and interpolation block 160: video synthesis block

170: control block 180: database block

The above and other objects and various advantages of the present invention will become more apparent from the preferred embodiments of the present invention described below with reference to the accompanying drawings by those skilled in the art.

First, the core technical gist of the present invention is to significantly reduce the time and expense of the computer animation production process by using image recognition and processing technology, and investigates the change or movement of color / contrast of each object between originals. It is to automatically generate fairy tales that meet the needs of the creators.

In general, there are many associations between originals and originals in making animations, and when an object moves to another position in the next scene, the moving path is automatically generated when the object is predicted. You can do it. Therefore, in the present invention, first, the relationship between the objects is established in the input original picture, and based on this, the objects are classified into different groups by using the color / contrast change or the characteristics of the movement. The complex changes and movements of the color / contrast of the analyzed object are expressed by affine transformation, and the trajectory of the movement is described using a straight line or a spline, and then used to express the trajectory between the originals. Automatically create and insert a number of moving pictures.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a configuration of a moving picture generating apparatus according to an exemplary embodiment of the present invention. The background / object separation block 110, the background storage memory block 120, the grouping block 130, and the modeling block 140 are illustrated in FIG. ), A moving picture generation and interpolation block 150, an image synthesis block 160, a control block 170, and a database block 180.

Referring to FIG. 1, the background / object separation block 110 analyzes an input image in various forms such as a Joint Photographic Experts Group (JPEG) and a Graphic Interchange Format (GIF) to perform a function of separating a desired object from an original picture. do. The background storage memory block 120 is a means for storing the background of the original picture separated from the background / object separation block 110.

On the other hand, the grouping block 130 groups the relevant parts automatically or by a user (manufacturer) specified based on the change or movement of the color / contrast for the object separated from the above-described background / object separation block 110.

When the recognition and grouping process of the object is completed through the above-described process, the modeling block 140 mathematically models the movement of the object, and classifies the movement of the object in the form of a straight line or a curve. Each modeling.

The moving picture generation and interpolation block 150 is a block for generating a moving picture to be inserted between the original pictures and controlling the insertion time of the generated moving picture uniformly or non-uniformly according to the movement of the object. That is, the interpolation time interval of the generated moving picture is adjusted according to the movement of the object.

The image synthesizing block 160 synthesizes the moving images interpolated at uniform or non-uniform time intervals in the moving image generation and interpolation block 150 and the background images stored in the background storage memory block 120 to output the entire image screen. Will be performed.

On the other hand, the control block 170 according to the present invention when the user (or the manufacturer) inputs the desired operation signal through the external operation signal input means (not shown), the various control signals in response to the operation signal generated thereby For example, a grouping control signal is generated in the above-described grouping block 130 to perform grouping on a specific part of an object designated by a user, and a modeling control signal is generated in the modeling block 150 to move the object. The trajectories of are classified into straight or curved lines to perform their respective modeling. In addition, the control block 170 generates a control signal corresponding to an input value input by the user to adjust the moving picture interpolation time interval of the moving picture generation and interpolation block 150.

The database block 180 is a means provided for estimating the movement of the object when an object that does not exist in the previous original is newly added or removed in the next original according to the present invention. In detail, if a new object is added between the originals that is not present in the previous original, the user may specify movements for each situation for the added object. If you save the data, you can estimate the motion of the newly added object more efficiently.

Hereinafter, a digital moving picture generation method according to a preferred embodiment of the present invention will be described in detail with reference to FIG. 1.

First, when an image of an original is input as various types of data, the background / object separation block 110 analyzes the input image and applies an image segmentation technique to separate an object from the background as shown in FIG. 2. do. That is, the background image of the still image and the image of the continuously moving object are separated from the original picture, respectively.

Then, the background screen separated from the original picture is stored in the background storage memory block 120, and the image of the object is provided to the grouping block 130, and the grouping block 130 is used to color the object separated from the background. Group related parts based on change or movement of contrast. Referring to FIG. 3 as an example, the traveling direction of the bicycle (object) shown in FIG. 3 is forward, but the movement of the wheel is the rotation direction. Therefore, after separating the object (bicycle) from the background, each grouping according to the movement.

On the other hand, such a grouping process may be automatically performed as described above, or the user (or producer) may designate a group as a group and perform grouping accordingly.

On the other hand, when an object separated from the background makes a more complex movement or change, for example, when the separated object performs rotational motion and joint motion at the same time, the object is grouped more finely accordingly. .

FIG. 4 is a diagram exemplarily illustrating this. When the object is a person, the following description will be given.

As shown in the drawing, when the object separated from the input image is a human, the user performs grouping separately by designating parts to be grouped according to the direction of joints or movements such as arms, legs, waist, and neck. In this case, the grouping process can be adaptively applied to each object such as an animal as well as a human.

On the other hand, when the grouping for each object is completed through this process, the motion of the object must be mathematically modeled, typically, the motion of the object can be classified as linear or nonlinear motion in the form of a straight line or a curve.

5A to 5D are diagrams for explaining this. First, FIGS. 5A and 5B are diagrams illustrating a moving picture having linear movements over time, considering two original pictures as boundary values, and FIG. 5C and 5D exemplarily show a moving picture having a curved movement.

Here, in order to express when the object has a curved movement as shown in FIGS. 5C and 5D, a spline curve as shown in FIG. 6 is used or Model using the polynomial of.

When the modeling of the movement and the expression method of the object is completed through each of these processes, the moving picture generation and interpolation block 150 generates a moving picture according to the modeling result of the object and inserts the generated moving picture. Interpolation is performed, and the time for inserting a fairy tale can be interpolated by adjusting at uniform or non-uniform time intervals.

In other words, if two originals are regarded as both boundary values and they move uniformly with time, as shown in FIG. 7A, a fairy tale is inserted every equal time, and if the object moves with acceleration, When the speed gradually decreases, there is a non-uniform time interval, and as shown in FIG. 7B, the user arbitrarily inputs a moving time standing time interval and inserts a non-uniformity accordingly.

On the other hand, when an object that is not added between the original pictures is newly added, the above-described motion estimation technique cannot be applied as it is. In this case, the user designates the motion of the object according to each case.

For example, as illustrated in FIG. 8, when a finger (object) is stretched from one to two, if a user designates a new finger and defines the direction of movement as upward, the user may move correspondingly. At this time, the position of the other finger may be left as it is, or the processing for this case may be databased in advance so that the other finger may be moved by the processing defined in this database.

That is, the database block 180 may store the motion information of various objects in a database, and the user may easily estimate the motion of the object using the motion information of the various objects stored in the database block 180. As described above, the database block 180 can be easily used to estimate the movement of the newly added object.

On the other hand, if a fairy tale is generated through each process as described above, coloring the fairy tale with the same color and contrast as the original picture is also an important process. This contrast and coloring process can be performed using the above-described grouping information, that is, the grouping information grouped by the above-described grouping block 130.

In detail, the grouping block 130 stores color or contrast information in each grouping area in the above-described grouping process, and when the object is transformed or moved in the input model by an affine transformation, etc. It keeps track of groupings so you can keep track of them.

Accordingly, the object is continuously tracked to give the newly created moving object the same contrast and color as that area. That is, color / contrast information of the grouped areas is extracted from the input original image, and the same object and color information as the input original image are given by continuously tracking the same object for the moving picture.

Through this process, when the completed moving picture is generated according to the movement of the object, it is synthesized with the background screen through the image synthesis block 160 and output as a complete image (animation).

As a result, it is possible to interactively directly check the generated fairy tale in real time using the method of generating a fairy tale according to the present invention, and to perform the overall animation production work.

As described above, according to the present invention, it is possible to more efficiently generate a digital animation generation process that requires a lot of cost and manpower in a short time, thereby dramatically reducing the time and cost required in the process of animation production using a computer. It has an effect. In addition, the number of animations inserted between the original paintings can be adaptively adjusted by the producer, and the coloring process of each animation can be automatically performed.

Claims (12)

In the digital animation automatic generator, A background / object separation block that separates a background image and an object from an original image by using image segmentation techniques for inputting images in various forms; A background storage memory block for storing the background screen separated by the background / object separation block; A grouping block for grouping related portions on the basis of a change in color / contrast and movement of the object separated from the background / object separation block; A modeling block that mathematically models the movement of the object when the recognition and grouping process of the object is completed; A moving picture generation and interpolation block for generating and inserting a moving picture to be inserted between the original pictures; An image synthesizing block for synthesizing the moving image interpolated by the moving image generation and interpolation block and the background screen stored in the background storage memory block and outputting an entire image screen; A digital moving picture including a control block for generating various control signals for controlling operations of the grouping block, the modeling block, the moving picture generation, and the interpolation block based on an operation signal input from the user through an external operation signal input means. Generating device. The method of claim 1, wherein the moving picture generating apparatus, When the motion of various objects is pre-stored in the form of a database to add or disappear a new object that does not exist between the original pictures, the motion for the object is extracted from the database to estimate the motion of the added object. A digital moving picture generating apparatus further comprising a database block for enabling. The digital moving picture generating apparatus according to claim 1 or 2, wherein the grouping block is grouped according to the change and the movement of the color / contrast of the portion designated by the user based on the control signal. The apparatus of claim 1 or 2, wherein the modeling block classifies the movement of the object into a straight line or a curved line based on the control signal, and models each of the modeling blocks. The digital image generating system according to claim 1 or 2, wherein the moving image generation and interpolation block inserts the generated moving image by uniformly or non-uniformly adjusting the insertion time of the generated moving image according to the movement of the object. Fairy Tale Generation Device. The method of claim 4, wherein the modeling block comprises: a spline curve when the object has a curved motion; Digital moving picture generating apparatus characterized in that the modeling using a polynomial represented by. In the digital moving picture generation method, A first step of separating a background image and an object from an original image by using an image segmentation technique for input images input in various forms, and storing the separated background image in a memory means; A second step of grouping related parts with respect to the separated object based on a change or movement of color / contrast; A third step of mathematically modeling a trajectory of movement of the object when grouping of the object is completed; Generating a moving picture according to time according to a modeling result of the object and inserting the generated moving picture; And a fifth step of synthesizing the interpolated moving picture and the background screen stored in the memory means and outputting an entire video screen. The method of claim 7, wherein the assimilation generating method, In the case where a new object that does not exist between the original pictures is added by storing the motion of various objects in the form of a database, the motion of the added object may be extracted from the database to estimate the motion of the added object. Digital moving picture generation method further comprising the step of enabling. The method of claim 7 or 8, wherein the second step comprises grouping according to a change and movement of color / contrast of a specific part of the object designated by a user through an external manipulation means. . The method of claim 7 or 8, wherein the third step is based on a control signal input by the user through an external operation means to classify the movement of the object in the form of a straight line or a curve, respectively, characterized in that modeling How to create a digital fairy tale. The digital moving picture generation method according to claim 7 or 8, wherein the fourth step inserts the generated moving picture by uniformly or non-uniformly adjusting the insertion time of the generated moving picture according to the movement of the object. Way. The method of claim 10, wherein the third step comprises: a spline curve when the object has a curved motion; Digital moving picture generation method characterized in that the modeling using a polynomial represented by.