KR101111172B1 - Method for producing moving picture of composite user image - Google Patents

Abstract

The present invention relates to a method for producing a video synthesized with a user image, and more particularly, the user can be a main character of the video directly, thereby increasing learning and entertainment effects, and the user's face-synthesized character moves naturally. The present invention relates to a method for producing a video by synthesizing a user image capable of realizing a video and enhancing the perspective, speed, and completeness of the video in which the user's face is synthesized.

According to the present invention, a method for producing a video synthesized with a user image, comprising: an image preparation step of preparing a user image; A synthesizing target layer manufacturing step of distinguishing the synthesizing target region to be used for compositing from the user image and the remaining background region and manufacturing the synthesis target layer with a mask layer including an alpha channel; A region adjusting step of adjusting the size and position of the synthesis target region to correspond to the synthesis region of the video; A synthetic layer manufacturing step of arranging one or two of a prop layer and an object layer on the composition target layer and manufacturing a synthetic layer with a mask layer including an alpha channel; And a custom video production step of producing a custom video by combining the composite layer and the video. It provides a method for producing a video synthesized user image comprising a.

User image, compositing, video, alpha channel, mask layer, rendering, dominant layer

Description

How to make a video composed of user images {METHOD FOR PRODUCING MOVING PICTURE OF COMPOSITE USER IMAGE}

The present invention relates to a method for producing a video synthesized with a user image, and more particularly, the user can be a main character of the video directly, thereby increasing learning and entertainment effects, and the user's face-synthesized character moves naturally. The present invention relates to a method for producing a video by synthesizing a user image capable of realizing a video and enhancing the perspective, speed, and completeness of the video in which the user's face is synthesized.

Viewers watching videos such as movies and animations often have a desire to be the same as the characters in the videos, but this is almost impossible in reality.

Accordingly, various chain stores or vending machine services are actively provided to attract users' interests, such as providing pictures in various shapes by using pictures of users. Recently, when a user registers his own photo through the Internet, the registered photo Increasingly, various Internet on-demand services are available, such as the ability to synthesize and output images to specific images.

Particularly, in terms of learning and entertainment, children and children are developing perception and emotion, and sometimes follow and watch educational videos, which can be used to actively contribute to improving perception and emotional development. You can increase your learning and entertainment effects by letting yourself appear as the hero of the genus.

An object of the present invention is to provide a method for producing a video synthesized user image that can increase the learning and entertainment effects because the user can be the main character of the video directly.

Another object of the present invention is to provide a method for producing a video synthesized with a user image that can realize a video moving naturally the character of the user's face synthesized.

Still another object of the present invention is to provide a method for producing a video by synthesizing a user image that can enhance the perspective, speed, and completeness of a video in which a user's face is synthesized.

According to the present invention for achieving the above object, a method for producing a video synthesized with a user image, the image preparation step of preparing a user image; A synthesizing target layer manufacturing step of distinguishing the synthesizing target region to be used for compositing from the user image and the remaining background region and manufacturing the synthesis target layer with a mask layer including an alpha channel; A region adjusting step of adjusting the size and position of the synthesis target region to correspond to the synthesis region of the video; A synthetic layer manufacturing step of arranging one or two of a prop layer and an object layer on the composition target layer and manufacturing a synthetic layer with a mask layer including an alpha channel; And a custom video production step of producing a custom video by combining the composite layer and the video. It provides a method for producing a video synthesized user image comprising a.

The video may be composed of a background video produced by separating a specific layer from the original video and rendering the remaining layers.

The background video may be configured to include a dominant layer that controls the size, position, and movement of one or both of the composition target layer and the prop layer.

The synthesis region may be the head of the character appearing in the background video, the synthesis target region is the head of the user, and the dominant layer may be configured as the body of the character.

The specific layer may be composed of any one or two or more of the composite region layer, the prop layer, and the object layer of the video.

The synthesis layer manufacturing step may be configured such that any one or two of the composition target layer, the prop layer, and the object layer are sequentially arranged and rendered.

According to the method for producing a video synthesized with the user image according to the present invention, the user can directly be the main character of the video, there is an effect that can increase the learning and entertainment effects.

In addition, the present invention has an effect that can implement a moving picture of a character that is synthesized the user's face naturally.

In addition, the present invention has the effect of increasing the perspective and speed and the completeness of the video synthesized the user's face.

Hereinafter, with reference to the drawings will be described in detail. However, these drawings are for illustrative purposes only and the present invention is not limited thereto. In this case, the image that the user wants to synthesize in the video may be various, such as a person, an animal, or an object, but in this case, the head (the face and the shape of the face, the face below) shown in the picture file provided by the user to the character appearing in the video ) Will be described as an example.

1 is a block diagram of a system for providing a video production service synthesized with a user image according to an embodiment of the present invention.

Referring to FIG. 1, a system for providing a video production service by synthesizing user images according to an embodiment of the present invention includes a large number of user terminals 500, a network 600, and a server 700. do.

The user terminal 500 is a personal computer that allows a user to be connected to the server 700 through the network 600 and to transmit a user image (hereinafter, referred to as a photo file) to the server 700. Or a personal mobile communication terminal such as a mobile phone or a PDA.

The network 600 connects and connects the user terminal 500 and the server 700, and connects one or more of wired or wireless Internet network, intranet, telephone network, satellite communication network, or mobile network, or a similar network thereof. In the present specification, a case where a personal computer (user terminal) is connected to a wired Internet network using the World Wide Web (WWW) is used as an example.

The server 700 may provide an interface including a web page for allowing a user connected through the user terminal 500 to order a video production service. The server 700 is a central processing unit (controller, not shown) and server 700 for controlling the database unit 710 and the video production module unit 720, the database unit 710 and the video production module unit 720. ) Is a connection device (not shown) to be connected to the network 600.

The database unit 710 is a component that stores various databases for producing a video, and includes a video DB 711, a character DB 713, a prop DB 715, a background DB 717, and an image DB 719. .

The video DB 712 is a component that stores a video produced or held by a service provider.

The character DB 714 is a component that stores an image of a character appearing in a video, and may be divided and stored into a character's face shape (contour and head shape), upper body or lower body, and a body type such as a torso, or a combination thereof. May be stored as one. In addition, it may be stored divided into the front, side, or rear, and when implemented in 3D the shape of the character is stored as a coordinate value. The character DB 714 may store and provide various types of facial images generated in advance so that the user may select and synthesize the video file when the user does not provide the photo file 100. By providing a shape image for each part such as a mouth, a nose, and an ear, the user may be configured to generate a virtual face image. On the other hand, in the character DB 714, the face type of the character may be divided into several standard types and stored. That is, by preparing and preparing a standard face type such as a basic type, a dry type, a chubby type, and an elongated type in advance, a standard face type corresponding to the face image of the photo file 100 provided by the user may be used.

Prop DB (715) is a variety of accessory images that can be worn or worn by the characters appearing in the video, such as rings, necklaces, ornaments, hats, scarves, neckties, socks, footwear, ribbons, clothing, belts , Components such as watches, gloves, umbrellas, fans, bags, glasses, masks, wigs, etc. are stored.

The background DB 717 is a part in which various background images appearing in the video stored in the video DB 712, for example, images such as trees, cars, sky, roads, the sun, and the like are stored.

The image DB 719 stores the photo file 100 provided by the user to the server 700 using the user terminal 500, and includes information on the photo file 100, namely, a file name, a storage directory, a user ID, The creation date and image properties are stored.

In addition to the various DBs such as this, when a user accesses the server 700 through the user terminal 500 and joins a website built on the server 700, the user details, such as the user's name, ID, password, etc., are stored. Member DB (not shown) may be included.

The video production module unit 720 extracts a region (synthesis target region) 102, for example, a face image, from among the photo files 100 provided by the user, and reflects the extracted face image on the video. As a component to be produced by the image extraction module 722, an image processing module 724, and an image synthesis module 726.

The image extraction module 722 extracts the synthesis target region 102, for example, the user's face from the photo file 100 provided by the user, or stores the data in the character DB 714 of the database unit 710. A virtual face image desired by the user is generated by using the face image or the shape image of each part of the face.

The image processing module 724 adjusts the size and position so as to correspond to the composition position (composition region 202) of the video to be synthesized with the face image extracted by the image extraction module 722, that is, the face portion of the character appearing in the video. Adjust and place various props and background images used in the video.

The image synthesizing module 726 renders the image processed by the image processing module 724 and synthesizes it, and renders it with the video to be synthesized to generate a custom video file.

In addition, the video production module unit 720 includes a payment module (not shown) that allows a user to make a payment through a credit card, cash withdrawal, bank transfer, mobile phone, etc. in order to use a video production service that synthesizes a photo file. Can be.

The server 700 configured as described above may be appropriately integrated or distributed as necessary for each DB or module. That is, it may be distributed like a DB server, a web server, etc., and a plurality of servers having the same content may be connected in parallel as necessary.

2 to 6 is a view showing a preliminary preparation process before providing a video production service synthesized with a user image according to an embodiment of the present invention.

First, as shown in FIG. 2, an original video (OMP) to be the original of the video to be finally produced is produced. In this specification, animation is used among various videos. It is preferable to implement animation using a Flash made by Macromedia. However, when using Flash, the size of data generated during animation production is relatively small, and various effects can be easily realized. . In this case, the server 700 includes a program for processing a flash animation such as a flash player.

The animation may be purchased by already owned animations such as "Cinderella", "Peter Pan", and "Pinocchio", but for convenience, it is recommended to make the animation by digital animation.

Flash animation has the concept of layer and object, and all individual shapes (objects) included in the animation exist in the form of different layers and can be separated, and key frames are used. To implement the movement. Accordingly, the facial image extracted from the photo file 100 may be naturally synthesized with the face of the character appearing in the animation. That is, since it is completed by substituting the face image, all the effects and animation effects applied in the existing flash are applied as they are, and there is no need to perform a new operation every time the character moves, which does not put much load on the server 700.

When the original animation (OMP) is produced, a suitable background sound source is produced and converted into the form of a digital file. The background sound source may be produced before the original animation (OMP).

Next, as shown in FIG. 3, the background animation 200 is produced except for a specific layer in the original animation (OMP). In other words, the face layer (composite area layer) in which the character's face image (composite area) appears in the original animation (OMP), the layer in which the prop image such as glasses appears, and the layer in which the background image such as tree appears Render all the remaining layers except the background animation 200, that is, create an animation for compositing. Hereinafter, the character face layer 202 is used as the layer on which the face image of the character appears, the prop layer 220 is used as the layer on which the prop image appears, and the object layer 230 is used to display layers such as various objects or backgrounds other than the props. It is called).

4 shows a dominant layer 210. The dominant layer 210 is a layer that most determines the size, position, and movement of the character's face layer 202 in the animation. In other words, the face image of the character is dominant. Subordinate to the image appearing in the layer 210 is changed according to the size change, position change, or movement of the image appearing in the dominant layer 210. In this case, the layer in which the body image of the character appears (hereinafter referred to as a trunk layer) is used as the dominant layer 210. First, as shown in (a) of FIG. 4, the trunk layer 210 is changed from the original animation (OMP). After separation, the color information is excluded and transformed into a layer having only size and position information as shown in FIG. Accordingly, the file size of the torso layer 210 is reduced, which enables fast rendering. The torso layer 210 may be a layer in which a garment image is synthesized in a torso image of a character, or may be a layer expressing a torso image using only a garment image without a torso image.

5 and 6 are separated from the prop layer 220 to be synthesized on the character face layer 202 and the object layer 230 to be synthesized in the background of the specific layer excluded from the original animation, accordingly the photo file 100 The face image extracted from it is ready for compositing.

7 to 9 are diagrams schematically showing a state in which a character of an original video is reproduced in a customized video.

First, the layer 102 in which the face image of the user appears in the character face layer 202 of the original animation (OMP) shown in FIG. 7A as shown in FIG. 7B (hereinafter, referred to as a user face layer). ) Is placed. The character and user face layers 102 and 202 are subordinate to the body layer 210. Accordingly, when the size of the body layer 210 changes or moves as shown in FIGS. 8A and 8B, the dependent face layers 102 and 202 also change according to the size and movement of the body layer 210. will be. The same applies to the prop layer 220 when the prop is worn on the face of the character, that is, when the prop layer 220 is disposed on the character face layer 202.

As described above, the face layers 102 and 202 are subordinate to the body layer 210. The facial layers 102 and 202 are dependent on the body layer 210, depending on the user's facial features, animation scenarios, and the user's request. By adding a motion or the like to the original animation OMP, the character face layer 202 of the original animation OMP and the user face layer 102 of the custom animation 300 may be configured to move differently.

Hereinafter will be described in detail with reference to the accompanying drawings a method of producing a video synthesized user image according to the present invention.

10 to 16 are views illustrating a manufacturing process of a method for producing a video synthesized with a user image according to an embodiment of the present invention, Figure 17 is a production of a video synthesized with a user image according to an embodiment of the present invention A flowchart showing the procedure.

First, a user accesses a website built on a server 700 through a user terminal 500 and orders a video production. In this case, when various animations are provided in the server 700, the user may select a desired video through the user terminal 500.

The user uploads the photo file 100 showing the face image desired to be synthesized to the video through the user terminal 500 to the server 700 or by using an e-mail or the like. In this case, the user may make a payment for the corresponding video production after the video production order and the photo file are transmitted, and receive a personalized video produced during the payment process, and input personal information such as an address.

The server 700 also stores the transmitted picture file 100, the title of the video designated by the user, the user information, and the like in the image DB 719 (S10).

Then, the image extraction module 722 of the video production module 720 extracts a face image (synthesis target area) 102 to be used for synthesis with the video from the photo file 100. This extraction process distinguishes the face image 102 from the photo file as shown in FIG. 11 (a) and the background region 104 except for the face image 102, as shown in FIG. 11 (b). By using the mask layer including the alpha channel, the background region 104 is designated as a transparent empty space, and thus, the synthesis target layer 110 is manufactured (S20).

Then, as shown in FIG. 12, the size and position of the composition target region (user's face image 102) appearing on the composition target layer 110 are adjusted to correspond to the composition region (character face image 202) of the video. . It is preferable to use a standard face shape suitable for the extracted face image 102 from the character DB 713 and use the face image 102 of the composition target layer 110 on the character face layer 202. After adjusting the position of the eyes, nose, mouth, etc. to the top, bottom, left and right of the standard face-type image, the accessory layer 220 on the face image 102 of the composition target layer 110 whose size and position are adjusted as shown in FIG. 13. That is, the glasses image is arranged (S30). At this time, the size and position of the props may be adjusted according to the characteristics of the user's face to make them more comic or stylish.

Next, as shown in (a) of FIG. 14, the object layer 230 including an image such as a tree, a background, etc. is displayed on the composition layer 110 and the prop layer 220, and then a mask including an alpha channel is disposed. Rendering in a layer to produce a composite layer 240 as shown in Figure 14 (b) (S40). At this time, only the face image, prop image, and background image are rendered, so that the rendering can be performed quickly. Since the user face layer 102 and the prop layer 220 are subordinate to the body layer 210, the same animation as that of the original animation (OMP) can be reproduced, and if necessary, the user face layer 102 or the prop layer 220 can be reproduced. ) Can be adjusted to show a movement more suited to the user's facial features. On the other hand, in order to increase the sense of perspective, speed and completeness of the custom animation 300, it is preferable to sequentially arrange and synthesize in order of the prop layer 220, and the object layer 230 on the synthesis target layer (110).

As shown in FIG. 15, the synthetic layer 240 made as described above may have all the layers except the background animation 200 prepared in advance, that is, the character face layer 202, the prop layer 220, and the object layer 230. The customized animation 300 is produced on the rendered background animation 200 (S50). In this case, the custom animation 300 may be produced in various video formats, for example, MPEG or MOV (QuickTime Movie), RealVideo, Avi, etc., and combines the custom animation 300 with the background sound source. The animation 400 to be delivered to the user is produced. The animation 400 produced as described above may be transmitted to the user as digital data through the Internet, or stored in an image storage medium such as a CD or a DVD and delivered to the user by mail or courier.

Accordingly, the user who has been provided with the custom animation can enjoy his / her animation 400 by synthesizing his face into the actual animation as shown in FIGS. 16A and 16B.

On the other hand, in the present specification, the user described a video production service online, that is, ordered through the network 600, but also offline, that is, the user directly delivers a CD or DVD, such as a picture file 100 is stored by mail or the like You can make a video file by using a scanner, etc. to make a video, or you can come in and take a photo and produce it.

As such, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without changing the technical spirit or essential features thereof.

Therefore, the exemplary embodiments described above are to be understood as illustrative and not restrictive in all respects, and the scope of the present invention is indicated by the following claims rather than the detailed description, and the meaning and scope of the claims and All changes or modifications derived from the equivalent concept should be interpreted as being included in the scope of the present invention.

1 is a block diagram of a system for providing a video production service synthesized with a user image according to an embodiment of the present invention.

2 to 6 is a view showing a preliminary preparation process before providing a video production service synthesized with a user image according to an embodiment of the present invention.

7 to 9 are diagrams schematically showing a state in which a character of an original video is reproduced in a customized video.

10 to 16 are diagrams illustrating a manufacturing process of a method for producing a video synthesized with a user image according to an embodiment of the present invention.

FIG. 17 is a flowchart illustrating a procedure of a method of manufacturing a moving picture synthesized with a user image, according to an exemplary embodiment. Referring to FIG.

Explanation of symbols on the main parts of the drawings

100: user image 102: composition target area, user face layer

104: background area 110: composition target layer

200: background video 202: composition region, character face layer

210: dominant layer 220: prop layer

230: object layer 240: synthetic layer

300: Custom video 400: Video playing

500: user terminal 600: network

700: server 710: database portion

711: Video DB 713: Character DB

715: Prop DB 717: Background DB

719: Image DB 720: video production module

722: image extraction module 724: image processing module

726: image synthesis module OMP: original video

Claims (7)

In the method of producing a video synthesized user image, An image preparation step of preparing a user image; A synthesizing target layer manufacturing step of distinguishing the synthesizing target region to be used for the synthesis from the user image and the rest of the background region and manufacturing the synthesis target layer with a mask layer including an alpha channel; A region adjusting step of adjusting the size and position of the synthesis target region to correspond to the synthesis region of the video; A synthetic layer manufacturing step of disposing one or two of a prop layer and an object layer on the object to be synthesized, and manufacturing a synthetic layer as a mask layer including an alpha channel; And A custom video production step of producing a custom video by combining the composite layer and the video; Method of producing a video synthesized user image comprising a. The method of claim 1, The video above, A method of producing a video composited with a user image, characterized in that it is a background video produced by separating a specific layer from the original video and rendering the remaining layers. The method of claim 2, In the background video, And a dominant layer governing the size, position, and movement of any one or both of the synthesis target layer and the prop layer. The method of claim 3, wherein The synthesis region is the head of the character appearing in the background video, The synthesis target area is the head of the user, The dominant layer is a body of the character, characterized in that the production method of the video synthesized user image. The method according to any one of claims 2 to 4, The specific layer, The method of claim 1, wherein at least one of the composite region layer, the prop layer, and the object layer of the video is synthesized. The method according to any one of claims 1 to 4, The synthetic layer production step, One or two of the composition target layer, the prop layer, and the object layer are sequentially arranged and rendered, wherein the moving image is synthesized. The method of claim 5, The synthetic layer production step, One or two of the composition target layer, the prop layer, and the object layer are sequentially arranged and rendered, wherein the moving image is synthesized.

Images