KR101843025B1 - System and Method for Video Editing Based on Camera Movement - Google Patents

Abstract

The present invention relates to a video synthesis system and a video synthesis method based on camera work. According to the present invention, the video synthesis system based on camera work comprises: a storing module which relates and stores a plurality of automatically-recorded video content, including a dynamic video clip as a section recorded by an automatically controlled camera controlled by at least one camera control parameter among pan control, tilt control, and moving control, with the camera control parameter; a content providing module which provides one type of source among the automatically-recorded video content to a user terminal through a communications network; a searching module which receives an object synthesis request for a source video clip of the source automatically-recorded video content from the user terminal, obtains the camera control parameter of the source dynamic video clip as a reference control parameter, and searches for a synthesis target dynamic video clip of synthesis target automatically-recorded video content having a matching control parameter which is the same as or similar to the reference control parameter; and a synthesizing module which generates a synthesized video clip that includes at least a source object video of the source dynamic video clip and a synthesis target object video of the synthesis target dynamic video clip. The content providing module provides the synthesized clip to the user terminal.

Description

[0001] The present invention relates to a camera-based video synthesis system and a video synthesis method,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a camera work-based image synthesis system and an image synthesis method, and more particularly, to an image synthesis system and an image synthesis method for automatically synthesizing dynamic video clips of video contents having similar camera work through a data- .

As image processing technology develops, various image synthesis technologies become common. Among the image composition methods, object composition is to synthesize objects of different video contents to original video contents, and it is possible to illustrate a composite image obtained by synthesizing an object image of a weather caster in which a background image is separated, such as weather forecast news, have. In this case, the CG background image is combined with the object image captured by the real-world camera. At this time, the weather caster object image is separated from the original background image by the chroma key technique and synthesized to the CG background image. In this example, the background image and the object image are synthesized, so that it is not required to have a high degree of difficulty. Therefore, not only Professionally Generated Contents (PGC) such as a professional TV program and a movie but also UGC (User Generated Contents) Has been introduced.

Next, an example of synthesizing characters of different images will be described. A method of composing objects of video contents in which different characters appear is performed by combining a first person object image of a first video content and a second person object image of a second video content with a first video content, The two-person object image is synthesized to the new background image, so that no other technique is required compared with the case of the background synthesis described above. However, if the first video content and the second video content are respectively photographed by the cameras fixed at the same angle of view as the whole body shots, the first person object image and the second person object image are naturally synthesized in the composite video content. However, it is assumed that the first video content is photographed while the camera moves on the dynamic camera work, for example, the first person, and the second video content is photographed by the fixed camera. In this case, if the first person video content and the second person video content are combined into one composite video content, there is a problem that an unnatural composite image is generated because they are photographed by different camera works.

Particularly, content consumers prefer dynamic video content shot by dynamic camera work, so synthesizing different characters at a static angle of view can not satisfy the higher standards of content consumers. As a method of generating a composite image of a dynamic camera work, a method of photographing using a synchronized camera or rendering a 3D object has been proposed. However, this method is not suitable for a special shooting technique based on a shooting plan It is limited to only movies and TV programs that use a lot of production cost because of demanding editing technology, and there is a limitation that it can not be used for image synthesis of a large number of independent UGCs that are not photographed on the assumption of a synthetic image.

Meanwhile, various UGCs are being produced and circulated through video content services such as YouTube. Some UGC creators are getting high advertising revenue through high quality UGC, and various industries are taking advantage of the power of high quality UGC. However, UGC's production has soared, and UGC's lifecycle, which attracts attention from content consumers, is shortening. Therefore, the UGC creator has the problem of having to upload more UGCs more frequently. One way to deal with this problem is to increase the value and authenticity of existing UGCs by renewing and editing existing UGCs. However, due to the nature of UGCs produced in various production environments, UGC reproduction is insufficient to satisfy the higher standards of content consumers, as it is merely a matter of temporally combining or parallelly displaying specific video clips of multiple UGCs.

In order to generate a composite image having a dynamic camera work, it is necessary to find video clips of video contents having similar camera works among a large number of video contents. Therefore, .

 Japanese Patent Registration No. 4140006 of FUJINON CORP, entitled " Photographing System for Composite Image Generation " is a system in which a photographing camera of a background image and a photographing camera of an object image are synchronously controlled to generate a composite image System. According to such a photographing system, it is possible to generate a high-quality composite image using a dynamic camera work through synchronization control. However, such a shooting system captures a background image and an object image according to a shooting plan based on a synthetic image, and there is a problem that it can not be applied to the generation of a dynamic synthetic image between UGCs that does not require image synthesis. In addition, since two sets of automatic control cameras are required for background shooting and portrait shooting, the costs for synthesized image generation are increased, which is suitable for producing a high-cost broadcast program but is not suitable for low-cost UGC composite video production have.

US Patent No. 7,843,510, entitled " Method and System for Combining Video Sequences with Spatio-temproal Alignment ", by Ecole Polytechnique Federale de Lausanne, A video synthesis system for displaying on a screen is disclosed. According to this image synthesis system, a composite image obtained by combining an object image of a player who competed in the first match and an object image of a player who is currently playing in the record match broadcasting can be provided, so that viewers can easily visually check the record difference between the two players. , It is possible to synthesize each object image tracked by the camera into a single composite image with no sense of discomfort. However, this synthetic video system is limited to the synthesis of analogous video with only a time difference according to the record of the athlete because it has repetitive and regular camera angles due to the characteristics of the recording game. There is a problem that it can not be applied to reproduction through content synthesis such as UGC having a camera angle.

According to Japanese Patent Laid-Open Publication No. 1994-028449, " Picture Synthesizer " of PANASONIC Corp., CG graphics linked to the direction and position of an actual camera are generated to synthesize a real image and a CG image, A synthesizing apparatus is disclosed. According to this image synthesizing apparatus, it is possible to obtain a synthesized image composed of a real image and a CG image, which do not cause any discomfort even in a dynamic camera work. However, such a video synthesizer can not be used to generate synthesized video composed of live video and live video. In order to generate adaptive CG graphics according to the camera direction, 3D modeling, which requires a lot of cost and expertise, There is a problem that the manufacturing cost is increased.

According to Japanese Patent Registration No. 5706718 of " Moving Picture Composing System, Method, Moving Picture Composing Program and Storage Medium ", KDDI Corp. discloses an image combining system for synthesizing moving images of the same music in a tile form. Since such a video synthesis system automatically searches for a plurality of videos sharing the same feature (voices for the same music) among a large number of videos and automatically synthesizes them into a single composite video, cost and time required for video synthesis are shortened Effect. However, according to such a system, since a composite video is merely a combination of small moving images arranged in a tile format, there is a problem that a composite image in which a high quality object image is synthesized naturally does not meet the high standard of a content consumer.

JP 4140006 B2 US 7843510 B1 JP 1994-028449 A JP 5706718 B2

The camera-work-based image synthesis system and image synthesis method according to the present invention automatically search other synthetic target dynamic video clips having a dynamic camera work similar to the source dynamic video clip of the source automatic shot video contents through the similarity of camera control parameters A synthesized video clip obtained by synthesizing a source object image and a synthesized object object image is automatically generated so that a high quality synthetic video clip having a dynamic camera work can be generated without discomfort, It is possible to eliminate time and effort required for searching for video contents having a camera work and to reproduce new synthesized video contents by adding a new performer to the disclosed video contents as a method of object composition, Ongoing interest in And to extend the vitality of video content produced by the company.

The camera work-based image synthesis system and the image synthesis method according to the embodiment of the present invention can be applied to an image synthesis system and an image synthesis method in which a plurality of synthesis target contents each including synthesis target dynamic video clips belonging to a category of dynamic camera work similar to a source dynamic video clip, It is another object of the present invention to generate a composite image of a dynamic camera work in which a plurality of performers appear by synthesizing video contents each appearing by a single cast, for example, by extracting an object and generating it as a single composite image.

The camera work-based image synthesis system and image synthesis method according to an embodiment of the present invention extracts a plurality of dynamic camera work photographing sections as source dynamic video clips according to a user's synthesis request for source automatic photographed video contents, Object video contents including all of the compositing target dynamic video clips in a similar range to the camera work of the source automatic photographed video contents, and synthesizing the video contents for each section, The purpose.

The camera work based image synthesis system and image synthesis method according to the embodiment of the present invention may be configured such that a new background image selected by the user is input and a source object image and a synthesized object image are synthesized to generate a synthesized video clip And to reproduce synthesized video having a large change width, thereby continuously supplying video contents that the content consumer does not feel.

The camera work-based image synthesis system and the image synthesis method according to the embodiment of the present invention can be realized by projecting a planar background image on a background projection plane having a three-dimensional shape having a curvature and synthesizing a source object image and a synthesis object object image, And to generate a high-quality composite image in which the background image has object images and an appropriate perspective, and changes according to the background image.

The camera work based image synthesis system and image synthesis method according to the embodiment of the present invention preferentially searches and synthesizes the automatic shot video contents appearing with other performers having a social relationship with the performer of the source automatic shot video contents Another purpose is to automatically create customized composite video content.

In order to solve the above problems, a camera-work based image synthesis system according to the present invention is a camera-based image synthesizing system for dynamic video, which is a section photographed by an automatic control camera controlled by at least one of camera control parameters such as fan control, tilt control, A storage module for storing a plurality of automatic shooting video contents including a clip in association with the camera control parameter; A content providing module for providing any one of the plurality of automatic shooting video contents to a user terminal through a communication network; Receiving from the user terminal an object composition request for a source dynamic video clip of the source automatic shooting video content, obtaining the camera control parameter of the source dynamic video clip as a reference control parameter, A retrieval module for retrieving the compositing target dynamic video clips of the compositing target automatic photographing video contents having the matching control parameter which is the camera control parameter; And a synthesis module for generating a synthesized video clip such that at least a source object image of the source dynamic video clip and a synthesis object video image of the synthesis target dynamic video clip are included, And provides a clip to the user terminal.

In the camera work based image synthesis system according to the embodiment of the present invention, the search module further searches synthetic target dynamic video clips in each of a plurality of the automatic photographing video contents having the matching control parameter, The composite video clip is generated such that the source object image of the source dynamic video clip and the composite object images of the plurality of synthesis target dynamic video clips are included.

In the camera work-based image synthesis system according to an embodiment of the present invention, the search module receives an object composition request for the source automatic photographed video contents from the user terminal, (N is an integer of 2 or more) source dynamic video clips, and acquires the n-th interval reference control parameter of the source dynamic video clip from the first reference reference parameter to the n < th > reference reference control parameter The first module searches for the first section synthesis target dynamic video clip to the nth section synthesis target dynamic video clip of the synthesis object automatic photographing video contents having the section matching control parameter to the nth section matching control parameter, Source image of the source dynamic video clip and the phase An n-th section source object image of the first interval synthetic video clip or the n-th section interval source dynamic video clip including the first interval composition object image of the first interval composition dynamic video clip, And an n-th section composite video clip including an n-th section composition object image of the clip, wherein the content providing module generates the composite video content including the first-section composite video clip to the n-th section- To the user terminal.

In the camera work based image synthesis system according to the embodiment of the present invention, the synthesis module may generate the synthesized video clip by synthesizing the source object image and the synthesis object image with the background image of the dynamic video clip .

The camera work based image synthesis system according to an embodiment of the present invention further comprises a background image input module for receiving a user selected background image from the user terminal, The source object image, and the composite object image to generate the composite video clip.

In the camera work-based image synthesis system according to an embodiment of the present invention, the synthesis module forms a background projection plane having a predetermined height and formed with a curved surface with a concave central portion in a virtual space, A background image projecting unit for projecting at least a part of the user selected background image on the background projection plane, arranging the source object image and the composite object image between the virtual projection point on the virtual space and the background projection plane, And generating at least a part of the user selected background image, at least a part of the source object image, and at least a part of the composite object image at an angle of view of the camera.

In the camera work-based image synthesis system according to the embodiment of the present invention, the search module preferentially searches the automatic photographed video contents appearing with other performers having a social relationship on-line with the performers of the source automatic photographed video contents .

The camera-work-based image synthesis method according to the present invention includes a dynamic video clip, which is a section taken by an automatic control camera controlled by at least one of camera control parameters such as fan control, tilt control or moving control Storing a plurality of automatic photographed video contents in association with the camera control parameter; Providing the image synthesis system to a user terminal through a communication network, the source automatic photographed video content of any one of the plurality of automatic photographed video contents; Receiving from the user terminal an object composition request for a source dynamic video clip of the source automatic photographed video content; The video synthesis system obtaining the camera control parameter of the source dynamic video clip as a reference control parameter; The video synthesis system retrieving a synthesis target dynamic video clip of synthesis target automatic shooting video content having a matching control parameter that is the same or similar to the reference control parameter; Generating a composite video clip such that the image synthesis system includes at least a source object image of the source dynamic video clip and a composite object image of the composite dynamic video clip; And providing the composite video clip to the user terminal by the video synthesis system.

In the camera work-based image synthesis method according to an embodiment of the present invention, the step of searching for the synthesis target dynamic video clip may include a step of synthesizing a plurality of the automatic photographing video contents having the matching control parameter, Wherein the step of further retrieving the target dynamic video clips and generating the composite video clip further comprises the steps of: when the image synthesis system generates the source object image of the source dynamic video clip and the composite object images of the plurality of composite dynamic- And a synthesized video clip is generated so as to be included.

In the camera-based image synthesis method according to an embodiment of the present invention, the step of receiving the object synthesis request may include receiving an object synthesis request for the source automatic photographed video content from the user terminal, Wherein the step of acquiring the reference control parameter comprises the steps of: when the video synthesis system performs a first interval reference control parameter of the first interval source dynamic video clip to the nth interval reference control of the nth interval (n is an integer of 2 or more) Wherein the step of acquiring the parameter and retrieving the synthesis target dynamic video clip comprises the steps of: obtaining a first interval adaptation control parameter corresponding to the first interval reference control parameter to an nth interval reference control parameter, Composite Subject Shooting with Matching Control Parameters Wherein the step of retrieving the dynamic video clips to be synthesized for the first section of the content and the dynamic video clips for the nth section of the video content and generating the synthesized video clip includes the steps of An n-th section source object image of the first-section composite video clip or the n-th section-source dynamic video clip including the first-interval composition object object image of the first- wherein the step of generating the composite video clip includes generating an n-th section composite video clip including the n-th section composite object image of the n-th section composite dynamic video clip, and providing the composite video clip, Lt; RTI ID = 0.0 > n-th < / RTI > And to give.

In the method of synthesizing a camera work based on an embodiment of the present invention, the step of generating the synthesized video clip may include a step of, when the image synthesis system synthesizes the source object image and the synthesis target object image in the background image of the source dynamic video clip, And generates the synthesized video clip.

The camera-based image synthesis method according to an exemplary embodiment of the present invention may further include receiving the user-selected background image from the user terminal, wherein the step of generating the synthesized video clip comprises: And the video synthesis system generates the composite video clip by combining the source object image and the composite object object image with the user selected background image.

In the camera work-based image synthesis method according to an embodiment of the present invention, the step of generating the synthesized video clip may include forming a background projection plane having a predetermined height and a central concave curved surface in a virtual space A first sub-step; A second sub-step of the image synthesizing system to project at least a part of the user selected background image on the background projection plane at a virtual projection point on the virtual space; A third sub-step of arranging the source object image and the composite object image between the virtual projection point on the virtual space and the background projection plane; And the image synthesis system includes at least a part of the user-selected background image, at least a part of the source object image, and at least a part of the composite object image at an angle of view of a virtual camera disposed in the virtual space, And a fourth sub-step of generating the second sub-step.

In the camera-work-based image synthesis method according to an embodiment of the present invention, the step of searching for the synthesis target dynamic video clip may include the step of: The automatic photographed video contents are preferentially searched.

The camera-work-based image synthesis system and image synthesis method according to the present invention automatically search other synthetic target dynamic video clips having a dynamic camera work similar to the source dynamic video clip of the source automatic shot video contents through the similarity of camera control parameters A synthesized video clip obtained by synthesizing a source object image and a synthesized object object image is automatically generated so that a high quality synthetic video clip having a dynamic camera work can be generated without discomfort, It is possible to eliminate time and effort required for searching for video contents having a camera work and to reproduce new synthesized video contents by adding a new performer to the disclosed video contents as a method of object composition, Ongoing interest in Thereby providing an effect of extending the life of the video content produced by the user.

The camera work-based image synthesis system and the image synthesis method according to the embodiment of the present invention can be applied to an image synthesis system and an image synthesis method in which a plurality of synthesis target contents each including synthesis target dynamic video clips belonging to a category of dynamic camera work similar to a source dynamic video clip, The present invention provides an effect of generating a composite image of a dynamic camera work in which a plurality of cast members appear by synthesizing video contents each appearing by a single cast, for example, by extracting an object and generating a single composite image.

The camera work-based image synthesis system and image synthesis method according to an embodiment of the present invention extracts a plurality of dynamic camera work photographing sections as source dynamic video clips according to a user's synthesis request for source automatic photographed video contents, The synthesizing target video contents including all of the compositing target dynamic video clips in a similar range to the camera work of the source automatic photographed video contents are automatically searched and synthesized for each section, to provide.

The camera work based image synthesis system and image synthesis method according to the embodiment of the present invention may be configured such that a new background image selected by the user is input and a source object image and a synthesized object image are synthesized to generate a synthesized video clip Thereby providing a reproduced composite image having a large variation width and continuously supplying video contents not consumed by the content consumer.

The camera work-based image synthesis system and the image synthesis method according to the embodiment of the present invention can be realized by projecting a planar background image on a background projection plane having a three-dimensional shape having a curvature and synthesizing a source object image and a synthesis object object image, The background image provides an effect of generating a high-quality synthetic image which changes with object images and an appropriate perspective.

The camera work based image synthesis system and image synthesis method according to the embodiment of the present invention preferentially searches and synthesizes the automatic shot video contents appearing with other performers having a social relationship with the performer of the source automatic shot video contents And provides the effect of automatically producing customized composite video contents.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing a video synthesis system according to the present invention; FIG.
2 is a configuration diagram showing an automatic control camera according to an embodiment of the present invention;
3 is a data structure diagram of a camera control parameter according to an embodiment of the present invention;
FIG. 4 is a structure of a video clip of automatic photographed video contents according to an embodiment of the present invention; FIG.
FIG. 5 illustrates an example of an object composition request input interface in a user terminal according to an embodiment of the present invention; FIG.
6 is a configuration diagram illustrating image synthesis according to an embodiment of the present invention;
7 is a flow chart showing a method of image synthesis according to the present invention;

It is to be understood that the terms and words used herein are not to be construed in a conventional or dictionary sense and that the inventors may define terms and concepts in order to best explain their invention in the best mode, It should be interpreted in terms of meaning and concept consistent with technical thought.

Therefore, the embodiments described in the present specification and the configurations shown in the drawings correspond to the preferred embodiments of the present invention and do not represent all the technical ideas of the present invention, so that the configurations can be replaced at the time of filing of the present invention Various equivalents and variations may be present.

The specification that " comprises " any element in any specification throughout the specification does not exclude other elements, but may also include other elements, unless the context clearly indicates otherwise. The terms " module, " " part, " " system, " and the like, which are described in the specification, mean a unit for processing at least one function or operation, And may be included in one device or in another device.

Hereinafter, a camera-based image synthesis system 100 and an image synthesis method according to the present invention will be described with reference to the drawings. The camera work based image synthesis system 100 according to the present invention includes a storage module 110, a content providing module 120, a search module 130, and a synthesis module 140 as shown in FIG. 1 .

 The storage module 110 stores a plurality of automatic photographed video contents including a dynamic video clip, which is a section photographed by an automatic control camera 301 controlled by at least one of camera control parameters such as fan control, tilt control, In association with the camera control parameters.

The storage module 110 may be a conventional storage device for storing data, and may be an optical storage device, a magnetic storage device, a semiconductor storage device, or the like. The storage module 110 may be a storage device installed inside the image synthesizing system 100 or a storage device connected via a network.

The camera control parameter means a control command for changing the orientation of the camera by changing the position of the automatic control camera 301 to be controlled by a mechanical method or by a mechanical method. For example, as shown in FIG. 2, the automatic control camera 301 moves in the horizontal direction or the vertical direction along the rails in accordance with the camera movement control in the specific time period of the camera control parameter. The automatic control camera 301 rotates in the left and right direction according to the panning control in the specific time period of the camera control parameter to change the camera directing angle. The automatic control camera 301 rotates in the vertical direction according to the tilt control in the specific time interval of the camera control parameter to change the camera directing angle. It is possible to adjust the zoom of the automatic control camera 301 through the zoom control as well as the camera control parameters. However, since the change of the zoom is to change the size of the object image without changing the orientation point of the automatic control camera 301, the change of the zoom of the automatic control camera 301 that takes the source object image 431 Accordingly, since the synthesized image can be easily generated by reducing the size of the synthesized object image 432, the dynamic video clip of the present invention does not include the video clip applied only with the zoom control.

The dynamic video clip includes a pan-controlled automatic control camera 301, a tilt-controlled automatic control camera 301, a moving-controlled automatic control camera 301, or an automatic control camera 301 ) Of the automatic photographing video contents photographed by the automatic control camera 301 controlled by a combination of pan, tilt, and moving. As shown in FIG. 4, there are portions photographed and controlled from 0 minute to 1 minute among the 7 minutes-long automatic photographed video contents, there are portions photographed by controlling the pan from 3 minutes to 4 minutes, and 6 minutes to 7 minutes Minute, and the portion photographed by the fixed automatic control camera 301 is present for one minute to three minutes and four minutes to six minutes for the remaining sections, ≪ / RTI > of dynamic video clips.

Since the part other than the dynamic video clip is a static video clip, it does not involve a change of the camera work over time, so that a composite image can be easily produced by a conventional image synthesis method.

On the other hand, the automatic photographed video contents in the present invention means video contents photographed by the automatic control camera 301 in which the photographing position or photographing angle is controlled by a control command. For example, the video photographed by the camera The contents do not correspond to the automatic photographed video contents of the present invention.

Figure 2 illustrates a camera automatic control system. Utility Model Application No. 2016-0004490 "Stage-Coupled Studio Control System" filed by the applicant of the present patent application discloses an embodiment of such a camera automatic control system. The automatic control camera 301 of the present invention is not limited to the embodiment of FIG. 2, but may be a camera system mounted on a robot arm, a camera system mounted on a ground moving device, or a camera system mounted on a public dron have.

The automatic control camera 301 uses camera control parameters, which are numerical data for camera control for each time slot. Fig. 3 shows an example of the configuration of such camera control parameters. The camera control parameter includes at least the time stamp and the position information of the camera or the orientation information of the camera at the corresponding time stamp. The image synthesizing system 100 judges whether a specific section of the automatic photographed video content corresponds to a dynamic video clip or a static video clip through a camera control parameter. For example, when the position information of the camera or the orientation information of the camera is changed by comparing with the preceding time stamp in the specific time stamp, the time stamp may be determined to be included in the dynamic video clip. Alternatively, if the positional information of the camera or the rate of change of the orientation information of the camera is equal to or greater than the set value during a specific time interval, the corresponding time interval may be determined to be included in the dynamic video clip. This is because when the position information of the camera continuously changes in a specific time interval and the camera is stopped for a short time, for example, about 1 second, when the position information of the camera is changed again, two dynamic video clips This is because it is more efficient in the image synthesis processing to ignore the stopping point of the camera for a moment than to discriminate and judge it as one dynamic video clip.

The storage module 110 stores a plurality of automatic shooting video contents, and for example, a plurality of users access a web server to upload automatic shooting video contents that they have appeared or produced. At this time, the camera control parameters used for shooting the corresponding automatic photographed video contents are stored in association with the automatic photographed video contents. For example, the corresponding camera control parameter may be retrieved through the identification information of the automatic photographing video content, or the computer file of the automatic photographing video content may include the camera control parameter. At this time, the automatic photographed video contents do not necessarily have to be photographed through the same automatic photographed camera system. It is easy to determine the similarity between the automatic photographed video contents photographed through the same automatic photographed camera system because the camera control parameters have the same shape. The automatic photographed video contents photographed through different automatic photographed camera systems can use different types of camera control parameters. In this case, the image synthesizing system 100 may change and store different types of camera control parameters in a standardized form.

The content providing module 120 provides the source automatic photographed video contents (contents_source) of the plurality of automatic photographed video contents to the user terminal 200 through the communication network. The content providing module 120 exemplifies a web service server that provides video content desired by a user by means of content search or content recommendation such as a conventional video sharing web server such as YouTube or Vimeo . The source automatic photographed video contents (contents_source) refers to the automatic photographed video contents to be provided to the user among the plurality of automatic photographed video contents stored in the storage module 110 and used for producing the composite video contents (contents_composite).

The search module 130 receives an object compositing request for the source dynamic video clip clip_dynamic_source of the source automatic photographed video content contents_source from the user terminal 200 and stores the camera control parameter of the source dynamic video clip clip_dynamic_source as a reference And obtains the synthesis target dynamic video clip clip_dynamic_add of the synthesis object automatic photographing video contents (contents_add) having the matching control parameter (parameter_match) which is the same or similar as the reference control parameter (parameter_ref) as the camera control parameter And performs a search function.

The user terminal 200 may search the search module 130 by clicking on the object composition request icon 201 while playing the source automatic photographed video contents contents_source on the web browser or the video viewer application, Lt; RTI ID = 0.0 > object < / RTI > The object compositing request may be a composing request for the source dynamic video clip (clip_dynamic_source) or, in some embodiments, a compositing request for the source automatically photographed video contents (contents_source).

The search module 130 may include an automatic shooting video module 130 that includes a dynamic video clip having camera control parameters of the same or similar category as the reference control parameter (parameter_ref) among a plurality of automatic shooting video contents excluding the source automatic shooting video contents (contents_source) Search for content. At this time, dynamic video clips of a plurality of automatic shooting video contents may be searched, and a plurality of dynamic video clips may be searched in one automatic shooting video content. The search module 130 may select one or more synthesis target dynamic video clips clip_dynamic_add among a plurality of dynamic video clips searched according to user setting or system setting. A method for selecting a final composite video clip (clip_dynamic_add) may be variously implemented. According to an embodiment, a recommendation list of a plurality of dynamic video clips or a plurality of automatic shooting video contents may be provided to the user terminal 200, and a selection target dynamic video clip clip_dynamic_add may be selected by the user. According to another embodiment, the attributes of the compositing target dynamic video clip (clip_dynamic_add) such as the genre of the video content, the background music of the video content, the shooting point or the uploading point of the video content, The search module 130 may preferentially search the compositing target dynamic video clip clip_dynamic_add considering attributes of the uploading user or performer of the video clip such as online social relationship between the participant and the participant.

According to an embodiment considering the content genre, the storage module 110 further stores the content genre information in association with the automatic photographed video content, and further stores the genre information in the automatic photographed video content having the same content genre information as the source automatic photographed video content (contents_source) It is possible to provide an effect of automatically synthesizing video contents sharing the same genre attribute without directly viewing and confirming the attributes of the automatically photographed video contents by preferentially searching the dynamic video clips with the synthesis target dynamic video clip (clip_dynamic_add).

According to an embodiment considering background music, the storage module 110 further stores the background music information in association with the automatic photographed video content, and stores the automatically photographed video content having the same background music information as the source automatic photographed video content (contents_source) A composite video clip clip_dynamic_composite for composing video contents naturally composing and performing karaoke or instrument performance by using the same music as a background music is searched for by priority searching the dynamic video clip with a compositing target dynamic video clip clip_dynamic_add It is possible to provide an effect to generate.

According to the embodiment in which the uploading time is considered, the storage module 110 further stores the uploading time information in association with the automatic shooting video content, and has uploading time information close to the uploading time of the source automatic shooting video contents (contents_source) Or the dynamic video clip of the automatically photographed video content having the latest uploading time information is first searched with the compositing target dynamic video clip clip_dynamic_add to provide the effect of synthesizing the uploaded video contents at the same time or synthesizing the latest video contents can do.

According to embodiments in which online social relationships are considered, the storage module 110 further searches for social relationships on-line between uploading users or video performers, and uploads the uploaded users or video performers of the source automatically photographed video contents (contents_source) It is possible to provide an effect of generating a synthetic video clip (clip_dynamic_composite) based on a user relationship by first searching a dynamic video clip of an automatically captured video content of an upload user or a video performer having a social relationship as a synthesis target dynamic video clip (clip_dynamic_add) . At this time, the social relation on-line may be, for example, social relation information established through affiliation or fan-out between users on a web service server providing the automatic photographed video contents of the present invention, a facebook, an Instagram ) And the like, and social relation information provided from an independent social network service.

The reference control parameter parameter_ref is a camera control parameter of the source dynamic video clip clip_dynamic_source subjected to the synthesis request and the matching control parameter parameter_match is a synthesis target dynamic video clip (clip_dynamic_add). The criterion for selecting a matching control parameter (parameter_match) that is the same as or similar to the reference control parameter of the search module 130 does not require a complete identity and requires the same degree of uncomfortable feeling in the composite image to which the camera work is applied . For example, the search module 130 may select a matching control parameter (parameter_match) in a range of 10% difference of each parameter such as time interval, camera position information, and camera angle information based on time stamp information of a reference control parameter (parameter_ref).

The compositing module 140 generates a composite video clip clip_dynamic_composite so that at least the source object image 431 of the source dynamic video clip clip_dynamic_source and the compositing object image 432 of the compositing target dynamic video clip clip_dynamic_add are included Function. The camera control parameter is composed of a combination of various parameters including time stamp, camera position information, and camera orientation angle information, and the combinations of the different video contents rarely coincide with each other. Therefore, a relaxed identity condition of identity in a certain error range, not an exact match, should be applied. For example, if the time taken for the camera to move 1m to the right is 30 seconds for the source dynamic video clip (clip_dynamic_source) and 33 seconds for the synthesis target dynamic video clip (clip_dynamic_add), the synthesis module 140 It is possible to generate a 30 second synthetic video clip (clip_dynamic_composite) to which a moving camera work is applied. If the time taken for the camera to move 1m to the right is 30 seconds for the source dynamic video clip clip_dynamic_source and the synthesis target dynamic video clip clip_dynamic_add is 27 seconds, then this is within an error range of 10% A composite video clip (clip_dynamic_composite) of 27 seconds to which a camera work is applied or a source dynamic video clip (clip_dynamic_source) is reproduced at a slow speed of 90% to generate a 30 second synthetic video clip (clip_dynamic_composite) .

As another example, if the angle at which the camera is rotated to the right for 10 seconds is 10 degrees for the source dynamic video clip (clip_dynamic_source) and the synthesized target dynamic video clip (clip_dynamic_add) is 11 degrees, ) Can generate a 10 second composite video clip (clip_dynamic_composite) to which a panning camera work is applied.

As another example, when the camera captures a source dynamic video clip (clip_dynamic_source) for 10 seconds is rotated 10 degrees to the right, and the camera capturing the composite dynamic video clip (clip_dynamic_add) is rotated 10 degrees to the left, 140 can generate a composite video clip clip_dynamic_composite of 10 seconds to which the panning camera work is applied by reversing the compositing object image 432 of the compositing target dynamic video clip clip_dynamic_add.

Composite module 140 may generate a composite video clip clip_dynamic_composite in a variety of ways. For example, the compositing module 140 may synthesize the source object image 431 and the compositing object image 432 with the background image of the source dynamic video clip (clip_dynamic_source) to generate a composite video clip clip_dynamic_composite. At this time, the composing module 140 synthesizes the object image separated from the compositing target dynamic video clip (clip_dynamic_add) without separating the source object image 431 of the source dynamic video clip (clip_dynamic_source) Or by separating the source object image 431 from the source dynamic video clip clip_dynamic_source and separating the synthesis target object image 432 from the synthesis target dynamic video clip clip_dynamic_add to generate a background image of the source dynamic video clip clip_dynamic_source The composite video clip (clip_dynamic_composite) can be generated by rearranging the two object images. The separation of the object image can be obtained from the captured image of the chroma key or through the detection of the outline of the object in the dynamic video clip.

Alternatively, the image synthesizing system 100 may further include a background image input module that receives a user selected background image from the user terminal 200, and the synthesizing module 140 may include a source object image 431 and the object object image 432 to generate a composite video clip clip_dynamic_composite. At this time, the background image input module provides an interface through which a user can input a user input background image composed of a still image, a video image, 3D modeling data or the like through the user terminal 200, Background video can be received through a communication network. According to this embodiment, since the synthesized video clip (clip_dynamic_composite) is compared with the source dynamic video clip (clip_dynamic_source), not only the synthesized object image 432 such as a cast is added but also the background is changed, the degree of change Height is effective.

Korean Patent Application No. 2016-0171469 entitled " Image synthesis system and image synthesis method ", filed by the applicant of the present patent application, discloses a method of synthesizing a background image and an object in a virtual space so that a background image and a foreground image are naturally synthesized An image synthesis system (100) for synthesizing images is disclosed. Also in the present invention, it is preferable that the composite module 140 generates a composite video clip (clip_dynamic_composite) through the same method so that the object image and the background image are synthesized naturally according to the camera work. 6, the combining module 140 forms a background projection plane 410 having a predetermined height and a concave curved surface at a central portion in a virtual space, and forms a background projection plane 410 at a virtual projection point on the virtual space, A background object image 431 and a composite object image 432 are arranged between the virtual projection point on the virtual space and the background projection plane 410, At least a part of the user-selected background image, at least a part of the source object image 431, and at least a part of the object-of-synthesis object image 432 in the angle of view of the camera 420 to generate a composite image. In this case, the virtual projection point is set to a position corresponding to the position of the real-world camera that photographed the object image, and the projection of the user-selected background image on the background projection plane 410 is transformed so as to have no distortion when viewed from the virtual projection point. Selected background image to the background projection plane 410. In this case,

Meanwhile, according to the embodiment, it is possible to synthesize two or more object images 432, which are not a single object object image 432, in the source video clip. To this end, the search module 130 further retrieves the compositing target dynamic video clips (clip_dynamic_add) from the plurality of automatically photographed video contents having matching control parameters, and the compositing module 140 retrieves the source dynamic video clip (clip_dynamic_source) A composite video clip clip_dynamic_composite may be generated so that the object video 431 and a plurality of object video object clips of the object video clips are included.

According to an embodiment, it is possible to generate a synthesized image for all the source automatic shot video contents as well as the dynamic video clip section to which the dynamic camera work is applied. One video consists of a plurality of dynamic video clip intervals and a plurality of static video clip intervals. The static video clip sections without changes of the camera can be easily synthesized according to the conventional video composition method and the plurality of dynamic video clip sections are used to generate synthesized video contents contents_composite by applying the synthesis method according to the present invention . To this end, the search module 130 receives an object compositing request for the source automatic photographed video contents (contents_source) from the user terminal 200 and acquires a first interval reference control parameter (parameter_ref) of the first interval source dynamic video clip (clip_dynamic_source) ) Of the source dynamic video clip (clip_dynamic_source) to the n-th section (n is an integer greater than or equal to 2) source dynamic video clip (clip_dynamic_source) and acquires the n-th section reference control parameter (parameter_ref) the first section composition target dynamic video clips clip_dynamic_add to cl_dynamic_add of the compositing target automatic photographing video contents (contents_add) having the first section matching control parameter (parameter_match) to the nth section matching control parameter (parameter_match) and to search for the dynamic video clip (clip_dynamic_add) There. The synthesis module 140 generates the first section object image 432 of the first section source dynamic video clip clip_dynamic_source and the first section composition object object image 432 of the first section composite dynamic video clip clip_dynamic_add The n-th section of the n-th section source object image 431 and the n-th section of the dynamic video clip clip_dynamic_add of the n-th sectioned source video clip (clip_dynamic_source) included in the first- And an n-th section composite video clip (clip_dynamic_composite) including the object image 432, respectively. The content providing module 120 may configure the user terminal 200 to provide composite video contents (contents_composite) including the first section video clip clip_dynamic_composite to the nth section video clip clip_dynamic_composite.

Hereinafter, a camera-based image synthesis method according to the present invention will be described with reference to FIG. The image synthesis method of the present invention is performed by the image synthesis system 100. The image synthesis system 100 includes an application installed on a server side of a server-client network connected to a communication network, A storage device of a server, or an application installed in a client such as a storage device of a server and an information terminal such as a smart phone or a PC, an operation processing device of a client driving an application, or the like.

First, the image synthesizing system 100 performs a plurality of automatic photographing including a dynamic video clip that is a section photographed by an automatic control camera 301 controlled by at least one of camera control parameters such as fan control, tilt control, (S10) of storing the video contents in association with the camera control parameters. The automatic photographed video content refers to video content produced through an automatic control camera (301) in which at least one of fan control, tilt control, or moving control is controlled by predefined camera control parameters, Is not included in the automatic photographed video contents of the present invention.

Next, the image synthesizing system 100 performs step s20 of providing any one of the plurality of automatic photographed video contents source automatic photographed video contents (contents_source) to the user terminal 200 through the communication network. The user can access the web server providing the automatic photographed video content through the application of the user terminal 200 or the web browser to provide the automatic photographed video content.

Next, the image compositing system 100 performs a step (s30) of receiving an object compositing request from the user terminal 200 for the source dynamic video clip clip_dynamic_source of the source automatically photographed video contents (contents_source). The source automatic photographed video contents (contents_source) is an automatic photographed video content to be synthesized by the user and the source dynamic video clip (clip_dynamic_source) is at least one of a pan operation, a tilting operation and a moving operation among the source automatic photographed video contents (contents_source) It means the time interval during which the dynamic camera work is applied. According to an embodiment, the image synthesizing system 100 provides dynamic video clip intervals among the source automatically photographed video contents (contents_source) through a camera control parameter, and the user selects one of the video clip intervals The compositing system 100 may receive an object compositing request for the source dynamic video clip clip_dynamic_source. According to another embodiment, the user requests an object compositing requirement for the source automatic photographed video contents (contents_source), and the video compositing system 100 requests a source dynamic video clip (contents_source) included in the synthesized requested source automatic photographed video contents clip_dynamic_source) can be performed.

Next, the image synthesizing system 100 performs step (s40) of acquiring the camera control parameter of the source dynamic video clip (clip_dynamic_source) as the reference control parameter (parameter_ref). The image synthesizing system 100 can acquire the camera control parameter of the time interval corresponding to the source dynamic video clip clip_dynamic_source among the camera control meters stored in association with the source automatic photographed video contents contents_source as the reference control parameter have.

Next, the image compositing system 100 sets the compositing target dynamic video clip clip_dynamic_add of the compositing target automatic photographing video contents (contents_add) having the matching control parameter (parameter_match) which is the same or similar as the reference control parameter (parameter_ref) (S50). The image synthesis system 100 compares the camera control parameters of other automatic photographed video contents with the reference control parameter (parameter_ref), and when the time interval of the same or similar camera control parameter is found, it recognizes it as a matching control parameter (parameter_match) And searches the video clip of the section with the synthesis target dynamic video clip clip_dynamic_add.

At this time, the image synthesis system 100 searches for a synthesis target dynamic (e.g., a genre of a video content, a background music of a video content, a shooting time of a video content, The search module 130 may search for attributes of the video clip (clip_dynamic_add), or the attributes of the upload user or performer of the video clip, such as, for example, online social relationships among uploading users, The target dynamic video clip clip_dynamic_add can be preferentially searched.

Next, the video synthesis system 100 generates a composite video clip (clip_dynamic_composite) so that at least the source object image 431 of the source dynamic video clip (clip_dynamic_source) and the synthesis object image 432 of the synthesis target dynamic video clip (clip_dynamic_add) (Step s60). Since the source object image 431 and the composite object image 432 share the same or similar camera work, the composite video clip clip_dynamic_composite can provide a natural composite image to the user despite the dynamic camera work.

The image synthesis system 100 may apply various synthesis methods to generate a composite video clip (clip_dynamic_composite). For example, in the step s60 of generating a composite video clip clip_dynamic_composite, the image synthesis system 100 synthesizes the source object image 431 and the synthesis object image 432 with the background image of the source dynamic video clip clip_dynamic_source A composite video clip (clip_dynamic_composite) can be generated.

According to another embodiment, the image synthesis method further includes a step of receiving the user selected background image from the user terminal 200 by the image synthesis system 100, and generating the synthesized video clip clip_dynamic_composite (s60 May generate a composite video clip clip_dynamic_composite by combining the source object image 431 and the composite object object image 432 with the user selected background image by the image synthesis system 100. [

In this case, it is preferable to synthesize the background image and object images in the virtual space in order to naturally synthesize the dynamic camera work object image even if the 2D background image is used in the dynamic camera work. In step s60 of generating a composite video clip clip_dynamic_composite, the image synthesis system 100 includes a first part for forming a background projection plane 410 having a predetermined height and formed with a concave curved surface at a predetermined height in a virtual space, Step can be performed. Next, the image synthesizing system 100 may perform a second sub-step of projecting at least a part of the user selected background image on the background projection plane 410 at the virtual projection point in the virtual space. Subsequently, the image synthesizing system 100 can perform a third sub-step of arranging the source object image 431 and the compositing object image 432 between the virtual projection point in the virtual space and the background projection plane 410 . Finally, at least a part of the user-selected background image, at least a part of the source object image 431, and at least a part of the composite object image 432 in the view angle of the virtual camera 420 placed in the virtual space, And a fourth sub-step of generating a composite video clip (clip_dynamic_composite) including a part thereof.

Finally, the video composition system 100 performs step s70 of providing the composite video clip clip_dynamic_composite to the user terminal 200. [

In an embodiment in which a plurality of compositing objects are combined with a source dynamic video clip (clip_dynamic_source) to generate a composing video clip (clip_dynamic_composite), the step s50 of retrieving the compositing target dynamic video clip clip_dynamic_add comprises: 100) can further search each of the compositing target dynamic video clips (clip_dynamic_add) in the plurality of automatic photographing video contents having the matching control parameter. The step s60 of generating the composite video clip clip_dynamic_composite is a step of generating the composite video clip clip_dynamic_composite by combining the source object image 431 of the source dynamic video clip clip_dynamic_source and the plurality of synthesis target dynamic video clips A composite video clip clip_dynamic_composite may be generated so that the images 432 are included.

The synthesized video content contents_composite is generated by synthesizing the synthesis target object image 432 in the whole source automatic photographed video contents contents_source without synthesizing the synthesis target object image 432 only with the source dynamic video clip clip_dynamic_source For example, the step s30 of receiving the object synthesis request may receive the object synthesis request for the source automatic photographed video contents (contents_source) from the user terminal 200 by the image synthesis system 100. [ The step (s40) of acquiring the reference control parameter (parameter_ref) is performed in such a manner that the image synthesis system 100 acquires the first interval reference control parameter (parameter_ref) through the n-th interval (n is 2 Of the source dynamic video clip (clip_dynamic_source) of the source dynamic video clip (clip_dynamic_source). The step (s50) of searching the synthesis target dynamic video clip (clip_dynamic_add) is performed in such a manner that the image synthesis system 100 generates the first section reference control parameter (parameter_ref) to the nth section reference control parameter (parameter_ref) Target dynamic video clips clip_dynamic_add through n_th section synthesis target dynamic video clips clip_dynamic_add_indicate of the compositing target automatic photographed video contents contents_add having the matching control parameter (parameter_match) to the nth section matching control parameter (parameter_match) ) Can be searched. The step s60 of generating the composite video clip clip_dynamic_composite is a step S60 of generating the composite video clip clip_dynamic_composite by combining the first interval source object image of the first interval source dynamic video clip clip_dynamic_source and the first interval composition dynamic video clip clip_dynamic_add ) Of the first interval synthetic video clip clip_dynamic_composite to the nth interval source dynamic video clip clip_dynamic_source including the first interval composition object object image of the first interval synthesis object video clip clip_dynamic_add And an n-th section composite video clip (clip_dynamic_composite) including the n-th section object image to be synthesized. The step s70 of providing the composite video clip clip_dynamic_composite may be such that the video synthesis system 100 generates the composite video content contents_composite including the first section composite video clip clip_dynamic_composite to the nth section composite video clip clip_dynamic_composite To the user terminal 200. In the above embodiment, in the time period corresponding to the static dynamic video clip photographed using the static camera work, a time interval not corresponding to the source dynamic video clip (clip_dynamic_source) is synthesized using the conventional video object synthesis technique Video contents (contents_composite) can be generated.

The detailed description of the invention in this specification is intended to illustrate the preferred embodiments, and the invention is not limited to these embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. .

100: image synthesis system 110: storage module
120: Content providing module 130: Search module
140: Composite module 200: User terminal
301: Automatic control camera

Claims (14)

A plurality of automatic photographed video contents including a dynamic video clip which is an interval photographed by an automatic control camera controlled by at least any one of camera control parameters such as a pan control, a tilt control or a moving control, A storage module;
A content providing module for providing any one of the plurality of automatic shooting video contents to a user terminal through a communication network;
Receiving from the user terminal an object composition request for a source dynamic video clip of the source automatic shooting video content, obtaining the camera control parameter of the source dynamic video clip as a reference control parameter, A retrieval module for retrieving a compositing target dynamic video clip of the compositing target automatic photographing video contents having the matching control parameter which is the camera control parameter within an error range; And
And a synthesis module for generating a synthesized video clip such that at least a source object image of the source dynamic video clip and a synthesis object image of the synthesis target dynamic video clip are included,
Wherein the content providing module provides the composite video clip to the user terminal.
The method according to claim 1,
Wherein the search module is further operable to further retrieve composite target dynamic video clips from each of a plurality of the automatically photographed video contents having the matching control parameter,
Wherein the synthesis module generates a composite video clip such that the source object image of the source dynamic video clip and the composite object images of the plurality of composite dynamic video clips are included.
The method according to claim 1,
Wherein the search module receives an object composition request for the source automatic photographed video content from the user terminal and generates a first interval reference control parameter of the first interval source dynamic video clip through the nth interval An nth interval reference control parameter of the dynamic video clip; and a synthesis-target automatic control section that acquires a nth interval reference control parameter of the dynamic video clip, The dynamic video clips to be subjected to the first interval synthesis and the dynamic video clips to be subjected to the nth section synthesis of the photographed video contents,
Wherein the synthesis module includes a first interval synthesis video clip including a first interval source object image of the first interval source dynamic video clip and a first interval composition object image of the first interval composition dynamic video clip, an nth interval synthetic video clip including an nth interval source object image of the n-period source dynamic video clip and an nth interval object image of the nth interval of the dynamic video clip to be synthesized,
Wherein the content providing module provides the user terminal with a composite video content including the first interval video clip to the nth interval video clip.
2. The apparatus of claim 1,
And the synthesized video clip is generated by synthesizing the source object image and the synthesis object object image with the background image of the dynamic video clip.
The method according to claim 1,
The image synthesizing system may further include a background image input module receiving a user selected background image from the user terminal,
Wherein the synthesizing module generates the synthesized video clip by synthesizing the source object image and the synthesized object object image with the user selected background image.
6. The apparatus of claim 5,
A background projection plane having a predetermined height and formed with a concave curved surface in a virtual space; projecting at least a part of the user selected background image on the background projection plane at a virtual projection point on the virtual space; Wherein the source object image and the compositing object image are disposed between the projecting point and the background projection plane, and at least a part of the user selected background image, at least a part of the source object image, And generates the composite video clip including at least a portion of the composite object object image.
The apparatus of claim 1,
Wherein the automatic shoot video content is preferentially searched for the automatic shot video content in which the other performers having a social relationship with the cast of the source automatic shot video content appear.
A plurality of automatic photographed video contents including a dynamic video clip that is a section taken by an automatic control camera whose image synthesis system is controlled by at least one of camera control parameters such as fan control, tilt control or moving control, In association with;
Providing the image synthesis system to a user terminal through a communication network, the source automatic photographed video content of any one of the plurality of automatic photographed video contents;
Receiving from the user terminal an object composition request for a source dynamic video clip of the source automatic photographed video content;
The video synthesis system obtaining the camera control parameter of the source dynamic video clip as a reference control parameter;
Searching the synthesis target dynamic video clip of the synthesis subject automatic photographing video contents having the matching control parameter which is the same as the reference control parameter or the camera control parameter within the certain error range;
Generating a composite video clip such that the image synthesis system includes at least a source object image of the source dynamic video clip and a composite object image of the composite dynamic video clip; And
And providing the composite video clip to the user terminal by the video synthesis system.
9. The method of claim 8,
Wherein the step of retrieving the compositing target dynamic video clip further comprises the step of the video synthesizing system further retrieving the compositing target dynamic video clips from each of the plurality of the automatic photographing video contents having the matching control parameter,
Wherein generating the composite video clip comprises generating the composite video clip such that the image synthesis system includes the source object image of the source dynamic video clip and the composite object images of the plurality of composite dynamic video clips A camera work based image synthesis method characterized by.
9. The method of claim 8,
Wherein the receiving of the object combining request comprises receiving the object combining request for the source automatic shooting video content from the user terminal,
Wherein the step of acquiring the reference control parameter comprises the steps of: when the video synthesis system performs a first interval reference control parameter of the first interval source dynamic video clip to the nth interval reference control of the nth interval (n is an integer of 2 or more) Parameters are acquired,
Wherein the step of retrieving the synthesis target dynamic video clip comprises the steps of: the image synthesis system having a first interval matching control parameter to an nth interval matching control parameter corresponding to the first interval reference control parameter to the nth interval reference control parameter The dynamic video clips to be subjected to the first section synthesis and the dynamic video clips to be synthesized to the nth section of the automatic shooting video contents of the object to be synthesized,
The step of generating the composite video clip may include a step of generating a composite video clip by combining the first interval source object image of the first interval source dynamic video clip and the first interval composition object image of the first interval composition target dynamic video clip An n-th segmental synthesis video clip including an n-th segmental source object image of the n-th section source dynamic video clip and an n-th segmental synthesis object image of the n-th sectional synthesis- Respectively,
Wherein providing the composite video clip comprises providing the composite video content to the user terminal, wherein the composite video content comprises the first-interval composite video clip to the n-th section composite video clip. Way.
9. The method of claim 8, wherein generating the composite video clip further comprises:
Wherein the image synthesis system synthesizes the source object image and the composite object image with the background image of the source dynamic video clip to generate the composite video clip.
9. The method of claim 8,
The image synthesizing method may further include receiving the user selected background image from the user terminal by the image synthesizing system,
Wherein the generating of the composite video clip comprises generating the composite video clip by combining the source object image and the composite object object image with the user selected background image, Way.
13. The method of claim 12, wherein generating the composite video clip further comprises:
A first sub-step of forming a background projection plane having a predetermined height and a central concave curved surface in a virtual space;
A second sub-step of the image synthesizing system to project at least a part of the user selected background image on the background projection plane at a virtual projection point on the virtual space;
A third sub-step of arranging the source object image and the composite object image between the virtual projection point on the virtual space and the background projection plane; And
Wherein the image synthesis system includes at least a portion of the user selected background image, at least a portion of the source object image, and at least a portion of the composite object image at an angle of view of a virtual camera disposed in the virtual space, And a fourth step of generating the camera-based image.
9. The method as claimed in claim 8,
Wherein the image synthesis system preferentially searches for the automatic photographic video content appearing by other performers who have a social relationship with the performer of the source automatic photographic video content on-line.

Images