KR102167588B1 - Video producing service device based on contents received from a plurality of user equipments, video producing method based on contents received from a plurality of user equipments and computer readable medium having computer program recorded therefor - Google Patents

Abstract

The present invention discloses a content creation service device for generating a moving picture based on a plurality of user devices, a method for generating a moving picture based on personal contents, and a recording medium in which a computer program is recorded. That is, in the present invention, a plurality of user devices may share a video by acquiring personal content from each user device in a template using a plurality of user devices. When creating a video including personal content acquired from a plurality of user devices, a plurality of user devices map each personal content in consideration of location information and size information of an area for combining personal content mapped to each template. Personal content can be mapped naturally. In addition, a video generated based on personal content is deleted at a preset time, thereby protecting personal information included in the video.

Description

A content creation service device that generates a video based on a plurality of user devices, a method of creating a video based on a plurality of user devices, and a recording medium in which a computer program is recorded. equipments, video producing method based on contents received from a plurality of user equipments and computer readable medium having computer program recorded therefor}

The present invention relates to a content creation service device for generating a moving picture based on a plurality of user devices, a method for generating a moving picture based on a plurality of user devices, and a recording medium in which a computer program is recorded, and in particular, obtained from a plurality of user devices. The present invention relates to a content generation service device that generates a video based on the personal content and a selected template, a video generation method, and a recording medium in which a computer program is recorded.

With the emergence of the web paradigm characterized by participation, openness, sharing, and personalization, contents created by individuals are being widely distributed on the Internet. This web paradigm is changing so that in the past, netizens who passively enjoyed content provided centering on media can directly create and consume content. Contents created by individuals are also gradually changing from text to image and from image to video. The development of user devices (high-end PCs, digital cameras, smartphones) is also helping to spread netizens who create personal contents.

In addition, tools to make it easier for netizens to produce personal content are also increasing. These content creation tools make it possible to easily create content and upload content on the web without the difficulty of creating a homepage or learning programming techniques to create and upload content in the past. The demand to use such personalized content is also changing the evolution of applications such as social network service (SNS).

Social media is an open platform that is used to produce and spread one's own thoughts, experiences, and information as an open and interactive medium led by the general public as a concept in contrast to mass media represented by traditional newspapers and broadcasting. (Blog, YouTube) refers to social media that form a relationship. Among the social media categories, SNS is an online social networking service that supports the formation of a more active human network that transcends time and space by implementing social relationships that have existed online.

Smartphone users can communicate with other smartphone users through SNS. At this time, smartphone users have a desire to express the message they want to transmit more clearly and abundantly by using not only text but also various multimedia information in order to transmit personal messages in SNS applications. Accordingly, there is an increasing need for a method capable of satisfying the personal expression needs of users and enriching communication.

Korean Patent Application Publication No. 10-2010-0008313 [Name: Synthetic video generation apparatus and method]

An object of the present invention is a content creation service device for generating a video based on a plurality of user devices for sharing one video information between a plurality of user devices by combining a pre-stored template and personal content respectively transmitted from a plurality of user devices , To provide a method for generating a moving picture based on a plurality of user devices and a recording medium in which a computer program is recorded.

Another object of the present invention is to protect personal information by sharing a video generated between a plurality of user devices, and allowing the shared video to be deleted from a plurality of user devices and content creation service devices within a time set by the user device. A content generation service device that generates a video based on a user device of, a method of creating a video based on a plurality of user devices, and a recording medium in which a computer program is recorded.

Another object of the present invention is to provide a plurality of user devices for combining personal content with a template at an accurate location by mapping personal content combination location information to combine personal content with the template and the size of personal content in combining the template and personal content. The present invention provides a content generation service device that generates a moving picture based on a video, a method of generating a moving picture based on a plurality of user devices, and a recording medium in which a computer program is recorded.

A content creation service device that generates a video based on a plurality of user devices according to an embodiment of the present invention receives information on a selection template selected to generate a first video from a first user device, and based on the selection template Creating a first video by acquiring first personal content from a first user device, creating a first video by combining the first personal content with a selected template, and transmitting the first video to a first user device and a second user device part; It is determined whether the selected template requires the second personal content, and if the second personal content is required, the second personal content is obtained from the second user device, and the second personal content is combined with the first video to generate a second video. And a second moving picture generator for transmitting the second moving picture to the first user device and the second user device; And a personal content obtaining unit that obtains first personal content from a first user device and obtains second personal content from a second user device.

As an example related to the present invention, the first personal content is information obtained by extracting the content creation service device using an object recognition method based on the profile information registered in the first user device, and the second personal content is a content creation service It may be information obtained by extracting by the device using an object recognition method based on profile information registered in the second user device.

As an example related to the present invention, the first video may be a video generated by covering a portion corresponding to the second personal content with a specific pattern.

As an example related to the present invention, when a specific pattern is selected by the first user device and the second user device, the second video generation unit prioritizes the second personal content information of low-volume data so that the specific pattern is displayed as the second personal content. Then, data of the second personal content information other than the low-capacity data may be additionally transmitted.

As an example related to the present invention, when the set deletion time elapses after the second user device plays the second video based on the deletion time set by the first user device, the first video and the second A deletion time setting unit for setting a deletion time so that the video is deleted may be further included.

As an example related to the present invention, when at least one of the first user device and the second user device does not check the second video, the content creation service device is at least one user who does not check the second video information The device may further include an alarm signal generator that generates alarm information for checking the second video.

As an example related to the present invention, a content creation service device includes: a template storage unit for storing a plurality of templates for combining first personal content and second personal content; And comparing the template search information received from the user device with a hash tag for identifying contents of a plurality of templates mapped to the plurality of templates to search for a matching template matching the template search information, and to transfer the matching template to the first user device. It may further include a template search unit implemented so that the first user device can determine the selection template by transmitting.

As an example related to the present invention, the first video generation unit determines information on the synthesis location where the first personal content is synthesized in the selection template and information on the size of the first personal content to be synthesized in the synthesis location, and the first personal content The first video may be generated by combining the first personal content with the selection template based on the information on the synthesis location of and the size of the first personal content.

A method of generating a video based on a plurality of user devices according to an embodiment of the present invention includes, by a content creation service device, receiving information on a selection template selected to generate a first video from a first user device; Requesting, by the content creation service device, first personal content from the first user device based on the selection template, and obtaining first personal content from the first user device; Generating, by the content creation service device, a first video by combining the first personal content with a selection template, and transmitting the first video to the first user device and the second user device; Determining, by the content creation service device, whether second personal content is required in the selection template, and requesting second personal content from a second user device when 2 personal content is required in the selection template; And the content creation service device obtains second personal content from the second user device, combines the second personal content with the first video to generate a second video, and sends information on the second video to the first user device and the second video. 2 It may include transmitting to the user device.

As an example related to the present invention, the step of requesting the first personal content from the first user device and obtaining the first personal content from the first user device by the content creation service device based on the selection template is the requested first personal content In the case of image information of an object, the content creation service device transmitting the contour information of the object to the first user device so that the first user device can image the object based on the contour information of the object to generate first personal content ; And receiving, by the content generation service device, first personal content captured based on the outline information from the first user device.

As an example related to the present invention, the information on the second video may include image synthesis information for generating a second video by combining second personal content with the first video.

A computer program for performing the method according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

The present invention obtains personal content from a plurality of user devices and combines it with a pre-stored template to allow a plurality of users to share a video created based on individual personal content, thereby generating and sharing various video content between a plurality of users. Make it possible.

In addition, in combining the personal content and the template, the personal content can be naturally combined with the template by mapping the location of the personal content to be combined with the template and the size of the personal content to combine the personal content.

In addition, it is possible to protect personal information included in the generated video by deleting the generated video within a set time.

1 is a conceptual diagram illustrating a method of generating a video based on personal content according to an embodiment of the present invention.
2 is a conceptual diagram illustrating a method of selecting a template in a user device according to an embodiment of the present invention.
3 is a conceptual diagram illustrating a method of adding personal content in a template according to an embodiment of the present invention.
4 is a conceptual diagram illustrating a method of generating a video based on personal content according to an embodiment of the present invention.
5 is a conceptual diagram illustrating a method of requesting personal content from a user device according to an embodiment of the present invention.
6 is a conceptual diagram illustrating a method of generating a video based on personal contents of a plurality of user devices according to an embodiment of the present invention.
7 is a conceptual diagram illustrating a method of performing a chat by transmitting and receiving video information by a plurality of user devices according to an embodiment of the present invention.
8 is a conceptual diagram illustrating a method of displaying video information according to an embodiment of the present invention.
9 is a flowchart illustrating a method of transmitting and receiving moving image information in a plurality of user devices according to an embodiment of the present invention.
10 is a conceptual diagram illustrating a content creation service device for generating a video according to an embodiment of the present invention.

It should be noted that the technical terms used in the present invention are used only to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as generally understood by those of ordinary skill in the technical field to which the present invention belongs, unless otherwise defined in the present invention. It should not be interpreted as a meaning or an excessively reduced meaning. In addition, when a technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be replaced with a technical term that can be correctly understood by those skilled in the art. In addition, general terms used in the present invention should be interpreted as defined in the dictionary or according to the context before and after, and should not be interpreted as an excessively reduced meaning.

In addition, the singular expression used in the present invention includes a plurality of expressions unless the context clearly indicates otherwise. In the present invention, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various components or steps described in the invention, and some components or some steps may not be included. It should be construed that it may or may further include additional components or steps.

In addition, terms including ordinal numbers such as first and second used in the present invention may be used to describe the elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted.

In addition, in describing the present invention, when it is determined that a detailed description of a related known technology may obscure the subject matter of the present invention, a detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easily understanding the spirit of the present invention and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

Hereinafter, in an embodiment of the present invention, a method of generating a video based on personal content obtained from a user device and another user device is disclosed.

1 is a conceptual diagram illustrating a method of generating a video based on personal content according to an embodiment of the present invention.

Hereinafter, the operation of generating a video based on personal content according to an embodiment of the present invention may be an operation performed by a content generation application installed in a user device or by a content generation service device. Hereinafter, in the embodiment of the present invention, for convenience of description, it is assumed that the operation is mainly performed by the content generation service device 150.

Referring to FIG. 1, the first user device 110 may search for a template stored in the content creation service device 150 and select a template for synthesizing first personal content. Alternatively, a template previously downloaded from the content creation service device 150 to the first user device 110 may be selected.

The first user device 110 may select a template and receive a template capable of synthesizing first personal content from the content creation service device 150. First personal content information may be combined with the selected template, and then, the template combined with the first personal content may be transmitted to the second user device 120, which is another user device.

The first personal content may be extracted based on image information previously stored in the first user device 110. For example, it may be assumed that the face image of the user of the first user device 110 is combined with the template as first personal content information. In this case, the first personal content may be registered in a content creation application installed in the first user device 110 or extracted from profile information of the user stored in the first user device 110. For example, the content generation application of the first user device 110 or the content generation service device 150 extracts image information corresponding to a face from among profile information registered in the first user device 110 to provide first personal content. As an example, it may be combined with the template selected by the first user device 110. The user face image information is an example of the first personal content, and various multimedia information may be the first personal content.

The first user device 110 may transmit the first personal content requested to be combined with the template according to the template to the content generation service device 150, and the content generation service device 150 transmits the first personal content to the template. Combined to create a first video. The first personal content received from the first user device 110 and the first video generated based on the template may be transmitted to the second user device 120.

According to an embodiment of the present invention, the first video may be completed as a second video by adding second personal content, which is additional personal content acquired from the second user device 120. For example, the template may be a template in which not only the user face image extracted from the first user device 110 is combined, but the user face image extracted from the second user device 120 is combined to generate a second video. . In this case, the content creation service device 150 separately obtains the second personal content from the second user device 120 and includes a first video generated based on the first personal content extracted from the first user device 110. Combined to create a second video. The generated second video may be transmitted to the first user device 110 and the second user device 120.

For example, in order to create a second video by combining the user face image of the second user device 120 with the first video transmitted by the first user device 110, the second user device 120 An image corresponding to the face of may be extracted based on the profile information of the user registered in the second user device 120. The content creation service device 150 may generate a second video by synthesizing the user's face image acquired from the second user device 120. The image of the face is an example of the second personal content received from the second user device 120 and other multimedia information may be received as the second personal content from the second user device 120, and based on this, a second video Can be generated.

This template-based video generation method may be performed in real time, and may be used when a user device and another user device use a service such as chat through a network.

Hereinafter, in an embodiment of the present invention, a method of generating a video by receiving personal content from a plurality of user devices will be described in detail.

2 is a conceptual diagram illustrating a method of selecting a template in a user device according to an embodiment of the present invention.

The content creation service device may store various templates for generating a video. Hereinafter, in an embodiment of the present invention, for convenience of explanation, it is assumed that a template for generating a video is stored in the template pool 200 (or a template storage unit) of the content creation service device, but the template for creating a video is stored in the user device. It can be used immediately.

The user device may select a template for combining personal content stored in the template pool 200. Templates can be saved with a hash tag. The user device may search for a template stored in the content creation service device based on a hash tag. The hash tag is a tag attached to search for a template. By using the hash tag, the stored template can be efficiently searched. In addition, when a template is produced and uploaded by a user device, a hash tag may be tagged to facilitate other user devices to search for an uploaded template. Templates may be categorized based on these hash tags.

Referring to FIG. 2, the template may be multimedia information for combining personal content. Individual templates may be assigned a hash tag to search for templates. The hash tag may be provided with a plurality of tags for identifying the template. For example, it may be assumed that a specific template is a template in which a man gives flowers to a woman, and that a template is created as a video by adding personal content to portions corresponding to the man's face and the woman's face. In this case, a hash tag for expressing content included in the template, such as "propose", "love", and "flower", may be attached to the specific template.

When a user device wants to search for a template related to a proposal, the template may be searched by entering a search word “propose” in the template search unit of the content creation service device. In this case, a template with a tag of proposal may be searched in the template storage unit of the content creation service device and the search result may be transmitted to the user device.

Templates stored in the content creation service device may be classified into various categories 210 and 220 based on such hash tags. The user device may search for a template based on the categories 210 and 220. For example, it is possible to determine the categories 210 and 220 primarily for classification into family, travel, couple, company, school, and the like. Next, a hash tag associated with the categories 210 and 220 may be assigned. For example, in the case of a family, a hash tag that can be associated with the family such as dad, mother, younger brother, older brother, older sister, older sister, cousin, grandfather, grandmother may be assigned. If a template is created and uploaded on a specific user device, the created template can be uploaded by attaching a tag. Templates uploaded with a tag may be classified into corresponding categories 210 and 220 according to which category 210 and 220 the tag is assigned to.

As another category classification method, categories 210 and 220 may be adaptively generated based on information on tags that are most used among hash tags. For example, when the number of templates to which a hash tag of "love" is assigned increases, a category of love may be created as a new category. In the case of using the adaptive category 210 and 220 regeneration method, the more frequently used tags can be easily searched by the user device.

3 is a conceptual diagram illustrating a method of adding personal content to a template according to an embodiment of the present invention.

FIG. 3 discloses a method of generating a video by combining a face image 300 extracted from a profile registered in a user device with a template.

Referring to FIG. 3, it may be assumed that a template for synthesizing personal content is selected by a user device, and a face image 300 of a profile registered in the user device is combined with the selected template as personal content. The content generation service device (or a content generation application installed on the user device, hereinafter, for convenience of explanation, it is assumed that an operation performed by the content generation service device is described) is registered as user profile information of the user device. It may be determined whether or not an image 300 corresponding to a person's face exists by first searching for an image. When an image corresponding to a human face exists, an image 300 corresponding to the face may be extracted from the image. Various image processing techniques may be used to search and extract the human face 300. For example, based on the template model of a person's face, it is determined whether an image similar to the template model exists in the image registered in the profile information, and whether the region 300 corresponding to the person's face exists in the profile information. May be determined and the region 300 corresponding to the person's face may be extracted.

As another method, based on the feature point information of the image 300 corresponding to the person's face, it is determined whether an object with the same feature point exists in the image registered in the profile information, and the image 300 corresponding to the person's face If there is an object mapped to the feature point information of, the object may be recognized as a human face 300. In addition, various methods can be used to recognize and extract a person's face 300 from an image.

When a plurality of human face images 300 exist in the profile information, at least one of the corresponding images may be combined with a template selected by the user device as personal content. In addition, when multiple pieces of profile information are stored, the user's face image 300 may be extracted from the multiple pieces of profile information images.

As another method, it is possible to determine whether to combine the extracted image to the template by checking once whether the image extracted by the user device is the personal content to be combined with the template.

If the face image does not exist in the profile, or the face of the person in the profile is not the image that the user wants to combine with the template, the content creation service device requests separate personal content information from the user device or Personal content can be automatically extracted from stored image information.

For example, the content creation service device may transmit a signal requesting personal content (eg, face image information) to be mapped to a template to the user device. The user device may select personal content based on the received personal content request signal and transmit it to the content creation service device.

4 is a conceptual diagram illustrating a video generation method based on a plurality of user devices according to an embodiment of the present invention.

In FIG. 4, for convenience of explanation, the template 400 is a video consisting of three images (a first image 410, a second image 430, and a third image 430), and the content creation service device is a personal content as a user device. The description assumes the case of requesting.

Referring to FIG. 4, a video may be generated by combining an image of a person turning their head in a template 400 as personal content. In this case, the first image 410 may require a right side of the face, the second image 420 may require a middle point between the right side and the front of the face, and the third image 430 may require a front image of the face.

In this case, the content creation service device may request the right side image of the face, the middle image of the right side and the front side of the face, and the front image of the face from the user device. The user device may transmit the captured image information to the content creation service device. The content creation service device may extract a right side image of a face, an intermediate image of a right side and a front side, and a front image of a face from among information transmitted through various object extraction methods. The user device may transmit information of the previously captured image as personal content to the content generation service device, but may transmit newly captured image information as personal content to the content generation service device. Alternatively, the user's face template model may be generated and stored in the content generation service device, so that separate image information may not be transmitted to the content generation service device each time a template is generated. A method of extracting an object to be used in the template 400 and a method of registering a user's face template model will be described later.

The input personal content, such as the right side image of the face, the middle image of the right side and the front side of the face, and the front image of the face, may be adjusted according to the template coordinates and the size of the personal content and synthesized into the template.

Each image included in the template 400 may be mapped to coordinates of an image for synthesizing personal content, information on the size of personal content, or information on a motion vector. For example, coordinates for synthesizing personal content of (x1, y1) may exist in the first image, and information on the size of personal content of 1 cm ² may be mapped. In order to synthesize personal content with the first image 410, the size of the extracted personal content (eg, an image of the left side of the face) may be resized to fit the size of the set personal content. The resized personal content may be moved to a corresponding image location based on location information for synthesizing the personal content with the template 400, so that the first image 410 of the template 400 and the personal content may be synthesized. In this way, the second image 420 and the third image 430 of the template and personal content may be combined, and the template 400 and personal content may be combined to generate a single video.

In FIG. 4, it has been exemplified that a plurality of personal contents are received from the template 400 and a video is generated based on them. And these embodiments are also included in the scope of the present invention.

5 is a conceptual diagram illustrating a method of requesting personal content from a user device according to an embodiment of the present invention.

FIG. 5 discloses a method for a content creation service device to request personal content to be synthesized into a template by a user device.

Referring to FIG. 5, the content creation service device may request the user device 500 to capture an object at a specific angle. As described above in FIG. 4, if an image of the right side of the face, the middle of the right side and the front of the face, and the front of the face is required, information on the outline of the face (510, 520, 530) is provided and the corresponding outline information (510, 520) is provided. , 530), the object image may be captured and transmitted. That is, the content creation service device may provide contour information 510, 520, 530 of an object corresponding to personal content requested according to the template, and request the user device 500 to transmit a captured image to match the contour information. have.

As another example, if video information is required, the user device can be set to transmit a message that is helpful for shooting a video, and the user device generates a video based on the received message and transmits it to the content creation service device. have. For example, as described above, if a person needs personal content that turns their neck, a video recording help message is transmitted to the user device saying "Please turn your neck so that your face comes out from the left to the front." Can be operated by interlocking. Such a help message is mapped to an individual template, and when a corresponding template is selected, it is transmitted to a user device, thereby helping the user device to easily create personal content.

According to another embodiment of the present invention, in the case of personal content that is frequently used as personal content synthesized in a template, modeling may be performed and then registered in a content creation service device for use. For example, in the case of an object that is frequently used (eg, a human face), an object model can be created by modeling the object. When an object is required for object modeling, a video can be generated using the modeled object without requesting information for generating personal content from a user device. To create an object model, for example, the following method can be used.

Object models can be created using motion-based modeling (Shape from Motion, SFM). In the motion-based modeling method, a three-dimensional model can be obtained by calculating the feature points of an object from a moving picture of an object from several viewpoints or from an image photographing the object from several viewpoints and calculating the correspondence between these frames for the object. have. For example, an object model may be generated by modeling a shape of an object based on a correspondence relationship between feature points of an object included between the first image and the second image. Object models can also be created through silhouette-based modeling (Shape from Silhouette).

In order to use the video generation method disclosed in FIGS. 1 to 5 described above, a content generation application for searching a template from a content generation service device and providing personal content may be installed on a user device. The user device may generate a video including personal content based on the content creation application.

According to an embodiment of the present invention, the content creation service device may transmit additional information (product information, gifticon or coupon information) to the user device based on the video generated by the above method.

6 is a conceptual diagram illustrating a method of generating a video based on personal contents of a plurality of user devices according to an embodiment of the present invention.

In FIG. 6, the first user device 610 transmits a first video obtained by synthesizing the first personal content to the second user device 620 through the content creation service device 600 and obtains it from the second user device 620. A method of generating a second video by combining second personal content, which is personal content of the second user device 620, is disclosed.

In FIG. 6, it is assumed that the content generation service device 600 plays the role of a service device that transmits and receives video information between the first user device 610 and the second user device 620, but the content generation service device A transmission/reception service device other than 600 may be used to transmit and receive video information between the first user device 610 and the second user device 620.

Referring to FIG. 6, a first video obtained by combining the first personal content obtained from the first user device 610 may be transmitted to the second user device 620. The content creation service device 600 is based on the template information included in the video that the first user device 610 transmits to the second user device 620, the corresponding template is obtained from the second user device 620 2 It is possible to determine whether it is a template to be combined with contents. If the template is a template that does not require the combination of the second content, the content creation service device 600 may transmit the generated video to the second user device 620. However, if the template is a template requiring the combination of the second content, the content creation service device 600 may obtain additional second personal content from the second user device 620.

For example, it may be assumed that the template is a template that requires a face image of the user of the second user device 620 as the second content from the second user device 620. In this case, the content creation service device 600 searches for profile information registered in the content creation application of the second user device 620 and searches whether image information corresponding to a person's face exists, and retrieves the person's face information. Can be extracted. If there is image information corresponding to a person's face by searching for profile information registered in the second user device 620, a template included in the video transmitted by the first user device 610 by extracting the person's face image Can be combined with That is, the second video may be completed by combining the first video transmitted from the first user device 610 with the second personal content information obtained from the second user device 620. The second video completed by combining the second personal content information may be transmitted to the first user device 610 and the second user device 620. The entire information of the second video may be transmitted, or only combined information of the additionally combined second personal content of the second video may be transmitted to the first user device 610 and the second user device 620.

In order to create a second video by combining the second personal content in real time, a portion corresponding to the second personal content that has not yet been combined in the first video may be processed like a mosaic. After receiving the second personal content and completing the combination with the first video, video information related to the second video is transmitted to the first user device 610 and the second user device 620 so that the second personal content is displayed in the video instead of a mosaic. Can be transmitted.

When a specific pattern such as a mosaic display is selected through a touch or the like by a user device, it disappears and may be gradually displayed as a video in which the second personal content is combined. For example, when a specific pattern displayed on the first user device 610 or the second user device 620 is selected through touch, etc., a low-volume second personal content so that the specific pattern is displayed as the second personal content. Information can be transmitted first. Next, data of the second personal content information other than the transmitted second personal content information may be additionally transmitted to the first user device 610 or the second user device 620.

As another method, as described above, the content creation service device 600 determines whether the image obtained from the second user device 620 is used as the second personal content to be combined with the first video. You can check it through. The second personal content extracted from the video may be combined only when the second user device 620 determines that the second personal content to be combined with the first video is correct.

If, as a result of performing the search on the second user device 620, there is no image information corresponding to the face information of the person, or the extracted image is the second personal content that the second user device 620 wants to combine. If not, the second user device 620 may request and receive multimedia information corresponding to the second personal content, or the second personal content required through a multimedia storage unit such as an image storage unit of the second user device 620 may be provided. It can also be extracted and used.

7 is a conceptual diagram illustrating a method of performing a chat by transmitting and receiving video information by a plurality of user devices according to an embodiment of the present invention.

Referring to FIG. 7, a first user device selects a template based on a content creation service device, and transmits first video information 710 obtained by combining first personal content with the selected template through a networking service such as a chat application. Can be transmitted to the user device. Here, the chat application is an example of an application for transmitting and receiving video information between a plurality of user devices. The first service device and the second service device may transmit and receive video information through other network service applications as well as a chat application.

The content creation service device (or the second user device) may determine whether to add the second personal content to the first video information 710 based on the received first video information 710.

The first video information 710 may be video information that is completed only with first personal content combined with the first user device, or is completed by separately combining second personal content obtained from another user device such as a second user device. It may be video information. When the first video information 710 is video information completed only with first personal content combined with the first user device, the second user device may receive the first video information 710 as it is. Conversely, if the first video information 710 is not video information completed by only the first personal content combined by the first user device, but a video completed by adding the second personal content in the second user device, the second user device 1 The moving picture information 710 may not be received as it is, and a specific display (eg, mosaic display) 700 may be performed on a portion corresponding to the second personal content.

In the first video information 710 displayed on the first user device, a portion to which the second personal content is to be combined may be mosaic-processed 700.

The second user device may determine the second personal content requested from the first video information 710 based on the template information and transmit information on the second personal content to the content creation service device. Alternatively, the content creation service device may determine second personal content requested from the first video information 710 and obtain second personal content from the second user device.

The content creation service device may generate second video information 720 by combining the second personal content with the first video 710 after obtaining information on the second personal content. The added second video information 720 may be transmitted to the first user device and the second user device. The content creation service device may transmit only the synthesis information of the second personal content to the first user device and the second user device. In this case, the portion displayed as the mosaic 700 in the first user device and the second user device disappears, and the completed second video information 720 in which the second personal content is combined is displayed on the first user device and the second user device. 2 It may be transmitted to the user device.

This operation is assumed to be a case in which the second personal content is combined in the content creation service device. As another method of generating the second video information 720, an operation of combining the second personal content with the first video information 710 may be performed in an individual device. For example, the second personal content selected by the second user device based on the content creation application may be directly combined with the first video information 710 to generate the second video information 720. In addition, the second personal content is transmitted to the first user device through the content generation service device, and the second personal content is combined with the first video information 710 based on the content generation application in the second user device to provide a second video. Information 720 may be generated. The video generation unit functionally generates a first video generation unit that generates a video based on the first personal content received from the first user device and a second video generation unit that generates a video based on the second personal content received from the second user device It can be divided into wealth.

8 is a conceptual diagram illustrating a method of displaying video information according to an embodiment of the present invention.

In FIG. 8, a method for displaying second personal content information by removing mosaic information from the first video information based on the second personal content obtained by the content generation service device by obtaining second personal content from a second user device About it.

Referring to the left side of FIG. 8, when the first user device or the second user device performs a touch, the second personal content is displayed on the first user device and the second user device while the mosaics 800 and 850 are released. I can. In addition, through an operation of touching the mosaic part 850 in the video received by the second user device, the first user device may check whether or not the video transmitted by the second user device has been received. If the second user device does not check the first video transmitted by the first user device, the second user device may request to check the video received by the second user device through an alarm signal such as periodic vibration.

In addition, the second video obtained by combining the first video and the second personal content transmitted from the first user device to the second user device may be set to be deleted when a predetermined time is set and the set time elapses. . For example, when transmitting the first video from the first user device, the data deletion time may be set to 30 seconds.

In this case, 30 seconds after the second user device checks the first video and synthesizes the second content to play the video, the second video to which the first video and the second content are combined may be deleted.

9 is a flowchart illustrating a method of transmitting and receiving moving image information in a plurality of user devices according to an embodiment of the present invention.

9 shows an operation performed to generate a video in the content creation service device.

Referring to FIG. 9, a template may be selected by the first user device (step S900).

The first user device may use a template previously downloaded from the content creation service device. Alternatively, the first user device may select a template for synthesizing personal content by searching a template pool in which the template is stored in the content creation service device. As described above, a hash tag is mapped to the template, and the template may be provided to the first user device by matching information input from the first user device with the hash tag of the template. A plurality of templates may be selected, and a plurality of templates may be arranged in order to generate a single video.

A first video is generated by combining the first personal content with the template information selected by the first user device (step S910).

As described above, the first personal content may be generated by being extracted from information registered or stored in advance in the first user device (eg, profile information of the first user device). Alternatively, the content creation service device may request separate first personal content from the first user device by determining personal content information requested from the template. The content generation service device may generate a first video by combining the first personal content and the template. As described above, information necessary for combining the first personal content to the template, such as location information for combining the first personal content to the template or size information of the first personal content, may be present. The content creation service device may generate a first video by combining the first personal content based on information necessary to combine the first personal content with the template. As described above, the operation of generating the first video may be performed in a first user device other than a content creation service device. For example, a first video may be generated by combining first personal content through a content generation application installed on the first user device.

If it is necessary to combine the second personal content with the first video, a portion corresponding to the second content in the first video may be generated as a specific display such as a mosaic display.

The first video is transmitted to the second user device (step S920).

The first video generated based on step S910 may be transmitted to the second user device.

In the first video transmitted to the second user device, a portion corresponding to the second personal content may be a specific display such as a mosaic display.

It may be determined whether or not second personal content is required (step S930).

It may be determined whether the second personal content is additionally required based on a template included in the first video by the content creation service device.

If the second personal content to be received from the second user device does not exist in the first video, the second user device may display the received first video as it is.

When second personal content to be received from the second user device exists in the first video, a second video may be generated by obtaining second personal content from the second user device (step S940).

The second personal content may be extracted from information registered or stored in advance in the second user device (eg, profile information of the second user device). Alternatively, the content creation service device may request second personal content from the second user device by determining personal content information requested from the template. The content generation service device may receive the second personal content information, and may generate a second video by combining the second personal content and the template. The operation of generating the second video by combining the second personal content and the template may be performed in the second user device. When a second video is generated, a portion covered by a mosaic may be displayed as second personal content.

The second personal content or the second video is transmitted to the first user device (step S950).

Information on the second personal content obtained from the second user device may be transmitted to the first user device to generate a second video, or the second video may be transmitted to the first user device. The first user device may acquire second video information in which second personal content is additionally combined with the previously generated first video.

As described above, when the time for deleting the first video or the second video is set in the first user device, the content creation service device may store data corresponding to the first video or the second video according to the setting of the first user device. You can also delete it.

The content creation service device may additionally receive a template generated by the user device and uploaded, and may classify the template into various categories based on a hash tag mapped to the template.

10 is a conceptual diagram illustrating a content creation service device for generating a video according to an embodiment of the present invention.

Referring to FIG. 10, the content creation service device includes a template storage unit 1000, a template classification unit 1010, a template search unit 1020, a personal content acquisition unit 1030, a video generation unit 1040, and a deletion time setting. A unit 1050, a communication unit 1060, and a processor 1070 may be included.

The content generation service device disclosed in FIG. 10 may perform the operation of the content generation service device described above in FIGS. 1 to 9. The operation of each component included in the content creation service device may perform, for example, the following operation.

The template storage unit 1000 may be a template pool in which various templates for synthesizing personal content are stored. The template may be classified and stored in the template storage unit 1000 based on hash tag information of the template. In addition, templates may be categorized and stored in the template storage unit 1000 based on hash tag information.

The template classification unit 1010 may be implemented to classify and store various templates. The template classifying unit 1010 may be implemented to classify a template based on hash tag information of a template newly registered in the content creation service device and store it in the template storage unit 1000.

The template search unit 1020 may be implemented to search for a template stored in the template storage unit 1000 based on template search information input by the user device. The template search unit 1020 may search for a template corresponding to the template search information input by the user device based on the hash tag and provide it to the user device.

The personal content acquisition unit 1030 may be implemented to acquire personal content according to a template. When the template is a template that requires the first personal content of the first user device and the second personal content of the second user device, implementation to obtain the first personal content and the second personal content from the first user device and the second user device Can be. The personal content acquisition unit 1030 may acquire personal content based on profile information of a user device that is previously stored or registered, or may obtain personal content by requesting separate personal content from the first user device and the second user device. .

The video generation unit 1040 may generate video information by combining the template selected by the user device and personal content obtained from each user device through the personal content acquisition unit 1030. The video generation unit 1040 may generate a video by displaying a mosaic on a portion to which personal content is to be combined with respect to a video in which personal content has not yet been combined. The moving picture generator 1040 may be implemented separately in the first user device and the second user device to generate a moving picture in the first user device and the second user device. The video generation unit functionally generates a first video generation unit that generates a video based on the first personal content received from the first user device and a second video generation unit that generates a video based on the second personal content received from the second user device It can be divided into wealth.

The communication unit 1060 may be implemented to transmit moving image information generated by the moving image generating unit 1040. In addition, it may be implemented to receive personal content from a user device.

In addition, the content generation service device further includes an alarm signal generator (not shown) to check the second video information when at least one of the first user device and the second user device does not check the second video. Alarm information for checking the second video may be generated with at least one user device that has not been performed.

The processor 1070 includes a template storage unit 1000, a template classification unit 1010, a template search unit 1020, a personal content acquisition unit 1030, a video generation unit 1040, a deletion time setting unit 1050, and a communication unit. It may be implemented to control the operation of 1060.

A method of generating a moving picture based on a plurality of user devices according to an embodiment of the present invention can be written in a computer program, and codes and code segments constituting a computer program can be easily inferred by a computer programmer in the field. have. In addition, the computer program is stored in a computer readable media, and is read and executed by a computer, a user device according to an embodiment of the present invention, and a content generation service device, thereby providing a video content generation service. Can be implemented.

Information storage media include magnetic recording media, optical recording media, and carrier wave media. According to an embodiment of the present invention, a content creation service device for generating a video based on a plurality of user devices, and a computer program for implementing a method for generating a video based on a plurality of user devices are stored in an internal memory such as a user device, and Can be installed. Alternatively, a content generation service device that generates a video based on a plurality of user devices according to an embodiment of the present invention, a smart card storing and installing a computer program that implements a method of creating a video based on a plurality of user devices, etc. The external memory of may be mounted on a user device or the like through an interface.

The above contents may be modified and modified without departing from the essential characteristics of the present invention by those of ordinary skill in the technical field to which the present invention belongs. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

The present invention obtains personal content from a plurality of user devices and combines it with a pre-stored template to allow a plurality of users to share a video created based on individual personal content, thereby generating and sharing various video content between a plurality of users. Make it possible. Personal content may be separately captured by the user device, but may be acquired by extracting an object from an image based on profile information previously stored in the user device, and thus personal content may be acquired without additional selection of the user device. In addition, in combining the personal content and the template, the personal content can be naturally combined with the template by mapping the location of the personal content to be combined with the personal content and the size of the personal content and using it to combine the personal content. In addition, it is possible to protect personal information included in the generated video by deleting the generated video within a set time.

100: user device 150: content creation service device
200: template pool 210: first category
220: second category 300: profile information
400: template 410: first image
420: second image 430: third image
610: first user device 620: second user device
1000: template storage unit 1010: template classification unit
1020: template search unit 1030: personal content acquisition unit
1040: video generation unit 1050: deletion time setting unit
1060: communication unit 1070: processor

Claims (12)

Receive information on a selection template selected to generate a first video from a first user device, obtain first personal content from the first user device based on the selection template, and select the first personal content A first moving picture generation unit for generating a first moving picture by combining with a template and transmitting the first moving picture to the first user device and the second user device;
Determine whether the selected template requires second personal content, if the second personal content is needed, obtain the second personal content from the second user device, and combine the second personal content with the first video A second moving picture generator configured to generate a second moving picture and transmit the second moving picture to the first user device and the second user device; And
A content creation service device for generating a video based on a plurality of user devices including a personal content acquisition unit acquiring the first personal content from the first user device and acquiring the second personal content from the second user device. delete The method of claim 1,
The first video is a content creation service device for generating a video based on a plurality of user devices, wherein the first video is a video generated by covering a portion corresponding to the second personal content with a specific pattern. The method of claim 3,
When the specific pattern is selected by the first user device and the second user device, the second video generation unit may generate the second personal content information of low-volume data so that the specific pattern is displayed as the second personal content. A content creation service device for generating a video based on a plurality of user devices, characterized in that first transmitting and additionally transmitting data of second personal content information other than the low-capacity data. delete delete The method of claim 1,
A template storage unit that stores a plurality of templates for combining the first personal content and the second personal content; And
By comparing the template search information received from the user device with a hash tag for identifying the contents of the plurality of templates mapped to the plurality of templates, a matching template matching the template search information is searched, and the matching template 1 A content creation service device for generating a moving picture based on a plurality of user devices, further comprising a template search unit that is transmitted to a user device and implemented so that the first user device can determine the selection template. delete delete delete delete delete

Images