KR102472801B1 - Distributed Multimedia editing System and Method - Google Patents

Abstract

A distributed multimedia editing system according to the present invention includes: a first camera control module for receiving first video source data obtained by capturing a performer's performance by controlling a first camera module through first camera pre-control data; a second camera control module for receiving second video source data obtained by capturing the performance of the performer by controlling the second camera module through second camera pre-control data; and a microphone module for generating recorded audio source data in which the performance of the performer is recorded; a studio control server including; a video source storage module for storing the first video source data and the second video source data; an audio source storage module configured to store background audio source data defined by the recorded audio source data and audio pre-control data; single real-time editing video data having a data size smaller than the sum of the data size of the first video source data and the data size of the second video source data based on the first video source data and the second video source data Real-time video editing module to create; and generating single real-time edited audio data having a data size smaller than the sum of the data sizes of the recording audio source data and the data sizes of the background audio source data based on the recording audio source data and the background audio source data. Audio editing module; Multimedia editing server comprising a; A data size of the first video source data and a data size of the second video source data based on the first video source data and the second video source data through video editing by accessing the multimedia editing server through a communication network a post-video editing terminal device generating a single post-editing video data having a data size smaller than the sum of and transmitting the post-editing video data to the multimedia editing server; and connects to the multimedia editing server through a communication network, and through audio editing, based on the recorded audio source data and the background audio source data, a data size of the recorded audio source data and a data size of the background audio source data are greater than the sum of the data sizes of the recorded audio source data and the background audio source data. and a post-audio editing terminal device generating a single post-editing audio data having a small data size and transmitting the post-editing audio data to the multimedia editing server, wherein the multimedia editing server sends the post-video editing terminal device to the post-video editing terminal device. Optional access right management for selectively granting access rights to source data and the second video source data, and selectively granting access rights to the recorded audio source data and background audio source data to the post-audio editing terminal device module; Selective editing data transmission for selectively transmitting the real-time edited audio data or the post-editing audio data to the post-video editing terminal device and selectively transmitting the real-time edited video data or the post-editing video data to the post-editing audio editing terminal device module; and a multimedia file generation module for generating single multimedia file data according to video editing applied to the post-edited video data and audio editing applied to the post-edited audio data.

Description

Distributed Multimedia Editing System and Method

The present invention relates to a distributed multimedia editing system and editing method, and to a distributed multimedia editing system and editing method capable of providing a multimedia production environment through systematic collaboration of a plurality of participants through a communication network.

It is common for video content to require a lot of effort and cost for shooting, editing, and distributing video content. Therefore, professionally generated content (PGC) produced by film studios, TV stations, and broadcasting content productions equipped with professional filming equipment, professional filming personnel, professional editing equipment, and professional filming and editing personnel was common. More specifically, in the PGC production process of movies and TV programs, the pre-production process that confirms the shooting concept such as content planning, scenario writing, shooting script production, production meeting, outdoor shooting, indoor shooting, and set shooting The content production process can be subdivided into the actual production process of shooting actual video through video editing, color correction, background compositing, and post-production that performs post-production such as audio editing. Each process requires a lot of professional manpower and specialized equipment. Of course, the realization of digital non-linear video editing using a computer effectively reduces the cost and manpower required for editing compared to the past analog linear video editing using film or video tape. However, due to the development of new video effects such as 3D modeling and image synthesis and the increase in audio channels included in multimedia files, a lot of cost and manpower are still required in the post-production process according to the development of video and audio technologies.

On the other hand, in video shooting, smartphones, tablet PCs, digital cameras, etc. that can shoot video have been disseminated, and a video editing application that enables basic video editing even by ordinary people without professional skills has been developed. A video sharing service for sharing with other users is provided over the Internet. As a result, UGC (User Generated Content), which is directly filmed, edited, and distributed by general users, is increasing, and the size of businesses in which general users generate profits from UGC distribution by adding advertisements to UGC is also increasing.

However, it is common for UGC not to use professional shooting equipment, and the image composition is sloppy due to the photographer's lack of shooting skills, the image is unstable, and the subject is not highlighted due to inappropriate lighting. In addition, there are many cases in which monotonous images of a single angle are continuously continuously tediously due to non-professional editing techniques or post-production processes such as video editing. In other words, due to unprofessional filming and unprofessional editing, the image quality of UGC is generally inferior to that of PGC.

However, in an environment where a large number of UGCs are produced competitively and existing PGC providers also supply content through video sharing services such as YouTube, content consumers have higher standards for content selection, so UGC also requires high video quality. do. Furthermore, with the development of communication technology, the resolution of the video that broadband Internet service can provide increases, and the quality of the display of content users increases with the development of display technology, so high-quality UGC that can appeal to general content consumers. production is required.

In order to produce high-quality video contents, a method of filming with professional photographers and studio equipment equipped with professional lighting, cameras, sound equipment, etc., and editing with professional editing equipment and professional editors is the same as conventional PGC production. can be considered. However, unlike PGC, which has high expected profits through distribution through movie theaters and TV programs and sales of content copyrights, UGC has low expected profits except for very exceptional cases, so it is not feasible to invest a lot of money to produce UGC. there is no problem

Next, by implementing automated studio equipment such as camera control, lighting control, and sound control that minimizes the number of shooting personnel, and allowing many UGC producers to utilize the automated studio equipment, appropriate shooting lighting while minimizing the cost of UGC shooting It is possible to produce video contents with stable camera work under Walt Disney Productions' US Patent No. 4,283,766 "Automatic Camera Control for Creating Special Effects in Motion Picture Photography" discloses a camera control system that automatically controls the shooting position of a camera according to a predefined control command. This automated camera control system has the advantage of being able to take relatively high-quality images at low cost because a number of users can share the same camera control system without requiring professional photographers. However, this applies only to the pre-production process and the actual production process, and there is no problem without considering the post-production process such as post-editing, which greatly affects the quality of video content. have. Furthermore, in a multi-camera production environment composed of two or more cameras, there is a problem in that a method of generating a single multimedia file by editing video source data produced by each camera cannot be disclosed.

U.S. Patent No. 6,392,694 “Method and Apparatus for an automatic Camera Selection System” by Telcordia Technologies, Inc and U.S. Patent No. 7,349,008 “Automated Camera Management System and Method for Capturing Presentations Using Videography Rules” by Microsoft Corporation are An automated camera selection system for filming of a presentation is disclosed. According to this system, since the system automatically selects images and creates multimedia files according to predefined video rules in a multi-camera production environment, the pre-production process, the actual production process, and the post-production process It has the advantage of securing appropriate image quality while reducing the cost required for producing video contents by automating the production process. However, as described in the prior art, such an automatic editing system is suitable for information delivery type video contents such as video lecture contents consisting of a fixed shooting format, but dynamic entertainment video contents such as music videos recording performances of users such as singing. There are limitations to its application. Due to its nature, it is important to maintain the interest of viewers through various dynamic editing methods for entertainment video content. Monotonous and mechanical automated editing according to preset editing rules can produce high-quality video content with sensuous editing. There are problems that are difficult to produce. In addition, in the case of entertainment contents, audio editing such as editing of background music composed of various musical instruments as well as video and adding sound effects such as reverb, delay, and pitch shifting is important. The prior art has limitations in not considering audio editing.

In particular, in order to overcome the limitations of automatic editing in entertainment contents, etc., creative video editing and audio editing through editing experts are required in the post-production process. However, as described above, the method of regularly maintaining editorial experts has a problem of increasing content production costs. In order to solve this problem, a distributed editing system has been proposed in which a general user with editing skills accesses and edits through a communication network.

Japanese Registered Patent No. 5111422 of NIPPON HOSO KYOKAI, "Contents Creation System and Contents Creation Program," discloses a distributed production system for video contents composed of 3D animations. According to this distributed production system, there is an advantage in that a production work for one video content can be divided and a plurality of terminals can divide and perform the production work. However, this distributed production system is applied to a content production environment based on 3D animation, and is a system that distributes TVML program commands that define the acting of virtual characters and program commands that define the virtual camera viewpoint that shows the acting of virtual characters in quantitative terms. As a distributed editing system for the pre-production process, which does not have a post-production process due to the nature of 3D animation, it consists of 3D animation rather than video editing or audio editing based on live action images There is a limitation that can be applied only to program editing that can be performed.

MEGA CHIPS CORP's Japanese Registered Patent No. 5152458 “Content Base, Communication System” discloses a content production system in which several participants participate. According to this system, there is an advantage in that a single content can be created through the participation of several users through a communication network. However, in the system according to the present art, a plurality of users provide their own content according to scenario data through a communication network to produce content according to scenario data, and an editorial expert through a communication network in a post-production process. There is a limit that is not considered for improving the quality of video contents by participating.

EYESPOT CORPORATION's US Patent Publication No. 2009-0196570 “System and Methods for Online Collaborative Video Creation” discloses a distributed editing system in a post-production process through a communication network. According to this system, there is an advantage in that a user with editing skills can reduce the effort and cost required for editing by editing video content through a communication network. However, the distributed editing system according to the prior art has a problem in that, first, only a post-production process is considered as editing for video contents that have already been filmed. For example, when the quality of video itself is degraded due to inexperienced shooting, there is a limit to improving the quality of video contents only by post-editing. Meanwhile, video content includes visual video data and auditory audio data, and although video editing and audio editing belong to different specialized areas, the cited invention simply edits video content through a communication network. By disclosing only the video editing terminal device and the audio editing terminal device, there is a limit that does not consider the problem of efficient data transmission and distribution of data access rights.

US 4283766 A US 6392694 B1 US 7349008 B2 JP 5111422 B2 JP 5152458 B2 US 2009-0196570 A1

The present invention is to solve the above problems, and the distributed multimedia editing system and editing method according to the present invention, through camera pre-control data and audio pre-control data, pre-production process, video source data and The actual production process of receiving audio source data, and the post-production process of producing real-time edited video data, real-time edited audio data, post-edited video data, and post-edited audio data are performed through a single system. By doing so, it aims to reduce the production cost and production time of multimedia contents, and to increase production efficiency and contents quality.

The distributed multimedia editing system and editing method according to the present invention preferentially generate real-time edited video data through video source data and provide it to a post-audio editing terminal device, so that the post-video editing terminal device can perform post-video editing even before post-video editing. The editing terminal device refers to the real-time editing video data to edit audio synchronized with it, and generates real-time editing audio data preferentially through audio source data and provides it to the post-video editing terminal device, thereby improving the quality of the post-audio editing terminal device. Another object is to allow a post-video editing terminal device to refer to real-time edited audio data and edit video synchronized therewith even before post-audio editing work.

Distributed multimedia editing system and editing method according to the present invention, a multimedia editing server allows a post-video editing terminal device to selectively access video source data, and a post-audio editing terminal device to selectively access source audio data. By including an optional access right management module to prevent arbitrary audio editing and audio source data access by post-video editing terminal devices, and by preventing arbitrary video editing and video source data access by post-audio editing terminal devices, communication network Another purpose is to provide systematic data management in a distributed editing environment through

Distributed multimedia editing system and editing method according to the present invention provides real-time edited audio data or post-edited audio data having a smaller size than audio source data to a post-video editing terminal device responsible for post-video editing, and post-editing audio data. Editing terminal devices are provided with real-time editing audio data or post-editing audio data having a smaller size than video source data, so that they can participate in distributed editing even when the storage capacity and processor performance of terminal devices connected through a communication network are poor, Another object of the present invention is to reduce the burden of computational processing on a multimedia editing server by minimizing the amount of data transmission to a terminal device.

Distributed multimedia editing system and editing method according to an embodiment of the present invention further generates camera pre-control data through a post-video editing terminal device or further generates audio pre-control data through a post-audio editing terminal device, Another purpose is to streamline the production of multimedia contents by distributing not only the post-production process but also the pre-production stage through a communication network.

Distributed multimedia editing system and editing method according to an embodiment of the present invention further includes background video data in video source data generated by cameras to generate real-time edited video data, thereby performing editing operations such as chroma key synthesis. As well as performing in real time, the post-audio editing terminal device refers to real-time edited video data in which a background is synthesized to be similar to the final result, and post-edits audio that matches the video for another purpose.

Distributed multimedia editing system and editing method according to an embodiment of the present invention, when a creation event and a modification event of post-editing data by a post-video editing terminal device or a post-audio editing terminal device occur in a multimedia editing server through a communication network. Another object is to further include a data change notification module for notifying other post-editing terminal devices so that a plurality of post-editing terminal devices connected through a communication network can quickly grasp changes in an editing collaboration process.

Distributed multimedia editing system and editing method according to an embodiment of the present invention, the multimedia editing server further includes an editing task distribution module capable of temporally allocating the editing order of the post-video editing terminal device and the post-audio editing terminal device. Another purpose is to improve the efficiency of multimedia editing work by designating the editing order among post-editing terminal devices that perform editing work distributed over a communication network.

Finally, in the distributed multimedia editing system and editing method according to an embodiment of the present invention, the multimedia editing server changes high-quality video source data captured by cameras into smaller-capacity proxy media in post-video editing. Another object is to reduce the amount of data transmission and reduce the computational burden required for editing post-video source data by providing it to a video editing terminal device.

In order to achieve the above object, the distributed multimedia editing system according to the present invention includes a first camera that receives first video source data of a performer's performance by controlling a first camera module through first camera pre-control data. control module; a second camera control module for receiving second video source data obtained by capturing the performance of the performer by controlling the second camera module through second camera pre-control data; and a microphone module for generating recorded audio source data in which the performance of the performer is recorded; a studio control server including; a video source storage module for storing the first video source data and the second video source data; an audio source storage module configured to store background audio source data defined by the recorded audio source data and audio pre-control data; single real-time editing video data having a data size smaller than the sum of the data size of the first video source data and the data size of the second video source data based on the first video source data and the second video source data Real-time video editing module to create; and generating single real-time edited audio data having a data size smaller than the sum of the data sizes of the recording audio source data and the data sizes of the background audio source data based on the recording audio source data and the background audio source data. Audio editing module; Multimedia editing server comprising a; A data size of the first video source data and a data size of the second video source data based on the first video source data and the second video source data through video editing by accessing the multimedia editing server through a communication network a post-video editing terminal device generating a single post-editing video data having a data size smaller than the sum of and transmitting the post-editing video data to the multimedia editing server; and connects to the multimedia editing server through a communication network, and through audio editing, based on the recorded audio source data and the background audio source data, a data size of the recorded audio source data and a data size of the background audio source data are greater than the sum of the data sizes of the recorded audio source data and the background audio source data. and a post-audio editing terminal device generating a single post-editing audio data having a small data size and transmitting the post-editing audio data to the multimedia editing server, wherein the multimedia editing server sends the post-video editing terminal device to the post-video editing terminal device. Optional access right management for selectively granting access rights to source data and the second video source data, and selectively granting access rights to the recorded audio source data and background audio source data to the post-audio editing terminal device module; Selective editing data transmission for selectively transmitting the real-time edited audio data or the post-editing audio data to the post-video editing terminal device and selectively transmitting the real-time edited video data or the post-editing video data to the post-editing audio editing terminal device module; and a multimedia file generation module for generating single multimedia file data according to video editing applied to the post-edited video data and audio editing applied to the post-edited audio data.

In the distributed multimedia editing system according to an embodiment of the present invention, the post-video editing terminal device may further generate the first camera pre-control data.

In the distributed multimedia editing system according to an embodiment of the present invention, the post-audio editing terminal device is characterized in that it further generates the audio pre-control data.

In the distributed multimedia editing system according to an embodiment of the present invention, the real-time video editing module is defined by the object image of the performer and video pre-control data of the first video source data and the second video source data. It is characterized in that the real-time video editing data is generated by synthesizing the first background video source data.

In the distributed multimedia editing system according to an embodiment of the present invention, the post-video editing terminal device generates the object image of the performer and the second background video source data of the first video source data and the second video source data. It is characterized in that the post-editing video data is generated by synthesis.

In the distributed multimedia editing system according to an embodiment of the present invention, the multimedia editing server may perform the post-editing video data creation event or post-editing video data modification event in the post-editing terminal device. A data change notification module that notifies the audio editing terminal device and, when the post-editing audio data generation event or the post-editing audio data modification event occurs in the post-editing audio editing terminal device, notifies the post-video editing terminal device thereof. It is characterized in that it further includes;

In the distributed multimedia editing system according to an embodiment of the present invention, the multimedia editing server operates the post-editing audio editing terminal device only when an event of generating the post-editing video data by the post-video editing terminal device occurs. It is characterized in that it further includes; an editing work distribution module for controlling generation of post-editing audio data.

In the distributed multimedia editing system according to an embodiment of the present invention, the post-editing video data terminal device uses proxy media of the first video source data and proxy media of the second video source data to edit the post-editing video data. It is characterized by generating.

A distributed multimedia editing method according to the present invention includes the steps of receiving, by a studio control server, first video source data obtained by capturing a performer's performance by controlling a first camera module through first camera pre-control data; receiving, by the studio control server, second video source data obtained by capturing the performance of the performer by controlling a second camera module through second camera pre-control data; receiving, by the studio control server, recorded audio source data obtained by recording the performance of the performer through a microphone module; storing, by a multimedia editing server, the first video source data and the second video source data; storing, by the multimedia editing server, background audio source data defined by the recorded audio source data and audio pre-control data; The multimedia editing server, based on the first video source data and the second video source data, a single data size having a data size smaller than the sum of the data size of the first video source data and the data size of the second video source data generating real-time editing video data of; wherein the multimedia editing server has a data size smaller than the sum of the data size of the recorded audio source data and the data size of the background audio source data, based on the recorded audio source data and the background audio source data; generating data; The multimedia editing server selectively grants access rights to the first video source data and the second video source data to the post-video editing terminal device, and allows the post-audio editing terminal device to access the recorded audio source data and the selectively granting access to background audio source data; selectively transmitting, by the multimedia editing server, the real-time edited audio data to the post-video editing terminal device, and selectively transmitting the real-time edited video data to the post-audio editing terminal device; The post-video editing terminal device accesses the multimedia editing server through a communication network, and determines the data size of the first video source data and the data size of the first video source data based on the first video source data and the second video source data through video editing. generating single post-editing video data having a data size smaller than the sum of data sizes of second video source data and transmitting the data to the multimedia editing server; The post-audio editing terminal device accesses the multimedia editing server through a communication network, and the data size of the recorded audio source data and the background audio source data are based on the recorded audio source data and the background audio source data through audio editing. generating and transmitting single post-editing audio data having a data size smaller than the sum of the data sizes of data to the multimedia editing server; and generating, by the multimedia editing server, single multimedia file data according to video editing applied to the post-edited video data and audio editing applied to the post-edited audio data.

The distributed multimedia editing method according to an embodiment of the present invention further includes generating the first camera pre-control data by the post-video editing terminal device before receiving the first video source data. It is characterized by doing.

The distributed multimedia editing method according to an embodiment of the present invention further comprises, before the step of receiving the recorded audio source data, the post-audio editing terminal device generating the audio pre-control data. to be

In the distributed multimedia editing method according to an embodiment of the present invention, the generating of the real-time video editing data may include, in the multimedia editing server, the performer's object of the first video source data and the second video source data and generating the real-time video editing data by synthesizing first background video source data defined by video and video pre-control data.

In the distributed multimedia editing method according to an embodiment of the present invention, the generating of the post-editing video data may include, in the post-editing video editing terminal device, the performer of the first video source data and the second video source data It is characterized in that the post-edited video data is generated by synthesizing the object image of and the second background video source data.

In the distributed multimedia editing method according to an embodiment of the present invention, when the multimedia editing server generates the post-edited video data or the post-edited video data modification event in the post-video editing terminal device, the post-edited video data is generated. notifying the audio editing terminal device and notifying the post-editing audio data generation event or post-editing audio data modification event to the post-editing audio data terminal device when the post-editing audio data generation event occurs in the post-editing audio editing terminal device; It is characterized by including.

In the distributed multimedia editing method according to an embodiment of the present invention, the generating of the post-editing audio data may include the post-editing audio data only when an event of generating the post-editing video data occurs by the post-video editing terminal device. It is characterized in that the editing terminal device generates the post-editing audio data.

In the distributed multimedia editing method according to an embodiment of the present invention, the generating of the post-editing video data may include the post-editing video editing terminal device using proxy media of the first video source data and the second video source data It is characterized in that the post-editing video data is generated using proxy media of.

According to the above configuration, the distributed multimedia editing system and editing method according to the present invention receive a pre-production process, video source data and audio source data through camera pre-control data and audio pre-control data. Production process, real-time edited video data, real-time edited audio data, post-production process that produces post-edited video data, and post-edited audio data are performed through a single system to reduce the cost and production of multimedia contents. It reduces the required time and provides an effect of increasing production efficiency and content quality.

The distributed multimedia editing system and editing method according to the present invention preferentially generate real-time edited video data through video source data and provide it to a post-audio editing terminal device, so that the post-video editing terminal device can perform post-video editing even before post-video editing. The editing terminal device refers to the real-time editing video data to edit audio synchronized with it, and generates real-time editing audio data preferentially through audio source data and provides it to the post-video editing terminal device, thereby improving the quality of the post-audio editing terminal device. Even before post-audio editing, post-video editing terminal devices refer to real-time editing audio data and provide an effect of editing synchronized video with it.

Distributed multimedia editing system and editing method according to the present invention, a multimedia editing server allows a post-video editing terminal device to selectively access video source data, and a post-audio editing terminal device to selectively access source audio data. By including an optional access right management module to prevent arbitrary audio editing and audio source data access by post-video editing terminal devices, and by preventing arbitrary video editing and video source data access by post-audio editing terminal devices, communication network Provides the effect of providing systematic data management in a distributed editing environment through

Distributed multimedia editing system and editing method according to the present invention provides real-time edited audio data or post-edited audio data having a smaller size than audio source data to a post-video editing terminal device responsible for post-video editing, and post-editing audio data. Editing terminal devices are provided with real-time editing audio data or post-editing audio data having a smaller size than video source data, so that they can participate in distributed editing even when the storage capacity and processor performance of terminal devices connected through a communication network are poor, By minimizing the amount of data transmission to the terminal device, it provides an effect of reducing the computational processing burden of the multimedia editing server.

Distributed multimedia editing system and editing method according to an embodiment of the present invention further generates camera pre-control data through a post-video editing terminal device or further generates audio pre-control data through a post-audio editing terminal device, It provides the effect of streamlining the production of multimedia contents by distributing not only the post-production process but also the pre-production step through a communication network.

Distributed multimedia editing system and editing method according to an embodiment of the present invention further includes background video data in video source data generated by cameras to generate real-time edited video data, thereby performing editing operations such as chroma key synthesis. At the same time as performing in real time, the post-audio editing terminal device refers to the real-time edited video data in which the background is synthesized to be similar to the final result, and provides an effect of post-editing the audio that matches the video.

Distributed multimedia editing system and editing method according to an embodiment of the present invention, when a creation event and a modification event of post-editing data by a post-video editing terminal device or a post-audio editing terminal device occur in a multimedia editing server through a communication network. By further including a data change notification module for notifying other post-editing terminal devices, an effect of enabling a plurality of post-editing terminal devices connected through a communication network to quickly grasp changes in an editing collaboration process is provided.

Distributed multimedia editing system and editing method according to an embodiment of the present invention, the multimedia editing server further includes an editing task distribution module capable of temporally allocating the editing order of the post-video editing terminal device and the post-audio editing terminal device. , It provides the effect of improving the efficiency of multimedia editing work by specifying the editing order among post-editing terminal devices that are distributed through the communication network and perform editing work.

Finally, in the distributed multimedia editing system and editing method according to an embodiment of the present invention, the multimedia editing server changes high-quality video source data captured by cameras into smaller-capacity proxy media in post-video editing. By providing it to the video editing terminal device, it provides an effect of reducing the amount of data transmission and reducing the computational burden required for editing post-video source data.

1 is a configuration diagram showing a distributed multimedia editing system according to an embodiment of the present invention;
2 is an exemplary view showing the configuration of studio devices according to an embodiment of the present invention.
3 is an exemplary view of an editing interface of first camera pre-control data according to an embodiment of the present invention;
4 is an exemplary configuration diagram of a studio control server according to an embodiment of the present invention.
5 is an exemplary view of an editing interface of lighting pre-control data according to an embodiment of the present invention;
6 is an exemplary diagram of an editing interface of audio pre-control data according to an embodiment of the present invention;
Fig. 7 is an exemplary diagram of an editing interface of video pre-control data specifying a first background video source data according to an embodiment of the present invention;
8 is an exemplary view of a video editing interface in a post-video editing terminal device according to an embodiment of the present invention;
9 is an exemplary view of an audio editing interface in a post-audio editing terminal device according to an embodiment of the present invention;
10 is a process flow diagram illustrating a distributed multimedia editing method according to an embodiment of the present invention.

The terms or words used in this specification and claims should not be construed as limited in their usual or dictionary meanings, and based on the principle that the inventors can define terms and concepts in order to best describe their inventions. It should be interpreted as meaning and concept consistent with the technical idea of the present invention.

Therefore, the embodiments described in this specification and the configurations shown in the drawings correspond to a preferred embodiment of the present invention, and do not represent all the technical ideas of the present invention, so that the corresponding configurations are various to replace them at the time of filing of the present invention. There may be equivalents and variations.

Throughout the specification, the description that a certain part "includes" a certain component means that it may further include other components, not excluding other components unless otherwise specified. In addition, terms such as “..module”, “..unit”, and “..system” described in the specification mean a unit that processes at least one function or operation, which is hardware or software, or a combination of hardware and software. It can be implemented and included in one device or each other device.

Among the terms used in the present invention, “multimedia file data” refers to video data in which visual information (video data) that changes during a playback period and auditory information (audio data) that changes during a playback period are synchronously combined. “Video data” refers to data composed only of visual information that changes during a playback section, and “audio data” refers to data composed only of auditory information that changes during a play section.

1 illustrates a distributed multimedia editing system according to an embodiment of the present invention. The distributed multimedia editing system of the present invention includes a studio control server 100, a multimedia editing server 200, a post video editing terminal device 300, and a post audio editing terminal device 400.

The studio control server 100 performs a function of controlling studio equipment including the camera modules 111 and 121 and the microphone module 130, and includes a first camera control module 110, a second camera control module 120, and a microphone module 130. 2 shows an example of a studio in which studio equipment is installed. A studio may be composed of, for example, a space for shooting, stage props, shooting equipment such as a camera and a microphone, and additional equipment such as lighting and a monitor. The studio is preferably configured to provide an environment optimized for video recording, and does not necessarily have to be an enclosed space. The shooting background of the studio may be changed according to the type of multimedia content to be photographed, and when the background is synthesized through chroma key synthesis, a single color background such as green or blue may be used.

The first camera control module 110 controls the first camera module 111 through first camera pre-control data (data_control_pre_camera_1) to perform a function of receiving first video source data (data_video_source_1) in which a performer's performance is captured. do. The second camera control module 120 controls the second camera module 121 through second camera pre-control data (data_control_pre_camera_2) to perform a function of receiving second video source data (data_video_source_2) in which a performer's performance is captured. do.

The camera modules 111 and 121 may be video recording capable camcorders, broadcasting cameras, and smartphone camera modules, and the camera control modules 110 and 120 may control the camera's shooting start or the camera's zoom function. In addition, it is preferable to control camera panning, camera tilt, and camera position movement by a mechanical camera mounting device.

In order to improve the quality of multimedia contents, it is desirable to shoot the camera module in a stable fixed state. It is desirable to do The method of measuring the depth of an image is a multi-camera method commercialized through Microsoft's Kinnect and Intel's RealSense Camera, a Time-of-Flight (ToF) method, or an infrared pattern recognition method, or a Micro Lens Array commercialized by Lytro. Light Field method through can be exemplified. Through this technique of measuring the depth of a subject, it is possible to easily separate the background from the foreground without a chroma key background and synthesize the foreground image captured through the camera modules 111 and 121 and the prepared background image.

In addition, the dynamics and quality of a video can be improved by editing a subject by changing the camera point of view appropriately after photographing one subject through multiple cameras. To this end, the distributed multimedia editing system according to the present invention is configured to include at least two camera modules 111 and 121. Depending on the embodiment, it may be configured with three or more camera modules. In the present invention, since a plurality of video source data for a single subject is generated through at least two camera modules 111 and 121, video editing is necessarily required.

Unlike the plurality of camera modules 111 and 121 installed in different locations, the first camera control module 110 and the second camera control module 120 controlling the camera modules 111 and 121 may be implemented as a single control device. can

The first camera pre-control data (data_control_pre_camera_1) and the second camera pre-control data (data_control_pre_camera_2) are each composed of a set of control signals defining the operation of the camera module at the time of capturing. 3 illustrates an editing screen for generating first camera pre-control data (data_control_pre_camera_1). As an example, if you define X-axis movement, Y-axis movement, zoom, pan, tilt, etc. of the camera at a specific shooting point through an application or web browser, the 3D modeled subject is configured to render what it looks like on the screen. It can be configured so that the results can be predicted in advance. As shown in FIG. 3 , editing of such camera pre-control data is preferably configured so that even a non-expert user can easily edit through a screen composed of an intuitive user interface.

The first camera pre-control data (data_control_pre_camera_1) and the second camera pre-control data (data_control_pre_camera_2) are connected to the studio control server 100 or the multimedia editing server 200 through a communication network, for example, a multimedia file production requester's terminal device or post-video It can be configured to be edited by the editing terminal device 300 . In addition, depending on the embodiment, the first camera pre-control data (data_control_pre_camera_1) and the second camera pre-control data (data_control_pre_camera_2) used in the creation of other multimedia files with similar characteristics are used as they are or modified to use them to create a new multimedia file. As a result, it is possible to reduce the effort and cost required to create a multimedia file.

Since the first video source data (data_video_source_1) and the second video source data (data_video_source_2) are original captured data, they are generated in high resolution to support various resolutions, and are compressed using a non-compression method or a low compression rate to prevent loss of image quality. It is preferable to create in this way.

The microphone module 130 performs a function of generating recorded audio source data (data_audio_source_recording) in which a performer's performance is recorded. The microphone module 130 may be a professional microphone capable of recording sound or voice, a microphone module 130 added to a camcorder or broadcasting camera, or a microphone module 130 of a smartphone. In addition, a plurality of microphone modules 130 may be used to reproduce stereoscopic sound from a multimedia file. In this case, a plurality of recorded audio source data (data_audio_source_recording) is generated.

4 shows an example of the configuration of the studio control server 100. As shown, the studio control server 100 may further include a lighting module and a lighting control module for controlling flickering of the light source, brightness of the light source, color of the light source, color temperature of the light source, or direction of the light source according to the embodiment. have. 5 illustrates an editing screen for generating lighting pre-control data (data_control_pre_lighting) according to an embodiment of the present invention. The lighting control module is configured to control the lighting module through lighting pre-control data (data_control_pre_lighting), and the lighting pre-control data (data_control_pre_lighting) may be configured to set lighting of the lighting module for each shooting time.

The multimedia editing server 200 includes a video source storage module 210, an audio source storage module 211, a real-time audio editing module 221, an optional access rights management module 230, an optional editing data transmission module 240, and It is configured to include a multimedia file creation module 250.

The multimedia editing server 200 generates multimedia file data (data_multimedia_file) by using the first video source data (data_video_source_1), the second video source data (data_video_source_2), and the recorded audio source data (data_audio_source_recording) generated by the studio control server 100. performs the function of generating The multimedia editing server 200 may be configured to be physically separated from the studio control server 100 and connected through a communication network, or may be configured as a single server.

The video source storage module 210 performs a function of storing first video source data (data_video_source_1) and second video source data (data_video_source_2) together.

The audio source storage module 211 performs a function of storing background audio source data (data_audio_source_BG) defined by recorded audio source data (data_audio_source_recording) and audio pre-control data (data_control_pre_audio).

The audio pre-control data (data_control_pre_audio) may be predefined additional audio data or sound effects. The audio pre-control data (data_control_pre_audio) is data specifying sound effects, background sounds, etc. to be included in multimedia in advance before filming, and functions as data for setting audio editing in advance in a pre-production stage. The audio pre-control data (data_control_pre_audio) may include sound source data for background music and sound source data for effect sounds, or may include sound source data storage location information such as URL information for the corresponding sound source data. In addition, in the case of a sound effect added to a specific reproduction point of a specific multimedia file, timestamp information, which is reproduction time information at which the corresponding sound effect is to be reproduced, may be further included. The audio pre-control data (data_control_pre_audio) may further include equalizer parameter information using a digital sound filter or sound effect parameter information. The sound effect may include, for example, a reverb effect (reverb), an echo effect (delay), a chorus chorus effect (harmony), a homophonic choral effect (doubler), and a mechanical sound modulation effect (hard tune). The background audio source data (data_audio_source_BG) may be background music included in multimedia content or data of accompaniment music in the case of music video content.

6 illustrates a screen for editing audio pre-control data (data_control_pre_audio). The audio pre-control data (data_control_pre_audio) may be created by a multimedia content producer, an audio editing expert, or an ordinary person talented in audio editing, and may be edited in advance by the audio editing terminal device 400 after the fact. As illustrated in FIG. 6 , audio pre-control data (data_control_pre_audio) may be created and edited through an application or a web browser.

The real-time video editing module 220 determines the data size of the first video source data (data_video_source_1) and the data of the second video source data (data_video_source_2) based on the first video source data (data_video_source_1) and the second video source data (data_video_source_2). It performs a function of generating single real-time edited video data (data_video_edited_RT) having a data size smaller than the sum of the sizes. The real-time video editing module 220 automatically performs video editing according to given editing rules without relying on video editing personnel. The real-time video editing module 220 may automatically perform real-time video editing in various ways according to embodiments. For example, the real-time video editing module 220 may simply edit the real-time edited video data (data_video_edited_RT) for reference in audio editing in the post-audio editing terminal device 400 or may edit with a quality close to the final result. have. For example, when producing for audio editing reference, real-time edited video data (data_video_edited_RT) may be generated with only the first video source data (data_video_source_1), and the first video source data (data_video_source_1) and the second video source data (data_video_source_2) are displayed on the screen. Real-time edited video data (data_video_edited_RT) may be generated to be divided into and simultaneously displayed, or real-time edited video data (data_video_edited_RT) may be generated so that a camera is switched at an arbitrary point in time. If you want to automatically edit with a quality close to the final result, you can set the camera transition point in advance through video pre-control data (data_control_pre_video), and designate the background screen and composite object to be synthesized in advance with the video.

According to the embodiment of automatically synthesizing the background screen, the real-time video editing module 220 is performed on the performer object image of the first video source data (data_video_source_1) and the second video source data (data_video_source_2) and the video pre-control data (data_control_pre_video). The first background video source data (data_video_source_BG_1) defined by is synthesized to generate real-time video editing data. 7 illustrates an interface for editing video pre-control data (data_control_pre_video) by specifying a first background video source data (data_video_source_BG_1). According to this embodiment, by adding the first background video source data (data_video_source_BG_1) designated in advance according to the generation of video source data, an effect of reducing time and cost required for video editing is provided. Similar to the aforementioned audio pre-control data (data_control_pre_audio), the video pre-control data (data_control_pre_video) may be composed of data that pre-defines subtitle information, image filter information, color correction information, etc., and includes the first background video source data. (data_video_source_BG_1) or storage location information such as URL information for the first background video source data (data_video_source_BG_1). Depending on the embodiment, the first background video source data (data_video_source_BG_1) is implemented as a virtual background modeled in three dimensions rather than a flat image, and is displayed in a camera view according to the shooting position of the camera modules 111 and 121 or the movement of the camera modules 111 and 121. It may be adaptively rendered and combined with the first video source data (data_video_source_1) and the second video source data (data_video_source_2).

Real-time edited video data (data_video_edited_RT) consists of video files that can be played through software such as a video player. It is not a video file that is directly edited, but a reference video file that is used as a reference for audio editing in post-audio editing, so it is the original video data. It is created as a single file separately from the first video source data (data_video_source_1) and the second video source data (data_video_source_2). In addition, it is desirable to generate real-time edited video data (data_video_edited_RT) by resizing to a small screen size to have as small a data size as possible, changing the resolution to a low resolution, and compressing and storing with a high compression rate. In addition, the resolution of the real-time edited video data (data_video_edited_RT) may be adaptively changed according to the network environment, calculation processing capability, remaining storage space, etc. of the post-audio editing terminal device 400 . However, in any case, the data size of the real-time edited video data (data_video_edited_RT) does not exceed the sum of the data size of the first video source data (data_video_source_1) and the data size of the second video source data (data_video_source_2), so that the post-audio editing terminal device ( 400), it is possible to prevent transmission of excessively large video data during audio editing, and to reduce unnecessary computational burden due to video data during audio editing.

Based on the recorded audio source data (data_audio_source_recording) and the background audio source data (data_audio_source_BG), the real-time audio editing module 221 is configured to exceed the sum of the data size of the recorded audio source data (data_audio_source_recording) and the data size of the background audio source data (data_audio_source_BG). It performs a function of generating single real-time edited audio data (data_audio_edited_RT) with a small data size. The real-time audio editing module 221 automatically performs audio editing according to given editing rules without relying on audio editing personnel. The real-time audio editing module 221 may automatically perform audio editing in various ways according to embodiments. For example, the real-time audio editing module 221 may simply edit the real-time edited audio data (data_audio_edited_RT) for reference in video editing in the post-video editing terminal device 300 or may edit with a quality close to the final result. . For example, when producing for video editing reference, recording audio source data (data_audio_source_recording) and background audio source data (data_audio_source_BG) can be simply mixed to generate real-time edited audio data (data_audio_edited_RT), and the aforementioned audio pre-control data (data_control_pre_audio) High-quality real-time edited audio data (data_audio_edited_RT) can be generated by adding the sound effects or sound effects defined in [0080] to the recorded audio source data (data_audio_source_recording) or the background audio source data (data_audio_source_BG).

It is preferable to generate the real-time edited audio data (data_audio_edited_RT) by a method such as compression and storage with a high compression rate so as to have a data size as small as possible. Through this, it is possible to prevent transmission of excessively large audio data during video editing of the post-video editing terminal device 300 and reduce unnecessary computational burden due to excessive audio data during video editing.

Real-time edited video data (data_video_edited_RT) and real-time edited audio data (data_audio_edited_RT) are first video source data (data_video_source_1), second video source data (data_video_source_2), and recorded audio source data (data_audio_source_recording) generated through professional studio equipment. Since it is generated based on the UGC and generated through an automated editing process according to predefined editing rules, it has an effect of having a higher quality than the UGC that general users produce on their own. Nevertheless, it is necessary to produce higher quality multimedia files through video editing and audio editing by professional editors. To this end, in the present invention, video editing and audio editing are further performed post-processing through a communication network so that high-quality multimedia contents can be efficiently generated. Real-time edited audio data (data_audio_edited_RT) and real-time edited video data (data_video_edited_RT) are input when first video source data (data_video_source_1), second video source data (data_video_source_2), and recorded audio source data (data_audio_source_recording) generated by shooting are input. Configure to start generating real-time edited video data (data_video_edited_RT) and real-time edited audio data (data_audio_edited_RT).

Depending on embodiments, the distributed multimedia editing system of the present invention may further include a multimedia content server that uploads generated multimedia content and provides it to general users. At this time, the multimedia content server is configured to provide the multimedia content by further including the identification information of the user in charge of video editing and the identification information of the user in charge of audio editing of the multimedia content, and the user who has viewed the multimedia content is himself/herself. When creating new multimedia contents, through the identification information of the user participating in the editing work, the user can be configured to request video editing or audio editing of the multimedia contents production to the corresponding user through the communication network. Through this, general users with talent in video editing or audio editing can be configured to participate in multimedia content editing. According to this embodiment, it is possible for general users to voluntarily build a multimedia content production environment, and provides an effect of matching a new requester and editor again through multimedia content, which is an edited result.

The post-video editing terminal device 300 accesses the multimedia editing server 200 through a communication network, and generates first video source data (data_video_source_1) based on the first video source data (data_video_source_1) and the second video source data (data_video_source_2). Performs a function of generating single post-edited video data (data_video_edited_post) having a data size smaller than the sum of the data size of and the data size of the second video source data (data_video_source_2) and transmitting it to the multimedia editing server 200. The post-video editing terminal device 300 may be implemented as an information terminal such as a PC, smart phone, or tablet PC, and may be implemented as an application that provides a video editing interface as shown in FIG. 8 or a function for remotely performing video editing. It is configured to include a web browser that can access a web page that provides. Since the post-video editing terminal device 300 is only responsible for video editing, the selective access management module 230 grants access to recorded audio source data (data_audio_source_recording) and background audio source data (data_audio_source_BG) necessary for audio editing. access rights to the first video source data (data_video_source_1) and the second video source data (data_video_source_2) required for video editing are selectively granted. On the other hand, since it is necessary to refer to the sound information at the corresponding playback time for video editing, the selective editing data transmission module 240 uses real-time editing audio data (data_audio_edited_RT) or post-editing audio data (data_audio_edited_post) with a small data size (post-audio editing terminal). When the device 400 generates post-edited audio data (data_audio_edited_post)) is provided.

The post-edited video data (data_video_edited_post) is, for example, video editing according to the selective playback time of the first video source data (data_video_source_1) and the second video source data (data_video_source_2), application of post-added video effects, addition of additional video and It is created with the same video editing applied. The post-edited video data (data_video_edited_post) consists of a video file that can be played through software such as a video player, and is not a video file that is directly subject to editing. Since the reference video file is a reference video file, it is generated in the form of a single file separate from the first video source data (data_video_source_1) and the second video source data (data_video_source_2), which are original video data. In addition, it is desirable to generate post-edited video data (data_video_edited_post) by a method such as resizing to a small screen size, changing the resolution to a low resolution, and compressing and storing with a high compression rate so as to have the smallest possible data size. In addition, the resolution of the post-editing video data (data_video_edited_RT) may be adaptively changed according to the network environment, calculation processing capability, storage space, etc. of the post-audio editing terminal device 400 . However, in any case, the data size of the post-edited video data (data_video_edited_post) does not exceed the sum of the data size of the first video source data (data_video_source_1) and the data size of the second video source data (data_video_source_2), so that the post audio editing terminal device ( 400), it is possible to prevent transmission of excessively large video data during audio editing, and to reduce the computational burden of video files during audio editing.

Depending on the embodiment, the multimedia editing server may be configured to generate post-edited video data (data_video_edited_post) according to video editing by the post-video editing terminal device 300 .

In order to edit a source video file having a large data size, high processing speed and data processing speed are required. Therefore, during video editing, it is preferable to use proxy media encoded with a smaller data size than video source data, and to edit the video source data according to rules applied to video editing to create a final result. To this end, the post-video editing terminal device 300 may be configured to generate post-edited video data (data_video_edited_post) by using proxy media of the first video source data (data_video_source_1) and proxy media of the second video source data (data_video_source_2). have.

It is more desirable for the user of the post-video editing terminal device 300 to be involved not only in the post-production process but also in the pre-production process. To this end, it is preferable to configure the post video editing terminal device 300 to further generate first camera pre-control data (data_control_pre_camera_1) through an editing interface as shown in FIG. 3 .

In addition, in the embodiment of synthesizing the background screen, a new background screen is synthesized by the post-video editing terminal device 300 or a background screen different from the first background video source data (data_video_source_BG_1) synthesized by the real-time video editing module 220. By compositing, more diverse video editing is possible. To this end, the post-editing terminal device generates post-edited video data (data_video_edited_post) by synthesizing the performer object image of the first video source data (data_video_source_1) and the second video source data (data_video_source_2) and the second background video source data (data_video_source_BG_2). It is desirable to configure it so that

The post-audio editing terminal device 400 accesses the multimedia editing server 200 through a communication network, and the data size of the recorded audio source data (data_audio_source_recording) based on the recorded audio source data (data_audio_source_recording) and the background audio source data (data_audio_source_BG). and generating a single post-edited audio data (data_audio_edited_post) having a data size smaller than the sum of the data sizes of the background audio source data (data_audio_source_BG) and transmitting it to the multimedia editing server 200. The post-audio editing terminal device 400 may be implemented as an information terminal such as a PC, smart phone, tablet PC, etc., for example, an application that provides an audio editing interface as shown in FIG. 9 or a function for performing audio editing remotely. It is configured to include a web browser that can access a web page that provides. Since the post-audio editing terminal device 400 is in charge of only audio editing, access to the first video source data (data_video_source_1) and the second video source data (data_video_source_2) is not granted by the optional access right management module 230, , Access rights to recording audio source data (data_audio_source_recording) and background audio source data (data_audio_source_BG) are selectively granted. On the other hand, since video information at the corresponding playback time must be referred to for audio editing, the selective editing data transmission module 240 transmits real-time edited video data (data_video_edited_RT) or post-edited video data (data_video_edited_post) with a small data size (post-video editing terminal). When the device 300 generates post-edited video data (data_video_edited_post)) is provided.

The post-edited audio data (data_audio_edited_post) is generated by applying audio editing, such as, for example, applying sound effects added posthumously. The post-edited audio data (data_audio_edited_post) consists of an audio file that can be played through software such as an audio player, and is not an audio file that is directly subject to editing. Since it is a reference audio file to be used, it is created as a single file separately from the original audio data, the recording audio source data (data_audio_source_recording) and the background audio source data (data_audio_source_BG). In addition, it is desirable to generate the post-edited audio data (data_audio_edited_post) by a method such as compression and storage having a high compression rate so as to have a data size as small as possible. Through this, it is possible to prevent transmission of unnecessary audio data of an excessive size during video editing of the post-video editing terminal device 300, and to reduce the computational burden of audio files during video editing.

Depending on the embodiment, the multimedia editing server may be configured to generate post-edited audio data (data_audio_edited_post) according to the audio editing of the post-audio editing terminal device 400 .

It is more desirable for the user of the post-audio editing terminal device 400 to be involved not only in the post-production process but also in the pre-production process. To this end, it is preferable to configure the post-audio editing terminal device 400 to further generate audio pre-control data (data_control_pre_audio) through an editing interface as shown in FIG. 6 .

As described above, the optional access rights management module 230 of the multimedia editing server 200 grants the post-video editing terminal device 300 access rights to the first video source data (data_video_source_1) and the second video source data (data_video_source_2). is selectively granted, and access rights to recorded audio source data (data_audio_source_recording) and background audio source data (data_audio_source_BG) are selectively granted to the post-audio editing terminal device 400. The optional editing data transmission module 240 selectively transmits real-time edited audio data (data_audio_edited_RT) or post-edited audio data (data_audio_edited_post) to the post-video editing terminal device 300 and transmits the post-video editing terminal device 400 to the real-time edited video. Data (data_video_edited_RT) or post-edited video data (data_video_edited_post) is selectively transmitted. For example, when the post video editing terminal device 300 first starts video editing before the post audio editing terminal device 400 generates the post editing audio data (data_audio_edited_post), the selective editing data transmission module 240 may perform post video editing terminal device 300. After transmitting the real-time edited audio data (data_audio_edited_RT) to the device 300 and generating the post-edited audio data (data_audio_edited_post) by the post-audio editing terminal device 400, the post-video editing terminal device 300 starts video editing. In this case, the optional edited data transmission module 240 transmits post-edited audio data (data_audio_edited_post) to the post-video editing terminal device 300 . If the post-editing audio data (data_audio_edited_post) is generated several times by the post-audio editing terminal device 400, the most recently created post-editing audio data (data_audio_edited_post) is provided to the post-video editing terminal device 300.

Conversely, if the post-video editing terminal device 400 starts audio editing before the post-video editing terminal device 300 generates the post-editing video data (data_video_edited_post), the selective editing data transmission module 240 transmits the post-editing audio data data_video_edited_post. After transmitting the real-time edited video data (data_video_edited_RT) to the device 400 and generating the post-edited video data (data_video_edited_post) by the post-video editing terminal device 300, the post-audio editing terminal device 400 starts audio editing. In this case, the optional edited data transmission module 240 transmits post-edited video data (data_video_edited_post) to the post-audio editing terminal device 400 . If the post-video editing terminal device 300 generates post-editing video data (data_video_edited_post) several times, the most recently generated post-editing video data (data_video_edited_post) is provided to the post-audio editing terminal device 400.

The multimedia file generation module 250 generates a single multimedia file data (data_multimedia_file) according to video editing applied to the post-edited video data (data_video_edited_post) and audio editing applied to the post-edited audio data (data_audio_edited_post). To this end, the post video editing terminal device 300 generates a video editing job as post video editing data and transmits it to the multimedia editing server 200, and the post audio editing terminal device 400 converts the audio editing job to post audio editing for this purpose. It is generated as data and transmitted to the multimedia editing server 200, and the multimedia file generation module 250 generates a multimedia file by applying the post-video editing data and post-audio editing data to the video source data and the audio source data. Unlike the post-edited video data (data_video_edited_post), the post-edited video data is not actually edited video data, and is composed of information about video editing. For example, information about video source data selected at each playback time applied by the video editor, background In the case of synthesizing, it may be configured to include information on selected background source data, information on video effects applied to each playback time, and the like. Unlike the post-edited audio data (data_audio_edited_post), the post-edited audio data is not actual edited audio data, and is composed of information about audio editing. For example, information about audio source data selected at each playback time applied by the audio editor, audio When mixing is performed, information on a plurality of mixed audio source data and information on sound effects applied to each playback time may be included. Meanwhile, depending on the embodiment, the post-video editing terminal device 300 or the post-audio editing terminal device 300 that has completed the last editing task may generate multimedia file data (data_multimedia_file) and transmit it to the multimedia editing server 200. .

Since the multimedia file data (data_multimedia_file) is a final product, it is desirable to generate it with high quality. In the case of the embodiment further including the above-described multimedia content server, the generated multimedia file data (data_multimedia_file) may be configured to be uploaded to the multimedia content server in a form that can be provided in a streaming method or a download method through a communication network. At this time, depending on the embodiment, it is preferable that multimedia file data (data_multimedia_file) is provided to be associated with the user identifier of the user who participated in the video editing and the user identifier of the user who participated in the audio editing.

Meanwhile, audio editing and video editing are preferably performed in association with each other. To this end, the multimedia editing server 200 may generate a post-editing video data (data_video_edited_post) event or a post-editing video data (data_video_edited_post) modification event in the post-video editing terminal device 300. ) is notified of this, and when an event of generating post-edited audio data (data_audio_edited_post) or a modification event of post-edited audio data (data_audio_edited_post) occurs in the post-audio editing terminal device 400, the post-video editing terminal device 300 is notified of this. A data change notification module 260 for notifying may be further included.

In some cases, video editing must precede audio editing. For example, if an additional intro video is added through video editing, the audio track may need to be increased according to the added playback time, and when an additional video effect is added, a corresponding sound effect may need to be included. To this end, the multimedia editing server 200 generates post-editing audio data (data_audio_edited_post) only when an event of generating post-editing video data (data_video_edited_post) by the post-video editing terminal device 300 occurs. It may further include an editing work distribution module 270 that controls to generate. At this time, if there is a request for audio editing according to the corrections in video editing, it is preferable to configure the post-video editing terminal device 300 to transmit the request to the post-audio editing terminal device 400 through a communication network. .

Hereinafter, a distributed multimedia editing method according to the present invention will be described with reference to FIG. 10 .

First, the studio control server 100 controls the first camera module 111 through the first camera pre-control data (data_control_pre_camera_1) to receive first video source data (data_video_source_1) in which a performance of a performer is captured (s11). ) is performed. And the studio control server 100 controlling the second camera module 121 through the second camera pre-control data (data_control_pre_camera_2) to receive second video source data (data_video_source_2) recording the performance of the performer ( s12) and the studio control server 100 receives recorded audio source data (data_audio_source_recording) in which the performer's performance is recorded through the microphone module 130 (s13).

The first video source data (data_video_source_1), the second video source data (data_video_source_2), and the recorded audio source data (data_audio_source_recording) are created through the performance of the same performer, and the above steps (s11, s12, and s13) are performed simultaneously. The first video source data (data_video_source_1), the second video source data (data_video_source_2), and the recorded audio source data (data_audio_source_recording) are original data that are subject to video editing and audio editing, and are preferably generated as high quality video data and audio data. desirable.

Next, the multimedia editing server 200 performs step s21 of storing the first video source data (data_video_source_1) and the second video source data (data_video_source_2), and the multimedia editing server 200 performs recording audio source data ( A step s22 of storing background audio source data (data_audio_source_BG) defined by data_audio_source_recording) and audio pre-control data (data_control_pre_audio) is performed. The two steps s21 and s22 may be performed simultaneously with each other.

Next, the multimedia editing server 200 determines the data size of the first video source data (data_video_source_1) and the second video source data (data_video_source_2) based on the first video source data (data_video_source_1) and the second video source data (data_video_source_2). A step (s31) of generating single real-time edited video data (data_video_edited_RT) having a data size smaller than the sum of the data sizes of s is performed. The real-time edited video data (data_video_edited_RT) is video data that is used as a reference for audio editing in the post-audio editing terminal device 400 and is not directly used for video editing. can be created

According to an embodiment of synthesizing a predefined background screen and a captured image, in the step of generating real-time video editing data (s31), the multimedia editing server 200 converts first video source data (data_video_source_1) and second video source data It can be configured to generate real-time edited video data (data_video_edited_RT) by synthesizing the first background video source data (data_video_source_BG_1) defined by the performer object image of (data_video_source_2) and video pre-control data.

Next, the multimedia editing server 200 determines the data size of the recorded audio source data (data_audio_source_recording) and the data size of the background audio source data (data_audio_source_BG) based on the recorded audio source data (data_audio_source_recording) and the background audio source data (data_audio_source_BG). A step s32 of generating single real-time edited audio data (data_audio_edited_RT) having a data size smaller than the sum is performed. Real-time edited audio data (data_audio_edited_RT) is audio data that is referred to when editing video in the post-video editing terminal device 300 and is not directly used for audio editing, so it can be generated, for example, in the form of an audio file encoded with a high compression rate. The step s31 of generating the real-time edited video data (data_video_edited_RT) and the step s32 of generating the real-time edited audio data (data_audio_edited_RT) may be performed simultaneously.

Next, the multimedia editing server 200 selectively grants access to the first video source data (data_video_source_1) and the second video source data (data_video_source_2) to the post-video editing terminal device 300, and the post-audio editing terminal A step s40 of selectively granting access to the recorded audio source data (data_audio_source_recording) and the background audio source data (data_audio_source_BG) to the device 400 is performed. Through this selective access right, misediting of the source audio data by the post video editing terminal device 300 during video editing is prevented and misediting of the source video data by the post audio editing terminal device 400 during audio editing. can prevent

Next, the multimedia editing server 200 selectively transmits real-time edited audio data (data_audio_edited_RT) to the post-video editing terminal device 300, and selectively transmits real-time edited video data (data_video_edited_RT) to the post-audio editing terminal device 400. The step (s50) of transmitting to is performed. Through this configuration, it is possible to prevent the post-video editing terminal device 300 from receiving audio source data of an excessive size or the post-audio editing terminal device 400 from receiving excessive-size video source data, and each editing terminal device It is possible to reduce the computational processing burden of editing work that may occur due to unnecessary data during editing in . Meanwhile, when the post-editing video data (data_video_edited_post) is generated by the post-video editing terminal device 300, the multimedia editing server 200 transmits the post-editing video data (data_video_edited_post) instead of the real-time edited video data (data_video_edited_RT) to the post-audio editing terminal. Provided to the device 400, and when post-editing audio data (data_audio_edited_post) is generated by the post-audio editing terminal device 400, the multimedia editing server 200 provides post-edited audio data (not real-time edited audio data (data_audio_edited_RT)) data_audio_edited_post) may be provided to the post-video editing terminal device 300.

Next, the post-video editing terminal device 300 accesses the multimedia editing server 200 through a communication network, and through video editing, based on the first video source data (data_video_source_1) and the second video source data (data_video_source_2), A single post-edited video data (data_video_edited_post) having a data size smaller than the sum of the data size of the first video source data (data_video_source_1) and the data size of the second video source data (data_video_source_2) is generated and transmitted to the multimedia editing server 200. Step (s61) is performed. At this time, the post-video editing terminal device 300 is configured to perform post-video editing by referring to the real-time edited audio data (data_audio_edited_RT). For example, the editing application of the post-video editing terminal device 300 may refer to audio data for video editing by reproducing real-time edited audio data (data_audio_edited_RT) of the corresponding playback time through a speaker when editing a video of a specific playback time. have.

The post-edited video data (data_video_edited_post) is video data that is used as a reference for audio editing in the post-audio editing terminal device 400 and is not directly used for video editing.

According to an embodiment in which the post-video editing terminal device 300 participates in a pre-production process, before the step s11 of receiving the first video source data (data_video_source_1), the post-video editing terminal device 300 ) may be configured to further perform the step of generating the first camera pre-control data (data_control_pre_camera_1).

According to an embodiment in which the post-video editing terminal device 300 adds or changes a background image in a post-video editing process, the step of generating post-edited video data (data_video_edited_post) (s61) includes the post-video editing terminal device 300 may be configured to generate post-edited video data (data_video_edited_post) by synthesizing the performer object image of the first video source data (data_video_source_1) and the second video source data (data_video_source_2) and the second background video source data (data_video_source_BG_2).

Meanwhile, according to an embodiment in which proxy media is used to reduce the computational load of the post-video editing terminal device 300 during video editing, the step of generating post-edited video data (data_video_edited_post) (s61) is a post-video editing terminal. The device 300 may be configured to generate post-edited video data (data_video_edited_post) by using proxy media of the first video source data (data_video_source_1) and proxy media of the second video source data (data_video_source_2).

Next, the post-audio editing terminal device 400 accesses the multimedia editing server 200 through a communication network, and records the audio source based on the recorded audio source data (data_audio_source_recording) and the background audio source data (data_audio_source_BG) through audio editing. Generating single post-edited audio data (data_audio_edited_post) having a data size smaller than the sum of the data size of the data (data_audio_source_recording) and the data size of the background audio source data (data_audio_source_BG) and transmitting the data to the multimedia editing server 200 (S62). ) is performed. At this time, the post-audio editing terminal device 400 is configured to perform post-audio editing by referring to the real-time edited video data (data_video_edited_RT). For example, when editing audio of a specific playback time, the editing application of the post-audio editing terminal device 400 reproduces real-time edited video data (data_video_edited_RT) of the corresponding playback time through a video player to refer to the video data for audio editing. can

Post-edited audio data (data_audio_edited_post) is audio data that is referred to when editing video in the post-video editing terminal device 300 and is not directly used for audio editing, so it can be generated in the form of an audio file encoded with a high compression rate, for example.

According to an embodiment in which the post-audio editing terminal device 400 participates in a pre-production process, before the step of receiving the recorded audio source data (data_audio_source_recording) (S13), the post-audio editing terminal device 400 may be configured to further perform a step of generating audio pre-control data (data_control_pre_audio).

Finally, the multimedia editing server 200 generates a single multimedia file data (data_multimedia_file) according to the video editing applied to the post-editing video data (data_video_edited_post) and the audio editing applied to the post-editing audio data (data_audio_edited_post) (S70) do The multimedia file data (data_multimedia_file) is configured to be generated through video source data and audio source data so as to have high quality as a final result.

Meanwhile, according to an embodiment of notifying other terminal devices when a post video editing event or a post audio editing event occurs, in the distributed multimedia editing method, the multimedia editing server 200 performs post editing in the post video editing terminal device 300. When a creation event of video data (data_video_edited_post) or a modification event of post-edited video data (data_video_edited_post) occurs, the post-editing audio editing terminal device 400 is notified of this, and the post-editing audio editing terminal device 400 post-editing audio data ( When a creation event of data_audio_edited_post) or a modification event of post-edited audio data (data_audio_edited_post) occurs, a step of notifying the post-video editing terminal device 300 may be further included.

According to an embodiment in which a post-video editing job is performed and then a post-editing audio editing job is performed, the step of generating post-edited audio data (data_audio_edited_post) (S62) is the post-edited video data by the post-video editing terminal device 300. Only when a generation event of (data_video_edited_post) occurs, the post audio editing terminal device 400 can be configured to generate post edited audio data (data_audio_edited_post).

The detailed description of the invention in this specification describes preferred embodiments, and the present invention is not limited to these embodiments. Those skilled in the art to which the present invention pertains can make various changes and modifications to the above embodiments without departing from the technical spirit of the present invention, and the technical spirit of the present invention is all of these various changes and modifications. include

Studio control server: 100 1st camera control module: 110
1st camera module: 111 2nd camera control module: 120
Second camera module: 121 Microphone module: 130
Multimedia editing server: 200 Video source storage module: 210
Audio source storage module: 211 Real-time video editing module: 220
Real-time audio editing module: 221 Multimedia file creation module: 250
Optional access authority management module: 230 Optional editing data transmission module: 240
Post video editing terminals: 300 Post audio editing terminals: 400

Claims (16)

a first camera control module that controls the first camera module through first camera pre-control data to receive first video source data of a performer's performance; a second camera control module for receiving second video source data obtained by capturing the performance of the performer by controlling the second camera module through second camera pre-control data; and a microphone module for generating recorded audio source data in which the performance of the performer is recorded; a studio control server including;
a video source storage module for storing the first video source data and the second video source data; an audio source storage module configured to store background audio source data defined by the recorded audio source data and audio pre-control data; single real-time editing video data having a data size smaller than the sum of the data size of the first video source data and the data size of the second video source data based on the first video source data and the second video source data Real-time video editing module to create; and generating single real-time edited audio data having a data size smaller than the sum of the data sizes of the recording audio source data and the data sizes of the background audio source data based on the recording audio source data and the background audio source data. Audio editing module; Multimedia editing server comprising a;
A data size of the first video source data and a data size of the second video source data based on the first video source data and the second video source data through video editing by accessing the multimedia editing server through a communication network a post-video editing terminal device generating a single post-editing video data having a data size smaller than the sum of and transmitting the post-editing video data to the multimedia editing server; and
It accesses the multimedia editing server through a communication network, and through audio editing is smaller than the sum of the data size of the recorded audio source data and the data size of the background audio source data based on the recorded audio source data and the background audio source data. A post-audio editing terminal device generating a single post-editing audio data having a data size and transmitting the post-editing audio data to the multimedia editing server;
The multimedia editing server selectively grants access rights to the first video source data and the second video source data to the post-video editing terminal device, and to the post-audio editing terminal device to access the recorded audio source data and the An optional access right management module that selectively grants access to background audio source data;
When the post video editing terminal device starts the post video editing before the post audio editing terminal device generates the post editing audio data, the real time editing audio data is provided to the post video editing terminal device; When the post video editing terminal device starts editing the post video after the post audio editing terminal device generates the post editing audio data, the post editing audio data is provided to the post video editing terminal device; if the post audio editing terminal device starts the post audio editing before the video editing terminal device generates the post edited video data, the real time edited video data is provided to the post audio editing terminal device; An optional editing data transmission module for providing the post-editing video data to the post-editing video data when the post-audio editing terminal device starts the post-editing audio editing after the editing terminal device generates the post-editing video data. ; and a multimedia file generation module for generating single multimedia file data according to video editing applied to the post-edited video data and audio editing applied to the post-edited audio data.
The method of claim 1, wherein the post-video editing terminal device,
Distributed multimedia editing system, characterized in that further generating the first camera pre-control data.
The method of claim 1, wherein the post-audio editing terminal device,
Distributed multimedia editing system, characterized in that further generating the audio pre-control data.
The method of claim 1, wherein the real-time video editing module,
Dispersion characterized in that the real-time video editing data is generated by synthesizing first background video source data defined by the object image of the performer and video pre-control data of the first video source data and the second video source data. type multimedia editing system.
The method of claim 4, wherein the post-video editing terminal device,
Distributed multimedia editing system, characterized in that the post-editing video data is generated by synthesizing the object image of the performer and the second background video source data of the first video source data and the second video source data.
The method of claim 1, wherein the multimedia editing server,
When an event of generating the post-edited video data or a modification event of the post-edited video data occurs in the post-video editing terminal device, the post-editing audio editing terminal device notifies the post-editing audio data generation event or the post-editing audio data modification event. Distributed multimedia editing system, characterized in that it further comprises; a data change notification module for notifying the post-editing video editing terminal device when a creation event or post-editing audio data modification event occurs.
The method of claim 1, wherein the multimedia editing server,
and an editing task distribution module for controlling the post-video editing terminal device to generate the post-editing audio data only when an event of generating the post-editing video data by the post-video editing terminal device occurs. Distributed multimedia editing system featuring.
The method of claim 1, wherein the post-video editing terminal device,
and generating the post-edited video data using proxy media of the first video source data and proxy media of the second video source data.
receiving, by a studio control server, first video source data of a performer's performance by controlling a first camera module through first camera pre-control data;
receiving, by the studio control server, second video source data obtained by capturing the performance of the performer by controlling a second camera module through second camera pre-control data;
receiving, by the studio control server, recorded audio source data obtained by recording the performance of the performer through a microphone module;
storing, by a multimedia editing server, the first video source data and the second video source data;
storing, by the multimedia editing server, background audio source data defined by the recorded audio source data and audio pre-control data;
The multimedia editing server, based on the first video source data and the second video source data, a single data size having a data size smaller than the sum of the data size of the first video source data and the data size of the second video source data generating real-time editing video data of;
wherein the multimedia editing server has a data size smaller than the sum of the data size of the recorded audio source data and the data size of the background audio source data, based on the recorded audio source data and the background audio source data; generating data;
The multimedia editing server selectively grants access rights to the first video source data and the second video source data to a post-video editing terminal device, and provides a post-audio editing terminal device with the recorded audio source data and the background audio selectively granting access to source data;
selectively transmitting, by the multimedia editing server, the real-time edited audio data to the post-video editing terminal device, and selectively transmitting the real-time edited video data to the post-audio editing terminal device;
The post-video editing terminal device accesses the multimedia editing server through a communication network, and determines the data size of the first video source data and the data size of the first video source data based on the first video source data and the second video source data through video editing. generating single post-editing video data having a data size smaller than the sum of data sizes of second video source data and transmitting the data to the multimedia editing server;
The post-audio editing terminal device accesses the multimedia editing server through a communication network, and the data size of the recorded audio source data and the background audio source data are based on the recorded audio source data and the background audio source data through audio editing. generating and transmitting single post-editing audio data having a data size smaller than the sum of the data sizes of data to the multimedia editing server; and
and generating, by the multimedia editing server, single multimedia file data according to video editing applied to the post-edited video data and audio editing applied to the post-edited audio data.
The method of claim 9, wherein the distributed multimedia editing method comprises:
Distributed multimedia editing method, characterized in that it further comprises a step of generating the first camera pre-control data by the post-video editing terminal device before the step of receiving the first video source data.
The method of claim 9, wherein the distributed multimedia editing method comprises:
and generating the audio pre-control data by the post-audio editing terminal device prior to the receiving of the recorded audio source data.
10. The method of claim 9, wherein generating the real-time video editing data comprises:
The multimedia editing server generates the real-time video editing data by synthesizing the first background video source data defined by the object image of the performer and the video pre-control data of the first video source data and the second video source data. Distributed multimedia editing method, characterized in that.
13. The method of claim 12, wherein generating the post-edited video data comprises:
wherein the post-video editing terminal apparatus generates the post-editing video data by synthesizing the object image of the performer and the second background video source data of the first video source data and the second video source data. Type multimedia editing method.
The method of claim 9, wherein the distributed multimedia editing method comprises:
The multimedia editing server notifies the post-editing audio editing terminal device of the post-editing video data generation event or the post-editing video data modification event when the post-editing video data generation event occurs in the post-editing video editing terminal device. Distributed multimedia editing method further comprising a step of notifying the post-editing audio data generation event or the post-editing audio data modification event in the post-editing audio data.
10. The method of claim 9, wherein generating the post-edited audio data comprises:
The distributed multimedia editing method, characterized in that the post-editing audio data is generated by the post-editing audio data only when an event of generating the post-editing video data by the post-video editing terminal device occurs.
10. The method of claim 9, wherein generating the post-edited video data comprises:
The distributed multimedia editing method according to claim 1 , wherein the post-editing video editing terminal device generates the post-editing video data by using proxy media of the first video source data and proxy media of the second video source data.

Images