KR100530086B1 - System and method of automatic moving picture editing and storage media for the method - Google Patents

Abstract

According to the present invention, a capturing step of digitizing a moving picture or a still image recorded by various digital video input devices, dividing a transition part of the scene into respective video clips, adding special effects using 2D and 3D video filters, The video editing process is automated by creating the subtitles, arranging the appropriate background music for the subject, and rendering the files so that the edited video can be played on a general multimedia player. .

Description

Automatic recording device for video and its method and recording media for automatic video editing {System and method of automatic moving picture editing and storage media for the method}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to the automatic editing of moving images. In particular, when editing a moving image using a personal computer (PC), the moving image is obtained from an external video input device (e.g., a camcorder) based on information obtained through minimal user intervention. The present invention relates to an automatic editing apparatus for moving images, a method for automatically editing a moving image, and an automatic editing method for moving images after editing and processing the image automatically after receiving the input.

Generally, conventional video editing software basically inputs an image from a camcorder to a PC to create a video file (hereinafter referred to as "capture"), and then cuts the captured file to an appropriate temporal length (in which case each is arbitrarily cut). A video editing section, called a "video clip"), pasting, deleting, moving, and shuffling, and inserting text or adding special video effects to some or all video clips. The application process, the sound synthesis process that adds background music, sound or voice to a part or all of the video clip (hereinafter referred to as "mixing"), and the video output process that outputs the final processed video file ("Rendering"). It is configured to perform the steps of "

The software is a function-intensive software in which post-production work that is edited by a large number of people using a large-scale system is reduced to a digitized single work environment using a personal computer in order to make a video content such as a broadcast content or a movie.

Thus, the software has the performance for a single person scale to the level of the general public, amateur videographers, and small-scale video production.

Since the software requires a technical understanding of editing due to a business characteristic of image editing, the software has a characteristic of having professional knowledge or experience or having to receive professional training. Therefore, the general public lacking knowledge or experience is very difficult to understand the function of each step as well as the overall step of utilization.

Since the various functional modules function as individual programs, the software has to deal with the amount of work required to use several pieces of software to use each module, and the work time becomes longer. For example, in order to add subtitles, you need to learn and learn about the same level as using a general dedicated subtitle program. It also means that you need to learn how to use effects to add special effects.

In order to perform a series of editing processes using the software, five steps of capture, simple editing, special effects, mixing, and rendering as described above are required. At this point, the user must decide various options manually.

For example, in the case of capture, after connecting the camcorder to the PC, the user presses the operation buttons in the software to stop the camcorder tape back and forth to stop at a desired point and then start capturing. After capturing the desired part, keep an eye on the PC screen during capture to stop it. In this case, however, if the capturing time limit is set in advance, or if the capturing capacity of the file to be captured is set in advance, there is no need to keep an eye on the recording. In this case, it is worth noting that the user must manually manipulate the tape to start capturing, and then repeat the manual operations such as naming the file after capturing. Most beginners, however, often lack the technical understanding of capture and are often unable to even capture it because they are unable to respond to situations where their PC freezes due to excessive file capacity or the lack of hard disk. After the capture process is complete, a video file is created for the video on the PC, especially for DV camcorders in the format of DV-AVI.

DV is a technical term of original digital video. DV is a term that is intended to express digital images in contrast to conventional analog images. Specifically, DV is a digital compression method used in commercial digital imaging equipment. DV can be divided into DV25, DV50, DV100, DVCAM, DVCPRO, Digital8, etc. according to the device and compression method. In the following description, DV is collectively referred to as DV.

The DV camcorder represents a digital camcorder using the DV system. For home use, DV25, DV50, DV100 method are used mainly for business use. In the following descriptions, the remote control of these devices is the key, so they will be collectively referred to without any type of compression.

In addition, DV-AVI refers to the technical terminology that refers to the file or format when the video is compressed using the DV codec in the video file format called AVI.

On the other hand, in the case of simple editing, one captured file usually contains video for a sufficiently long time. However, it is customary that this single image usually contains different contents of several pieces. In other words, there may be several times where the middle camcorder stops and starts recording again. For example, when shooting in an amusement park, it means that the roller coaster line contains various screens such as the scene of riding an elephant train and eating lunch. The user may want to filter out unwanted scenes among these scenes. For example, if a walking scene was taken for only one minute after a person's back, but this scene was considered unnecessary and boring, it would have to be found and deleted. Or if you've taken a personal movie, rather than just a record, you may need to reverse the order in which you're shooting. To make simple edits such as cutting, pasting, and shuffling, the captured files should be arranged in chronological order and played directly, finding, displaying, deleting, and cutting the desired parts several times. There are two main user environments for such simple editing.

The simple editing method includes a timeline method and a thumbnail method. In the timeline method, a video is set as a bar on a horizontal axis with a time axis, and overlapping images are stacked on a vertical axis. The thumbnail method displays video clips as a single thumbnail icon and arranges them in chronological order, reminiscent of a camera film. The former case is very precise with respect to the passage of time, but has a disadvantage in that it is not intuitive to grasp the overall content of the content. The latter case overcomes the disadvantages of the former, but also has the disadvantage that it is not intuitive to precisely edit the temporal flow. Most of the software uses a timeline scheme, and very few of them use a thumbnail scheme.

In addition, in the case of application of special effects, three special effects processes such as subtitles, filters, and scene effects may be processed. Some of the three functions may not be provided depending on the software. The use of special effects is different because each manufacturer does not have a common protocol. In addition, although the principle technique of applying the filter is the same, the result is also different enough to be difficult to judge the level. However, the common way of working is to set the basic pattern of a specific filter, and then manually adjust various settings to use the desired filter pattern. You should repeat the exercise until you are fully familiar with the software to find the proper basic pattern. Another approach, which is rarely used, is to allow the user to select only the basic pattern without giving the user a choice. This is called the preset method.

In addition, in the case of the sound synthesis process, even though the mixing operation is a very simple operation function such as adjusting the volume ratio of the background sound to the original sound and adjusting the start position of the sound, each software takes a completely different method. The common point here is that the user environment is a timeline method. This is because sound, unlike video, cannot be represented as thumbnails. Therefore, even in the case of the thumbnail-type software, the sound mixing follows the timeline method. Due to the nature of sound content and the timeline nature, mixing is much more difficult and time-consuming than editing video.

Finally, in the case of rendering, the output video should use an appropriate image codec for a specific purpose. The final video will be produced as a new video from the original, rather than the original capture. Therefore, the captured original and the output video may be made in different formats (files). To render the video, a technical selection must be made. Many variables must be selected manually, such as the screen size (resolution) of the video, the quality of the image, the estimated size of the file, the usage of the video, etc. Since there is no unified technical standard for video, different codecs should be used depending on the purpose of use, and different settings for the codec should be made. Most of the software is designed to predetermine the codec and format of the final output image before editing, and in very few cases to determine the codec and format after editing.

Codec is a technical term for shortening "coder and decoder" and is called "codec". As a term referring to a technology or software for encoding and re-decoding digital data, the following description specifically refers to an image codec which handles digital images, among other codecs.

In the prior art, the video editing software used the software to be able to be operated on a PC to make a professional editing system and work in a special field such as video editing. However, for this professional work, it required users to have a considerable amount of major knowledge and ability to handle the software at the same time. Therefore, the existing software is designed to require the minimum level of expertise even for the low-end software, and the general user who is not familiar with the editing is almost impossible to use without such knowledge.

In addition, in the prior art, the software has to go through a large five-step process as described above, and there has been only a manual operation method in which the user has to select a large number of functions in each step. If the software provides only one or two functions, manual work may not be very inconvenient. However, as mentioned above, since the software consists of functional modules that each step was performed in one system, general users who attempt to edit for the first time acquire the knowledge and software at each step until the actual work is completed. There was a problem of spending a considerable amount of time to learn how to use.

In addition, in the prior art, there are some important obstacles that cause the work to be interrupted or cause an error if not understood in each step.

That is, in the case of capture, depending on the version of the operating system (OS) of the PC, due to the technical characteristic of not making a file larger than 2GB or 4GB at a time, the system or program stops due to reaching the limit during the capture operation. Or it might end. To this end, the user had to determine the capacities that can be captured at one time in advance, and in order to capture an image exceeding the limit capacity, there was a problem of trying to repeat the operation several times. In this case, if the user proceeds without taking proper measures beforehand, the error message may not be displayed when the system stops.In addition, even if an error message appears, the user cannot determine the cause of the system stop. There was a problem that could not cope with the situation.

In addition, in the case of editing, the captured file must be cut, pasted, and reordered, but there is a problem in that the original source has to be monitored from beginning to end. In addition, because the size of the video to be processed is too large and it consumes almost all of the resources of the PC including the CPU, it is frequently a problem that the PC is overloaded, or becomes unstable during frequent iterations to cut the scene. there was.

In the case of rendering, as in the case of capture, a file exceeding the limit is created during the process, or when the working space of the hard disk is insufficient, the work is stopped or, in the worst case, the system hangs.

In addition, in the related art, there is a case in which a question-and-answer user environment of a wizard type that guides the editing steps in order for an inexperienced user is sometimes presented. However, since this method is limited to the function of explaining the order of manual editing as described above and inducing user input in order, the process of manual editing is performed as it is, and the process is not simplified. Therefore, the wizard function also had the problem of the said manual editing.

In addition, in the prior art, in the editing step, a user interrupt is required for every process. Each of the above steps must go through a long mechanical work duration of at least a few minutes to a few hours, except for user input time in which the user indicates work intent. Therefore, the user should wait until the completion of each process, and then engage in the work until the end of the whole process by repeating the user's intervention instructing the work again when the process is completed. There is a problem that it is long, and there is a problem that the work efficiency decreases because the time that the software waits for the middle user input is generated.

In addition, the related art requires an input device capable of inputting a complicated command such as a keyboard or a mouse in order to control the above complicated editing process, and requires a skilled skill in the device. Therefore, it could be applied only in the form of software that can be used only in specialized equipment such as PC or expensive dedicated equipment in which the software is embedded. Due to the complexity of the input and control methods, it is difficult to mount the software on a low-end video device using a remote controller or a numeric keypad, and thus there is a problem in that there is no access to a general-purpose device.

Therefore, the present invention has been proposed to solve various problems caused in the conventional video editing method as described above,

An object of the present invention is to implement a software or device that automates the entire process of digitizing video, editing, applying special effects, and mixing sound and outputting it as a new video. The present invention provides an automatic editing apparatus for moving images, a method thereof, and an automatic editing method for moving images so that a complete image can be easily obtained.

Still another object of the present invention is to automatically edit an apparatus and method and automatically edit a video for maximizing user convenience by eliminating any manual work in the editing process with a minimum Q & A user environment on a PC or similar device. The method provides a stored recording medium.

Another object of the present invention, by making a simple recorded general video as a processed video with a variety of themes having a specific editing pattern, so that the general user can obtain a professional-quality work that is difficult to implement, the user's satisfaction In order to maximize the automatic video editing apparatus and its method and the video editing method to provide a stored recording medium.

Still another object of the present invention is to collectively arrange user input steps that allow a user to select a minimum editing intention before editing starts, thereby completely eliminating user interrupts that are intermittently performed at every step, The present invention provides an apparatus for automatically editing a video and a method and an automatic video editing method for storing a video, which can relieve a user's time inconvenience by drastically shortening the actual time required for editing.

It is still another object of the present invention to automatically perform batch editing on a PC or a similar product, which requires multi-processing of large files, thereby causing a system stop or abrupt operation to be interrupted while the user manually edits. The present invention provides an automatic editing apparatus for moving images and a method and an automatic editing method for moving images for predicting or detecting and preventing or preventing a cause causing technical problems.

Still another object of the present invention is to provide a video editing product, a mobile device, or a similar product, which requires the use of an input device that is impossible to edit manually or improperly, such as a remote controller or a numeric keypad by batch processing a complicated editing process with simple questions and minimal selection. In addition, the present invention provides an automatic editing apparatus for moving images and a recording medium storing the method and the automatic editing method for moving images so as to expand the range of applicable products by providing a complete automatic editing method.

Hereinafter, a preferred embodiment of the present invention according to the technical spirit as described above will be described in detail with reference to the accompanying drawings.

The present invention receives a video from an image input device such as a camcorder, and in response to the user's minimal intervention, the software or editing apparatus automatically edits the image and outputs it as a new video file.

1 is a block diagram showing the configuration of an automatic video editing apparatus according to the present invention.

As shown therein, an information input unit 100 for inputting information for transmitting a user's minimum intention; A video analog / digital converter 200 for converting an analog video input through an external video input device into a digital video corresponding thereto; The information input from the information input unit 100 is stored in the information storage unit 300, and the digital image converted by the video analog-to-digital converter 200 is captured in accordance with the stored information, and simply edited. A video editing and control unit 400 for automatically editing a video by applying effects and mixing sounds; The video editing and control unit 400 is an image rendering unit 500 for outputting an image file by rendering the video automatically edited in a suitable image format for a specific purpose.

Referring to the operation of the automatic video editing apparatus according to the present invention configured as described above in more detail.

First, the user inputs information for delivering the user's minimum intention through the information input unit 100.

For example, a title, a photographer's name, a performer's name, a shooting date, a shooting location, and other words to be left are input according to a format presented by the device.

When information is input from the information input unit 100, the video editing and control unit 400 stores the input information in the information storage unit 300, and later uses the stored information when editing the video.

Next, when a user selects an external video input device after inputting information, the video analog / digital converter 200 converts the analog video input through the external video input device selected by the user into a corresponding digital video. The video is edited and transferred to the controller 400. The external image input apparatus includes image input apparatuses capable of inputting images through a remote control such as a camcorder, a digital camera, a video communication camera, and the like, and already captured video files themselves. However, even in the case of still images, if the device can be treated as a moving picture file having a certain length of time, it is regarded as moving picture, and the input device is also regarded as the same category as the moving picture input device. Since devices other than the camcorder do not need complicated control other than capture, the following embodiment regards the input device as a camcorder.

Next, the video editing and control unit 400 captures the digital image converted by the video analog / digital converter 200 in response to the information stored in the information storage unit 300, edits simply, and applies special effects. The sound will be mixed to automatically edit the movie.

The image rendering unit 500 renders the video automatically edited by the video editing and control unit 400 using a codec in an appropriate video format suitable for a specific use and outputs the video file.

2 is a flowchart illustrating a method for automatically editing a video according to the present invention.

As shown in the figure, a process of receiving user information for grasping the minimal user's intention (S100), automatically capturing a digital image according to the received user information, simple editing, and applying special effects After mixing the sound, rendering is performed to automatically edit the video (S200).

The automatic editing method of the video according to the present invention is carried out before the actual image automatic editing is performed in the user input process (S100) to give a minimum selection opportunity for the purpose of figuring out what result the user wants. Done. Since the automatic editing method of the video requests user intervention only at this stage throughout the editing process, the user does not have to observe the work until the end of editing is completed after the input is completed.

3 is a flowchart illustrating an embodiment of the user input process (S100).

As shown therein, a step of inputting a project file name (S110), a step of inputting the contents of a subtitle according to a presented format (S120), a step of selecting an input device to input an external image (S130), Selecting whether to use an option (user selection) (S140), and if the check result option is used, changing the input file name / path setting (S150), and when the option is not used or the input file name / path setting is changed Afterwards, a theme selection step (S160) of selecting a category of a work to be edited, a step of selecting whether to change the format of a video output after the theme selection (S170), and in the case of the format change, changing an output format setting Step S180 and step S190 of changing the output file name and the path setting are performed.

Looking at the user input process (S100) made in this way in more detail as follows.

Each time you perform a new auto-edit, you need to create a project file that keeps track of the editing plan you create. This project file is intended to record all the very detailed information needed for editing, such as the location of the original, the type and order of filters to add, the location of temporary files, and so on. It is a document file that serves as a guide, adding new records. This file may be deleted after the completion of automatic editing depending on the purpose of use. On the contrary, there may be a case where the contents of the record are kept in a file in consideration of the linkage with the next work. In this embodiment, it is assumed that the project file is preserved.

First, in step S110, the user inputs the name of the project file so that the project file can be created. If you do not need to keep the project file, this process can be omitted.

Next, in step S120, the user selects a "title", "photographer name", "performer name", "shooting date", "shooting place", "other words that he wants to display" on the screen during the new editing work. Enter the content of the subtitles according to the format presented by the device. This entry is temporarily saved in the project file.

Then, the user selects an input device through which the image source is input in step S130. The input apparatus includes video input apparatuses capable of inputting images through remote control of a camcorder, a digital camera, a video communication camera, and the like, and a video file itself that is already captured is included in the input apparatus. However, a still image is regarded as a moving image when it can be treated as a moving image file having a certain length of time, and the input device is also regarded as the same category as the moving image input device. Devices other than camcorders do not require complex controls other than capture.

In the input device selection, the environment of the user's PC or similar device may be different for each user, and the default value may not be appropriate depending on the situation, so that the user can change the name of the capture file and its file path arbitrarily. Check whether the option is used in. In this case, when the user wants to use the option, the input file name / path setting is changed in step S150.

In this case, step S150 is an additional item, and thus the user does not necessarily go through the process. Even if the user does not go through the setting change step (S150), the capture file name is basically specified based on the project file name, and the path is also specified in advance. These settings are also temporarily stored in the project file.

Next, in step S160, the user selects a theme for selecting a category of a work to be edited. The theme here is to provide some other form of editing in automatic editing. One theme specifies a combination of special effects filters applied to the title and main part, as well as background music and subtitle display. The effect filter or background music applied to the theme may be applied in a predetermined order or in a random order. The user assigns a theme similar to the video to be edited among various patterns such as "family events", "travel", "children" and the like. However, the user only specifies the type of theme, not the details. This is because transforming the content of the theme itself falls into the category of manual editing.

After the theme is selected, whether to change the format of the video file is selected in step S170. In this case, when the format is to be changed, the format of the video output in step S180 is changed, and the output file name / path setting of the video output in step S190 is changed. Since the information on the output format and the path is additional, the output format and the path are already set so that the user can output the specified default value even if the user does not specifically designate, and thus the user can proceed without knowledge of the format.

4 is a flowchart illustrating an embodiment of an automatic editing process S200 of FIG. 2.

As shown therein, a step (S210) of generating a project file with a project file name input by the user, a step of inputting an image source to be edited (S220), and a branch point to which a scene is switched in the input image source is detected. (SDB) step (S230), generating a title sequence which is an auxiliary image added before and after the main video after the detection of the branch point (S240), and the scene change after the title sequence generation Generating a transition effect (TRX) sequence (S250) to generate an auxiliary image to which the transition filters are applied to the viewpoints (S250), and combining the auxiliary images (title, TRX and source) generated in each of the above steps and simultaneously background Mixing music BGM (S260, S270) and converting (edit) the edited video file to a desired output format (format) are performed.

The automatic editing process (S200) made in this way will be described in more detail as follows.

First, in step S210, a project file is generated with a project file name input by the user. As described above, the project file is used to record in detail before the occurrence of the details of the automatic editing process to be performed below, and to refer to the next step while continuing.

When the project file is generated, an image source corresponding to a video capturing process is input in step S220.

5 is a flowchart illustrating an embodiment of the image source input step (S220).

As shown in FIG. 2, a step (S221) of discriminating whether an image source is a digital camcorder or a video file, and if the image source is a digital camcorder, regards the entirety of a tape photographed by a user and captures it. Automatically rewinding the tape (S222), performing the image capturing while the tape is advanced (S223), generating a source file from the captured image (S224), and If the classification result image source is a video file (S225), and if the codec is available as a result of the check, and if the codec is available as a result of the recognition as an image source step SBD (scene bovndary dectection) performing step (S230) If it is impossible to use the codec as a result of the checking, it is indicated that the editing is impossible and ends (S226).

The image source input step (S220) made in this way will be described in more detail as follows.

Image sources can be classified into three categories: camcorders, other video devices, and files, depending on the device. Since other video devices such as digital cameras, video communication cameras, scanners, etc. do not have a single method of input or control, and are usually manual inputs, input from these devices is processed in a different process. Assuming that only a file is input, an embodiment of the present invention only uses a digital camcorder and a file as a preferred example.

First, in step S221, whether the image input apparatus is a digital camcorder or a video file is distinguished.

In the case where the classification result image input apparatus is a digital camcorder, the tape is automatically rewound as in step S222 in order to capture the entirety of the tape photographed by the user as content and capture all of them. This is to save the effort of manual search of the tape to find the desired image by the general users, and also to edit the whole tape because it is impossible to judge the part intended by the user without user input due to the nature of auto editing. It is considered an object. The reason for this judgment is that many amateur video users, who are general users, often use tapes to the end. When using a film camera, it's common practice to shoot a film until the end of the film. In addition, since the entire process is cut for each scene in the SBD step (S230) to be described later during the above process, even if unnecessary processes are inserted, it is easy to modify them later after the completion of the automatic editing. That means you don't have to take time. In addition, the general amateur shooting, not the professional shooting with continuity, records the event as time passes, so it is impossible to decide which scene to remove before editing. It is the basis of.

Next, when the rewind is finished, the process proceeds to step S223, while performing the DV capture step of capturing the tape while proceeding to generate a source file as shown in step S224. At this time, if you do not shoot until the end of the tape, and there is a blank (also called blank or general black) where the image and sound are not recorded in the back of the pre-recording or in the middle of the recording, it is detected even if it is captured. You can exclude them from editing, or you can't capture them at all. The blanking feature may or may not exist due to the nature of the device. The important thing is to rewind the tape and perform the capture by yourself without the user's instructions.

On the other hand, if the classification result input device of the step S221 is a video file, the process can be processed only if there is a codec (codec) that can read the file, it is determined whether the CODEC can be used in step S225. If the applicable codec is not installed at this time or if the video created with the codec cannot be edited, go to step S226 to install the codec and indicate that the user is recommended or unable to retry after installing the codec. This will end the autoedit routine. In addition, if there is no problem in the use of codec, the video file can be processed. Therefore, the video source input device is recognized, and the process moves to the next step S230 of FIG.

On the other hand, after finishing the image source input step (S220), the process moves to step S230 to perform a SBD (Scene Boundary Detection) corresponding to the analysis process for finding the branch points to which the scene is changed in the captured video in the process.

SBD is also referred to as scene change detection in the technical field to which the present invention belongs. It is a technology that finds the point of change of a scene in a moving picture. It is a technology or algorithm that detects a significant change in the screen over a reference value by measuring the amount of change of the screen through a mathematical process.

The SBD process is the same as performing the cut during the simple editing process in manual editing. In FIG. 9, a process of separating an image source S into x videos such as s1, s2, s3, ..., sx is illustrated. The clipped video is displayed as each thumbnail image. The reason for cutting the transition part of the scene is to add a special effect to the transition part in the following process, and even after the automatic editing is completed later, the video fragmented into several pieces is easier to handle when editing manually.

After performing the SBD, the process moves to step S240 to generate a title sequence.

6 is a flowchart illustrating an embodiment of the title sequence generation step S240.

As shown in the drawing, extracting an arbitrary scene to be used for a title sequence from each video clip (S241), selecting the required number of video clips from the extracted video clip, and selecting the selected video clip as one new video. Step S242, inserting TRX into the merged video (S243), inserting a special visual effect (SFX) for the first title after the step (S244), and for the first title after the step Inserting a CGX (charater generation effect) (S245), rendering the first title after the step (S246), inserting an SFX for the tail title after the step (S247), and ending tail after the step And inserting the CGX for dragon (S248) and rendering the trailing title after the step (S249).

A more detailed description of the title sequence generation process is as follows.

The title sequence is an auxiliary picture added before and after the main story where the original moving picture is located. For example, if the drama itself is the main story in a TV drama, the drama theme song of the previous part of the main part and the subtitle part after the main part of the main part may be referred to as a title sequence. In the following process, the part corresponding to the theme song will be referred to as the "leading title", and the part corresponding to the subtitle will be referred to as "the tail title". Creating separate leading and trailing titles is a measure to protect the original video as much as possible. In general, amateur movies are often edited as they are without discarding, so it is not good to see the title subtitles directly on the front and back of the original, resulting in poor quality. Therefore, the title is separated from the original and the title part to create a new title to distinguish the beginning, the main part, and the end part like a drama or a documentary. However, depending on the theme, the concept of the title part may change somewhat in the case of genres other than drama or documentary form. For example, in the case of a movie, the first title may be applied to the first half of the main body, the title sequence may be in the middle of the main body, such as a 007 movie, and in the case of the omnibus format, an intermediate middle title sequence may be provided for each story. In the following embodiments, all examples of such variations are not described, and therefore, the description will be made based on the drama or documentary form. The important point here is that there is a step of automatically extracting and processing the original moving picture, and using the processed new moving picture as an auxiliary picture and re-editing it with the original in the following process.

As described in the above process, the title sequence is illustrated in order by generating two kinds of heading titles and trailing titles as an example.

In the above process, it should be recalled that the original video has been divided into several video clips through the SBD performing step S230. The figure represented by s1, s2, ..., sx in the second row of Figure 9 illustrates the results.

In order to extract an arbitrary scene to be used for the title sequence from each of the clips thus divided, an image clip random extraction step is performed as in step S241. The third row of FIG. 9 is a schematic diagram of extracting an arbitrary section by each section from each video clip. In other words, the title sequence is to copy and use a few scenes in the video to be edited. This is the same reason that movie trailers are made using parts of a movie scene.

The extracted video clips are selected as many as necessary in step S242 and merged into one new video. The fourth row of Fig. 9 is a diagram illustrating the arrangement of the extracted images by joining them together.

After the above process, the main body has the same shape as the SBD of the main body after the SBD is performed. Next, in step S243, TRX is added to the title sequence in the same manner as the process of generating the TRX sequence of FIG. 4. Will be inserted.

In the above, TRX is short for transition effects, and refers to a special effect or special effect filter used for transition between clips in a video.

FIG. 10 is a diagram illustrating a process of separating the sections of each video clip, applying the filter, and then recombining them in order to apply the TRX filter. In order to apply the TRX filter, the rear part of the front clip and the front part of the rear clip are extracted to the same length, and then merged into one, so that the final synthesized title sequence is shorter than the original clip. Here, the difference from the main body TRX sequence generation step (S250) is that FI (fade in) and fade out (FAD) are placed at the front and the rear of the title sequence. These are TRX filters that are intentionally inserted to distinguish them from the main story. In this part, the background music of the BGM mixing step S270 of FIG. 4 also performs a mixing of gradually lowering or raising the volume, similarly to the brightness of the image. The title sequence defined by the above process is used as a basic video source for both the leading and trailing titles.

In the following process, the SFX filter, which is a special effect filter, is first applied to the title sequence, and the caption is applied by applying a CGX filter to the title sequence.

In the above description, CGX is an abbreviation of character generation effects, and refers to a subtitle special effect or special effect filter used when displaying characters or symbols on a video. SFX is an abbreviation of special visual effects. This refers to a technique that makes it appear different from the original, and the above-mentioned TRX and CGX are also included in the scope of this "special effect". However, in the following description, only pure visual effects except for TRX and CGX are specifically referred to as SFX for convenience of explanation.

Here, the above process is repeatedly applied while applying different filters to the leading title and the trailing title.

First, as in steps S244 to S246, the head title sequence is output through the head title SFX insertion, the head title CGX insertion, and the head title rendering. Then, as in steps S247 to S249, the tail title SFX insertion and the tail title are used. Output trailing title sequences through CGX insertion and trailing title rendering. 7 conceptually illustrates the structure of the actual image data layer synthesized through this process. The bottom layer M3 indicated by SX is the original video layer rearranged by the title sequence indicated by S ′ in the fourth row of FIG. 9. The SX layer M3 will be described in detail with reference to FIG. 8 while explaining the TRX sequence generation step S250 of FIG. 4, and the Tx generated as a result of FIG. 8 is the SX (M3) here. Becomes In other words, SX is not just a video, but a composite video source combined with TRX. The concept of title sequence generation is that the CGX layer (M1) and the special effect filter layer (M2), which are subtitle effect layers, are put on top of each other in the order shown in the figure. (M4) to (M6) on the left side of FIG. 7 show example screens corresponding to the embodiments of these hierarchies, and (M7) on the right side show the results of the final synthesis.

When the title sequence generation step (S240) is finished and the preparation of the title sequence is completed, the TRX sequence generation step is performed as in step S250 to create an auxiliary image to which the scene change filter is applied to the scene change points of the main story.

8 conceptually illustrates a hierarchical structure of data to which a scene change filter is applied. SRC-F (T1) and SRC-B (T3) are the original source divided into foreground and background, respectively. SRC-F is the front scene and SRC-B is the video source of the next scene. Assume The SRC, SRC-F, and SRC-B refer to the original, that is, the source of the video before being processed. SRC-F stands for Source-foreground, and SRC-B stands for Source-background, meaning the original video layer corresponding to the front and back scenes, respectively.

Between these two layers, the TRX filter T2, which is a scene change filter, is applied. The front scene disappears and the rear scene appears according to the type of the filter. (T4) to (T6) on the left are the embodiments for each layer. Looking at (T5), the black part represents the foreground and the white part represents the background, and the arrow is the calculation direction of the filter. In T7, the actual composite screen is applied. For example, the foreground wipes the background in the direction of the arrow, changing the scene. The TRX sequence, unlike other filters, allows the front edge and the front of the scene to overlap for a very short time, emphasizing the transition in the scene with little damage to the original. In this case, editing is done by cutting the TRX sequence from the original and the previous original, and sandwiching the TRX sequence. The TRX sequence generation step (S250) is a process of generating a TRX sequence to be used in the following manner as described above. In this case, the TRX filters may be arranged in a predetermined order or randomly according to the theme. In addition, a filter may not be applied to a section that is too short.

When the TRX sequence generation step S50 is completed, virtually all auxiliary images generated are ready. The process of arranging the video sources prepared in this order and then gluing them into a single video is the next step, title, TRX and source combining step (S260).

A background music (BGM) mixing step (S270) for mixing background music almost simultaneously with the title, TRX and source combining step (S260) is performed in parallel. Then, the background music arranged according to the theme is arranged at the beginning, the main part, and the end part along the time arrangement of the pasted video, and the volume is adjusted. In this case, the background music is arranged according to a certain rule, which will be described below with reference to the most preferred embodiment.

11 is an example of a method of arranging sections according to the above-described drama or documentary format video object. In FIG. 11, T denotes a title, M denotes a main title, and C denotes an abbreviation of a title, and indicates a division of a first title, a main title, and a trailing title, respectively.

In addition, it means that M∞ = M1∞ + M2∞ + .... + Mx∞. If there is music in at least one of the small groups of M1, M2, ..., Mx, it is indicated that music is arranged in M. In addition, even if M∞, music is not arranged, the small section is muted, and even if the music is arranged, the repetition is set only within the small group.

In addition, the o notation indicates that music is arranged in the corresponding section. In this case, not one piece of music but several pieces of music may be arranged in one section. As can be seen in Figure 11, the background music can be arranged only when there is music in the T section. If there is music only in the remaining sections, mixing is not performed regardless of music arrangement. This means that the video without the theme song is defined as it violates the basic pattern of drama or documentary format. If there is music in section T, there may be four different layout types depending on the arrangement of sections M and C. If there is only music in T, it means that the music is applied as a whole rather than a theme song, so the music arranged in section T is repeatedly played until the end. If there is music in T and M, it means that there is a theme song and the background music of the main story. In this case, the theme song is played only once in the T section, and the M section repeatedly plays the music of the main story until the end. If there is music in T and C, it means that there are only parts of the theme before and after, so play music only once in that section, and do not mix in the remaining M sections. Finally, if there is music in all sections, T and C are played only once and M is played repeatedly. In the above-mentioned automatic editing, it is the last case, that is, the case where music is arranged in all of T, M and C. That is, the music is arranged to match the length of the video using the background music arranged in the theme, and mixing is performed according to the above rules. At this time, T and C reduce the scene sound (original sound) and make the background music louder, and M adjusts the scene sound and the background music at an appropriate ratio so that the music spreads slightly behind the scene sound. In this case, there may be a case where the ratio of the volume is set in advance, or there may be a method of automatically measuring the volume of the original sound and adjusting it relative thereto. The above-described BGM mixing step S270 may also be various as shown in FIG. 11, and when based on a format other than drama or documentary, other modified forms of rules may be applied. It is difficult to lift. The above examples are only the most common and preferred embodiments thereof. The important thing is to automatically arrange the music according to the rules and adjust the volume automatically.

When the above process is completed, the rendering step (S280) is finally performed for output.

Since rendering is a process of recreating an image to a new format after the above process, setting of a codec becomes a very important variable. For this process, the user input step (S100) did not ask the user for the variable value, but only the purpose of the application. For example, only a condition is input such as a high quality for TV, a large output, a small screen such as a PDA, or a medium quality. In this embodiment, the type of codec (mpeg4, DV, etc.) that can be used, the screen resolution (high resolution 640x480, medium resolution 512x384, low resolution 320x240, ultra low resolution 160x120), and the estimated capacity for image quality (700MB, 1400MB, 4.5GB, etc.) It is done. Of course, even though these values are not selected by the user, the preferred default value is already set as "Mpeg4, medium resolution, 1 CD (700MB)", and this value is already set by the user without any modification. ) Assumes the user has selected that value. Then, the software or device calculates the temporal length, codec, resolution, and capacity of the synthesized final video image by using the target value as the target value to determine the image quality and the output format. If the range of calculated image quality is too large or too small, the resolution should be changed automatically. In the rendering step S280, the target value is calculated as described above, and the output is performed accordingly. The important point here is that even if it is not determined by the user or only one or two requirements are required, the length of the image is measured by itself and the target value is calculated by automatically calculating settings such as image quality and resolution. After this, auto-editing is complete, and users can watch the output video file.

On the other hand, the recording medium according to the present invention, the process of receiving the user information to determine the minimum user intention; Generating a project file with a project file name input by a user, inputting an image source to be edited, detecting a branch point to which a scene is switched from the input image source (SDB), and detecting the original after the branch point detection Generating a title sequence, which is an auxiliary image added before and after the main video where the video is located, and generating a TRX sequence to create an auxiliary video to which a transition filter is applied to the transition points of the main video after generating the title sequence; Combining the auxiliary images (title, TRX and source) generated in each step, mixing background music (BGM) at the same time, and converting the edited video file into a desired output format (format). Contains a program for executing an automatic video editing process including a (rendering) step on a computer.

The technical spirit of the present invention described above has been described in detail according to the above-described specific preferred embodiment, but the above embodiment is only for the description and the present invention is not limited thereto. In addition, without departing from the gist of the invention claimed in the claims, any person of ordinary skill in the art that various modifications can be made, and such changes are within the scope of the claims Will be inside.

The present invention described above has the following effects.

First, by realizing software or devices that automate the entire process of digitizing videos, editing them, applying special effects, and mixing sound and outputting them as new videos, the average user can get the perfect video without the basics or expertise. It is effective to help.

Secondly, in a PC or a similar device, by minimizing a question-and-answer user environment, it eliminates any manual work in the editing process, thereby maximizing user convenience.

Third, by making a simple recorded general video into a processed video with various themes with a specific editing pattern, it is possible to obtain professional works that are difficult for ordinary users to easily realize, thereby maximizing user satisfaction. There is.

Fourth, by collectively arranging user input steps at which the user can select the minimum editing intention before the start of editing, the user's involvement in editing can be completely eliminated by completely eliminating user interrupts that were intermittently performed at every step. By drastically shortening the time required for work, there is an effect of eliminating user's time inconvenience.

Fifth, by automatically editing video files that require multi-processing of large files on a PC or a similar product in a batch, it causes technical problems such as system stoppage or sudden interruption that may occur when a user edits manually. Predicting or detecting the cause of the effect is to prevent or prevent it.

Sixth, complete automatic editing method for video appliances, mobile devices or similar products that require manual editing or improper input device such as remote control or numeric keypad by batch processing complex editing process with simple questions and minimum selection. The effect of this is to expand the range of applicable products.

1 is a block diagram showing the configuration of an automatic video editing apparatus according to the present invention,

2 is a flowchart illustrating an automatic editing method of a video according to the present invention.

FIG. 3 is a flowchart representing a sub-performance step of the user input process of FIG. 1.

FIG. 4 is a flowchart illustrating sub-steps for the automated routine execution process of FIG. 1.

FIG. 5 is a flowchart illustrating a sub-step of performing an image source input process of FIG. 4.

6 is a flowchart representing a sub-step of performing a title sequence generation process of FIG. 4.

7 is a conceptual diagram representing the order and state of an image filter to be applied at the same time,

FIG. 8 is a conceptual diagram representing a sub-application state of a scene change filter of the original video layer SX of FIG. 7.

FIG. 9 is a conceptual diagram illustrating one step of actual image data processing for generating a title sequence of FIG. 6.

FIG. 10 is a conceptual diagram illustrating two stages of actual image data processing for generating a title sequence of FIG. 6.

FIG. 11 is a diagram representing a state and a case of intra-music arrangements applied in the BGM mixing step of FIG. 4.

<Explanation of symbols for the main parts of the drawings>

100 ..... Information input section

200 ..... Video Analog-to-Digital Converter

300 ..... Information storage

400 ..... video editing and control

500 ..... video rendering unit

Claims (8)

In the automatic editing device of the video, An information input unit for inputting information for delivering a user's minimum intention; A video analog / digital converter for converting an analog video input through an external video input device into a digital video corresponding thereto; The information inputted from the information input unit is stored in an information storage unit, and in response to the stored information, the digital image converted by the video analog-to-digital converter is captured, simple edited, special effects are applied, and the sound is mixed. A video editing and control unit for automatically editing the video; And an image rendering unit configured to output an image file by rendering the video automatically edited by the video editing and control unit in an appropriate image format suitable for a specific use. In the automatic editing method of the video, A first step of receiving user information for identifying a minimum user intention; And a second process of automatically capturing a digital image according to the received user information, simply editing, applying special effects, mixing sound, rendering, and automatically editing the video. Auto edit method. The method of claim 2, wherein the first process comprises: Inputting a project file name, inputting subtitle contents according to a presented format, selecting an input device to input an external image, selecting whether to use an option (user selection), and confirming the above Changing the input file name / path setting when using the result option; selecting a category of a work to be edited after the option is not used or the input file name / path setting is changed; and outputting after selecting the theme. Selecting whether or not to change the format of the video, changing the output format setting in the case of the format change, and changing the output file name and the path setting. According to claim 2 or 3, wherein the first process, A method for automatically editing a video, characterized in that a user inputs a reference value to all or a part of a user input item, adjusts the input value by calculation or judgment, or accepts user information by unifying the user's will based on only a default value. The method of claim 2, wherein the second process, Generating a project file used to refer to the recorded information while recording the details generated in the automatic editing process in advance before generation; An image source input step of capturing a video input from an image input device; A Scene Boundary Detection (SBD) step of finding a branch point of the captured video; A title sequence generating step of generating a title sequence which is an auxiliary picture placed before, behind, or in the middle of the main story where the original moving picture is located; Generating a TRX sequence for generating an auxiliary image to which a scene change (TRX) filter is applied to a part or all of the scene change branch points of the main piece; Combining the sub-pictures and the original video as a material and arranging them in order, and combining titles, TRXs, and sources that are connected to one video; A background music (BGM) mixing step of arranging background music defined according to a theme and adjusting a relative volume with the original sound for each section according to the time arrangement of the subsequent final video; And a rendering step of regenerating the image in a new format for the final output of the moving image. The method of claim 5, wherein the input image source step, Identifying whether the image source is a digital camcorder or a video file; If the image source is a digital camcorder, recognizing the entirety of the tape photographed by the user as contents and automatically rewinding the tape to capture the content; Performing image capture while advancing the tape when the rewind is completed; Generating a source file from the captured image; Checking whether a codec is available when the classification result image source is a video file; If it is possible to use the codec as a result of the check, it is recognized as an image source and moves to the next step of performing the SBD. If it is impossible to use the codec as a result of the check, it indicates that editing is not possible and ends the video. Way. The method of claim 5, wherein generating the title sequence, Extracting, from each video clip, any scene to use for the title sequence; Selecting the required number of video clips from the extracted video clips and rearranging the selected video clips into one new video; Inserting a TRX for generating an auxiliary image to which the scene change filter is applied to the scene change branch points of the rearranged image clip; Inserting an SFX into a first title to apply a special image effect after the TRX insertion; Inserting a CGX for the first title to apply a subtitle effect after inserting the SFX into the first title; Rendering the head title into which the head title CGX is inserted; Inserting an SFX into a trailing title to apply a special image effect after the TRX insertion after rendering the leading title; Inserting a CGX for a tail title to apply a subtitle effect after inserting an SFX into the tail title; And rendering a tail title into which the tail title CGX is inserted. Receiving user information for identifying a minimum user intention; Generating a project file with a project file name input by a user, inputting an image source to be edited, detecting a branch point to which a scene is switched from the input image source (SDB), and detecting the original after the branch point detection Generating a title sequence, which is an auxiliary image added before and after the main video where the video is located, and generating a TRX sequence to create an auxiliary video to which a transition filter is applied to the transition points of the main video after generating the title sequence; Combining the auxiliary images (title, TRX and source) generated in each step, mixing background music (BGM) at the same time, and converting the edited video file into a desired output form (format). A computer-readable recording medium that records a program consisting of an automatic video editing process including a (rendering) step.