KR101808157B1 - Method for Inserting Background Music into the Moving Picture and Software Distributing Server Storing the Software for Processing the same Method - Google Patents

Abstract

An automatic background music inserting method for inserting background music into a moving picture and a software distributing server storing software for executing the same are disclosed. A moving picture making apparatus according to the present invention can automatically insert the background music by adapting to the length of the moving picture of a user. In this case, the background music can be naturally inserted as a whole by arranging an intro and an outro of the corresponding music in the first part and the final part of the moving picture, instead of simply cutting and inserting the background music according to the length of the moving picture.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and apparatus for inserting background music into a video material,

The present invention relates to a background music automatic insertion method for automatically inserting background music in a process of producing a video material in an image production apparatus, and a software distribution server storing software for performing the method.

The advertising market is a complex market in which advertisers, media companies (or media) and advertising companies produce, distribute and consume goods called advertising within the connected distribution structure. Every economic entity that provides services or provides goods uses the advertising market to utilize the marketing means of advertising, which advertises its products to consumers.

In terms of the form of advertising, video advertising is not only instantly communicated to the public through visual and auditory, but also has a relatively large advertising effect compared to other forms of advertising because it can deliver a single story even though it is a short time. In the case of video advertising, the degree of exposure or effect of the advertisement differs depending on the medium in which the video advertisement is reproduced.

However, in recent years, with the development of smartphones, it has become an era when ordinary individuals can easily produce video contents and distribute them via social media. In accordance with this, various video production software (so-called applications) Have been produced and widely used. In addition to creating video clips or inserting captions using cameras, video production software also includes the ability to select and insert a variety of background music.

Background music is considered as an important tool for effectively expressing the contents to be conveyed, but good background music is evaluated higher than the video itself and often affects the viewer. For example, an advertisement video is usually produced in a size of 15 seconds, 30 seconds, etc., and background music is considered to be an important factor to admit its advertising effect separately. Background music is very important as a way to effectively express the content that a video object wants to convey, even if it is not a commercial video. For this reason, it is strengthening the ability to insert background music even if it is non-professional image production software using smartphone.

When a user creates a video using a smartphone, it is almost impossible for a general user to find a background music having a playback time such as a video clip shot by the user. Generally, video clips with a unit length specified by video production software are created, and video clips are simply selected based on the unit length. In other words, if the user of the smartphone video production software is not a user who can directly produce the background music, the prepared background music is continuously repeated during the video reproduction time (when the background music reproduction time is shorter than the video) It is inevitable to use a method of arbitrarily cutting out the section (when the video playback time is shorter than the background music). Random editing of the playback interval in the background music belongs to an expert area using a separate editing tool.

On the other hand, the basic form elements of music include the intro corresponding to the prelude, the outro corresponding to the end of the song, Verse as the verse, chorus, chorus, bridge, Pre Chrous). Background music of a video can include similar configurations, but background music of a short video can hardly include all of these factors.

An object of the present invention is to provide a method of automatically inserting background music for inserting background music into a video and a software distribution server in which software for performing the method is stored.

In order to achieve the above object, the present invention provides a background music insertion method of an image production apparatus capable of producing a video image. The inserting method of the present invention includes a sound source providing step, a sound source selecting step, a first combining step and a second combining step, and automatically inserts background music of a video using a music file selected by a user.

In the sound source providing step, the sound source managing unit displays a list of the plurality of music files to the user, and the setting information in which the intro portion, the outro portion and the looping portion are set is mapped to the music file. In the sound source selection step, the sound source management unit receives a command from the user to select a music file to be used as background music of the video material among the plurality of music files. In the first combining step, based on the setting information of the selected music file, the background music inserting unit combines the intro portion and the outro portion of the selected music file at the beginning and the end of the entire reproduction period of the video object.

And the second combining step is performed when there is a remaining section in the middle portion of the entire reproduction section that is not filled with the first combining step. Thus, the background music can be completed in the first combining step. In the second combining step, the background music inserting unit repeats the looping part by n (n is an integer of n> 0) times by the remaining interval to complete the background music.

According to an embodiment, a first transition section may be arranged at the end of the intro section and at the beginning of the looping section, or a second transition section may be arranged at the end of the looping section and at the beginning of the outro section.

According to another embodiment of the present invention, the plurality of music files provided to the user by the sound source management unit may be stored in an external sound source management server connected via the Internet.

According to another embodiment of the present invention, the intro portion is set at the beginning of the music file, the outro portion is set at the end of the music file, and the middle portion of the music file except the intro and outro The looping portion can be set as all or part of the looping portion.

According to another embodiment of the present invention, the setting information of the plurality of music files may be recorded in a separate setting information table and managed together, or may be stored as a separate setting information file for each music file. Alternatively, the configuration information of the music file may be separately recorded in the header of the music file.

According to another embodiment of the present invention, the video production apparatus may include a camera and a microphone to generate the video material, and may be a portable terminal capable of accessing an external software distribution server through the Internet.

The present invention is also applicable to a software distribution server storing software for performing operations of the sound source managing unit and the background music inserting unit of the background music inserting method described above. At this time, the software distribution server stores and manages the software on a computer-readable storage medium, and the image production apparatus can access the software distribution server through the Internet and download the software.

According to the method of the present invention, when the background music is inserted into the video material, even if the playback time of the video file and the music file (sound source) to be used as the background music are different, the program starts with the intro of the music file, , It is possible to insert natural background music that starts with an intro and ends with an outro. The user can insert the selected music into the background music without considering the same time of the reproduction time of the sound source and the reproduction time of the video, simply by selecting one of the plurality of sound sources presented by the video production apparatus of the present invention.

Accordingly, the video production apparatus of the present invention can automatically insert background music of video objects having different playback times using the same sound source.

Also, it is possible to eliminate the awkwardness due to the simple cutting and combining of the sound sources according to the reproduction time of the image as in the conventional art.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a configuration diagram of a system including an image production apparatus in which a method of the present invention is performed;
2 is a diagram for explaining various embodiments of the background music insertion method of the present invention,
FIG. 3 shows a music file according to another embodiment of the present invention, and FIG.
4 is a flow chart provided in the description of the background music insertion method of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION The present invention will be described in more detail with reference to the drawings.

The method of the present invention is performed by software installed to perform the method of the present invention in an image production apparatus. Accordingly, any terminal equipped with software for processing the method of the present invention can be an image producing apparatus of the present invention. For example, a device such as a personal computer or a notebook computer as well as a portable terminal such as a smart phone having a camera, a microphone, a display unit, and an input unit may be an image production apparatus of the present invention if the method of the present invention is performed. Hereinafter, an image production apparatus implemented in the form of a portable terminal will be mainly described.

1, a video production apparatus 100 according to the present invention includes a management server 30 (hereinafter simply referred to as a 'sound source management server') for storing, managing, and downloading a sound source through the Internet 10, And may be connected to the software distribution server 50 or the like. The video production apparatus 100 does not necessarily have to generate a video by capturing a video and / or an image, and provides a user interface for inserting background music into a video, It is sufficient if the background music of the video object can be automatically inserted. At this time, the background music can be automatically inserted even if the reproduction time of the music file selected by the user for the background sound selected is different from the reproduction time of the video.

The video images generated by the video production apparatus 100 of the present invention can process various image file formats. For example, MPEG (Extension mpg), Compressed video format created by Moving Picture Experts Group, Audio Video Interleave (extension avi) created by Microsoft, Advanced Streaming Format (extension asf), Windows Media Video (extension WMV) Video file formats such as video file format (extension rm, ram) and QuickTime movie (extension mov) are available.

Each video is composed of video, audio, and subtitles. The video is composed of a plurality of image frames. The audio includes at least one of voice, sound effect, and background music (BGM).

The sound source management server 30 is a server for storing and managing a plurality of music files. The sound source management server 30 can provide a list of music files as well as stored music files upon request of the image producing apparatus 100. According to the embodiment, as will be described later, the music file can be stored and managed in the image production apparatus 100 in addition to the sound source management server 30.

In the present invention, a music file stored in the sound source management server 30 is a sound source to be used as background music of a video object. However, in the present invention, a part used as background music in a music file is limited to an intro part, a looping part and an outro part.

Therefore, the intro portion, the looping portion, and the outro portion are all set in the music source management server 30 for all music files managed in association with the present invention. Music files can be used as background music as a whole, but only a part of the music file can be used as background music. In the case where only a part of the music file is used as the background music, a part of the music file playback section is set to Intro, Looping and Outro.

<Music file settings>

Hereinafter, the setting of the background music portion of the music file will be described with reference to FIG. 2 and FIG. The intro portion, the looping portion, and the outro portion are set in the music file of the present invention, and the setting information related to the setting is generated.

The setting information of each music file may be (1) recorded in one setting information table to manage a plurality of music files together, (2) be generated in the form of a setting information file for each music file File creation), and (3) each music file may be individually recorded in its header. In the case of (2) method, music files and extensions can be identified differently by storing them in the same file name.

In FIG. 2A, the first music file M1 is displayed in the form of a bar graph for expressing its length (reproduction time), and an intro portion, a looping portion and an outro portion are set. The intro portion, the looping portion, and the outro portion can be set anywhere in the first music file M1. However, considering the development of the music, the intro portion is set at the first portion of the first music file M1, Is set at the last part of the first music file M1 and the looping part is set in the middle area of the first music file M1 except for the part set as the intro part and the outro part.

In principle, there is no limit to the size of the intro, looping and outro region. It suffices to set it considering the size of a video image mainly generated by the video production apparatus 100. For example, if the video production apparatus 100 mainly generates an advertisement video that is generated in a basic unit of 15 seconds or 30 seconds in length, the intro portion is approximately 3-5 seconds, the looping portion is approximately 3-5 seconds, Can be set to about 3-5 seconds.

In general, when an image is uploaded to a social media as a user's arbitrary production video image, the capacity and length of the video image are limited. Therefore, the intro portion is about 3-5 seconds, the loop portion is about 3-5 seconds, The outro portion can also be set to about 3-5 seconds.

The case where the intro, looping, and outro parts are set to use the general pop music produced by the sound producer for about three minutes or less as the music file of the present invention may correspond to FIG. 2 (a). In this case, if the intro portion is set to about the first 5 seconds of the music file, and the outro portion is set to about 5 seconds of the last portion of the music file, the middle portion of the music file becomes about 170 seconds long. The roofing part can be set to about 5 seconds in the middle part.

Unlike FIG. 2 (a), as shown in FIG. 3, a music file is prepared for the present invention from the beginning, and may be composed of only three parts of an intro portion, a looping portion, and an outro portion.

Referring again to FIG. 1, the software distribution server 50 is a server called 'AppStore'. The sound source management unit 111 and the background music insertion unit 113 of the image production apparatus 100 described below may be made of at least one software for performing the operations and stored in the software distribution server 50 and managed. For example, when a portable terminal such as a smart phone downloads and installs the software from the software distribution server 50, the image producing apparatus 100 of the present invention can be used.

The video production apparatus 100 of the present invention includes a display unit 101, an input unit 103, a network interface 105 and a control unit 110. The video production apparatus 100 includes a camera (not shown) A microphone (not shown), and the like.

The display unit 101 is a means for visually displaying various kinds of information to the user, and the input unit 103 receives a control command of the user or a message to be input to the post. The display unit 101 and the input unit 103 may be integrally formed as a touch screen. The network interface 105 connects to the sound source management server 30 or the software distribution server 50 via the Internet 10.

The control unit 110 controls the overall operation of the image producing apparatus 100 and includes a sound source managing unit 111 and a background music inserting unit 113 for automatically inserting the background music of the present invention.

In the case where the image producing apparatus 100 is implemented in the form of a portable terminal, the controller 110 may be interpreted as a configuration specifically installed for the present invention, but generally the main or basic functions of the portable terminal (e.g., Communication, etc.) in the manufacturing state of the portable terminal. In the case where the controller 110 is installed to perform basic functions of the portable terminal, the controller 110 includes a processor chip (hardware), which is basically possessed by the video production apparatus 100, (OS: Operating System) operating in accordance with an instruction from the user. In other words, a conventional portable terminal to which the present invention is not applied may also include a control unit 110. [

In this respect, the sound source managing unit 111 and the background music inserting unit 113 may be installed in an existing portable terminal for implementing the present invention as an application which is software operating on the operating system program. In other words, when the sound source managing unit 111 and the background music inserting unit 113 of the present invention are installed in the conventional portable terminal, it becomes the image producing apparatus 100 of the present invention. Meanwhile, the application may be software recorded in a computer-readable storage medium 51 of the software distribution server 50, and a conventional portable terminal may be connected to the software distribution server 50, Software) can be downloaded and installed.

The sound source managing unit 111 and the background music inserting unit 113 are set to operate at all times in the image producing apparatus 100 so that they can be operated even when the image producing apparatus 100 is in the locked state, It is preferable to operate only when a separate operation command (icon click, etc.) is input.

The sound source management unit 111 displays a list of a plurality of music files to the user through the display unit 101 and receives a user command for selecting a music file to be used as a background music of the video material from the user.

The music files on the music file list may be stored and managed by the sound source management server 30 or may be stored and managed by the sound source management unit 111 in the image production apparatus 100. [

When the sound source management server 30 stores and manages a plurality of music files, the sound source management unit 111 requests the sound source management server 30 for a list of music files and displays the list of music files to the user through the display unit 101 And the user downloads the music files selected from the list from the sound source management server 30 and provides them to the background music inserting unit 113 so as to insert them as background music.

When the music source management unit 111 stores and manages a plurality of music files in a memory (not shown) of the video production apparatus 100, the music source management unit 111 provides a list of music files being managed to the user, (Not shown) and provides the selected music file to the background music inserting unit 113 so as to insert it into the background music.

The background music inserting unit 113 inserts the background music into the first and second combining steps using the music file selected by the user. The first combining step is necessary, but the second combining step is selectively performed when the entire playback period of the video object is not all filled with the first combining step. Even if the first coupling step and the second coupling step are simultaneously performed as needed, since the first coupling step and the second coupling step are provided for convenience of explanation, the first coupling step and the second coupling step are separated It is preferable that the first coupling step and the second coupling step are performed concurrently or in parallel.

The first combining step is to combine the intro portion of the selected music file at the beginning of the entire playback portion of the video and combine the outro portion of the selected music file at the end of the playback portion. The second combining step is a step of inserting the looping part while repeating the looping part n times in the middle part except the beginning and the end of the video object reproducing part. Where n > 0.

By performing the first combining step and the second combining step, the present invention can insert background music of video material of different lengths (reproduction time) using one music file. The background music insertion examples 1 to 4 below are examples in which background music is inserted into the same first music file M1 in accordance with video images V1, V2, V3, and V4 having different lengths.

&Lt; Embodiment 1 of Background Music Insertion >

In FIG. 2 (b), the first video object V1 being generated by the user is displayed in a bar graph format to display its length (playback time). The total length of the first video object V1 is equal to the length of the first background music BGM1 to be embedded in the video object and the video object. If the user selects the first music file M1 as shown in FIG. 2A as a background music exploit in the music file list, the background music inserting unit 113 inserts the first music file M1 1 &lt; / RTI &gt; background music (BGM1) having the same length as the first video content (V1).

Through the first combining step, the intro portion is combined with the first portion of the first background music (BGM 1) corresponding to the playback portion of the first video object (V1), and the outro portion is combined with the last portion of the playback portion.

As a result of the first combining step, since the middle portion of the entire reproduction range of the first video object V1 is not filled, a second combining step of repeatedly filling the looping portion has to be performed. The background music inserting unit 113 completes the first background music BGM 1 by filling the remaining portion of the first background music BGM 1 with the looping portion of the first music file M 1 selected for background sound exploitation. 2 (b) is an example in which the looping portion is filled with 3 and 1/2 times of repetition (n = 3.5).

&Lt; Embodiment 2 of Background Music Insertion >

Suppose that the user selects the first music file M1 as a music file for background music while photographing the second video object V2 and generating a video object. Referring to FIG. 2 (c), the length of the second video object V2 is shorter than the length of the first video object V1.

The background music inserting unit 113 generates the second background music BGM 2 having the same length as the second video content V2 or inserts the second background music BGM 2 into the video as background music.

The second background music (BGM 2) performs the first combining step to insert the intro portion and the outro portion, then repeats the looping portion twice (n = 2) in the remaining portion through the second combining step can do.

&Lt; Embodiment 3 of background music insertion >

The third embodiment is a case in which the length is longer than (the intro part + the outro part), and is shorter than (the intro part + the looping part + the outro part) as the third video V3 in Fig. 2 (d). The background music inserting unit 113 generates the third background music BGM 3 having the same length as the third video content V3 or inserts the third background music BGM 3 into the video as background music.

The third background music (BGM 3) is completed by inserting the intro portion and the outro portion by performing the first combining step, and then inserting the remaining portion of the looping portion (for example, n = 0.6) through the second combining step .

&Lt; Embodiment 4 of insertion of background music &

In case of performing the first combining step and the second combining step, the length of the video material, that is, the length of the background music, is not a problem. However, if the length of the video object is shorter than the sum of the intro portion and the outro portion, the second combining step need not be performed.

Referring to FIG. 2E, the fourth video material V4 generated by the user is generated to have a length shorter than the sum of the intro portion and the outro portion set in the first music file M1 selected by the user for background sound exploitation . In this case, one of the intro part and the outro part must be cut off, and whether to cut the intro part or the outro part is optional. However, since it is often appropriate to reproduce the outline part of the background music, the outline part is inserted as it is in the fourth background music (BGM 4) of FIG. 2 (e) .

Although the first music file M1 has been described above, even if the user selects the second music file M2 as a music file for background sound, the music is inserted into the background music in the same manner. In other words, if the length of the video material is longer than the second music file M2, the intro and outro are arranged, and the looping part is inserted n times repeatedly between the intro and the outro, to complete the background music. Likewise, n > 0 is a rational number.

&Lt; Embodiment 5 of Background Music Insertion >

In the first to third background music (BGM 1, BGM 2 and BGM 3), a first switching section (x1) is connected to a connecting portion between the intro portion and the looping portion, and a second switching section (x2) processing to perform a natural connection.

Therefore, in the embodiment of the present invention, it is possible to arrange the intro and the roofing so as to overlap each other by a predetermined length (for example, one second) in the first switching section x1, which is the connection portion of the intro and the roofing, The looping and the outro is overlapped with each other by a predetermined length (for example, one second) in the second switching section (x2). In the first and second switching periods (x1, x2), the front portion may be gradually reduced in size, and the succeeding portion may be switched to a form in which the size of the sound is gradually increased.

In the first switching period (x1) between the intro portion and the roofing portion, the end of the intro portion and the start of the roofing portion are overlapped by, for example, about 1 second, Is completely removed, and the looping causes the negative transition to be reproduced in a complete form at the end of the first transition period (x1) as the intensity of the negative gradually increases. In the second switching period (x2) between the roofing and the outro, the looping is gradually reduced and the intensity of the outro is adjusted so as to gradually increase.

In the second music file M2 as shown in FIG. 3, since the intro and the roofing are already naturally connected, it is not necessary to arrange the switching section in the connection portion between the intro portion and the roofing portion. But the roofing part is different from the outro. Since the connection between the looping and the outro is not connected like the second music file M2 and the looping section can be connected to the outro in a state in which the looping section is cut off according to the length of the video, ).

Hereinafter, the background music insertion method of the present invention will be described with reference to FIG.

&Lt; Start of background music insertion process: S401 >

The user starts the operation of the sound source management unit 111 to start the process of creating the background music insertion process of the present invention. The user selects a video which is a basic material of the video material and allows the sound source management unit 111 to check the video.

In the case where the video production apparatus 100 of the present invention is a mobile terminal having a camera, the control unit may additionally provide a process of generating a video by combining a video clip or an image captured by the camera. In this case, step S401 includes a video generation process or a process performed after the video generation process.

&Lt; Selection of music files for background sound exploitation: S403, S4005 >

The sound source management unit 111 presents a list of the music files being managed to the user through the display unit 101 in step S403, and receives a selection command for selecting a music file to be used for exploiting the background sound in step S405.

&Lt; First coupling step: S407 >

Based on the first to fourth embodiments described above, the background music inserting unit 113 performs the first combining step. The intro and outro parts are inserted into the first part and the last part respectively in the first to third background music (BGM 1, BGM 2, BGM 3) for the first to third video images (V 1, V 2, V 3) .

If the length of the video object is shorter than the combined length of the intro portion and the outro portion, as in the fourth video object (V4), the intro and outro are properly inserted. In Fig. 2 (e), the intro is filled in the remaining part after the outro is completely inserted.

&Lt; Judging whether or not the second joining step is entered: S409 >

It is determined whether there is a remaining portion of the video object that is not filled with the background music. After performing the first combining step, there is still a remaining portion in which the background music is not still inserted in the first background music to the third background music (BGM 1, BGM 2, and BGM 3), so the process should proceed to the second combining step . The fourth background music (BGM 4) was completed as the first combining step.

&Lt; Second coupling step: S411 >

The background music inserting unit 113 performs a second combining step of filling the remaining part of the first background music to the third background music BGM 1, BGM 2, and BGM 3 into which the background music is not yet inserted. The second joining step is to fill the remaining portion by repeating the looping portion as necessary.

Therefore, it is repeated three times in the first background music (BGM 1), repeatedly inserted 1/2 times, inserted repeatedly 32 times in the second background music (BGM 2), repeated in the third background music (BGM 1) And was inserted in the remaining section without.

The background music of the video image generated by the user is automatically inserted through the second combining step.

The method of inserting a hash tag by image recognition of the present invention is performed in the above manner.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

Claims (8)

A method for inserting a background music in a video production apparatus capable of producing a video material,
A sound source providing step in which a sound source management unit displays a list of a plurality of music files to a user, the setting information having an intro part, an outro part and a looping part set in the music file;
A sound source selecting step of receiving a command from the user to select a music file to be used as a background music of the video object from the plurality of music files;
A first combining step in which a background music inserting unit combines an intro portion and an outro portion of the selected music file at the beginning and at the end of the entire reproduction section of the video based on the setting information of the selected music file; And
The background music insertion unit repeatedly repeats the looping portion by n (n is an integer of 0) times as much as the remaining interval, and when the remaining portion is not filled with the first combining step, 2 &lt; / RTI &gt; combining step of inserting the selected music file into the background music of the video material,
Wherein the image production apparatus is a mobile terminal capable of generating the image and having a camera and a microphone and being able to access an external software distribution server through the Internet.
The method according to claim 1,
In the first combining step and the second combining step,
Wherein a first transition section is arranged at the end of the intro section and at the beginning of the looping section or a second transition section is arranged at the end of the looping section and at the beginning of the outro section.
The method according to claim 1,
Wherein the plurality of music files provided to the user by the sound source management unit are stored in an external sound source management server connected via the Internet.
The method according to claim 1,
Wherein the intro portion is set at a beginning portion of the music file, the outro portion is set at a last portion of the music file, and the looping portion is set to all or a part of a middle portion of the music file except the intro and outro And the background music is inserted into the background music.
The method according to claim 1,
Wherein the setting information of the plurality of music files is recorded in a separate setting information table and is managed together or is stored as a separate setting information file for each music file.
The method according to claim 1,
Wherein the setting information of the music file is individually recorded in a header of the music file.
delete There is provided a computer-readable storage medium storing software for performing operations of the sound source managing unit and the background music inserting unit of the background music inserting method according to any one of claims 1 to 6, And to download the software when connected to the software distribution server.

Images