KR100383019B1 - Apparatus for authoring a music video - Google Patents

Abstract

The user can create a music video by combining various animation effects, video, still images, and characters. The user can design the music video contents using the storyboard creator, and the contents are stored in the storyboard. The storyboard analyzer controls an image controller, a character image generator, a video processor, a still image processor, and the like to perform animation effects, character image generation, video processing, and still image processing according to the created storyboard. The image controller generates various effects on these animations, moving images, still images, and text images according to the input sound or audio of the music file. The generated video is combined with sound by the video sound combiner to generate a video file which is a final music video file. In addition, a recording processing unit may be provided so that a user may input his or her own voice and insert the same into a music video. After or while creating a storyboard, users can view the contents of their storyboards.

Description

Music video production device {Apparatus for authoring a music video}

The present invention relates to an apparatus for producing a music video, and more particularly, to an apparatus capable of producing a music video using various animations and videos that change in accordance with music.

In the past, singers only released their albums when they recorded them. However, as the video component has a great influence on the sales of albums, singers release their music videos along with their releases.

However, these music videos are expensive and time-consuming because professional artists use expensive equipment to produce them. Therefore, it was almost impossible for the general public to produce music videos.

Of course, a music video can be produced by simply combining music with a video that is irrelevant to music, but it cannot be called a music video because it cannot give any inspiration as a music video.

Therefore, there is a demand for a device capable of producing a music video that can produce a music video of its own in a short period of time at a low cost, and expresses various effects in accordance with music to give an impression as a music video.

The present invention has been made in view of this point, and an object thereof is to provide a device capable of producing a music video of its own in a short period of time at a low cost.

In addition, an object of the present invention is to provide a device that can produce a music video that varies in accordance with the music image of the music video.

1 is a schematic block diagram showing an internal configuration of a music video production apparatus according to the present invention.

2 is a schematic block diagram illustrating an example of an apparatus for synthesizing various images in an image controller.

3 is a view showing a screen example of a music video production apparatus according to the present invention.

The user can create a music video by combining various animation effects, video, still images, and characters. The user can design the music video contents using the storyboard creator, and the contents are stored in the storyboard. The storyboard analyzer controls an image controller, a character image generator, a video processor, a still image processor, and the like to perform animation effects, character image generation, video processing, and still image processing according to the created storyboard. The image controller generates various effects on these animations, moving images, still images, and text images according to the input sound or audio of the music file. The generated video is combined with sound by the video sound combiner to generate a video file which is a final music video file. In addition, a recording processing unit may be provided so that a user may input his or her own voice and insert the same into a music video.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic block diagram showing an internal configuration of a music video production apparatus according to the present invention.

First, a user edits a desired music video using the storyboard creator 190. The user may select or input music to be inserted into a music video, animation effects, a video to be inserted, a text to be inserted, a still image to be inserted, and the like. The user can also specify at what time and for how long these effects will appear. These effects may have only one effect at the same time, but two or more effects may appear at the same time.

The content of the music video thus created will be referred to as a "story board" in the present specification. When the user writes a storyboard and issues a music video generation command, the storyboard interpreter 180 generates a music video file according to the storyboard created by the user.

First, the storyboard records what music will be used to create the music video. The storyboard interpreter 180 instructs the sound analyzer 110 to read the corresponding music file according to the content of the storyboard. The basic music may be music stored in a file in a format such as MP3 or WAV, or may be encoded music directly input through a microphone.

The acoustic analyzer 110 extracts characteristics of an audio signal such as a waveform, a spectrum, a loudness (the size of an audio signal), a fundamental frequency (the pitch of a sound), a beat (the speed of a beat) from the input music data. Examples of the method for extracting these characteristics include the contents described in Korean Patent Application No. 1999-51707 filed by the present inventor, but the present invention is not limited to a specific audio characteristic extraction method.

The extracted audio characteristic data is input to the image controller 120. The image controller 120 uses the storyboard content and audio characteristic data input from the storyboard analyzer 180 to provide various effects to the image.

For example, if the storyboard includes a content for transforming a specific character to music, the image controller 120 uses the text image generated by the text image generator 130 to transform the text according to audio characteristics. do. For example, if the effect of protruding convexly from the center of the character every time there is a bit is specified, the image controller 120 has the effect of convexing the character image according to the bit data among the audio characteristic data. will be.

Alternatively, the image controller 120 transmits the audio characteristic data to the text image generation unit 130, and the text image generation unit 130 deforms the text image according to the audio characteristic data, thereby converting the modified text image into the image control unit ( There is also a method to deliver to (120). In this case, the image controller 120 generates an animation that changes the entire screen or the background screen and synthesizes the images inputted from the text image generator 130, the video processor 140, and the still image processor 150. It will play a role.

Similarly, the video processing unit 140 and the still image processing unit 150 may be used to apply such effects not only to text but also to video and still images. In addition, it is possible to give this effect to the background. For example, if the user selects a snowfall animation effect, the snowy image is generated according to the audio characteristic data. At this time, for example, if a moving video of the car is designated at the same time, the image controller 120 synthesizes the moving video of the car from the moving image processor 140 and the animation image of the snow generated by the image controller 120, It creates an image of snow flying over a running car.

Examples of animations that can be generated by the image controller 120 include snowfall animations, lightning animations, firecrackers animations, animations of lips moving to music, animations of characters dancing to music, animations of changing background color, Space travel simulations, sea simulations, animations in which textures, shapes, colors, etc. of 3D objects change, and the like, and the present invention is not limited to specific animation effects.

In addition, the transformation effects that can be applied to each image such as a text image, a moving picture, a still image, and the like can be changed to match the music, change the contrast, distort the shape, or filter various images. There are a variety of effects such as changing the coefficient of the filter, moving or rotating the image, changing the size, lighting effect, magnifier effect, etc. in accordance with the music, the present invention Is not limited to specific image distortion effects.

In addition, the video processing unit 140 may be connected to a digital camcorder. In this case, the user can specify to use real time video from the digital camcorder. Therefore, the user can create a music video on the spot while giving a variety of animation effects by recording the user singing songs to the music with a digital camcorder. For example, when a user creates a storyboard, the user selects a picture from a digital camcorder, simultaneously shows a lightning strike for 20 seconds, a rain effect for 30 seconds, and a video distortion for 20 seconds. In the finished music video, lightning strikes 20 seconds on the video from the digital camcorder, rain falls for 30 seconds, and the video from the digital camcorder is distorted for 20 seconds.

As such, the image data generated by the image controller 120 is combined with the music file by the image sound combiner 170 to finally output a music video file that can be used by the user. The music video file may be a commonly used audio-video file format such as MPEG or MOV.

However, such an audio-video file format is often inconvenient to transmit over a large file size. In this case, it is also possible to use a dedicated music video file format. In other words, as a format that can be played on a dedicated music video player, a dedicated file format that records basic music files, various basic images (characters, movies, still images), and data (storyboards) related to them is used. This can reduce the size of the music video file.

In addition, the apparatus of the present invention may further include a recording processor 160. This can be used when you want to insert your own voice or special sound into the music video. The audio data recorded as described above is combined by the video sound combiner 170 to include the final music video file.

Next, an example of an apparatus for synthesizing various images in the image controller 120 will be described with reference to FIG. 2.

The image controller 120 combines various animation effects and images such as moving pictures, characters, and still images according to the contents of the storyboard. The results of various animation effects are stored in the main memory 240 and the temporary memory 250. The temporary memory 250 is used to perform calculations according to various animation effects. The result calculated using the temporary memory 250 is stored in the main memory 240.

The text image, video, and still image data 260a..260n from the text image generation unit 130, the video processing unit 140, and the still image processing unit 150 are stored in the texture memory 230a..230n and designated. The texture effect is applied. These images can be displayed by a predetermined number n at one time. For example, a character image such as a letter rises up from the top of the screen, a video with a star shining on the upper part of the screen as a background, and a still image of a rural village on the bottom part of the screen.

These images and animation effects stored in the main memory are combined in the second video memory 220. The combined video image is transferred to the first video memory 210 to be displayed on a monitor or sent to an image / acoustic combiner to be combined with sound to generate a final file.

In this case, the first video memory 210, the second video memory 220, and the texture memory 230a... 230n can use the image processing function of the video card, so that the processing speed is high. You lose. The main memory 240 and the temporary memory 250 may use a memory of a computer main board.

3 shows an example of a screen of a music video production apparatus according to the present invention.

In FIG. 3, reference numeral 310 denotes icons for performing functions related to files such as creating a storyboard file, opening an existing storyboard file, saving a storyboard file, opening a music file, saving a video format, and burning to a CD. It is shown.

You can use these icons to open the music files you want to use in your music video, create a storyboard, save it as a storyboard file, save it in video format, or burn it to a CD.

Reference numeral 320 denotes a window for showing a produced or produced music video, and reference numeral 330 denotes a button used for selecting or inputting an animation, still picture, video, sound, text, etc. while editing the music video.

When the user selects the desired effect type (animation, still image, video, etc.) by using the button 330, items that can be selected from the effect type are displayed in the upper right window 340. For example, if the user selects an animation effect, various animation effects such as raining animation, snowing animation, lightning animation, and space travel animation are displayed as icons, and the user displays the icon in the storyboard window 360. By dragging, you can display the effect at a specific time. In addition, if the user selects a video, a list of video files that the user can select is displayed in the window 340 on the upper right.

In the lower right window 350, image processing effects selectable by the user are collected. Examples of the effect of the image processing include grayscale, strong contrast, color inversion, top and bottom inversion, magnifier effect, water drop effect, lighting effect, and the like.

The user may edit the music video by dragging and dropping a desired effect or file on the storyboard window 360 from the editing function selection button 330, the upper right window 340, and the lower right window 350.

Each effect / image placed on the storyboard window 360 is represented in the form of a bar 361. The user may adjust the time at which the effect / image appears by adjusting the position of the bar 361, and adjust the time at which the effect / image appears by adjusting the length of the bar 361. In FIG. 3, up to five effects / images can be designated at the same time. However, the present invention is not limited thereto, and the number of effects / images simultaneously displayed may be changed by changing the texture memory number n of FIG. 2. .

In addition, the user can edit details of the effect / image by double-clicking the bar 361. The details of the effect / image include the size of the effect / image and its position on the screen, and in the case of a text image, the content of the character, font type, and font size.

After editing the storyboard or clicking the play button 370 during the editing, the music video is displayed on the screen according to the contents of the storyboard from the time when the control bar 362 is positioned on the storyboard. During playback, the user can stop the music video playback using the stop button 380.

Although the present invention has been described by way of example, the present invention is not limited to the specific examples, and it will be understood by those skilled in the art that various changes and modifications may be made.

As described above, according to the present invention, it is possible to produce your own music video in a short time at a low cost.

In addition, according to the present invention, the image of the music video is varied according to the music, and the user can edit these effects arbitrarily, there is an effect that can easily produce a variety of interesting music video.

In addition, according to the present invention, it is possible to produce a music video while giving a variety of effects to the video input in real time using a camcorder, there is an effect that can directly produce a music video while singing in a karaoke.

Claims (3)

Storyboard creator that allows users to select the music they want to use in the music video, insert animations, images, videos, etc. that change according to the music, and insert or edit them at any point of time. Storyboard analysis unit that reads the storyboard created by the user and interprets the contents of the storyboard and gives commands to the parts of the device according to the contents of the storyboard, An acoustic analyzer that reads the music file to be inserted into the music video according to the storyboard interpreter and extracts the characteristics of the audio signal such as waveform, spectrum, loudness, fundamental frequency, and beat of the music; Character image generation unit for generating a character image according to the instructions of the storyboard analysis unit, A video processing unit that reads a video file according to the instructions of the storyboard interpreter and processes the video according to the contents of the storyboard; A still image processing unit which reads a still image file according to the instruction of the storyboard analyzing unit and processes the still image according to the contents of the storyboard; According to the instruction of the storyboard analysis unit, an animation effect is generated according to the audio characteristic data from the sound analysis unit, and an image according to the instruction from the storyboard analysis unit is applied to the images from the text image generation unit, the video processing unit, and the still image processing unit. An image control unit for generating a composite image of all of them; Image sound combining unit for generating a video file by combining the synthesized image from the image control unit and the music file Music video editor, characterized in that it comprises a. The music video editor of claim 1, further comprising a recording processor configured to transmit a sound input by a user through a microphone to the video sound coupling unit according to a storyboard analyzer. The method according to claim 1 or 2, A camcorder may be connected to the video processing unit, and the video processing unit transfers an image from the camcorder to the image control unit according to an instruction from the storyboard analyzing unit.