JPH10304242A - Dramatic video image production support method and device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily produce an attractive and dramatic video image by supporting a video image production job. SOLUTION: In the video block/music block extract stage 1 at first, a video block 13 to which a music is added and a music block 14 desired to be in use are selected based on video information 11 and music information 12. Then in the video information extract stage 2, a scene change of a video image, a start point and an end point of a camera work, a start point and an end point of the video block are extracted from the video block 13 as a video image climax object 15. In the music information extract stage 3, a change point of a sound volume of a music and a change point of frequency distribution are extracted as a music climax object 16 from the music block 14. Then in the climax coincidence stage 4, the music block 14 is adjusted so as to be synchronized with the video block 13 based on the climax objects 15, 16. Finally, in the information addition stage 5, the music information is added to the video image to obtain a final dramatic video work 19.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to the production of a multimedia title by combining video information and music information,
The present invention relates to a method and apparatus for editing, and more particularly to a method and apparatus for assisting in combining music information to add dramatic effects to video information.

[0002]

2. Description of the Related Art Advances in digital technology have made it easier for ordinary people other than broadcast stations and productions to handle video information. However, while video information captured by a camera or the like is enough to convey the facts, in order to emphasize or attract people's interests,
It is common to not only show a video, but also to devise cutting and BGM. For example, BG
Just adding M greatly enhances the appeal of the video work.

Therefore, several work tools for supporting such editing and production work have been developed and commercialized. For example, a non-linear editing device developed by AVID Co. stores video information and music information as digital data, spatially displays time-series information, and visualizes it on a display, so that data in the time direction can be spatially edited. The user can intuitively comprehend, and can easily perform editing work by randomly accessing each information of video and music.

[0004] However, in order to make a video more attractive, it is necessary to not only add music to the video but also to enhance and express the mood, emotion and mental state by the music, and to make use of the synergistic effect of the video and music. There is a need. According to the mood and scenario of the video, appropriate music selection is performed, and music is added to the video at the appropriate timing to create a synergistic effect, making the video work attractive.

[0005] There are various techniques for adding music to a video, and some of them are techniques that have been widely used since ancient times. Examples are given below. 1) In a video having camera work, the volume of music information is increased in accordance with the camera work, the volume is maximized at the end of the camera work, a sense of excitement is expressed, and the viewer is excited. 2) By starting or ending the music at the same time as switching the video, the viewer is impacted and the video at the start or end of the music is impressed. 3) By gradually lowering the volume of music as the video scene progresses, or by making the performance gradually slower,
Give viewers a calm and emotional feeling. 4) The change in the musical tone and the change in the shot of the video are matched, and the viewer is given a state of silence due to the intensity and vice versa.

In these techniques, various information such as an editing point, that is, a scene change, an end point and a start point of camera work, and a music, such as a volume change point, a rhythm point, and a tempo, are recorded from the video. Based on the reference, the video and music match as a result of synchronization.

[0007] Ideally, based on the mood and scenario of the video, the music is automatically selected, the appropriate music is selected, and only the required length is cut out.
Fully automated tools are needed, as they require human creativity and the ability to understand the semantic information in video and music information, although tools that properly add to the video based on the techniques described above are desirable. That is almost impossible at the moment.

[0008]

Therefore, a conventional editing device is used to select a song and edit it so as to produce an effect. However, the camera work of an image used in the above-described technique and an editing change point are used. , Music information volume, tempo,
Information such as rhythms, change points and peaks in the frequency distribution is unknown, and the video creator analyzes the video and music information individually, searches for characteristic information, synchronizes, and repeats trial and error to determine perfection. We needed to raise it. That is, when a video work with a higher degree of perfection is to be produced, an enormous amount of time and labor is required to enhance the degree of perfection.

[0009] The above-mentioned problem of the prior art is that the conventional video production and editing apparatus only handles video and music as raw data. It is necessary to search for and combine relevant information.

An object of the present invention is to process video and audio information, extract characteristic information from video and music information often used in video production techniques, and obtain characteristic information obtained from both. Dramatic video production support method and apparatus that enables automatic processing and combination according to the user's request based on each other, supports video production work, and facilitates the production of attractive dramatic video Is to provide.

[0011]

A dramatic video production support method according to the present invention comprises: a video section / music section extracting step of extracting a video section and a music section desired by a user from video information and music information; The start and end points of the video section, which is the climax candidate information of the video from the video section,
A video information extraction step of extracting a start point and an end point of a scene change, a start point and an end point of camera work, and a start point and an end point of a music section which is music climax candidate information from the music section; A music information extracting step of extracting a change point, and a video climax candidate information and a music climax candidate information using a climax candidate matching model prepared from one or a plurality of climax candidate matching models prepared in advance. In accordance with the climax candidate to be matched, processing the music section so that it can be synchronized with the video section, and synchronizing the music section with the video section.

According to the present invention, information on a scene change of a video, camera work, volume of music, and a change point of a frequency distribution which is likely to be used for video production is extracted as climax information, and video production is performed based on the climax candidate information. Add music to the video according to the operation of the technique model.

According to the present invention, it is possible to automatically process synchronization based on video feature points and music feature points, which are references when applying techniques in video production, and produce a dramatic effect. Can assist in the creation of works.

According to an embodiment of the present invention, one of the climax candidate matching models prepared in advance is:
A model that matches the end point of the camerawork extracted as a video climax candidate with the volume change point extracted as a music climax candidate and adds music to the video based on those values, or is extracted as a video climax candidate A model that matches the end point of the camerawork that has been performed with the change point of the frequency extracted as a music climax candidate, and adds music to the video based on those values,
Or, match the starting point of the camera work extracted as a video climax candidate with the volume change point extracted as a music climax candidate, and extract as a model or video climax candidate that adds music to the video based on those values A model that adds the music to the video based on those values, or the scene change extracted as a video climax candidate, A model that matches the change point of the volume extracted as a music climax candidate and adds music to the video based on those values, or a scene change extracted as a video climax candidate and a frequency of a frequency extracted as a music climax candidate Match change points,
A model that adds music to the video based on those values, or one of the start point and end point of the video section extracted as a video climax candidate, and a change in volume and frequency extracted as a music climax candidate A model that matches any one of the points and adds music to the video based on those values, or a start point and an end point of a scene change in a video section extracted as a video climax candidate; Match one of the start point and the end point with one of the start point and the end point of the music section extracted as the music climax candidate, and add music to the video based on those values. Model.

By using these models, a video work can be automatically generated.

A dramatic video production supporting apparatus according to the present invention is a video section / music section extracting means for extracting a video section and a music section which a user wants to target from video information and music information, respectively, and a climax of video from the video section. Image information extraction means for extracting the start and end points of the video section, the start and end points of the scene change, and the start and end points of the camera work, which are candidate information, and climax candidate information of music from the music section. Music information extraction means for extracting a start point and an end point in a music section, a change point of volume and frequency, and a climax candidate model selected from a climax candidate match model or a plurality of climax candidate match models prepared in advance. Video climax candidate and music climax candidate According climax candidate is, and a climax matching means for synchronizing the music section to video section performs a processing for the music section to allow synchronization with the video section.

[0017]

Next, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a flowchart of a dramatic video production supporting method according to an embodiment of the present invention.

First, video section / music section extraction stage 1
, A video section 13 to which music is to be added and a music section 14 to be used specified by the user are extracted from the video information 11 and the music information 12. The lengths of both sections 13 and 14 do not necessarily have to match. In taking out the video section 13, the time information of the video information 11 is displayed on an output device such as a display, and the start of the video section to be used is specified in an interactive specification format using a display and a mouse, a command format specification method, or the like. Point and end point. At this time, not only the time information but also a representative image in the video information may be displayed on the time information. In addition,
The representative image here refers to an image immediately after a scene change, an image immediately after the end of a camera work, an image for an appropriate time interval, or an image given by a human hand in advance. Also, ignoring time information as well as time information,
A method of selecting and extracting only from such image information may be used.
It should be noted that music and audio information are stored together with video information in files on existing media such as video tapes, laser disks, and computers. However, in the editing work, it is assumed that the time information of such sound information is separated in advance. At the time of extracting the music section 14, the time information of the music information is displayed on an output device such as a display, and the starting point of the music division is determined by an interactive specification method using a display and a mouse or a command format. Select the end point. In addition to the video information, it is also possible to display a feature amount extracted from the music information in time series. Here, the parameters extracted from the music information indicate frequency distribution, volume change, and the like. Further, depending on the media, additional information such as a song title, a singer's name, and lyrics may be stored together with the music information. These pieces of information may be added and displayed on a time series and selected.

Next, in the video information extracting step 2, the video scene change start and end points, the camera work start and end points, and the video section start and end points from the video section 13 are set as video climax candidates 15. Extract. On the other hand, in the music information extraction stage 3, the music section 14
, The start point and end point of the music section, the change point of the volume, and the change point of the frequency distribution are extracted as music climax candidates 16. Next, in the climax matching stage 4,
Using the climax candidate matching model 17 specified by the user, a process of matching the video climax candidate 15 with the music climax candidate 16 is performed. In the climax matching step 4, the music section 14 is adjusted so as to be able to synchronize with the video section 13 based on the climax candidates 15 and 16, and a synchronization signal 18 is output. To obtain the final dramatic video work 19. It should be noted that it is naturally possible to further edit the dramatic video work 19 to produce a new work.

The synchronization signal 18 manages video information and music information, and is based on a time signal required for processing. For example, any information may be used as long as the information is proportional to the time information based on the time information required for reproducing the video information and the music information. The synchronization signal 18 is necessary to reproduce video information and music information while synchronizing them with other video information and audio information, and other additional information (for example, characters, telops, lyrics, etc. displayed on the screen). Signal. For example, when video information and music information are configured as data files on a computer, the target information is played by randomly accessing a plurality of locations in a plurality of data files. At this time, the file to be accessed, the data location of the file to be accessed, the buffering timing required at the time of access, and the like are included in the synchronization signal. This signal may be recorded and stored, and the recording medium is not particularly limited. It is stored as a data file on a computer or data recorded on a reading medium using optics, magnetism, or the like.

FIG. 2 is a block diagram showing a schematic configuration of the dramatic video production support device according to the embodiment of the present invention. The input video buffer 20 and the input music buffer 21 are buffers for storing the input video information 11 and the input music information 12, respectively. The input video information 11 and the input music information 12 are
It is digitalized in advance, and may be compressed in various compression formats, as long as it can be processed. Therefore, in the present embodiment, a buffer is used for convenience, but a medium for storing digital data such as a CD-ROM or a hard disk may be used.

The user selects the video section 13 and the music section 14 from the video information and music information displayed on the video feature display section 22 and the music feature display section 23 by the video section cutout section 25 and the music section cutout section 26. And cut out useful sections. In cutting out both sections, the user gives an instruction through the user instruction section 24 to cut out the video and music sections. It should be noted that the image feature display unit 22
With regard to, time-series information, characteristic images, and the like may be displayed on a display monitor of a personal computer. Alternatively, information such as a monitor of a video display unit composed of a VCR and a television monitor, and a timer and a tape counter of the VCR may be used. Similarly, information such as a laser disk counter may be used. The music feature display unit 23 may display the feature amount of the music, or may display the time series by a counter display in a music player centering on a CD or music. Information that is not a feature obtained from inside the music but is added in advance from the outside, such as subtitles in karaoke, may be displayed as a feature amount. The user determines the necessary video and music sections by viewing the displayed feature amounts and, if necessary, reproducing the video and music information as appropriate. The instruction method may be a method of instructing the display unit displayed on the display using a pointing device such as a mouse, or a script-type instruction specialized for a special operating system. By the above series of processing, the video section cutout unit 2
5, the required video section 13 from the video information is stored in the video section buffer 27, and the required music section 14 is stored in the music section buffer 2 from the music information by the music section cutout unit 26.
8 is stored. The user instructing unit 24 may include an interface screen displayed on a monitor, a keyboard and a mouse, or may be any unit that can instruct data, such as a script created in advance by a computer editor. . The video section buffer 27 and the music section buffer 28 may be a memory of a computer or a virtual disk. The video section 13 and the music section 14 which are temporarily converted into digital data are stored in the computer. Anything that can be stored is desirable, and one that can be accessed at high speed is desirable.

When the video section 13 and the music section 14 are stored in the video section buffer 27 and the music section buffer 28, respectively, the video climax candidate 15 and the music climax candidate 16 are Extract. The details of the video information extraction unit 30 and the music information extraction unit 31 will be described later.
In the present embodiment, the video climax candidate 15 includes a start point and an end point of the target video section 13, a start point and an end point of a scene change in the video section 13, and a start point of a camera work existing in the video section 13. For the end point, the music climax candidate 16 is a start point and an end point of the target music section 14, a volume change point, a frequency distribution change point, and the like.

When the video climax candidate 15 and the music climax candidate 16 are extracted, the user selects the climax candidate matching model 17 from the climax candidate matching model group 29 for matching the climax candidates 15 and 16, and the climax matching unit 32 According to the selected climax candidate matching model 17, the video climax candidate 15 and the music climax candidate 16 are combined and matched. Here, the combination may be, for example, a combination of the start point of the video section 13 and the start point of the music section 14, or the end point of the video section 13 and the music section 14.
There can be a combination of end points. Further, there may be a combination of a camera work end point in the video section 13 and a change point at which the volume of the music section 14 becomes maximum. further,
There may be a combination of an end point of the video section 13 and a start point of the music section 14.

Further, in the climax matching section 32,
In addition to synchronizing the video section and the music section based on both climax candidates specified by the climax candidate matching model 17, the volume is adjusted around the target music climax candidate and the volume is gradually reduced. , Such as deleting only a certain frequency,
The music section is processed accordingly. Note that depending on the method of selecting the climax candidate, there is a possibility that perfect synchronization cannot be obtained due to a difference in time length. In such a case, the music section is extended or shortened in accordance with the video section. If the entire input music information is shorter than the video section, the input music information is repeatedly added.
Other combination processing can be performed.

FIG. 3 is a block diagram of the video information extracting unit 30. The video section start point / end point detection section 41, the scene change detection section 42, and the camera work detection section 43 extract a video section start point / end point 44, a scene change 45, and a camera work start point / end point 46, respectively. It is extracted as a video climax candidate 15. When an object is an uncompressed digital video, a scene change or a camera work is extracted by performing a correlation operation between frames using information of each pixel. Further, when compression encoding is performed, for example, when MPEG encoding compression is performed, this is realized by using a method of extracting from motion vector information and prediction error information included in MPEG data. Further, in addition to the scene change and the camera work, the movement of the subject, the change of the subject, the appearance / exit of a specific subject, and the like may be included in the video climax candidate.

FIG. 4 is a configuration diagram of the music information extraction unit 31. The music section start / end point detection section 51, the maximum volume extraction section 52, the volume change continuation section extraction section 53, and the frequency distribution extraction section 54, the music section start point / end point 55, the maximum volume point 56, and the same volume are constant. The start point / end point 57 of the same volume continuation section that is a section where time continues, the end point 58 of the maximum frequency density section that is the end point of the section where the frequency distribution per unit time is maximum, and the frequency component Observation, frequency distribution inflection point 5 which is a point where the frequency distribution has changed
9 is extracted as a music climax candidate 16.

The start point and end point 57 of the same volume continuation section are the start point and end point of the section in which the volume level is observed and a constant volume is maintained. It indicates the start point and end point of a section where the volume is 0 and the volume is not 0. In addition, the end point 58 of the maximum frequency density section indicates a point at which the frequency components are observed, many frequency components are present, and the frequency components have ended. The frequency distribution inflection point 59 is
Observe the distribution from the high-frequency component to the low-frequency component, measure the presence / absence of the distribution, and the presence / absence of the distribution per unit time per unit time. And Such a point indicates a change from a high frequency center to a low frequency center of music, or vice versa, and is deeply related to a change in tune.

The changing point of the frequency distribution can be used as another characteristic point. For example, the frequency distribution is first divided into a high frequency band and a low frequency band, the power of each frequency is extracted, and the number when each power is larger than a predetermined threshold is determined as the high frequency band and the low frequency band. Count with the frequency band, look at the change of each number,
A point where the number of low frequency bands and the number of high frequency bands are reversed is defined as a change point of the frequency distribution. There are various other methods for changing the frequency distribution. Although what is described here is only the number, the density in the frequency direction may be used as a comparison target as a feature value, or the distribution may be evaluated after weighting is added according to the magnitude of power. I do not care. In addition to the evaluation using only the two distributions of the height, the evaluation may be performed in a plurality of distribution bands. Music climax candidate 1
6, other than the above, rhythm change, tempo change,
Information such as changes in lyrics in the case of music with a song may also be used as music climax candidates.

Next, the climax candidate matching model 17
Will be described. Climax candidate matching model 17
Is a reflection of a technique in video production, and corresponds to, for example, recording of an operation aiming at realizing the above four production techniques on parameters.

The following are models corresponding to the above four examples. 1) In a video having camera work, the volume of music information is increased in accordance with the camera work, the volume is maximized at the end of the camera work, a sense of excitement is expressed, and the viewer is excited.

In this case, the end point of the camera work from the video climax candidate points and the maximum sound volume point from the music climax candidates 16 are used as a reference for synchronization. 2) By starting or ending the music at the same time as switching the video, the viewer is impacted and the video at the start or end of the music is impressed.

In this case, video climax candidate 1
5 and the start point or the end point of the music section from the music climax candidates 16 are used as a reference for synchronization. 3) By gradually lowering the volume of music as the video scene progresses, or by making the performance gradually slower,
Give viewers a calm and emotional feeling.

In this case, video climax candidate 1
5 and the maximum volume point of the music section from the music climax candidates 16 is used as a reference for synchronization. 4) The change in the musical tone and the change in the shot of the video are matched, and the viewer is given a state of silence due to violence or vice versa.

In this case, video climax candidate 1
5, the scene change of the video section from the music climax candidate 16 and the frequency distribution inflection point of the music section from the music climax candidates 16 are both used as a reference for synchronization.

In the present embodiment, the above-described video work production techniques are targeted, and the climax candidate matching model 17 described above makes it easy to produce them.

Furthermore, if a climax candidate matching model satisfying other production techniques can be added to a model group and made selectable, it is possible to support the production of a more complete video work.

FIG. 5 shows how climax matching section 32 adds video and music to produce a dramatic video.
In this case, the camerawork end point is obtained from the video climax candidate 15, the volume maximum point is obtained from the music climax candidate 16, and the climax candidate match model 17
In the final dramatic video work 1
9 is being produced.

FIG. 6 shows how climax matching section 32 adds video and music to form dramatic video work 19. In this case, the process of synchronizing the scene change from the video climax candidate 15 and the change point of the frequency distribution from the music climax candidate 16 by the climax candidate matching model 17 is shown, and the final dramatic video work 19 is produced. doing. Note that the frequency distribution maximum density end point is used as the change point of the frequency distribution.

As described above, if the video climax candidate and the music climax candidate have been extracted in advance, then the climax candidates are matched with each other based on either of the climax candidates and synchronization is achieved. The same processing can be performed for other climax candidates.

[0042]

As described above, the present invention relates to a video scene change and camera which are used in advance in video production techniques when producing and editing a video work with a high degree of perfection by combining video and music information. By extracting information such as the start and end points of the work, the volume of music, and the change point of the frequency waveform as climax candidates, and inputting them to a pre-constructed video production model, processing based on basic video production techniques is performed. Automatically, it is possible to easily create high-quality video works.

In implementing the present invention, it is possible to realize the device by installing software describing the method on a general-purpose computer.

[Brief description of the drawings]

FIG. 1 is a flowchart of a dramatic video production support method according to an embodiment of the present invention.

FIG. 2 is a configuration diagram of a dramatic video production support device according to an embodiment of the present invention.

FIG. 3 is a configuration diagram of a video information extraction unit 30.

FIG. 4 is a configuration diagram of a music information extraction unit 31.

FIG. 5 is a schematic diagram of dramatic video production.

FIG. 6 is a schematic diagram of dramatic video production.

[Explanation of symbols]

 Reference Signs List 1 video section / music extraction stage 2 video information extraction stage 3 music information extraction stage 4 climax matching stage 5 information addition stage 11 video information 12 music information 13 video section 14 music section 15 video climax candidate 16 music climax candidate 17 climax candidate matching model Reference Signs List 18 Synchronization signal 19 Dramatic video work 20 Input video buffer 21 Input music buffer 22 Video feature display unit 23 Music feature display unit 24 User instruction unit 25 Video section cutout unit 26 Music section cutout unit 27 Video section buffer 28 Music section buffer 29 Climax candidate matching model group 30 Video information extraction unit 31 Music information extraction unit 32 Climax matching unit 33 Information addition unit 34 Video work memory 41 Video start / end point detection unit 42 Scene change detection unit 43 Turtle Work detection unit 44 Video section start point / end point 45 Scene change 46 Camera work start point / end point 51 Music section start point / end point detection unit 52 Maximum volume extraction unit 53 Volume change continuation section extraction unit 54 Frequency distribution extraction unit 55 Music section start point / end point 56 Maximum volume point 57 Same volume continuation section start point / end point 58 Frequency density maximum section end point 59 Frequency distribution inflection point

 ──────────────────────────────────────────────────の Continued on the front page (72) Inventor Yoshinobu Tonomura Nippon Telegraph and Telephone Corporation 3-19-2 Nishishinjuku, Shinjuku-ku, Tokyo

Claims (10)

[Claims] 1. A dramatic video production support method for adding dramatic effect to video information by adding music information according to an instruction, wherein the video section desired by the user is selected from the video information and the music information. And a video section / music section extraction step of extracting a music section and a start point and an end point of a video section which is climax candidate information of a video from the video section, a start point and an end point of a scene change, and a start point and an end of a camera work. A video information extraction step of extracting a point; a music information extraction step of extracting, from the music section, a start point and an end point of a music section which is music climax candidate information; A climax candidate match model or a climax candidate model selected from multiple climax candidate match models Using the above, the video climax candidate information and the music climax candidate information are matched, and according to the matched climax candidate information, the music section is processed so as to be synchronized with the video section, and the music section is synchronized with the video section. A dramatic video production support method having a climax matching stage. 2. One of the climax candidate matching models prepared in advance is to match the end point of the camerawork of the video extracted as the video climax candidate with the change point of the volume extracted as the music climax candidate. 2. The dramatic video production support method according to claim 1, wherein the model is a model for adding music to a video based on the value of. 3. One of the climax candidate matching models prepared in advance is to match the end point of the camerawork extracted as the video climax candidate with the change point of the frequency extracted as the music climax candidate. 2. The dramatic image production support method according to claim 1, wherein the model is a model for adding music to an image based on the standard. 4. One of the climax candidate matching models prepared in advance matches a starting point of camerawork extracted as a video climax candidate with a change point of a volume extracted as a music climax candidate,
The dramatic video production support method according to claim 1, wherein the model is a model for adding music to a video based on those values. 5. A climax candidate matching model prepared in advance matches a starting point of camerawork extracted as a video climax candidate with a change point of a frequency extracted as a music climax candidate, and sets the values thereof to be equal. 2. The dramatic image production support method according to claim 1, wherein the model is a model for adding music to an image based on the standard. 6. One of the climax candidate matching models prepared in advance matches a scene change extracted as a video climax candidate with a volume change point extracted as a music climax candidate, and based on these values. The dramatic video production support method according to claim 1, wherein the model is a model for adding music to video. 7. One of the climax candidate matching models prepared in advance matches a scene change extracted as a video climax candidate with a change point of a frequency extracted as a music climax candidate, and based on these values, The dramatic video production support method according to claim 1, wherein the model is a model for adding music to video. 8. One of the climax candidate matching models prepared in advance includes one of a start point and an end point of a video section extracted as a video climax candidate, and a volume and a volume extracted as a music climax candidate. 2. The dramatic image production supporting method according to claim 1, wherein the model is a model in which any one of the frequency change points is matched and music is added to the image based on those values. 9. One of the climax candidate matching models prepared in advance is one of a start point and an end point of a scene change in a video section extracted as a video climax candidate, and a start point and an end point of a camera work. One and one of the start point and end point of the music section extracted as a music climax candidate
2. The dramatic video production support method according to claim 1, wherein the model is a model in which music is added to a video based on those values. 10. A dramatic video production support device that adds music information to video information in accordance with an instruction to produce a more dramatic effect, wherein a video section desired by a user from video information and music information is provided. Means for extracting a music section and a music section; audio information in the video including conversations of people from the video section; start and end points of a video section which is climax candidate information of the video; start point of a scene change And video information extracting means for extracting a start point and an end point of camera work, and extracting, from the music section, a start point and an end point of a music section which is music climax candidate information, and a change point of a volume and a frequency. Music information extracting means, and whether a climax candidate matching model or a plurality of climax candidate matching models prepared in advance Using the selected climax candidate model, the video climax candidate information and the music climax candidate information are matched, and according to the matched climax candidate, processing for the music section is performed so that the video section can be synchronized with the video section. A dramatic video production support device having climax matching means for synchronizing music sections.