JP4337034B2 - Editing system and control method thereof - Google Patents

Description

  The present invention relates to an editing system and a control method therefor, and is suitable for application to an on-air system used in, for example, a television broadcasting station.

2. Description of the Related Art Conventionally, in an on-air system, video and audio obtained through interviews and the like are accumulated in an AV (Audio Visual) server, the video and audio are read out by an editing device, processed and edited, and the resulting edited video and audio are processed into an AV server. The edited video and audio registered in the AV server can be read and broadcast at a predetermined timing. (For example, refer to Patent Document 1).
JP-A-10-285533

  By the way, in the AV server of the above-mentioned on-air system, the video of the video and audio obtained by the interview or the like is recorded at the NTSC (National Television System Committee) field frequency 59.94 [Hz]. Some audio is recorded at a sampling frequency of 48 [kHz]. In this case, if the audio is equally divided for each frame frequency of the video (frame frequency = field frequency / 2), the number of audio samples per frame becomes 1601.60.

  Therefore, the number of samples is assigned to each frame in units of 5 frames in which the number of audio samples is just divisible, and the number of audio samples per 5 frames is 8008. 1601, 1602, 1601, 1602 are assigned.

  Such a method of synchronizing video and audio in units of 5 frames is called a 5 frame sequence, and the AV server records video and audio in this 5 frame sequence.

  In addition, in the editing apparatus of the on-air system as described above, the video / audio stored in the AV server is read, and only the processed and edited part of this video / audio is registered in the AV server as the edited video / audio. Can be registered in a shorter time than registering all parts of the video and audio read from the AV server as edited video and audio in the AV server This is considered by the applicant of the present patent application.

  However, in this case, if the video / audio is recorded on the AV server in a 5-frame sequence as described above, the editing apparatus cannot recognize the number of samples for each frame of the video / audio, and the editing process is performed. Therefore, the number of samples of the part that has not been processed and edited originally recorded in the AV server and the number of samples of the part that has been processed and edited by the editing device deviate. As a result, the AV server joins them. In this case, there is a problem that a discontinuity of sound occurs at this joint.

  The present invention has been made in consideration of the above points, and an object of the present invention is to propose an editing system and a control method therefor that can reliably avoid discontinuity of speech.

  In order to solve such a problem, in the present invention, the storage and holding means for synchronizing and storing video and audio of the video and audio data in units of a predetermined plurality of frames, and the storage and holding means according to the edit list defining the editing contents are required. The video / audio data is read and processed and edited to generate an edited video / audio corresponding to the editing list, and the editing means for registering the edited video / audio in the memory holding means and the video / audio data required by the editing means are read out. The synchronization information detecting means for detecting the synchronization information of the video / audio data, and the editing means only edits the edited and edited portion of the video / audio data based on the synchronization information detected by the synchronization information detecting means. The edited video / audio is generated and the edited video / audio is registered in the memory holding means, and the memory holding means is processed and edited in the video / audio data. And by connecting the edited video audio only processed and edited portion of the audiovisual data registered so as to play the part and editing means no.

  As a result, this editing system prevents the audio from becoming discontinuous at the joint between the unedited portion of the video / audio data and the edited video / audio of only the edited portion of the video / audio data. can do.

  In the present invention, the first step of synchronizing the video and audio of the video / audio data in units of a predetermined plurality of frames and storing and holding the same in the storage and holding unit and the editing and holding list in accordance with the editing list that defines the editing contents are necessary. A second step of reading out the video / audio data and detecting synchronization information of the video / audio data, a third step of processing and editing the read-out video / audio data according to the editing list in the editing means, and a video based on the synchronization information A fourth step of generating edited video / audio of only the edited and edited portion of the audio data in the editing means and registering the edited video / audio in the memory holding means; and a portion of the audio / video data that has not been processed and edited And edited video and audio of only the edited and edited portion of the video and audio data registered by the editing means It was provided with a fifth step of reproducing by connecting the lifting means.

  As a result, according to the control method of this editing system, the audio is discontinuous at the joint between the part of the video / audio data that has not been processed and edited and the edited video / audio of only the processed and edited part of the video / audio data. Can be prevented.

  According to the present invention, in the editing system, the audio becomes discontinuous at the joint between the part of the video / audio data that has not been edited and edited and the edited video / audio of only the processed and edited part of the video / audio data. Thus, it is possible to realize an editing system that can reliably avoid the discontinuity of sound.

  According to the present invention, in the control method of the editing system, the audio is connected at the joint between the part of the video / audio data that has not been edited and edited and the edited video / audio of only the part of the video / audio data that has been edited and edited. It is possible to prevent the discontinuity, and thus it is possible to realize an editing system control method capable of reliably avoiding the discontinuity of the sound.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

(1) Configuration of on-air system according to this embodiment In FIG. 1, reference numeral 1 denotes an on-air system according to this embodiment installed as a whole in a television broadcasting station or the like. The video / audio data in HDCAM (Sony Corporation) format having a resolution of about 140 [Mbps] reproduced by a video tape recorder (not shown) and reproduced from an interview tape (hereinafter referred to as high-resolution video / audio data). D1 is input to the material server 3 and the down converter 4 via the router 2.

  The material server 3 is a large-capacity AV server composed of a plurality of RAIDs (Redundant Arrays of Independent Disks), and is supplied via the router 2 under the control of the system control unit 5 composed of a personal computer. The series of high-resolution video / audio data D1 is stored as a file.

  The down-converter 4 down-converts the supplied high-resolution video / audio data D1 to a resolution of about 8 [Mbps] and compresses and encodes this in the MPEG (Motion Picture Experts Group) format. Video / audio data (hereinafter referred to as low-resolution video / audio data) D2 is sent to the proxy server 6.

  Similar to the material server 3, the proxy server 6 is an AV server composed of a plurality of RAIDs, and a series of low-resolution video / audio data D 2 supplied from the down converter 4 under the control of the system control unit 5. Is stored as a file. In this way, in this on-air system 1, a low-resolution clip having the same content as the clip recorded in the material server 3 is recorded in the proxy server 6.

The low-resolution video / audio data D2 of each clip stored in the proxy server 6 is sent to each proxy editing terminal device 8 ₁ to 8 _n and each editing terminal connected to the proxy server 6 via the Ethernet (registered trademark) 7. Video and audio that can be read out using the devices 9 _{1 to} 9 _n and processed and edited by connecting which clips and which clips from the clips stored in the material server 3 in any order. The proxy editing terminal devices 8 ₁ to 8 _n and the editing terminal devices 9 _{1 to} 9 _n create an editing list that defines editing contents only for cut editing, such as whether to generate (hereinafter referred to as edited video and audio). be able to.

In practice, each of the proxy editing terminal devices 8 ₁ to 8 _n has one of the clips recorded in the proxy server 6 by the operator in the edit list creation mode in which dedicated software for creating the edit list is activated. When a clip is selected and a playback command is input, the proxy is accessed by accessing the system control unit 5 via the Ethernet (registered trademark) 7 and controlling the proxy server 6 via the system control unit 5. The server 6 is made to read the low-resolution video / audio data D2 of the clip.

Then, the proxy editing terminal devices 8 ₁ to 8 _n decode the low-resolution video / audio data D2 read out from the proxy server 6 in this way, and display the video based on the obtained baseband video / audio data on the display. To do. Thus, the operator can create an edit list for only cut editing while visually confirming the video displayed on the display. In the following, such an edit list for only cut editing is referred to as an EDL (Edit Decision List).

Further, the edit list data, which is the edit list data created in this way, is sent from the proxy edit terminal devices 8 ₁ to 8 _n to the desired edit terminal device 9 ₁ via the Ethernet (registered trademark) 7 by the operator's operation. ~ 9 _n can be transferred. The transferred editing list data is stored and managed by the editing terminal devices 9 _{1 to} 9 _n .

On the other hand, the editing terminal devices 9 _{1 to} 9 _n are non-linear editing devices equipped with a video board capable of performing video special effect processing on the high-resolution video / audio data D1 in real time. In the list creation mode, when one clip is selected from clips recorded in the proxy server 6 by the operator and a playback command is input, the proxy server 6 is controlled via the system control unit 5. Thus, the low-resolution video of the clip is displayed on the display in the same manner as the proxy editing terminal devices 8 ₁ to 8 _n .

As a result, the operator visually confirms the video and edits the final edit list including the video special effects and audio mixing settings newly or created using the proxy editing terminal devices 8 ₁ to 8 _n. Can be created using a list.

The editing terminal devices 9 _{1 to} 9 _n are respectively connected with video tape recorders 11 _{1 to} 11 _n and local storages 12 _{1 to} 12 _n such as hard disk devices, and thus the video and audio material recorded on the video tape or the like. Are taken into the local storages 12 _{1 to} 12 _n as clips via the video tape recorders 11 _{1 to} 11 _n and can be used for editing.

In addition, the editing terminal devices 9 _{1 to} 9 _n each specify the Ethernet (when the IN and OUT points of a desired video / audio portion of one clip are specified and arranged on the timeline in the process of creating the editing list. By accessing the system control unit 5 via the registered trademark 7 and controlling the gateway 13 via the system control unit 5, the high resolution of the video and audio portions arranged on the timeline in the gateway 13 The audio / video data D1 is sequentially read from the material server 3.

The high-resolution video / audio data D1 is converted into a predetermined format by the gateway 13 under the control of the system control unit 5, and then a semiconductor having a storage capacity of, for example, about 180 gigabytes via the fiber channel switcher 14. The data I / O cache units 15 ₁ to 15 _{n made} of a memory are given and stored.

Thus editing terminal device 9 ₁ to 9 _n, when reproducing (preview) command by the high resolution image for editing list by the operator after the is input, high required from the corresponding data I / O cache unit 15 ₁ to 15 _n The resolution video / audio data D1 is read out, and an edited video based on the high-resolution video / audio data D1 is generated and displayed on the display.

The editing terminal devices 9 _{1 to} 9 _n eventually complete the editing list creation work by the operator, and when an editing list execution command is input thereafter, the data I / O cache units 15 ₁ to 15 _n are operated according to the editing list. sequentially reads high-resolution video and audio data D1 corresponding from 15 _n, while subjected to a special effect processing and audio mixing as necessary for this high-resolution video and audio data D1, thus obtained edited video and audio data ( This is hereinafter referred to as edited video / audio data) D3 is sent to the material server 3. As a result, the edited video / audio data D3 is filed and recorded in the material server 3 under the control of the system control unit 5.

  Further, the edited video / audio data D3 recorded in the material server 3 is then transferred to an on-air server (not shown) by an operator's operation, and then read out from the on-air server according to a so-called playlist created by a program creator or the like. To be broadcast.

  In this manner, the on-air system 1 can efficiently perform a series of processing from editing to on-air of the edited video and audio obtained by the editing.

(2) where the editing terminal ₉ 1 to 9 _n configuration of the editing terminal device ₉ 1 to 9 _n, as shown in FIG. 2, CPU (Central Processing Unit) 20, ROM (Read Only Memory) 21 and RAM ( Random Access Memory) 22, a hard disk device 23 in which various software are stored, a data processing unit 24 having various video data processing functions and audio data processing functions, and a video special designated for the high-resolution video / audio data D1. The video special effect and audio mixing processing unit 25 that performs effect processing and audio mixing processing and various interface units 26 to 28 are connected via the CPU bus 29, and the Ethernet (registration) is connected via the interface unit 26. Trademark) 7.

The interface unit 27 is connected to input devices such as a mouse 30 and a keyboard 31, and the interface unit 28 is connected to video tape recorders 11 _{1 to} 11 _n and local storages 12 _{1 to} 12 _n. A display 32 and a speaker 33 are connected to each other.

  Then, when necessary, the CPU 20 reads the screen data stored in the hard disk device 23 and gives it to the data processing unit, thereby displaying various windows and dialogs as described below on the display.

Further, when necessary, the CPU 20 sends a command to the system control unit 5 (FIG. 1) through the interface unit 26 and the Ethernet (registered trademark) 7 so that the material server 3 (FIG. 1) or The proxy server 6 (FIG. 1), gateway 13 (FIG. 1), FC switcher 14 (FIG. 1), data I / O cache units 15 ₁ to 15 _n (FIG. 1), and the like are controlled to a desired state.

  Then, for example, as a result of this, the CPU 20 takes in the low-resolution video / audio data D2 of the clip designated by the operator, which is transferred from the proxy server 6 via the Ethernet (registered trademark) 7, via the interface unit 26, and this is received as data. By giving to the processing unit 24, the video based on the low-resolution video / audio data D2 is displayed at a predetermined position in the corresponding window or dialog.

Further, the CPU 20 controls the video special effect and audio mixing processing unit 25 when necessary to read out the corresponding high resolution video / audio data D1 from the data I / O cache units 15 ₁ to 15 _n , and the high resolution video. Video special effect processing and audio mixing processing are executed on the audio data D1 as necessary.

  Then, the edited video / audio data D3 obtained as a result is provided to the data processing unit 24, whereby the edited video obtained by the video special effect processing based on the edited video / audio data D3 is displayed on the display 32, and The edited sound obtained by the sound mixing process is output from the speaker 33.

  At this time, the CPU 20 controls the video special effect and audio mixing processing unit 25 as necessary to send out the edited video / audio data D3 to the material server 3, while the material server 3 via the system control unit 5. The edited video / audio data D3 is stored, and the edited video / audio data D3 is registered in the material server 3.

(3) Procedure for preparing and editing terminal device ₉ 1 to 9 edited in _n list will now be described a procedure of creating the edit list in this editing terminal device ₉ 1 to 9 _n.

In the editing terminal devices 9 _{1 to} 9 _n , a desired video / audio part of a desired clip recorded in the material server 3 or the like is specified, and the cut video transmission order is set by sequentially arranging them on the timeline. At the same time, the edit list is created by setting the video special effect process and the audio mixing process and inserting the title.

  In the edit list created in this way, the time code of the in and out points of each cut, the order of cuts, information such as the edit list name, creator and creation date and time (EDL information), Information regarding the contents of the set video special effects and audio mixing, various information regarding the work environment when the edit list is created, and the like are stored in one file and managed as a “project”.

  For this reason, when a new edit list is created, it is necessary to create a new project. In this case, the operator first activates the corresponding software to display a project manager window 40 as shown in FIG. (FIG. 2).

  Here, the project manager window 40 is a window for managing and browsing the project, and includes a tree display unit 41, a clip display unit 42, and a project list display unit 43.

At this time, the tree display unit 41 of the project manager window 40 has a project file server 10 for centrally managing project files (hereinafter referred to as project files) in the editing terminal devices 9 _{1 to} 9 _n and as described later. For all project files existing in the folder, the storage locations of these project files are displayed in a tree format.

  The clip display unit 42 displays a list of thumbnail images of the clips belonging to the project selected in the tree display unit 41 as icons (hereinafter referred to as clip icons) 44, and the clip list display unit 43 further displays the thumbnail images. For each project displayed in the tree display section 41, management information such as a storage drive name, a project name, and an update date and time is displayed as text in a list format.

  When creating a new project, the operator clicks the new creation button 45A in the button group 45 displayed at the top of the project manager window 40 to display the new project dialog 50 shown in FIG. Then, a desired project name is input in the project name input box 51 of the new project dialog 50, and various attributes relating to the project are set in the attribute setting unit 52, and then an OK button 53 is clicked.

Thus, the new project is newly registered in the editing terminal devices 9 _{1 to} 9 _n and the project file server 10, and a new folder and bin are automatically created in the project, and the result is displayed in the project manager window. It is reflected in the tree display section 41 and the project list display section 43 of 40 (FIG. 3).

  At this time, a clip explorer window 60 shown in FIG. 5 and a server site explorer window 61 having the same configuration are displayed on the display 32 (FIG. 2).

  The clip explorer window 60 is a window for displaying and managing clips belonging to the currently opened project, and includes a tree display unit 62 and a clip display unit 63.

  The tree display section 62 of the clip explorer window 60 displays all projects existing in the system and their contents (folders, bins, etc.) in a tree format. The clip display section 63 displays the tree display section 62. A list of the clip icons 64 of all the clips belonging to the bin selected in is displayed. In the initial state immediately after the new project is created, there are no clips belonging to the project, and therefore the clip icon 64 is not displayed in the clip display portion 63 of the clip explorer window 60.

  The server site explorer window 61 is a window for displaying a list of clips recorded in the material server 3 and the proxy server 6, and includes a tree display unit 62 and a clip display unit 63, similar to the clip explorer window 60. Is done.

  In the tree display portion 62 of the server site explorer window 61, all folders and files in the material server 3 and the proxy server 6 are displayed in a tree format, and the cup display portion 63 is selected in the tree display portion 62. Clip icons 64 of all clips stored in the folder or the like are displayed.

When creating a new edit list, the operator creates a new project as described above, and then clicks a new sequence creation button 65A in the button group 65 displayed at the top of the clip explorer window 60. Like that. As a result, the clip icon 64 _NS corresponding to the edit list to be created is displayed in the clip display section 63 of the clip explorer window 60, and a timeline editor window 70 as shown in FIG. 2).

  The timeline editor window 70 arranges the source viewer unit 71 for performing an operation of cutting out a desired portion as a cut while visually confirming the clip image, and how to arrange the cuts thus cut out. At that time, a timeline unit 72 for setting editing contents such as what kind of special effect is applied at the joint of cuts, and a master viewer for confirming the editing contents set in the timeline unit 72 by a high-resolution video. Part 73.

  The operator then drags and drops the clip icon 64 of the desired clip from the clip icons 64 (FIG. 5) displayed in the clip display section 63 (FIG. 5) of the server site explorer window 61 (FIG. 5). The clip can be selected as a clip to be used for editing by moving it into the source viewer section 71 of the line editor window 70, and a plurality of clips can be selected collectively by repeating this operation.

  In the timeline editor window 70, by clicking the clip selection menu display button 74 displayed on the upper side of the source viewer section 71, a list of clips selected as described above can be displayed as a menu. A desired clip can be selected from the menu as a clip to be edited.

  Note that, for example, the video of the first frame of the selected clip is displayed in the source viewer section 71, and the name of this clip is displayed in the clip list box 75 and also displayed in the source viewer section 71 of the clip. The time code of the frame and the material length of the clip are displayed in the time code display section 76.

  In the timeline editor window 70, a video based on the low-resolution video / audio data D2 (FIG. 1) recorded in the proxy server 6 (FIG. 1) of the clip selected as the editing target in this way is displayed in the source viewer section 71. By clicking the corresponding command button from the command button group 77 displayed on the lower side, normal playback, frame advance playback, frame back playback, and the like can be performed.

  In practice, when the command button for normal playback, frame-by-frame playback or frame-by-frame reverse playback is clicked from the command button group 77 in the CPU 20 (FIG. 2), the system controller 5 By controlling the proxy server 6 via (FIG. 1), the low-resolution video / audio data D2 of the corresponding video / audio part in the clip is read in the playback mode corresponding to the clicked command button 72. As a result, a low-resolution normal playback video, a frame-by-frame playback video, a frame-by-frame reverse playback video, or the like based on the low-resolution video / audio data D2 is displayed on the source viewer unit 71.

Thus, the operator visually confirms the playback video of the clip displayed on the source viewer unit 71 and presses the mark-in button 77 _IN and the mark-out button 77 _OUT of the command buttons 77 while the desired video is displayed. By clicking, it is possible to specify the start point (in point) and end point (out point) of the video / audio part to be used as a cut from the video / audio of this clip.

  On the other hand, the operator can create an edit list by the following procedure using the audio / video portion to be used as a cut for each clip whose range is specified in this way.

First, as described above, after specifying the range of the video / audio part to be used as a cut of the clip, the play line 78 displayed in the time line part 72 is displayed as the time displayed at the lower part of the time line part 72. The scale 79 is used as an index to move to a desired position by a mouse operation, and thereafter, an overwrite button 77 _O or a splice-in button 77 _S in the command button group 77 displayed at the bottom of the source viewer section 71 is clicked. .

As a result, as shown in FIG. 7, overwriting when the overwrite button 77 _O is clicked, so as to insert when the splice IN button 77 _S is clicked, on the video track 80 _V of the time line part 72, the video and audio portions of the material length length of the colored area 81 _V corresponding to the to the top position the position of the play line 78 is displayed at that time.

At this time, if audio is attached to the video / audio portion, the audio tracks 80 corresponding to the number of corresponding channels among the plurality of audio tracks 80 _A1 to 80 _A4 provided below the video track 80 _V. on _A1 to 80 _A4, the video track 80 _V corresponding colored region 81 colored region ₈₁ of the same length as the _V A1 _{to 81 A4} of which the start position the position of the play line 78 at that time, respectively, are displayed.

At this time, the CPU 20 notifies the system control unit 5 of a command corresponding to the operation of the operator. As a result, under the control of the system control unit 5, the high-resolution video / audio data D1 of the video / audio portion of the corresponding clip from the material server 3 (FIG. 1) is about several seconds on the in-point side and the out-point side. read out remembering margin, which gateway 13 (FIG. 1), FC switcher 14 applied to data I / O cache unit ₁₅ 1 to 15 _n of the editing terminal device ₉ 1 to 9 for _n via (FIG. 1) And memorized.

If you want to output audio other than the audio accompanying the video / audio part during playback of the edited video / audio, click the clip selection menu display button 74 and register it in advance from the list of clips displayed at this time. After selecting the clip of the audio that has been placed, the play line 78 of the timeline unit 72 is moved to a desired position, and then the desired audio tracks 80 _A1 to 80 _A4 are designated, and then the above-described overwrite button 77 _{O is selected.} or so as to click the splice-in button 77 _S.

And also in this case, the colored areas ₈₁ A1 _{to 81} positions of the head position to a length corresponding to the material length of the clip play line 78 at that time on the audio track ₈₀ A1 _{to 80 A4} its designated _A4 Is displayed and the audio data is read from the material server 3 and stored in the data I / O cache units 15 ₁ to 15 _n. Become.

Then, the operator designates the range of the video / audio part to be used as the cut as described above (determines the cut) and pastes the video / audio part to the timeline unit 72 (video track) for each desired clip. 80 _V and / or the display of the colored areas 81 _V and 81 _{A1 to} 81 _A4 on the audio tracks 80 _A1 to 80 _A4 are repeated, and as shown in FIG. 8, the beginning of the time scale 79 (“00:00 : 00: 00 "), the colored areas 81 _V and 81 _{A1 to} 81 are respectively formed on the video track 80 _V and the audio tracks 80 _A1 to 80 _A4 so as to be continuous on the time scale 79 for a desired time. _A4 is sequentially displayed.

Here, since the colored areas 81 _V and 81 _{A1 to} 81 _A4 are displayed on the video track 80 _V and the audio tracks 80 _A1 to 80 _A4 of the timeline unit 72 in this way, the time scale is displayed when the edited video and audio are played back. see the video of the corresponding portion of the video and audio portions and corresponding the colored area 81 _V, 81 _A1 ~81 _A4 to time expressed in 79 or audio means to be output. Therefore, it is possible to create an edit list that defines the order and contents of video and audio displayed or output as edited video and audio by such work.

Incidentally, the number of video tracks 80 _V and audio tracks ₈₀ A1 _{to 80 A4} to be displayed in the time line part 72 can be freely set. And in a state where a plurality of video tracks 80 _V and audio tracks ₈₀ A1 _{to 80 A4} is displayed, if these video track 80 _V or respectively cut and clip the audio tracks ₈₀ A1 _{to 80 A4} is pasted , images superimposed each picture at the same position on the time scale 79 at each of the video track 80 _V is obtained as edited video, overlapping each voice in the same position on the time scale 79 at each audio track 80 _A1 to 80 _A4 The combined voice is obtained as the edited voice.

  Further, when the edit list is created in this way, for example, when it is desired to perform special effect processing at the time of switching from a continuous first cut video to a second cut video, a desired video special effect is performed by the following procedure. Processing settings can be made.

That is, first, the preceding first cut and the following second cut are pasted on the video track 80 _V so as to be continuous on the time scale 79, and then the buttons displayed on the upper portion of the time line portion 72. Click the FX explorer button 82 _FX in the group 82. As a result, for example, an FX explorer window 90 as shown in FIG. 9 is displayed on the display 32 (FIG. 2).

The FX explorer window 90 includes a tree display unit 91 and an icon display unit 92. The tree display unit 91 displays various video special effects that can be executed by the editing terminal devices 9 _{1 to} 9 _n in a tree format. At the same time, the contents of these video special effects are displayed in an icon format on the icon display unit 92.

Subsequently, a special effect icon 93 for a desired video special effect process is dragged and dropped from icons (hereinafter referred to as special effect icons) 93 displayed in the icon display unit 92 of the FX explorer window 90. , pasted on the joint of the aforementioned first and second cut in the video track 80 _V of the time line editor window 70.

During generation of the edited video Thus, video special effect processing corresponding to the special effect icon pasted to the video track 80 _V as described above in the first cut of the video switch to the video of the second cut Is set to be executed.

Incidentally, the mark thus the special effect icon 93 when performing an operation of pasting the video track 80 _V of the time line editor window 70, as shown in FIG. 8, in accordance with the special effect icon 93 in its application position 94 is displayed.

Also when creating an edit list, either when it is desired subjecting the audio mixing for the pasted cut and clip the audio to an audio track 80 _A1 to 80 _A4, the desired audio mixing according to the procedure described below Can be set.

That is, first the play line 78 displayed on the time line part 72 of the time line editor window 70, the corresponding cut or clip desired audio mixing among the cuts or clips pasted to the audio tracks 80 _A1 to 80 _A4 After moving the coloring area 81 _{A1 to} 81 _A4 , the audio mixer button 82 _MIX is clicked from the button group 82 displayed on the upper part of the timeline portion 72.

As a result, as shown in FIG. 10, respectively corresponding to the audio track ₈₀ A1 _{to 80 A4} of the time line part 72 of the time line editor window 70, the volume 101 and the level meter 102 and various setting buttons 103A~103F etc. An audio mixer window 100 provided with a plurality of mixing units 104 is displayed.

And after this, this is displayed in the audio mixer window 100, a desired audio track ₈₀ A1 _{to 80 A4} and the associated volume 101 and setting buttons 103A~103F like timeline portion 72 of the time line editor window 70 The level meter 102 is operated while visually checking.

As a result, at the time of output of the edited audio, the setting that the audio data should be subjected to the audio mixing processing with the contents set as described above when the video / audio portion pasted on the audio tracks 80 _A1 to 80 _A4 is reproduced. It will be done.

Further, the timeline editor window 70 moves the playline 78 in the timeline unit 72 to a desired position by operating the mouse after completing the creation of the edit list as described above or during the creation of the edit list. By clicking the preview button 110 _PV from the command button group 110 displayed on the lower side of the master viewer section 73, the video / audio part corresponding to the position of the play line 78 at that time is used as a starting point, and the high resolution The edited video can be normally reproduced and displayed in the master viewer unit 73.

In practice, when the preview button 110 _PV is clicked, the CPU 20 controls the video special effect and audio mixing processing unit 25 (FIG. 2), so that the data I / O cache units 15 ₁ to 15 _n are at this time. The high-resolution video / audio data D1 of the corresponding video / audio part stored and held is read, and the high-resolution video / audio data D1 is subjected to video special effect processing and audio mixing processing as necessary.

  As a result, high-resolution edited video / audio data D3 obtained by the video special effect processing and audio mixing processing is generated, and is provided to the data processing unit 24 (FIG. 2), whereby the edited video / audio data D3 is generated. The edited video is reproduced and displayed in the master viewer section 73 of the timeline editor window 70, and the edited audio is output from the speaker 33 (FIG. 2).

  As a result, the operator creates an edit list while visually confirming (previewing) the edit contents as needed based on the edited video displayed in the master viewer section 73 of the timeline editor window 70, or the edit list that has been created. The contents of can be confirmed.

After creating the edit list in this way, the clip site 64 _NS (FIG. 5) corresponding to the edit list displayed in the clip display section 63 of the clip explorer window 60 (FIG. 5) is dragged and dropped to the server site. An edit result based on this edit list can be registered in the material server 3 (FIG. 1) by being moved into the clip display section 63 of the explorer window 61 (FIG. 5).

  At this time, as shown in FIG. 11A, the operator selects the editing video / audio of the entire range of the editing video / audio based on the editing list as a registration mode when registering the editing result based on the editing list in the material server 3. The entire registration mode for registering the data D3 in the material server 3, and the edited video / audio of each video / audio portion subjected to the video special effect processing or the audio mixing processing of the edited video / audio as shown in FIG. Either one of the batch partial registration modes in which only the data D3 is batch registered can be selected and set. In the following description, the video special effect processing and the audio mixing processing are collectively referred to as special effect processing, and the video / audio portion on which the video special effect processing or audio mixing processing has been performed is referred to as a special effect portion.

Then, a dialog for selecting these registration modes (hereinafter referred to as a registration mode dialog) is displayed on the server site explorer window 61 (FIG. 5) by dragging and dropping the clip icon 64 _NS (FIG. 5). Displayed when moved into the display unit 63.

If the entire registration mode is selected as the registration mode at this time, it is assumed that the edited video / audio defined by the edit list created at that time is composed of video / audio portions A, B, and C as shown in FIG. All of the edited video / audio data D3 is generated, given to the material server 3, and stored in the file corresponding to the above-mentioned clip icon 64 _NS (FIG. 5) (hereinafter referred to as a clip file). . At the same time, a virtual file (hereinafter referred to as VFL (Virtual File List)) defining the playback order of the video / audio portions A, B and C is given to the material server 3 and registered.

On the other hand, when the batch partial registration is selected as the registration mode, the edited video / audio based on the edit list created at that time is composed of, for example, video / audio portions A, B, and C as shown in FIG. Since the special effect process is performed at the joint between the video / audio part B and the video / audio part C, the video / audio part B is changed from the non-special effect part B1 not subjected to the special effect process to the video / audio part C. And a special effect portion B2 that becomes a joint with the video and audio portion C, and a special effect portion C1 that becomes a joint with the video and audio portion B and a non-special effect portion C2. If it is determined that the edited video / audio data D3 of only the special effect portions B2 to C1 is generated, the edited video / audio data D3 is given to the material server 3 and clicked corresponding to the clip icon 64 _NS described above. Stored in the profile file. At the same time, a VFL that defines the playback order of the video and audio portions A, B, and C is given to the material server 3 and registered.

  When the editing result is partially registered in this way, when the editing result is reproduced, as shown in FIG. 13, it is adopted as the edited video / audio of the clip originally recorded in the material server 3. Part (video / audio part A, video / audio part B non-special effect part B1 and video / audio part C non-special effect part C2) and part registered in the material server 3 as a clip file (special effect parts B2 and C1) Are sequentially read from the material server 3 according to the VFL.

On the other hand, in the editing terminal devices 9 _{1 to} 9 _n , as described above, the edited video / audio data of the special effect portion is used as the partial registration mode in which the editing result based on the created editing list is partially registered in the material server 3. In addition to the batch partial registration mode in which only D3 is registered in the material server 3 after the edit list is created, only the edited video / audio data D3 of the special effect portion is sequentially registered in the material server 3 in the edit list creation stage. A partial registration mode is provided.

In the editing terminal devices 9 _{1 to} 9 _n , when the sequential partial registration mode is set as an initial setting, the preview button of the command button group 110 in the timeline editor window 70 (FIG. 6) is in the process of creating the edit list. Each time 110 _PV is clicked, normal reproduction display is performed for the special effect portion in which special effect processing is set to be performed, the video / audio data D3 of only the special effect portion at this time is stored in the material server. 3 is sequentially registered. This partial edited video / audio data D3 is stored in a clip file generated in the material server 3 in correspondence with the edit list.

  In addition, when such partial edited video / audio data D3 is registered in the material server 3, a setting is made to perform the corresponding special effect processing in the timeline unit 72 of the timeline editor window 70. A line 120 as shown in FIG. 14 is displayed above the special effect portion.

Thereafter, the creation of the edit list is completed, and the clip icon 64 _NS (FIG. 5) corresponding to the edit list is moved into the clip display section 63 of the server site explorer window 61 (FIG. 5) by drag and drop. Then, among the special effect parts in the edited video and audio based on this edit list, the edited video and audio data D3 of these special effect parts is generated for the special effect parts that are not yet registered in the material server 3 as the edited video and audio data D3. This is transferred to the material server 3 at a time. The partial edited video / audio data D3 is stored in the clip file generated in the material server 3 in association with the edit list as described above.

  At the same time, a VFL that defines the playback order of the edited video and audio based on this edit list is given to the material server 3 and registered.

In this way, in the editing terminal devices 9 _{1 to} 9 _n , the editing result is remarkably faster than when the editing video / audio data D3 of the entire range based on the created editing list is registered in the material server 3. Can be registered in the material server 3.

  By the way, in the material server 3 of this on-air system 1, in order to synchronize the video and audio of the high-resolution video / audio data D1 supplied via the router 2 (FIG. 1), the high-resolution video in a 5-frame sequence. The video and audio of the audio data D1 are recorded.

  That is, as shown in FIG. 15, the video and audio of the high-resolution video / audio data D1 are grouped in units of 5 frames, and the number of audio samples (8008) for 5 frames is 1602, 1601, 1602, 1601 for each frame. 1602 are assigned.

  In order to define the order of the assigned number of samples, a number (hereinafter referred to as a sequence number) is assigned to the number of samples for each frame, and the sequence number “ 0 ”(1602), sequence number“ 1 ”(1601), sequence number“ 2 ”(1602), sequence number“ 3 ”(1601), and sequence number“ 4 ”(1602).

  The material server 3 synchronizes the video and audio in units of 5 frames while circulating the number of audio samples for each frame in the sequence number order (0 to 4, 0 to 4,...). In addition, the sequence number for each frame is added to the high-resolution video / audio data D1 for recording.

However, after the editing terminal devices 9 _{1 to} 9 _n read the high-resolution video / audio data D1 recorded in the 5-frame sequence in this way and edit it as shown in FIG. 12, for example, the special effect portion B2 When the video / audio data D3 of only C1 is registered in the material server 3 as a clip file, the editing terminal devices 9 _{1 to} 9 _n have a five-frame sequence in the high-resolution video / audio data D1 originally recorded in the material server 3. Since the video / audio data D3 is not generated based on the above information (hereinafter referred to as 5-frame sequence information), when the editing result is reproduced according to the VFL as shown in FIG. in joint of the special effect part B2 generated by the non-special effects portion B1 that was edited terminal device 9 ₁ to 9 _n There is a problem that the voice of the discontinuity occurs.

Therefore, in the on-air system 1, the editing terminal devices 9 _{1 to} 9 _{n use} the high resolution video recorded in the material server 3 as the editing result based on the editing list created in the collective partial registration mode or the sequential partial registration mode. The information is partially registered in the material server 3 according to the 5-frame sequence information of the audio data D1.

In practice, the editing terminal devices 9 _{1 to} 9 _n perform an operation of pasting the video / audio portion of the clip necessary for creating the edit list to the timeline unit 72 on the timeline editor window 70 (FIG. 6) as described above. Is performed, a command corresponding to the operation is notified to the system control unit 5 (FIG. 1).

  The system control unit 5 controls the gateway 13 according to this command to cause the gateway 13 to read out the high-resolution video / audio data D1 of the video / audio part in the necessary clip from the material server 3.

  At this time, the gateway 13 confirms the sequence number added to the high-resolution video / audio data D1 for each frame, and as shown in FIG. 16, the sequence of the first frame of the high-resolution video / audio data D1. The number, the frame number where the sequence number becomes discontinuous, and the sequence number at this time are detected.

  Since the high-resolution video / audio data D1 is a video / audio portion cut out from the clip, the top sequence number does not always start with “0”, and the sequence numbers are basically continuous. This sequence number becomes discontinuous at an edit point or the like. Therefore, if it is not known how many sequence numbers of the first frame are and how many frame numbers the sequence numbers are discontinuous, a specific frame number (for example, a non-special effect part B1 and a special effect part B2) Therefore, it is necessary to detect the sequence number of the first frame, the frame number at which the sequence number becomes discontinuous, and the sequence number at this time.

Then, the gateway 13 (FIG. 1) converts the format of the high-resolution video / audio data D1 into a predetermined format and then transfers it to the corresponding data I / O cache units 15 ₁ to 15 _n via the FC switcher 14. The sequence number of the detected first frame, the frame number at which the sequence number becomes discontinuous, and the sequence number at this time are added to the high-resolution video / audio data D1 as 5-frame sequence information, and the 5-frame sequence information is added. The high-resolution video / audio data D1 is stored and held in the corresponding data I / O cache units 15 ₁ to 15 _n .

  As described above, by adding the 5-frame sequence information to the high-resolution video / audio data D1, it is necessary to store and hold the high-resolution video / audio data D1 and the corresponding 5-frame sequence information separately. Because there is no, these can be managed easily.

Then, the editing terminal devices 9 _{1 to} 9 _n receive the high-resolution video of the corresponding video / audio portion stored and held in the data I / O cache units 15 ₁ to 15 _n when the preview button 110 _PV is clicked by the operator. The audio data D1 is read, and special effect processing is performed on the high-resolution video / audio data D1 as necessary, for example, as shown in FIG.

Here, when the editing terminal devices 9 _{1 to} 9 _n are in the collective partial registration mode or the sequential partial registration mode, the edited video / audio data D3 of only the special effect portions B2 and C1 is generated.

First, the editing terminal devices 9 _{1 to} 9 _n detect the frame number of the joint between the non-special effect part B1 and the special effect part B2 in the video / audio part B. Note that the frame number in this case is detected by setting the head frame number of the video / audio part B as “0”.

Next, the editing terminal devices 9 _{1 to} 9 _n refer to the 5-frame sequence information (FIG. 16) added to the high-resolution video / audio data D1 of the video / audio portion B. As a result, the editing terminal devices 9 _{1 to} 9 _n have the sequence number of the first frame of the video / audio part B being “4”, the frame numbers having discontinuous sequence numbers are “200”, “260”,. frame there and can be recognized, wherein the joint of the frame number of the detected non-special effect portion B1 and special effects portion B2 is "201", according to 5-frame sequence as shown in Figure 17 By calculating the cumulative number of samples up to the number “200”, it can be recognized that the cumulative number of samples indicating the end position of the non- special effect portion B 1 is “321922”.

Therefore, the editing terminal devices 9 _{1 to} 9 _n use the audio from the sample next to “ 321922 ”, which is the cumulative number of samples indicating the end position of the non-special effect portion B1 in the video / audio portion B, as the audio of the special effect portion B2. Similarly, by calculating the cumulative number of samples at the end position of the special effect portion C1 in the video / audio portion C, the sound up to the obtained cumulative sample number is used as the sound of the special effect portion C1, and the special effect portions B2 and C1. Video / audio data D3 is generated. The video / audio data D3 is given to the material server 3 and stored and held as a clip file.

Thus, in the material server 3, when the edited result is reproduced according to the VFL as shown in FIG. 13, the partial registration is performed by the non-special effect portion B1 and the editing terminal devices 9 _{1 to} 9 _n originally stored in the material server 3. It is possible to prevent the discontinuity of the sound from occurring at the joint with the special effect portion B2.

(4) Partial Registration Processing Procedure Here, partial registration of the editing result based on the editing list as described above to the material server 3 is performed by the editing terminal devices 9 _{1 to} 9 _n according to the partial registration processing procedure RT1 shown in FIG. This is performed under the control of the CPU 20 (FIG. 2).

In practice, when the partial registration mode is selected in the registration mode dialog or when the partial registration mode is sequentially set as the initial setting, the CPU 20 sets a command button group in the timeline editor window 70 (FIG. 6) during the creation of the edit list. When the preview button 110 _PV of 110 is clicked, the partial registration processing procedure RT1 shown in FIG. 17 is started in step SP0, and in the following step SP1, the video / audio special effect and audio mixing processing unit 25 is controlled to The frame number of the joint between the non-special effect part and the special effect part in the video / audio part is detected.

Subsequently, the CPU 20 proceeds to step SP2, refers to the 5-frame sequence information added to the high-resolution video / audio data D1 of each video / audio portion, and based on the 5-frame sequence information and the frame number detected in step SP1. Thus, the total number of audio samples at the joint between the non-special effect portion and the special effect portion is calculated.

Then, the CPU 20 proceeds to step SP3 to control the video / audio special effect and audio mixing processing unit 25, so that the audio starting from the next sample of the total number of samples calculated in step SP2 is edited as the audio of the special effect portion. The audio data D3 is generated, and this is partially registered in the material server 3 as an editing result. Thereafter, the process proceeds to step SP4 and the partial registration processing procedure is terminated.

(5) Operation and effect of the present embodiment In the above configuration, the on-air system 1 records the high-resolution video / audio data D1 obtained by the interview or the like in the material server 3 in a 5-frame sequence, When the high-resolution video / audio data D1 of the video / audio part necessary for creation is transferred from the material server 3 to the data I / O cache units 15 ₁ to 15 _n , the sequence number of the first frame in the high-resolution video / audio data D1 and The frame number where the sequence number becomes discontinuous and the sequence number at this time are detected by the gateway 13, and these are added to the high resolution video / audio data D1 as 5 frame sequence information.

Then the editing terminal device ₉ 1 to 9 _n, the high-resolution video and audio data D1 of the video and audio portion is read from the corresponding data I / O cache unit ₁₅ 1 to 15 _n, with respect to the high-resolution video and audio data D1 When the special effect processing is performed, the edited video / audio data D3 of only the special effect portion subjected to the special effect processing is generated based on the 5-frame sequence information, and is registered in the material server 3 as a clip file.

  The material server 3 connects and reproduces the non-special effect portion of the video / audio portion originally recorded in the material server 3 and the special effect portion registered in the material server 3 as a clip file.

According to the above configuration, in the on-air system 1, when transferring the high-resolution video / audio data D1 recorded in the material server 3 in the 5-frame sequence to the data I / O cache units 15 ₁ to 15 _n , The five-frame sequence information in the high-resolution video / audio data D1 is detected, and the editing terminal devices 9 _{1 to} 9 _n read the high-resolution video / audio data D1 from the data I / O cache units 15 ₁ to 15 _n and perform special effect processing. When it is applied, the edited video / audio data D3 of only the special effect portion subjected to the special effect processing is generated based on the detected 5-frame sequence information, and this is registered in the material server 3 and originally stored in the material server 3. By connecting to the recorded non-special effect part and playing it back, the non-special effect recorded on the material server 3 is originally recorded. Part and the editing terminal device 9 ₁ to 9 _n by can voice joint of the registered special effect portion in the material server 3 is prevented from becoming discontinuous, thus reliably avoid discontinuity of speech be able to.

(6) Other Embodiments In the above-described embodiment, the case where the present invention is applied to the on-air system 1 configured as shown in FIG. 1 has been described, but the present invention is not limited thereto. In addition, the present invention can be widely applied to editing systems having various other configurations.

  In the above-described embodiment, the case where the high-resolution video / audio data D1 is recorded in a 5-frame sequence in which video and audio are synchronized in units of 5 frames has been described. However, the present invention is not limited to this. The frame unit of the frame sequence may be set in accordance with the video field frequency and the audio sampling frequency handled by the air system 1, and the high-resolution video / audio data D1 may be recorded in the frame sequence of the frame unit.

Further, in the above-described embodiment, the gateway 13 as the synchronization information detecting means detects the 5-frame sequence information as the synchronization information of the high resolution video / audio data D1 when the high resolution video / audio data D1 is transferred. Although the case has been described, the present invention is not limited to this. For example, the material server 3 or the editing terminal devices 9 _{1 to} 9 _n may detect the 5-frame sequence information of the high-resolution video / audio data D1. .

  Furthermore, in the above-described embodiment, when the frame number “0” is set as the first frame of the video / audio portion cut out from the clip, the frame number of the joint between the non-special effect portion and the special effect portion is calculated. However, the present invention is not limited to this, and the first frame of the clip including the video / audio portion is set to frame number “0”, and the joint between the non-special effect portion and the special effect portion in the video / audio portion is described. A frame number may be calculated.

  Further, in the above-described embodiment, the case has been described in which the material server 3 as the storage holding means for storing and holding the video and audio data of each clip obtained by the interview or the like is configured by a plurality of RAIDs. The invention is not limited to this, and various other configurations can be widely applied as the configuration of the material server 3.

Further, in the above-described embodiment, the data I / O cache units 15 ₁ to 15 _n that store and hold the high-resolution video / audio data D1 read from the material server 3 are configured by a semiconductor memory. As described above, the present invention is not limited to this. In short, if it is configured using a storage medium having higher accessibility than the material server 3, it uses a storage medium other than the semiconductor memory. It may be.

Further, in the above-described embodiment, the high-resolution video / audio data D1 is read from the data I / O cache units 15 ₁ to 15 _n in accordance with the selected edit list, and is edited and edited in accordance with the edit list. Although the case where the editing terminal devices 9 _{1 to} 9 _n as the editing means for generating the video are configured as shown in FIG. 2 has been described, the present invention is not limited to this, and various other configurations are widely applied. be able to.

Furthermore, in the above-described embodiment, the system control unit 5 that controls the entire on-air system 1 is applied as a control unit that controls the material server 3 and the data I / O cache units 15 ₁ to 15 _n. However, the present invention is not limited to this. For example, the functions of the system control unit 5 related to the present invention may be provided to the editing terminal devices 9 _{1 to} 9 _n .

  The present invention can be applied to an on-air system used in a television broadcasting station.

It is a block diagram which shows the whole structure of the on-air system by this Embodiment. It is a block diagram which shows the structure of an edit terminal device. It is a basic diagram which shows a project manager window. It is a basic diagram which shows a new project dialog. It is a basic diagram which shows a clip explorer window. It is a basic diagram which shows a timeline editor window. It is a basic diagram which shows a timeline editor window. It is a basic diagram which shows a timeline editor window. It is a basic diagram which shows FX explorer window. It is a basic diagram which shows an audio mixer window. It is a basic diagram which shows whole registration and partial registration. It is a basic diagram which shows the example of edit of a clip. It is a basic diagram which shows reproduction | regeneration of the edit result partially registered. It is a basic diagram which shows the display of the audio | video part by which the partial registration was carried out sequentially. It is an approximate line figure showing an example of circulation of the number of samples in a 5-frame sequence system. It is a basic diagram which shows the example of 5 frame sequence information. It is an approximate line figure showing calculation of the number of samples of a joint. It is a flowchart which shows a partial registration process procedure.

Explanation of symbols

1 ...... on-air system, 3 ...... material _server, 9 1 to 9 _n ...... editing terminal device 13 ...... _gateway, 15 1 to 15 _n ...... data I / O cache unit, CF ...... clip file, D1 ... high resolution video / audio data, D3 ... edited video / audio data.

Claims (4)

Storage and holding means for synchronizing and storing video and audio of video and audio data in units of a predetermined plurality of frames; and
The video / audio data required is read from the storage / holding means according to an edit list that defines the editing content, and the edited video / audio is generated according to the edit list, and the edited video / audio is stored in the storage / holding means. Editing means to register with
Synchronization information detecting means for detecting synchronization information of the video / audio data when the editing means reads out the necessary video / audio data;
The editing means is
Based on the synchronization information detected by the synchronization information detecting means, the edited video / audio is generated only for the processed and edited portion of the video / audio data, and the edited video / audio is registered in the storage holding means,
The memory holding means is
A portion of the video and audio data that has not been edited and edited and an edited video and audio of only the portion of the video and audio data registered by the editing means that has been edited and edited are played back. Editing system. The synchronization detection means includes
The editing system according to claim 1, wherein the synchronization information is added to the video / audio data read by the editing unit. A first step of synchronizing the video and audio of the video and audio data in units of a predetermined plurality of frames and storing and holding the same in the storage and holding means;
A second step of reading out the necessary video / audio data from the storage / holding means according to an edit list defining the editing content, and detecting synchronization information of the video / audio data;
A third step of processing and editing the read video / audio data according to the editing list in the editing means;
A fourth step of generating, in the editing means, an edited video / audio of only the processed and edited portion of the video / audio data based on the synchronization information, and registering the edited video / audio in the storage / holding means;
A portion of the video and audio data that has not been edited and edited and an edited video and audio of only the portion of the video and audio data registered by the editing means that has been edited and edited are connected and reproduced in the storage and holding means. An editing system control method comprising: a fifth step. In the second step,
The control method of an editing system according to claim 3, wherein the synchronization information is added to the video / audio data read from the upper storage holding means.

Images