JP3841815B2 - How to edit video data - Google Patents

Description

  The present invention relates to a video data editing method, and more particularly to a technique for a video data editing method used for television broadcast program production, video program production, program simulator, presentation, demonstration, and the like.

  In recent years, video data editing systems that produce video data using a computer by combining CG (computer graphics) animation technology, voice synthesis technology, moving image reproduction technology, and the like have been developed.

  Furthermore, it is a system in which a TV program is described in a programming language in the manner of writing a scenario, and this is interpreted by a computer to generate a TV program. There has been considered a video data editing system that displays an editing state on a display screen in a format and can perform an editing operation in an interactive format using a GUI (Graphical User Interface).

  An example of a video and video editing system that produces TV programs by interactive operations between the user and the computer is Toshiaki Yokoyama et al., “Program Generation / Interactive Editing System Based on TV Program Description Language TVML” 3rd Intelligent Information Media Symposium, December 1997, and Toshiaki Yokoyama et al. “Development of Machine Interface for TV Program Description Language TVML” Electronic Information Society Conference, September 1997.

  An example of the editing screen of the video data editing system disclosed in the above document will be described with reference to FIG. FIG. 3 shows a basic editing screen displayed on the monitor. 201 is an editing window, 202 and 202 'are studio blocks, 203 is a movie block, 204 is a title block, 205 is a superimpose character block, 206 is a sound block, 207 is a narration block, 208 is various setting blocks, and 209 is an event Mark, 210 is a serif setting unit, 211 is an operation setting unit, 212 is a camera work setting unit, 214 is another setting unit, 213 and 213 ′ are scroll bars, 215 is a start block, and 11 and 12 are representative screens.

  In the editing window 201, a studio block 202, a movie block 203, a title block 204, a studio block 202 ′, and the like are arranged on the left side of the editing window 201, and indicate video data output on a television screen. Yes. In the editing window 201, the vertical axis is the time axis, and a television program that is broadcast in order from the top to the bottom of the screen is generated.

  For example, in the television program having the configuration shown in FIG. 3, a studio block 202, a movie block 203, a title block 204, and a studio block 202 'are successively arranged from the bottom of the start block 215 drawn as "beginning". Therefore, in this case, first, the events generated for the CG characters and camera work in the CG studio, and the studio set (props, large tools, background) are broadcast in the order of the event mark 209. The moving image of “Disappeared scene (daytime)” will be broadcast, then the title will be displayed in text, and the CG studio scene will be broadcast. Of course, this order and combination differ depending on the contents of the broadcast program.

  The studio block 202 has a dialogue setting unit 210 for making CG characters audible (setting CG character speech, voice, and quality), and setting for walking (setting CG character placement / motion) in the CG studio. Various program related information is set such as a unit 211, a camera work setting unit 212 for specifying camera work, and other setting unit 214 for setting the background of the CG studio, the props and tools of the studio set, and combinations thereof. The studio block 202 displays various types of video data information set for each event, that is, CG studio set information, CG character lines and actions, and camera work information. The movie block 203 is a part for performing playback control setting of an edited moving image prepared in advance, and displays the file name of the moving image and other information. For example, when the representative screen 11 on the left side of the movie block 203 is clicked with the mouse of the input device, a movie setting window (not shown) pops up on the editing screen, and a moving image is displayed by editing / setting operation of the movie setting window. While playing, fast-forwarding, rewinding, etc., the in-point / out-point, superimpose, narration, sound timing, etc. are designated, and the video information is displayed on the movie block 203 after setting. The title block 204 is a part that controls the display of character information on the television screen and the display of still images. For example, when the representative screen 12 on the left side of the title block 204 is clicked, a title window (not shown) pops up on the editing screen by clicking with the mouse of the input device, and the title screen can be edited. Then, the set information is displayed on the title block 204 as video data.

  The superimpose character block 205 is a part that controls the synthesis of superimpose characters to the video output to the television, and the sound block 206 is a part that controls music such as BGM to be synthesized to the video, and a narration block Reference numeral 207 denotes a portion for synthesizing narration with video during reproduction of a moving image, and various setting blocks 208 are portions for setting waiting time and the like. The above blocks can also be edited in the same manner as the studio block 202, movie block 203, and title block 205 described above.

  As described above, in the studio block 202, the dialogue setting unit 210 for setting the dialogue of the CG character, the action setting unit 211 for setting the movement of the CG character, the camera work setting for setting the camera work in the studio There is a part 212. Each block of the studio block 202, the movie block 203, and the title block 204 is broken down into several units called events in the vertical direction (in time axis order), but an event corresponding to each of the events. Displayed with a mark 209. A TV program producer (hereinafter referred to as a producer) produces a TV program by a GUI operation on the editing screen of FIG. First, the producer generates a studio block 202, a movie block 203, a title block 204, etc. in the editing window 201 in accordance with the scene of the program to be produced, and arranges them in the order in which the program progresses (elapses). Then, various detailed settings are made in each block to produce a program. Hereinafter, an example of setting in the studio block 202 will be described. Basically, all settings such as dialogue and movement of CG characters can be set only at the corresponding part of one event. That is, when the studio block 202 is generated and arranged on the editing screen, only one event is generated in the studio block 202. Here, the event indicates the content of one line in the horizontal direction of the screen displayed in the event mark 209 in FIG. Normally, multiple events are required for the studio block 202, and if the producer specifies the addition of an event, a new event is added to the studio block 202, and the studio block 202 extends in the vertical direction. A block in the direction (for example, the movie block 203 or later) is shifted downward by one event. After adding an event to each block in this way, various event settings are made. For example, the line of the character is entered in the line of the line in the studio block 202. Now, when a dog appears as a CG and makes a dog bark, a bark is input to the dialogue column 210 of the studio block 202, and a bark operation is input to the motion column 211 of the same line. In the column 212, camera work information of the scene is input, and in the other column 214, a studio set (a large tool, a small tool, a background, etc.) is input. Further, necessary information is similarly input to the superimpose character block 205, sound block 206, narration block 207, and various setting blocks 208 on the same line. In addition, since information unnecessary for the event is not input to each of these blocks, it may be blank. A television program is produced by the operation as described above. Here, the scroll bar 213 is used to move the display by operating with a mouse or the like when the events of each block increase as described above and the display is not completely displayed in the window 201. When the editing window 201 is displayed in a range smaller than the monitor screen, the display can be moved up, down, left and right using the scroll bars 213, 213 '.

  The television program produced in this way is confirmed on a display screen as shown in FIG. FIG. 4 is an example of another state of the editing screen displayed on the monitor. 201 is an editing window, 301 is a preview window, 302 is a play button, and the preview window 301 is displayed in a pop-up on the editing window 201. When the play button 302 of the preview window 301 is clicked with the mouse of the input device, produced television programs are generated one after another and are displayed in the order of scenario broadcast time series. The video displayed in the preview window 301 is the video that is actually broadcast on television.

  In addition to the purpose of producing programs directly, the studio set can be realized in a virtual space, so the actual program can be used without using an actual camera, studio set, large tools, props, actors, extras, etc. You can easily perform a simulation before producing Furthermore, it can be used not only for broadcast programs and video programs, but also for the production of presentation and demonstration materials such as conferences and presentations.

As described above, as the program editing / production work proceeds, the number of events increases, and the size of one block to be displayed gradually increases and extends in the vertical direction accordingly. The block at the bottom of the screen cannot be displayed on the monitor due to the limitation of the resolution of the monitor screen. In this case, if the TV program producer wants to display a block that protrudes at the bottom of the screen on the screen, the scroll bar 213 (FIG. 3) on the right side of the editing window 201 is operated with the mouse to display the displayed contents of the window. The contents of production must be confirmed by scrolling, the operation becomes complicated, and the contents cannot be grasped at a time.
Yokoyama Toshiaki et al., “Program Generation / Interactive Editing System Based on TV Program Description Language TVML” 3rd Intelligent Information Media Symposium, December 1997 Toshiaki Yokoyama et al. “Development of TVML Machine Interface for TV Program Description Language” Electronic Information Society Conference, September 1997

  As described above, in the above-described conventional technology, when displaying video data on the screen and editing the video data on the GUI screen, a scroll bar is used to find a necessary part of the video data. It has to be confirmed while operating with a mouse, and there is a drawback that the operation becomes complicated and the contents are difficult to grasp.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a video data editing method that includes an editing screen that eliminates the above-described drawbacks, makes it easy to search for contents, and is easy to check.

  In order to achieve the above object, a video data editing method according to the present invention displays video data including computer graphics, animation, moving image data, still image data, character data, audio data, and synthesized voice data on a monitor screen. The video data information is divided into a plurality of blocks on the monitor screen and is displayed on the monitor screen according to the designation. One is displayed with a smaller data size and a smaller data size than the previous display size.

  The computer-readable recording medium according to the present invention displays video data including computer graphics, animation, moving image data, still image data, character data, audio data, and synthesized voice data on a monitor screen, and data on the monitor screen. Used in an editing system that edits by interaction with operation and computer, video data information is divided into a plurality of blocks and displayed on the monitor screen, and at least one of the plurality of blocks is displayed in front as specified. A program for displaying with a smaller size and a smaller amount of data is recorded.

  That is, according to the present invention, in order to display the content of the video data, the block displayed at a normal size is reduced and displayed, and the content of the block is displayed differently before and after the reduction. This is a video data editing method that enables an easy-to-confirm editing screen that allows easy search of contents.

  Furthermore, when previewing the content of video data including reduced blocks, a video data editing method with a display method that enables effective use of the editing screen by selecting how to play back the reduced portion is realized. It is a thing.

  According to the present invention, when editing video data while arranging and arranging video information as blocks for each scenario, the edited blocks are displayed in a reduced size, thereby reducing the complexity of operation and displaying one column. The number of events can be increased, and the contents of the entire video data can be quickly grasped. Also, when checking the actual video for the content of the video data including the above-mentioned reduced display block, the portion reduced by the content preview is fast-forwarded or skip-played so that only the portion required by the editor can be obtained. Can be previewed quickly.

  An example of an interactive video data editing system for performing video data editing according to the present invention will be described with reference to FIG. FIG. 2 is a block diagram showing an example of the configuration of a television program editing apparatus. 1 is a CPU (Central Processing Unit), 2 is a memory, 3 is a CG animation generation unit, 4 is a speech synthesis unit, 5 is a sequencer unit, 6 is A magnetic recording device, 7 is a moving image generation unit, 8 is a monitor, 9 is an input device, and 10 is a bus. The CPU 1 is connected to a memory 2, a CG animation generation unit 3, a voice synthesis unit 4, a sequencer unit 5, a magnetic recording device 6, a moving image generation unit 7, a monitor 8, and an input device 9 via a bus 10. A communication interface (not shown) may be connected to the bus 10 as necessary.

  In FIG. 2, a CG animation generating unit 3 generates a CG animation of an appearing character or a studio set, and a speech synthesizing unit 4 generates a voice (such as speech, crying, onomatopoeia, and studio sound effects) of the appearing character. In addition, when there are a plurality of languages used in the country or ethnic group, there may be a plurality of speech synthesis units 4 corresponding to the languages. The moving image generating unit 7 reproduces a pre-edited moving image, and the memory 2 stores events such as the appearance and motion of the appearing character corresponding to the television program scenario, moving image reproduction, and audio reproduction. Based on the event information of the TV program stored in the memory 2, the sequencer unit 5 controls the CG animation generating unit 3, the voice synthesizing unit 4, and the moving image generating unit 7 to sequentially generate TV programs. The monitor 8 displays the generated TV program and program editing information. The input device 9 is for instructing display on the monitor 8, instructing reproduction to the sequencer unit 5, and editing event information of the TV program stored in the memory 2, and mainly performs GUI operation. It consists of a pointing device such as a mouse and a keyboard for performing. The CPU 1 operates the program editing information stored in the memory 2. The magnetic storage device 6 stores character modeling data, studio data, moving image video information, audio data (music, background sounds, other audio data), and the like, and also stores editing data. The magnetic storage device 6 may be an external remote file that can be accessed at random, such as a hard disk, an optical disk, or a magneto-optical disk, via another communication network. The bus 10 connects these components. Also, connection to other devices via the bus 10 is possible. The CPU 1 transmits and receives signals to and from other components connected via the bus 10, and each component is controlled by an access signal from the CPU 1. By using the editing apparatus, it is possible to arrange scenarios of TV programs in chronological order, edit them efficiently, and generate and output TV programs created as a result.

  An embodiment of the video data editing method according to the present invention using the system of FIG. 2 will be described below with reference to FIGS. FIG. 1 is a diagram for explaining an embodiment of the present invention, and FIG. 3 is an example of a basic editing screen. FIG. 1 is a schematic diagram showing display examples in which the display of the studio block 202 in FIG. 3 is different between the normal display of (a) and the reduced display of (b). 101 is a normal studio block, 102 is a reduced-size studio block, 103 is a reduced button, 104 is an enlarged button, 105 is a status display, 106 is an event number display, and 107 is a text input box. In FIG. 2, a TV program producer (hereinafter referred to as a producer) produces a TV program on the editing screen of FIG. First, the producer generates a studio block 202, a movie block 203, a title block 204, and the like in the editing window 201 in accordance with the scene of the program to be produced, and arranges them vertically. Then, various detailed settings are made in each block to produce a program. When a television program is produced by the same method as that described in the above-cited document, in the embodiment of the present invention, a reduction button 103 is provided at the upper left of each block as shown in FIG. When the reduction button 103 is clicked with the mouse, the normal studio block 101 becomes the reduced-display studio block 102 as shown in (b). The reduced-sized studio block 102 has a state display 105 indicating that the reduced-sized studio block 102 is being displayed in a reduced state, and its normal state in the state before the reduction. There is an event number display 106 that displays the number of events included in the studio block 101, and a text input box 107 that allows an operator to input an explanatory text and other information using the input device 9 in the reduced display block. By displaying the text that is displayed and input in the text input box 107, it is possible to identify what studio block the studio block of the reduced display is. Note that data input to the text input box 107 can be automatically performed.

  As another studio block identification method, there is a method of automatically displaying the contents described in the dialogue setting unit, operation setting unit, and camera work setting unit in the text input box 107. An example is shown in FIG. For example, in the speech setting section 110 of the top Event 120, appeared as "Bob" person in a setting that speaks as "Hello", "BOB: Hi" and if they are written in the text input box 107 "BOB: Hello" Is displayed. Also, there is no setting in the dialogue setting section 110 of the first event 120, and the action setting section 111 is described as “MARY: bow” with the setting that the character “Mary” bows. If it is, “MARY: Bow” is displayed in the text input box 107. Furthermore, if only the camera work setting unit 112 of the first event 120 is set to “Camera A: Close-up BOB” in the setting that the camera named Camera A performs close-up on the character “Bob” “Camera A: Close-up BOB” is displayed in the text input box 107. By this method, the creator can grasp at a glance how the contents of the block displayed in a reduced size start, and it is not necessary to input a description of the block in the text input box 107.

  As another studio block identification method, there is a method of automatically displaying an image of one scene of a program in a block in a reduced studio block. An example is shown in FIG. For example, the speech setting unit 110 of the first event 120, if the appearance of "Bob" person is in the set that speaks a "hello", as shown in FIG. 8 (b), the scene representative image 121 Zoom out and display. Also, if no setting is made in the dialogue setting section 110 of the first event 120 and the action setting section 111 is set so that the character “Mary” bows, the scene is displayed. Let Furthermore, if only the camera work setting unit 112 of the top event 120 is set to perform a close-up on the character “Bob”, the camera “Camera A” is displayed on the representative screen 121. With this method, the creator can grasp at a glance and visually understand how the contents of the reduced-size block start.

  In addition, the blocks that are considered to be particularly important can be decorated with accents or changing the color or thickness of the characters. Furthermore, the reduction button 103 is changed to an enlargement button 104 by reduction display, and the normal studio block 101 is returned by clicking the button with the mouse.

  The process of reducing the studio block display is shown in the flowchart of FIG. 9, and the process of restoring the reduced studio block is shown in the flowchart of FIG. Hereinafter, FIGS. 9 and 10 will be described. First, when the normal studio block 101 is reduced, the reduction button 103 is clicked with the mouse in step 800 of FIG. In response to this operation, in step 801, the number of events included in the normal studio block 101 is calculated and stored in the internal data. In step 802, the display of those events is deleted. In step 803, the normal studio block 101 is changed to the reduced-size studio block 102, and in step 804, the blocks after the reduced-size studio block 102 are displayed in a manner aligned above the deleted event. Is done.

  Next, when the reduced scaled studio block 102 is restored, the enlarge button 104 is clicked in step 810 of FIG. In response to this operation, the number of events to be displayed in the reduced-size studio block 102 is acquired from the internal data in step 811, and these events are displayed in step 812. In step 813, the reduced studio block 102 is changed to the normal studio block 101. In step 814, the blocks after the normal studio block 101 are displayed shifted downward by the displayed event. The Similar to the studio block, the movie block and the title block can be displayed in a reduced scale. The operation of the reduced display of those blocks is the same as that of the studio block. FIG. 11 and FIG. 12 respectively show how movie blocks and title blocks are displayed in a reduced scale.

  FIG. 11A shows a normal size display of the movie block 1101, in which 1103 is a reduction button, 1109 is an event mark, and 1110 is a representative image of a video defined in the block. 11B in FIG. 11B, 1102 is a reduced-size movie block, 1104 is an enlarge button icon for returning to the original normal size display, 1105 indicates the display state, and 1106 indicates the entire movie block. Shows the number of events.

  (A) of FIG. 12 is a normal size display of the title block 1201, 1203 is a reduction button, 1209 is an event mark, and 1210 is a representative image of a title defined in the block. In FIG. 12B, 1202 is a title block displayed in a reduced size, 1204 is an enlarge button icon for returning to the original normal size display, 1205 indicates the display state, and 1206 indicates the entire title block. Shows the number of events.

  FIG. 5 is a diagram showing that the editing screen can be effectively used by reducing the block display as described above. 101 ′ is a normal display studio block, 102 ′ is a reduced display studio block, and 102 ′ is the next studio. The other symbols in the block are the same as in FIG. When the normal display studio block 101 ′ is reduced to the reduced display studio block 102 ′ by the above operation, the blocks below the editing window 201 (movie block 203 and title block 204) from the reduced display studio block 102 ′. ) Moves upward in the editing window 201, and the next studio block 102 'that has not been displayed on the editing window 201 until now is displayed as shown in FIG. Further, the reduced display block or the normal display block or the frame can be more easily distinguished by giving a color or decoration.

  The contents of the television program including the reduced display block produced as shown in FIG. 5 can be actually reproduced and confirmed by the preview window of FIG. FIG. 6 shows an example of a preview window when previewing a reduced block according to the present invention. 501 is a preview window, 502 is a playback selection button, 503 is a normal playback button, 504 is a fast-forward playback button, 505 is a skip playback button, and 302 is a play button. This preview window 501 displays a button 502 for selecting how to play back the reduced block. By clicking the button 502 with the mouse, the normal playback button 503, the fast forward playback button 504, and the skip playback button 505 are selected, and any one of the normal playback button 503, the fast forward playback button 504, and the skip playback button 505 is selected. Can do. When the normal playback button 503 is selected, playback is performed at a normal playback speed regardless of whether there is a reduced-size block. When the fast-forward playback button 504 is selected, the reduced block portion is fast-forwarded at, for example, three times the normal playback speed. When the skip reproduction button 505 is selected, the reduced block portion is not reproduced and only the other portion is reproduced.

  In the above-described embodiment, the video data editing method for broadcasting a scenario about a TV program is described, and the scenarios are arranged in the time series in which the scenarios are broadcast. However, the broadcast time is not necessarily displayed in the time series. Since the broadcast may be performed based on the information as part of the information, the display order may be the order of the scenario titles or the like, or the alphabetical order. Also, it is not necessary to edit only TV programs, and those skilled in the art can also be applied to the production of recordings, manuals, albums, educational materials, product advertisements, etc. using audio data or image data as video information. It is self-evident.

The figure explaining an example of the normal size display and reduction display of the studio block of one Example of this invention. The block diagram which shows the structural example of the television program production apparatus for implementing one Example of this invention. The figure which showed an example of the edit screen of the conventional television program editing apparatus. The figure which showed the preview window of the program video confirmation of the conventional television program production apparatus. The figure for demonstrating the advantage at the time of reducing the studio block of one Example of this invention from normal size display. The figure which showed the preview screen of the image | video of the studio block by which the reduced display of this invention was carried out. The figure which shows an example of the content of the text input box of the studio block of this invention. The figure which shows another example of the content of the text input box of the studio block of this invention. The flowchart of the reduction process of one Example of this invention. The flowchart of the expansion process of one Example of this invention. The figure which shows the normal display and reduction display of the movie block of one Example of this invention. The figure which shows the normal display and reduction display of the title block of one Example of this invention.

Explanation of symbols

1: CPU (Central Processing Unit), 2: Memory, 3: CG animation generation unit, 4: Speech synthesis unit, 5: Sequencer unit, 6: Magnetic recording device, 7: Moving image generation unit, 8: Monitor, 9: Input device 10: Bus 11, 12: Representative screen 101, 101 ': Normal studio block 102, 102', 102 ": Reduced studio block 103: Reduce button 104: Enlarge button 105: Status display, 106: Event number display, 107: Text input box, 109: Event mark, 201: Editing window, 202, 202 ': Studio block, 203: Movie block, 204: Title block, 205: Superimpose Character block, 206: Sound block, 207: Narration block, 208: Various setting block, 209: Event mark, 210: Dialog setting section, 211: Operation setting section, 212: Camera work setting section, 213: Crawl bar, 214: Other setting section, 215: Start block, 301: Preview window, 302: Play button, 501: Preview window, 502: Playback selection button, 503: Normal playback button, 504: Fast forward playback button, 505: Skip Play button.

Claims (1)

In the video data editing system that displays video information data in blocks for each scenario on the monitor screen and edits by data operation on the monitor screen and interaction with the computer,
The block to be displayed on the monitor screen displays at least character speech, character motion, and camera work for each event, and the display content of the block is changed to the number of events by a predetermined motion, and the block is reduced. A video data editing method characterized by displaying .