JP2001202531A - Method for editing moving image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a moving image editing method capable of more easily performing program production or the editing operation of video information in a short time by immediately displaying an image seen from another viewpoint desired by an editor, which is different from the image of a camera viewpoint during preview display in the middle of editing the video information such as the production of a television program and facilitating operations such as object arrangement in a CG studio and the movement confirmation of CG characters. SOLUTION: Dedicated viewpoints for knowing the arrangement of objects in the studio and the movements of the CG characters are provided in the CG studio and are made freely changeable during editing.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video information editing method and a moving image editing apparatus for editing video information, and more particularly to a television program image editing apparatus used for producing television broadcast programs and video programs.

[0002]

2. Description of the Related Art In recent years, computer graphics (C)
2. Description of the Related Art There is a television program production and editing system that combines animation technology, audio synthesis technology, moving image reproduction technology, and the like, and produces all television programs using a single computer.

[0003] As an example of a video system for creating a television program through an interactive operation between a user and a computer, T
VML (Tele-Vision Program M
There's an aking Language eddy. This T
The VML editor includes animation character and CG studio set information stored in a large-capacity randomly accessible storage device such as a hard disk device,
Using a speech synthesis tool or animation creation tool, it is possible to produce a program that develops in a studio in virtual reality space only on the computer and the connected screen without using the actual studio or character it can. On the editing screen of the TVML editor, an image of a program being edited or being created can be displayed (reproduced). The displayed image is only an image pickup direction (camera viewing angle) set in advance, that is, an image from the camera viewpoint in the CG studio.

In the process of producing or editing a video such as a video program, a different camera direction or camera is often used in order to move the appearing CG character or to set the dialogue of the CG character accurately in accordance with the operation. It is necessary to confirm the image of the produced program viewed from the position (camera viewing angle). In order to change the imaging direction and camera position of such a virtual studio, it is necessary to change the imaging direction of the editing screen displayed by performing an input operation for changing the setting value of the camera viewpoint each time.

[0005] Such an image from another viewpoint is, for example, C
Examples include an image looking down from directly above the G studio, a close-up image of the mouth of the CG character, and an image outside the frame of the image being edited. After displaying such an image in a different viewpoint direction and confirming the operation of the CG character, the user returns to the original camera viewpoint image and continues editing, which is inconvenient for the editor. It takes a long time to edit.

[0006] In addition, the processing for moving the appearing CG character and the line of the CG character are merely changed in order to accurately set them in accordance with the operation, but the edited video is shot from the changed camera viewpoint. Since the edited video is reproduced, the video is different from the scenario and different from the editing intention. Therefore, such an image viewed from another viewpoint is rarely used for an actual program and is deleted, which is a wasteful operation.

Hereinafter, a moving image editing method including CG animation according to the present invention will be described. An example of a conventional typical television program editing system using TVML will be described with reference to FIG. FIG. 2 is a block diagram of the TV program editing apparatus. Reference numeral 103 denotes a CG animation generation unit that generates an animation of a character or a studio set by CG; 104, a voice synthesis unit that generates a talking voice (line) of the character; 107, a moving image for displaying a moving image that has been edited in advance. An image generation unit 102 is a memory for storing events such as “speaking characters”, “movement of characters”, and “moving image playback” corresponding to a script of a television program, and 105 is stored in the memory 102. A sequencer unit that controls the CG animation generation unit 103, the voice synthesis unit 104, and the moving image generation unit 107 based on the event information of the generated TV program to sequentially generate a TV program, and 108 displays the generated TV program. A monitor 109 displays program editing information. The monitor 109 gives an instruction of reproduction to the sequencer unit and an event of a television program stored in the memory. An input device consisting of a mouse and a keyboard for instructing editing of bets information, 101 denotes a CPU for operating the editing information of the program stored in the memory 102 (Central Pro
, a magnetic storage device for storing modeling data of characters, CG studio data, video information of moving images, and the like, and a bus 110 for connecting these components.

[0008] By using the above apparatus, the scenario of the television program is arranged on the display screen of the monitor 108 in chronological order, and the television program creator (hereinafter, referred to as an operator) can efficiently edit using the input device 109. As a result, it is possible to generate and output the created television program.

FIG. 3 shows an example of a display screen of the television program editing apparatus. FIG. 3 shows a basic editing screen displayed on a monitor of a conventional television program editing apparatus. Reference numeral 201 denotes an edit screen; 202, a studio block for setting a CG character to speak (speak words), to walk (operate), and to designate a camera work in a CG studio; A movie block for controlling playback of a previously prepared edited moving image, 204 is a title block for controlling character information to be displayed on a television screen and a still image, and 205 is a super block for combining superimposed characters with an output video. A block 206, a sound block for controlling music to be synthesized with the video, a 207 a narration block for synthesizing the narration with the video during movie playback or the like, a 208, various setting blocks for setting the waiting time, etc., 209, an event mark, 210 is C
Dialogue setting part to set dialogue of G character, 2
11 is a motion setting portion for setting the motion of the CG character, 212 is a camera work setting portion for setting camera work in the CG studio, 213 and 214 are sliders for sliding the display on the display screen, and 215 is the start of the program. Start block, 216 is an end block indicating the end of the program, 220 is a pull-down menu, 410
Is a setup button, and 650 is a pointer indicating a position on the display screen 201 when the mouse is moved by the input device 109.

In FIG. 3, a vertical axis of the editing screen 201 is a time axis, and a television program is generated so as to progress in order from the top of the screen to the bottom.

A vertical column having a studio block 202, a movie block 203, a title block 204, and the like on the left side of the editing screen 201 indicates an image to be output to the television screen. In the studio block 202, C
There are a part 210 for setting the dialogue of the G character, a part 211 for setting the movement of the CG character, and a part 212 for setting the camera work in the CG studio. Each block of the studio block 202, the movie block 203, and the title block 204 is decomposed in the vertical direction into units called several events, and the event mark 209 corresponds to each of the existing events. Mark. Basically, all settings such as character dialogue and movement are one for each event.
Only one can be set.

The television program produced in this way is:
It can be confirmed by a preview window that pops up when double-clicking one column (this is called a cell) in each of the dialog setting portion 210, the operation setting portion 211, and the camera setting portion 212 with a mouse.

FIG. 4 is a diagram showing an example in which a preview window for confirming the program video of the television program editing apparatus is displayed.
Components having the same functions as those in FIG. 3 are denoted by the same reference numerals.
201-1 is an editing screen, 202 'is a studio block, 203' is a title block, 500 is a preview window, 301 is a preview controller window, 302 is a play button, 500 is a preview window, 606 is a CG character B, and 607 is a CG character. CG character A.

[0014] The operator transmits the produced television program,
The preview controller window 301 is used to check the entirety from the beginning (start block 215) to the end (end block 216). The preview controller window 301 is displayed as a pop-up by selecting “Preview” (a display example of the pull-down menu 220 is not shown) in the pull-down menu 220 on the upper side of the editing screen 201. The pull-down menu means that a title portion of the pull-down menu 220 (for example, “event” in the pull-down menu 220) is always displayed, and when the title portion (“event”) is clicked on with a mouse, several menu items are displayed. One column is displayed, and when one menu item is selected and clicked, the process associated with the selected item is performed, and at the same time, the menu item disappears and the menu returns to the original title display. is there.

Preview controller window 301
Is clicked with a mouse, the produced television programs are successively generated and displayed in the preview window 500 in the order of events. The image displayed in preview window 500 is the image that is actually broadcast on television.

At this time, after selecting a desired range of the event mark 209 and clicking the play button 302 with a mouse, an image of only the event of the selected event mark 209 is displayed alongside the event mark. Are reproduced in the preview window 500 in this order.

If the play button 302 is clicked with the mouse without selecting the event mark 209, all the images of the edited event are reproduced in order from the beginning to the end.

In the course of creating and editing such a program, the arrangement of CG characters may be determined, for example, in a CG studio. For example, when setting the arrangement of the CG character and the arrangement of the camera in the CG studio, the setting is performed using the studio setup preparation window. This studio setup preparation window corresponds to the studio block 202 '(in FIG. 3, studio block 2).
The pop-up is displayed by clicking the set button 410 arranged at the upper right of 02) with the mouse. At this time, the head state of the studio block 202 is displayed in the preview window 500, and specific information thereof is displayed in the studio setup preparation window.

FIG. 5 is a diagram showing an example in which a studio setup preparation window is displayed on the television program editing apparatus. The same components as those described so far are denoted by the same reference numerals. In addition, 201-2 is an edit screen, 4
00 is the studio setup preparation window, 413
Is a setting mode option menu, 411 is a setting board column, and 401 and 421 are CG characters B606, respectively.
And a CG character setting board for setting the arrangement of the CG character A607, an add button 412 for adding a CG character by clicking the mouse when adding a CG character, and a reference numeral 402 in the CG studio for the CG character A607. X-coordinate text field for setting the X-coordinate position of the CG character A607
Z coordinate text field for setting coordinate position, 40
Reference numeral 4 denotes an orientation setting field for setting the orientation of the body of the CG character A607, and reference numeral 414 denotes a slider for operating the change of the display position of the setting board column 411.

In FIG. 5, in the studio setup preparation window 400, only information on the CG character is displayed. This state is called a CG character setting mode. In the CG character setting mode, the display of the setting mode option menu 413 in the studio setup preparation window 400 is “character setting”.

Hereinafter, a GUI (Graphical User Interf) in the CG character setting mode will be described.
ace) An operation example will be described with reference to FIGS.

When setting the CG character A 607, the operator operates the X coordinate text field 402, the Z coordinate text field 403, and the orientation setting text field 40 in the CG character setting board 401.
By changing the value of the CG character A6,
07 and the body orientation are set. In the example of FIG. 5, two CG characters (CG character A607 and CG character B606) are set. If the operator wants to set not only the CG character A607 but also the CG character B606, the setting board column 4
By changing the same setting items on the character board 421 in FIG. 11, the position and orientation of the CG character B606 can be set. If the display is hidden and invisible, the setting is continued by scrolling the slider 414 to display a hidden and invisible part. FIG. 18 shows a specific coordinate system for setting the arrangement of the CG character and the orientation of the body.

FIG. 18 is a diagram for explaining an example of a coordinate system in the CG studio. 1200 is a CG studio, 1
Reference numeral 800 denotes the center of the CG studio 1200 (X coordinate 0, Z coordinate 0, Y coordinate 0), and 1801 denotes an X axis (lateral from the operator to CG) indicating the center 1800 as the origin.
The right direction is positive when looking at the studio 1200), and 1802 is a Z for indicating the position in the depth direction with the center 1800 as the origin.
Axis (the forward direction is positive when viewing the CG studio 1200 from the operator), 1804 is a Y axis for indicating the position in the height direction of the CG studio 1200 with the center 1800 as the origin, 18
Reference numeral 05 denotes a right-handed screw rotation (pan) direction around the Y axis 1804 which sets the plus (positive) direction of the Z axis 1802 as an angle 0, and reference numeral 1803 designates a plus (positive) axis of the Z axis 1802 as a reference (angle 0) The angle (d) in the right-hand screw rotation direction with the Y axis 1804 being positive, and the X axis 1806 with the minus (negative) direction axis of the Z axis 1802 as the reference (angle 0)
Right-hand screw rotation (tilt) direction with 01 as positive, 1807
Is based on the plus (positive) direction axis of the Y axis 1804 (angle 0)
Right-hand screw rotation with the Z axis 1802 being positive (roll
The 1) direction 1808 is a vertical viewing range angle indicating a viewing angle (angle) when viewing the Y direction from one point on the XZ plane.

That is, the X coordinate text field 402,
By changing the values of the Z coordinate text field 403 and the direction setting field 404, the position of the CG character in the X axis direction and the Z axis direction and the body direction can be set.

Here, for example, in FIG. 5, the coordinates in each text field are in units of "m (meters)" and the angles are in units of "° (degrees)."

When the operator determines the arrangement of the CG character in the character setting mode, the CG studio 1200 is viewed from directly above in the Y-axis direction.
Character placement is easy to understand. Conventionally, in order to obtain such a viewpoint, the operator moves the camera to the CG studio 12.
It was necessary to arrange the camera angle just above 00 and adjust the camera angle so as to look down right below.

When setting a camera work like the adjustment of the camera angle, it is necessary to switch the setting mode option menu 413 in FIG. 5 to a “camera setting” mode. That is, by selecting “camera setting” from an item displayed by clicking the right side of the setting mode option menu 413 with a mouse, the studio setup preparation window 400 in FIG. 5 switches to the “camera setting” mode. The display of the setting mode option menu 413 is changed from “character setting” to “camera setting”.

FIG. 6 is a view showing a display example when the studio setup preparation window is in the camera setting mode. The same components as those described so far are denoted by the same reference numerals. In addition, 201-3 is an edit screen, 4
00-1 is the studio setup preparation window, 5
13 is a setting mode option menu, 511 is a camera setting board column, and 501 and 521 are camera setting boards for setting the arrangement of cameras A and B, respectively.
Is an add button for adding a camera by clicking the mouse when adding a camera, 502 is an X coordinate text field for setting the X coordinate position in the CG studio 1200 of the camera, and 503 is the Z coordinate position of the camera 504 is a Y coordinate text field of the camera, 505 is a pan text field, 506 is a tilt text field, 507 is a roll text field, and 508 is a field of view. A corner text field 514 is a slider for changing the display position of the camera setting board 511.

In FIG. 6, preview window 50
0 indicates that the camera “Aca
m ”is an image obtained when the inside of the CG studio 1200 is photographed from“ m ”. The position of the camera “Acam” and the angle of the camera in the CG studio 1200 are indicated by the values of the text fields 502 to 508 which are parameters in the camera setting board 501 for setting the camera “Acam”. . This camera "A
When “cam” is set directly above the CG studio 1200, the operator changes the set coordinate values of the respective text fields 502 to 508 in the camera setting board 501 so as to be directly above the CG studio 1200.

However, such a camera having a viewpoint looking down from directly above the CG studio 1200 is rarely used while a program is in progress (used as an image for broadcasting a program). The operator must set a camera that is not directly used as the video of the program only to know the arrangement of the CG character. When the camera viewpoint is changed in order to know the arrangement of objects such as CG characters or the positional relationship between objects, an image viewed from the camera viewpoint is reproduced or broadcast as an edited program image. This is not desirable in terms of editing. Therefore, after confirmation, it is necessary to delete the video.

The fact that the same inconvenience may occur in the case of confirming the operation of the CG character will be described with reference to the GUI operation in FIG. FIG. 7 is a diagram showing a display example in the case of setting the dialogue of the CG character in the dialogue preparation window.

In FIG. 7, the same components as those described above are denoted by the same reference numerals. In addition, 201-
4 is an edit screen, 500-1 is a preview window, 7
50 is a dialogue window, 751 is a character menu, 752 is a dialogue setting unit, 753 is a slider group, 754 is an option menu group, and 755 is a slider for sliding the display of the dialogue setting unit 752.

When setting the dialogue of the CG character, first, the CG character in the studio block 202 shown in FIG.
In the character dialogue setting portion 211, a dialogue window 750 is displayed in a pop-up by double-clicking one cell with a mouse. At this time,
In preview window 500-1, an image at the end of the operation of the selected (double-clicked with the mouse) cell (in this example, when the CG character finishes speaking words) is displayed in a static state.

Referring to FIG.
When the dialogue of the CG character is set at 50, the character menu 751 is a part for setting the character speaking the dialogue, and can be set with a mouse. For example, in FIG. 7, a CG character named “BOB” is set.

The serif setting unit 752 is a part for setting the contents of the serif, and the contents of the serif are set by, for example, a keyboard input. In the example of FIG. 7, the contents of the dialogue is set to "Hello, everyone".

The slider group 753 is a part for setting the speed of speaking dialogue, volume (volume), sound quality (for example, male voice, female voice, child voice, etc.), intonation, etc., and is set with a mouse. . The option menu group 754 is a part for setting the operation to be performed while the character is speaking, setting the contents of the dialogue to be displayed in the preview window 500 as subtitles, and the like, and is set with the mouse.

At the time of setting the dialogue, the operator displays the CG character on the preview screen 500 in a large size, closely observes the movement of the mouth of the CG character in response to the dialogue, and the dialogue between the dialogue and the mouth is synchronized. Sometimes you want to make sure. Also at this time, the operator has to operate the camera in the CG studio 1200 to reset the camera close to the CG character.

Further, the similar inconvenience may be caused when the position and direction of the end of walking of the CG character are set in the action preparation window, with reference to the GUI operation in FIG. 8 as an example. FIG. 8 is a diagram showing a display example of a motion preparation window when the motion of the CG character is set.

In FIG. 8, the same components as those described above are denoted by the same reference numerals. In addition, 850 is an operation preparation window, 851 is an operation target menu, 8
52 is an operation menu, 853 is a character menu, 8
54 is an option menu, and 855 is a text field group.

Operation preparation window 8 as shown in FIG.
When setting the position and direction of the end of walking of the CG character in 50, the operation target menu 851 is a part for setting an operation target and is set with a mouse. In FIG. 8, C
G character is set. In addition, as an example,
There are settings for props, etc.

The operation menu 852 is a part for setting the operation performed by the CG character, and is set with a mouse. In FIG. 8, "walk" is set, but other examples include "bow", "tremble", and "open mouth".

The character menu 853 is for setting a CG character to be operated, and is set with a mouse. In FIG. 8, a CG character named “BOB” is set.

The text field group 855 is a part for setting the end position of walking, the orientation of the body, and the like. This coordinate system corresponds to the studio setup preparation window 4 in FIG.
Each parameter 4 of the character setting board 401 in 00
Same as 02 to 404.

The option menu 854 is a part for setting the degree of operation and the like, for example, in the case of "bow" operation, whether to deeply bow or lower the head only lightly.
Set with the mouse.

During this operation, the operator sometimes wants to make the CG character walk outside the preview screen 500-1. Assuming that the image displayed on the preview screen 500-1 is, for example, an image acquired by the camera Acam in the CG studio 1200, at this time, the operator sets a camera viewpoint different from Acam to the CG studio 12A.
00, the position and direction of the CG character's end of walking had to be set.

Now, on the screen shown in FIG.
In the state where the video acquired from the camera viewpoint of the image is displayed in the preview window 500-1, the CG
Assume a situation in which an editing operation for setting the movement of the character A is to be performed. At this time, the CG character A
Is outside the shooting range of the image of the program that can be acquired by the camera Acam,
Another camera B that can accommodate the range in which the G character A moves
Set cam. Then, it is necessary to set the moving range of the CG character A on the operation preparation window 850 while viewing the image acquired by the camera Bcam.

For this purpose, an operation for closing the operation preparation window 850 is first performed on the screen shown in FIG. Next, in order to start up the studio setup preparation window 400, the set button 410 in FIG. Studio setup preparation window 40
When 0 is displayed in a pop-up, the screen state shown in FIG. 5 is set. The preview window 500 displays an image acquired by the camera Acam. Further, the setting mode is changed from “character setting” to “camera setting” with the mouse 650.
Perform the operation of switching to. When the studio setup preparation window 400 changes to the camera setting mode, the screen state shown in FIG. 6 is set. At this point, the preview window 500 still displays the image acquired by the camera Acam.

Next, when an arbitrary text field in the camera setting board 521 is clicked with the mouse 650,
The camera Acam switches to another camera Bcam, and an image acquired by the camera Bcam is displayed in the preview window 500.

Next, when the studio setup preparation window 400 is closed, a preview window 500 is displayed on the screen shown in FIG. Thereafter, an operation for starting up the motion preparation window 850 is performed to set the screen state in FIG. 8 and input a set value for the motion of the CG character A while viewing the image from the camera Bcam in the preview window 500-1.

As described above, in order to switch the camera from Acam to another camera Bcam in order to set the operation of the CG character, it is necessary to go through a number of operation steps and screen switching. Necessary and complicated.

When the image from the camera ACam is displayed in the preview window 500-1 on the screen shown in FIG. 8, the operation preparation window 850 is closed, and the camera preparation window (not shown) is started.
In that window, another camera Bc from camera Acam
There is another way to switch to am. However, this alternative method also requires more screen operations and screen switchings than in the above case, and finally starts the operation preparation window 850 while displaying the image of the camera Bcam, so that the editing work is more complicated and inconvenient. It is.

[0052]

In the prior art described above, in order to confirm the arrangement of objects (CG characters and CG props) in the CG studio and the operation of the CG characters, the camera settings of the current edited image must be changed. In addition, a camera for confirmation needs to be set in the CG studio, which has a disadvantage that the operation becomes complicated.

An object of the present invention is to eliminate the above-mentioned drawbacks and to provide a different image from a camera viewpoint image during preview display during editing of video information such as production of a television program.
The image viewed from another point of view desired by the editor can be instantly displayed with a simple operation, and the arrangement of objects in the CG studio and C
It is an object of the present invention to provide a moving image editing method which facilitates operations such as checking the operation of a G character, and allows a program production or editing of video information to be performed more easily and in a shorter time.

[0054]

In order to achieve the above object, a moving image editing method according to the present invention provides a dedicated viewpoint for previewing the arrangement of objects in a CG studio and the operation of a CG character. By the way, CG
This realizes a moving image editing method that facilitates operations such as arranging objects in a studio and confirming the operation of a CG character.

According to the present invention, an image of a camera viewpoint and an image of a user viewpoint are defined, and data relating to the viewpoint is set. The camera viewpoint is a viewpoint of a reproduced image of video information being edited, which is the same as the conventional TVML editing, or a viewpoint captured by a camera to be broadcast. On the other hand, the user viewpoint is an editing viewpoint other than the camera viewpoint. The camera viewpoint and the user viewpoint can be easily switched and displayed by operation on the screen. Even when switching from the camera viewpoint to the user viewpoint, the image reproduced after editing is the image viewed from the set camera viewpoint.

According to the present invention, coordinate data and direction data of the camera viewpoint and the user viewpoint on the three-dimensional coordinates of the CG studio are set. The editor can change the setting data of the user viewpoint. Further, the user's viewpoint can be moved in accordance with the movement of the CG character on the CG studio. When an editing operation is performed on an image acquired from a user viewpoint, the editing operation is automatically reflected on an image acquired from a camera viewpoint.

In the moving picture editing method according to the present invention, information of image data relating to video information such as a video program is displayed on a screen of a display device, and a camera viewpoint which is a viewpoint of a reproduced image of the edited program and a camera viewpoint other than the camera viewpoint. By setting a user viewpoint which is a viewpoint for editing, displaying an image viewed from the user viewpoint on a display device, and operating setting data relating to an image acquired from a camera viewpoint while referring to an image acquired from the user viewpoint. Edit the image viewed from the camera viewpoint.

The computer-readable recording medium according to the present invention is for displaying an edited image including a computer graphics animation, and the computer-readable encoding means displays image data information on a program on a screen of a display device. Means for displaying, means for reading from a storage device data relating to a camera viewpoint which is a viewpoint of a reproduced image of the program, and a user viewpoint for editing other than the camera viewpoint, and a means for reading from the user viewpoint based on the data relating to the user viewpoint. Means for displaying an image on a display device.

That is, according to the moving picture editing method of the present invention, a plurality of user viewpoints for acquiring an image which is not reproduced or broadcasted are set in advance, and are switched to any of the plurality of user viewpoints. With reference to the edited moving image, the moving image is edited while confirming the referenced image.

In the moving picture editing method according to the present invention, the user's viewpoint is always set near an object existing in the image, and the user's viewpoint is moved in accordance with the movement of the object.

Further, the moving image editing method of the present invention
The projection method for referring to the image viewed from the user's viewpoint is switched.

Furthermore, the moving image editing method of the present invention
The user's viewpoint can be adjusted to any position and direction. A window for changing the parameters for adjusting the position and direction of the user's viewpoint is displayed, and the user's viewpoint is changed by changing the window parameters. is there.

The moving picture editing method according to the present invention is a moving picture editing method for editing in a studio in a virtual reality space (hereinafter referred to as a CG studio), and is for acquiring an image to be reproduced or broadcast. As a viewpoint, a camera viewpoint for acquiring an image in the CG studio is set, and as a viewpoint for confirming the arrangement of objects during editing, a user viewpoint for acquiring an image in the CG studio is set. Store the setting information in the storage device, read the desired camera viewpoint and the user viewpoint from the storage device, preview the image being edited by the read user viewpoint on the display device, and refer to the play-viewed image, C
The moving image is edited by manipulating the arrangement of the objects in the G studio, and the read image from the viewpoint of the camera is edited as an image for reproduction or broadcasting.

Further, the user viewpoint of the moving picture editing method according to the present invention can be changed according to the movement of the selected object.
Move while maintaining the relative relationship with the designated part of the selected object in the CG studio.

In addition, the user's viewpoint of the moving picture editing method of the present invention can change the setting conditions during moving picture editing.

Further, the moving picture editing method of the present invention
An image obtained by viewing the CG studio from the user's viewpoint is selectively switched between perspective projection display and orthographic display.

The data for setting the user's viewpoint in the moving picture editing method of the present invention is the position and orientation for the camera to capture the CG studio.

[0068]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to FIG. FIG. 1 is a view showing an editing screen for explaining a television program editing method according to one embodiment of the present invention.

In FIG. 1, the same components as those described so far are denoted by the same reference numerals. Other, 201
-6 is an edit screen, 600 is a preview window, 60
1 is a preview screen, 602 is a viewpoint option menu (hereinafter, referred to as a viewpoint menu), 603 is a user viewpoint position option menu (hereinafter, referred to as a position menu), and 604 is a projection conversion option menu (hereinafter, projection conversion). 605 user viewpoint adjustment button (hereinafter, referred to as a viewpoint adjustment button). Hereinafter, each of these functions will be described.

First, a CG studio 1 as shown in FIG.
The viewpoint menu 602 and the position menu 603 will be described by taking as an example a case where the position of the CG character in 200 is set. The studio setup preparation window 400 displayed in FIG. 1 is displayed in a pop-up manner in the same manner as in FIG. Preview window 6
In the preview screen 601 in 00, C (photographed) obtained from the camera set in the camera setting mode of the studio setup preparation window 400 in FIG. 6 is displayed.
The image of the G studio 1200 is displayed. The fact that the image displayed on the preview screen 601 was taken by a camera for broadcasting as a television program
This is indicated by the viewpoint menu 602 being “camera viewpoint”.

In the case of FIG. 1, an image acquired by a camera arranged slightly to the right of the CG studio is displayed on the preview screen 601 as an image acquired from the set camera viewpoint. Here, for example, the operator determines that the CG character 606 (name is MARY) and the CG character 60
Assume that it is desired to adjust the arrangement of 7 (the name is BOB) from the front of the CG studio 1200. This is C
The adjustment is performed to more accurately grasp the position of the CG character in the X direction of the G studio.

In this case, the operator sets the position of the camera to C
Instead of adjusting the position of the CG character after changing to the front of the G studio, the adjustment is performed using another viewpoint preset in the editing apparatus. This different viewpoint set in advance is called a user viewpoint.

FIGS. 12 and 1 show examples of the position of the user's viewpoint.
3 is shown. FIG. 12 is a diagram showing an embodiment of the arrangement of the user's viewpoint of the present invention viewed from above the CG studio.
FIG. 3 is a diagram showing an embodiment of the arrangement of the user's viewpoint according to the present invention viewed from the front of the CG studio. The same components as those described so far are denoted by the same reference numerals. In addition, 1200-1 is a CG studio viewed from above, 120
0-2 is a CG studio viewed from the front, 1201 to 120
Reference numeral 7 denotes a camera, which faces the CG studio 1200-1 or 1200-2. The camera 1201 is in front, the camera 1202 is right next to the camera, the camera 1203 is right next to the camera, the camera 1204 is right above, and the camera 1205 is diagonally right above. Camera 1206 is in front of the character 606,
The camera 1206 is set before the character 607.

There are two methods for setting the user viewpoint. It is shown in FIGS. 16 and 17. FIG. 16 illustrates a setting method for five user viewpoints of the front camera 1201, the right camera 1202, the left camera 1203, the camera 1204, and the upper right camera 1205 in FIG. It is a flowchart.

First, in step 1600, the operator activates the editing device. As a result, the editing screen 201 of FIG. 3 is displayed on the monitor 108 of FIG.

In step 1601, the internal data relating to the position of the user's viewpoint (front, right beside right, right beside left, directly above, diagonally above right) is automatically acquired from the memory 102. This position data is a value in the coordinate system shown in FIG. The memory 102 stores position data relating to the user viewpoint in advance.

At step 1602, the user's viewpoint (cameras 1201 to 1205) is automatically set at a predetermined position in the CG studio.

FIG. 17 is a flowchart illustrating a method for setting two user viewpoints by the cameras 1206 and 1207 installed in front of the CG character in FIG. This user viewpoint moves in accordance with the movement of the CG character.

First, in step 1700, the operator activates the editing device. As a result, the editing screen 201 of FIG. 3 is displayed on the monitor 108 of FIG.

Next, in step 1701, the setup button 410 shown in FIG.
A studio setup preparation window 400 is displayed in a pop-up.

Next, in step 1702, a character addition button 412 is clicked on with a mouse to add a CG character in the CG studio. Adding a CG character means setting (arranging) the CG character in the CG studio.

At step 1703, the position and orientation data of the added CG character are automatically obtained. CG
The character data is set in the studio setup preparation window 400 of the character setting in FIG.

In step 1704, internal data relating to the position of the user's viewpoint (in front of the CG character) is automatically obtained from the memory 102.

FIG. 19 is a diagram for explaining position data when a user viewpoint is set in the flowchart of FIG. The same components as those described so far are denoted by the same reference numerals. In addition, 1900 indicates the position of the CG character 607 on the XZ plane (origin:
X '= 0, Y' = 0, Z '= 0), the center of the coordinate system,
Reference numeral 1901 denotes X having the origin at the position of the center 1900 of the coordinate system.
X 'axis parallel to axis 1801 and perpendicular to the front direction of CG character 607. Reference numeral 1902 denotes a CG character 60 which is parallel to the Z axis 1802 with the origin at the position of the center 1900 of the coordinate system.
7 is a Z ′ axis parallel to the front direction of the CG character 1904, and Y is an origin having the position of the center 1900 of the coordinate system of the CG character 607 as the origin.
Y 'axis, which determines the position in the height direction parallel to axis 1804, 1
903 is one of viewing direction parameters, and is a Y 'axis 1904.
1910 is the distance from the center 1900 of the coordinate system of the CG character 607, 1905
Is a pan angle indicating an angle in the right-handed screw direction with the Y 'axis 1904 being positive with the minus direction of the z' axis 1902 being zero, and 1906 is an X 'having the minus direction of the Z' axis 1902 being zero. A tilt angle 1907 indicating the angle in the left-handed screw direction with the axis 1901 being positive, and a roll 1907 indicating the angle in the right-handed screw direction with the Z 'axis 1902 being positive with the plus direction of the Y' axis 1904 being zero. r
oll) angle, 1908 is the viewing angle.

As described above, this position data is a cylindrical coordinate system in which the center 1900 of the character 607 as shown in FIG. 19 is set as the origin and the front of the character 607 is set to the zero point in the circumferential direction.

Returning to the description of FIG. In step 1705, the position data of the user's viewpoint with respect to the CG character acquired in step 1704 is added to the position of the CG character with respect to the CG studio acquired in step 1703, and the final position of the user's viewpoint, that is, CG
Calculate position relative to studio coordinates.

On the basis of this, in step 1706,
The user viewpoint (in this example, the viewpoint viewed from the camera 1207) is automatically set at a predetermined position in front of the CG character 607. In this case, when the CG character 607 moves, the camera 1207 moves while maintaining the relative relationship with the CG character 607.

When adjusting the arrangement of the CG character using the user's viewpoint, it is necessary to switch the viewpoint for viewing the CG studio from the camera's viewpoint to the user's viewpoint. An example of the operation method will be described with reference to FIGS.
Here, FIGS. 9 to 11 are diagrams showing an embodiment of screen display from the user's viewpoint. The studio setup preparation window 400 displayed in FIGS. 9 and 10 is displayed in a pop-up manner in the same manner as in FIG. FIG. 20 is a flowchart for explaining an embodiment of the operation of switching the preview screen from the camera viewpoint to the user viewpoint.

9 and 10, the same components as those described above are denoted by the same reference numerals. In addition, 201-7 and 201-8 are edit screens, 600-1 is a preview window, 701 is a preview screen, 70
2 and 802 are viewpoint menus, 803 is a position menu, 8
04 is a projection conversion menu, 805 is a viewpoint menu 802
The user viewpoint menu displayed therein, 830 is a preview window, 831 is a preview screen, 820 is a user viewpoint adjustment window, 821 is a user viewpoint position display field, 822 is an X coordinate text field, 824 is a Y coordinate text field, and 823 is a Y coordinate text field. A Z coordinate text field, 825 was a pan angle text field, 826 was a tilt angle text field, 827 was a roll angle text field, 828 was a viewing angle text field, and 829 was the adjusted position and angle of the user viewpoint. A default button 840 for returning to the value is a button for closing the user viewpoint adjustment window 820.
Note that the sub-windows 803 and 803 displayed in FIG.
Although 804, 805, and 820 are displayed on the same screen for explanation, they are not actually displayed all at the same time.

First, in step 2000 of FIG.
The operator uses the mouse to change the viewpoint menu 60 in FIG.
2 is selected and switched from “camera viewpoint” to “user viewpoint”. A specific operation of menu switching will be described. First, when the viewpoint menu 602 is clicked with the mouse, the viewpoint menu becomes a state like the viewpoint menu 802 in FIG. When the user's viewpoint 805 is selected, a viewpoint menu 702 shown in FIG. 9 is displayed.

After step 2000, step 200
In step 1, internal data of the position of the currently selected user viewpoint is acquired. In the case of FIG. 9, the currently selected user viewpoint is the front user viewpoint (the viewpoint from the camera 1201 in FIG. 12) as specified by the position menu 603.

Then, in the next step 2002,
As shown in a preview screen 701 in FIG. 9, the display is switched to the user viewpoint from the front.

As a result, the operator operates the preview screen 7
01 using the image acquired from the user's viewpoint displayed in C
The positions of the G characters 606 and 607 can be adjusted more accurately.

When the user wants to return from the user's viewpoint to the camera viewpoint, switching the viewpoint menu 602 to "camera viewpoint" switches to a preview screen acquired from the camera viewpoint as shown in FIG.

Further, the position of the user's viewpoint is set not only at the front as described above, but also at a plurality of positions in the CG studio. When the operator wants to view the inside of the CG studio from a user viewpoint different from the front, the operator may switch the position menu 603 with a mouse. As an example, consider a case where the user's viewpoint is switched from front to right above. This is performed to more accurately grasp or adjust the position of the CG character in the horizontal (X) direction and the depth (Z) direction. One example of the operation method will be described with reference to FIGS. 1, 10, 13, and 20 to 22. FIG. 22 is a diagram showing an example of a preview window when the CG studio is viewed from directly above from a user viewpoint, and FIG. 21 is a flowchart for explaining an embodiment of an operation of switching from a camera viewpoint to a user viewpoint.

In FIG. 22, the same components as those described so far are denoted by the same reference numerals. Other, 20
1-9 is an edit screen, 600-4 is a preview window, 2201 is a preview screen, 2203 is a position menu.

The studio setup preparation window 400 displayed in FIG. 22 is displayed in a pop-up manner in the same manner as in FIG.

First, the operator performs step 2 in FIG.
At 100, select the position menu 603 of FIG.
Switch from "front" to "directly above". The specific operation of menu switching will be described. First, when the position menu 603 is clicked with the mouse, the position menu changes to a state like the position menu 803 in FIG. When the position directly above 840 is selected, a position menu 2203 is displayed as shown in FIG.

After step 2100, step 2101
Then, the user's viewpoint directly above the selected camera (camera 1 in FIG. 13)
(View point 204).

Next, in step 2102, FIG.
As in a preview screen 2201 of FIG. 2, the user's viewpoint is switched from directly above.

As a result, the operator enters the preview screen 2
The position of the CG characters 606 and 607 can be accurately adjusted using the image acquired from the user's viewpoint displayed in 201.

If the user's viewpoint is set to the front (viewpoint of camera 1201), right side (viewpoint of camera 1202), right side (viewpoint of camera 1203), or right above (viewpoint of camera 1204), the position By simply switching the menu 603, one of the three views of the CG studio can be obtained,
The arrangement of CG characters and the like in the CG studio can be grasped more accurately. Even if the CG character goes out of the field of view of the camera in the CG studio, the position of the CG character can be seen from the user's viewpoint.

Further, when the user's viewpoint is shifted obliquely to the right (camera 12
05 viewpoint), the CG in the CG studio
It becomes easy to grasp the arrangement of characters and the like three-dimensionally.

As described above, by using such a user viewpoint, the entire inside of the CG studio can be viewed from various angles.

In the television program editing work, there is a case where a user wants to see a finer portion of an image. For example,
This corresponds to a case where it is desired to confirm the action of the CG character in the vicinity of the CG character. For this purpose, user viewpoints (viewpoints of the camera 1206 and 1207) associated with the CG character are set. This embodiment will be described with reference to FIGS.

FIG. 14 is a flowchart for setting the dialogue of the CG character using the dialogue window of the present invention.
9 is a screen illustrating an example of a method for setting a user viewpoint. FIG. 11 is a diagram showing another embodiment of the user viewpoint adjustment window for setting the dialogue of the CG character. In FIG. 14, the same components as those described so far are denoted by the same reference numerals. Other 2
01-10 is an edit screen, 600-2 is a preview window, 1401 is a preview screen, and 1403 is a position menu. 11, 820 'is a user viewpoint adjustment window, 821' is a user viewpoint position display field, 822 'is an X coordinate text field, 824' is a Y coordinate text field, 823 'is a Z coordinate text field, and 825' Is the pan angle text field,
826 'is a tilt angle text field, 827' is a roll angle text field, 828 'is a viewing angle text field, 829' is a default button for returning the adjusted user's viewpoint position and angle to the stored values, 840 ' Is a button for closing the user viewpoint adjustment window 820 '.

When the dialogue of the CG character 607 (BOB) is set in the dialogue preparation window 750 as shown in FIG. I feel I need to check it. At this time, the operator performs the processing of FIGS. 20 and 21 and changes the viewpoint menu 702 to “user viewpoint” using the mouse as shown in FIG. 14, and then changes the position menu 1403 to “before BOB”.
Set to. By performing such an operation, the user's viewpoint is switched to the position of the camera 1207 in FIG. FIG.
Is displayed in a pop-up manner in the same manner as in FIG. As a result, a CG character 607 viewed from the user's viewpoint (the viewpoint of the camera 1207) is displayed on the preview screen 1401. The operator can check the movement of the mouth of the CG character 607 in close proximity to the dialogue from the image acquired from the user's viewpoint.

FIG. 15 shows another embodiment. FIG. 15 shows “bow” as an example of the action to make the CG character. FIG. 15 is a screen illustrating an embodiment of a method of setting a user viewpoint in order to set a motion of a CG character using the motion preparation window of the present invention. In FIG. 15, the same components as those described so far are denoted by the same reference numerals. In addition, 201-11 is an editing screen, 600-3 is a preview window, 1501 is a preview screen, 1503 is a position menu, 1551 is an operation target menu, 1552 is an operation menu, 1553 is a character menu, and 1555 is an option menu group.

When setting the operation of the CG character 606 (MARY) in the operation preparation window 851 as shown in FIG. 15, the operator performs the processing of FIGS. 20 and 21 and wants to check the operation of the CG character 606 up close. There are times. Note that the operation preparation window 850 displayed in FIG. 15 is displayed in a pop-up manner in the same manner as in FIG. However, the contents of the operation are different from those in FIG.

In the operation menu 1552, "bow" is set. In the character menu 1553, a CG character “MARY” is set. The slider group 1554 is a part for setting the operation speed and the like, and can be set with a mouse. The option menu group 1555 is a part for setting the degree of operation and the like (for example, if the operation is “bow”, whether to bow deeply or lower the head only lightly), and is set with a mouse. At this time, as shown in FIG. 15, the operator sets the viewpoint menu 702 to “user viewpoint” using the mouse, and then sets the position menu 1503 to “before MARY”. With such an operation, the user's viewpoint is switched to the position of the camera 1206 in FIG. As a result, the preview screen 1501 shows the user viewpoint (camera 12
The CG character 606 viewed from step 06) is displayed. The operator obtains C from the image acquired from the user's viewpoint.
The movement of the “bow” of the G character 606 can be confirmed up close.

The user's viewpoint (the viewpoint of the camera 1206 and the viewpoint of the camera 1207) is the CG character 606.
Moves along with it, and is always maintained in the position and direction as in front of the CG character 606. Therefore, if the CG character 606 walks in the CG studio and then speaks again,
Even if you want to check the bowing behavior,
If you switch between 2 and the position menu 1503, CG
An image in front of the character is displayed on the preview screen 1501.

Next, the projection conversion menu 604 shown in FIG. 1 will be described. In order to more accurately set the arrangement of objects in the CG studio irrespective of the depth, the projection transformation from the user viewpoint can be switched from perspective projection to orthographic projection.

When the projective transformation is perspective projection, the apparent arrangement and size of the object in the CG studio changes depending on the position in the depth direction (Z direction). In particular,
The closer the object is, the more the arrangement is shifted toward the vanishing point, and the smaller the object is. Conversely, when the projective transformation is orthographic, the appearance arrangement and size of the object are constant regardless of the depth direction.

For example, when it is desired to align a plurality of CG characters in a line in the depth direction, if the perspective transformation is a perspective projection, the apparent arrangement and size of each CG character change in the depth direction. It is difficult to check if they are aligned. Conversely, in the case of orthographic projection, the arrangement and size of the individual CG characters are constant irrespective of the depth, so that it is possible to accurately check whether the CG characters are aligned in a line and to easily set them.

GU for operating switching of projective transformation
I is the projection conversion menu 604. Switching the projective transformation to orthographic projection can be executed by selecting orthographic projection in the projective transformation menu 604. Figure 1 shows the projective conversion menu
As shown in the projection conversion menu 804 of “0”, there are two items of “projection method projection” and “orthogonal projection”.

Next, the viewpoint adjustment button 605 in FIG. 1 will be described. Examples of the position of the user viewpoint in the CG studio are shown in FIGS. However, there are cases where the object in the CG studio that the operator wants to check is outside the field of view of the user's viewpoint, or the object that the operator wants to check is only a part of the number of objects included in the image. . Furthermore, there may be an object that becomes a shield between the user's viewpoint and the object that the operator wants to check. In such a case, if the operator himself / herself adjusts the position of the user's viewpoint and the angle so as to display the desired object, the usability of the user's viewpoint is further improved.

When the operator wants to adjust the position and angle of the user's viewpoint, the adjustment is made in the user's viewpoint adjustment window. An example of the user viewpoint adjustment window will be described with reference to FIGS.

In the case of FIG. 9, the front user viewpoint (the viewpoint of the camera 1201) in FIG. 12 is selected. When adjusting the user viewpoint, clicking a viewpoint adjustment button 605 with a mouse causes a user viewpoint adjustment window 820 to be displayed.
(FIG. 10) pops up.

Hereinafter, a user viewpoint adjustment window 820 will be described.
Will be described. The user viewpoint position display field 821 clearly indicates the position of the user viewpoint selected in the position menu 603. Also, an X coordinate text field 822,
By changing the values of the Z coordinate text field 823, the Y coordinate text field 824, the pan angle text field 825, the tilt angle text field 826, the roll angle text field 827, and the viewing angle text field 828, the position and angle of the user's viewpoint can be changed. Set the viewing angle.

These values represent the values of the coordinate system shown in FIG. To describe the relationship, the value of the X coordinate text field 822 is the value of the X axis 1801. The value of the Z coordinate text field 823 is the value of the Z axis 1802. The value of the Y coordinate text field 824 is Y axis 180
The value is 4. The unit of these three coordinates is, for example, meters. Also, a pan angle text field 825
Is the value of the pan angle 1805. The value of the tilt angle text field 826 is the value of the tilt angle 1806. The value of the roll angle text field 827 is 180
The value is 7. The value of the viewing angle text field 828 is the value of the viewing angle 1808. The unit of these angles is, for example, meters.

The adjusted position, angle, and viewing angle of the user's viewpoint return to the initial state by clicking the default button 829 with the mouse.

When the user viewpoints 1206 and 1207 are selected, the user viewpoint adjustment window becomes a user viewpoint adjustment window 820 'shown in FIG. The parameter values set in this window are
20 shows values in the coordinate system shown in FIG. To describe the relationship, the viewing direction text field 822 'is Y' axis 1
The value of the angle 1903 in the right-hand screw direction with 904 being positive, the distance text field 823 'is the value of the distance 1910 from the center of the CG character 607, the viewing height text field 824' is the value of the distance 1909 in the Y'-axis direction, View pan angle direction text field 825 'is pan angle 1905
Value, viewing tilt angle text field 826 ′ is the value of tilt angle 1906, viewing roll angle text field 8
27 'is the value of the roll angle 1907, and the viewing angle text field 828' is the value of the viewing angle 1908.

When the close button 840 'is clicked on with a mouse, the values adjusted for the position, angle, and viewing angle of the user's viewpoint are stored in the internal data, and the user viewpoint adjustment window 820' is closed.

When previewing from the beginning to the end of a television program created by the preview controller 301 shown in FIG. 4, conventionally, an image taken from the camera viewpoint in the CG studio is displayed. It is now possible to preview television programs viewed from the user's viewpoint.

An example of a process for performing a preview from the user's viewpoint will be described with reference to FIGS. 23 and 24. FIG. 23 is a diagram showing an embodiment of the preview window of the present invention. FIG. 24 is a flowchart for explaining the operation of one embodiment of the preview window of the present invention. FIG.
Here, the same components as those described so far are denoted by the same reference numerals.

First, in step 2400, the operator causes the preview controller window 301 to pop up as shown in FIG. Note that this operation has been described with reference to FIG.

Next, in step 2401, the viewpoint is switched from the camera viewpoint to the user viewpoint. In the case of FIG. 23, the viewpoint menu 702 is switched to the user viewpoint, and the position menu 603 is switched to the front.

Next, in step 2402, the reproduction button of preview controller window 301 is clicked on with a mouse.

In response, in step 2403, the preview of the program is started. And step 2
At 404, one event in the program is read.

Next, in step 2405, it is determined whether or not the event read in step 2404 is an event relating to a camera in the CG studio. If the event is not an event relating to a camera, the process of step 2406 is performed. If not, the process proceeds to the next step 2407 without performing any process.

In step 2407, the event is generated, and the generated event is displayed on preview screen 2301.

At step 2407, it is determined whether or not the event of the program has ended. If the event has not ended, the process returns to step 2404 to read the next event. If the event is over, step 24
In step 08, the preview of the program ends.

That is, steps 2404 to 24
By inserting the conditional branch of step 2405 during the period 07, only the event relating to the camera in the CG studio is not previewed, so that the image always viewed from the user's viewpoint is displayed on the preview screen 2301.

As a result, the progress of the program in the CG studio can be viewed throughout the CG studio without changing the camera video for actual reproduction or broadcasting, or the progress of an individual CG character can be viewed. Since only the CG character in front of the user can be seen from the viewpoint, the progress of the program can be grasped diversified and quickly.

In the above embodiment, the CG character is described as imitating a human. However, the present invention is not limited to a human being, but may be applied to a creature, a plant, or any other object that can be displayed as an image regardless of whether it is realistic or virtual. It goes without saying that the present invention can be applied.

Further, in the above embodiment, the position of the camera installed in the CG studio is a predetermined position, but may be any other position.
It goes without saying that changes and additions can be made. Further, it is obvious that the projection method and each parameter that can be set are also freely set according to the situation.

In the above embodiment, the TV program editing apparatus for producing and editing a TV program has been described. However, the present invention is not limited to the TV program, but may be, for example, a moving picture editing apparatus such as an educational video, a demonstration video, and a conference material. It is self-evident that the present invention can be applied to any device for producing and editing video information, such as a CG studio imitating an actual television studio, and any image (scene) corresponding to virtual reality (virtual reality space). ) Can be applied to a space in which an image (scene) actually photographed and virtual reality are combined.

An apparatus for implementing the editing method of the present invention can be realized by a general-purpose computer. A system that implements the editing method of the present invention includes a CPU that operates according to a program of the editing method, a RAM for temporarily storing the data, an input / output interface that controls the exchange of signals with the outside, and a bus that connects them. And

The program of the editing method according to the present invention may be stored in a computer-readable recording medium and downloaded to a storage device of the computer for use.

[0140]

As described above, according to the present invention, when arranging an object in the CG studio, the position of the object is referenced by referring to the image acquired using the user viewpoint set in the CG studio. Relationships can be easily understood,
The work of arranging objects could be performed quickly.

As a second effect of the present invention, when confirming the operation of the CG character, the position of the CG character is moved by using a user viewpoint which is always set in front of the CG character. CG in the middle
The movement of the character could be confirmed up close, and the program editing work could be performed quickly.

Further, as a third effect of the present invention, C
When it is desired to grasp the arrangement of the objects in the G studio more accurately, the arrangement of the objects can be grasped accurately regardless of the depth by changing the projective transformation from the user's viewpoint to the orthographic projection.

As a fourth effect of the present invention, since the position and angle of the user's viewpoint can be easily changed by the operator himself, only the object that he wants to confirm can be seen from the user's viewpoint.

Further, as a fifth effect of the present invention, when previewing the entire program, not the viewpoint of the camera but the
By using the user's viewpoint that looks over the entire CG studio or the user's viewpoint that looks only at the action of an individual CG character, the progress of the program can be grasped diversified and quickly.

[Brief description of the drawings]

FIG. 1 is a diagram showing one embodiment of an editing screen of the present invention.

FIG. 2 is a block diagram of a television program editing system.

FIG. 3 is a diagram showing a basic editing screen of a conventional television program editing device.

FIG. 4 is an exemplary view showing a preview window of the television program editing apparatus.

FIG. 5 is a view showing a studio setup preparation window.

FIG. 6 is a diagram showing a studio setup preparation window.

FIG. 7 is a view showing a serif preparation window.

FIG. 8 is a diagram showing an operation preparation window.

FIG. 9 is a diagram showing an embodiment of an editing screen according to the present invention.

FIG. 10 is a diagram showing an embodiment of an editing screen according to the present invention.

FIG. 11 is a diagram showing an embodiment of an editing screen according to the present invention.

FIG. 12 is a diagram showing an embodiment of an arrangement of user viewpoints according to the present invention.

FIG. 13 is a diagram showing an embodiment of an arrangement of user viewpoints according to the present invention.

FIG. 14 is a flowchart illustrating an embodiment of a method of setting a user viewpoint according to the present invention.

FIG. 15 is a flowchart illustrating an embodiment of a method for setting a user viewpoint according to the present invention.

FIG. 16 is a flowchart illustrating an embodiment of a method of setting a user viewpoint according to the present invention.

FIG. 17 is a flowchart illustrating an embodiment of a method of setting a user viewpoint according to the present invention.

FIG. 18 is a view for explaining an example of a coordinate system in a CG studio.

FIG. 19 is a view for explaining an embodiment of a method of setting position data of a user viewpoint according to the present invention.

FIG. 20 is a flowchart illustrating an embodiment of an operation of switching from a camera viewpoint to a user viewpoint according to the present invention.

FIG. 21 is a flowchart illustrating an embodiment of an operation of switching from a camera viewpoint to a user viewpoint according to the present invention.

FIG. 22 is a view showing an example of a preview window in the case of a user viewpoint when the CG studio is viewed from directly above.

FIG. 23 is a view showing an embodiment of a preview window of the present invention.

FIG. 24 is a flowchart illustrating the operation of an embodiment of a preview window of the present invention.

[Explanation of symbols]

101: CPU, 102: memory, 103: CG animation generator, 104: speech synthesizer, 10
5: Sequencer unit, 106: Magnetic storage device, 107:
Moving image generation unit, 108: monitor, 109: input device, 110: bus, 201, 201-1, 201-
2,201-3,201-4,201-5,201-
6,201-7,201-8,201-9,201-1
0, 201-11: edit screen, 202, 202 ': studio block, 203, 203': movie block, 204: title block, 205: super block, 206: sound block, 207: narration block, 208: various setting blocks ,
209: event mark, 210: line setting part,
211: motion setting part, 212: camera work setting part, 213, 214: slider, 215: start block, 216: end block, 220: event pull-down menu, 301: preview controller window, 302: play button, 40
0, 400-1: Studio setup preparation window, 401: CG character setting board, 402:
X coordinate text field, 403: Z coordinate text field, 404: orientation setting field, 41
0: set button, 411: setting board column, 41
2: Add button, 413: Setting mode option menu, 414: Slider, 421: CG character setting board, 500, 500-1: Preview window, 501: Camera setting board, 502: X coordinate text field, 503: Z coordinate text Field, 504: Y coordinate text field, 50
5: Pan angle text field, 506: Tilt angle text field, 507: Roll angle text field, 508: Viewing angle text field, 51
1: Camera setting board column, 512: Add button, 5
13: setting mode option menu, 514: slider, 521: camera setting board, 600, 60
0-1, 600-2, 600-3, 600-4: preview window, 601: preview screen, 60
2: View point menu, 603: Position menu, 60
4: Projection conversion menu, 605: Viewpoint adjustment button,
606: 607: CG character, 650: pointer, 701: preview screen, 702: viewpoint menu, 750: serif preparation window, 751: character menu, 752: serif setting unit, 75
3: slider group, 754: option menu group,
755: slider, 802: viewpoint menu, 80
3: Position menu, 804: Projection conversion menu, 8
05: user viewpoint menu, 830: preview window, 831: preview screen, 820: user viewpoint adjustment window, 821: user viewpoint position display column,
822: X coordinate text field, 824: Y coordinate text field, 823: Z coordinate text field, 825: Pan angle text field, 82
6: tilt angle text field, 827: roll angle text field, 828: viewing angle text field, 829: default button, 850: operation preparation window, 851: operation target menu, 8
52: operation menu, 853: character menu,
854: Option menu, 855: Text field group, 1200, 1200-1, 1200-2:
CG studio, 1201-1207: camera, 14
01: preview screen, 1403: position menu, 1
501: preview screen, 1503: position menu,
1550: operation preparation window, 1551: operation target menu, 1552: operation menu, 1553:
Character menu, 1555: Option menu, 1800: CG studio center (origin), 18
01: X axis, 1802: Z axis, 1804: Y axis,
1805: Y axis rotation direction, 1803: Z axis rotation direction angle, 1806: X axis rotation direction, 1807: Z axis rotation direction, 1808: viewing angle, 1900: center of CG character 607, 1901: X 'axis, 1902 :
Z 'axis, 1904: Y' axis, 1903: Right-handed screw angle, 1910: Distance from center of CG character 607, 1905: Pan angle, 1906: Tilt angle,
1907: roll angle, 2201: preview screen,
2203: Position menu.

Claims (12)

[Claims] 1. A moving picture editing apparatus based on a moving picture generating technique using a computer graphics animation, a moving picture, a music file, a voice synthesizing apparatus, and the like, has a plurality of viewpoints for acquiring an image which is not reproduced or broadcasted. Is set in advance, switching to any of the plurality of viewpoints, referring to the moving image being edited viewed from the switched viewpoint, and performing moving image editing while confirming the referenced image. Video editing method. 2. The moving image editing method according to claim 1, wherein the viewpoint is always set near an object existing in the image, and the viewpoint is moved according to the movement of the object. How to edit moving images. 3. The moving image editing method according to claim 1, wherein a projection method for referring to an image viewed from the viewpoint is switched. 4. The moving image editing method according to claim 1, wherein the viewpoint can be adjusted to any position and direction. 5. The moving image editing method according to claim 1, wherein a window for changing a parameter for adjusting the position and the direction of the viewpoint is displayed, and the viewpoint is changed by changing a parameter of the window. A moving image editing method, characterized in that 6. An image including a computer graphics animation is converted into a virtual reality space studio (hereinafter, CG).
A video editing method for editing an image in a CG studio as a viewpoint for obtaining an image to be reproduced or broadcasted. Setting a user viewpoint for acquiring an image in the CG studio as a viewpoint for confirming the arrangement of the camera viewpoint, storing setting information of the camera viewpoint and the user viewpoint in a storage device, and a desired camera viewpoint and a user viewpoint from the storage device Read out the image being edited on the display device from the read user's viewpoint, edit the moving image by operating the arrangement of the objects in the CG studio while viewing the play-viewed image, A moving image editing method, wherein the read image from the camera viewpoint is edited as an image for reproduction or broadcasting. . 7. The moving image editing method according to claim 6, wherein the user viewpoint maintains a relative relationship with a designated portion of the selected object in the CG studio in accordance with movement of the selected object. A moving image editing method characterized by moving while moving. 8. The moving image editing method according to claim 6, wherein a setting condition of the user viewpoint can be changed during editing of the moving image. 9. The moving image editing method according to claim 6, wherein an image obtained by viewing the CG studio from the user's viewpoint is a perspective projection display or an orthographic projection display. A moving image editing method characterized by selectively switching. 10. The moving image editing method according to claim 1, wherein the data for setting the user viewpoint is a position and an orientation for a camera to image the CG studio. Characteristic moving image editing method. 11. A computer-readable recording medium according to the present invention is a display of video information including computer graphics animation, and said computer-readable encoding means displays information of image data related to a video program on a display device. Means for displaying on a screen, means for reading from a storage device data relating to a camera viewpoint which is a viewpoint of the reproduced image of the video program, and a user viewpoint for editing other than the camera viewpoint, and data relating to the user viewpoint. Means for displaying, on a display device, an image viewed from the user's viewpoint based on the computer-readable recording medium. 12. The computer-readable recording medium according to claim 11, wherein the information of the image data is T
VML (Tele-Vision Program M
A recording medium readable by a computer.