JPH11250276A - Picture editing device and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily edit a picture including an object in a time axial direction. SOLUTION: This device is provided with an outputting part 20 including a CRT 22 for displaying a time axial display area for displaying plural time bars to specifying a time on a time axis and an object display area for displaying plural objects on the same screen, an inputting part 10 including a pointing device 13 for setting a time bar, and a central processing part 1 for controlling an object displayed in the object display area corresponding to a time specified by the time bar displayed in the time bar display area. Thus, the shape of the object in plural points of time or the changing shape between objects can be simultaneously displayed in the same space. Thus, while the object in a certain point of time is fixedly displayed, the object in another point of time can be simultaneously displayed, and those objects can be moved with respect to time.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an image editing apparatus and method for editing an image, and more particularly, to an image editing apparatus and method for editing an image including an object using a time axis.

[0002]

2. Description of the Related Art Conventionally, authoring software for authoring and editing image data, and game creation software for creating a game including image data, have been proposed.
2. Description of the Related Art There has been provided a display technique for displaying an object which is a target in editing image data having a time axis on the same screen.

In editing object data having a time axis, how an object at the present time has changed from an object at a previous (past) time, or how it changes at an earlier (future) time. You have to edit while confirming. For this reason, onion skin, a technique that displays several consecutive frames along the past or the future from that point on, and sometimes overlays objects from all frames with a little transparency,
A method is known in which a time bar is operated to sequentially display and confirm objects at that time from the past and the future.

[0004] In key frame-based object editing, an editing technique for saving and setting attributes of an object between two arbitrary key frames is provided.

That is, in key frame-based object editing, a method of storing one attribute of an object set between two key frames, for example, position information, and applying the stored data to another object is known. Have been taken. This is because, for example, when creating an animation, the operation of deciding the movement is complicated and difficult,
This is because a skilled technique is required to set the same motion, and it is convenient to apply the motion once set to another object. However, according to this method, the section in which the attribute is stored is limited from the beginning to the end, and all the attributes of the object are limited.

[0006] Further, in editing and browsing work in an authoring system or the like for authoring and editing image data, there is provided an editing operation and browsing technique for maintaining a series of work histories and visualizing the operation.

In this editing technique, there is a case where an operation history is held at the time of editing or browsing of image data, and the editing or browsing performed up to that time is redone. In this case, the previous operation was unconditionally returned, or displayed on a menu or the like to be specified, and the operation was redone.

[0008] In key frame-based object editing, a definition and an editing technique for a relationship between two or more objects are provided.

That is, in the editing using the key frame base, when a plurality of objects are handled as a group, a method is adopted in which the objects are grouped on a display screen displaying the objects and all are handled as one object. I have been.

Furthermore, in editing an object along a time axis based on a key frame, trajectories set between key frames are grouped, and automatically set between key frames before and after the key frame when the key frame is changed. Editing techniques that can make relative changes in the trajectory are provided.

According to this editing technique, in editing using a key frame, a display screen for displaying the key frame includes:
For example, after setting the values of key 1 to key 4, key 1
The value of the key 4 may be changed while keeping the trajectory from the key to the key 4 relatively. In the conventional system, the values of the key 2 and the key 3 are manually set again, the locus is displayed on the editing screen, and the locus from the key 1 to the key 4 is grouped as a group. For example, the point corresponding to the key 4 of the trajectory was moved.
However, in such a grouping, when the value of the key 2 is changed after the keys 1 to 4 are grouped, the trajectories between the keys 1 and 2 and between the keys 2 and 3 are relatively determined. It was difficult to change the value of key 2 while maintaining it.

[0012]

In editing an object in the time axis direction, one time bar is provided on the time axis, and only an object at a certain point where the time bar is set is displayed and edited. Before and after the point in time, it is difficult to simultaneously check how the object is changing.

However, even if the onion skin described above is used to simultaneously display changes of other objects in the same space, the shapes of the objects at all points in time are displayed on the screen although they are transparent, making it very difficult to see. . For this reason, there is a drawback that it is difficult to edit while confirming a temporal change of the object to be edited and other related objects.

In key frame-based object editing, conventionally, one attribute of an object, such as position information, set between certain two key frames is stored, and the attribute is applied to another object. I was However, the information that can be stored is all the attributes of the object. In addition, in the application of the attribute, it was not possible to specify an arbitrary section and apply it.

Furthermore, when an operation history is retained and an editing or browsing operation is performed again, it has not been possible to display at a glance what the operation was up to that point. Although the operation history may be shown as text as a menu,
It was difficult to tell what kind of operation was performed.

In key frame-based object editing, when a plurality of objects are handled as a group, a method of grouping the objects is used. All the objects in are treated as one, so in order to change the position of that one object, perform processing such as ungrouping, changing the position, and re-grouping. Was very cumbersome and complicated.

Further, in key frame-based object editing, attribute values such as the position of an object can be set or changed.
Only for the time corresponding to the keyframe. For this reason, there is one point that it is difficult to change the values of the key frames at both ends while maintaining the relationship between the value groups set between a certain key frame and another key frame relatively. The difficulty of this operation is due to the fact that it is not possible to operate only the key frame of interest, but also to another key frame or an object displayed on the screen. .

The present invention has been made in view of the above situation, and shows a state at a plurality of points of time of all objects existing in the same space at a certain point in time when a specific time bar is set. An object of the present invention is to facilitate editing while confirming a temporal change of an object.

Further, the present invention selectively saves attribute information set between any two key frames of the application object and selects attribute information set between any two key frames of the application object. It is intended to be applied in a targeted manner.

Further, according to the present invention, by visualizing and displaying the kind of operation, it is possible to understand what kind of operation has been performed just by looking at the operation, and to edit or browse the immediately preceding operation. An object of the present invention is to improve work efficiency by providing means that can be seen inside.

According to the present invention, a hierarchical relationship is set between two objects, the position of another child object is determined according to the movement of the target parent object, and each object is designated. In this case, an object is to enable setting by superimposing a target object on a target object using a keyboard or a pointing device on a screen.

Still further, the present invention introduces the concept of a sub-key frame between key frames, and groups the trajectories set between the key frames so that the change of the value of the key frame can be processed for the key frame of interest. The goal is to be able to do just that.

[0023]

In order to solve the above-mentioned problems, an image editing apparatus according to the present invention is an image editing apparatus for editing an image including an object along a time axis. A display means having a time axis display area for displaying a plurality of bars on the time axis, an object display area for displaying a plurality of objects on the same screen, and setting a time bar in the time axis display area of the display means And a control unit for causing the object displayed in the object display area of the display means to correspond to the time specified by the time bar in the time axis display area.

An image editing method according to the present invention is an image editing method for editing an image including an object along a time axis, wherein a time axis display area for displaying a plurality of time bars for specifying time on the time axis; A display step having an object display area for displaying a plurality of objects on the same screen, a time bar setting step of setting a time bar in a time axis display area of the display means, and an object display area of the display means And a control step of causing the object displayed in the step (b) to correspond to the time specified by the time bar in the time axis display area.

That is, in the image editing apparatus and method, in editing an object along a time axis, a plurality of time bars can be set, thereby displaying the shapes of the objects at a plurality of time points in the same space. This is an editing method characterized by having a means for clarifying a changing shape such as a locus connecting objects at a point in time and an object of interest. Further, it has control means for displaying / non-displaying the shape of the object to be displayed simultaneously.

Therefore, in the above-described image editing apparatus and method, the conventional time bar control unit for displaying only the current time is extended, a mechanism for setting a plurality of time bars is provided, and the selected time bar to be noted is It is highlighted in different shapes and colors to distinguish it from others. In addition, a mechanism for setting the display / non-display attribute of each object provided on the designated time bar is provided.

The time bar setting means comprises a list of objects existing in the same space and a time bar, and the object display section displays a change shape such as a shape or a locus of each object in a two-dimensional or three-dimensional space. .

According to the above-described image editing apparatus and method, a plurality of time bars can be set at desired points on the time axis, and display / non-display of an object corresponding to each time bar can be selected. Therefore, it becomes possible to view and edit only the desired object both spatially and temporally.

Further, in order to solve the above-mentioned problem, an image editing apparatus according to the present invention provides an image editing apparatus for an object having attribute information including at least one of a position, a direction, a size, and an angle. In an image editing apparatus that edits an image including a time axis along a time axis, a time axis display area for displaying a plurality of time bars for specifying time on the time axis and an object display area for displaying a plurality of objects are the same. Display means on a screen, time bar setting means for setting a time bar in a time axis display area of the display means, and an object displayed in an object display area of the display means, Control means for corresponding to the time specified by the bar; section selection means for arbitrarily selecting a section along the time axis of the object; and attribute value of the section selected by the section selection means. And attribute value control means for, and has a storage means for storing information under the control means.

According to the image editing method of the present invention, for an object having attribute information including at least one of a position, a direction, a size, and an angle, an image including the object is edited along a time axis. A display step of, on the same screen, a time axis display area for displaying a plurality of time bars for specifying time on the time axis, and an object display area for displaying a plurality of objects in the image editing method; A time bar setting step of setting a time bar in the time axis display area of
A control step of causing an object displayed in the object display area of the display means to correspond to a time specified by a time bar of the time axis display area; and optionally, a section along the time axis of the object. A section selection step of selecting, an attribute value control step of controlling an attribute value of an attribute of the section selected by the section selection means, and a storage step of storing information under the control of the control means. is there.

That is, the image editing apparatus and method include a means for arbitrarily setting a section in which one or more attributes of an object are stored or applied in key frame-based object editing. .

For this reason, if the start time corresponding to the start frame or the end time corresponding to the end frame is not a key frame, a new key frame is generated in the stored data at that time, and the value of the attribute of the time and Necessary data is generated by a method such as an attribute of a section up to a next key frame or an end frame. In applying the attribute, the key frame is applied by actually generating a key frame. In this method, the time corresponding to the start time is managed as a relative time as zero, and the value corresponding to the start time is also managed as a reference value and stored as a relative value for each value. This is made possible by having means.

The image editing apparatus and method have means for selecting an attribute to be saved from a plurality of attributes of the object when saving, and apply only the same attribute as the object to be applied when applying. In addition, there is provided a means for selecting an attribute to be applied in the same manner as when saving.

Therefore, according to the image editing apparatus and method, in key frame based object editing,
The information of a plurality of attributes of an object set between any two points can be selectively stored, and the attribute of an object to be applied can be stored between any two points of another object or the same object. In addition, it is possible to selectively select and apply information of a plurality of attributes from the stored information.

Further, in order to solve the above-mentioned problems, the image editing apparatus according to the present invention has a history control unit for controlling history information relating to a series of operations, and a visualizing means for visualizing the history information. The display means displays the history visualized by the visualization means.

That is, in the above-described image editing apparatus, in a system in which editing and browsing operations are performed while maintaining an operation history, each operation is visualized and displayed as an icon, so that any operation can be performed. It has means that can be understood only by seeing whether or not the operation has been performed.
Further, by continuing to display the immediately preceding operation even during the operation, the operation efficiency of the re-operation is improved.

Therefore, according to the image editing apparatus, when an operation is performed immediately before or retroactively in an editing or browsing operation, what kind of operation is restored by looking at the operation that is visualized and displayed. It helps to improve work efficiency. Since the immediately preceding operation is always displayed, the efficiency of the operation of redoing the operation is improved.

In order to solve the above-mentioned problem, the image editing apparatus according to the present invention has a hierarchical structure control means for setting or changing a hierarchical structure based on a relationship between objects.

That is, in the key frame-based object editing, the image editing apparatus determines the attribute values such as the position and direction of the object by determining the position of the parent object of the hierarchical structure corresponding to the key frame by the attribute value. , The editing and browsing are performed by calculating the position and direction of the child object at each time by maintaining the direction and the distance to the child object. In addition, as a means for designating a parent object, editing and browsing are performed by having a method of superimposing on a parent object.

Thus, the procedure and method for performing processing such as grouping are greatly facilitated. Even if a hierarchical relationship is set between objects, attribute values such as the position of each object can be freely changed as long as the attribute values correspond to key frames.

Therefore, according to the present invention, in key frame-based object editing and browsing, processing such as grouping can be performed by simpler operations, and even after grouping or the like, each object can be edited. The ability to change attribute values such as position makes it particularly easy to edit.

Still further, in order to solve the above-mentioned problem, the image editing apparatus according to the present invention uses the key frame for the trajectory of an object set between key frames at discrete times in the time axis direction. It has key frame control means for selecting a section as a unit, and trajectory control means for controlling the trajectory of the section selected by the key frame control means.

That is, in the key frame-based object editing, the image editing apparatus sets an arbitrary number of sub-key frames between key frames, and sets the number of sub-key frames corresponding to the key frames in the same manner as the key frames. By allowing you to set, change, etc.
A locus set between key frames is grouped. In addition, even if the keyframe values at both ends are changed, it has a function of automatically recalculating by a method such as freeform deformation so that the value set in the subkeyframe between them is relatively maintained. is there.

Further, since the image editing apparatus can set a sub-key frame between two key frames, it is not necessary to set many key frames when setting the motion of an object.

Therefore, according to the image editing apparatus, in key frame-based object editing, the number of key frames themselves can be reduced, and the value corresponding to the sub key frame can be changed by a simple operation. Become.

[0046]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an image editing apparatus and method according to the present invention will be described with reference to the drawings.

As shown in FIG. 1, the image editing apparatus includes a central processing unit 1 for controlling a series of procedures relating to image editing in the image editing apparatus, and transmits predetermined information under the control of the central processing unit 1. And a storage unit 2 for storing.

The central processing unit 1 is control means for centrally performing image editing and other processing of the image editing apparatus.
The central processing unit 1 performs processing on the control data input from the input unit, for example, according to the processing procedure read from the storage unit 2, and outputs data resulting from this processing to the output unit. Here, when performing a predetermined operation related to image editing, a control unit corresponding to the recording unit is provided, and the predetermined operation is executed based on the control of the control unit. The predetermined operation related to the image editing will be described later in detail.

The storage unit 2 is a storage unit for writing and reading information under the control of the central processing unit 1. The storage unit 2 temporarily stores an image related to image editing, and is provided with a predetermined control unit related to image editing.

In the image editing apparatus, the input unit 10
It has a disk 11, a keyboard 12, and a pointing device 13. Information is input to the disk 11, the keyboard 12, and the pointing device 13 of the input unit 10, and the input information is transmitted to the central processing unit 1.

The input unit 10 is used to add or delete an image and a time axis relating to an object, to move data, or to move the time, or the shape of a three-dimensional computer graphics model (hereinafter referred to as a 3DCG model) at each time. , Coordinates, colors, light sources, and the like.

The disk 11 is a recording medium for reading, for example, magnetically, optically, or magneto-optically recorded information on a disk-shaped medium housed in a housing. The disc 11 is, for example, a CD-R in which information is optically recorded on a polycarbonate substrate having a diameter of 120 mm.
OM is provided. In addition, there has been provided a hard disk drive in which a disk-shaped substrate coated with a so-called magnetic material is rotationally driven to record and reproduce information on and from the disk. The disk 11 reads out predetermined information such as the shape and coordinate data of a 3DCG model.

The keyboard 12 is an input device in which a plurality of push-button switches are provided on the main surface of a casing that is flat and substantially rectangular. For example, the keyboard 12 is used to input an image corresponding to an object or movement, addition or deletion of a time axis.

The pointing device 13 is an input device for inputting information relating to a position, for example, in correspondence with a cursor displayed on a CRT. For example, a mouse can be used as the pointing device 13. Specifically, the pointing device 13 receives information necessary for moving, adding, or deleting an image or a time axis corresponding to an object that is a target object.

In the image editing apparatus, the output unit 20
It has a disk 21, a CRT 22, and a printer 23. The output unit 20 displays or saves a processing result on the object and the time axis given from the central processing unit 1.

The disk 21 is a recording medium capable of recording information magnetically, optically, or magneto-optically on a disk-shaped substrate, like the disk 11 provided in the input unit 10. As the disk 21 included in the output unit 20, a recordable disk 21 can be used.
When a recordable / reproducible disk is used, it can also be used as the disk 11 of the input unit 10.

The CRT 22 is a graphic display for displaying given information as an image on the screen. For example, as shown in FIG. 2, the CRT 22 has a first window 22a which is an object display area including an object, and a time bar display area which has a plurality of time bars set on the display screen of the CRT 22. 2 is displayed.

The printer 23 is an output device that prints out given information on paper and outputs it. This printer 2
3 outputs, for example, a processing result for the object and the time axis.

Next, editing of the image including the object along the time axis in the image editing apparatus will be described. This image editing includes, as shown in FIG. 2, one window 22a for displaying a plurality of objects displayed on the display screen of the CRT 22 and another window 22b for setting a time bar on a time axis. And operating the object and the time bar on these windows with a mouse as a pointing device of the input unit 10.

Specifically, in the above-described image editing method, a method using a key frame is used to generate an animation. In this method, a key frame is set at an arbitrary time (also called a frame) on the time axis, and an attribute value of an object corresponding to the time is set. Then, a value group between key frames is automatically generated by a method such as linear interpolation based on the values set in the preceding and following key frames. Here, the attribute value is, for example, a value representing position information.

At the time of such image editing, as shown in FIG. 3, a block related to control includes an object control unit 31 which is a control means for controlling an object.
And a time bar display unit 33 that is a time bar setting unit that controls the display of the time bar, and an object display control unit 32 that is a display unit that controls the display of the object. These object control unit 31, time bar control unit 33, and object display control unit 32 are interconnected.

These control blocks may be incorporated in the central processing unit 1, or may be realized by software using the storage unit 2. This is the same for a control block described later.

The object control unit 31 has one 3
The DCG model is held as one object. Then, the object list is managed, and control is performed as to which object exists at which time.

The time bar control section 33 manages the current time and controls and displays the current time bar.
In addition, control such as generation and deletion of a new time bar is performed.

The object display control unit 32 receives time from the time bar control unit 33 and receives a list of objects existing at that time from the object control unit 31. Then, the required shape and coordinate data of the object group are collected from the data and rendered to generate and display an image.

Next, image editing using the first window for displaying the object displayed on the CRT 22 and the second window for displaying the time axis will be described.

As shown in FIG. 4, the first window 22a edits a first object OBJ1 and a second object OBJ2 along a time axis.

That is, in the first window 22a, the first object OBJ1 of a fourteen-sided shape indicated by a solid line and the second object OBJ2 of a substantially regular triangle also indicated by a solid line 5 corresponds to the first time bar TB1 at the second time t2 in the second window 22b shown in FIG.

The first object OBJ1 'indicated by a dotted line and the second object OBJ2' also indicated by a dotted line correspond to the first object OBJ1 'in the second window 22b of FIG. Corresponds to the first time bar TB1 'at time t1.

In FIG. 5, since the first time bar TB1 has been moved from the first time t1 to the second time t2, the first object represented by the broken line in FIG. OBJ1 'and second object OBJ2'
Is a first time bar TB1 'at a first time t1.
Indicates the position before the movement corresponding to.

First time bar TB1 at time t1
', A first object OBJ1' corresponding to '
2, a first trajectory TRJ1 is displayed between the first time bar TB1 and the first object OBJ1 corresponding to the first time bar TB1. This first trajectory TRJ1 is at time t1
Between the time t2 and the first object OB
This indicates the route that J1 has moved.

A second object OBJ2 ′ corresponding to the first time bar TB1 ′ at the first time t1,
The second trajectory TR between the second object OBJ2 corresponding to the first time bar TB1 at time t2
J2 is displayed. The second trajectory TRJ2 indicates a path along which the second object OBJ2 has moved from time t1 to time t2.

As shown in FIG. 5, the second window 22b has a time axis TA, an axis A1 related to the first object OBJ1, and an axis related to the second object OBJ2 in order from the top to the bottom in the figure. A2 is displayed in parallel with the right side in the figure as the direction of elapse of time, and the horizontal direction in the figure as the axial direction.

A first time t1 and a second time t2 are displayed on the time axis TA. Of these, the second
At time t2 is highlighted in time t2.
2 indicates that it has been selected.

The axis A1 relating to the first object OBJ1 and the axis A2 relating to the second object OBJ2 have the axis A1 relating to the first object OBJ1 and the axis A1 relating to the second object OBJ2 at positions corresponding to the second time t2. A first time bar TB1 having a substantially rectangular shape with the longitudinal direction being the vertical direction in the figure so as to straddle the axis A2 relating to the second object OBJ2
Is displayed.

The axis A1 related to the first object OBJ1 and the axis A2 related to the second object OBJ2 are located at the position corresponding to the first time t1. The first time bar TB1 has a substantially rectangular shape with the vertical direction in the figure as a longitudinal direction so as to straddle the axis A2 of the second object OBJ2.
'Is indicated by a broken line. This first time bar T
B1 'virtually indicates a state in which the first time bar TB1 displayed at the position corresponding to the second time t2 is displayed at the position corresponding to time t1.

The first window 22a shown in FIG.
The first object OBJ1 and the second object OBJ2 in are linked to the first time bar TB1 in the second window 22b. That is, when the first time bar TB1 is moved from the time bar TB1 'at time t1 to the time bar TB1 at time t2 in the second window 22b shown in FIG. First
Is the object OBJ1 ′ represented by the solid line from the object OBJ1 ′ represented by the dotted line.
It moves along the first trajectory TRJ1 to J1. Also,
The second object O in the first window 22a
Similarly, the BJ2 moves along the second trajectory TRJ2 from the second object OBJ2 ′ represented by the broken line to the second object OBJ2 represented by the solid line.

Subsequently, in the second window 22b, a second time bar TB2 is added, and editing using two time bars of a first time bar TB1 and a second time bar TB2 will be described. I do.

In the first window 22a, as shown in FIG. 6, the first object OBJ1, the highlighted first object OBJ1 ', and the highlighted first object OBJ1' are displayed. A first trajectory TRJ1 toward the first object OBJ1 is shown.

The first window 22a has a second window 22a.
OBJ2, the highlighted second object OBJ2 ', and the second trajectory TRJ2 from the highlighted second object OBJ2' to the second object OBJ2.

In the second window 22b, as shown in FIG. 7, the second window 22b highlighted on the time axis TA is displayed.
At the position corresponding to time t2 of the first object OB
A substantially rectangular first time bar TB1 whose longitudinal direction is the vertical direction in the figure is displayed so as to straddle the axis A1 relating to J1 and the axis A2 relating to the second object OBJ2.

In the second window 22b,
At a position corresponding to the first time t1 on the time axis TA, the longitudinal direction is substantially the vertical direction in the drawing so as to straddle the axis A1 related to the first object OBJ1 and the axis A2 related to the second object OBJ2. Rectangular second time bar TB2
Is highlighted.

The first time bar TB1 of the second window 22b corresponds to the first object OBJ1 and the second object OBJ2 of the first window 22a. In addition, the second window 22b of the second
Correspond to the highlighted first object OBJ1 ′ and the similarly highlighted second object OBJ2 ′ in the first window 22a.

In the first window 22a,
The first object OBJ1 'is, as shown in FIG.
From the first object OBJ1 ′ corresponding to the second time bar TB2 at the first time t1 in the second window 22b shown in FIG. 9, the first object OBJ1 ′ corresponding to the time lapse direction along the first trajectory TRJ1. Object OB
Via J1c, OBJ1b and OBJ1a, the first window at the second time t2 in the second window 22b
Object OB corresponding to the time bar TB1 of
It has moved to J1.

In the first window 22a, the second object OBJ2 'corresponds to the second object OBJ2' corresponding to the second time bar TB2 at the first time t1 in the second window 22b.
Objects OBJ2c, OBJ2b, and O corresponding to times passing along the second trajectory TRJ2 from
The object has moved to the second object OBJ2 corresponding to the first time bar TB1 at the second time t2 in the second window 22b via the BJ2a.

The movement of the first object OBJ1 and the second object OBJ2 in the first window is performed at time t1 in the second window 22b.
This is because the second time bar TB2 in FIG. 5 is moved toward the second time t2, which is the direction in which time elapses.

Then, the position of the second object OBJ2 'in the first window 22a is set while moving the second time bar TB2 of the second window 22b from time t1 to time t2. In this way,
The position of the second object OBJ2 at the second time t2 can be set.

Here, when the second time bar TB2 is added to the second window 22b,
The object to be displayed corresponding to the time bar TB2 can be limited to, for example, the second object OBJ2.

That is, as shown in the second window 22b of FIG. 10, the symbol "" is placed on the axis A1 of the first object OBJ1 on the first time bar TB1 corresponding to the time t2 on the time axis TA. The symbol "x" TB1b is displayed on the axis A2 relating to the "O" TB1a and the second object OBJ2.

In the second window 22b, the axis A of the first object OBJ1 of the second time bar TB2 corresponding to the time t1 on the time axis TA is set.
The symbol "x" TB2a is displayed at the position corresponding to the position on the number 1, and the symbol "O" TB2b is displayed at the position corresponding to the axis A2 of the second object OBJ2.

The symbol "O" indicates that the corresponding object is displayed in the first window 22a, and the symbol "x" indicates that the corresponding object is not displayed in the first window. Therefore, the first time bar T
The second object OBJ2 ′ corresponding to the sign “○” TB2b in B1 is displayed in the first window 22a shown in FIG. 11, while the first object OBJ1 corresponding to the sign “×” TB2a is displayed. Not done. Further, the symbol ““ ”TB1a in the first time bar TB1
Is displayed in the first window 22a, but the second object OBJ2 corresponding to the symbol "x" TB1b is not displayed.
Here, the second object OBJ2 in the figure corresponds to the second time bar TB2, as described later.

In the second window 22b, when the second time bar TB2 located at the time t1 is moved toward the second time t2, which is a direction in which time passes, the first time bar TB2 shown in FIG. In the window 22a, the second object OBJ2 is moved from the second object OBJ2 ′ corresponding to the second time bar TB2 at the first time t1 in the direction in which the second time bar TB2 elapses. As it moves in the direction of a certain second time t2, along the second trajectory TRJ2, it passes through the second objects OBJ2c, OBJ2b and OBJ2a corresponding to each time in the moving direction of the second time bar TB2. When the second time bar TB2 reaches the second time t2 and overlaps the first time bar TB1, the second time bar TB2 indicated by a solid line Reach the object OBJ2.

As described above, only the necessary objects can be selectively displayed on the first display screen 22a for displaying the objects during the editing operation.
As a result, the efficiency of the editing operation can be improved.

Next, a series of procedures relating to the central processing unit 1 when the time bar is moved will be described with reference to a flowchart shown in FIG.

In the first step S11, a time bar to be moved is selected and time is set. For example,
Using the pointing device 13, one of the first time bar TB1 and the second time bar TB2 is selected in the second window 22b shown in FIG. Then, the process proceeds to step S12.

In step S12, the time is acquired from the time bar control unit 33 according to the movement of the selected time bar, and is passed to the object control unit 31. Then, the process proceeds to step S13.

In step S13, the object existing at the time specified by the time bar is obtained from the object control unit 31, transmitted to the object display control unit 32, and the process proceeds to step S14.

In step S14, the object display control unit 32 acquires and displays data such as the shape of an object necessary for display. That is, the object display control unit 32 determines which objects need to be displayed at that time, and passes a list of those objects to the object display control unit 32. Then, the object display control unit 32 acquires data such as a display shape from each object, and obtains the first window 22 on the display screen of the CRT 22.
It is displayed as an object in a. Then, this series of steps is completed, or step S11 or step S1 is performed.
Proceed to 2.

Next, a series of procedures relating to the central processing unit 1 when the time bar is added will be described with reference to a flowchart shown in FIG.

In the first step S21, time bar addition is selected from the menu by using, for example, the pointing device 13, and the process proceeds to the next step S22.

In step S22, the time at which the time bar is added is obtained from the time bar control unit 33.
This time is passed to the object control unit 31, and in the next step S23, an object existing at the time to be added is obtained from the object control unit 31, transmitted to the object display control unit 32, and proceeds to step S24.

In step S24, data such as the shape is acquired from the object that needs to be displayed and displayed, and in step S25, a new time bar is displayed. Then, this series of steps ends.

As described above, by simultaneously displaying the shape of the object at a plurality of time points and the changing shape between the objects in the same space, the object at a certain time point is kept fixed and displayed at another time point. Objects can be displayed simultaneously, and those objects can be moved in time. This makes it possible to easily edit the values such as the positions of the plurality of objects at a certain point in time.

In addition, it has become possible to recognize not only objects having the same mutual relationship but also other objects over time. Furthermore, by restricting the object of interest for each time bar, the movement of the object can be displayed and confirmed separately, and the efficiency of the editing operation can be further increased.

Next, storage or application of object attributes along a key frame-based time axis will be described.

When the attributes of the object are stored or applied along the time axis, as shown in FIG. 14, the internal structure related to the control includes an object control unit 31 which is a control means for controlling the object, A key frame control unit 34 which is a section selection unit for controlling a frame, an attribute value control unit 35 which controls an attribute value, and a storage data control unit 36 which is a storage unit for controlling storage data are provided. Here, the object control unit 31 is mutually connected to each of the key frame control unit 34, the attribute value control unit 35, and the stored data control unit 36.

Here, a series of procedures for storing the attributes of the object in the time axis direction will be described with reference to the drawings.

When the second window 22b relates to the operation of the attribute of the object, as shown in FIG. 15, the second window 22b relates to the time axis TA, the axis A1 relating to the first object OBJ1, and the axis relating to the second object OBJ2. In addition to the axis A2, selection buttons of a “time bar” button B1, a “start” button B2, an “end” button B3, and a “save” button B4 are arranged in order from left to right above the time axis TA in the figure. Is displayed.

In the second window 22b, on the axis A1 relating to the first object OBJ1,
In the direction of elapse of time, the first key frame KF
1, a second key frame KF2 and a third key frame KF3 are displayed. Among these key frames, the first key frame KF1 and the third key frame KF3 are highlighted.

Here, when the "time bar" button B1 is selected in the second window 22b, a first time bar TB1 'is displayed. The first time bar TB1 'is located at the end of the second window 22b in the direction opposite to the direction in which time passes with respect to the time axis TA.

In the second window 22b,
When the "start" button B2 is selected, as shown in FIG. 16, the first time bar TB1 'moves in the direction of elapse of time and overlaps with the first key frame KF1,
This is the first time bar TB1.

When the "time bar" button B1 is selected in the second window 22b while the first time bar TB1 is displayed, as shown in FIG. 17, the time on the time axis TA in the figure is displayed. A second time bar TB2 'is displayed at the end in the direction of passage.

In the second window 22b,
When the "end" button B3 is selected, as shown in FIG. 18, the second time bar TB2 'displayed at the end of the time elapse direction moves the third key in a direction opposite to the time elapse direction. Move to a position overlapping frame KF3. As a result, a key frame-based section for storing attributes is set.

In the second window 22b,
When the "save" button B4 is selected, the first menu window 40a is displayed on the second window 22b shown in FIG. 19, as shown in FIG.

In the first menu window 40a, a “position” selection area 41, a “direction” selection area 42, a “size” selection area 43, a “mode” selection area 44, and a A "Confirm" selection area 45 is displayed.

Each of these selection areas 41 to 45 takes two states, “ON” and “OFF”, except for the “confirmation” selection area 45, and transitions between these two states. ing. Then, in the "on" state, a so-called dash is displayed. The “confirmation” selection area 45
It is used to confirm the setting of the above-mentioned state. When this "confirmation" selection area 45 is selected, after the above-mentioned state is set, the first menu window 40a is escaped.
These "ON" and "OFF" can be switched by, for example, positioning the cursor in the selection areas 41 to 44 and clicking with the mouse.

In the first menu window 40a, a “position” selection area 21 and a “direction” selection area 4
2 is selected, and a so-called point is displayed.
The “size” selection area 43 and the “mode” selection area 44 are not selected. In this case, the “position” selection area 41 and the “direction” that are in the “on” state where the point is displayed.
Attribute values for the position and direction corresponding to the selection area 42 are stored, and the “size” selection area 4 in the “off” state
3 and the attribute value for the size and mode corresponding to the “mode” selection area 44 are not stored.

The first menu window 40
a, the second window 2 shown in FIG.
When the "Save" button B4 is selected in 2b and the first menu window 40 appears, the "position" selection area 41 of the first menu window 40, the "direction"
The selection area 42, the “size” selection area 44, and the “mode” selection area 44 are all “on”.

After setting the attributes in these selection areas, when the "confirmation" selection area 45 in the first menu window 40a is selected, the attribute values for the selected "position" and "direction" are stored. The pool window 46 shown in FIG. 22 is displayed on the second window 22b shown in FIG.

In the pool window 46, a first attribute information icon 47, a second attribute information icon 48, and a third attribute information icon 49 are shown. Here, since the attribute information between the selected key frames is stored in correspondence with the third attribute information icon 49, the third attribute information icon 49 is highlighted.

Next, the application of the attribute stored as described above will be described. In the second window 22b, as shown in FIG.
On axis A according to J2, in the direction of elapse of time,
A first key frame KF1 and a second key frame KF
2 is displayed. The first object OBJ
No key frame is displayed on the axis A1 related to No. 1.

In the second window 22b,
When the "time bar" button B1 is selected, a first time bar TB1 'is displayed at the end of the time axis in the direction opposite to the elapse of time on the time axis.

In the second window 22b, when the "start" button B2 is selected as shown in FIG. 24, when the "start" button B2 is selected, the first time bar TB1 displayed at the end opposite to the direction in which time elapses is displayed. 'Reaches the position of the first time bar TB1 in the figure overlapping the first key frame KF1 in the direction in which the time elapses.

In the second window 22b, when the "time bar" button B1 is selected while the first first time bar TA1 is displayed as shown in FIG. A second time bar TB2 'is displayed at the end of TA in the direction of time passage.

When the "end" button B3 is selected in the second window 22b as shown in FIG. 26, the second time bar TB2 'displayed at the end of the time elapse direction displays the time. A second time bar TB2, which is overlaid on the second key frame KF2, is reached in a direction opposite to the elapse direction. As a result, a key frame-based section to which the attribute is applied is set.

In the second window, as shown in FIG. 27, the icon 49 of the third attribute information stored earlier from the pool window 46 shown in FIG. 22 displayed on the second window 22b. And drag it with the mouse to the section between the first key frame KF1 and the second key frame KF2 on the axis A2 relating to the second object OBJ2, and drop it in the section. The icon 49 of the third attribute information in the pool window 46 is shown as an attribute ATR on the axis A2 relating to the second object OBJ2.

When the attribute ATR is stored, the second
28, a second menu window 40b shown in FIG. 28 appears. The second menu window 40b has the same selection area as the first menu window 40a shown in FIG. That is, the second menu window 40b includes a “position” selection area 41, a “direction” selection area 42,
A “size” selection area 43, a “mode” selection area 44, and a “confirmation” head area 45 are provided. Here, since the “position” selection area 41 is selected from the selection areas 41 to 44, only the attribute information relating to the position is applied. When the “confirmation” selection area 45 is selected, the application of the attribute area relating to the position is determined in the section where the attribute information ATR is dropped.

As described above, the second window 22b
In FIG. 29, when the attribute information ATR is set,
As shown in the figure, the axis A related to the second object OBJ2
2 at the position where the attribute information ATR is newly set,
A new key frame KF1 'is provided.

As described above, in the key frame-based image editing, the attribute information pooled as an icon in the pool window 46 can be obtained by dragging the attribute information with a mouse and dropping it on the axis of the desired object. , A new key frame is provided, and its attribute is set.

Next, a series of procedures for storing the attribute information will be described with reference to a flowchart shown in FIG.

In the first step S31, it is determined whether or not the button has been pressed. That is, this step S3
1, in the second window 22b,
"Time bar" button B1, "Start" button B2,
It is determined whether any one of the "end" button B3 and the "save" button B4 has been pressed, and if the button has been pressed, the process branches to "YES" according to the type of the pressed button. Specifically, the “time bar” button B1
Is pressed, the process proceeds to step S32, if the "start" button B2 or "end" button B3 is pressed, the process proceeds to step S33, and if the "save" button B4 is pressed, the process proceeds to step S34. If none of the buttons B1 to B4 is pressed, the determination is "NO" and the process returns to step S31.

In step S32, a new time bar is set at the position specified by the mouse in the second window 22b under the control of the key frame control unit 34, and the process returns to step S31.

In step S33, based on the control of the key frame control section 34, the position of the closest key frame in the second window 22b is
Move the position of the time bar so that the time bars overlap. Then, the process returns to step S31.

In step S34, the start key frame and the end key frame set in the second window 22b are transmitted to the object control section 31, and the flow advances to the next step S35.

In step S35, the object control section 31 displays the attribute list menu displayed as the first menu window 40a in FIG. 20 on the second window 22b. Then, the attribute displayed in the attribute list menu is set by selecting the “confirmation” selection area 45 in the attribute list menu. Then, the process proceeds to the subsequent step S36.

In step S36, the attribute specified by the attribute list menu, the start key frame and the end key frame are transmitted. Then, the process proceeds to the next step S37.

In step S37, the attribute value control unit 35 collects necessary data from the respective attributes, collectively stores the data on the disk 21, and proceeds to the next step S38.

In step S38, the object control unit 31 receives the processing end notification from the attribute value control unit 35 in the second window 22b, and displays the saved information pool screen shown as the pool window 46 in FIG. The newly saved attribute information is added and displayed on the second window 22b. Then, when the display of the storage information pool screen ends, a series of steps related to storage of the attribute information ends.

Next, a series of procedures for applying the stored attribute information will be described with reference to a flowchart shown in FIG.

In step S41, in the second window 22b, a "time bar" button B1,
If any one of the “start” button B2 and “end” button B3 has been pressed, “YES” is determined, the process proceeds to the corresponding step, and if none of the buttons B1 to B3 has been pressed, “ NO "and the process proceeds to the step S44. Here, if the "time bar" B1 is pressed, the process proceeds to step S42, and if either the "start" button B2 or the "end" button B3 is pressed, the process proceeds to step S43.

In step S42, the key frame control unit 34 displays a new time bar at the position designated by the mouse in the second window 22b. Then, the process returns to step S41.

In step S43, the key frame control unit 34 sets the second window 22b such that the time bar overlaps the key frame closest to the time bar displayed in step S42. Move this time bar. Then, the process returns to step S41.

In step S44, it is determined whether the icon related to the storage information of the storage information pool shown as the pool window 46 in FIG. 22 has been dragged with a mouse. If the icon has been dragged, the process proceeds to step S45 as “YES”,
For example, if it is not dragged into a predetermined place, "N
Return to step S41 as "O".

In step S45, it is determined whether or not the icon relating to the attribute information has been dropped with a mouse in a designated section on the axis relating to the object in the second window. When the icon is dropped on the axis related to the object, the process proceeds to step S46 as “YES”, and when the icon is dropped on another axis, the process returns to step S41 as “NO”.

In step S46, the set start key frame and end key frame are transmitted to the object control unit 31. Then, the process proceeds to the next step S47.

In step S47, the object control section 31 sets the pool window 46 in FIG.
Receive the save information selected on the save information pool screen shown as. Then, the process proceeds to step S48.

In step S48, the object control section 31 displays the attribute list menu shown as the first menu window 40b in FIG.
The attribute displayed in the attribute list menu is set by selecting the “confirmation” selection area 45 in the attribute list menu. Then, the following step S49
Proceed to.

In step S49, the object control unit 31 notifies the attribute value control unit 35 of the designated attribute value, the start and end key frames, and proceeds to the next step S50.

In step S50, the attribute value control unit 35 collects the data of the required attributes from the stored information data, converts the data into a processable format, and converts the required key frame based on the data. Generate.
Then, a series of steps related to the setting of the attribute value ends.

In the above example, the position of the object is illustrated as the attribute.
Not only attributes that change along the time axis, such as colors, model types or shapes, but also certain attributes regardless of time can be used.

Next, the operation history and visualization of image editing in the image editing apparatus will be described. A specific example here is that, in an authoring system using model data of three-dimensional computer graphics, when changing the direction in which an object is viewed on a screen, the change in the direction in which the object is viewed is held as an operation history, and the previous operation is performed. Is displayed in the viewfinder of the camera.

In the operation history and visualization of the image editing, as blocks related to the control, as shown in FIG. 32, an object display control unit 32 which is a control means for controlling the display of an object, and a view finder of a camera. A view operation control unit 37, which is a visualization unit for operating the view direction, and a history information control unit 38, which controls a history of operations on the object, are provided.

Next, a window displayed on the display screen of the CRT 22 regarding the operation history and visualization of the image editing will be described.

As shown in FIG. 33, a substantially cubic first object OBJ1 is displayed in the window 22c as viewed obliquely from the upper right. This first
The object OBJ1 has a front surface S1 displayed in the center of the drawing, a right surface S2 on the right side of the front surface S1, and an upper surface S3 on the upper side of the front surface S1.

Here, on the display screen of the CRT 22, a view operation control unit 50 as shown in FIG. 34 is displayed as another window 22d. The view operation control unit 50 includes a view finder 51 and a view input unit 52.
And The view operation control unit 50 indicates the direction in which the first object OBJ1 displayed in the window 22c shown in FIG. 33 is viewed as the direction of the dice 53 in the figure. The face S1 of the first eye on which “•” on the front of the die 53 is displayed is the same as FIG.
This corresponds to the direction in which the front S1 of the object inside is viewed.

In the view input section 52 of the view operation control section 50, a button 52a pointing rightward is selected.
Then, in the other window 22c shown in FIG. 33, the viewing direction of the first object OBJ1 changes, and as shown in FIG.
The right surface S2 of the BJ1 is the front in the figure, the back surface S4 is displayed on the right side of the right surface S2, and the upper surface S3 is displayed above the right surface S2.

At this time, in the dice 53 in the viewfinder, as shown in FIG. 36, the first eye on which “•” is displayed faces the left side. This means that, as shown in FIG. 37, the first direction D1 with respect to the front is the view direction, but the second direction D2 with respect to the right side is changed to the view direction.

Next, a series of steps related to the history information or visualization will be described with reference to a flowchart shown in FIG.

In the first step S51, the selected button of the view operation input section 52 of the view operation control section 50 is obtained. When the input is made to the view operation input unit 52, the process proceeds to step S52, and when the view operation button is not pressed, the process returns to step S51.

In step S52, the history operation control section 38 is notified of which button of which view operation input section 52 has been selected, and the corresponding visual image data information is obtained and displayed. The history operation control unit 38 proceeds to step S61 described below, and returns from step S63 of the history information control unit 38. Then, the process proceeds to the next step S53.

In step S53, the object display control unit 32 is notified of the view direction from which the object is to be viewed. Then, the process proceeds to step S54 following this.

In step S54, the object display control unit 32 reprocesses and displays the shape and the like of the object based on the received view direction. Then, a series of steps relating to the view change processing ends.

Next, the history management information of the view operation will be described with reference to the flowchart shown in FIG.

In the first step S61, information on which button of the view operation input section of the view operation control section 50 has been selected is obtained. Then, the process proceeds to step S62.

In step S62, from the information obtained in step S61, a search is performed to determine which visual data corresponds to the operation corresponding to the input, and the information is returned to the view operation control unit 37. move on.

In step S63, the operation information is updated as the latest information in the history information list. Then, a series of steps relating to the history management processing of the view operation is completed.

As described above, the view-related processing is stored in the history information control unit 38 as history information. At this time, the visual data corresponding to each operation acquired by the view operation control unit 50 is stored in the view operation control unit 5.
In addition to returning to 0, a coded version of the operation is stored as an operation history.

Next, a description will be given of the setting and changing of a hierarchy for each key frame in editing an object along a key frame-based time axis.

In the image editing apparatus, when the hierarchical structure is changed or set, as shown in FIG. 40, the object display control unit 32, which is a control means for controlling the display of objects, is used as a control block. And an object control unit 31 which is a control unit for controlling an object, and an attribute value control unit 35 which is a control unit for controlling an attribute value. Here, the object control unit 31, the object display control unit 32, and the attribute value control unit 35 are interconnected.

In this specific example, at the time of editing along a time axis based on a key frame using three-dimensional computer graphics model data, two objects are grouped and become a parent while maintaining a certain distance. It operates according to the object.

Here, the processing for obtaining the position of the target object when the parent object is specified and when the parent object moves will be described.

In the window 22e shown in FIG. 41, the first object OBJ1
And the second object OBJ2 are displayed.

In the window 22e, the first object OBJ1 and the second object OBJ2 are grouped by introducing a hierarchical structure of the relationship between the objects. That is, by operating the mouse on the second object OBJ2, the cursor 55 is positioned on the second object OBJ2 and clicked.

When the second object OBJ2 is dragged with the cursor 55 in the second window 22e, as shown in FIG. 42, the second object OBJ2 becomes a semi-transparent second object OBJ2 '. The second object OBJ2 'is the first object OBJ1
In the state of being superimposed on the second, as shown in FIG.
Object OBJ2 is dropped. Then, a hierarchical relationship between the parent and child is set with the dropped first object OBJ1 as a parent object and the dropped second object OBJ2 as a child object. Here, a parent object is an object at a higher level,
The child object means an object of a lower hierarchy.

The hierarchical structure of the parent and child of the object can be set by dragging the object to the target object and dropping it, as described above, or by selecting from a list of target objects. Or display a list in a menu and allow the user to select from this list.

Subsequently, following the parent object,
The object follow will be described. The object follow causes the child object to follow the parent object based on the position of the parent object.

As a specific example of this object follow, as shown in FIG. 44, it is possible to apply an attribute relating to the direction to the parent object. That is, the direction of the child object follows the parent object. For example, if the child object is model data in the form of a human, it is possible to perform a process of continuing to direct the face corresponding to the face toward the parent object. it can.

An example of this operation is that the first object OBJ1, which is the parent object located near the left end in the figure,
The first object OBJ1 substantially above the center in the figure
′, The first object OBJ1 near the right end in the figure
When moving to "", a triangle 56 provided along a circumference which is a part of a second object OBJ2 which is a child object at the bottom in the figure is a triangle of the first object OBJ1 to OBJ1 ". A hierarchical relationship is set for the attribute of the direction so as to follow the direction.

The above-described setting and changing of key frames can be performed for each key frame or sub-key frame.

Here, a conventional hierarchical structure setting will be described for reference. When grouping objects as a conventional hierarchical structure setting, the first object OBJ having a substantially equilateral triangle in the window of FIG.
1 and the pentagonal second object OBJ2, for example, by designating the area within a rectangular area to be grouped using a mouse.

The first object OBJ1 and the second object OB thus grouped are
J2 is indicated by a rectangular area indicating grouping, as shown in FIG.

Next, a series of procedures relating to a parent object setting process will be described with reference to a flowchart shown in FIG.

In the first step S71, the process waits until the mouse is clicked. In the next step S72, it is determined whether or not the object selected by the cursor 55 in the window on the CRT 22 is an object. And the cursor 5 when clicked with the mouse
If the target specified in 5 is an object, the process proceeds to step S73 as “YES”, and if the target is other than an object, the process returns to step S71 as “NO”.

In step S73, the object control section 31 determines which object is designated by the cursor in the window 22e and selected by clicking. Then, the selected object is made translucent. Then, the process proceeds to the next step S74.

At step S74, it is determined whether or not the selected object is being dragged. If dragging is being performed, “YES” is determined and the process proceeds to step S75. If dragging is not being performed, “NO” is determined.
To step S76. This step S74 is
Determine if the object is being dragged.

In step S75, the position of the cursor is displayed in the window 22e while keeping the object translucent, and the flow returns to step S74.

In step S76, it is determined whether or not the position at which the selected translucent object is dropped corresponds to another object. If the dropped position is on another object, the process proceeds to step S77 as “YES”, and otherwise, as “NO”, a series of processes related to the setting process of the parent object is performed. finish.

In step S77, the translucent display of the object being dragged is stopped, and the object control unit 31 is notified of which object has been dropped. Then, a series of processes related to the setting process of the parent object ends.

Next, a series of steps related to information processing setting between objects will be described with reference to a flowchart shown in FIG.

In the first step S81, the process branches depending on whether the object is stationary or operating. When the vehicle is stationary, the process proceeds to step S82.
If the operation is in progress, the flow branches to step S85.

In step S82, the object control unit 31 acquires a parent object from the object display control unit 32, and proceeds to step S83, where the next object control unit notifies the attribute value control unit 35 of the parent object. In the subsequent step S84, the attribute value control unit 35 acquires the position of the parent object, obtains the distance and direction from the position of the child object, and holds it. Then, a series of steps relating to the information setting processing between the objects is completed.

On the other hand, in step S85, the attribute value control unit 35 obtains the current time, and in the next step S86, obtains the position of the parent object at the time obtained in step S85, followed by step S87. In, the position of the child object is calculated from the distance and direction held or the position of the parent object. Then, a series of steps relating to the information setting processing between the objects is completed.

Next, a description will be given of the grouping of trajectories set between two key frames and the grouping of a plurality of trajectories in editing of an object along a time axis based on a key frame in the video editing apparatus. .

At the time of grouping the trajectories, as shown in FIG. 49, the blocks related to control include an object display control unit 32 which is a control means for controlling the display of an object, and a key frame. And a trajectory control unit 39 for controlling the trajectory. The key frame control unit 34, the object display control unit 32, and the trajectory control unit 39 are connected to each other.

With respect to the grouping of the trajectories, the CR
A description will be given with reference to a window 22f that displays the locus of the object drawn on the display screen at T22.

FIG. 50 shows a first key frame KF1.
To the second key frame KF2, the first trajectory TRJ1 of the first object OBJ1 that moves while changing its position is displayed. Here, the first key frame KF1
And the second key frame KF2 are displayed as squares in the figure.

On the first trajectory TRJ1, the first
The first sub-key frame SKF1, the second sub-frame SKF1,
, A third sub-key frame SKF3, a fourth sub-key frame SKF4, and a fifth sub-key frame SKF5. Among these sub-key frames, a first sub-key frame SKF1 overlapping the first key frame KF1 and a second
, Except for the fifth sub-key frame SKF5 overlapping the key frame KF2 of FIG. In the drawing, a substantially equilateral triangular first object OBJ1 is represented by a third sub-key frame SKF.
3 overlaps.

The first trajectory TRJ1 is composed of sub-key frames SKF1 to SK passing through the first trajectory TRJ1.
It can be changed by moving F5. That is, the first trajectory TRJ1 'shown in FIG.
Is the same as the first trajectory TRJ1 shown in FIG.
Sub-key frame SKF2 on the trajectory TRJ1 '
', The third sub-key frame SKF3' and the fourth sub-key frame SKF4 'are moved to be positioned at the second sub-key frame SKF2, the third sub-key frame SKF3, and the fourth sub-key frame SKF4, respectively. The first trajectory TRJ1 ′ can be changed to a first trajectory TRJ1 that passes through these subframes SKF1 to SKF5.

Here, in FIG. 51, the first sub-key frame SKF1 overlapping the first key frame KF1 and the fifth sub-key frame SKF5 overlapping the second key frame KF2 do not move. It remains in its original position.

Further, the sub key frames SKF1 to SKF
A trajectory TRJ1 ′ indicating the movement to KF5 is, for example, a second key frame KF2 using a mouse as shown in FIG.
', Click to select it, drag it to a desired position, and drop it at the position indicated by the second key frame KF2 to change to a new trajectory TRJ1 while maintaining the shape of trajectory TRJ1'. it can.

Next, a series of procedures relating to the key frame and sub key frame change processing will be described with reference to the flowchart shown in FIG.

In the first step S91, the object display control unit 32 sends information on which key or sub-key frame has been selected and to which position it has been moved.
Pass to keyframe control. Then, the next step S92
Proceed to.

In step S92, the key frame control unit 34 passes the original position information and the new position information of each sub key frame to the trajectory control unit 39. When the key frame is changed, the process proceeds to step S93, and when the sub key frame is changed, the process proceeds to step S94.

In step S93, the trajectory control section 39 generates changed position information using a trajectory generation function between key frames. At this time, for each piece of position information between sub-key frames, new position information is calculated from the degree of change in the position information of the key frames. The function generated in this manner is returned to the key frame control unit 34. Then, the process proceeds to the next step S95.

In step S94, the trajectory control section 39 generates a trajectory generation function between key frames based on the changed position information, and returns it to the key frame control section. Then, the process proceeds to the next step S95.

[0206] In step S95, the key frame control section 34 obtains position information at each time from the key frame KF1 to the key frame KF2, returns the position information to the object display control section 32, and proceeds to step S96.

In step S96, the object display control section 32 performs rendering from data such as the shape of the object and its trajectory, and displays the result on the screen. Then, a series of steps related to the key frame and sub key frame change processing ends.

Here, a conventional change of the locus will be described for reference. This trajectory, as shown in FIG.
The first object OBJ1 starts at the first key frame KF1, passes through the second key frame KF2, the third key frame KF3, and the fourth key frame KF4, and ends at the fifth key frame KF5. It is a trace that has passed above. The figure shows the first object OBJ1 when the first object OBJ1 is located on the third key frame KF3.

In the above description, a mouse has been described as a pointing device, but the pointing device of the present invention is not limited to a mouse.
For example, a keyboard, trackball, or the like can be used.

Further, in the above description, a CRT is used as the display means, but the display means of the present invention is not limited to the CRT. For example, a liquid crystal panel can be used as the display means.

[0211]

As described above, according to the present invention, it is possible to simultaneously display the shapes of objects at a plurality of time points and the changed shapes between the objects in the same space.
For this reason, it has become possible to simultaneously display objects at other points in time while moving and displaying the objects at a certain point in time, and to move those objects with time.

As a result, when editing the values such as the positions of a plurality of objects at a certain point in time, it becomes much easier visually in comparison with the conventional editing method. In addition, it has become possible to recognize not only objects having the same mutual relationship but also other objects over time. Furthermore, by restricting the object of interest for each time bar, it is possible to separately display and confirm the movement of the object, and it is possible to further improve the efficiency of the editing work.

Further, according to the present invention, in key frame-based object editing, any two points can be selected to save or apply one or more pieces of attribute information of the object in the section. In addition, in the case of saving, it is possible to select only necessary attributes from the attributes of the object, and in the case of application, it is necessary to select only the attributes of the applicable object or to apply it by selecting from among them It was possible.

For this reason, it is possible to store the movement of a desired section of an object having a plurality of attributes, such as a position and a direction, which has been created with difficulty, and to save the movement between any two points of another object or the same object. In addition, by selectively selecting information of a plurality of attribute values from the stored information and applying the same, it becomes possible to use a favorite movement or change in a different scene many times. This facilitates the reuse of animation in authoring, and also dramatically improves the work efficiency of the creator.

Further, according to the present invention, in a system in which editing and browsing operations are performed while maintaining operation histories, it is possible to easily visualize what each operation is. You can see at a glance what it was.

As a result, when the operation is undone, it is only necessary to look at the history as to where to go back, and it is not necessary to return the operation to a dark cloud, and the efficiency of the work itself is improved. In addition, by displaying the immediately preceding operation at all times during the operation, the efficiency of the operation of determining the operation to be performed or returning the operation to the original operation can be improved.

According to the present invention, in key frame-based object editing, relationships between objects are provided as a hierarchical structure, and these structures can be changed for each key frame.

For this reason, the efficiency of the editing operation for performing processing such as grouping is remarkably improved, and the expressive power of the grouped objects in animation is improved by dynamically changing the parent object. Is now possible. Also, the attribute values such as the position and direction of the grouped objects are limited to those corresponding to the key frame, but can be individually changed, thereby greatly improving the efficiency of object editing.

Further, according to the present invention, it is possible to easily change the values of the key frames at both ends while relatively maintaining the trajectory set between the two key frames. As a result, the efficiency of the object editing operation is dramatically improved. In addition, the introduction of sub-keyframes enables grouping, which reduces operations that are required to add or delete keyframes, and reduces operations that were conventionally set between keyframes on subkeyframes. Since it is possible, an operation for paying attention to the set value of the adjacent key frame is not required, and the operability is improved.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a schematic configuration of an image editing device.

FIG. 2 is a diagram showing a first window and a second window displayed on a display screen of a CRT of the image editing apparatus.

FIG. 3 is a block diagram showing an internal configuration related to control when an image is edited using a plurality of time bars set on a time axis in the image editing apparatus.

FIG. 4 is a diagram showing a first object and a second object displayed in the first window.

FIG. 5 is a diagram showing a time axis and a first time bar displayed in the second window.

FIG. 6 is a diagram showing a first object and a second object corresponding to a first time bar and a second time bar displayed in the first window.

FIG. 7 is a diagram showing a first time bar and a second time bar displayed in the second window.

FIG. 8 illustrates a state in which the first object and the second object displayed in the first window move in the first window in accordance with the movement of the second time bar along the time axis. FIG.

FIG. 9 is a view showing a first time bar on a time axis and a second time bar moving on the time axis in the second window.

FIG. 10 is a diagram showing a state in which the first object is fixed on the time axis and the second object is moved on the time axis in the first window.

FIG. 11 is a diagram showing a fixed first object and a moving second object in the first window.

FIG. 12 is a flowchart showing a series of steps relating to processing in the central processing unit when the time bar is moved.

FIG. 13 is a flowchart showing a series of steps related to processing in the central device when a time bar is added.

FIG. 14 is a block diagram showing an internal configuration related to control when saving or applying attributes along a key frame-based time axis in the image editing apparatus.

FIG. 15 is a diagram showing a state where a “time bar” button is selected in the second window.

FIG. 16 shows a “start” in the second window.
It is a figure showing the state where the button was selected.

FIG. 17 is a diagram showing a state where the “time bar” button is selected again in the second window.

FIG. 18 is a diagram showing a state where an “end” button is selected in the second window.

FIG. 19 is a diagram showing a state where a “Save” button is selected in the second window.

FIG. 20 shows “Save” in the window shown in FIG.
FIG. 7 is a diagram showing a menu window displayed overlapping the window when a button is selected.

FIG. 21 is a diagram showing a pool window displayed when a “confirmation” selection area is selected in the menu window shown in FIG. 20;

FIG. 22 is a diagram showing a pool window displayed on the window of FIG. 21.

FIG. 23 is a diagram showing a state where a “time bar” button is selected in the second window.

FIG. 24: “Start” in the second window
It is a figure showing the state where the button was selected.

FIG. 25 is a diagram showing a state where the “time bar” button is selected again in the second window.

FIG. 26 is a diagram showing a state in which an “end” button is selected in the second window.

FIG. 27 is a view showing a state after attribute information is dragged from the pool window shown in FIG. 22 and dropped on an axis related to an object in the second window.

FIG. 28 is a diagram showing a menu window appearing on the window of FIG. 27 when attribute information is applied in the window.

FIG. 29 is a diagram showing a state in which an operation of applying attribute information has been completed in the window of FIG. 28;

FIG. 30 is a flowchart showing a series of steps for performing a process related to storing attributes.

FIG. 31 is a flowchart showing a series of steps for performing processing related to application of an attribute.

FIG. 32 is a block diagram showing an internal structure related to control when visualizing the operation history of an object in the image editing apparatus.

FIG. 33 is a diagram showing a substantially cubic object displayed in the first window.

FIG. 34 is a view showing a view operation unit displayed on the display screen of the CRT.

FIG. 35 is a diagram showing a state where the direction in which the object is viewed in the first window is changed.

FIG. 36 is a diagram illustrating the view operation unit in a state where a direction in which the object is viewed is changed.

FIG. 37 is a diagram showing a view direction of an object in the first window.

FIG. 38 is a flowchart showing a series of steps relating to a view change process.

FIG. 39 is a flowchart showing a series of steps relating to a view operation history management process.

FIG. 40 is a block diagram showing an internal configuration related to control when hierarchization is performed in the image editing apparatus.

FIG. 41 is a diagram showing a first object and a second object displayed in the first window.

FIG. 42 is a diagram showing a state in which a semi-transparent second object is being dragged with a cursor in the first window.

FIG. 43 is a diagram showing a state in which the semi-transparent second object is dragged by the cursor to the first object in the first window.

FIG. 44 In the first window, a first object moving from left to right in the window and a second object following the direction of the first object.
FIG.

FIG. 45 is a diagram illustrating a first object and a second object for explaining conventional hierarchization.

FIG. 46 is a diagram illustrating a first object and a second object that are grouped for explaining conventional hierarchization.

FIG. 47 is a flowchart showing a series of procedures relating to a parent object setting process.

FIG. 48 is a flowchart showing a series of procedures relating to information setting processing between objects.

FIG. 49 is a block diagram showing an internal configuration related to control of the storage unit when grouping trajectories set between key frames in the image editing apparatus.

FIG. 50 is a diagram showing key frames and sub-key frames displayed in the first window.

FIG. 51 is a diagram showing a state in which a sub key frame has been moved in the window of FIG. 50;

FIG. 52 is a diagram showing a state in which the key frame at one end of the track has been moved in the window of FIG. 51;

FIG. 53 is a flowchart showing a series of procedures related to a key frame and sub key frame change process.

FIG. 54 is a diagram illustrating a conventional process of changing a trajectory related to a key frame.

[Explanation of symbols]

Reference Signs List 1 central processing unit, 2 storage unit, 10 input unit, 11 disk, 12 keyboard, 13 pointing device, 20 output unit, 21 disk, 22 CRT, 2
3 Printer

 ──────────────────────────────────────────────────続 き Continuing from the front page (72) Inventor Natsuo Kada 1-14-10 Higashi-Gotanda, Shinagawa-ku, Tokyo Inside Sony Kihara Research Laboratories Co., Ltd. No. 10 Inside the Sony Kihara Research Laboratories (72) Inventor Naosuke Asari 1-14-10 Higashi Gotanda, Shinagawa-ku, Tokyo, Japan Inside the Sony Kihara Research Laboratories (72) Inventor Lim, Xiao Bin Singapore 089315, Keppel Tower 19-00, Ho Chi An Road 10, Sony Systems Design International Private Limited (72) Inventor Ofori, Charles Singapore 089315, Keppel Towers 19-00, Ho Chi An Road 10, Sony Systems Design International Private Limited Over door Limited in (72) inventor Jean, the way Singapore countries 089315, Keppel Tower's 19-00, Ho Chiang load 10 Sony Systems Design International, a Private Limited in

Claims (20)

[Claims] 1. An image editing apparatus for editing an image including an object along a time axis, wherein a time axis display area for displaying a plurality of time bars for specifying time on the time axis and a plurality of objects are displayed. Display means having an object display area on the same screen; time bar setting means for setting a time bar in the time axis display area of the display means; and an object displayed in the object display area of the display means. An image editing apparatus comprising: a control unit configured to correspond to a time specified by a time bar in the time axis display area. 2. The control means switches display / non-display of each object corresponding to each time bar, and displays the display / non-display state of the object on the time bar. The image editing apparatus according to claim 1, wherein: 3. The image editing apparatus according to claim 1, wherein the object is a three-dimensional figure or a two-dimensional figure. 4. The image editing apparatus according to claim 1, wherein the object is a character, a still image, or a moving image. 5. The image editing apparatus according to claim 1, wherein said display means highlights a selected object. 6. A history control unit for controlling history information relating to a history of a series of operations, and visualization means for visualizing the history information, wherein the display means is visualized by the visualization means. The image editing apparatus according to claim 1, wherein the history is displayed. 7. The image editing apparatus according to claim 6, wherein the visualization means displays the history relating to the direction of the object as a dice perspective view. 8. The image editing apparatus according to claim 1, further comprising a hierarchical structure control means for setting or changing a hierarchical structure based on a relationship between objects. 9. The hierarchical structure according to claim 1, wherein when an object in a lower layer corresponds to an object in a higher layer, the number of lower objects corresponding to the object in the upper layer is singular or 9. The image editing apparatus according to claim 8, wherein the image editing apparatus has a plurality of tree structures. 10. The hierarchical structure controlling means superimposes one object on another object on the display screen of the display means, so that the one object is an object of a lower hierarchy, 9. The image editing apparatus according to claim 8, wherein a hierarchical structure is set in which the target object is an object of a higher hierarchical level. 11. The apparatus according to claim 8, wherein the object is defined as a key frame at a discrete time in a time axis direction, and the hierarchical structure control means sets and changes a hierarchical structure of the key frame. An image editing apparatus as described in the above. 12. A trajectory of an object set between key frames at discrete times in a time axis direction, wherein a time and / or a time corresponding to the key frame for the object are determined.
2. The image editing apparatus according to claim 1, further comprising: key frame control means for managing position information; and trajectory control means for calculating a trajectory from the information corresponding to the key frame. 13. The key frame control means according to claim 1, wherein
13. The image editing apparatus according to claim 12, wherein trajectories of a plurality of objects are grouped. 14. The trajectory according to claim 12, wherein the trajectory is attribute information including at least one of a position, a direction, a size, and an angle representing a continuous change of the object along the time axis. Image editing device. 15. An image editing method for editing an image including an object along a time axis, wherein a time axis display area for displaying a plurality of time bars for specifying time on the time axis and a plurality of objects are displayed. A display step of having an object display area on the same screen; a time bar setting step of setting a time bar in a time axis display area of the display means; and an object displayed in the object display area of the display means. A control step of causing a time specified by a time bar in the time axis display area to correspond to the time. 16. An image editing apparatus that edits an image including an object along a time axis for an object having attribute information including at least one of a position, a direction, a size, and an angle. A time axis display area for displaying a plurality of time bars on the time axis, an object display area for displaying a plurality of objects on the same screen, and a time bar in the time axis display area of the display means. Time bar setting means for setting the object, the control means for making the object displayed in the object display area of the display means correspond to the time specified by the time bar of the time axis display area, Section selection means for arbitrarily selecting a section along the time axis; attribute value control means for controlling an attribute value of the section selected by the section selection means; and storage for storing information under the control means. And an image editing device. 17. Selecting an attribute type of the object,
17. The image editing apparatus according to claim 16, wherein the selected type of attribute is stored or applied. 18. When storing the attribute of one section of the object and applying the attribute of the one section to the attribute of another section of the object or another object, 17. The image editing apparatus according to claim 16, wherein an attribute of a kind overlapping between the attribute of the section and the attribute of the other section is applied. 19. The image editing apparatus according to claim 16, wherein the object is a three-dimensional figure, a two-dimensional figure, a character, a still image, or a moving image. 20. An image editing method for editing an image including an object along a time axis for an object having attribute information including at least one of a position, a direction, a size, and an angle. A time axis display area for displaying a plurality of time bars on the time axis, and a display step having an object display area for displaying a plurality of objects on the same screen; and a time bar in the time axis display area of the display means. A time bar setting step of setting an object displayed in the object display area of the display means to correspond to a time specified by a time bar of the time axis display area; and A section selection step of arbitrarily selecting a section along the time axis; an attribute value control step of controlling an attribute value of an attribute of the section selected by the section selection means; and information under control of the control means. Storing an image.