JP2870819B2 - Data editing method and device - Google Patents

Description

The present invention relates to a method for editing a presentation position and a presentation timing on a screen when presenting a plurality of media data recorded on an electronic medium, and a user. The present invention relates to a method for editing a presentation position and a presentation timing of an interactive menu for presenting related data according to an instruction of the user, and an apparatus for simultaneously performing the methods.

(Related Art) In recent years, multimedia information such as text, still images, audio, and moving images has been recorded on an electronic medium, and the computer has been able to edit and present the information in an integrated manner. Attempts have also been made to connect multimedia data with a network-like data structure to construct a more flexible electronic document. Such an electronic document is sometimes called hypermedia. In hypermedia,
Each media data is integratedly managed in an access unit called a node, and information (accessing node name or pointer, etc.) for accessing one related node from another node is recorded as link information of each node. I do. This example is shown in FIG. The user can present relevant information by selecting an interactive menu on the screen.

With respect to such a method of editing a presentation position (referred to as a spatial layout) and a temporal timing (referred to as a temporal layout) of multimedia data on a screen, the following methods have been implemented.

Procedure File There is a method of describing a presentation sequence on the time axis of a plurality of data in a procedure file, and instructing start and end of data presentation based on a time table created in accordance with the procedure. This example is described in Japanese Patent Application No. 63-060908, entitled "Data Presentation Method and Apparatus".

How to edit time design and space design in parallel on the device Divide the screen into two parts, display time information (eg, a timing chart in a graph) on one side, and spatial information (eg, on the screen) on the other. A method of displaying and displaying a frame indicating a presentation position) has also been proposed.

This example is described in Japanese Patent Application No. 63-157301, entitled "Data Presentation Editing Apparatus".

(Problems to be Solved by the Invention) The conventional method is an effective method when a plurality of media are not simultaneously presented in parallel. However, when multiple media are presented in parallel, it is difficult to intuitively grasp the temporal and spatial layout, and it is necessary to edit the numerical values in detail. It was difficult to use for no ordinary users.

In the conventional method, since the temporal layout and the spatial layout are edited independently, it is difficult to edit the temporal and spatial fine adjustments at the same time, and the intuitive understanding of the spatiotemporal layout is required. Is difficult.

The data editing method and apparatus according to the present invention solves the above-described problem by displaying and editing the temporal and spatial layout of multimedia data and interactive menus in a three-dimensional manner. The purpose is to realize the operation.

(Means for Solving the Problems) The present invention has solved the above-mentioned problems, and the first invention is to provide a presentation position and a presentation timing of a plurality of media data recorded on an electronic medium on a screen. It is a method of editing, in which the presentation position and presentation time of each media data on the screen are visually represented in three dimensions, and the three-dimensional movement on the screen,
It is characterized in that the presentation position and the presentation timing are designated by performing an enlargement / reduction operation.

A second invention is a method of editing a presentation position and a presentation timing of an interactive menu on a screen for presenting related media data in accordance with a user's instruction. The time interval is visually represented as a three-dimensional object, and the three-dimensional object is moved, enlarged, and reduced on the screen together with the three-dimensional object representing the presentation time and the presentation size of the media data according to claim 1. Is determined.

According to a third aspect of the present invention, media data management means for managing the attributes of each media data, interactive menu management means for managing the attributes of each interactive menu, and attributes of the media data and attributes of the interactive menu are temporarily stored for editing. Three-dimensional generating means for generating graphic data for display from edit data storage means, attributes of the media data being edited, and attributes of the interactive menu being edited, and coordinate conversion for converting the graphic data into drawing coordinates on a display screen Means, three-dimensional display means for performing graphic display based on drawing coordinates on the display screen, input management means for receiving an editing command and input relating to three-dimensional operation from a user, the media data management means, and attribute data from the interactive menu management means. Is read and recorded in the edit data storage means, and the three-dimensional generation means, the coordinate conversion means, and the vertical A data update device for sending an instruction or data to a display unit and updating the attribute data in the edited data storage unit in accordance with an input from the input management unit; The two inventions can be carried out simultaneously.

(Operation) In the data editing method and apparatus according to the present invention, text /
Multimedia data including time-independent media such as still images (referred to as static media) and time-dependent media such as audio / video (referred to as dynamic media) is targeted. Each media data is recorded in a file unit, and one file is one node. Each node records the presentation start time, the presentation end time, and the presentation position and size on the screen in the media data management means as the presentation layout information. Also, presentation layout information of an interactive menu for presenting data related to each node is recorded in the interactive menu management means. The interactive menu presentation layout information specifies a certain time zone during the presentation time of a certain node and a position on the screen, and during this time zone, presents an interactive menu indicating that there is related data, and prompts the user to select a menu. This is the information needed to make it work. Each interactive menu has related data information and interactive menu presentation layout information as link information.

The first invention provides a method for editing the presentation layout information of the media data. The second invention provides a method for editing the presentation layout information of the above-mentioned interactive menu.
The third invention provides an apparatus configuration that can simultaneously execute the first and second methods. Hereinafter, the methods of the first and second inventions will be described based on the device configuration of the third invention.

First, a method of editing presentation layout information of media data (first invention) will be described. The user inputs a media data editing instruction and a node name to be edited into the input management unit. The input management means includes an input device such as a keyboard and a mouse. The display update control unit receives the node name from the input management unit, reads out the presentation layout information of the corresponding node from the media data management unit, and records it in the edited data storage unit. Also,
This data is sent to the three-dimensional generating means to generate graphic data. Subsequently, the graphic data is converted into drawing coordinates on the screen by the coordinate conversion means, and is displayed by the three-dimensional display means.

This solid is shown in FIG. In the figure, (X, Y) is a position in the spatial direction, and T is a virtual coordinate axis indicating the presentation time. Here, changing the position of the three-dimensional object in the spatial direction corresponds to changing the position of the window on the screen that presents the media data, and changing the size in the spatial direction corresponds to changing the position of the presenting window on the screen. Corresponding to changing the size of Changing the position in the time direction corresponds to changing the start time, and changing the size in the time direction corresponds to changing the length of the presentation time.
Therefore, by changing the position and size of the three-dimensional object on the screen in the spatiotemporal coordinates, layout editing in the spatiotemporal space can be performed.

The user changes the position and size of the three-dimensional object in the spatio-temporal space by performing operations of moving, enlarging, and reducing the displayed solid object through the input management unit.

The operation is realized such that, for example, when the vertex on the upper left side of the solid is moved by the mouse, the entire solid is moved, and when the vertex on the lower right rear is moved by the mouse, the size of the solid is changed. Also, if the movement is defined in the spatial direction when operated with the left button of the mouse, and the movement in the time direction when operated with the right button, the position and size of the solid in space and time can be freely edited.

The input management unit notifies the display update control unit of the mouse input. The display update control means converts the displacement of the mouse into the displacement of the presentation layout information, and updates the corresponding node information in the edited data storage. Further, the updated node information is sent to the media data management means and recorded.
Further, based on the updated node information, the display of the solid on the screen is updated.

Next, a method of editing the interactive menu spatio-temporal information (second invention) will be described. The user can enter an interactive menu edit command,
The name of the interactive menu (link name) to be edited is input to the input management means. The display update control means receives the link name from the input management means, reads out the interactive menu presentation layout information of the corresponding link from the interactive menu management means, and records it in the edited data storage means. The data is sent to the three-dimensional generating means to generate graphic data. Subsequently, the graphic data is converted into drawing coordinates on the screen by the coordinate conversion means, and is displayed by the three-dimensional display means.

By moving, enlarging, and reducing the three-dimensional object in the same manner as in the case of media data, the layout of the interactive menu in time and space is edited. The input management unit notifies the display update control unit of the mouse input. The display update control means converts the displacement of the mouse into the displacement of the spatiotemporal information, and updates the corresponding link information in the edited data storage. Further, the updated link information is sent to the interactive menu management means and recorded. Also, based on the updated link information,
The display of the solid on the screen is also updated.

(Example) Hereinafter, one example of the present invention will be described with reference to the drawings. FIG. 1 shows an example of the configuration of a data editing device that implements a data editing method according to the present invention.

A. Description of Apparatus Configuration This embodiment is an implementation of the apparatus configuration of the third invention, and details of each apparatus are as follows.

(1) Media data management unit 11 (media data management means) Manages the attribute of each media data as node information. The node information is stored, for example, in a format as shown in FIG. In the figure, as attributes of the node information, a node type Nt (for example, recording a media type), a node name Nn, a presentation position (Xn1, Yn1), (Xn2, Yn2) on the screen, a presentation start / end time (Tn1) , Tn2). The time attribute can be specified for both dynamic media and static media. The presentation layout information is (Xn1, Yn1, Tn1, Xn2,
Yn2, Tn2).

(2) Dialogue menu management unit 12 (dialogue menu management means) Manages the attributes of each dialogue menu as link information.
The link information is stored, for example, in a format as shown in FIG. As attributes of the link information, a link type Lt (for example, a type of association is recorded), a link start node name Ns, a link end node name Ne (a name of a node presented as related data), and a presentation position on the screen of the dialog menu graphic (X,
y) (for example, base point coordinates for drawing a menu figure), a presentation size (dx, dy), and presentation start / end times (ts, te).
(Ts, te) indicates the start / end time of the effective section in which the dialogue menu should be displayed when the presentation start time of the start node Ns is set to 0, and the default value is the presentation start / end time (Tn1) of the node Ns. , Tn2). The interactive menu presentation layout information is (x, y, ts, dx, dy, te).

(3) Solid generation unit 13 (solid generation unit) Receives media data or spatio-temporal information of a dialogue menu from the display update control unit 110, generates the coordinates of the eight vertices of the rectangular parallelepiped created by this, and updates the display update control unit 11
Returns to 0. This is called a three-dimensional space-time coordinate.

(4) Coordinate converter 14 (coordinate converter) The coordinates of each vertex of the solid are received from the display update controller 110, converted into two-dimensional drawing coordinates on the display screen, and returned to the display update controller 110. At the time of conversion, a parameter indicating the direction of the line of sight for viewing a solid in space-time is set. With this parameter, it is possible to display the three-dimensional object so that the weight is small.

(5) Three-dimensional display unit 15 (three-dimensional display means) Receives the drawing coordinates on the three-dimensional display screen from the display update control unit 110 and displays them on the CRT display.

(6) Edit data storage unit 16 (edit data storage means) As shown in FIG. 2, the edit data storage unit 16 includes a node information storage unit 21, a link information storage unit 22, a spatiotemporal coordinate storage unit 23, and a drawing coordinate storage unit 24. .

The node information storage unit 21 stores node information from the media data management unit.

The link information storage unit 22 stores link information from the interactive menu management unit.

The space-time coordinate storage unit 23 stores the space-time coordinates of each vertex of the solid generated by the solid generation unit 13.

The drawing coordinate storage unit 24 stores the drawing coordinates of each vertex converted by the coordinate conversion unit 14.

Each storage unit returns the data to the display update control unit 110 in response to a read command from the display update control unit 110.

(7) Input management unit 17 (input management unit) The input management unit 17 includes a keyboard, a mouse input device and its control unit, and an interprinter that decodes an input from a user. Send mouse cursor displacement and mouse button information.

(8) Display Update Control Unit 110 (Display Update Control Means) The node information storage unit 21 and the link information storage receive the node information of the media data and the link information of the interactive menu from the media data management unit 11 and the interactive menu management unit 12, respectively. Recorded in part 22.

In addition, the data is sent to the solid generating unit 13 to receive the spatio-temporal coordinates of each vertex of the solid, stored in the spatio-temporal coordinate storage unit 23, and sent to the coordinate converting unit 14 to receive the drawing coordinates on the display screen. Then, it is stored in the drawing coordinate storage unit 24 and is sent to the three-dimensional display unit 15 for display.

On the other hand, the input of the button press of the mouse and the displacement of the coordinates of the mouse cursor are received from the input management unit 17, and the node information of the node information storage unit 21 or the link information of the link information storage unit 22 is changed. 11 or the interactive menu management unit 12 to update the data. The updated data is displayed again on the three-dimensional display unit 15 via the three-dimensional generation unit 13 and the coordinate conversion unit 14.

B. Embodiment of the First Invention The user inputs an editing start command and a node name of media data to be edited to the input management unit 17. Upon receiving this, the display update control unit 110 follows the flow shown in FIG.
It works as follows.

(1) The node information is read from the media data management unit 11 and stored in the node information storage unit 21. (Step 41) (2) The presentation layout information is sent to the three-dimensional generation unit 13, and the spatio-temporal coordinates of the eight vertices of the three-dimensional object are obtained.
To memorize. (Step 42) (3) The spatiotemporal coordinates of each vertex of the generated three-dimensional figure are sent to the coordinate conversion unit 14, converted into drawing coordinates on the display screen, and stored in the drawing coordinate storage unit 24. (Step 43) (4) The converted drawing coordinates are sent to the three-dimensional display unit 15 and displayed on the screen. (Step 44) (5) Check the state of the mouse button. (Step 45) (6) If the mouse button is not pressed, the process returns to (5). (Step 46) (7) It is checked whether or not a three-dimensional vertex corresponding to the mouse cursor exists in the drawing coordinate storage unit 24. (Step 47) (8) If the corresponding solid is found, the process jumps to (11). (Step 48) (9) Check the state of the mouse buttons. (Step 49) (10) If the mouse button is pressed (9)
If it is released, the process returns to (5) and waits for the next input. (Step 410) (11) Store the coordinates of the mouse cursor. (Step 41
1) (12) Check the state of the mouse buttons. (Step 41
2) (13) If the mouse button is pressed (12)
Return to (Step 413) (14) The displacement of the coordinates of the current mouse cursor and the coordinates of the mouse cursor at the time of (11) is obtained, and is converted into the displacement amount of the space-time coordinates. (Step 414) (15) Update the presentation layout information in the node information storage unit 21 based on the obtained displacement. At this time, when the vertex on the upper left side of the solid is selected, the presentation position (Xn1, Yn1, Tn
Add the displacement for (1) and (Xn2, Yn2, Tn2). This changes the position of the three-dimensional object. When the lower right vertex of the solid is selected, the displacement amount is added only at (Xn2, Yn2, Tn2).
This corresponds to a change in size. (Step 415) (16) Generate a data write command and send the updated node information to the media data management unit 11. (Step 416) (17) Return to (5).

In the above description, editing of node information is limited to one, but a plurality of media data can be edited simultaneously. At this time, a plurality of node information can be recorded in the edited data storage unit 16 and a flag (pointer) indicating that editing is being performed is provided.

C. Embodiment of Third Invention The user inputs an edit start command and a link name of an interactive menu to be edited to the input management unit 17. Upon receiving this, the display update control unit 110 operates as follows according to the flow shown in FIG.

(1) The link information is read from the interactive menu management unit 12 and stored in the three-dimensional data storage unit 16. (Step 51) (2) The spatio-temporal information is sent to the three-dimensional generating unit 13 to obtain the spatio-temporal coordinates of the eight vertices of the three-dimensional object, and store them in the spatio-temporal coordinate storage unit 23. (Step 52) (3) The spatiotemporal coordinates of each vertex of the generated three-dimensional figure are sent to the coordinate conversion unit 14, converted into drawing coordinates on the display screen, and stored in the drawing coordinate storage unit 24. (Step 53) (4) The converted drawing coordinates are sent to the three-dimensional display unit 15 and displayed on the screen. (Step 54) (5) Check the state of the mouse button. (Step 55) (6) If the mouse button is not pressed, the process returns to (5). (Step 56) (7) It is checked whether or not a three-dimensional vertex corresponding to the mouse cursor exists in the drawing coordinate storage unit 24. (Step 57) (8) If the corresponding solid is found, the process jumps to (11). (Step 58) (9) Check the state of the mouse buttons. (Step 59) (10) If the mouse button is pressed (9)
If it is released, the process returns to (5) and waits for the next input. (Step 510) (11) Store the coordinates of the mouse cursor. (Step 51
1) (12) Check the state of the mouse buttons. (Step 51
2) (13) If the mouse button is pressed (12)
Return to (Step 513) (14) The displacement of the coordinates of the current mouse cursor and the coordinates of the mouse cursor at the time of (11) is obtained, and is converted into the displacement amount of the space-time coordinates. (Step 514) (15) Update the presentation layout information in the link information storage unit 22 based on the obtained displacement. At this time, when the vertex on the upper left side of the solid is selected, the presentation position (x, y) (when the left mouse button is pressed) or the presentation start time ts
Add the amount of displacement for (right button). This corresponds to a change in the position of the solid. If the lower right vertex of the solid is selected, the displacement is added to the presentation size (dx, dy) (left mouse button) or the presentation end time te (right button). This corresponds to a change in size. (Step 515) (16) Generate a data write command and send the updated link information to the interactive menu management unit 12. (Step 516) (17) Return to (5).

In the above description, the editing of the link information is limited to one, but a plurality of interactive menus can be simultaneously edited. At this time, a plurality of pieces of link information can be recorded in the edited data storage unit 16, and a flag (point) indicating that editing is being performed is provided.

(Effects of the Invention) According to the first aspect, in editing a plurality of pieces of multimedia information, the presentation position and the presentation time on the screen can be easily and visually edited.

According to the second invention, in editing the interactive menu for presenting related data in accordance with the user's instruction, the presentation position and the presentation time on the screen can be easily and visually edited.

According to the third invention, the first and second inventions can be combined on the same device, and the media data and the interactive menu can be edited intuitively and visually at the same time.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration example of a data editing device that implements a data editing method according to the present invention. FIG. 2 is a block diagram showing a detailed configuration example of a three-dimensional data storage unit 16 in FIG.
FIG. 3 is a diagram schematically showing an example of a storage format of node information and link information stored in the media data management unit 11 and the interactive menu management unit 12, and FIG. 4 is a display update management in response to a media data editing instruction. FIG. 5 is a flow chart showing the operation of the unit 110, and FIG.
It is a flowchart which shows operation | movement of 110. FIG. 6 is a diagram schematically showing a spatiotemporal layout of media data or an interactive menu. FIG. 7 is a diagram showing an example of an electronic document. In the figure, 11: media data management unit, 12: interactive menu management unit, 13: three-dimensional generation unit, 14: coordinate conversion unit, 15: three-dimensional display unit, 16: three-dimensional data storage unit, 17 inputs Management unit 110 Display update control unit 21 Node information storage unit 22 Link information storage unit 23 Spatiotemporal coordinate storage unit 24 Drawing coordinate storage unit

Continuation of the front page (58) Field surveyed (Int. Cl. ⁶ , DB name) G06T 1/00-17/50 G09G 1/00-5/40 G06F 3/14-3/153

Claims (3)

(57) [Claims] 1. A method for editing a presentation position and a presentation timing of a plurality of media data recorded on an electronic medium on a screen, wherein a presentation position and a presentation time of each media data on a screen are three-dimensionally and visually. A data editing method, wherein the presentation position and the presentation timing are designated by expressing, and performing movement, enlargement, and reduction operations on a screen for each three-dimensional object. 2. A method for editing a presentation position and a presentation timing of an interactive menu on a screen for presenting related media data in accordance with an instruction of a user, the presentation position and a presentation time of each interactive menu on a screen. The interval is visually represented by a three-dimensional object, and the three-dimensional object is moved, enlarged, and reduced on the screen together with the three-dimensional object representing the presentation time and the presentation size of the media data according to claim 1, so that the presentation position and the presentation timing can be changed. A data editing method characterized by determining. 3. Media data management means for managing the attributes of media data, interactive menu management means for managing the attributes of each interactive menu, and edited data for temporarily storing the attributes of the media data and the attributes of the interactive menu for editing. Storage means and three-dimensional generating means for generating graphic data for display from attributes of the media data being edited and attributes of the interactive menu being edited; and coordinate converting means for converting the graphic data into drawing coordinates on a display screen. 3D display means for performing a graphic display based on the drawing coordinates on the display screen, input management means for receiving an edit command and input relating to a 3D operation from a user, the media data management means, and reading attribute data from the interactive menu management means The three-dimensional generating means, the coordinate converting means, the three-dimensional table Sends instructions or data to the unit, the data editing apparatus characterized by a display update control means for updating the attribute data in the editing data storing means in accordance with an input from the input management unit.