JP3175239B2 - Multimedia information editing device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia information editing apparatus, and more particularly, to a card type computer for operating and editing multimedia information such as character strings, figures, still images, and moving images.
The present invention relates to a multimedia information editing device performed by a computer.

[0002]

2. Description of the Related Art For example, a "multimedia presentation system" described in JP-A-3-74769.
As seen in the description of Hitomi Matsumoto, Hitomi Baba and Tetsuo Tamura, "Hypermedia Editing and Creation System", FRIEND21 "Third Achievement Presentation Proceedings" pp.99-108, conventional multimedia systems, hyper 2. Description of the Related Art A media system or the like is configured as a system that manages multimedia information such as character strings, graphics, still images, and moving images in a specific unit (for example, a page) and allows a user to define a mutual relationship. I have. For this reason, the system is capable of flexibly managing and editing multimedia information.

[0003]

However, in order to obtain an output corresponding to a specific purpose (report, presentation, plan, scenario, etc.) from the multimedia information, the user needs to obtain the multimedia information from the accumulated multimedia information. The necessary information in a form suitable for the purpose must be selected and reconstructed. In addition, there is a problem that the work load is heavy, for example, it is necessary to arrange the format in consideration of the output form to the display or the printer.

SUMMARY OF THE INVENTION The present invention has been made to solve the problems in such a conventional multimedia system. It is an object of the present invention to enable multimedia information to be easily edited according to a predetermined format, It is an object of the present invention to provide a multimedia information editing apparatus that can easily create an output such as a book, a plan, a scenario, or the like according to the purpose.

[0005]

In order to achieve the above object, a multimedia information editing apparatus according to the present invention comprises a card type for designating a media type of multimedia information including a still image and a moving image, and editing of the card type. the designation of the attribute information including the node identifier for indicating the structure, circle
A first creation unit (5: FIG. 1) for extracting a source of multimedia information and creating a card-type node having multimedia information and the attribute information, and a first storage unit (6: FIG. 1), the attribute second storage means in which information for storing the output format created in a format that includes a (8: and FIG. 1), retrieves the first stored in the storage means based on said designated output format, the In front of node in card format
Edit the multimedia information in combination based on the serial node identifier, a second generating means for generating as output data: characterized by comprising (7 1) and.

[0006]

In the multimedia editing apparatus of the present invention,
The first creating means (5; FIG. 1) includes a node type (for example, a card type) for indicating the type of media of multimedia information including still images and moving images, and a node identifier (for example, for indicating the editing structure). By specifying attribute information including a cut number and link information to be described later, a multimedia information source is cut out and a card node of multimedia information having the attribute information is created. That is, the attributes of the structure of each piece of multimedia information including the node identifier and the card type are defined for the node, and are stored in the first storage means (6: FIG. 1). The second storage unit (8: FIG. 1) stores an output format created in a format including the attribute information of the structure of the multimedia information, and the second creation unit (7) : FIG. 1) searches the first storage means based on the specified output format, and edits the multimedia information of each node according to the node identifier to create output data. That is,
Combine nodes in card form based on node identifier
Edit the multimedia information and create it as output data.
To achieve.

[0007] Thus, the output type, depending on the purpose, desired pieces of information cards (nodes) of multimedia structured information is managed per node card format is collected, designated Me pre According to the output format, the multimedia information is edited and automatically reconstructed. Then, it is displayed on the screen of the display, even the printer output is I line. For this reason, the user simply selects the necessary multimedia information and considers the output form only by selecting an output format suitable for the purpose of outputting the multimedia information and an information element of the carded multimedia information. Can be restructured into a format. Therefore, the work load for editing the multimedia information is reduced.

[0008]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be specifically described below with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a multimedia information editing apparatus according to one embodiment of the present invention. In FIG. 1, 1 is a keyboard, 2 is a mouse of a pointing device, 3 is an input control unit, 4 is a user interface control unit, 5 is a multimedia information editing unit, 6
Is a multimedia information structure holding unit, 7 is a multimedia information output format creation unit, 8 is an output format information holding unit, 9 is a printer device, 10 is a multimedia information access control unit, 11 is a multimedia device control unit, and 12 is a multimedia device control unit. Multimedia equipment, 13 is a multimedia information storage controller , 1
4 is an external storage device, 15 is a multimedia information display control unit, and 16 is a CRT display.

An outline of the operation of the multimedia editing apparatus composed of such respective device elements will be described. Multimedia information such as character strings, graphics, still images, and moving images is handled by the multimedia device 12. The multimedia device 12 is controlled by the multimedia device control unit 11. Multimedia information such as character strings, figures, still images, and moving images is transmitted from the multimedia device 12 to the
It is input under the control of the multimedia device control unit 11,
Further, the multimedia information storage control unit 13 controls the external storage device 14 and inputs each multimedia information stored in the external storage device 14.

[0010] Multimedia information access control unit 10
Is a control unit that controls the multimedia device control unit 11 and the multimedia information storage control unit 13 according to the access method. The control unit controls the multimedia information directly from the multimedia device 12 and the multimedia information stored in the external storage device 14. Multimedia information storage system for media information
It is output by the control unit 13 reading it out. The output control of the multimedia information is controlled according to the access method of the attribute of the card format node held in the multimedia information structure holding unit 6 described later, and the output information is sent to the multimedia information display control unit 15. You. The multimedia information display control unit 15 controls the CRT display 16 and the multimedia information access control unit 10
And outputs the multimedia information obtained through the CRT display 16 to the CRT display 16.

Further, the user interface control unit 4
In response to input data from an input control unit 3 for controlling input devices such as a keyboard 1 and a mouse 2, a user interface process for a user to interactively operate multimedia information is performed.

The multimedia information editing apparatus further includes a multimedia information editing unit 5 which indicates the type of media of multimedia information including still images and moving images. Then, the source of the multimedia information is cut out by designating a card type to be edited and a node identifier for designating the editing structure, and a card-shaped node that defines the configuration is created. The created node has the node identifier and the card type added to the node, defines the structure attribute of each multimedia information, and is stored in the multimedia information structure holding unit 6.

Further, the output format information holding section 8, the structure output format created attribute information in the form containing the multimedia information is stored is created Me pre, the output format stored here The multimedia information output format creation unit 7 searches the multimedia information structure holding unit 6 based on the specified output format, edits the multimedia information of each node using the node identifier, and creates output data. Then, the output data is sent to the multimedia information display control unit 15. When print output is required, output data is sent to the printer device 9 to obtain a print output.
The output format created in the format including the attribute information of the structure of the multimedia information stored in the output format information holding unit 8 is edited by the multimedia information output format creation unit 7 by editing the output format of the multimedia information. When the output is performed, the output format is stored as format information.

As described above, the multimedia information output format creation unit 7 is stored in the multimedia information structure storage unit 6 at a certain point in time according to the format information of the specific output format in the output format information storage unit 8. The multimedia information corresponding to the content information index of the multimedia information of the card is reconstructed, and a moving image or the like is read from the multimedia device 12 by the content information access method instructed on the card, and the printer, the display, etc. , A file or the like.

[0015] Thereby, specific card information is managed from structured multimedia information managed in card format units (nodes) in accordance with the output type and purpose, and automatically collected in accordance with the specific output format. Since the information can be output to a display and a printer, the load on the user for editing the multimedia information can be reduced.

FIG. 2 is a view for explaining an example of the format of a node serving as a management unit when editing multimedia information according to the present embodiment. As shown in FIG. 2, the node 21, which is a management unit when editing multimedia information, manages each piece of multimedia information in a card format, and defines a cut number 2 in order to define the attribute of its structure.
1a, card type 21b, content information index 21
c and a content information access method 21d. The cut number 21a is an identification number (node identifier) of the node, and the cut number 2 of this identification number
The multimedia information of each node is edited by 1a and card type 21b. The information type of each node 21 is specified by a card type 21b, and four types of information, such as a narration card, an instruction card, a still image cut card, and a moving image cut card, are provided here as card types. ing. Node 21 of each information of different card type is cut number 21a
And edited the card type 21b as a key, for example, as shown, is the card being coupled to one another integrated with the same cut number (Cut # 1), the information card type different nodes (card) of one display unit Is output.

It is assumed that the information type of each card type 21b of the multimedia information handled here has the following attributes. That is, a narration card holds original text data for "line". Instruction card: Holds instruction text data for the storyboard. Still image cut card ..... The image for the storyboard is stored as a bitmap. Moving image cut card: Holds the start / end time of the moving image for storyboards, and the operation can be played back from the operation panel, and the moving image is displayed in the display area in the cut card.

The content information index 21 of each node 21
c holds a file name when the multimedia information is stored in the external storage device 14 (such as text). In addition, the contents information access method 2 of each node 21
1d holds a pointer to a function to be called in order to display the multimedia information associated with the content information index 21c on the display. For example, when the multimedia information is a moving image of a VTR, the content information access method 21d reproduces the moving image from the start time to the end time held as the additional information for the VTR corresponding to the device identifier. As
A control function that controls the multimedia information access control unit 10 and instructs the multimedia device control unit 11 is held.

Referring again to FIG. 1, the input control unit 3
A keyboard 1, receives input information from a user input device such as a mouse 2, and passes <br/> the input information to the user interface control unit 4. User interface control unit 4
Manages a menu for instructing display, deletion, movement, etc. of a card displayed on the CRT display 16 and controls input to the multimedia information editing unit 5.

The multimedia information editing unit 5 edits multimedia information via a multimedia information structure holding unit 6 that holds attribute information of a node that defines an information structure serving as an index to actual multimedia information. /
Perform processing.

As shown in FIG. 2 described above, the multimedia information structure holding unit 6 has nodes 21, 22, 2 as units for managing multimedia information in each card format.
3,... Are held, and each node has a cut number 2
1a, card type 21b, content information index 21
c, the attribute information of the structure such as the content information access method 21d is held.

The cut number 21a is a decimal number assigned to identify which cut screen the card is for, and the card type 21b in this case is a narration card, instruction card, still image card, or One of the moving image cut cards. The content information index 21c holds a file name when the multimedia information is held in the external storage device 14 (such as text). If the multimedia information is based on the input from the multimedia device 12,
It holds a device identifier (eg, a file descriptor in UNIX) and additional information (eg, VTR start / end time). The content information access method 21d holds a pointer to a function to be called to display the multimedia information associated with the content information index 21c on the CRT display 16. For example, when the multimedia information is a moving image by a VTR (video tape recorder), the content information access method 21d includes the moving image from the start time to the end time as additional information for the VTR corresponding to the device identifier. Is set, and this attribute information is set in the multimedia information access control unit 10.
Is stored as a function for giving an instruction to the multimedia device control unit 11 from the.

Multimedia information access control unit 10
Selects the type of multimedia information accessed according to the content information access method 21d of the corresponding node 21 in the multimedia information structure holding unit 6 as described above, and selects the multimedia device control unit 11, the multimedia information The control of multimedia information access is passed to one of the accumulation control units 13. The multimedia device control unit 11
The control for inputting the information of the multimedia device 12 to the system is performed. Multimedia information storage control unit 13
Performs control for inputting information on the external storage device 14 to the system.

When the user input analyzed by the user interface control unit 4 is, for example, an “output creation” request, the multimedia information output format creation unit 7 is held in the multimedia information structure holding unit 6. The printer device 9 or the CRT can be referred to each other by referring to the multimedia information structure information and the output format information held in the output format information holding unit 8 defining the output format of the information.
The multimedia information is output to the display 16.

Next, an operation example when editing multimedia information in this embodiment will be described. Here, in addition to the multimedia device 12 controlled by the multimedia device control unit 11, for example, the image data from the image scanner and the moving image from the VTR, the external storage accessed by the multimedia information storage control unit 13 A procedure for creating a storyboard using text data held in the device 14 will be described as an operation example.

FIG. 3 is a view showing an example of the entire display screen of the CRT display when the multimedia information editing process is performed. FIG. 4 shows a pop-up menu for selecting a card type displayed during the card creation process. FIG. 5 is a diagram showing a display example, and FIG. 5 is a diagram showing a display example of a pop-up menu at the time of selecting an input type of multimedia information displayed during the card creation process.

First, as an example of creating a node which is a basic management unit when editing multimedia information, the creation of a cut card will be described by the procedure of creating a still image card. Creation can be performed by the following two methods.

The first card creation method is a case where an image input directly from the multimedia device control unit 11 by an image scanner is used as a still cut card. In this case, first, the operator operates the CR as shown in FIG.
When the "create card" menu 31 displayed on the screen 30 of the T display is clicked with the mouse cursor 32, a pop-up menu is displayed as shown in FIG.
A card type menu 33 is displayed on the screen, and a card type of a desired information type is selected with the mouse cursor 32 from the displayed card type menu. Here, you will create a still image and select "still image Zoka over de". Thereby, CRT
On the screen 30 of the display, a frame 34 of an initialized card (node) whose card type is a still image cut card is displayed.

When the mouse is clicked in frame 34 of the still image cut card, selection of the input source type of the multimedia information is requested as a subsequent pop-up menu. As shown in FIG. The menu 35 is displayed. Here, “image scanner input” is selected by clicking with the mouse cursor 32. By selecting this “image scanner input”, the multimedia device control unit 11 activates the image scanner as an input source and performs image input.
A still image creation process is performed to put the input image information result in the frame 34 of the still image cut card. After that, input the cut number and output image file name of the cut card, reflect the contents to the contents of the multimedia information structure holding unit that stores the attribute of the structure of the cut card as a node, and finish creating the static cut card I do.

In the second card creation method, in the above-described still image cut card creation, selection of the input type of multimedia information is requested, and as shown in FIG. When the menu 35 is displayed, "input image file" is selected from the still image cut card menu 35, and the already stored still image is input from the multimedia information accumulation control unit 13. In this case, as an input source selection, the user clicks and selects “input image file” from the still image cut card menu 35 of the pop-up menu, and further inputs an input image file name and a cut number. Thereby, the multimedia information storage control unit 13
Searches for an image file stored in the external storage device 14, and its content information is displayed in the frame 34 of the still image cut card. Then, the content of the node of the multimedia information structure holding unit 6 (the content information index 21c of the corresponding node 21 and the content information access method 2)
1d) is updated, and the processing ends.

As a result of performing such a card creation operation, for example, as shown in FIG. 3, the cut card of each node created here is displayed on the screen 30 of the CRT display. In this example, the cut of cut number 1 (Cut 1) and the cut of cut number 2 (Cut 1) are displayed on the CRT display.
Each cut card of the cut of 2) is created. These cards are narration cards for Cut 1 and Cut 2,
The instruction card, the still image cut card, and the moving image cut card are displayed as windows. In this way, the operator defines and manages the information necessary for the multimedia information as a card structure (a data structure that can be managed in a card format) according to the above-described card creation method according to the output type and purpose. And display them on the screen, and perform the desired editing using these as editing elements.

Next, an example of the operation of creating a storyboard from the state shown in FIG. 3 will be described. In this case, first, when the menu 36 of “output creation” of the editing operation menu on the screen 30 is clicked with the mouse cursor, the user interface control unit 4 issues an instruction to create a storyboard to the multimedia information output format creation unit 7. In the multimedia information output format creation unit 7, for example, as shown in FIG. 6, format information (output information 1, output information 2,...) Of one cut of output format held in the output format information holding unit 8 is stored. ) Is read and referenced to reconfigure the multimedia information. Hereinafter, the procedure will be described in detail.

The multimedia information output format creation unit 7
First, for example, one cut of the format information group 37 held in the output format information holding unit 8 as shown in FIG. 6 is sequentially read from output information 1 to output information 2, output information 3,. . As shown, the format information of each cut in the format information group 37 includes a card type 37a, an output position 3
7b, which is composed of an output conversion method 37c, etc., and is format information in which the output format of each cut in the case of performing screen display / print output of multimedia information managed as a card is registered.

Next, a card (node) corresponding to the card type of the format information of the currently read output information is searched from the multimedia information structure holding unit 6. Then, the entity of the information is obtained by the content information index and the content information access method that indicate the attribute of the card structure of the corresponding node (FIG. 2) according to the search result. Further, if an output conversion method is specified as format information for outputting the information, the information is converted according to the output conversion method, and the information is output to a position on the CRT display or printer corresponding to the output position. . Perform the above procedure 1
By repeating from the 1st output information 1 to the Nth output information N, information of one cut is collected from the multimedia device 12 or the external storage device 14, respectively.
This means that the image is output to the CRT display 16 or the printer 9. The storyboard creation is completed by repeating the output operation for one cut for all cuts. As a result, the output information is reconstructed from the card group as exemplified in FIG. 3, and as shown in FIG. 7, the screen of each cut is edited and output by the output screen of a predetermined output format.

FIG. 7 is a diagram showing an example of an output screen in which the output is reconstructed from the card group exemplified in FIG. On the output screen 40, a still image 41 of cut # 1, a narration 4
2, and one cut consisting of instructions 43 is reconstructed, it is displayed in the order of cut number. By displaying the cut numbers in chronological order, the configuration of the scenario and the like can be easily displayed. Next, from the card creation processing on the system side using the card creation method as described above,
An example of the processing on the system side when the output information is created using the created card will be described more specifically.

FIG. 8 is a flowchart illustrating the processing flow of the card creation processing, and FIG. 9 is a flowchart illustrating the processing flow of the output creation processing. Hereinafter, the card creation processing and the output creation processing will be described with reference to these flowcharts.

In the card creation process, as shown in FIG. 8, first, in step 51, when it is detected that the card creation menu is selected, in the next step 52, a card type selection menu is displayed. When the operator according to this select a card type, then the create card type selected card type on the screen in step 53. Next, in step 54, an input source selection menu is displayed according to the type of the created card. In response to this, when the operator selects an input source from the menu, in step 55, the selected input source is set as the input source of the card. Then, in a process from the next step, a process of creating a node of attribute information defining a card structure is performed.

In the next step 56, it is determined whether or not the input source is an external storage device. If the input source is not an external storage device, in step 57,
Next, the input source name input is registered as a content information index. If the input source is an external storage device, the input file name is registered as a content information index in step 58. Next, in step 59, a pointer to a conversion function depending on the input source is registered in the content information access method of the node. Then, in the next step 60, a record of the multimedia information structure is created, and the record is named M
Register in INFO file. Next, in step 61, the input cut number is registered as the cut number of the node. In the next step 62, for the card (node) to be created, the cut number, creation card type, content information index, and content information access med data that have been input and registered so far are stored in the multimedia information structure. Identifier MINF as the card information of
O. Is stored as information with. In other words, and the cut number MINFO. Cut number, the creation card type and MINFO. Create card type, the content information index and MINFO. Description information index, the contents of information access methods and MINFO. Contents information access method. Next, to confirm the contents of the card information created in step 63, in accordance with MINFO. Contents information index MINFO information content indicated. Description information access method, displayed on the CRT display.

Next, the output creation process will be described with reference to the flowchart of FIG. In this processing, first, when it is detected in step 71 that the “output start” menu is selected, in next step 72, format information for one cut in the output format information holding unit is selected, and the output information array and I do. Next, in step 73, the cut number is initially set to "1".
The counter number X of the output information array indicating the format information for output control of the cut is initially set to "1". And
In step 75, the counter number X of the output information array
With respect to the format information of, the data of the multimedia information structure holding unit in which the card type and the currently processed cut number match are searched. In step 76, by executing MINFO. Description information access method of MINFO. Information content indicated by the content information index nodes retrieved cut number, and outputs to the printer.

Next, at step 77, the value of the counter number X is incremented by one. Then, in step 78, it is determined whether or not the counter number X has exceeded the maximum value N of the number of the output information in the output format information holding unit. If the counter number X does not exceed the maximum value N of the number of output information, the process returns to step 75, and the processing from step 75 is repeated. When the counter number X exceeds the maximum value N of the number of the output information, the output of each card (node) information of the current cut number has been completed.
In step 79, the cut number is updated, and the cut number is incremented by one. Then, in step 80, it is determined whether or not the current cut number has exceeded the maximum cut number in the multimedia information structure holding unit. If the current cut number does not exceed the maximum cut number, the flow returns to step 74 to output the card information of the next cut number, and a series of processing from step 74 is performed on the information of the next cut number. I do. Also,
If the current cut number exceeds the maximum cut number,
Since the output of the information of all the cut numbers has been completed by the processing so far, the processing is terminated.

As described above, according to the multimedia information editing apparatus of the present embodiment, each piece of multimedia information is managed on a node basis of a card structure and is made an element of structured multimedia information. . Then, the node information of the card structure is automatically reconfigured according to the format information of a specific output format, and can be displayed on a CRT display, and can be output to a printer. For this reason, reports, presentations, proposals,
The operator does not need to reconfigure the stored information according to the output form to be created, such as a scenario, and the efficiency of work is improved. In addition, since miscellaneous information can be classified as a card and put into a specific format, it is also effective when the work results of a large number of people are summarized or the work entity is standardized.

Further, in the multimedia information editing apparatus, link information for associating mutual cards (information) frequently used in a hypertext system is added to a node, so that the information is used as reference information when reconstructing a format. It can be used, and a more advanced format configuration is possible.

In the embodiment described above, when creating output data, the cut number is used as the node identifier to identify the related node from other nodes. However, as a modified example, the cut number is used instead of the card number. Obviously, the same effect can be obtained by using the link information indicating the node to perform. For example, a still image card may be a parent card, a narration card or an instruction card may be a child node, a parent node may have link information to a child node, and a child node may have link information to a parent node. .

[0044]

As described above, according to the multimedia information editing apparatus of the present invention, a specific type of multimedia information managed and associated with each node of the card structure is stored. Only information can be collected and reconstructed according to a specific format. For this reason, the user simply selects the necessary multimedia information and considers the output form only by selecting an output format suitable for the purpose of outputting the multimedia information and an information element of the carded multimedia information. Can be restructured into a format.
Therefore, the work load for editing the multimedia information is reduced.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a multimedia information editing apparatus according to one embodiment of the present invention;

FIG. 2 is an exemplary view for explaining an example of a format of a node serving as a management unit when editing multimedia information according to the embodiment;

FIG. 3 is a diagram showing an example of an entire display screen of a CRT display when editing processing of multimedia information is performed;

FIG. 4 is a diagram showing a display example of a pop-up menu when a card type is selected, which is displayed during the card creation process;

FIG. 5 is a diagram showing a display example of a pop-up menu at the time of selecting an input type of multimedia information displayed during the card creation process;

FIG. 6 is a diagram showing an example of a format information group of an output format held in an output format information holding unit;

FIG. 7 is a diagram showing an example of an output screen in which output is reconstructed from the card group illustrated in FIG. 3;

FIG. 8 is a flowchart illustrating a processing flow of a card creation process;

FIG. 9 is a flowchart illustrating a processing flow of an output creation processing;

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Keyboard, 2 ... pointing device mouse, 3 ... Input control part, 4 ... User interface control part, 5 ... Multimedia information editing part, 6 ... Multimedia information structure holding part, 7 ... Multimedia information output format creation part .. 8 output format information holding unit 9 printer device 1
0: multimedia information access control unit, 11: multimedia device control unit, 12: multimedia device, 13
... Multimedia information storage control unit, 14 ... External storage device, 15 ... Multimedia information display control unit, 16 ... CR
T display, 20 nodes, 30 display screens, 32 mouse cursor, 33 card type menu, 35 still image cut card menu, 37 output format information group.

──────────────────────────────────────────────────続 き Continued on the front page (58) Fields surveyed (Int. Cl. ⁷ , DB name) G06T 1/00 G06T 11/60-17/50 G06F 12/00 G06F 17/30

Claims (1)

(57) [Claims] 1. A source of multimedia information by specifying attribute information including a card type indicating a media type of multimedia information including a still image and a moving image, and a node identifier for indicating an editing structure of the card. Cut out
The multimedia information and the attribute information having the attribute information.
First creating means for creating a node in the form of a node, first storing means for storing the created node, and second storing means for storing an output form created in a format including the attribute information. searched for first in the storage unit based on the output format, based on the node of the card format to the node identifier
Zui edit multimedia information in combination with, the multimedia information editing apparatus characterized by comprising a second generating means for generating, as output data.