JP3679427B2 - Multimedia document editing method and apparatus - Google Patents

Description

[0001]
[Industrial application fields]
The present invention relates to a multimedia document editing method and apparatus for handling multimedia data such as characters, still images, sounds, and moving images.
[0002]
[Prior art]
In recent years, with the rapid progress of personal computers, workstations, and networks, documents that have been distributed by paper media have been distributed via magnetic recording media, optical recording media, and networks, and can be viewed by computers. Various forms of documents are spreading. Such a document can handle not only characters and still images, but also moving images and voices, so that the expressive power is greatly improved. On the premise of browsing on such a computer, a document including characters, still images, sounds, moving images, and the like is referred to as a multimedia document. Conventionally, as a means for editing such a document, there are many means for expanding a conventional editing function for handling characters and still images, such as a word processor, so as to handle moving image data.
[0003]
[Problems to be solved by the invention]
However, the conventional document editing means has the following problems.
[0004]
(1) When a multimedia document is played back, it may be played back on the computer used for editing but not on another computer.
[0005]
Especially for data formats such as video and audio, since these data have recently been handled by computers, and technology for compressing these data is under development, various data formats have been developed one after another. It tends to appear.
[0006]
Therefore, in recent OSs (operating systems), as in Microsoft Windows 3.1, video and audio playback is provided on the OS side, and playback means for data formats of various formats are provided. It has means that can be added as a library. For example, when a moving image is pasted in characters being created by a word processor, the word processor only provides a rectangular area occupied by the moving image data, and is not involved in reproducing the moving image. In this case, there is no problem because the document can be edited without being aware of the data format of the movie while the document is being created. However, when the document is reproduced on another computer, reproduction means corresponding to the data format embedded in the document is provided. There has been a problem in that it cannot be played at all unless it is installed in a computer used for playback. In addition, in order to determine which format of data reproduction means is introduced, highly specialized knowledge is required, which has been a factor that hinders the spread of multimedia documents.
[0007]
(2) It is difficult to fit a document within a specific storage capacity.
[0008]
Video and audio data is generally large. For example, when storing data on a floppy disk, edit the document and check the file capacity using the file management program. The data capacity exceeds the capacity of the floppy disk. In this case, it was necessary to re-edit the data several times by trial and error in order to store the data in the capacity of the floppy disk, which was very troublesome.
[0009]
The present invention has been made in view of the above-described conventional example, and can be played back without a playback means for the corresponding multimedia format in a playback computer, and a multimedia document editing method and an increase in file capacity can be prevented. An object is to provide an apparatus.
[0010]
[Means for Solving the Problems]
In order to solve the problem (1), the multimedia document editing apparatus of the present invention has the following configuration. That is, an editing apparatus for a multimedia document including a plurality of types of multimedia data, and a procedure for outputting at least one type of data among the multimedia data included in the multimedia document is provided. As a library group Storage means for storing and a procedure necessary for outputting data included in the multimedia document based on the attribute of the data Said Library group Selection means to select more and the procedure selected by the selection means The The data Along with the file Output means for outputting.
[0011]
Also. The multimedia document editing method of the present invention has the following configuration. That is, a method for editing a multimedia document including a plurality of types of multimedia data, and a procedure necessary for outputting the data included in the multimedia document. , Based on the attributes of the data The procedure for outputting at least one kind of data among the multimedia data included in the multimedia document is stored. Library group Selection process to select more and the selection Process Procedure selected by The The data Along with the file An output step of outputting.
[0017]
[Action]
With the above configuration, output according to the format of the data to be output In Necessary steps From libraries Select that step , data Along with the file Output.
[0018]
【Example】
FIG. 1 is a diagram showing a hardware configuration of a system used for editing and playing back a multimedia document according to the present embodiment. The configuration shown in FIG. 1 can be configured as a dedicated machine, or can be configured using a personal computer, a workstation, and peripheral devices.
[0019]
In FIG. 1, 101 is a CPU that performs data processing, 102 is a main memory used for temporary storage of data processed by the CPU 101, 103 is a ROM for storing read-only programs and data, and 104 is data of the CPU and peripheral devices. The data bus 105 is a display control unit for displaying data on the screen, 106 is a VRAM for storing screen display data sent from the display control unit, and 107 is analog data for the data stored in the VRAM 106. Reference numeral 108 denotes a DA conversion unit that converts the display data into a display for displaying screen display data. 110 is a hard disk memory for storing data permanently or temporarily, 109 is a hard disk interface for connecting the hard disk memory 110 to the data bus 104, 112 is data permanently like the hard disk memory 110, or A memory card 111 for temporarily storing is a memory card interface unit for connecting the memory card 112 to the data bus 104. Reference numeral 114 denotes a network such as EtherNet, and reference numeral 113 denotes a network interface unit for connecting the network 114 to the data bus 104. 116 is a floppy disk device for storing data permanently or temporarily, and 115 is a floppy disk interface unit for connecting the floppy disk device 116 to the data bus 104. Reference numeral 118 denotes a keyboard, and reference numeral 117 denotes a keyboard interface unit for connecting the keyboard 118 to the CPU 101. Reference numeral 120 denotes a mouse, and 119 denotes a mouse interface unit for connecting the mouse 120 to the CPU 101. Reference numeral 122 denotes a microphone for inputting audio data, reference numeral 123 denotes a speaker for reproducing the audio data, and reference numeral 121 denotes a sound interface unit for connecting the microphone 122 and the speaker 123 to the data bus 104.
[0020]
FIG. 2 is a diagram showing a software configuration of the multimedia document editing system of this embodiment.
[0021]
In FIG. 2, 1 is a multimedia document editing system, 200 is an OS, 201 and 202 are software added to the OS so that the OS 200 can play back multimedia data, 201 is a multimedia data playback core program, 202 Is a library subset for multimedia data control. Under such an OS with an extended multimedia function, for example, when moving image data is embedded in a document created by a word processor, when a document viewer instructs reproduction of moving image data, the multimedia data reproduction core program 201 is first executed. Is dynamically linked from the multimedia data control library subset 202 to a program necessary for reproducing moving image data in a format instructed to be reproduced, and the moving image data is reproduced (dynamic link). See Microsoft Windows Programmer's Reference). Therefore, it is possible to reproduce moving image data even if the word processor itself does not have a function for reproducing moving image data.
[0022]
Reference numeral 2 denotes a multimedia document editing software group, a multimedia document editing program 3 that edits a document including multimedia data, a multimedia document control core program 4 that analyzes the structure of the multimedia document and serves as a core of browsing means, It is composed of a multimedia data control library group 5 which is a collection of various multimedia data control libraries required for processing and playing back multimedia data that can be handled in a multimedia document.
[0023]
11 is a multimedia material data group, i character data groups from first text data 12 to i-th text data 13, j video data groups from first video data 14 to j-th video data 17, The k still image data groups from the first still image data 20 to the kth still image data 21, the l audio data groups from the first audio data 14 to the lth audio data 15, the first illustration data (line drawing) Data) is composed of m illustration data groups from 18 to m-th illustration data 19. These material data are data collected by the editing company of the multimedia document by various means, and often include various data formats.
[0024]
Reference numeral 6 denotes a multimedia document file created by the editor using the multimedia document editing program 3. The multimedia document structure data 7 indicating the arrangement of each multimedia data in the multimedia document, the multimedia document control core program 8 ( Normally, the multimedia document control core program 4 is copied as it is), the multimedia control library subset 9 (only the libraries necessary for reproducing the data embedded in the multimedia document are selected from the multimedia data control library group 5) A multimedia data group 10 which is data selected and processed for embedding in the document from the multimedia material data group 11.
[0025]
FIG. 3 is a diagram showing the configuration of the multimedia document editing program 3. In FIG. 3, reference numeral 31 denotes a multimedia document reading means for reading an edited multimedia document file 6 stored in the hard disk memory 110 or the like. Reference numeral 32 denotes multimedia data reading means for reading data to be embedded in a document from the multimedia material data group 11. Reference numeral 33 denotes multimedia data attribute analysis means. If the read data is multimedia document data, the multimedia document structure data 7 is analyzed and stored in the multimedia document editing information storage means 34. The read data is the multimedia data. If it is material data, multimedia attribute information is stored in the multimedia document editing information storage means 34 by analyzing header information and the like. Since the multimedia attribute analysis means 33 is actually included in the multimedia control core program 4, the multimedia document editing program control means 30 instructs the multimedia control core program 4 to perform the processing when using this function. . The multimedia material data included in the read multimedia document and the directly read multimedia material data are stored in the multimedia data temporary storage means 203.
[0026]
The multimedia document editing information storage means 34 includes a multimedia document background information 35 indicating the background color and pattern of the multimedia document, and a list of libraries necessary for reproduction and processing of the multimedia material data embedded in the multimedia document. The multimedia data control library table 36 shown in FIG. 1 is composed of multimedia document attribute information of q pages from first page multimedia document attribute information 38 to qth page multimedia document attribute information 48.
[0027]
The multimedia document attribute information for one page includes the first multimedia data attribute information and the first multimedia document control information 46, which is information for controlling the document such as display of related data and page feed, to the pth multimedia. It consists of p multimedia document control information up to document control information 47.
[0028]
One multimedia data attribute information, like the first multimedia data attribute information, is a data ID 40 for identifying multimedia data, a data type 41 specifying the format of the multimedia data, a display position and a size of the multimedia data. Display position rectangle information 42 indicating the length, a data control procedure 43 indicating a procedure such as a display method of multimedia data, a related data ID 44, and a file indicating the position and size of the multimedia data in the multimedia document data file 6 It consists of internal position information 37.
[0029]
Reference numeral 50 denotes multimedia document display means for displaying the multimedia document on the display 108 based on the information in the multimedia document editing information storage means 34. Since the multimedia document display means 50 is actually included in the multimedia control core program 4, the multimedia document editing program control means 30 instructs the multimedia control core program 4 to perform the processing when using this function. .
[0030]
The multimedia document control core program 4 determines a library corresponding to the data type 41 in the multimedia data attribute information 39 from the multimedia data control library table 36, and selects a necessary library from the multimedia data control library group 5. The multimedia data is displayed or reproduced by dynamically linking.
[0031]
The multimedia data attribute changing unit 49 changes the information in the multimedia document editing information storage unit 34 according to an instruction from the mouse 120 or the keyboard 118, and reflects the change result on the display 108 via the multimedia document display unit 50.
[0032]
Since the multimedia data attribute changing unit 49 is actually included in the multimedia control core program 4, the multimedia document editing program control unit 30 instructs the multimedia control core program 4 to perform the process when using this function. To do.
[0033]
The multimedia document control core program 4 determines a library corresponding to the data type 41 in the multimedia data attribute information 39 from the multimedia control library table 36 and selects a necessary library from the multimedia data control library group 5. Change the attributes of multimedia data by dynamically linking.
[0034]
51 is a data capacity calculating means for calculating the data capacity of the multimedia document from the information in the multimedia document editing information storage means 34 and displaying it on the data capacity display means 52. The data capacity of the multimedia document includes the capacity when the contents of the multimedia document structure data 7, that is, the contents of the multimedia document editing information storage unit 34 are filed, the file capacity of the multimedia document control core program 8, and the multimedia document The file capacity of the multimedia data group 10 used therein and the files of the library set 9 for multimedia data reproduction, which is a subset of the multimedia control library group 5 necessary for displaying and reproducing the data of the multimedia data group 10 Includes capacity. Further, the data capacity calculation means 51 obtains the capacity of the multimedia data selected as the editing target by the instruction of the mouse 120 or the keyboard 118 during the editing work from the multimedia data attribute changing means 49 and sends it to the data capacity display means 52. indicate.
[0035]
53 is a data capacity control means, which compares the data capacity with a predetermined capacity value previously designated by the editor, and displays a warning if the multimedia document being edited exceeds the capacity value. The data capacity control means 53 also has a function of compressing multimedia data so that the multimedia document falls below the capacity value in accordance with the editor's instruction. When data compression is instructed, the data capacity restriction unit 53 instructs the multimedia document control core program 4 to perform data compression. The multimedia document control core program 4 dynamically links a library necessary for data compression of multimedia data included in the multimedia document being edited from the library group 5 for multimedia data control, and compresses the multimedia data. Do. The compressed multimedia data is stored again in the multimedia data temporary storage unit 203. However, since the image quality deteriorates in the irreversible compression, the data before compression is also retained so that the state before compression can be restored.
[0036]
Reference numeral 54 denotes multimedia document writing means for writing the editing result into the multimedia document file 6. Reference numeral 30 denotes multimedia document editing program control means for controlling the overall operation of the multimedia document editing program 3.
[0037]
FIG. 25 is a diagram showing the configuration of the multimedia document control core programs 4 and 8, and multimedia data attribute analysis means 33, multimedia document display means 50, multimedia data attribute change means 49, multimedia document structure data address storage. Consists of means 73.
[0038]
FIG. 4 is a diagram showing the configuration of the multimedia data control library group 5, and still image data in r still image formats from the first still image format control library 60 to the r-th still image format control library 61. A library group that controls the operations of the s video formats from the first video format control library 62 to the sth video format display means 63, and the first audio format control library 64 to the tth audio. A library group for controlling audio in t audio formats up to the format control library 65, and a library for controlling illustrations in u illustration formats from the first illustration format control library 66 to the uth illustration format control library 67 Consists of That.
[0039]
FIG. 24 is a diagram showing the configuration of one multimedia control library. Reference numeral 68 denotes a multimedia data control library, which is a multimedia data display means 69 for displaying multimedia data, a multimedia data playback means 70 for playback in a predetermined sequence in the case of moving image or audio data, and a data compression unit. Data means such as a multimedia data compressing means 71 used when storing in a file and a multimedia decompressing means 72 when decompressing and extracting compressed data from the file are provided.
[0040]
FIG. 5 shows an example of a screen displayed when the multimedia document editing program 3 is set to display a warning when the file capacity of the multimedia document exceeds a predetermined capacity. In FIG. 5, reference numeral 80 denotes a window of the multimedia document editing program 3. Reference numeral 81 denotes a mouse cursor for instructing a specific portion of the screen with the mouse 120. The mouse is provided with a button, and an operation in which the user presses and releases the button is generally referred to as a click, and an operation in which the mouse is clicked twice within a predetermined interval is referred to as a double click. In addition, the user specifies the characteristic position, and drags the movement of the mouse while holding down the mouse button. 82 is a file menu that mainly includes commands related to file operations, 83 is an edit menu that mainly includes commands related to editing operations for specific data, and 84 is a setting menu that mainly includes commands related to settings. . When the setting menu 84 is clicked with the mouse cursor 81, a setting dialog 85 is displayed. Reference numeral 86 denotes a data capacity limit value input field, and a desired limit value of the data capacity of the multimedia document can be directly input from the keyboard 118. Reference numeral 87 denotes a data capacity calculation option setting button area.
[0041]
Only one of the button 88 and the button 89 can be selected, and when the button 88 is selected, the data capacity is calculated including the capacity of the multimedia core program 8 and the library subset 9 for playing multimedia data. When the button 89 is selected, calculation is performed without including the capacity of the multimedia core program 8 and the library subset 9 for reproducing multimedia data. Reference numeral 90 denotes an approval button. When the approval button 90 is clicked, the setting is validated and the setting dialog 85 is not displayed.
[0042]
FIG. 22 shows changes in the data capacity of a multimedia document due to a user's data import operation when editing the multimedia document in the multimedia document editing system of the present invention, and exceeds the capacity predetermined by the user. It is a flowchart explaining the operation | movement at the time of issuing a warning at the time. FIG. 23 shows a change in the data capacity of the multimedia document due to the user's trimming range designation operation when editing the multimedia document in the multimedia document editing system of the present invention. It is a flowchart explaining the operation | movement at the time of issuing a warning when it exceeds capacity. Now, the operation of the steps shown in FIGS. 22 and 23 will be described with reference to other drawings.
[0043]
FIG. 6 is a diagram showing a screen display example when a multimedia document is newly created by the multimedia document editing program 3. When the file menu 92 is clicked in FIG. 6, a list of file-related command items is displayed. 91 is a newly created menu item, and since FIG. 6 shows the screen after the newly created menu item 91 is selected, an untitled multimedia document editing window 204 is displayed. At this time, the multimedia document window 204 is filled with a default background color, and the background information is stored in the multimedia document background information 35. Reference numeral 92 denotes a multimedia document reading menu item. Reference numeral 93 denotes a multimedia data reading menu item for selecting multimedia material data to be included in the multimedia document from the multimedia data group 10. Reference numeral 94 denotes a compression menu item for compressing the multimedia material data so as to be within the set value of the data capacity set in the description of FIG. Reference numeral 95 denotes a “Save as Rename” menu item for saving the edited multimedia document in a file with a different name. Reference numeral 96 denotes a save menu item for saving the edited multimedia document in a file. Reference numeral 97 denotes an end menu item for ending the program. A total data capacity display 98 displays the total data capacity value of the multimedia document. The data capacity display means 52 displays the value calculated by the data capacity calculation means 51. Since the multimedia data group 10 and the multimedia data playback library subset 9 are empty when newly created, only the total capacity of the multimedia document control core program 8 and the multimedia document structure data 7 is displayed. That is, in step S501 in FIG. 22, the total capacity is calculated and displayed as the capacity addition value of the background data and the multimedia data document control core program.
[0044]
Step S502 in FIG. 22 and step S509 in FIG. 23 are common steps for designating data to be imported into the multimedia document to be edited. FIG. 7 is an example of a display screen for designating multimedia material data to be read in this step. is there. Reference numeral 130 denotes a read multimedia data selection dialog, which is displayed by clicking a multimedia data read menu item in FIG. 131 is a disk drive designation list for designating a disk drive, 132 is a directory designation list for designating a directory, 133 is a format designation list for designating the format of multimedia data, and 134 is a file name designation list for designating a file name.
[0045]
Since the file name specified in the file name specification list 134 is displayed in the file name input field 135, when the read button 136 is clicked, the read multimedia data selection dialog 130 is hidden and the specified multimedia material data file is displayed in the multi-file format. It is read by the media material data reading means 32. At the time of reading the designated multimedia material data, the multimedia data attribute analyzing means 33 analyzes the attributes of the multimedia data from the header information etc. and stores them in the multimedia document editing information storage means 34 as described with reference to FIG. At this time, the data ID 40 is given an identification number that enables the multimedia data attribute information analysis means 33 to uniquely identify the multimedia material data in one multimedia document. The multimedia data control library table 36 stores the multimedia data control library name necessary for displaying and editing the read data together with the entry number. The data control procedure 43 stores a list of means necessary for displaying and editing the read multimedia data and the entry number in the multimedia control library table 36 of the multimedia data control library name including those means. .
[0046]
FIG. 8 shows an example of a display screen displayed by the multimedia data attribute changing means 49 via the multimedia document display means 50 when changing the display range of the read multimedia material data. Reference numeral 140 denotes the read still image data. At the time of reading, the data capacity calculation means 51 calculates the capacity of the still image data 140 imported to the total capacity of the multimedia document in step S503 in FIG. In step S504 in FIG. 22, the multimedia data attribute analyzing unit determines whether a new multimedia data control unit is necessary for displaying the still image data 140. If necessary, the data capacity calculating unit 51 in step S505 in FIG. The newly required library capacity is added to the total capacity, and the total capacity is displayed on the total capacity display 98. The data capacity control means 53 determines whether or not the data capacity preset in step S506 in FIG. 22 is exceeded. At this time, if the preset data capacity is exceeded, a warning is displayed in step S507 in FIG. 22, and if not, no warning is given in step S508 in FIG. As an example of the warning display, the display is reversed as shown in the total capacity display 98 of FIG.
Reference numeral 141 denotes an outer frame of still image data. When an arbitrary point on the still image data 140 is clicked, the outer frame 141 is displayed with a thick line, indicating that the still image data 140 is selected for editing. At that time, the data capacity of the data selected in step S510 in FIG. 23, that is, the still image data 140 is calculated by the data capacity calculation means 51 and displayed on the selected data capacity display 99. When the mouse cursor 81 is over the outer frame 141 of the still image data, it becomes a double-ended arrow shape, and the size of the frame 141 changes by dragging in that state. This data trimming range designation operation corresponds to step S511 in FIG. Depending on the size of the frame 141, the data capacity calculation means 51 calculates the data capacity and reflects it in the selected data capacity display 99. Only the portion of the data enclosed by the frame 141 is stored in the final multimedia document. The total data capacity display 98 is added with the data capacity of the still image data 140 and the capacity of the multimedia data control library subset 9 necessary for displaying the still image data 140. Here, in the determination step of FIG. 23, step S513, the data capacity limiting means 53 determines that the total data capacity does not exceed the set value of the data capacity, and the data capacity limiting means 53 is the warning non-display step of FIG. 23 step S515. Do not display warnings.
[0047]
FIG. 9 shows an example of a display screen displayed by the multimedia data attribute changing unit 49 via the multimedia document display unit 50 when the display position of the read multimedia material data is changed. Here, the display range of the still image data 140 is reduced by the operation described with reference to FIG. 8, and the value of the selected data capacity display 99 is also smaller than that in FIG. The shape of the mouse cursor 81 changes to the shape shown in FIG. 9 inside the frame 141. The display position of the still image data 140 can be changed by dragging in this state. The coordinates P1 (x1, y1) and P2 (x2, y2) indicating the display position and display range of the still image data 140 are sequentially reflected in the display position rectangular information 42 of the still image data 140 by the multimedia data attribute changing unit 49. .
[0048]
FIGS. 10 and 11 show examples of display screens displayed by the multimedia data attribute changing unit 49 via the multimedia document display unit 50 when inputting characters. In FIG. 10, reference numeral 142 denotes a character input tool icon. When the character input tool icon is clicked, the mouse cursor has the shape of the cursor 81 shown in FIG. 11, and the character string 144 can be input to the multimedia document window 204. become. At this time, since the still image data 140 is automatically in a non-selected state, it becomes a thin line. When multimedia data such as a character string 144 is directly input, the nth multimedia data attribute information 46 is newly created by the multimedia data attribute changing means 49.
[0049]
FIG. 12 is an example of a display screen when the moving image data 145 is further read. Here, when it is detected that the total data capacity has exceeded the set value of the data capacity, the data capacity limiting means 53 reversely displays the display of the total data capacity display 98 as a warning display.
[0050]
22 and 23 are flowcharts showing the operations of the data capacity calculation means 51 and the data capacity restriction means 53 described above.
[0051]
FIG. 13 shows an operation for performing data compression in order to reduce the data capacity below the set value of the data capacity. When the compression menu item 94 as shown in FIG. 13 is clicked, the data capacity restriction means 53 searches the multimedia data attribute information represented by the first multimedia data attribute information 38 for the compressible data, and controls multimedia document control. Instructs the core program 4 to compress the corresponding multimedia data. The multimedia document control core program 4 retrieves the necessary library from the multimedia control library table 36 and dynamically links it to obtain the data compression means 71, so that the data capacity of the multimedia document is less than or equal to the set value of the data capacity. The corresponding compressed data is compressed so that The compressed data is stored in the multimedia data temporary storage means 203, but the data before compression is also saved as it is.
[0052]
FIG. 14 shows a display during data compression, and a compression progress display 146 indicating that compression is in progress is displayed. FIG. 15 shows a display screen after compression. As a result of the compression, the total data capacity becomes equal to or less than the set value as shown in the total data capacity display 98, so that the data capacity control means 53 cancels the reverse display for warning. Data once compressed in the multimedia data temporary storage means 203 is decompressed and displayed by the corresponding data reproducing means included in the multimedia control library group 5. Reference numeral 147 denotes block distortion caused by excessive compression of the still image data 140.
[0053]
FIG. 16 is a diagram illustrating an operation for restoring data from a compressed state to a state before being compressed. When the edit menu 83 is clicked, a restore menu item 148 for returning the edited multimedia document to the state of the previous step, the selected data is reduced and moved to a shared data area generally called a clipboard provided by the OS. A cut-out menu item 149 for copying the selected data to the clipboard, a paste menu item 151 for reading the clipboard area data into the multimedia document, and a delete menu item for deleting the selected data 152 is displayed. When the restoration menu item 148 is clicked, it is restored to the data before compression stored in the multimedia data temporary storage means 203.
[0054]
FIG. 17 shows a screen display after restoration. Although the block distortion 147 is eliminated, the data capacity is restored and the display of the total data capacity display 98 is again reversed.
[0055]
18, 19, 20, and 21 are diagrams for explaining an editing procedure for deleting an unnecessary area from the moving image data. In FIG. 18, 154 is a reverse playback button for reversely playing back the moving image data 145, 156 is a stop button for stopping the playback and stopping the image, 157 is a playback button for playing back the moving image data, and 158 is a playback in the moving image data. It is a playback position designation slide bar for designating a start position. The first screen of the unnecessary area is designated by dragging the reproduction position designation slide bar 158 with the mouse cursor. Next, while pressing a predetermined key (for example, a shift key) on the keyboard 118, the playback position designation slide bar 158 is dragged until the last screen of an unnecessary area appears. At that time, the screen display is as shown in FIG. 19, and a selection data range display 159 is selected and displayed as an unnecessary area in the moving image data, and the data capacity of the selected range is calculated. The means 51 calculates and displays it on the selected data capacity display 99. Next, when the delete menu item 152 is clicked from the edit menu 83, the selected unnecessary data area is deleted from the moving picture data 145, and the data one frame before the deleted area is displayed in the moving picture data 145 display area as shown in FIG. Is displayed. Further, since the total data capacity becomes equal to or less than the set capacity, the determination state of the total data capacity display 99 is cancelled.
[0056]
The edited multimedia document edited as described above is stored in the multimedia document file 6 by the multimedia document writing means 54. Data indicating the structure of the multimedia document stored in the multimedia document editing information storage means 34 is stored in the multimedia document structure data 7. After the offset to the multimedia document structure data 7 (file name if the multimedia document structure data 7 is a separate file) is recorded in the multimedia document structure data address storage means 73 of the multimedia document control core program 4 The multimedia document control core program 8 is stored in the multimedia document file 6. A library necessary for reproducing a multimedia document is selected from the multimedia data control library group 5 from the multimedia data control library table 36 and written in the library subset 9 for reproducing multimedia data. The processed multimedia data finally used from the multimedia data temporary storage means 203 is written into the multimedia data group 10.
[0057]
FIG. 27 is a diagram showing the configuration of a multimedia document playback system. In FIG. 27, 600 is a multimedia document playback system, 200 is an OS, 201 and 202 are software added to the OS so that the OS can play back multimedia data, 201 is a multimedia data playback core program, Reference numeral 202 denotes a library subset for controlling multimedia data. Reference numeral 6 denotes a multimedia document file created by an editor. Multimedia document structure data 7 indicating the arrangement of each multimedia data in the multimedia document, multimedia document control core program 8, multimedia data control library subset 9 The multimedia data group 10. In FIG. 27, the multimedia data control core program 201 and the multimedia data control library subset 202 have a video and audio playback function in a format supported by the OS as standard, but videos, audio, still images, and illustrations in different formats can be displayed. Cannot be used if included in the document. FIG. 26 shows a flowchart for reproducing a multimedia document created by the system of the present invention.
[0058]
At the time of reproduction, when the multimedia document control core program 8 is first activated in step S516 in FIG. 26, the multimedia document structure data 7 is read from the information stored in the multimedia multimedia document structure data address storage means 73 in step S517 in FIG. In step S518 in FIG. 26, the multimedia data attribute analysis unit 33 analyzes the attribute information. In step S519 in FIG. 26, the multimedia document display unit 50 uses the analyzed attribute information to convert a library required for display into the multimedia data playback. Linking dynamically from the library subset 9, the multimedia data is read from the multimedia data group 10 in step S520 of FIG. 26, and the multimedia document is displayed.
[0059]
As described above, in the multimedia document editing system according to the present embodiment, a library having means necessary for reproducing and displaying the multimedia data included in the edited document is selected from the library group and automatically written in the document file. By having the means, display reproduction is possible even if the reproduction side computer has no reproduction means for the corresponding multimedia format. In addition, there is an effect of preventing an increase in the capacity of a file for writing by selecting only a library necessary for display and reproduction of multimedia data in a format appearing in the multimedia document.
[0060]
Further, in the multimedia document editing system of this embodiment, information on the capacity of the data and playback means necessary for playing back the data is displayed during editing of the multimedia document, and the capacity set in advance during editing is displayed. If it exceeds the limit, a warning is displayed and a means for compressing the data so as to be less than the preset capacity is provided. This has the effect of improving the efficiency of editing to fit within the predetermined file capacity.
[0061]
The present invention may be applied to a system composed of a plurality of devices or an apparatus composed of one device. Needless to say, the present invention can also be applied to a case where the present invention is achieved by supplying a program to a system or apparatus.
[0062]
【The invention's effect】
As described above, the multimedia document editing method and apparatus according to the present invention has means for selecting a library having means necessary for reproducing and displaying the included multimedia data from the library group and automatically writing it to the document file. Thus, display reproduction is possible even if there is no reproduction means for the corresponding multimedia format on the reproduction side. In addition, there is an effect of preventing an increase in the capacity of a file for writing by selecting only a library necessary for display and reproduction of multimedia data in a format appearing in the multimedia document.
[0064]
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a hardware configuration of a system used for editing and reproduction of a multimedia document according to an embodiment.
FIG. 2 is a diagram illustrating a software configuration of the multimedia document editing system according to the embodiment.
FIG. 3 is a diagram showing a configuration of a multimedia document editing program 3;
FIG. 4 is a diagram showing a configuration of a multimedia data control library group 5;
FIG. 5 is a diagram showing a screen display example when setting for displaying a warning when the file capacity of a multimedia document exceeds a predetermined capacity in the multimedia document editing program 3;
6 is a diagram showing a screen display example when a multimedia document is newly created by the multimedia document editing program 3. FIG.
FIG. 7 is a diagram showing an example of a display screen when designating multimedia material data to be read.
FIG. 8 is a view showing an example of a display screen displayed by the multimedia data attribute changing unit 49 via the multimedia document display unit 50 when changing the display range of the read multimedia material data.
FIG. 9 is a view showing an example of a display screen displayed by the multimedia data attribute changing unit 49 via the multimedia document display unit 50 when the display position of the read multimedia material data is changed.
FIG. 10 is a diagram showing an example of a display screen displayed by the multimedia data attribute changing unit 49 via the multimedia document display unit 50 when inputting characters.
FIG. 11 is a diagram showing an example of a display screen displayed by the multimedia data attribute changing unit 49 via the multimedia document display unit 50 when inputting characters.
FIG. 12 is a diagram showing an example of a display screen when moving image data 145 is further read.
FIG. 13 is a diagram illustrating an operation for performing data compression in order to reduce the data capacity below a set value of the data capacity.
FIG. 14 is a diagram illustrating a display during data compression.
FIG. 15 is a diagram showing a display screen after compression.
FIG. 16 is a diagram illustrating an operation for restoring data from a compressed state to a state before being compressed.
FIG. 17 is a diagram showing a screen display after restoration.
FIG. 18 is a diagram illustrating an editing procedure for deleting an unnecessary area from moving image data.
FIG. 19 is a diagram illustrating an editing procedure for deleting an unnecessary area from moving image data.
FIG. 20 is a diagram illustrating an editing procedure for deleting an unnecessary area from moving image data.
FIG. 21 is a diagram illustrating an editing procedure for deleting an unnecessary area from moving image data.
FIG. 22 is a flowchart showing the operations of the data capacity calculating unit 51 and the data capacity limiting unit 53.
FIG. 23 is a flowchart showing the operations of the data capacity calculation means 51 and the data capacity restriction means 53.
FIG. 24 is a diagram showing the configuration of one multimedia control library.
FIG. 25 is a diagram showing the configuration of multimedia document control core programs 4 and 8. FIG.
FIG. 26 is a flowchart when playing back a multimedia document.
FIG. 27 is a diagram showing a configuration of a multimedia document reproduction system.

Claims (2)

An editing device for multimedia documents including a plurality of types of multimedia data,
Storage means for storing, as a library group, a procedure for outputting at least one kind of data among multimedia data included in the multimedia document;
Selection means for selecting from the libraries based on the attributes of the data the steps necessary to output the data included in the multimedia document,
Multimedia document editing apparatus according to an outputting means for outputting the procedure selected by said selection means into a file together with the data. A method of editing a multimedia document including a plurality of types of multimedia data,
The steps required to output the data included in the multimedia document, based on the attribute of the data, from libraries that stores instructions for outputting at least one data among the multimedia data included in the multimedia document A selection process to select;
Multimedia document editing method according to an outputting step of outputting the procedure selected by said selecting step to a file along with the data.

Images