JPH07271804A - Method and device for editing multimedium document - Google Patents

Abstract

PURPOSE:To simply manage the capacity of a multimedium document. CONSTITUTION:When a document stored in a multimedium document editing information storing means 34 is edited, the capacity of the edited document is calculated by a data capacity calculating means and its value is displayed by a data capacity displaying means. A data capacity controlling means 53 previously stores a set value, compares the stored value with the calculated data, and when the document exceeds the previously set capacity, displays an alarm. A library for reproducing the data of the multimedium document is previously registered in a multimedium data controlling library group 5, and when a document output is instructed, the sort of data included in the document is checked and a library matched with the data sort is selected and dynamically linked to reproduce the data.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION The present invention relates to, for example, characters, still images,
The present invention relates to a multimedia document editing method and device for handling multimedia data such as audio and moving images.

[0002]

2. Description of the Related Art In recent years, with the rapid progress of personal computers, workstations, and networks, documents that were conventionally distributed on paper are
Documents in the form of being distributed via a magnetic recording medium, an optical recording medium, or a network and viewed by a computer are becoming popular. In this type of document, the characters,
Not only still images, but also video and audio can be handled, so the expressiveness is dramatically improved. A document including characters, a still image, a sound, a moving image, etc. is referred to as a multimedia document on the assumption that it is browsed on such a computer. In the past, as a means for editing such a document, there have been many means such as a word processor, which is simply an extension of a conventional editing function for handling characters and still images so that moving image data can be handled.

[0003]

However, the conventional document editing means has the following problems.

(1) When reproducing a multimedia document,
Sometimes it can be played on the computer used for editing but not on another computer.

In particular, data formats such as moving images and voices have various data formats because these data have recently been handled by computers and the technology for compressing these data is under development. Tend to appear one after another.

Therefore, in recent OSs (operating systems), Windows 3.1 of Microsoft Corporation is used.
As described above, with respect to the reproduction of moving images and sounds, the OS side provides a reproducing means, and further, means for adding a reproducing means for various data formats as a library is provided. For example, when a moving image is pasted in a character being created by a word processor, the word processor only provides a rectangular area occupied by the moving image data and does not participate in reproducing the moving image. In this case, there is no problem because the document can be edited without being conscious of the data format of the moving image while the document is being created.However, when the document is played back on another computer, the playback means corresponding to the data format embedded in the document is used. There was a problem that it could not be played at all unless it was installed in the computer used for playback. In addition, a high degree of specialized knowledge is required to determine which format of data reproduction means has been introduced, which has been a factor that impedes the spread of multimedia documents.

(2) It is difficult to store a document within a specific storage capacity.

Video and audio data generally has a large capacity. For example, when data is stored in a floppy disk, the file capacity is checked by a file management program after editing the document, and the data capacity is the capacity of the floppy disk. If it exceeds the limit, it was necessary to re-edit by trial and error several times to fit the data in the capacity of the floppy disk, which was very troublesome.

The present invention has been made in view of the above-mentioned conventional example, and reproduction is possible even if the reproducing computer does not have a reproducing means for the corresponding multimedia format.
Another object of the present invention is to provide a multimedia document editing method and device that prevent an increase in file size.

[0010]

In order to solve the above problem (1), the multimedia document editing apparatus of the present invention has the following configuration. That is, a multimedia document editing apparatus including a plurality of types of multimedia data, a storage unit that stores a procedure for outputting at least one type of multimedia data included in the multimedia document, and a multimedia document. A selection means for selecting a procedure necessary for outputting the data contained therein from the library based on the attribute of the data, and an output means for outputting the data according to the procedure selected by the selection means.

The multimedia document editing method of the present invention has the following configuration. That is, a method of editing a multimedia document including a plurality of types of multimedia data, the storing process storing a procedure for outputting at least one type of multimedia data included in the multimedia document; A selection step of selecting a procedure required for outputting the data contained therein from the library based on the attribute of the data, and an output step of outputting the data according to the procedure selected by the selecting means.

In order to solve the above problem (2), the multimedia document editing apparatus of the present invention has the following configuration. That is, an editing apparatus for a multimedia document including a plurality of types of multimedia data, the editing means for editing the multimedia document, the setting means for presetting the size of the document to be edited by the editing means, and the editing means. Calculating means for calculating the size of the document edited by the means, comparing means for comparing the size of the document set by the setting means with the size of the document calculated by the calculating means, and comparison by the comparing means As a result, if the calculated document is larger, a warning means for outputting that effect is provided.

According to another aspect, there is provided a multimedia document editing apparatus including a plurality of types of multimedia data, wherein the input means inputs an instruction of an operator, and the editing means edits the multimedia document. Setting means for presetting the size of the document to be edited by the editing means,
Judgment means for judging compressible data in the document based on an attribute of data contained in the document edited by the editing means, and judgment means for judging if the input means gives a compression instruction. The compressed data is compressed so that the document becomes smaller than the size set by the setting unit.

The multimedia document editing method of the present invention has the following configuration. That is, a method of editing a multimedia document including a plurality of types of multimedia data, the storing process storing a procedure for outputting at least one type of multimedia data included in the multimedia document; A selection step of selecting a procedure necessary for outputting the data contained therein from the library based on the attribute of the data, and an output step of outputting the data according to the procedure selected by the selecting means. Characteristic multimedia document editing method.

According to another aspect, there is provided a method of editing a multimedia document containing a plurality of types of multimedia data, the editing step comprising: editing the multimedia document;
A setting step of presetting the size of the document to be edited in the editing step, a calculation step of calculating the size of the document edited in the editing step, and a size of the document set in the setting step and the calculating step. A comparison step of comparing the size of the document calculated by the above step and a warning step of outputting that the calculated document size is larger as a result of the comparison by the comparison step is output.

According to another aspect, there is provided a method of editing a multimedia document including a plurality of types of multimedia data, the input step of inputting an operator's instruction, and the editing step of editing the multimedia document. A setting step of presetting the size of the document to be edited in the editing step,
A determining step of determining compressible data in the document based on an attribute of data included in the document being edited in the editing step, and a determining step in the case of a compression instruction given in the input step And compressing the created data so that the document becomes smaller than the size set by the setting step.

[0017]

With the above configuration, the procedure that requires the output is selected according to the format of the data to be output, and the data is output using the procedure. Also, the size of the document being edited is calculated and displayed, and compared with a preset value, a warning is issued if the size is larger than that.

[0018]

FIG. 1 is a diagram showing a hardware configuration of a system used for editing and reproducing a multimedia document according to this embodiment. The configuration shown in FIG. 1 can be configured as a dedicated machine, or can be configured using a personal computer, a workstation, and peripheral devices.

In FIG. 1, 101 is a C for data processing.
PU, 102 is a main memory used for temporary storage of data processed by the CPU 101, 103 is a ROM for storing read-only programs and data, and 104 is a CPU
A data bus, which is a communication path for data between
Is a display control unit for displaying data on the screen, 106
V stores the screen display data sent from the display controller
A RAM 107 is a DA converter that converts the data stored in the VRAM 106 into analog data, and a display 108 is a display that displays screen display data. 110 is a hard disk memory for storing data permanently or temporarily, and 109 is a hard disk memory 110.
To a data bus 104, a hard disk interface 112, a hard disk memory 110
Similarly, a memory card for permanently or temporarily storing data, and a memory card interface unit 111 for connecting the memory card 112 to the data bus 104. Reference numeral 114 is a network such as EtherNet, and 113 is the network 114 connected to the data bus 104.
Is a network interface unit for connecting to. Reference numeral 116 is a floppy disk device for storing data permanently or temporarily, and 115 is a floppy disk interface unit for connecting the floppy disk device 116 to the data bus 104. Reference numeral 118 is a keyboard, and 117 is a keyboard 1.
A keyboard interface unit for connecting 18 to the CPU 101. Reference numeral 120 is a mouse, and 119 is a mouse interface unit for connecting the mouse 120 to the CPU 101. 122 is a microphone for inputting audio data, 123 is a speaker for reproducing audio data, 121 is a microphone 122, speaker 123
Is a sound interface unit for connecting to the data bus 104.

FIG. 2 is a diagram showing the software configuration of the multimedia document editing system of this embodiment.

In FIG. 2, reference numeral 1 is a multimedia document editing system, 200 is an OS, and 201 and 202 are OS20.
Reference numeral 0 is software added to the OS for reproducing multimedia data, 201 is a multimedia data reproducing core program, and 202 is a multimedia data control library subset. Under such an OS with expanded multimedia functions, for example, when moving image data is embedded in a document created by a word processor, when a viewer of the document instructs reproduction of the moving image data, the multimedia data reproducing core program 20 is first executed.
1 is activated, and a program required for reproducing moving picture data of a format instructed to be reproduced is dynamically linked from the multimedia data control library subset 202 to reproduce the moving picture data (dynamically. For links, see Microsoft Windows Programmer's Reference). Therefore, the moving image data can be reproduced even if the word processor itself does not have the reproducing function of the moving image data.

Reference numeral 2 denotes a multimedia document editing software group, which is a multimedia document editing program 3 for editing a document containing multimedia data, and a multimedia document control core which analyzes the structure of a multimedia document and serves as the core of browsing means. The program 4 is composed of a multimedia data control library group 5 that is a collection of various multimedia data control libraries required for processing and reproducing multimedia data that may be handled in a multimedia document. To be done.

Reference numeral 11 denotes a multimedia material data group, which includes first text data 12 to i-th text data 1
I character data group up to 3, j moving image data group from first moving image data 14 to jth moving image data 17, k still images from first still image data 20 to kth still image data 21 A data group, 1 voice data group from the first voice data 14 to the 1st voice data 15, and m illustration data groups from the first illustration data (line drawing data) 18 to the mth illustration data 19 ing. These material data are data collected by various editors of multimedia documents by various means, and often include various data formats.

Reference numeral 6 denotes a multimedia document file created by the editor using the multimedia document editing program 3, and includes multimedia document structure data 7 indicating the arrangement of each multimedia data in the multimedia document, a multimedia document control core. Program 8 (usually the multimedia document control core program 4 is copied as it is), multimedia control library subset 9
(Only the library necessary for reproducing the data embedded in the multimedia document is selected from the multimedia data control library group 5) and the data selected and processed from the multimedia material data group 11 to be embedded in the document. It is composed of a multimedia data group 10.

FIG. 3 is a diagram showing the structure of the multimedia document editing program 3. In FIG. 3, reference numeral 31 is a multimedia document reading means, which reads the edited multimedia document file 6 stored in the hard disk memory 110 or the like. Reference numeral 32 is a multimedia data reading means for reading the data desired to be embedded in the document from the multimedia material data group 11. Reference numeral 33 is a multimedia data attribute analyzing means, which analyzes the multimedia document structure data 7 if the read data is multimedia document data and stores it in the multimedia document edit information storage means 34, and the read data is multimedia. If it is material data, the attribute information of multimedia is stored in the multimedia document edit information storage means 34 by analyzing the header information and the like. Since the multimedia attribute analysis means 33 is actually included in the multimedia control core program 4, when using the function, the multimedia document editing program control means 30 instructs the multimedia control core program 4 to perform the processing. . The multimedia material data included in the read multimedia document and the multimedia material data directly read are stored in the multimedia data temporary storage means 203.

Multimedia document editing information storage means 34
Is a multimedia document background information 35 indicating the background color and pattern of the multimedia document, and a multimedia data control library table 36 indicating a list of libraries necessary for reproducing and processing the multimedia material data embedded in the multimedia document. , Page q multimedia document attribute information 38 to page q multimedia document attribute information 38.

The multimedia document attribute information for one page includes the first multimedia data attribute information and the first multimedia document control information 46 which is information for controlling the document such as display of related data and page feed. It is composed of p multimedia document control information up to p multimedia document control information 47.

One piece of multimedia data attribute information is, like the first multimedia data attribute information, a data ID 40 for identifying multimedia data and a data type 4 for specifying the format of multimedia data.
1. Display position rectangle information 42 indicating display position and size of multimedia data, data control procedure 43 indicating procedure of displaying multimedia data, related data ID 44, multimedia document data file 6 of multimedia data It is composed of in-file position information 37 showing the position and size in the file.

Reference numeral 50 denotes a multimedia document display means for displaying the multimedia document on the display 108 based on the information in the multimedia document edit information storage means 34. Since the multimedia document display means 50 is actually included in the multimedia control core program 4, the multimedia document editing program control means 30 instructs the multimedia control core program 4 to perform the processing when using the function. .

Multimedia document control core program 4
Is the data type 4 in the multimedia data attribute information 39
The library corresponding to 1 is determined from the multimedia data control library table 36, the required library is selected from the multimedia data control library group 5, and the multimedia data is displayed or reproduced by dynamically linking.

The multimedia data attribute changing means 49 changes the information in the multimedia document edit information storage means 34 according to an instruction from the mouse 120 or the keyboard 118, and reflects the change result on the display 108 via the multimedia document display means 50. Let

Since the multimedia data attribute changing means 49 is actually included in the multimedia control core program 4, when the function is used, the multimedia document editing program control means 30 causes the multimedia control core program 4 to perform the processing. Command to do.

Multimedia document control core program 4
Determines a library corresponding to the data type 41 in the multimedia data attribute information 39 from the multimedia control library table 36, selects a required library from the multimedia data control library group 5, and dynamically links it. Change the attributes of multimedia data with.

Reference numeral 51 is a data capacity calculating means, which calculates the data capacity of the multimedia document from the information in the multimedia document edit information storage means 34 and displays it on the data capacity display means 52. The data capacity of the multimedia document includes the capacity when the multimedia document structure data 7, that is, the content of the multimedia document edit information storage means 34 is filed, the file capacity of the multimedia document control core program 8, and the multimedia document. The file capacity of the multimedia data group 10 used therein and the file of the multimedia data reproducing library set 9 which is a subset of the multimedia controlling library group 5 necessary for displaying and reproducing the data of the multimedia data group 10 Includes capacity. Also, the data capacity calculation means 5
Reference numeral 1 designates a multimedia data attribute changing means 4 for changing the capacity of multimedia data selected as an editing target by an instruction of the mouse 120 or the keyboard 118 during the editing work.
9 and displays it on the data capacity display means 52.

Reference numeral 53 is a data capacity control means for comparing with a predetermined capacity value designated in advance by the editor,
If the multimedia document being edited exceeds the capacity value, a warning is displayed. Also, the data capacity control means 5
Reference numeral 3 also has a function of compressing multimedia data so that the multimedia document falls below the capacity value according to an editor's instruction. When the data compression is instructed, the data capacity limiting unit 53 instructs the multimedia document control core program 4 to compress the data. The multimedia document control core program 4 dynamically links the library required for data compression of the multimedia data contained in the multimedia document being edited from the multimedia data control library group 5 to compress the multimedia data. To do. The compressed multimedia data is stored again in the multimedia data temporary storage means 203,
Since the image quality is deteriorated by irreversible compression, the data before compression is also retained so that it can be returned to the state before compression.

Reference numeral 54 is a multimedia document writing means for writing the edited result in the multimedia document file 6. Reference numeral 30 denotes a multimedia document editing program control means for controlling the entire operation of the multimedia document editing program 3.

FIG. 25 is a diagram showing the structure of the multimedia document control core programs 4 and 8. The multimedia data attribute analyzing unit 33, the multimedia document displaying unit 50, the multimedia data attribute changing unit 49, and the multimedia document structure are shown in FIG. It comprises a data address storage means 73.

FIG. 4 is a diagram showing the structure of the multimedia data control library group 5, which shows r still image formats from the first still image format control library 60 to the rth still image format control library 61. From a library group for controlling still image data, a library group for controlling the operation of s moving image formats from the first moving image format control library 62 to the sth moving image format display means 63, and a first audio format control library 64. A library group for controlling sounds of t audio formats up to the t-th audio format control library 65 and illustrations of u illustration formats from the first illustration format control library 66 to the u-th illustration format control library 67 are displayed. Library to control It consists of.

FIG. 24 is a diagram showing the configuration of one multimedia control library. Reference numeral 68 denotes a multimedia data control library, which is a multimedia data display unit 69 for displaying multimedia data, a multimedia data reproducing unit 70 for reproducing a moving image or audio data in a predetermined sequence, and compressing the data. And a data means such as a multimedia decompression means 72 for decompressing and extracting compressed data from the file.

FIG. 5 shows an example of a screen display when setting for displaying a warning when the file size of a multimedia document exceeds a predetermined size in the multimedia document editing program 3. In FIG. 5, reference numeral 80 is a window of the multimedia document editing program 3. 81
Is a mouse cursor for pointing a specific portion of the screen with the mouse 120. The mouse is provided with a button, and the operation of the user pressing and releasing the button is generally referred to as clicking, and the operation of clicking twice within a predetermined interval is referred to as double-clicking. In addition, it is said that the action of moving the mouse while pointing the characteristic position and holding down the mouse button there is dragged. Reference numeral 82 is a file menu mainly containing commands related to file operations, 83 is an editing menu mainly containing commands related to editing operations on specific data, and 84 is a setting menu mainly containing commands related to setting. . When the setting menu 84 is clicked with the mouse cursor 81, a setting dialog 85 is displayed. A data capacity limit value input field 86 allows a desired limit value of the data capacity of the multimedia document to be directly input from the keyboard 118. 87 is a data capacity calculation option setting button area.

Only one of the buttons 88 and 89 can be selected. When the button 88 is selected, the data capacity is calculated including the capacity of the multimedia core program 8 and the multimedia data reproducing library subset 9. However, when the button 89 is selected, the calculation is performed without including the capacities of the multimedia core program 8 and the multimedia data reproducing library subset 9. Reference numeral 90 denotes an approval button. When the approval button 90 is clicked, the setting becomes effective and the setting dialog 85 is hidden.

FIG. 22 is a diagram showing a multimedia document editing system according to the present invention, which monitors the change in the data volume of the multimedia document due to the user's data import operation when the multimedia document is edited, and is preset by the user. It is a flow chart explaining the operation at the time of issuing a warning when the capacity is exceeded. In addition, FIG. 23 shows that, in the multimedia document editing system of the present invention, when the multimedia document is edited, a change in the data volume of the multimedia document due to the user's operation of designating the trimming range is monitored and predetermined by the user. It is a flow chart explaining the operation at the time of issuing a warning when the capacity is exceeded. The operation of the steps shown in FIGS. 22 and 23 will now be described with reference to other drawings.

FIG. 6 is a diagram showing a screen display example when a multimedia document is newly created by the multimedia document editing program 3. When the file menu 92 is clicked in FIG. 6, a list of file-related command items is displayed. Reference numeral 91 denotes a newly created menu item, and since FIG. 6 shows the screen after selecting the newly created menu item 91, an untitled multimedia document edit window 204 is displayed. At this time, the inside of the multimedia document window 204 is filled with the default background color, and the background information is stored in the multimedia document background information 35. Reference numeral 92 is a multimedia document reading menu item. Reference numeral 93 is a multimedia data read menu item for selecting from the multimedia data group 10 the multimedia material data to be included in the multimedia document. 9
Reference numeral 4 denotes a compression menu item for compressing the multimedia material data so that the multimedia material data is stored within the set value of the data capacity set in the description of FIG. Reference numeral 95 denotes a "rename and save" menu item for renaming and saving the edited multimedia document in a file. Reference numeral 96 is a save menu item for saving the edited multimedia document in a file. Reference numeral 97 is an end menu item for ending the program. Reference numeral 98 denotes a total data capacity display for displaying the total value of the data capacity of the multimedia document, and the data capacity display means 52 displays the value calculated by the data capacity calculation means 51. Since the multimedia data group 10 and the multimedia data reproducing library subset 9 are empty when newly created, only the total capacity of the multimedia document control core program 8 and the multimedia document structure data 7 is displayed. That is, step S50 in FIG.
As 1, the total capacity is calculated and displayed as the capacity addition value of the background data and the multimedia data document control core program.

Steps S502 and S509 in FIG. 22 are common steps for designating the data to be imported into the multimedia document to be edited, and FIG. 7 is a display for designating the multimedia material data to be read in the step. It is a screen example. Reference numeral 130 denotes a read multimedia data selection dialog, which is displayed by clicking a multimedia data read menu item in FIG. Reference numeral 131 is a disk drive specification list that specifies a disk drive, 132 is a directory specification list that specifies a directory, 133 is a format specification list that specifies the format of multimedia data, and 134 is a file name specification list that specifies a file name.

Since the file name specified in the file name specification list 134 is displayed in the file name input field 135, the read multimedia data selection dialog 130 is hidden by clicking the read button 136, and the specified multimedia material data is displayed. The file is read by the multimedia material data reading means 32. At the time of reading the designated multimedia material data, the multimedia data attribute analysis unit 33 analyzes the attributes of the multimedia data from the header information and the like and stores them in the multimedia document edit information storage unit 34 as described with reference to FIG. At this time, the data ID 40 is provided with an identification number by which the multimedia data attribute information analysis means 33 can uniquely identify the multimedia material data in one multimedia document. Further, the multimedia data control library table 36 stores the multimedia data control library name necessary for displaying and editing the read data together with the entry number. The data control procedure 43 stores a list of means necessary for displaying and editing the read multimedia data and the entry number in the multimedia control library table 36 of the multimedia data control library name including these means. .

FIG. 8 shows an example of a display screen displayed by the multimedia data attribute changing means 49 via the multimedia document display means 50 when changing the display range of the read multimedia material data. Reference numeral 140 is the read still image data. Fig. 22 at the time of reading
The data capacity of the still image data 140 imported to the total capacity of the multimedia document in step S503 is calculated by the data capacity calculation means 51. In step S504 of FIG. 22, it is determined by the multimedia data attribute analysis means whether or not a new multimedia data control means is necessary for displaying the still image data 140, and if necessary, FIG.
In step S505, the data capacity calculation means 51 adds the newly required library capacity to the total capacity of the data and displays the total capacity on the total capacity display 98. In step S506 of FIG. 22, the data capacity control means 53 determines whether the preset data capacity is exceeded.
At that time, when the preset data capacity is exceeded, a warning is displayed in step S507 in FIG. 22, and when the data capacity is not exceeded, no warning is displayed in step S508 in FIG. As an example of a warning display, the total capacity display 98 in FIG. 141 is an outer frame of the still image data. When an arbitrary point on the still image data 140 is clicked, the outer frame 141 is displayed in a thick line, which indicates that the still image data 140 is selected as an edit target. At that time, the data capacity of the data selected in step S510 of FIG. 23, that is, the still image data 140 is calculated by the data capacity calculation means 51,
It is displayed on the selected data capacity display 99. When the mouse cursor 81 is placed on the outer frame 141 of the still image data, the mouse cursor 81 has a double-headed arrow shape.
The size of 41 changes. The operation of specifying the data trimming range corresponds to step S511 in FIG. Frame 141
The data capacity calculation means 51 recalculates the data capacity in accordance with the size of, and reflects it on the selected data capacity display 99. Frame 1
Only the data in the area enclosed by 41 is saved in the final multimedia document. Further, the data capacity of the still image data 140 and the capacity of the multimedia data control library subset 9 required for displaying the still image data 140 are added to the total data capacity display 98. Figure 23 here
In the determination step of step S513, the data capacity limiting means 53 determines that the total data capacity does not exceed the set value of the data capacity, and the data capacity limiting means 53 does not display the warning in the warning non-display step of step S515 in FIG.

FIG. 9 shows an example of a display screen displayed by the multimedia data attribute changing means 49 via the multimedia document display means 50 when changing the display position of the read multimedia material data. Here, the display range of the still image data 140 is reduced by the operation described in FIG. 8, and the value of the selected data capacity display 99 is smaller than that in FIG. The shape of mouse cursor 81 is frame 1
Inside 41, the shape changes as shown in FIG. The display position of the still image data 140 can be changed by dragging in that state. Coordinates P1 (x1, y1) and P2 (x2, indicating the display position and display range of the still image data 140)
y2) is sequentially reflected on the display position rectangle information 42 of the still image data 140 by the multimedia data attribute changing means 49.

10 and 11 show examples of display screens displayed by the multimedia data attribute changing means 49 via the multimedia document display means 50 when inputting characters. In FIG. 10, reference numeral 142 denotes a character input tool icon, and at the same time when the character input tool icon is clicked, the mouse cursor has a shape similar to the cursor 81 shown in FIG. 11, and the character string 144 can be input to the multimedia document window 204. become. At this time, the still image data 140 is automatically in the non-selected state and becomes a thin line. When the multimedia data such as the character string 144 is directly input, the multimedia data attribute changing unit 49 newly creates the nth multimedia data attribute information 46.

FIG. 12 shows an example of a display screen when moving image data 145 is further read. Here, when it is detected that the total data capacity exceeds the set value of the data capacity, the data capacity limiting means 53 reversely displays the display of the total data capacity display 98 as a warning display.

22 and 23 are flowcharts showing the operations of the data capacity calculating means 51 and the data capacity limiting means 53 described above.

FIG. 13 shows an operation for performing data compression in order to reduce the data capacity below the set value of the data capacity. When the compression menu item 94 as shown in FIG. 13 is clicked, the data capacity limiting means 53 searches for compressible data from all multimedia data attribute information represented by the first multimedia data attribute information 38,
The multimedia document control core program 4 is instructed to compress the corresponding multimedia data. The multimedia document control core program 4 obtains the data compression means 71 by searching a required library from the multimedia control library table 36 and dynamically linking it.
Compress the corresponding compressed data so that the data size of the multimedia document is less than or equal to the set value of data size. The compressed data is stored in the multimedia data temporary storage means 203, but the data before compression is also stored as it is.

FIG. 14 is a view showing a display during data compression, and a compression progress display 146 showing that the data is being compressed is displayed. FIG. 15 is a diagram showing a display screen after compression.
As a result of the compression, as shown in the total data capacity display 98, the total data capacity has become less than or equal to the set value, so the data capacity control means 53 cancels the reverse display for a warning. The data once stored in the multimedia data temporary storage means 203 is expanded and displayed by the corresponding data reproducing means included in the multimedia control library group 5. Reference numeral 147 is a block distortion caused by excessively compressing the still image data 140.

FIG. 16 is a diagram showing an operation for restoring the data from the compressed state to the state before being compressed.
When the edit menu 83 is clicked, a restore menu item 148 for returning the edited multimedia document to the state of the previous step, reducing the selected data and moving to a shared data area generally provided by the OS called a clipboard. Cut menu item 149 for copying, Copy menu item 150 for copying the selected data to the clipboard, Paste menu item 1 for reading the data in the clipboard area into the multimedia document
51, a delete menu item 152 for deleting the selected data is displayed. When the restore menu item 148 is clicked, the data before compression stored in the multimedia data temporary storage means 203 is restored.

FIG. 17 shows a screen display after restoration. Although the block distortion 147 is eliminated, the data capacity also returns to the original value, so that the display of the total data capacity display 98 is highlighted again.

18, FIG. 19, FIG. 20, and FIG. 21 are diagrams for explaining the editing procedure for deleting an unnecessary area from moving image data. In FIG. 18, 154 is moving image data 145.
Reverse playback button for reverse playback, 156 is a stop button for stopping playback and stopping images, 157 is a playback button for playing video data, and 158 is a playback position designation for designating a playback start position in the video data. It is a slide bar. The first screen of the unnecessary area is designated by dragging the playback position designation slide bar 158 with the mouse cursor. Next, while pressing a predetermined key (eg, shift key) on the keyboard 118, the playback position designation slide bar 158 is dragged until the last screen of the unnecessary area appears. At that time, the screen display becomes as shown in FIG. 19, and the selected data range display 159 showing the data range selected as an unnecessary area in the moving image data is judged and displayed, and the data capacity of the selected range is calculated. The means 51 calculates and displays it on the selected data capacity display 99. Next, when the delete menu item 152 is clicked from the edit menu 83, the unnecessary data area selected is the moving image data 1
The data one frame before the area deleted from 45 and deleted as shown in FIG. 2 is displayed in the display area of the moving image data 145. Further, since the total data capacity has become less than or equal to the set capacity, the judgment state of the total data capacity display 99 is canceled.

The edited multimedia document edited as described above is stored in the multimedia document writing means 5 as described above.
4 is stored in the multimedia document file 6. The data indicating the structure of the multimedia document stored in the multimedia document editing information storage means 34 is stored in the multimedia document structure data 7. After the offset to the multimedia document structure data 7 (the file name when the multimedia document structure data 7 is a separate file) is recorded in the multimedia document structure data address storage means 73 of the multimedia document control core program 4. The multimedia document control core program 8 is stored in the multimedia document file 6. A library required for reproducing the multimedia document is selected from the multimedia data control library group 5 from the multimedia data control library table 36 and written in the multimedia data reproduction library subset 9. The processed multimedia data finally used is written from the multimedia data temporary storage means 203 to the multimedia data group 10.

FIG. 27 is a diagram showing the structure of a multimedia document reproducing system. In FIG. 27, 600 is a multimedia document reproducing system, 200 is an OS, 20
Reference numerals 1 and 202 are software added to the OS for the OS to reproduce multimedia data, 201 is a multimedia data reproducing core program, and 202 is a multimedia data control library subset. Reference numeral 6 denotes a multimedia document file created by an editor, which includes multimedia document structure data 7 indicating the arrangement of each multimedia data in the multimedia document, a multimedia document control core program 8, and a multimedia data control library subset 9. , Multimedia data group 10. In FIG. 27, the multimedia data control core program 201 and the multimedia data control library subset 202 have a playback function for moving images and sounds in formats that the OS supports as standard, but moving images, sounds, still images, and illustrations in different formats are If it is included in the document, it cannot be used. FIG. 26 shows a flowchart for reproducing a multimedia document created by the system of the present invention.

At the time of reproduction, first, the multimedia document control core program 8 is started in step S516 in FIG. 26. In step S517 in FIG. 26, the multimedia multimedia document structure data address storage means 7 is started.
The multimedia document structure data 7 is read from the information stored in 3, and the multimedia data attribute analysis unit 33 analyzes the attribute information in step S518 of FIG.
In step S519 of FIG. 26, the library required for display by the multimedia document display means 50 is dynamically linked from the multimedia data reproducing library subset 9 based on the analyzed attribute information.
At, the multimedia data is read from the multimedia data group 10 and the multimedia document is displayed.

As described above, in the multimedia document editing system according to the present embodiment, a library having means necessary for reproducing and displaying the multimedia data included in the edited document is selected from the library group and automatically converted into a document file. By providing a means for physically writing, the display side can be reproduced even if the reproducing side computer does not have a reproducing means for the corresponding multimedia format. Further, there is also an effect of preventing an increase in the file capacity for writing by selecting only the library necessary for displaying and reproducing the multimedia data of the format that appears in the multimedia document.

Further, in the multimedia document editing system of the present embodiment, information concerning the capacity of the data and the reproducing means necessary for reproducing the data is displayed during the editing of the multimedia document, and is preset during the editing. When the size exceeds the specified size, a warning is displayed, and a means for compressing the data so that the size is equal to or smaller than the preset size is provided, so that there is an effect that the work of editing the data so that the data fits into the predetermined file size becomes efficient.

The present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. Further, it goes without saying that the present invention can be applied to the case where it is achieved by supplying a program to a system or an apparatus.

[0062]

As described above, according to the multimedia document editing method and apparatus of the present invention, a library having means necessary for reproducing and displaying the contained multimedia data is selected from the library group and the document file is automatically created. By having the writing means, the display side can be reproduced even if the reproducing side does not have the reproducing means for the corresponding multimedia format. Further, there is also an effect of preventing an increase in the file capacity for writing by selecting only the library necessary for displaying and reproducing the multimedia data of the format that appears in the multimedia document.

In addition, the multimedia document editing system of the present invention displays information relating to the capacity of the data and the reproducing means necessary for reproducing the data during editing of the multimedia document, and preset during editing. When the capacity is exceeded, a warning is displayed and the data is compressed so that the capacity is equal to or less than the preset capacity, thereby improving the efficiency of the editing work so that the file can be stored in a predetermined file capacity.

[0064]

[Brief description of drawings]

FIG. 1 is a diagram showing a hardware configuration of a system used for editing and reproducing a multimedia document according to an embodiment.

FIG. 2 is a diagram showing a software configuration of a multimedia document editing system according to an embodiment.

FIG. 3 is a diagram showing a configuration of a multimedia document editing program 3.

FIG. 4 is a diagram showing a configuration of a multimedia data control library group 5.

FIG. 5 is a diagram showing an example of a screen display when making settings for displaying a warning when the file size of a multimedia document exceeds a predetermined size in the multimedia document editing program 3.

6 is a diagram showing a screen display example when a multimedia document is newly created by the multimedia document editing program 3. FIG.

FIG. 7 is a diagram showing an example of a display screen when designating multimedia material data to be read.

FIG. 8 is a diagram showing an example of a display screen displayed by the multimedia data attribute changing unit 49 via the multimedia document display unit 50 when changing the display range of the read multimedia material data.

FIG. 9 is a diagram showing an example of a display screen displayed by the multimedia data attribute changing unit 49 via the multimedia document display unit 50 when changing the display position of the read multimedia material data.

FIG. 10 shows a multimedia data attribute changing means 49,
Multimedia document display means 50 when inputting characters
It is a figure of the example of a display screen displayed via.

FIG. 11 shows a multimedia data attribute changing unit 49,
Multimedia document display means 50 when inputting characters
It is a figure of the example of a display screen displayed via.

FIG. 12 is a diagram showing an example of a display screen when moving image data 145 is further read.

FIG. 13 is a diagram showing an operation for causing data compression to reduce the data capacity to a value equal to or smaller than the set value of the data capacity.

FIG. 14 is a diagram showing a display during data compression.

FIG. 15 is a diagram showing a display screen after compression.

FIG. 16 is a diagram showing an operation for restoring a data from a compressed state to a state before being compressed.

FIG. 17 is a diagram showing a screen display after restoration.

FIG. 18 is a diagram illustrating an editing procedure for deleting an unnecessary area from moving image data.

FIG. 19 is a diagram illustrating an editing procedure for deleting an unnecessary area from moving image data.

FIG. 20 is a diagram illustrating an editing procedure for deleting an unnecessary area from moving image data.

FIG. 21 is a diagram illustrating an editing procedure for deleting an unnecessary area from moving image data.

FIG. 22 is a flowchart showing the operations of the data capacity calculating means 51 and the data capacity limiting means 53.

FIG. 23 is a flowchart showing the operations of the data capacity calculating means 51 and the data capacity limiting means 53.

FIG. 24 is a diagram showing a configuration of one multimedia control library.

FIG. 25 is a diagram showing a configuration of multimedia document control core programs 4 and 8.

FIG. 26 is a flowchart when a multimedia document is reproduced.

FIG. 27 is a diagram showing a configuration of a multimedia document reproduction system.

Claims (12)

[Claims] 1. An apparatus for editing a multimedia document including a plurality of types of multimedia data, wherein the storage means stores a procedure for outputting at least one type of data included in the multimedia document. Selecting means for selecting a procedure required for outputting data included in the multimedia document from the library based on an attribute of the data; and outputting means for outputting the data according to the procedure selected by the selecting means. A multimedia document editing apparatus comprising: 2. The procedure stored in the storage means is immediately stored in an unexecutable state, and the output means converts the procedure into an executable state and outputs data. The multimedia document editing apparatus according to claim 1, characterized in that: 3. An apparatus for editing a multimedia document containing a plurality of types of multimedia data, comprising: editing means for editing the multimedia document; and setting means for presetting the size of the document to be edited by the editing means. Calculating means for calculating the size of the document edited by the editing means; comparing means for comparing the size of the document set by the setting means with the size of the document calculated by the calculating means; If the calculated document is larger as a result of the comparison by the means, the multimedia document editing apparatus is provided with a warning means for outputting that effect. 4. The multimedia document editing apparatus according to claim 3, further comprising display means for sequentially displaying the size of the document calculated by the calculating means. 5. The multimedia document editing apparatus according to claim 4, wherein the warning unit reversely displays the display by the display unit. 6. An apparatus for editing a multimedia document including a plurality of types of multimedia data, comprising: input means for inputting an operator's instruction; editing means for editing the multimedia document; and a document edited by the editing means. Setting means for presetting the size of the data, determination means for determining data compressible in the document based on the attribute of the data included in the document edited by the editing means, and compression by the input means. A multimedia document editing apparatus, comprising: means for compressing the data determined by the determining means so that the document becomes smaller than the size set by the setting means when instructed. 7. A method for editing a multimedia document including a plurality of types of multimedia data, the storing step storing a procedure for outputting at least one type of multimedia data included in the multimedia document. A selection step of selecting a procedure required for outputting data included in the multimedia document from the library based on an attribute of the data; and an output step of outputting the data according to the procedure selected by the selecting means. A method for editing a multimedia document, comprising: 8. The procedure stored in the storage step is immediately stored in an unexecutable state, and the output step converts the procedure into an executable state and outputs data. 8. The multimedia document editing method according to claim 7, wherein. 9. A method of editing a multimedia document containing a plurality of types of multimedia data, comprising: an editing step of editing the multimedia document; and a setting step of presetting the size of the document edited by the editing step. A calculation step of calculating the size of the document to be edited in the editing step; a comparison step of comparing the size of the document set in the setting step with the size of the document calculated in the calculation step; If the calculated document is larger as a result of the comparison by the steps, a warning step of outputting that effect is provided, and a multimedia document editing method. 10. The multimedia document editing method according to claim 9, further comprising a display step of sequentially displaying the size of the document calculated by the calculation step. 11. The multimedia document editing method according to claim 10, wherein the warning step reversely displays the display by the display step. 12. A method of editing a multimedia document including a plurality of types of multimedia data, the input step of inputting an operator's instruction, the editing step of editing the multimedia document, and the document edited by the editing step. A setting step of presetting the size of the data, a determination step of determining compressible data in the document based on the attribute of the data included in the document edited by the editing step, and a compression step performed by the input step. And a step of compressing the data determined in the determination step so that the document becomes smaller than the size set in the setting step, when instructed.