JP2003099424A - Document data structure, storage medium and information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To additionally write in electronic document information. SOLUTION: Document data structure includes digital information files 103 and 104 having document information to be browsed by using a computer and additional writing information additionally written on the document information and stored separately from the document information. A program 105 having an additionally writing function for additionally writing the additional writing information on the document information and a display function for displaying the document information and the additional writing information in a multistoried state is also included in the document data structure.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data structure of a document that can be viewed and managed by a computer (digital information processing device), a storage medium storing the data structure of the document, and an information processing device.

[0002]

2. Description of the Related Art In recent years, various types of documents have been created and are in widespread use as information transmission media that can be browsed using a computer (digital information processing device).
Typical formats of such documents are, for example, text, rich text, multimedia, PDF, HT.
There are ML, MHTML, XML, etc. So first,
An overview of these various types of documents, based on their development history.

[Text, Rich Text, Multimedia] Among digital (electronic) documents that can be handled by a computer (digital information processing apparatus), a typical text document expressing text by a character code, There are rich text documents in which a plurality of character fonts can be used in a text document, and multimedia documents in which figures, images, moving images, voices, etc. can be pasted.

Usually, a text document uses a character code common to general computers. Therefore, in a general computer, the operation system is generally provided with an application software called a text editor capable of browsing and editing such a text document.

When information is sent and received by electronic mail, text information can be sent and received to exchange information, and recently, electronic mail software that can send and receive a document expressed in rich text is also available. It is becoming popular.

On the other hand, a multimedia document has
Although there is no uniform format, at present, the office (product name) including Microsoft's word (product name) is widely used, so this office format is treated as if it were a standard format. It is the current situation.

However, when the office format is used for the multimedia document, the user purchases the application software called Microsoft Office, which has a document creation function, just by browsing the multimedia document. You need to install it on your computer.

[PDF] On the other hand, a PDF format developed by Adobe Systems Incorporated is known as a document format compatible with multimedia documents. This format helps reduce the user's disadvantages seen in the word format by distributing the application for browsing the document for free, while paying the application for creating the document.

[0009] However, although the financial burden on the user for viewing the document is eliminated, the user still needs to install the viewing software of Adobe Co., Ltd. in order to view the PDF document.

[HTML] On the other hand, in recent years, information has been transferred to HTML (Hyper Text Markup) due to the spread of the Internet.
It is common to describe information in a language called "Language" and convey information.

The HTML document initially spread widely as a language used in application software called a navigator developed by Netscape Co., Ltd., and contributed to the rapid spread of the Internet.

[0012] After that, Microsoft Corp. installed the software called Internet Explorer, which uses the HTML language, as a standard in Windows, which is an operating system widely manufactured and sold by itself. This gives the user the impression that it is distributed free of charge, and, unlike the PDF file of Adobe, does not require the user to install the browsing software. Currently, Internet Explorer has exploded and is treated as if it were the standard format for browsing the Internet.

However, such an HTML document has a major drawback as a format for creating an ordinary document because of its occurrence. As a method of browsing documents on the Internet, when the information written in HTML is a document, the user's computer visually displays the document according to the HTML tag rule, whereas when the information is an image. Means that the information of the image does not exist in the displayed HTML information. That is, when the information is an image, only the reference destination and the layout information of the image are described in the HTML information, and the browsing software installed in the user's computer has such a description. Based on the arrangement information, the image data is downloaded from the server to the user's computer and displayed. More specifically, the current HTML document includes text information and arrangement information for laying out each information in the document, but for other images and moving images, refer to the reference destination where they are stored. Just by describing it, the actual image information and moving image information are stored in another place.

Therefore, the installer side of the HTML document is
In order to properly display an image or similar contents in a TML document, there is a complexity that an image file or the like has to be arranged at the reference destination described in the HTML information. In addition, the user who is a viewer of the HTML document needs to pay attention to the positions and names of these reference files in order to correctly handle the HTML document. Then, both the installer side and the user side of the HTML document try to save and manage such a reference file itself, which is extremely complicated.

[MHTML] In order to solve these problems, the Internet standard organization RFC defines MHTM.
The L format is a format format in which multimedia contents are stored together with HTML information. According to the MHTML format, a multimedia document including images and the like can be browsed by browsing software compatible with this standard.

However, MHTML has some problems because it extends HTML.

One of them is not to hold image data and the like as normal binary data but to hold as a character code represented by hexadecimal characters (0 to 9 and A to F). This is because the HTML file described in HTML is constructed so that the description content can be viewed with a text editor.

As another problem, since the MHTML document is stored in the same file as the layout information for displaying the image and the like, it is not possible to easily extract only the image or grasp the description content. There is also a problem.

From the above, at the present time, the document locally used in the personal computer is still a word document, and the document on the Internet is HT.
ML documents are used to separate houses.

[XML] On the other hand, in recent years, XML has been used.
A document format called (Extensible Markup Language) that connects the Internet and a local document has also been proposed.

The advantage of XML is that the user can define a portion corresponding to an HTML tag.
The fact that each software maker describes the data including the document in binary in its own format is that it is described in the text format that can be read and understood by a simple text editor using tags. However, XML defines a method of describing data, and a program for interpreting and executing the program, a program execution environment, and a computer (digital information processing device) are required for actual operation. Therefore, in order to display the document described in XML, a program therefor is required, and even when the same document described in XML is displayed, the display contents will be different if the programs are different. Similarly, a computer (digital information processing device)
The behavior also differs depending on the type of the program and the type of program execution environment.

In other words, in XML, even if the formats of data to be processed can be unified, it is not possible to unify the program and the computer (digital information processing device) for executing the formats.

[Multi-Platform Program Environment] Therefore, at present, a multi-platform program environment that is independent of the type of computer (digital information processing device), in other words, the type of operating system is proposed. Typical examples are JAVA of Sun Microsystems and NET concept of Microsoft. As a result, the document is described in the XML format, and the information described in the multi-platform language such as JAVA is processed, so that the type of computer (digital information processing device) (type of operation system)
There is an environment in which documents can be viewed, created, etc. without depending on.

In Japanese Patent Laid-Open No. 2000-353120, X
A combination of the ML format and JAVA is disclosed. The Japanese Patent Laid-Open No. 2000-353120 discloses that an XML document is read and a program described in JAVA is executed based on the read information.

Japanese Patent Application Laid-Open No. 09-134349 discloses that
It describes a data description in XML format and a document defining the program operation according to the data description.

The examples described in these publications are XML.
A program is started based on the description such as, and thereby multimedia contents and documents are displayed. In other words, the concept is to describe data using a descriptor such as XML for a combination of conventional data and an application that executes the data. As a result, data such as a document can be described in a general-purpose manner, and an application program for displaying a document or the like is created by using JAVA or the like, and a document can be browsed by this application program, so that the document can be displayed on different platforms. Can be viewed.

However, there is a problem in that there is no guarantee that it will operate normally if the application program for displaying a document is installed in a computer (digital information processing apparatus) or if the version of the application program is changed. In other words, when a certain document is desired to be stored for a long period of time, it is necessary to store an application program for displaying it, which is extremely complicated.

Furthermore, the document introduced in the above publication has another problem that a plurality of files make up the document. For this, JP-A-1
Japanese Patent Laid-Open No. 1-143906 discloses storing a plurality of WEB page files in a book format, which is apparently displayed in a book-like format. The contents are not managed as one file.

[0029]

At present, electronic documents represented by digital information have become widespread due to the development of computers and the spread of the Internet. In order to create, edit, save, browse, etc. such an electronic document, the following conditions are required. 1. Hardware (computer) that actually executes processing 1. Operation system (OS) that causes a computer to perform processing 3. Software (application software) for reading and displaying document information, editing, etc. 4. Document information (data file) in which document contents are expressed in a defined digital expression, that is, an electronic document cannot be browsed unless these four conditions are met. Of these four conditions, an operating system such as Windows is installed in the computer, and the computer and the operating system have a one-to-one relationship. Therefore, the user installs a typical application program suitable for the computer and operating system on the computer, and creates and browses documents.

Therefore, when creating, editing, saving, browsing, etc. of electronic documents, compatibility between the computer and operating system and the application programs is important. In other words, when trying to browse a certain document, if the viewer has not installed an application program that is the same as or compatible with the application program used by the creator of the document on his / her computer, he / she can browse the document. Is impossible. In this case, even if a document is created and browsed by the same application program, browsing may not be performed normally if the versions are different. Because of this, handling of electronic documents is extremely inconvenient.

Next, as the document format of the electronic document, as described above, text, rich text, PDF, HT
While there are various formats such as ML, MHTML, XML, etc.
It is no exaggeration to say that it is roughly divided into Microsoft office documents and WEB documents viewed with a WEB browser. However, the office document of Microsoft Corporation has a problem that an office application for browsing the document is required. Also, the WEB document is
Since it is a document specialized for the Internet, there is a problem that a single document is composed of multiple files and management is complicated due to the structure in which multiple files existing on the server are called by a browser and displayed. .

Furthermore, in recent years, due to the rapid spread of computers, especially personal computers, and the improvement of their processing capabilities, digital documents handle not only conventional character representations (texts) but also still images, moving images, and voices. Is becoming possible. Therefore, in a personal computer, it is possible to create and view a document form that mixes a plurality of media in which the document form cultivated in the conventional type document and the image cultivated in radio and television are fused. Has become. Documents of such a form have been distributed and distributed through a global network represented by the Internet today. Such digital documents are
Generally called a multimedia document.

Here, since the multimedia document includes a plurality of media, a plurality of application programs are required for viewing and reproducing the media. In other words, in order to browse and play multimedia documents, 1. Application program required for browsing 2. The same creation and viewing environment is required between the creator and the viewer. Multiple files needed to represent a single document 4. There are many problems such as the need to store an application program for browsing in order to browse the stored past documents. Therefore, it is difficult for general users to handle multimedia documents.

An object of the present invention is to make it possible to browse a desired digital information file without installing a specific operation program file in a computer in advance and preparing the environment.

An object of the present invention is to enable one or more digital information files to be handled as a single document regardless of the format, thereby facilitating document management. Is.

[0036]

According to another aspect of the present invention, there is provided a digital information file having document information browsed by a computer and a document information added and added to the document information. And a program having a editing function of adding the editing information to the document information, and a display function of displaying the document information and the editing information in a layered manner.

Therefore, it is possible to add to the document information, and the added information after the correction is managed separately from the document information, and the document information and the correction information can be used independently.

The invention of the data structure of a document according to claim 2 specifies one or more digital information files which are the representation entities on the document, the structure of the digital information file and the display state on the document. And a display information file that is interpreted and executed by a computer and is specified based on the display information file.
Alternatively, an operation program file including a digital information display program for displaying two or more digital information files on the display of the computer and a function operation program for executing a specific function without referring to the digital information. And the functional operation program is
The digital information file includes a writing function for adding the editing information on the document information included in the digital information file, a display function for displaying the document information and the editing information in a layered manner, and a saving function for saving the editing information. .

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
It is possible to add to the document information, and the added information after the addition is managed separately from the document information, and the document information and the added information can be used independently.

According to a third aspect of the present invention, in the data structure of the document according to the second aspect, an encapsulation means for encapsulating the digital information file, the display information file and the operation program file as a single document. To have.

Therefore, since the digital information file, the display information file and the operation program file are encapsulated as a single document by the encapsulation means, their handling and management are extremely easy.

According to a fourth aspect of the present invention, in the document data structure according to the second or third aspect, the functional operation program has a function of changing display densities of the editing information and the document information in inverse proportion. .

Therefore, it becomes easy to distinguish the touched information and the non-touched information at first glance, and it is possible to eliminate the difficulty of discrimination due to the overlapping display of these information.

According to a fifth aspect of the invention, in the data structure of the document according to the second or third aspect, the document information display plane for displaying the document information and the additional information for displaying the additional information overlaid on the front surface thereof. A display plane, and the functional operation program transparently displays the modification information display plane with respect to the document information display plane based on a set transparency.

Therefore, the visibility of the display can be obtained by setting the density of the added information and the density of the non-added information.

According to a sixth aspect of the present invention, in the data structure of the document according to the second or third aspect, the functional operation program adds a line segment connecting the editing start point and the editing end point to the editing function. The mode and the free hand mode in which the points are continuously added are added.

Therefore, the retouching operation becomes easy.

According to a seventh aspect of the present invention, in the data structure of the document according to the second or third aspect, the functional operation program adds a line segment editing mode for adding a line segment and a text font to the editing function. And the text editing mode to be added.

Therefore, by having a mode in which the text can be added, the text information can be added and the display is easy to see. Also, since the text information is added,
A search as a subsequent process can be easily performed.

According to an eighth aspect of the invention, in the data structure of the document according to the second or third aspect, the functional operation program adds line segments of different line widths or line segments of different colors to the editing function. Add the editing mode.

Therefore, the visibility of the display can be obtained.

According to a ninth aspect of the invention, in the data structure of the document according to the eighth aspect, the functional operation program is
The function for searching the correction information is added to the correction function.

Therefore, a search as a subsequent process can be easily performed based on the line width or color of the line segment of the editing information.

The invention according to claim 10 is the invention according to claim 2 or 3.
In the data structure of the described document, the functional operation program includes a first mode in which the editing function allows only horizontal or vertical editing of the document information, and a first mode in which the editing function allows editing at an arbitrary angle. The second mode and are added.

Therefore, the visibility of the display can be obtained. In addition, the first mode makes it easy to add underlines to characters.

The invention according to claim 11 is the invention according to claim 2 or 3.
In the data structure of the described document, the functional operation program previously provides the editing function with a free dot mode in which the editing start position and the editing end position are allowed only in display pixel units, and the editing start position and the editing end position. The specified dot mode that is allowed only at the set position is added.

Therefore, the prescribed dot mode makes it easy to add underlines to characters.

The invention according to claim 12 is the invention according to claim 2 or 3.
In the data structure of the described document, the functional operation program provides the editing function with a function that allows movement or deletion of all or part of the editing information.

Therefore, unnecessary editing information can be erased.

The invention according to claim 13 is the invention according to claim 2 or 3.
In the data structure of the described document, the functional operation program adds a function of recording the correction history of the correction information to the correction function.

Therefore, it is possible to go back to the corrections made in the past and, for example, it becomes easy to see the discussion process such as a meeting.

According to a fourteenth aspect of the present invention, in the data structure of the document according to any one of the second to thirteenth aspects, the functional operation program causes the additional information to be activated on another computer. It has the function of transmitting to.

Therefore, by using a document having this function in a meeting or the like, it is possible to smoothly proceed with the proceedings. In addition, a conference or the like on a network with a remote place becomes easy.

According to the invention of a storage medium for storing a data structure of a document as described in claim 15, a digital information file having document information browsed by a computer and the document information added on the document information are separately provided. And a program having a correction function for correcting the correction information to be stored, a correction function for correcting the correction information on the document information, and a display function for displaying the document information and the correction information in a layered manner.

Therefore, it is possible to add to the document information, and the added information after the correction is managed separately from the document information, and these document information and the added information can be used independently.

According to a sixteenth aspect of the present invention, there is provided a storage medium for storing a data structure of a document. One or two or more digital information files which are representation entities on the document, the structure of the digital information file and the document are described. Display information file that specifies the display state of
A digital information display program that is executed and displays the one or more digital information files on the display of the computer in a display state specified based on the display information file, and a unique program without referring to the digital information. An operation program file including a function operation program for executing a function, wherein the function operation program is a correction function for correcting the correction information on the document information included in the digital information file; and the document information. And a display function for displaying the editing information in a layered manner,
And a saving function of saving the correction information.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
It is possible to add to the document information, and the added information after the addition is managed separately from the document information, and the document information and the added information can be used independently.

According to the invention of an information processing apparatus described in claim 17,
A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document includes a digital information file having document information browsed by the computer, and the document information added to the document information. Includes a separately-stored editing information, a editing function of adding the editing information to the document information, and a program having a display function of displaying the document information and the editing information in a layered manner.

Therefore, it is possible to add to the document information, and the added information after the correction is managed separately from the document information, and the document information and the added information can be used independently.

According to the invention of an information processing apparatus described in claim 18,
A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representational entities on the document, the structure of the digital information file, and the document. The display information file for specifying the above-mentioned display state is interpreted and executed together by a computer, and the one or more digital information files are displayed on the display of the computer in the display state specified based on the display information file. Digital information display program to be displayed,
An operation program file including a function operation program for executing a specific function without referring to the digital information, wherein the function operation program is added to the document information included in the digital information file. And a display function of displaying the document information and the correction information in a layered manner, and a saving function of saving the correction information.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
It is possible to add to the document information, and the added information after the addition is managed separately from the document information, and the document information and the added information can be used independently.

[0072]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described with reference to the drawings.

[Data Structure of Document (Encapsulated Document)]
FIG. 1 is a schematic diagram showing a data structure of an encapsulated document which is an encapsulated document.

As shown in FIG. 1, the encapsulated document 101 is a document arrangement information 102 as a display information file showing a display state such as a structure and arrangement of the entire document, and a digital information file showing a text content in the document. Text information 103, other media information 104 as a digital information file representing a still image or a moving image, and a program 105 as a plurality of operation program files for displaying document contents and detecting user operations. Has been done. Each of these pieces of information has a structure of an individual file unit that can be managed by a general personal computer operating system.

Such an encapsulated document 101 is a magnetic storage medium such as a floppy (registered trademark) disk, a hard disk, a magnetic tape, a CD or a CD-RO.
M, CD-R, CD-RW, DVD-ROM, DVD-
It can be stored in various storage media such as an optical storage medium such as RAM, and can be easily carried depending on the type of storage medium. Also, the encapsulated document 101
Can be transmitted via various communication lines such as RAN and the Internet.

FIG. 2 is a schematic diagram showing an example of the data structure of the archive file, and FIG. 3 is a schematic diagram showing an example of another data structure of the archive file.

Each of the files 102, 103, 104 and 105 which form the encapsulated document 101 is stored in one file called an archive file 201, as shown in FIGS. As a result, the document arrangement information 10
2 (display information file), text information 103 (digital information file), media information 104 (digital information file), and program 105 (operation program file) are encapsulated as a single document. Has been done. Such an archive file 2
The 01 file format generally includes the ZIP format and the LHA format, and these techniques may be used.

Here, the archive file 201 has a file structure for storing a plurality of files 102, 103, 104, 105 as one file (archive file 201). Such an archive file 201 uses a archiver program having a storage function and a decompression function, so that a plurality of files 1 can be stored according to a user's request.
02, 103, 104, and 105 can be handled as one file (archive file 201).

In the archive file 201 illustrated in FIG. 2,
Each file 102, 10 is added to the archive file 201 that stores a plurality of files 102, 103, 104, 105.
Index information indicating which positions in the archive file 201, 3, 104 and 105 are located is added. As a result, it becomes possible to search the positions of the files 102, 103, 104 and 105. In addition, as another embodiment,
Like the archive file 201 illustrated in FIG. 3, the header information is added to each of the files 102, 103, 104, and 105, and the file 102, 10
It is also possible to adopt a method that enables position retrieval of 3, 104, and 105.

As described above, the file structure of the encapsulated document 101 has a plurality of files 102, 103, 104, 10 as shown in FIG.
5 is an index (see FIG. 2) or header (see FIG. 3)
It is an archive file format managed by. In this way, the encapsulated document 101 becomes a plurality of files 102, 103, 1
Since 04 and 105 are encapsulated as one archive file 201, the user can apparently manage and store a plurality of files 102, 103, 104 and 105 as one document.

FIG. 4 is a schematic diagram showing a data structure of a program stored in the encapsulated document 101, and FIG. 5 is a schematic diagram showing a data structure of a display information file that defines information about an extension program included in the program. Is.

The program 105, which is a plurality of operation program files stored in the encapsulated document 101.
Is composed of a basic program 111 and an extension program 112, as shown in FIG.

The basic program 111 is a program that can be called when the encapsulated document 101 is activated, and only one program exists in common to all encapsulated documents 101. This basic program 111
Includes a startup program (not shown), which is interpreted by the personal computer 301 in response to access to the encapsulated document 101 by the personal computer 301.
It is executed and started.

The extension program 112 is a program added according to the contents included in the encapsulated document 101, and is prepared according to the type of display medium, for example, as shown in FIG. As an example, when the digital information file included in the encapsulated document 101 is only the text information 103, the basic program 111
In addition to the Text P of the extension program 112
The annel program 112a is stored in the encapsulated document 101. When the media information 104, which is a digital information file representing a still image or a moving image, is included in the encapsulated document 101, in addition to the basic program 111, I
image Panel program 112b, Movei
The Panel program 112c and the 3D Panel program 112d are stored in the encapsulated document 101. The basic program 111 includes a startup program (not shown), and the personal computer 301
When the encapsulated document 101 is accessed by the user, or when necessary, the personal computer 301 interprets, executes, and activates.

FIG. 5 shows an example of the extension program reference file 113. The extension program reference file 113 defines the extension program 112, the tag 114 and the operation 115 corresponding to the extension program 112. Such an extended program reference file 113 is stored in the encapsulated document 101 as the program 105.

Next, the document arrangement information 102 will be described. The document arrangement information 102 is a file that describes the arrangement, display size, files of each medium, etc. of each medium of the encapsulated document 101. In the present embodiment, the description of these pieces of information is described in a general-purpose XML format.

FIG. 6 is a schematic diagram showing an example of the encapsulated document 101 described in XML. XML is
As shown in FIG. 6, an example thereof is a file format in which each element is described by a tag, and a document is described by a collection of elements called tags. In this case, it is possible to have a nested structure in which tags are described in tags.
It is also possible to add attributes to each tag by what is called an attribute that represents the attributes of the tag.

FIG. 7 is a schematic diagram showing a display example of the encapsulated document 101 described in XML as shown in FIG. Encapsulated document 101 as shown in FIG.
Is displayed based on the XML description illustrated in FIG. First, a tag <Document> representing the entire document is described, and the document structure is described in this tag. Then, to describe the title first, <TEXT
The display content when the tag> is used displays the content in the tag when the attribute is omitted.
The following TEXT tag example shows the text information as "Body.TX.
This is an example of reading from a file called "T". Next IMA
The GE tag is a still image called "image.JPG" in X, Y
The layout information is such that the coordinates are displayed in the size designated by WIDTH and HIGH from the starting point.

As described above, the document layout information 102 is the XM
The L format is used to instruct a file and an arrangement.

Although the document layout information 102 has been described by taking the XML format as an example, other description languages such as the HTML format may be used, or a unique description format may be used.

The remaining still image, moving image, 3D
The media information 104 representing images, audio information, etc. may be a general-purpose file format, or may be a unique format in the case of special specifications.

As described above, the file structure of the encapsulated document 101 has a plurality of document arrangement information 102 representing the structure of the entire document and a plurality of text information files and image files displayed corresponding to the document arrangement information 102. Media files (text information 103 and media information 104)
And a plurality of programs 105 group.

[Browsing of Encapsulated Document 101, etc.] Here, the basic operation of the encapsulated document 101 from the document activation to the document browsing will be described. Therefore,
For comparison with the encapsulated document 101, the operation of a general personal computer and the conventional document browsing operation will be described.

FIG. 8 is a hardware configuration diagram of a general personal computer 301 (computer).
The personal computer 301 is a CP that processes information.
U302, ROM303 and RAM3 for storing information
04, etc., a primary storage device 305, a secondary storage device 307 such as an HDD 306 (hard disk drive) for storing processing results, etc., and a removable medium 308 such as a CD-ROM for storing, distributing, and obtaining information outside. A network 309 for transmitting information by communication with other external computers, a display 310 for displaying the progress and results of processing to the operator, a keyboard 311 for the operator to input commands and information to the personal computer 301. And a mouse 312 and the like, and transmits / receives data transmitted / received between these units to / from the bus controller 31.
3 is arbitrating and operating.

Generally, a personal computer 301
Then, when the user turns on the power, the CPU 302 causes the ROM
Start the program called loader in 303 and
A program called an operating system, which manages computer hardware and software, is loaded into the RAM 304 from D306, and this operating system is activated. Such an operating system starts a program, reads information, and saves it according to a user's operation. A typical operating system is Windows
s (registered trademark), UNIX (registered trademark) and the like are known. Programs running on these operating systems are called applications.

FIG. 9 is a flow chart showing the flow of a conventional document browsing process using the personal computer 301. As a conventional document browsing process, as shown in FIG. 9, an application program for document browsing is activated (step S101), and a document file conforming to the format of this application program is read from the activated application program (step S101).
102), which is displayed (step S103). In addition, such processing has a mechanism in which when a user selects and starts (for example, double-clicks) a document file with the mouse 312 or the like, an application program associated with the selected document file is started. Is common. In other words, the conventional document file browsing processing method in the personal computer 301 is to read the document data from the application program. Therefore, in order to display and edit the document included in the document file, the application program corresponding to the document is indispensable.

FIG. 10 shows a personal computer 301.
7 is a flowchart showing a flow of a document browsing process of the encapsulated document 101 using the. In the present embodiment, such a personal computer 301 and the encapsulated document 1
An information processing device is configured by 01 and.

The encapsulated document 101 is the text information 1
03 and media information 104, an icon file relating to an icon (not shown) for displaying on the personal computer 301 an icon corresponding to the actual data thereof is included. Therefore, since an icon according to this icon file is displayed on the personal computer 301, when the user selects and activates (double-clicks) the icon corresponding to the substance data of the encapsulated document 101 with the mouse 312 or the like, the encapsulated document is displayed. The basic program 111 stored in the archive format as the archive file 201 in 101 is activated (step S20).
1). After starting, the basic program 111 creates a display window for displaying a document (step S
202). Then, the basic program 111 is the document layout information 10 in the archive file 201 described in XML or the like.
2 is read (step S203).

The basic program 111 is the document layout information 1
After reading 02, the tag structure is analyzed (step S2
04), the extension program 112 corresponding to the tag name as illustrated in FIG.
The attribute described in 02 is passed to each extension program 112 (step S205). Basic program 1
The processing unit 11 performs such processing until the processing is completed for all tags in the document arrangement information 102 stored in the encapsulated document 101 (step S206), whereby the plurality of extension programs 112 described in the document arrangement information 102. Is started in another thread (step S20)
5).

Each extension program 112 analyzes the attributes received from the basic program 111 (step S207), and outputs the necessary text information 103 and media information 104 according to the contents of the attributes from the archive file 201 in the encapsulated document 101. Read (step S208). Then, each extension program 112
Displays the text information 103 and the media information 104 in an area having a size corresponding to the attribute in the window created by the basic program 111 (step S209). By performing such processing, the encapsulated document 101 can display a plurality of text information 103 and media information 104 in a window secured by the basic program 111.

Further, when the expansion program 112 recognizes the occurrence of various events after such display (Y in step S210), it executes the process according to the recognized event (step S211). In this way, the encapsulated document 101 can display the document with a structure that is fundamentally different from the conventional document.

[Description Method of Program 105 Included in Encapsulated Document 101] Next, the encapsulated document 10 will be described.
The description of the program 105 included in 1 will be described.

When writing the program 105, a plurality of methods can be implemented.

The first method is to create the program 105 in the C programming language, which is currently the most popular language,
This is an example of using a native code in a format that can be directly executed by the CPU 302 by a C language compiler. In this case, the basic program 111 is executed in the execution format (Windows
In the EXE format), each extension program 112 is created in the library format (DLL format in Windows), and the document arrangement information 102, digital information files (text information 103 and media information 104) stored in the archive structure, and these The program 105 may be searched by the index or the header, and the searched program 105 may be designated as the basic program 111. However, in this method, the code of the CPU 302 is
Since it is limited to 302 types, it is not a very good method.

The second method is to use an interpreter language such as JAVA language. This is to construct a program with abstract intermediate code without using the execution code, convert the intermediate code into a native code that can be understood by the CPU 302 at the time of execution, and the CPU 302 executes the native code. By using this method, the CPU3
It is possible to use the encapsulated document 101 on a multi-platform regardless of the 02 type.

As described above, in the encapsulated document 101 of this embodiment, the basic program 111 is first activated,
The startup program reads various information from the document arrangement information 102 and operates the extension program 112 that conforms to the information.

As the extension program 112, as described above, a program corresponding to the tag type of the document arrangement information 102 described in XML or the like may be prepared and the extension program 112 may be activated. The extension program 112 may be started according to the types of various digital information files (text information 103, media information 104) from which the tag attribute information is read. For example, in FIG.
As shown in (1), there are a plurality of typical formats of moving images when displaying and reproducing moving image information. Therefore, if one expansion program 112 is created to display all of the plurality of moving images, it becomes a large program. Therefore, in FIG.
As shown in FIG. 1, a plurality of extension programs 112 are prepared according to the file format, and the encapsulated document 10
It suffices to encapsulate the extension program 112 that fits a specific type of file format in the No. 1 program.

[Extension Program 112] FIG. 12 is a schematic diagram showing types of the extension program 112. The extension program 112 is a digital information display program 1 for displaying and reproducing digital information, as illustrated in FIG.
Not only 12A but also a functional operation program 112B that provides a specific function without reading digital information. Alternatively, the digital information display program 112A and the functional operation program 112B in the extension program 112 are the auxiliary programs 1 that assist them.
It may have 12C.

Here, an example of the functions executed by the functional operation program 112B and the auxiliary program 112C will be described.

As an example, it is assumed that the document is longer than the display size of the display 310 of the personal computer 301 and extends over a plurality of pages. In this case, as illustrated in FIG. 13, a page turning button 118 as a function panel described as “next page”, for example.
Should appear on the display 310. As shown in FIG. 14, the tag <PAGE> is described in the document arrangement information 102, and the PAG corresponding to this tag is written.
The function operation program 112B is provided with the function of the extension program 112 called E Button. As a result, the function operation program 112B called PAGE Button is activated, and the page turning button 118 as shown in FIG. 13 appears in the document. When the user presses the button by a method such as clicking the mouse 312, the page turning function is provided. Provided.

Here, when the user presses the button, the extension program 112 determines the detection of an event as shown in the flowchart of FIG. 10 (step S21).
(Y of 0), the corresponding event operation is executed (step S211). The event operation here is a page turning function executed by the function operation program 112B and the auxiliary program 112C.

As another example, the function operation program 112B for displaying the function of displaying the document information such as the number of pages, the date of creation, the total number of words, etc. can be implemented.

Next, as an example of the functions executed by the extension program 112 and the auxiliary program 112C that assists the extension program 112, an example of the moving image reproduction function will be introduced.
In the moving image playback function, since the basic display portion can be used in common with any moving image file format, the basic extension program 11
2 uses the same one, but for the part that depends on the file format of the moving picture, the auxiliary program 1
There is an example of setting to 12C. For example, as shown in FIG. 15, the encoding portion of the file may be the auxiliary program 112C.

Next, a specific example of the extension program 112 will be described.

First, the function of the extension program 112, which is based on the premise that the encapsulated document 101 includes a plurality of digital information files (text information 103, media information 104), will be described.

The extension program 112 uses the display 3
A file specifying panel (not shown) is displayed at 10. This file specification panel is the encapsulated document 1
This is a panel listing a plurality of digital information files (text information 103, media information 104) included in 01 so that they can be selected and instructed. So, for example, mouse 31
When an arbitrary digital information file (text information 103, media information 104) is selected and instructed by a method such as clicking by 2, the extension program 112 determines event detection (see the flowchart shown in FIG. 10). In step S210, Y), the corresponding event operation is executed (step S211).

As an event operation here, the extension program 112 executes an operation of displaying the selected digital information file (text information 103, media information 104) on the display 310.

Next, the function of the extension program 112, which is premised on that the encapsulated document 101 includes a still image image file as the media information 104, will be described.

As shown in FIG. 16, the extension program 11
2 displays a still image 121 in the document displayed on the display 310. The display area of the still image 121 included in the document on the display 310 is the mouse 31.
When the selection instruction is given by clicking or the like by 2, the extension program 112 determines the detection of an event (Y in step S210) and executes the corresponding event operation (step S2), as shown in the flowchart of FIG.
11).

As an event operation here, the extension program 112 creates and displays a function panel 122 which is another frame for enlargement / reduction display as shown in FIG. The function panel 122 includes an enlarge button 124 and a reduce button 125 together with an enlarged or reduced image 123 of the still image 121.
I will provide a. Therefore, when one of the buttons 124 and 125 is selected and instructed, the extension program 112 executes the enlargement rate or reduction rate change processing in response to the selection instruction.

Expansion program 112 for displaying a still image
By adding such a new function to, the user's visibility can be significantly improved as compared with simply pasting the still image 121 in the document.

The enlargement / reduction function of the extension program 112 can be realized by any well-known enlargement / reduction function.

Next, the function of the extension program 112, which is premised on that the stereoscopic image file is included as the media information 104 in the encapsulated document 101, will be described.

As shown in FIG. 17, the extension program 11
2 displays a stereoscopic image 131 in the document displayed on the display 310. The display area of the stereoscopic image 131 included in the document on the display 310 is the mouse 31.
When the selection instruction is given by clicking or the like by 2, the extension program 112 determines the detection of an event (Y in step S210) and executes the corresponding event operation (step S2), as shown in the flowchart of FIG.
11).

As the event operation here, the expansion program 112 causes the pop-up frame 13 including the image 132 for enlarging, reducing or displaying the stereoscopic image 131 as it is.
3 is displayed, and a viewpoint changing button 134 for switching the viewpoint is arranged on the pop-up frame 133.
Then, when any of the viewpoint changing buttons 134 is selected and instructed, the extension program 112 switches the viewpoint according to the selected viewpoint changing button 134.

As a result, the visibility of the user can be improved.

Next, the function of the extension program 112, which is based on the premise that the moving picture image file is included as the media information 104 in the encapsulated document 101, will be described.

As shown in FIG. 18, the extension program 11
2 displays a still image 141 defined by one frame of a moving image in the document displayed on the display 310. Then, when the display area of the still image 141 included in the document on the display 310 is selected and instructed by clicking with the mouse 312 or the like, the extension program 11
2, as shown in the flowchart of FIG. 10, the event detection is determined (Y of step S210), and the corresponding event operation is executed (step S211).

As an event operation here, the extension program 112 causes the pop-up frame 14 including the image 142 for enlarging, reducing or displaying the still image 141 as it is.
3 is displayed, and a play button 144, a stop button 145, and a pause button 146 are displayed in the pop-up frame 143.
The operation button 147 consisting of appears. Then, when any of the buttons 144, 145, 146 included in the operation buttons 147 is instructed to be selected by a method such as clicking the mouse 312, the extension program 112 detects the event as shown in the flowchart of FIG. The determination is made (Y of step S210), and the corresponding event operation is executed (step S211).

As an event operation here, if the selection instruction is the reproduction button 144, the expansion program 112 reproduces the image 142 displayed as a still image as the original moving image, and the selection instruction is given. If is the stop button 145, the reproduction of the moving image is stopped. If the selection button is the pause button 146, the reproduction of the moving image is displayed as a still image at that time.

Further, the function of the extension program 112, which is premised on that the encapsulated document 101 includes the audio information file as the media information 104, will be described.

As shown in FIG. 19, the extension program 11
2 displays a voice reproduction button 151 as a function panel and a reproduction panel in the document displayed on the display 310. When the display area of the voice reproduction button 151 included in the document on the display 310 is selected and instructed by clicking with the mouse 312 or the like, the extension program 112 determines the event detection as shown in the flowchart of FIG. (Y in step S210), the corresponding event action is executed (step S2).
11).

As an event operation here, the extension program 112 uses the voice reading information display area 15 to be described later.
A pop-up frame 153 including 2 is displayed, and an operation button 157 including a play button 154, a stop button 155, and a pause button 156 appears on the pop-up frame 153. Then, when any one of the buttons 154, 155, 156 included in the operation button 157 is instructed to be selected by a method such as clicking the mouse 312, the extension program 112 detects the event as shown in the flowchart of FIG. The determination is made (Y in step S210), and the corresponding event action is executed (step S2).
11).

As an event operation here, the extension program 112 reproduces the sound in the sound information file included in the encapsulated document 101 if the reproduction button 154 is selected and instructed to be selected. If is the stop button 145, the voice reproduction in the voice information file being reproduced is stopped, and if the selection instruction is the pause button 146, the voice reproduction in the voice information file being reproduced is temporarily stopped. To do.

When the playback button 154 is selected and the voice in the voice information file is played back, the extension program 112 has another function, in which visual information obtained by converting the played voice into text information is read out as voice reading information. Area 1
The personal computer 301 is caused to execute the function displayed on 52. Such an operation is performed when the document is browsed by the document browsing apparatus (usually the personal computer 301).
If the speaker for audio playback of is turned off,
This is effective when a person with a hearing loss views a document. Further, such a reading function is provided by the personal computer 301.
The pop-up operation may be automatically performed based on the setting of the speaker or the like, the setting of the assisting function for persons with disabilities, and the like.

Here, the voice information file may have a data structure as voice data obtained by sampling voice, or may be text data.
In the case of text data, when the voice information file is played back, it can be played back by a method of converting the text data into voice data defined by a voice feature amount, for example, using a voice synthesis LSI. Further, when the voice information file is made up of text data, the text data can be used as it is for the text information conversion of the voice performed when the voice in the voice information file is reproduced. On the other hand, when the audio information file is composed of audio data, it is necessary to analyze the audio data and convert it into text information.

As mentioned above, the encapsulation document 10 contains many kinds of extension programs 112 according to the characteristics of various digital information to be displayed or reproduced.
It is possible to prepare for 1. Therefore, by preparing these extension programs 112 as parts of a multimedia document, it is possible to flexibly realize the extension programs 112 corresponding to various media. In this case, since only the necessary extension program 112 needs to be stored in the encapsulated document 101, handling of the encapsulated document 101 becomes extremely light.

FIG. 20 shows the structure of the extension program 112 included in the encapsulated document 101. In the encapsulated document 101 according to the present embodiment, the document arrangement information 102 is read by the basic program 111, and the document arrangement information 102 is read.
The digital information file (text information 1
03, media information 104) is started, and the started extension program 112 displays and reproduces the digital information file (text information 103, media information 104). In addition, each extension program 112 detects a user operation and performs a corresponding operation when the user operation is performed.
In this case, the digital information file (text information 10
3. In the case of the extension program 112 that does not refer to the media information 104), it simply receives a user operation and performs an operation according to the user operation.

The user operation may be a click on the mouse 312 or an input on the keyboard 311. Mouse 312
In the case of clicking, it is sufficient to judge whether the click position of the mouse 312 is within the display occupation range of each extension program 112, and to perform the operation corresponding to the case where the mouse 312 is clicked within its own display range. Keyboard 311
In the case of input, the cursor position (not shown) that can be moved by the keyboard 311 is the extension program 11
It is only necessary to judge whether or not it is within the display occupancy range of No. 2, and to perform the operation corresponding to the case where the selection instruction is made in the own display range. For example, as shown in FIG. 21, in the case of a document displaying three pieces of digital information (PRG1, PRG2, PRG3), as an example, when the user clicks the mouse 312 in the part marked with X, the PRG2 The extension program 112 detects the click of the mouse 312 and executes the corresponding operation.

As described above, the document format of the encapsulated document 101 in this embodiment is the extension program 1 related to the type of each medium and the type of tag of the display information file.
It is composed of 12 groups, and the minimum configuration is composed of the basic program 111 and the document arrangement information 102. Then, the encapsulated document 101 prepares a digital information file (text information 103, media information 104) according to the information that the user wants to store in the encapsulated document 101, and the extension program 112 that allows the information to be reproduced and displayed. It is established by adding. Then, the encapsulated document 101 according to the present embodiment stores such various files as a single file using the archive format.

[Additional Function Implemented by Extended Program 112] Generally, a document is mainly viewed, but
When browsing, you may want to add additional information to the document. Considering the addition of such a document, when the document itself is edited like a conventional electronic document, various problems occur.

Therefore, in the present embodiment, a technique is described in which a postscript (addition) function is added to the encapsulated document 101 and the information originally held by the document and the postscript added information are separately held. That is, the encapsulated document 101 according to the present embodiment originally has the document information 40 as illustrated in FIG.
If the user who is browsing the document information 401 adds a correction 402 as illustrated in FIG. 23 to the browsed document information 401, the correction information as illustrated in FIG. 24 is included. 403 is created.

In the encapsulated document 101 of the present embodiment, the function of adding the rewriting information 403 to the document information 401 is realized by the extension program 112 included in the encapsulating document 101. Therefore, the editing function realized by the extension program 112 will be described in detail below.

First, in the encapsulated document 101,
Various digital information files (text information 103, media information 1) stored in the encapsulated document 101
04), the basic program 111 includes digital information files (text information 103, media information 10).
The extended program 112 corresponding to 4) is called and displayed. The document display example illustrated in FIG. 22 is displayed on the display by such a mechanism.

On the other hand, if a tag such as <RETOUCH> is described in the document arrangement information 102 which is the arrangement information file, the basic program 111 will execute the extension program 112 having the editing function according to this description. call.

As a result, as shown in FIG. 25, the editing information plane 412 is overlaid on the document display plane 411 for displaying the information in the document, and the editing information 403 is placed on the editing information plane 412. It becomes possible to draw. In addition, in the modification information plane 412, the area other than the modification information 403 displays the document display plane 411 which is the background. As a result, the browsed document information 4
01 and additional information 403 can be viewed at the same time.

As a supplementary explanation, generally, when a program (not shown) installed in the personal computer 301 draws an image or a character on the screen, first, the drawing area (here, each plane) After painting with the specified background color, draw the next required image or character in the drawing area filled with the background color. Then, to explain with reference to FIG. 14, another plane (for example, the editing information plane 4) is provided on the document display plane 411.
When 12) is overlaid, only the upper plane (in this case, the writing information plane 412) can be seen. On the other hand, in the present embodiment, a plurality of planes (411, 4,
12) can be displayed at the same time.
There are several ways to do this.

As a first method, the lower plane (see FIG.
5 is a method of suppressing the filling with the background color when drawing the document display plane 411) and then drawing on the upper plane (the additional information plane 412 in FIG. 25).

As a second method, the lower plane (see FIG.
In FIG. 5, after drawing the document display plane 411), when drawing the upper plane (the additional information plane 412 in FIG. 25), first, there is a method of painting the lower information as the background.

As a third method, after drawing the lower plane (the document display plane 411 in FIG. 25), the upper background color and the lower drawing information are added together based on a certain coefficient. There is a method of drawing the upper information after drawing.

Therefore, in the present embodiment, as an example,
Based on the following formula, the document information 401 and the additional information 40
3 and are combined and displayed.

R = k1 × R1 + (1-k1) × ((1-
k2) * R2 + k2 * R3) G = k1 * G1 + (1-k1) * ((1-k2) * G2
+ K2 * G3) B = k1 * B1 + (1-k1) * ((1-k2) * B2
+ K2 × B3) When displaying a color image, the color of each dot is generally represented by the three primary colors of RGB. (R3, G3, B
3) is the color of the document display in the document information 401, and (R
2, G2, B2) are background colors that are the background of the retouching information 403. Further, (R1, G1, B1) is the editing information 403.
, And (R, G, B) are the colors displayed in a composite manner. Further, k1 and k2 are transmissivities for synthesizing these colors, and the document display in the document information 401 and the touch-up background and the touch-up information 403 are combined and displayed in the relationship of 0 ≦ k1, k2 ≦ 1.

That is, the addition background color is displayed with a constant transmittance with respect to the document display color, and the addition information is displayed thereon with a constant transmittance with respect to the addition background color. By combining images by such a method, for example, when k1 is reduced, the additional information 403 may be displayed lightly.
When = 0, the additional information 403 can be erased. Also,
When k2 is small, the document information 401 can be displayed lightly, and conversely, when k2 = 0, the document information 401 can be erased.

By allowing the user to change k1 and k2 in this way, it is possible to easily see only the rewriting information 403 or browse only the document information 401.
The revised document is easier to see.

The above description can be expressed as a drawing step as shown in FIG.

First, the lower document information is displayed (step S301).

Next, regarding the display of the editing information on the upper side,
The following processing is repeated for each display dot.

First, in order to apply the base color, the display color displayed on the dot in the portion where the base color is drawn is acquired (step S302).

Next, the background drawing color is calculated based on the determined transmittance (step S303).

Next, the dot is drawn with the calculated background color (step S304).

Next, the drawn display color is acquired (step S305), and the additional drawing color is determined based on the transmittance determined from the acquired display color and the additional information color (step S306).

Then, the final display color of this dot is determined with the determined additional color (step S307).

By doing so, the background and the correction information 403 are drawn in order on the document information 401,
The document information 401 and the additional information 403 can be easily displayed selectively.

In addition, actually, for the purpose of preventing flickering of the screen display, an image is formed in a virtual storage area and is displayed after the final image is created. good.

Next, the flow of processing of the extension program 112 for realizing the editing function is shown in the flowchart of FIG.

First, the extension program 1 having the editing function
When 12 is activated by the basic program 111 (step S401), the previously-added editing information 403 is read from the editing information file (not shown) saved in the archive file 201 in the document in the archive format (step S402). .

Next, the read information is displayed on the editing information plane 412 overlaid on the document display plane 411 by the processing shown in FIG. 26 (step S40).
3).

Next, the presence / absence of correction by the viewer is detected (step S404), and when correction is made, the correction information 403 is added.
Is updated and displayed again (step S403).

When the user notifies the document of the instruction to end the browsing of the document, the retouched information 403 that has been retouched is saved and the process is terminated (step S405).

Next, an example of touchup detection will be described.

Various user interfaces are conceivable for adding to a document. A typical method is to use a pointing device such as a mouse,
Tablet, keyboard input, etc. are considered.

Here, the addition with a general mouse will be described. Normally, when drawing letters or pictures with a mouse,
As illustrated in FIG. 28, the mouse pointer is moved to the target drawing start point position, the mouse button is pressed at the start point position,
The mouse is moved while it is pressed to draw the moving path, and the drawing end point is determined by releasing the mouse button. Thus, the stroke of the mouse can be drawn.

Therefore, the additional stroke information can be acquired by the flow of processing as shown in FIG.

First, it is detected whether or not the document browsing is finished (step S501), and if the document browsing is finished, the editing is finished (step S502).

Next, whether or not the mouse button is pressed is repeatedly detected until the button is pressed (step S503).

Next, when the button is pressed, the point coordinates of the mouse are added to the editing information as the starting point coordinates (step S504).

Next, it is detected whether the pointer of the mouse has moved or the button has turned off. If the mouse is on or has not moved, the mouse is moved and the button is turned on and off.
The FF detection is repeated (step S505).

Next, when the mouse is moved or turned off, it is detected whether the writing mode is the line mode or the freehand mode (step S506). The line mode is a mode in which the start point and the end point of the mouse are connected by a straight line, and the freehand mode is in which the trajectory of the pointer is drawn while the mouse is being pressed. Here, if the user selects the freehand mode, the moved mouse coordinates are added as the correction coordinates (step S507).

Next, in order to display the retouching information in real time, only the information newly retouched by turning on the mouse this time is displayed (step S508).

Next, if the mouse button is not turned off, or the process returns to the step of mouse movement and button off detection (step S505).

By repeating this, the added coordinates can be detected and drawn while the mouse button is ON.

Then, it is detected that the user has turned off the mouse button at the time when the end point coordinate of the editing is turned off (step S510), and this is added as a line stroke (step S511).

By performing such processing, information representing one drawing stroke starting from the editing start point coordinates, passing through a plurality of editing coordinates, and finally reaching the editing end point coordinates, as shown in FIG. 30, is obtained. Obtainable. By performing such operations of turning on the mouse, moving the mouse, and turning off the mouse a plurality of times, an arbitrary picture can be drawn, and the writing information 403 can be generated from the plurality of drawing stroke information. Further, the example described above is an example of obtaining the line information, but similarly for other rectangles, circles, filling, etc., the information may be obtained by the operation of the mouse.

As shown in FIG. 31, these plural types of graphic information can be managed in the form of a header representing the type of graphic, the size of the data following it, and the data. For example, in the case of a square,
As shown in 2, the header and size representing the rectangle are 6 data, the color of the outer frame of the rectangle, the fill color of the inside of the rectangle,
X coordinate of the upper right corner of the rectangle, Y coordinate of the upper right corner, X coordinate of the lower left corner,
It can be generated by a graphic data block called the Y coordinate at the lower left. By managing various added figures by using such figure data blocks as shown in FIG. 31, not only the above-mentioned line but also a plurality of kinds of figures can be held as the added display.

Further, in the examples explained so far, the addition of the figure by the mouse is described, but the text may be input by using the keyboard or the like. In this case, data blocks as shown in FIG. 33 may be used for management.

Further, handwritten characters such as a mouse may be converted into text by a character recognition program (not shown) in the handwriting extension program 112 and input.

As for the line type and line color of the line, by using a data block as shown in FIG. 34, the editing information 403 with different line types and line colors can be managed.

Next, a method of designating such plural kinds of figures will be described.

First, the extension program 112 for the editing function displays the editing toolbar 421 as shown in FIG. 35 in the document 422 as shown in FIG. 36 when the document is browsed.

Next, when the user wants to perform the editing, he or she depresses the figure designating button included in the editing toolbar 421 to designate the figure. At this time, the extension program 112
Acquires the drawing type corresponding to the header information of each data block shown in FIG.

Next, if necessary, the color button 423 for setting the color, the line type button 424 for setting the line type, etc. are pressed.
As a result, the extension program 112 acquires various setting information.

Next, a figure is drawn in the document 422 using a mouse or the like.
Draw on the display surface of. By the mouse operation for this drawing, the data shown in FIG. 31 is acquired, and when one figure is drawn, one data block is created, and the editing information composed of a plurality of data blocks as shown in FIG. Can be obtained.

By holding these data blocks together with the editing information 403 in this manner, it is possible to update the editing information 403 in real time.

At the end of browsing, the document information 401
The final editing information is saved in the archive format as an editing information file. With this, the user can easily perform the editing operation on the document by opening the document with the editing function, and further, the document information 4 created first.
The edit operation can be executed without changing 01 at all.

Further, it is possible to easily emphasize the added information or make it invisible by using the above-described function of changing the display transmittance. Further, since the correction information is composed of a plurality of data blocks as shown in FIG. 31, when the user wants to correct or delete the correction information, a correction button (not shown) is provided on the correction toolbar 421, After pressing the delete button, a figure to be deleted is selected and its data block is discarded, whereby a part of the editing information can be deleted.

Next, in the invention of this embodiment, various functions can be added to the encapsulated document 101 by the plurality of extension programs 112. Here, of these functions, the description has been centered on the edit function, but the edit function may be operated in cooperation with the function of another extension program 112.

As an example, the cooperation with the function of recording the user operation information history generated when the user operates the encapsulated document 101 will be described. Such a function can be achieved by recording together the time when the data block was created and the like for each data block as shown in FIG. Accordingly, when the user wants to check the past editing process, as shown in FIG. 38, the past editing process can be easily performed by reproducing the editing information 403 based on the time recorded in these data blocks. Can be traced back to. Therefore, it is easy to correct the correction information and browse past correction information.

As another extension program 112,
The extension program having the communication function is the encapsulated document 10
39, the data block created by the editing function is transmitted to the same document being browsed by another personal computer 301 by the communication function, as shown in FIG. Then, in order to browse the modification document received by the communication function, such a data block is transferred to the extension program 112 for the modification function and the modification information 403 is added.
Is displayed.

In other words, by using the document format of the encapsulated document 101 and utilizing a plurality of types of extension programs 112 stored therein, the functions of the extension programs 112 are realized, whereby the document information 401 is obtained. It is possible to realize various functions as well as the correction function for the. For example, a plurality of users can discuss using the same document by using an information processing device such as a plurality of personal computers 301 connected to a network. Even in this case, since the additional information 403 is transmitted to each information processing apparatus every time the additional information 403 is created, the amount of data transmitted / received at one time is small, and the additional information 403 is transmitted together with the additional action. Therefore, real-time communication is possible.

Further, as shown in FIG. 40, when combined with the function of recording the history of the operation, by recording the transmission / reception data, it is possible to record the discussion process such as the conference. That is, the example shown in FIG. 40 is the extension program 11 for realizing the editing function, the recording function, and the communication function.
This is an example of a combination of two.

Next, the search function will be described.

The extension program 1 which already has a recording function
Although it has been described that the rewriting information, the transmission / reception information and the like are recorded by using 12, the retrieval information is preferably some kind in the case of reproducing the recorded information later.

Therefore, as a method of inputting a key for searching without burdening the user, there is a method of using the color of the rewritten information. For example, red is usually added to draw particular attention in a document. Therefore, the extension program 112 may be disabled from having a color-added color search function capable of searching for a record of a part that has been red-colored. In addition, a method called text search may be used to add text information by using a keyboard or handwriting recognition.

Further, regarding the search, the correction information 403
It is also possible to search for the document information 401 to which the correction information 403 has been added, instead of searching for itself. For example, as shown in FIG. 41, when the part called "Internet" is added with a mark, it may be searched by the key called "Internet". In this way, since the editing function and the document being browsed are in the same archive file 201, mutual document information can be easily used.

Next, as shown in FIG. 41, when marking a document, it is preferable that the width of the editing line be matched with the character height so that the marking can be performed linearly. Therefore, a writing mode may be provided in which lines are drawn linearly horizontally and vertically. In addition, a character mark mode in which the starting point and the ending point of marking can be marked according to the width of the character may be provided.
In addition, the extension program 11 displaying the contents of the browsed document
From the information from 2, when the line is drawn in the character information, it automatically switches to the character mark mode described above, the marking width automatically becomes the character height, and it becomes possible to draw only horizontally, and the mark start position The end position may be automatically set in character units. As described above, the extension program 112 having the editing function is provided with the function of automatically changing the editing mode such as the line width, the editing position, and the editing angle of the editing based on the document information 401 to be edited. If this is the case, the operation for editing will be easier. In addition, in the case of adding a portion to which an image or the like is displayed, the writing color may be automatically changed so as to judge the color of the image and add an appropriate color.

[0206]

According to the invention of the data structure of the document described in claim 1, the digital information file having the document information browsed by the computer and the document information added to the document information and stored separately from the document information are stored. Since the editing information includes a writing function, a writing function for adding the editing information on the document information, and a display function for displaying the document information and the editing information in a layered manner, It is possible to retouch, and since retouched information after retouching is managed separately from the document information, and it is possible to use the document information and the retouched information independently, which makes it extremely easy to use the document. Can be planned.

The invention of the data structure of the document according to claim 2 specifies one or more digital information files which are the representation entities on the document, the structure of the digital information file and the display state on the document. And a display information file that is interpreted and executed by a computer and is specified based on the display information file.
Alternatively, an operation program file including a digital information display program for displaying two or more digital information files on the display of the computer and a function operation program for executing a specific function without referring to the digital information. And the functional operation program is
The digital information file includes a writing function for adding the editing information on the document information included in the digital information file, a display function for displaying the document information and the editing information in a layered manner, and a saving function for saving the editing information. Therefore, the digital information file, display information file and operation program file are
Since it is encapsulated as a single document by the encapsulation means, if the operation program file is interpreted and executed on the computer, the digital information file can be browsed, and only the operation program file is pre-installed on the computer by itself. The user can be relieved from the complexity that must be done. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. Further, since it is possible to add to the document information, and the added information after the addition is managed separately from the document information, and the document information and the added information can be used independently, it is extremely It is possible to use the document with excellent usability.

According to a third aspect of the invention, in the data structure of the document according to the second aspect, an encapsulation means for encapsulating the digital information file, the display information file and the operation program file as a single document is provided. Since it is provided, the handling and management of the digital information file, the display information file, and the operation program file can be extremely facilitated.

According to a fourth aspect of the invention, in the data structure of the document according to the second or third aspect, the functional operation program has a function of changing display densities of the editing information and the document information in inverse proportion. Therefore, it is possible to distinguish the added information and the unedited information at a glance, and it is possible to eliminate the difficulty of discrimination due to the overlapping display of these.

According to a fifth aspect of the invention, in the data structure of the document according to the second or third aspect, the document information display plane for displaying the document information and the additional information for displaying the additional information overlaid on the front surface thereof. Since the functional operation program has a display plane and transparently displays the modification information display plane on the document information display plane based on the set transparency, the density of the modification information and the non-modification information It is possible to make the display easy to see by setting the density of the.

According to the invention of claim 6, in the data structure of the document according to claim 2 or 3, the functional operation program adds a line segment connecting an editing start point and an editing end point to the editing function. Since the mode and the freehand mode for continuously connecting the writing points are added, the writing operation can be facilitated.

According to a seventh aspect of the present invention, in the data structure of the document according to the second or third aspect, the functional operation program adds a line segment editing mode for adding a line segment and a text font to the editing function. Since the text editing mode and the text editing mode are added, the text information can be added by having the mode in which the text can be added, and thus the visibility of the display can be obtained. Further, since the text information can be added, the search as the subsequent process can be facilitated.

According to an eighth aspect of the present invention, in the data structure of the document according to the second or third aspect, the functional operation program adds line segments of different line widths or line segments of different colors to the editing function. Since the editing mode is added, the visibility of the display can be obtained.

The invention according to claim 9 is the data structure of the document according to claim 8, wherein the functional operation program is
Since the function of searching the correction information is added to the correction function, the search as the subsequent process can be easily realized based on the line width or the color of the line segment of the correction information.

The invention according to claim 10 is the invention according to claim 2 or 3.
In the data structure of the described document, the functional operation program includes a first mode in which the editing function allows only horizontal or vertical editing of the document information, and a first mode in which the editing function allows editing at an arbitrary angle. Since the second mode and the second mode are added, the visibility of the display can be obtained. In addition, the first mode makes it easy to add underlines to characters.

The invention according to claim 11 is the invention according to claim 2 or 3.
In the data structure of the described document, the functional operation program previously provides the editing function with a free dot mode in which the editing start position and the editing end position are allowed only in display pixel units, and the editing start position and the editing end position. Since the specified dot mode which is allowed only at the set position is added, it is possible to easily add an underline to a character by the specified dot mode.

The invention according to claim 12 is the invention according to claim 2 or 3.
In the data structure of the described document, the functional operation program provides the editing function with a function of permitting the movement or deletion of all or part of the editing information, so that unnecessary editing information can be erased.

The invention according to claim 13 is the invention according to claim 2 or 3.
In the data structure of the described document, the functional operation program gives the editing function a function of recording the editing history of the editing information, so that it is possible to go back to past editing, for example, a discussion process such as a meeting. Confirmation of can also be made easily.

According to a fourteenth aspect of the present invention, in the data structure of the document according to any one of the second to thirteenth aspects, the functional operation program causes the additional information to be activated on another computer. Since it has a function of transmitting information to a user, it is possible to smoothly proceed with the proceedings by using a document having this function at a meeting or the like, and to easily hold a meeting using a network with a remote place. .

According to the invention of a storage medium for storing a data structure of a document as described in claim 15, a digital information file having document information browsed by a computer and the document information added on the document information are separately provided. Since the editing information to be saved, the editing function of editing the editing information on the document information, and a program having a display function of displaying the document information and the editing information in a layered manner,
Since it is possible to add to the document information, and the added information after editing is managed separately from the document information and the document information and the added information can be used independently, it is extremely easy to use. Excellent document usage can be achieved.

The invention of a storage medium for storing a data structure of a document according to claim 16 is one or more digital information files which are representation entities on the document, the structure of the digital information file and the document. Display information file that specifies the display state of
A digital information display program that is executed and displays the one or more digital information files on the display of the computer in a display state specified based on the display information file, and a unique program without referring to the digital information. An operation program file including a function operation program for executing a function, wherein the function operation program is a correction function for correcting the correction information on the document information included in the digital information file; and the document information. And a display function for displaying the editing information in a layered manner,
Since the digital information file, the display information file and the operation program file are encapsulated as a single document by the encapsulating means, the operation program file is stored in the computer. If interpreted and executed, the digital information file can be browsed, and the user can be relieved from the complexity of having to pre-install only the operation program file on the computer. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. further,
Since it is possible to add to the document information, and the added information after editing is managed separately from the document information and the document information and the added information can be used independently, it is extremely easy to use. Excellent document usage can be achieved.

According to the invention of the information processing apparatus of claim 17,
A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document includes a digital information file having document information browsed by the computer, and the document information added to the document information. Is provided with a program having separately added edit information, a edit function for adding the edit information on the document information, and a display function for displaying the document information and the edit information in a layered manner. It is extremely easy to use because it is possible to add to the document information, and the added information after editing is managed separately from the document information and the document information and the added information can be used independently. Excellent document usage can be achieved.

According to the invention of an information processing apparatus described in claim 18,
A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representational entities on the document, the structure of the digital information file, and the document. The display information file for specifying the above-mentioned display state is interpreted and executed together by a computer, and the one or more digital information files are displayed on the display of the computer in the display state specified based on the display information file. Digital information display program to be displayed,
An operation program file including a function operation program for executing a specific function without referring to the digital information, wherein the function operation program is added to the document information included in the digital information file. A digital information file, a display information file, and an operation program file, since they have an editing function for editing, a display function for displaying the document information and the editing information in a layered manner, and a storage function for saving the editing information. Is encapsulated as a single document by the encapsulation means, so if the operation program file is interpreted and executed by the computer, the digital information file can be browsed and only the operation program file can be read by the computer. Free users from the hassles of having to pre-install Door can be. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. Further, since it is possible to add to the document information, and the added information after the addition is managed separately from the document information, and the document information and the added information can be used independently, it is extremely It is possible to use the document with excellent usability.

[Brief description of drawings]

FIG. 1 is a schematic diagram showing a data structure of an encapsulated document.

FIG. 2 is a schematic diagram showing an example of a data structure of an archive file.

FIG. 3 is a schematic diagram showing an example of another data structure of an archive file.

FIG. 4 is a schematic diagram showing a data structure of a program stored in an encapsulated document.

FIG. 5 is a schematic diagram showing a data structure of an extended program reference file included in a program.

FIG. 6 is a schematic diagram showing an example of an encapsulated document described in XML.

FIG. 7 is a schematic diagram showing a display example of an encapsulated document described in XML as shown in FIG.

FIG. 8 is a hardware configuration diagram of a personal computer (computer).

FIG. 9 is a flowchart showing the flow of a conventional document browsing process performed by a personal computer (computer).

FIG. 10 is a flowchart showing the flow of document browsing processing of an encapsulated document by a personal computer (computer).

FIG. 11 is a schematic diagram showing a file structure of a file that defines a correspondence relationship between media types and extension programs.

FIG. 12 is a schematic diagram showing types of extension programs.

FIG. 13 is a schematic diagram showing a display example in which a page turning button appears.

FIG. 14 is a schematic diagram showing a description example of a functional operation program file.

FIG. 15 is a schematic diagram showing a process of using an auxiliary program for an encoding part of a file.

FIG. 16 is a schematic diagram illustrating a display image enlargement / reduction function by an extension program.

FIG. 17 is a schematic diagram illustrating a viewpoint changing function of a display image which is a stereoscopic image by an extension program.

FIG. 18 is a schematic diagram illustrating a display function of a display image which is a moving image by the extension program as a still image and a reproduction function thereof.

FIG. 19 is a schematic diagram exemplifying a voice reproduction function and a reproduction voice text information conversion function by the extension program.

FIG. 20 is a schematic diagram showing the structure of an extension program included in an encapsulated document.

FIG. 21 shows three pieces of digital information (PRG1, PRG2,
It is a schematic diagram which shows the document display example which is displaying PRG3).

FIG. 22 is a schematic diagram illustrating the original content of a document.

FIG. 23 is a schematic diagram illustrating a state in which a document is added.

FIG. 24 is a schematic diagram illustrating the editing information.

FIG. 25 is a schematic diagram showing a document display plane and an editing information plane.

FIG. 26 is a flowchart showing the flow of drawing processing.

FIG. 27 is a flowchart showing a processing flow of an extension program 112 that realizes an editing function.

FIG. 28 is a schematic diagram illustrating information drawing by a mouse.

FIG. 29 is a flowchart showing a flow of a process of acquiring additional stroke information with a mouse.

[Fig. 30] Fig. 30 is a schematic diagram exemplifying information indicating a drawing stroke during writing.

FIG. 31 is a schematic diagram illustrating a data block that manages editing information.

[Fig. 32] Fig. 32 is a schematic diagram exemplifying a data block that manages correction information that is a quadrangle.

[Fig. 33] Fig. 33 is a schematic diagram exemplifying a data block that manages editing information that is text information.

[Fig. 34] Fig. 34 is a schematic diagram illustrating a data block that manages a line type of editing information.

FIG. 35 is a schematic diagram illustrating a correction toolbar.

FIG. 36 is a schematic diagram showing a state in which a correction toolbar appears in a document.

FIG. 37 is a schematic diagram showing a data block of editing information.

FIG. 38 is a schematic diagram illustrating an editing history.

[Fig. 39] Fig. 39 is a schematic diagram illustrating an extension function realized by a combination of an extension program for an editing function and an extension program for a communication function.

[Fig. 40] Fig. 40 is a schematic diagram illustrating an extension function realized by a combination of an extension program for a writing function, an extension program for a recording function, and an extension program for a communication function.

[Fig. 41] Fig. 41 is a schematic diagram for explaining a process of searching for a word / phrase in document information in which the correction information is corrected.

[Explanation of symbols]

102 display information file (document arrangement information) 103 digital information file (text information) 104 digital information file (media information) 105 operation program file 112A digital information display program 112B functional operation program 301 computer (personal computer) 310 display

Claims (18)

[Claims] 1. A digital information file having document information browsed by a computer, correction information added to the document information and stored separately from the document information, and correction information added to the document information. A data structure of a document, which includes: a program having an editing function for editing and a display function for displaying the document information and the editing information in a layered manner. 2. One or more digital information files that are representation entities on a document, a display information file that specifies a structure of the digital information file and a display state on the document, and are both interpreted by a computer. A digital information display program that is executed and displays the one or more digital information files on the display of the computer in a display state specified based on the display information file, and a unique program without referring to the digital information. An operation program file including a function operation program for executing a function, wherein the function operation program is a correction function for correcting the correction information on the document information included in the digital information file; and the document information. And a display function for displaying the additional information and the additional information, and a storage function for storing the additional information. Data structure of the document with functionality and, a. 3. The data structure of a document according to claim 2, further comprising encapsulation means for encapsulating the digital information file, the display information file, and the operation program file as a single document. 4. The data structure of a document according to claim 2, wherein the functional operation program has a function of changing display densities of the editing information and the document information in inverse proportion. 5. A document information display plane for displaying the document information, and a correction information display plane for displaying the correction information overlaid on the front surface of the document information display plane, wherein the functional operation program is arranged on the document information display plane. 4. The data structure of the document according to claim 2, wherein the editing information display plane is transparently displayed based on the set transparency. 6. The functional operation program provides the editing function with a line mode for adding a line segment connecting an editing start point and an editing end point, and a freehand mode for continuously connecting the editing points. Data structure of the document of Item 2 or 3. 7. The data of the document according to claim 2, wherein the functional operation program adds a line segment addition mode for adding a line segment and a text addition mode for adding a text font to the addition function. Construction. 8. The data structure of a document according to claim 2, wherein the functional operation program provides the editing function with an editing mode for editing a line segment having a different line width or a line segment having a different color. 9. The data structure of a document according to claim 8, wherein the functional operation program provides the editing function with a function of searching the editing information by a line width or a color of a line segment of the editing information. 10. The functional operation program includes a first mode for allowing the editing function to add only horizontally or vertically to the document information, and a second mode for allowing the addition at an arbitrary angle. The data structure of the document according to claim 2, wherein 11. The functional operation program is configured such that a free dot mode in which a correction start position and a correction end position are allowed only in display pixel units, and a correction start position and a correction end position are preset in the correction function. A prescribed dot mode which is allowed only at the position is added.
Or the data structure of the document described in 3. 12. The data structure of a document according to claim 2, wherein the functional operation program provides the editing function with a function that allows movement or deletion of all or part of the editing information. 13. The data structure of the document according to claim 2, wherein the functional operation program provides the editing function with a function of recording an editing history of the editing information. 14. The data structure of a document according to claim 2, wherein the functional operation program has a function of transmitting the correction information to a document having the same content and activated on another computer. 15. A digital information file having document information browsed by a computer, editing information added to the document information and stored separately from the document information, and editing information added to the document information. A storage medium for storing a data structure of a document, which includes a program having an editing function for performing the above and a display function for displaying the document information and the editing information in a layered manner. 16. One or more digital information files that are representation entities on a document, a display information file that specifies a structure of the digital information file and a display state on the document, and are interpreted together by a computer. A digital information display program that is executed and displays the one or more digital information files on the display of the computer in a display state specified based on the display information file, and a unique program without referring to the digital information. An operation program file including a function operation program for executing a function, wherein the function operation program is a correction function for correcting the correction information on the document information included in the digital information file; and the document information. And a display function for displaying the additional information and the additional information, and saving the additional information. Storage medium for storing a data structure of a document having a presence function, a. 17. A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is a digital information file having document information browsed by the computer, and the data structure is added to the document information. And a program having a writing function that is stored separately from the document information, a writing function that adds the writing information on the document information, and a display function that displays the document information and the writing information in a layered manner. An information processing apparatus comprising: 18. A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representation entities on the document, and the digital information file. And a display information file that specifies a display state on the document and a display information file that is interpreted and executed together by a computer and is displayed based on the display information file. A digital information display program to be displayed on a display of a computer, and an operation program file including a function operation program for executing a specific function without referring to the digital information, and the function operation program, Add correction information to the document information included in the digital information file. It has a revision function of brush, and a display function of displaying overlaid with the document information and the revision information, and a storage function of storing the revision information, the information processing apparatus.