JP2003099447A - Document data structure, storage medium and information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To browse a desired digital information file without preparing environment by previously installing a specific operation program file to a computer, and to easily understand the content of the digital information file. SOLUTION: A set is formed of one or more digital information files 103 and 104 which serve as expression substance on a document, a display information file 102 for specifying the structure and a displaying state on the document of the digital information files 103 and 104, and an operation program file 105 which displays the one or more digital information files 103 and 104 interpreted, executed and specified by the computer based on the display information file 102 on the display of the computer. The digital information files 103 and 104 are partially summarized and displayed to facilitate understanding of it.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data structure of a document that can be viewed and managed by a computer (digital information processing device), a storage medium storing the data structure of the document, and an information processing device.

[0002]

2. Description of the Related Art In recent years, various types of documents have been created and are in widespread use as information transmission media that can be browsed using a computer (digital information processing device).
Typical formats of such documents are, for example, text, rich text, multimedia, PDF, HT.
There are ML, MHTML, XML, etc. So first,
An overview of these various types of documents, based on their development history.

[Text, Rich Text, Multimedia] Among digital (electronic) documents that can be handled by a computer (digital information processing apparatus), a typical text document expressing text by a character code, There are rich text documents in which a plurality of character fonts can be used in a text document, and multimedia documents in which figures, images, moving images, voices, etc. can be pasted.

Usually, a text document uses a character code common to general computers. Therefore, in a general computer, the operation system is generally provided with an application software called a text editor capable of browsing and editing such a text document.

When information is sent and received by electronic mail, text information can be sent and received to exchange information, and recently, electronic mail software that can send and receive a document expressed in rich text is also available. It is becoming popular.

On the other hand, a multimedia document has
Although there is no uniform format, at present, the office (product name) including Microsoft's word (product name) is widely used, so this office format is treated as if it were a standard format. It is the current situation.

However, when the office format is used for the multimedia document, the user purchases the application software called Microsoft Office, which has a document creation function, just by browsing the multimedia document. You need to install it on your computer.

[PDF] On the other hand, a PDF format developed by Adobe Systems Incorporated is known as a document format compatible with multimedia documents. This format helps reduce the user's disadvantages seen in the word format by distributing the application for browsing the document for free, while paying the application for creating the document.

[0009] However, although the financial burden on the user for viewing the document is eliminated, the user still needs to install the viewing software of Adobe Co., Ltd. in order to view the PDF document.

[HTML] On the other hand, in recent years, information has been transferred to HTML (Hyper Text Markup) due to the spread of the Internet.
It is common to describe information in a language called "Language" and convey information.

The HTML document initially spread widely as a language used in application software called a navigator developed by Netscape Co., Ltd., and contributed to the rapid spread of the Internet.

[0012] After that, Microsoft Corp. installed the software called Internet Explorer, which uses the HTML language, as a standard in Windows, which is an operating system widely manufactured and sold by itself. This gives the user the impression that it is distributed free of charge, and, unlike the PDF file of Adobe, does not require the user to install the browsing software. Currently, Internet Explorer has exploded and is treated as if it were the standard format for browsing the Internet.

However, such an HTML document has a major drawback as a format for creating an ordinary document because of its occurrence. As a method of browsing documents on the Internet, when the information written in HTML is a document, the user's computer visually displays the document according to the HTML tag rule, whereas when the information is an image. Means that the information of the image does not exist in the displayed HTML information. That is, when the information is an image, only the reference destination and the layout information of the image are described in the HTML information, and the browsing software installed in the user's computer has such a description. Based on the arrangement information, the image data is downloaded from the server to the user's computer and displayed. More specifically, the current HTML document includes text information and arrangement information for laying out each information in the document, but for other images and moving images, refer to the reference destination where they are stored. Just by describing it, the actual image information and moving image information are stored in another place.

Therefore, the installer side of the HTML document is
In order to properly display an image or similar contents in a TML document, there is a complexity that an image file or the like has to be arranged at the reference destination described in the HTML information. In addition, the user who is a viewer of the HTML document needs to pay attention to the positions and names of these reference files in order to correctly handle the HTML document. Then, both the installer side and the user side of the HTML document try to save and manage such a reference file itself, which is extremely complicated.

[MHTML] In order to solve these problems, the Internet standard organization RFC defines MHTM.
The L format is a format format in which multimedia contents are stored together with HTML information. According to the MHTML format, a multimedia document including images and the like can be browsed by browsing software compatible with this standard.

However, MHTML has some problems because it extends HTML.

One of them is not to hold image data and the like as normal binary data but to hold as a character code represented by hexadecimal characters (0 to 9 and A to F). This is because the HTML file described in HTML is constructed so that the description content can be viewed with a text editor.

As another problem, since the MHTML document is stored in the same file as the layout information for displaying the image and the like, it is not possible to easily extract only the image or grasp the description content. There is also a problem.

From the above, at the present time, the document locally used in the personal computer is still a word document, and the document on the Internet is HT.
ML documents are used to separate houses.

[XML] On the other hand, in recent years, XML has been used.
A document format called (Extensible Markup Language) that connects the Internet and a local document has also been proposed.

The advantage of XML is that the user can define a portion corresponding to an HTML tag.
The fact that each software maker describes the data including the document in binary in its own format is that it is described in the text format that can be read and understood by a simple text editor using tags. However, XML defines a method of describing data, and a program for interpreting and executing the program, a program execution environment, and a computer (digital information processing device) are required for actual operation. Therefore, in order to display the document described in XML, a program therefor is required, and even when the same document described in XML is displayed, the display contents will be different if the programs are different. Similarly, a computer (digital information processing device)
The behavior also differs depending on the type of the program and the type of program execution environment.

In other words, in XML, even if the formats of data to be processed can be unified, it is not possible to unify the program and the computer (digital information processing device) for executing the formats.

[Multi-Platform Program Environment] Therefore, at present, a multi-platform program environment that is independent of the type of computer (digital information processing device), in other words, the type of operating system is proposed. Typical examples are JAVA of Sun Microsystems and NET concept of Microsoft. As a result, the document is described in the XML format, and the information described in the multi-platform language such as JAVA is processed, so that the type of computer (digital information processing device) (type of operation system)
There is an environment in which documents can be viewed, created, etc. without depending on.

In Japanese Patent Laid-Open No. 2000-353120, X
A combination of the ML format and JAVA is disclosed. The Japanese Patent Laid-Open No. 2000-353120 discloses that an XML document is read and a program described in JAVA is executed based on the read information.

Japanese Patent Application Laid-Open No. 09-134349 discloses that
It describes a data description in XML format and a document defining the program operation according to the data description.

The examples described in these publications are XML.
A program is started based on the description such as, and thereby multimedia contents and documents are displayed. In other words, the concept is to describe data using a descriptor such as XML for a combination of conventional data and an application that executes the data. As a result, data such as a document can be described in a general-purpose manner, and an application program for displaying a document or the like is created by using JAVA or the like, and a document can be browsed by this application program, so that the document can be displayed on different platforms. Can be viewed.

However, there is a problem in that there is no guarantee that it will operate normally if the application program for displaying a document is installed in a computer (digital information processing apparatus) or if the version of the application program is changed. In other words, when a certain document is desired to be stored for a long period of time, it is necessary to store an application program for displaying it, which is extremely complicated.

Furthermore, the document introduced in the above publication has another problem that a plurality of files make up the document. For this, JP-A-1
Japanese Patent Laid-Open No. 1-143906 discloses storing a plurality of WEB page files in a book format, which is apparently displayed in a book-like format. The contents are not managed as one file.

[0029]

At present, electronic documents represented by digital information have become widespread due to the development of computers and the spread of the Internet. In order to create, edit, save, browse, etc. such an electronic document, the following conditions are required. 1. Hardware (computer) that actually executes processing 1. Operation system (OS) that causes a computer to perform processing 3. Software (application software) for reading and displaying document information, editing, etc. 4. Document information (data file) in which document contents are expressed in a defined digital expression, that is, an electronic document cannot be browsed unless these four conditions are met. Of these four conditions, an operating system such as Windows is installed in the computer, and the computer and the operating system have a one-to-one relationship. Therefore, the user installs a typical application program suitable for the computer and operating system on the computer, and creates and browses documents.

Therefore, when creating, editing, saving, browsing, etc. of electronic documents, compatibility between the computer and operating system and the application programs is important. In other words, when trying to browse a certain document, if the viewer has not installed an application program that is the same as or compatible with the application program used by the creator of the document on his / her computer, he / she can browse the document. Is impossible. In this case, even if a document is created and browsed by the same application program, browsing may not be performed normally if the versions are different. Because of this, handling of electronic documents is extremely inconvenient.

Next, as the document format of the electronic document, as described above, text, rich text, PDF, HT
While there are various formats such as ML, MHTML, XML, etc.
It is no exaggeration to say that it is roughly divided into Microsoft office documents and WEB documents viewed with a WEB browser. However, the office document of Microsoft Corporation has a problem that an office application for browsing the document is required. Also, the WEB document is
Since it is a document specialized for the Internet, there is a problem that a single document is composed of multiple files and management is complicated due to the structure in which multiple files existing on the server are called by a browser and displayed. .

Furthermore, in recent years, due to the rapid spread of computers, especially personal computers, and the improvement of their processing capabilities, digital documents handle not only conventional character representations (texts) but also still images, moving images, and voices. Is becoming possible. Therefore, in a personal computer, it is possible to create and view a document form that mixes a plurality of media in which the document form cultivated in the conventional type document and the image cultivated in radio and television are fused. Has become. Documents of such a form have been distributed and distributed through a global network represented by the Internet today. Such digital documents are
Generally called a multimedia document.

Here, since the multimedia document includes a plurality of media, a plurality of application programs are required for viewing and reproducing the media. In other words, in order to browse and play multimedia documents, 1. Application program required for browsing 2. The same creation and viewing environment is required between the creator and the viewer. Multiple files needed to represent a single document 4. There are many problems such as the need to store an application program for browsing in order to browse the stored past documents. Therefore, it is difficult for general users to handle multimedia documents.

An object of the present invention is to make it possible to browse a desired digital information file without installing a specific operation program file in a computer in advance and preparing the environment.

An object of the present invention is to enable one or more digital information files to be handled as a single document regardless of the format, thereby facilitating document management. Is.

[0036]

The invention of a data structure of a document according to claim 1 is a representation entity on the document 1 or 2
The digital information file described above, the display information file that specifies the structure of the digital information file and the display state on the document, the display state that is interpreted and executed by a computer, and is specified based on the display information file An operation program file for displaying one or more digital information files on the display of the computer, wherein the operation program file is a summary program for displaying a part of the digital information file in summary. According to this summary program, a part of the digital information file can be summarized and displayed.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since such a digital information file, display information file and operation program file are grouped, if the operation program file is interpreted and executed by a computer, the digital information file can be browsed, and only the operation program file can be viewed. There is no need to pre-install it on your computer. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Further, since the document content indicated by the digital information file is shown as a summary, it is easy to understand the document content when browsing the summary, and the presentation effect can be improved, for example, at a presentation site.

According to a second aspect of the invention, in the data structure of the document according to the first aspect, an encapsulation means for encapsulating the digital information file, the display information file and the operation program file as a single document. Have.

Therefore, since the digital information file, the display information file and the operation program file are encapsulated as a single document by the encapsulation means, their handling and management are extremely easy. In particular,
Since the summary of the digital information file is also encapsulated as a single document, it is possible to manage all the information collectively and facilitate its handling.

According to a third aspect of the present invention, in the data structure of the document according to the first or second aspect, the summary of the digital information file is composed of a plurality of display elements, and the display information file sequentially displays those display elements. Contains information for switching display.

Therefore, the display elements forming the summary of the digital information file are sequentially switched and displayed based on the information for sequentially switching and displaying the display elements included in the display information file. Therefore, when browsing the summary, it is easy to understand the summary. In addition, for example, at a presentation site, the presentation effect can be improved.

The invention according to claim 4 is the data structure of the document according to claim 1, 2 or 3, wherein the display information file is a structure for summarizing the digital information file and a display state on the document. Contains information that identifies the.

Therefore, by referring to the display information file, it is possible to easily obtain information for sequentially switching and displaying the display elements included in the display information file.

According to a fifth aspect of the present invention, in the data structure of the document according to the first, second or third aspect, the summarization program creates a summarization frame different from a display frame for displaying the digital information file. , A part of the digital information file is displayed in the summary frame.

Therefore, the document content based on the digital information file and the summary thereof can be simultaneously browsed, and the document content based on the digital information file can be easily understood when browsing the summary. Further, for example, in the case of a presentation, the presenter can easily understand, based on the summary, the place where the presenter is currently explaining the document contents based on the digital information file.

According to a sixth aspect of the invention, in the data structure of the document according to the third aspect, the display elements for the summary of the digital information file are sequentially switched and displayed based on an operation.

Therefore, the display elements included in the display information file are arbitrarily switched and displayed based on the operation of the operator. Therefore, when browsing the abstract, it becomes possible to browse the abstract at a pace of self-understanding, and, for example, in the case of a presentation, the presenter can advance the presentation based on the document content based on the digital information file at his own pace. Is possible.

According to a seventh aspect of the present invention, in the data structure of the document according to the third aspect, the display elements for the summary of the digital information file are sequentially switched and displayed based on a preset time interval.

Therefore, the display elements included in the display information file are automatically switched and displayed without requiring any special operation by the operator. Therefore, the abstract can be browsed without requiring any special operation when browsing the abstract, and, for example, in the case of a presentation, the presenter can concentrate on the presentation and proceed with the presentation.

According to an eighth aspect of the present invention, in the data structure of the document according to the fifth aspect, a display location of the digital information file corresponding to a summary display of a part of the digital information file displayed in the summary frame. Is highlighted.

Therefore, the corresponding portion of the summary in the digital information file is highlighted, which makes it easier to understand the document contents based on the digital information file.

According to a ninth aspect of the present invention, in the data structure of the document according to the fifth aspect, the display program has a voice synthesizing function, and when the digital information file is text information, the text information is stored. The voice corresponding to is synthesized and played.

Therefore, the content of the document based on the digital information file which is the text information is reproduced by voice, and the reader's time and effort for reading can be saved and the understanding of the content of the document can be facilitated.

According to a tenth aspect of the present invention, in the data structure of the document according to the fifth aspect, the display program has a moving image regenerating function, and when the digital information file is moving image information, the moving image is moved. Play some of the information.

Therefore, by reproducing a part of the digital information file which is the moving picture information, the viewer can understand the contents without seeing the redundant moving picture. The browsing time can be shortened.

The invention of a storage medium according to claim 11 is one or more digital information files which are the representation entities on a document, and a display for specifying the structure of the digital information file and the display state on the document. An information file; and an operation program file that is interpreted and executed by a computer to display the one or more digital information files on a display of the computer in a display state specified based on the display information file. ,
The operation program file includes a summarization program for summarizing and displaying a part of the digital information file, and stores a data structure of a document capable of summarizing and displaying a part of the digital information file according to the summarization program. To do.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since such a digital information file, display information file and operation program file are grouped, if the operation program file is interpreted and executed by a computer, the digital information file can be browsed, and only the operation program file can be viewed. There is no need to pre-install it on your computer. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Further, since the document content indicated by the digital information file is shown as a summary, it is easy to understand the document content when browsing the summary, and the presentation effect can be improved, for example, at a presentation site.

An invention of a document information processing apparatus according to claim 12 includes a computer and a data structure of a document which can be browsed by the computer, and the data structure of the document is a representation entity on the document 1 or Two or more digital information files, a display information file that specifies the structure of the digital information file and a display state on the document, and a display state that is interpreted and executed by a computer and is specified based on the display information file. An operation program file for displaying the one or more digital information files on the display of the computer;
The operation program file includes a summarization program for summarizing and displaying a part of the digital information file, and a part of the digital information file can be summarized and displayed according to the summarization program.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since such a digital information file, display information file and operation program file are grouped, if the operation program file is interpreted and executed by a computer, the digital information file can be browsed, and only the operation program file can be viewed. There is no need to pre-install it on your computer. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Further, since the document content indicated by the digital information file is shown as a summary, it is easy to understand the document content when browsing the summary, and the presentation effect can be improved, for example, at a presentation site.

[0060]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described with reference to the drawings.

[Data Structure of Document (Encapsulated Document)]
FIG. 1 is a schematic diagram showing a data structure of an encapsulated document which is an encapsulated document.

As shown in FIG. 1, the encapsulated document 101 is a document arrangement information 102 as a display information file showing a display state such as a structure and an arrangement of the entire document, and a digital information file showing text contents in the document. Text information 103, other media information 104 as a digital information file representing a still image or a moving image, and a program 105 as a plurality of operation program files for displaying document contents and detecting user operations. Has been done. Each of these pieces of information has a structure of an individual file unit that can be managed by a general personal computer operating system.

Such an encapsulated document 101 is a magnetic storage medium such as a floppy (registered trademark) disk, a hard disk, a magnetic tape, a CD or a CD-RO.
M, CD-R, CD-RW, DVD-ROM, DVD-
It can be stored in various storage media such as an optical storage medium such as RAM, and can be easily carried depending on the type of storage medium. Also, the encapsulated document 101
Can be transmitted via various communication lines such as RAN and the Internet.

FIG. 2 is a schematic diagram showing an example of the data structure of the archive file, and FIG. 3 is a schematic diagram showing an example of another data structure of the archive file.

Each of the files 102, 103, 104, and 105 forming the encapsulated document 101 is stored in one file called an archive file 201, as illustrated in FIGS. 2 and 3. As a result, the document arrangement information 10
2 (display information file), text information 103 (digital information file), media information 104 (digital information file), and program 105 (operation program file) are encapsulated as a single document. Has been done. Such an archive file 2
The 01 file format generally includes the ZIP format and the LHA format, and these techniques may be used.

Here, the archive file 201 has a file structure for storing a plurality of files 102, 103, 104, 105 as one file (archive file 201). Such an archive file 201 uses a archiver program having a storage function and a decompression function, so that a plurality of files 1 can be stored according to a user's request.
02, 103, 104, and 105 can be handled as one file (archive file 201).

In the archive file 201 illustrated in FIG. 2,
Each file 102, 10 is added to the archive file 201 that stores a plurality of files 102, 103, 104, 105.
Index information indicating which positions in the archive file 201, 3, 104 and 105 are located is added. As a result, it becomes possible to search the positions of the files 102, 103, 104 and 105. In addition, as another embodiment,
Like the archive file 201 illustrated in FIG. 3, the header information is added to each of the files 102, 103, 104, and 105, and the file 102, 10
It is also possible to adopt a method that enables position retrieval of 3, 104, and 105.

As described above, the file structure of the encapsulated document 101 has a plurality of files 102, 103, 104, 10 as shown in FIG.
5 is an index (see FIG. 2) or header (see FIG. 3)
It is an archive file format managed by. In this way, the encapsulated document 101 becomes a plurality of files 102, 103, 1
Since 04 and 105 are encapsulated as one archive file 201, the user can apparently manage and store a plurality of files 102, 103, 104 and 105 as one document.

FIG. 4 is a schematic diagram showing a data structure of a program stored in the encapsulated document 101, and FIG. 5 is a schematic diagram showing a data structure of a display information file that defines information about an extension program included in the program. Is.

The program 105, which is a plurality of operation program files stored in the encapsulated document 101.
Is composed of a basic program 111 and an extension program 112, as shown in FIG.

The basic program 111 is a program that can be called when the encapsulated document 101 is activated, and only one program exists in common to all encapsulated documents 101. This basic program 111
Includes a startup program (not shown), which is interpreted by the personal computer 301 in response to access to the encapsulated document 101 by the personal computer 301.
It is executed and started.

The extension program 112 is a program added according to the contents included in the encapsulated document 101, and is prepared according to the type of display medium, for example, as shown in FIG. As an example, when the digital information file included in the encapsulated document 101 is only the text information 103, the basic program 111
In addition to the Text P of the extension program 112
The annel program 112a is stored in the encapsulated document 101. When the media information 104, which is a digital information file representing a still image or a moving image, is included in the encapsulated document 101, in addition to the basic program 111, I
image Panel program 112b, Movei
The Panel program 112c and the 3D Panel program 112d are stored in the encapsulated document 101. The basic program 111 includes a startup program (not shown), and the personal computer 301
When the encapsulated document 101 is accessed by the user, or when necessary, the personal computer 301 interprets, executes, and activates.

FIG. 5 shows an example of the extension program reference file 113. The extension program reference file 113 defines the extension program 112, the tag 114 and the operation 115 corresponding to the extension program 112. Such an extended program reference file 113 is stored in the encapsulated document 101 as the program 105.

Next, the document arrangement information 102 will be described. The document arrangement information 102 is a file that describes the arrangement, display size, files of each medium, etc. of each medium of the encapsulated document 101. In the present embodiment, the description of these pieces of information is described in a general-purpose XML format.

FIG. 6 is a schematic diagram showing an example of the encapsulated document 101 described in XML. XML is
As shown in FIG. 6, an example thereof is a file format in which each element is described by a tag, and a document is described by a collection of elements called tags. In this case, it is possible to have a nested structure in which tags are described in tags.
It is also possible to add attributes to each tag by what is called an attribute that represents the attributes of the tag.

FIG. 7 is a schematic diagram showing a display example of the encapsulated document 101 described in XML as shown in FIG. Encapsulated document 101 as shown in FIG.
Is displayed based on the XML description illustrated in FIG. First, a tag <Document> representing the entire document is described, and the document structure is described in this tag. Then, to describe the title first, <TEXT
The display content when the tag> is used displays the content in the tag when the attribute is omitted.
The following TEXT tag example shows the text information as "Body.TX.
This is an example of reading from a file called "T". Next IMA
The GE tag is a still image called "image.JPG" in X, Y
The layout information is such that the coordinates are displayed in the size designated by WIDTH and HIGH from the starting point.

As described above, the document layout information 102 is the XM
The L format is used to instruct a file and an arrangement.

Although the document layout information 102 has been described by taking the XML format as an example, other description languages such as the HTML format may be used, or a unique description format may be used.

The remaining still image, moving image, 3D
The media information 104 representing images, audio information, etc. may be a general-purpose file format, or may be a unique format in the case of special specifications.

As described above, the file structure of the encapsulated document 101 has a plurality of document arrangement information 102 representing the structure of the entire document and a plurality of text information files and image files displayed corresponding to the document arrangement information 102. Media files (text information 103 and media information 104)
And a plurality of programs 105 group.

[Browsing of Encapsulated Document 101] Here, the basic operation of the encapsulated document 101, from the document activation to the document browsing, will be described. Therefore,
For comparison with the encapsulated document 101, the operation of a general personal computer and the conventional document browsing operation will be described.

FIG. 8 is a hardware configuration diagram of a general personal computer 301 (computer).
The personal computer 301 is a CP that processes information.
U302, ROM303 and RAM3 for storing information
04, etc., a primary storage device 305, a secondary storage device 307 such as an HDD 306 (hard disk drive) for storing processing results, etc., and a removable medium 308 such as a CD-ROM for storing, distributing, and obtaining information outside. A network 309 for transmitting information by communication with other external computers, a display 310 for displaying the progress and results of processing to the operator, a keyboard 311 for the operator to input commands and information to the personal computer 301. And a mouse 312 and the like, and transmits / receives data transmitted / received between these units to / from the bus controller 31.
3 is arbitrating and operating.

Generally, a personal computer 301
Then, when the user turns on the power, the CPU 302 causes the ROM
Start the program called loader in 303 and
A program called an operating system, which manages computer hardware and software, is loaded into the RAM 304 from D306, and this operating system is activated. Such an operating system starts a program, reads information, and saves it according to a user's operation. A typical operating system is Windows
s (registered trademark), UNIX and the like are known. Programs running on these operating systems are called applications.

FIG. 9 is a flowchart showing the flow of a conventional document browsing process using the personal computer 301. As a conventional document browsing process, as shown in FIG. 9, an application program for document browsing is activated (step S101), and a document file conforming to the format of this application program is read from the activated application program (step S101).
102), which is displayed (step S103). In addition, such processing has a mechanism in which when a user selects and starts (for example, double-clicks) a document file with the mouse 312 or the like, an application program associated with the selected document file is started. Is common. In other words, the conventional document file browsing processing method in the personal computer 301 is to read the document data from the application program. Therefore, in order to display and edit the document included in the document file, the application program corresponding to the document is indispensable.

FIG. 10 shows a personal computer 301.
7 is a flowchart showing a flow of a document browsing process of the encapsulated document 101 using the. In the present embodiment, such a personal computer 301 and the encapsulated document 1
An information processing device is configured by 01 and.

The encapsulated document 101 is the text information 1
03 and media information 104, an icon file relating to an icon (not shown) for displaying on the personal computer 301 an icon corresponding to the actual data thereof is included. Therefore, since an icon according to this icon file is displayed on the personal computer 301, when the user selects and activates (double-clicks) the icon corresponding to the substance data of the encapsulated document 101 with the mouse 312 or the like, the encapsulated document is displayed. The basic program 111 stored in the archive format as the archive file 201 in 101 is activated (step S20).
1). After starting, the basic program 111 creates a display window for displaying a document (step S
202). Then, the basic program 111 is the document layout information 10 in the archive file 201 described in XML or the like.
2 is read (step S203).

The basic program 111 is the document layout information 1
After reading 02, the tag structure is analyzed (step S2
04), the extension program 112 corresponding to the tag name as illustrated in FIG.
The attribute described in 02 is passed to each extension program 112 (step S205). Basic program 1
The processing unit 11 performs such processing until the processing is completed for all tags in the document arrangement information 102 stored in the encapsulated document 101 (step S206), whereby the plurality of extension programs 112 described in the document arrangement information 102. Is started in another thread (step S20)
5).

Each extension program 112 analyzes the attributes received from the basic program 111 (step S207), and outputs the necessary text information 103 and media information 104 according to the contents of the attributes from the archive file 201 in the encapsulated document 101. Read (step S208). Then, each extension program 112
Displays the text information 103 and the media information 104 in an area having a size corresponding to the attribute in the window created by the basic program 111 (step S209). By performing such processing, the encapsulated document 101 can display a plurality of text information 103 and media information 104 in a window secured by the basic program 111.

Further, when the expansion program 112 recognizes the occurrence of various events after such display (Y in step S210), it executes the process according to the recognized event (step S211). In this way, the encapsulated document 101 can display the document with a structure that is fundamentally different from the conventional document.

[Description Method of Program 105 Included in Encapsulated Document 101] Next, the encapsulated document 10
The description of the program 105 included in 1 will be described.

When writing the program 105, a plurality of methods can be implemented.

The first method is to create the program 105 in the C programming language, which is currently the most popular language,
This is an example of using a native code in a format that can be directly executed by the CPU 302 by a C language compiler. In this case, the basic program 111 is executed in the execution format (Windows
In the EXE format), each extension program 112 is created in the library format (DLL format in Windows), and the document arrangement information 102, digital information files (text information 103 and media information 104) stored in the archive structure, and these The program 105 may be searched by the index or the header, and the searched program 105 may be designated as the basic program 111. However, in this method, the code of the CPU 302 is
Since it is limited to 302 types, it is not a very good method.

The second method is to use an interpreter language such as JAVA language. This is to construct a program with abstract intermediate code without using the execution code, convert the intermediate code into a native code that can be understood by the CPU 302 at the time of execution, and the CPU 302 executes the native code. By using this method, the CPU3
It is possible to use the encapsulated document 101 on a multi-platform regardless of the 02 type.

As described above, in the encapsulated document 101 of this embodiment, the basic program 111 is first activated,
The startup program reads various information from the document arrangement information 102 and operates the extension program 112 that conforms to the information.

As the extension program 112, as described above, a program corresponding to the tag type of the document layout information 102 described in XML or the like may be prepared and the extension program 112 may be activated. The extension program 112 may be started according to the types of various digital information files (text information 103, media information 104) from which the tag attribute information is read. For example, in FIG.
As shown in (1), there are a plurality of typical formats of moving images when displaying and reproducing moving image information. Therefore, if one expansion program 112 is created to display all of the plurality of moving images, it becomes a large program. Therefore, in FIG.
As shown in FIG. 1, a plurality of extension programs 112 are prepared according to the file format, and the encapsulated document 10
It suffices to encapsulate the extension program 112 that fits a specific type of file format in the No. 1 program.

[Extension Program 112] FIG. 12 is a schematic diagram showing types of the extension program 112. The extension program 112 is a digital information display program 1 for displaying and reproducing digital information, as illustrated in FIG.
Not only 12A but also a functional operation program 112B that provides a specific function without reading digital information. Alternatively, the digital information display program 112A and the functional operation program 112B in the extension program 112 are the auxiliary programs 1 that assist them.
It may have 12C.

Here, an example of the functions executed by the functional operation program 112B and the auxiliary program 112C will be described.

As an example, it is assumed that the document is longer than the display size of the display 310 of the personal computer 301 and extends over a plurality of pages. In this case, as illustrated in FIG. 13, a page turning button 118 as a function panel described as “next page”, for example.
Should appear on the display 310. As shown in FIG. 14, the tag <PAGE> is described in the document arrangement information 102, and the PAG corresponding to this tag is written.
The function operation program 112B is provided with the function of the extension program 112 called E Button. As a result, the function operation program 112B called PAGE Button is activated, and the page turning button 118 as shown in FIG. 13 appears in the document. When the user presses the button by a method such as clicking the mouse 312, the page turning function is provided. Provided.

Here, when the user presses the button, the extension program 112 determines the detection of an event as shown in the flowchart of FIG. 10 (step S21).
(Y of 0), the corresponding event operation is executed (step S211). The event operation here is a page turning function executed by the function operation program 112B and the auxiliary program 112C.

As another example, the functional operation program 112B for displaying the function of displaying document information such as the number of pages, the date of creation, the total number of words, etc. can be implemented.

Next, as an example of the functions executed by the extension program 112 and the auxiliary program 112C that assists the extension program 112, an example of a moving image reproduction function will be introduced.
In the moving image playback function, since the basic display portion can be used in common with any moving image file format, the basic extension program 11
2 uses the same one, but for the part that depends on the file format of the moving picture, the auxiliary program 1
There is an example of setting to 12C. For example, as shown in FIG. 15, the encoding portion of the file may be the auxiliary program 112C.

Next, a specific example of the extension program 112 will be described.

First, the function of the extension program 112, which is based on the premise that the encapsulated document 101 includes a plurality of digital information files (text information 103, media information 104), will be described.

The extension program 112 uses the display 3
A file specifying panel (not shown) is displayed at 10. This file specification panel is the encapsulated document 1
This is a panel listing a plurality of digital information files (text information 103, media information 104) included in 01 so that they can be selected and instructed. So, for example, mouse 31
When an arbitrary digital information file (text information 103, media information 104) is selected and instructed by a method such as clicking by 2, the extension program 112 determines event detection (see the flowchart shown in FIG. 10). In step S210, Y), the corresponding event operation is executed (step S211).

As an event operation here, the extension program 112 executes an operation of displaying the digital information file (text information 103, media information 104) selected and instructed on the display 310.

Next, the function of the extension program 112, which is premised on that the encapsulated document 101 includes an image file of a still image as the media information 104, will be described.

As shown in FIG. 16, the extension program 11
2 displays a still image 121 in the document displayed on the display 310. The display area of the still image 121 included in the document on the display 310 is the mouse 31.
When the selection instruction is given by clicking or the like by 2, the extension program 112 determines the detection of an event (Y in step S210) and executes the corresponding event operation (step S2), as shown in the flowchart of FIG.
11).

As an event operation here, the extension program 112 creates and displays a function panel 122 which is another frame for enlargement / reduction display as shown in FIG. The function panel 122 includes an enlarge button 124 and a reduce button 125 together with an enlarged or reduced image 123 of the still image 121.
I will provide a. Therefore, when one of the buttons 124 and 125 is selected and instructed, the extension program 112 executes the enlargement rate or reduction rate change processing in response to the selection instruction.

Expansion program 112 for displaying a still image
By adding such a new function to, the user's visibility can be significantly improved as compared with simply pasting the still image 121 in the document.

The enlargement / reduction function of the extension program 112 can be realized by any well-known enlargement / reduction function.

Next, the function of the extension program 112, which is based on the premise that the stereoscopic image file is included as the media information 104 in the encapsulated document 101, will be described.

As shown in FIG. 17, the extension program 11
2 displays a stereoscopic image 131 in the document displayed on the display 310. The display area of the stereoscopic image 131 included in the document on the display 310 is the mouse 31.
When the selection instruction is given by clicking or the like by 2, the extension program 112 determines the detection of an event (Y in step S210) and executes the corresponding event operation (step S2), as shown in the flowchart of FIG.
11).

As an event operation here, the extension program 112 causes the pop-up frame 13 including the image 132 for enlarging, reducing or displaying the stereoscopic image 131 as it is.
3 is displayed, and a viewpoint changing button 134 for switching the viewpoint is arranged on the pop-up frame 133.
Then, when any of the viewpoint changing buttons 134 is selected and instructed, the extension program 112 switches the viewpoint according to the selected viewpoint changing button 134.

As a result, the visibility of the user can be improved.

Next, the function of the extension program 112, which is premised on that the moving image image file is included as the media information 104 in the encapsulated document 101, will be described.

As shown in FIG. 18, the extension program 11
2 displays a still image 141 defined by one frame of a moving image in the document displayed on the display 310. Then, when the display area of the still image 141 included in the document on the display 310 is selected and instructed by clicking with the mouse 312 or the like, the extension program 11
2, as shown in the flowchart of FIG. 10, the event detection is determined (Y of step S210), and the corresponding event operation is executed (step S211).

As an event operation here, the extension program 112 causes the pop-up frame 14 including the image 142 for enlarging, reducing, or displaying the still image 141 as it is.
3 is displayed, and a play button 144, a stop button 145, and a pause button 146 are displayed in the pop-up frame 143.
The operation button 147 consisting of appears. Then, when any of the buttons 144, 145, 146 included in the operation buttons 147 is instructed to be selected by a method such as clicking the mouse 312, the extension program 112 detects the event as shown in the flowchart of FIG. The determination is made (Y of step S210), and the corresponding event operation is executed (step S211).

As an event operation here, if the selection instruction is the reproduction button 144, the expansion program 112 reproduces the image 142 displayed as a still image as the original moving image and the selection instruction is given. If is the stop button 145, the reproduction of the moving image is stopped, and if the selection button is the pause button 146, the reproduction of the moving image is displayed as a still image at that time.

Further, the function of the extension program 112, which is premised on that the encapsulated document 101 includes a voice information file as the media information 104, will be described.

As shown in FIG. 19, the extension program 11
2 displays a voice reproduction button 151 as a function panel and a reproduction panel in the document displayed on the display 310. When the display area of the voice reproduction button 151 included in the document on the display 310 is selected and instructed by clicking with the mouse 312 or the like, the extension program 112 determines the event detection as shown in the flowchart of FIG. (Y in step S210), the corresponding event action is executed (step S2).
11).

As the event operation here, the extension program 112 uses the voice reading information display area 15 to be described later.
A pop-up frame 153 including 2 is displayed, and an operation button 157 including a play button 154, a stop button 155, and a pause button 156 appears on the pop-up frame 153. Then, when any one of the buttons 154, 155, 156 included in the operation button 157 is instructed to be selected by a method such as clicking the mouse 312, the extension program 112 detects the event as shown in the flowchart of FIG. The determination is made (Y in step S210), and the corresponding event action is executed (step S2).
11).

As the event operation here, the extension program 112 reproduces the sound in the sound information file included in the encapsulated document 101 if the selection instruction is the reproduction button 154, and the selection instruction is given. If is the stop button 145, the audio reproduction in the audio information file being reproduced is stopped, and if the selection instruction is the pause button 146, the audio reproduction in the audio information file being reproduced is temporarily stopped. To do.

As a further function, the extension program 112, when the playback button 154 is selected and instructed to play back the voice in the voice information file, displays the visual information in which the voice to be played back is converted into text information and read out as voice reading information. Area 1
The personal computer 301 is caused to execute the function displayed on 52. Such an operation is performed when the document is browsed by the document browsing apparatus (usually the personal computer 301).
If the speaker for audio playback of is turned off,
This is effective when a person with a hearing loss views a document. Further, such a reading function is provided by the personal computer 301.
The pop-up operation may be automatically performed based on the setting of the speaker or the like, the setting of the assisting function for persons with disabilities, and the like.

Here, the voice information file may have a data structure as voice data obtained by sampling voice, or may be text data.
In the case of text data, when the voice information file is played back, it can be played back by a method of converting the text data into voice data defined by a voice feature amount, for example, using a voice synthesis LSI. Further, when the voice information file is made up of text data, the text data can be used as it is for the text information conversion of the voice performed when the voice in the voice information file is reproduced. On the other hand, when the audio information file is composed of audio data, it is necessary to analyze the audio data and convert it into text information.

As mentioned above, the encapsulation document 10 contains many kinds of extension programs 112 according to the characteristics of various digital information to be displayed or reproduced.
It is possible to prepare for 1. Therefore, by preparing these extension programs 112 as parts of a multimedia document, it is possible to flexibly realize the extension programs 112 corresponding to various media. In this case, since only the necessary extension program 112 needs to be stored in the encapsulated document 101, handling of the encapsulated document 101 becomes extremely light.

FIG. 20 shows the structure of the extension program 112 included in the encapsulated document 101. In the encapsulated document 101 according to the present embodiment, the document arrangement information 102 is read by the basic program 111, and the document arrangement information 102 is read.
The digital information file (text information 1
03, media information 104) is started, and the started extension program 112 displays and reproduces the digital information file (text information 103, media information 104). In addition, each extension program 112 detects a user operation and performs a corresponding operation when the user operation is performed.
In this case, the digital information file (text information 10
3. In the case of the extension program 112 that does not refer to the media information 104), it simply receives a user operation and performs an operation according to the user operation.

As the user operation, it is possible to click the mouse 312 or input the keyboard 311. Mouse 312
In the case of clicking, it is sufficient to judge whether the click position of the mouse 312 is within the display occupation range of each extension program 112, and to perform the operation corresponding to the case where the mouse 312 is clicked within its own display range. Keyboard 311
In the case of input, the cursor position (not shown) that can be moved by the keyboard 311 is the extension program 11
It is only necessary to judge whether or not it is within the display occupancy range of No. 2, and to perform the operation corresponding to the case where the selection instruction is made in the own display range. For example, as shown in FIG. 21, in the case of a document displaying three pieces of digital information (PRG1, PRG2, PRG3), as an example, when the user clicks the mouse 312 in the part marked with X, the PRG2 The extension program 112 detects the click of the mouse 312 and executes the corresponding operation.

As described above, the document format of the encapsulated document 101 in this embodiment is the extension program 1 related to the type of each medium and the type of tag of the display information file.
It is composed of 12 groups, and the minimum configuration is composed of the basic program 111 and the document arrangement information 102. Then, the encapsulated document 101 prepares a digital information file (text information 103, media information 104) according to the information that the user wants to store in the encapsulated document 101, and the extension program 112 that allows the information to be reproduced and displayed. It is established by adding. Then, the encapsulated document 101 according to the present embodiment stores such various files as a single file using the archive format.

[Summary Display Using Extension Program 112] Here, the document summary function mainly implemented by the extension program 112 will be described. Such a document summarizing function facilitates a summarizing program (not shown) in the program 105 as the extension program 112, prepares information for summarizing in the text information 103, and adopts various other summarizing methods. It is realized by

FIG. 22 is a schematic diagram showing a display example of the encapsulated document 101 described in XML as shown in FIG. 6, as in FIG. 7. The difference from FIG.
1 is displayed.

The encapsulated document 101 whose display example is shown in FIG. 22 is displayed based on the XML description shown in FIG. First, <Document> representing the entire document
Is described, and the document structure is described in this tag. Then, to describe the title first, <TE
The display content when the tag XT> is used displays the content in the tag when the attribute is omitted. The following TEXT tag example shows the text information as "text.
This is an example of reading from a file "TXT".
The MAGE tag is layout information for displaying a still image “image.JPG” in the size designated by WIDTH and HIGH starting from the X and Y coordinates.

As described above, the document layout information 102 is the XM
The L format is used to instruct a file and an arrangement.

The document layout information 102 has been described by taking the XML format as an example, but other description languages such as the HTML format may be used, or a unique description format may be used.

Then, a still image, a moving image, a 3D image,
The media information 104 representing audio information or the like may be a general-purpose file format, or may have a unique format in the case of special specifications.

Further, by clicking the summary button 401 included in FIG. 22,
A summary frame 402 for displaying summary information about text information read from a file "text.TXT" is created on the screen, and the summary frame 402 is created.
It is provided to display summary information in.

FIG. 23 is a schematic diagram showing an example of the document arrangement information 102 for arranging the summary information. The document arrangement information 102 has a summary function tag <SUMMARY> for representing a summary display as shown in FIG.
Below this summary function tag, summary information that is a display element is described.

When there are a plurality of display elements, an attribute indicating a switching method is added to each display element to switch and display those display elements. For example, in the example illustrated in FIG. 23, the display element is displayed for the time of the value of Time using the attribute of Time. Also, Time is 0
If it is, the display is terminated by the user operating the mouse or the like. In this way, by sequentially switching the display, the entire summary information can be displayed and the document contents can be explained.

FIG. 24 shows an extended program 1 for displaying a summary.
13 is a flowchart showing the flow of processing in 12.
The extension program 112 here is a summary extension program for displaying a summary. Therefore, by the extension program 112 as this summary extension program,
The summary information included in the document arrangement information 102 is displayed on the display 310. The processing contents will be described below.

First, when the extension program 112 having the summarizing function is started based on the document arrangement information 102 from the basic program 105 in the encapsulated document 101 (step S301), the summarizing button indicating the summarizing function in the display document. 401 is displayed (step S302). Then, it waits until the user presses the summary button 401 (step S303).

When the extension program 112 recognizes that the user has pressed the summary button 401 (step S30).
3Y), the summary frame 402 for the summary display is created other than the display document (step S304). Then, until the processing for each display element included in the document arrangement information 102 is completed (step S305), the description of each such display element is analyzed (step S306), and each display is performed based on the analysis result. Extended program 1 corresponding to the element
12 is activated (step S307).

The started extension program 112 analyzes the attributes received from the basic program 111 (step S308), and stores the necessary text information 103 and media information 104 according to the contents of the attributes in the archive file 201 in the encapsulated document 101. Is read from (step S309).

As a result, the extension program 112 displays each display element in the summary frame 402 for summary display based on the description of each element obtained from the document arrangement information 102 in the archive file 201 (step S310). And
Based on the described attribute value, it is determined whether time has passed or whether there is a switching action (step S311), and when it is determined that any event has occurred (step S3).
In (Y of 11), the extension program 112 for the display element is terminated (step S312). At this time, in step S311, as an example, the Tim shown in FIG.
The e attribute is used to determine the passage of time or the presence or absence of a switching action. That is, the display element is displayed for the time of the value of Time, or when Time is 0, it is determined that the switching action is performed by the user's operation of the mouse or the like. Then, step S again
Returning to the processing of step 305, the same processing is repeated until there are no display elements (steps S306 to 312), and when there are no display elements, the summary display ends (step S31).
3).

As described above, the extension program 112 having the summary display function creates the summary frame 402 when instructed by the user (step S304), and sequentially activates the extension program 112 corresponding to the summary contents to summarize. Perform the operation to display.

FIG. 25 is a schematic diagram showing an example of the summary display 412 displayed in the summary frame 402 together with the browsed document 410 on the display 310.

When displaying the summary information in the summary frame 402, the position, size, etc. of the summary frame 402 may be set in advance as the attribute value of the summary function tag, and the summary frame 402 may be created accordingly. However, the size of the summary frame 402 may be changed to an appropriate size according to the display content.

The size of the summary frame 402 may be set by detecting the display screen size of the summary display, or the summary frame 402 may be displayed in the center of the screen, or
It may be displayed over the entire screen. These settings may be made based on the attribute values obtained by the attribute analysis in step S308 as described above, or may be changed by the user when displaying the summary. Further, when the browsed document 410 being displayed is visually or explanatoryally obstructive to the summary display, the browsed document 410 may be made invisible and visualized after the summary display is completed.

FIG. 26 is a schematic diagram illustrating various variations displayed on the display 310 during the summary display in step S310. In FIG.
Three variations are illustrated as (a), (b), and (c). Further, in FIG. 26, the browse document 410 includes text information 411 a, image information 411 b, and moving image information 411.
c and voice information (not shown) are included.

FIG. 26A shows an example of highlighting. In the flowchart of FIG. 24, a process of highlighting (step S310-1) the related extension program when displaying the information in step S310 is illustrated. In this process, in order to clearly inform the viewer of which part of the browsed document 411 the summary is explained, the corresponding part 421 of the browsed document 411 corresponding to the display element of the summary content which is sequentially displayed. Is highlighted. Thus, the viewer can easily grasp the entire browsed document 411 without reading the browsed document 411.

FIG. 26B shows an example of the relationship between voice and summary. For example, when the browsed document 411 is composed of text information 411a instead of image information, a voice synthesis function may be installed in the extension program 112 and the browsed document 411 may be read aloud by voice synthesis.
On the contrary, when the browsed document 411 is accompanied by an explanation by a voice file, a voice recognition function may be installed in the extension program and the summary display 412 in which voice is converted into text may be performed. The processing for handling such a voice is as described with reference to FIG.

The information for these brief explanations is as follows:
It may be prepared separately from the information of the browsed document 411, or may be appropriately extracted from the document content. As an example of the process of appropriately extracting the document contents, it is conceivable that only the first part of each paragraph in the browsed document 411 is extracted and sequentially displayed.

FIG. 26C illustrates the relationship between the moving image and the summary. When displaying and playing a video in a document as a summary, if the entire video information is played back, the playback time becomes long and the user is burdened to see the summary itself. By playing back only the part, you can browse the summary easily. In this way, in order to reproduce only a part of the moving image information as a summary, the attribute value representing a part of the moving image file may be described in the tag of each display element.

As described above with reference to FIG. 26, various variations can be displayed on the display 310 during the summary display in step S310.

Here, by describing the tag indicating the summary function in the document arrangement information 102 and storing the extension program 112 for the summary function in the archive file 201 at the same time,
With one archive file 201, it is possible to view the entire document and manage presentation materials for explaining the summary at the same time. This makes it easy to manage documents that require presentation.

Further, although it has been described that the summary contents are created by referring to the document information of the browsed document 411, in this case, only by changing the document information, the summary explanation linked to this is simultaneously changed. Therefore, by managing only the document information, the summary is managed together, so that the management of the presentation content can be facilitated.

Further, in the above-mentioned example, the creator created the summary information by himself, whereas if the automatic summary creation program is prepared as the extension program 112, the document information of the browsed document 411 is prepared. It is possible to automatically create a summary based on. Such an automatic summarization program extracts important words based on the frequency and emphasized expression of words in a document, grasps the context based on the important words, and automatically summarizes the summary based on the grasped context. To create it. As such an automatic summary creation program itself, a generally popular program of the same kind can be used as it is.

[0156]

According to the invention of the data structure of the document described in claim 1, one or more digital information files which are the representation entities on the document, the structure of the digital information file and the display state on the document. A display information file that specifies the display information file and an operation program file that is interpreted and executed by a computer and that displays the one or more digital information files on the display of the computer in a display state specified based on the display information file. ,
Since the operation program file includes a summary program for displaying a summary of a part of the digital information file, a part of the digital information file can be displayed in summary according to the summary program. When browsing the digital information file, it is possible to avoid the complexity of having to pre-install only the operation program file for that on the computer alone, and from the time when it is unknown whether to browse such digital information file, Alternatively, the user can be relieved from the complexity of having to pre-install only the operation program file on the computer separately from the digital information file to be browsed before obtaining such digital information file. . Further, since the document content indicated by the digital information file is shown as a summary, it is possible to easily understand the document content when browsing the summary, and, for example, in the case of a presentation,
The presentation effect can be improved.

The invention according to claim 2 is an encapsulation means for encapsulating the digital information file, the display information file, and the operation program file as a single document in the data structure of the document according to claim 1. Since it has, the handling and management of the digital information file, the display information file and the operation program file can be extremely facilitated. In particular, since the summary of the digital information file is also encapsulated as a single document, it becomes possible to manage all the information collectively, and to handle it extremely easily.

According to a third aspect of the present invention, in the data structure of the document according to the first or second aspect, the summary of the digital information file is composed of a plurality of display elements, and the display information file sequentially displays those display elements. Since the information for switching and displaying is included, it is possible to easily understand the abstract when browsing the abstract, and it is possible to improve the presentation effect, for example, at a presentation site.

According to a fourth aspect of the invention, in the data structure of the document according to the first, second or third aspect, the display information file is a structure for summarizing the digital information file and a display state on the document. Since the display information file is referred to, it is possible to easily obtain the information for sequentially switching and displaying the display elements included in the display information file by referring to the display information file.

According to a fifth aspect of the present invention, in the data structure of the document according to the first, second or third aspect, the summarization program creates a summarization frame different from a display frame for displaying the digital information file. Since a part of the digital information file is displayed in summary in this summary frame, the document content based on the digital information file and the summary can be simultaneously viewed. Therefore, at the time of browsing the summary, the document content based on the digital information file is displayed. Can be easily understood, and, for example, in the case of a presentation, the presenter can easily understand the place currently explained as the document content based on the digital information file based on the summary.

According to a sixth aspect of the invention, in the data structure of the document according to the third aspect, since the display elements for the summary of the digital information file are sequentially switched and displayed based on the operation, when browsing the summary, The summary can be viewed at a pace of self-understanding, and, for example, in the case of a presentation, the presenter can proceed with a presentation based on the document content based on the digital information file at his own pace.

According to the invention described in claim 7, in the data structure of the document according to claim 3, the display elements for the summary of the digital information file are sequentially switched and displayed based on a preset time interval. In browsing the abstract, the abstract can be browsed without requiring any special operation, and, for example, in the case of a presentation, the presenter can concentrate on the presentation and proceed with the presentation.

According to an eighth aspect of the invention, in the data structure of the document according to the fifth aspect, a display location of the digital information file corresponding to a summary display of a part of the digital information file displayed in the summary frame. Is highlighted, the document content based on the digital information file can be more easily understood.

According to a ninth aspect of the present invention, in the data structure of the document according to the fifth aspect, the display program has a voice synthesizing function, and when the digital information file is text information, the text information is stored. Since the voice corresponding to is synthesized and reproduced, it is possible to save the trouble of reading the document content based on the digital information file and to easily understand the document content.

According to a tenth aspect of the invention, in the data structure of the document according to the fifth aspect, the display program has a moving image regenerating function, and when the digital information file is moving image information, the moving image is moved. Since a part of the information is reproduced, the viewer can understand the content without seeing the redundant video, and the browsing time can be shortened.

According to the invention of a storage medium described in claim 11, one or more digital information files that are representation entities on a document, a structure for specifying the structure of the digital information file and a display state on the document are displayed. An information file; and an operation program file that is interpreted and executed by a computer to display the one or more digital information files on a display of the computer in a display state specified based on the display information file. ,
The operation program file includes a summarization program for summarizing and displaying a part of the digital information file, and stores a data structure of a document capable of summarizing and displaying a part of the digital information file according to the summarization program. Therefore, when browsing a digital information file, it is possible to avoid the complexity of having to pre-install only the operation program file for that purpose on the computer alone, and whether or not to browse such a digital information file can be avoided. Relieves the user of the need to pre-install the operating program file alone on the computer separately from the digital information file to be viewed, either from the time or before obtaining such digital information file. thing It can be. In addition, since the document content indicated by the digital information file is displayed as a summary, it is possible to easily understand the document content when browsing the summary. Further, for example, in the case of a presentation, the presentation effect is improved. be able to.

The invention of a document information processing apparatus according to claim 12 includes a computer and a data structure of a document which can be browsed by the computer, and the data structure of the document is a representation entity on the document 1 or Two or more digital information files, a display information file that specifies the structure of the digital information file and a display state on the document, and a display state that is interpreted and executed by a computer and is specified based on the display information file. An operation program file for displaying the one or more digital information files on the display of the computer;
Since the operation program file includes a summary program for displaying a summary of a part of the digital information file, a part of the digital information file can be displayed in summary according to the summary program. When browsing digital information files, it is possible to avoid the complexity of having to pre-install only the operation program file for that purpose on a computer independently, and from the time when it is unknown whether to browse such digital information files, Alternatively, the user can be relieved from the complexity of having to pre-install only the operation program file on the computer separately from the digital information file to be browsed before obtaining such digital information file. . Further, since the document content indicated by the digital information file is shown as a summary, it is possible to easily understand the document content when browsing the summary, and, for example, in the case of a presentation,
The presentation effect can be improved.

[Brief description of drawings]

FIG. 1 is a schematic diagram showing a data structure of an encapsulated document.

FIG. 2 is a schematic diagram showing an example of a data structure of an archive file.

FIG. 3 is a schematic diagram showing an example of another data structure of an archive file.

FIG. 4 is a schematic diagram showing a data structure of a program stored in an encapsulated document.

FIG. 5 is a schematic diagram showing a data structure of an extended program reference file included in a program.

FIG. 6 is a schematic diagram showing an example of an encapsulated document described in XML.

FIG. 7 is a schematic diagram showing a display example of an encapsulated document described in XML as shown in FIG.

FIG. 8 is a hardware configuration diagram of a personal computer (computer).

FIG. 9 is a flowchart showing the flow of a conventional document browsing process performed by a personal computer (computer).

FIG. 10 is a flowchart showing the flow of document browsing processing of an encapsulated document by a personal computer (computer).

FIG. 11 is a schematic diagram showing a file structure of a file that defines a correspondence relationship between media types and extension programs.

FIG. 12 is a schematic diagram showing types of extension programs.

FIG. 13 is a schematic diagram showing a display example in which a page turning button appears.

FIG. 14 is a schematic diagram showing a description example of a functional operation program file.

FIG. 15 is a schematic diagram showing a process of using an auxiliary program for an encoding part of a file.

FIG. 16 is a schematic diagram illustrating a display image enlargement / reduction function by an extension program.

FIG. 17 is a schematic diagram illustrating a viewpoint changing function of a display image which is a stereoscopic image by an extension program.

FIG. 18 is a schematic diagram illustrating a display function of a display image which is a moving image by the extension program as a still image and a reproduction function thereof.

FIG. 19 is a schematic diagram exemplifying a voice reproduction function and a reproduction voice text information conversion function by the extension program.

FIG. 20 is a schematic diagram showing the structure of an extension program included in an encapsulated document.

FIG. 21 shows three pieces of digital information (PRG1, PRG2,
It is a schematic diagram which shows the document display example which is displaying PRG3).

22 is a schematic diagram showing a display example of an encapsulated document described in XML as shown in FIG.

FIG. 23 is a schematic diagram showing an example of document arrangement information for arranging summary information.

FIG. 24 is a flowchart showing the flow of processing in an extension program for displaying a summary.

FIG. 25 is a schematic diagram showing an example of a summary display displayed in a summary frame together with a browsed document on the display.

FIG. 26 is a schematic diagram illustrating various variations displayed on the display during the summary display.

[Explanation of symbols]

102 display information file (document arrangement information) 103 digital information file (text information) 104 digital information file (media information) 105 operation program file 301 computer (personal computer) 310 display 402 summary frame

Continued front page    F-term (reference) 5B075 NS01 PQ02                 5B082 AA11 AA13 EA07                 5E501 AA02 AC20 AC35 BA03 BA10                       CA02 CB09 EA05 EA10 EB05                       FA23

Claims (12)

[Claims] 1. A computer-interpreted and executed one or more digital information files that are representation entities on a document, a display information file that specifies a structure of the digital information file and a display state on the document. And an operation program file that causes the display of the computer to display the one or more digital information files in a display state specified based on the display information file. A data structure of a document including a summarizing program for summarizing and displaying a part of an information file, wherein a part of the digital information file can be summarized and displayed according to the summarizing program. 2. The data structure of the document according to claim 1, further comprising encapsulation means for encapsulating the digital information file, the display information file, and the operation program file as a single document. 3. The data structure of the document according to claim 1, wherein the summary of the digital information file is composed of a plurality of display elements, and the display information file includes information for sequentially switching and displaying the display elements. . 4. The data structure of a document according to claim 1, 2 or 3, wherein the display information file includes a structure for summarizing the digital information file and information for specifying a display state on the document. 5. The summarization program creates a summarization frame different from a display frame for displaying the digital information file, and summarizes and displays a part of the digital information file in the summarization frame. Data structure of the document described in 2 or 3. 6. The data structure of the document according to claim 3, wherein the display element for the summary of the digital information file is sequentially switched and displayed based on an operation. 7. The data structure of the document according to claim 3, wherein the display element for the summary of the digital information file is sequentially switched and displayed based on a preset time interval. 8. The display part of the digital information file corresponding to the summary display of a part of the digital information file displayed in the summary frame is highlighted.
The data structure of the described document. 9. The document data according to claim 5, wherein the display program has a voice synthesizing function, and when the digital information file is text information, a voice corresponding to the text information is synthesized and reproduced. Construction. 10. The data structure of the document according to claim 5, wherein the display program has a moving image regenerating function, and when the digital information file is moving image information, a part of the moving image information is reproduced. 11. A computer interprets and executes one or more digital information files that are representation entities on a document, a display information file that specifies a structure of the digital information file and a display state on the document. And an operation program file that causes the display of the computer to display the one or more digital information files in a display state specified based on the display information file. A storage medium for storing a data structure of a document, which includes a summarization program for summarizing and displaying a part of an information file, and is capable of summarizing and displaying a part of the digital information file according to the summarization program. 12. A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representation entities on the document, and the digital information file. And a display information file that specifies the structure of the display information and the display state on the document, the computer interprets and executes the display information file, and displays the one or more digital information files in the display state specified based on the display information file. An operation program file to be displayed on the display of, and the operation program file includes a summarization program for summarizing and displaying a part of the digital information file. An information processing device that can display a partial summary Place