JP2003099302A - Document conversion service method, document data structure, storage medium and information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To read a desired digital information file, without having to arrange an environment by previously installing a specified operation program file in a computer, and also to facilitate document management by dealing with one or 2 or more digital information files as a single document, regardless of the differences in the form. SOLUTION: One or 2 or more digital information files 103 and 104, a display information file 102 for specifying the structures and display states in the document and the operation program file 105, which is analyzed and performed by the computer and displays one or 2 or more digital information files 103 and 104 on a display, in a display states specified by the display information file 102, are made encapsulated as a single document. The document transmitted from a user device via a network is encapsulated by a service device and is returned to the user device.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data structure of a document that can be viewed and managed by a computer (digital information processing device), a storage medium storing the data structure of the document, and an information processing device. The invention also relates to a document conversion service method for converting a document into such a document data structure.

[0002]

2. Description of the Related Art In recent years, various types of documents have been created and are in widespread use as information transmission media that can be browsed using a computer (digital information processing device).
Typical formats of such documents are, for example, text, rich text, multimedia, PDF, HT.
There are ML, MHTML, XML, etc. So first,
An overview of these various types of documents, based on their development history.

[Text, Rich Text, Multimedia] Among digital (electronic) documents that can be handled by a computer (digital information processing apparatus), a typical text document expressing text by a character code, There are rich text documents in which a plurality of character fonts can be used in a text document, and multimedia documents in which figures, images, moving images, voices, etc. can be pasted.

Usually, a text document uses a character code common to general computers. Therefore, in a general computer, the operation system is generally provided with an application software called a text editor capable of browsing and editing such a text document.

When information is sent and received by electronic mail, text information can be sent and received to exchange information, and recently, electronic mail software that can send and receive a document expressed in rich text is also available. It is becoming popular.

On the other hand, a multimedia document has
Although there is no uniform format, at present, the office (product name) including Microsoft's word (product name) is widely used, so this office format is treated as if it were a standard format. It is the current situation.

However, when the office format is used for the multimedia document, the user purchases the application software called Microsoft Office, which has a document creation function, just by browsing the multimedia document. You need to install it on your computer.

[PDF] On the other hand, a PDF format developed by Adobe Systems Incorporated is known as a document format compatible with multimedia documents. This format helps reduce the user's disadvantages seen in the word format by distributing the application for browsing the document for free, while paying the application for creating the document.

[0009] However, although the financial burden on the user for viewing the document is eliminated, the user still needs to install the viewing software of Adobe Co., Ltd. in order to view the PDF document.

[HTML] On the other hand, in recent years, information has been transferred to HTML (Hyper Text Markup) due to the spread of the Internet.
It is common to describe information in a language called "Language" and convey information.

The HTML document initially spread widely as a language used in application software called a navigator developed by Netscape Co., Ltd., and contributed to the rapid spread of the Internet.

[0012] After that, Microsoft Corporation incorporated the software called Internet Explorer using the HTML language as standard in Windows (registered trademark), which is an operating system widely manufactured and sold by itself. This gives the user the impression that it is distributed free of charge, and, unlike the PDF file of Adobe, does not require the user to install the browsing software. Currently, Internet Explorer has exploded and is treated as if it were the standard format for browsing the Internet.

However, such an HTML document has a major drawback as a format for creating an ordinary document because of its occurrence. As a method of browsing documents on the Internet, when the information written in HTML is a document, the user's computer visually displays the document according to the HTML tag rule, whereas when the information is an image. Means that the information of the image does not exist in the displayed HTML information. That is, when the information is an image, only the reference destination and the layout information of the image are described in the HTML information, and the browsing software installed in the user's computer has such a description. Based on the arrangement information, the image data is downloaded from the server to the user's computer and displayed. More specifically, the current HTML document includes text information and arrangement information for laying out each information in the document, but for other images and moving images, refer to the reference destination where they are stored. Just by describing it, the actual image information and moving image information are stored in another place.

Therefore, the installer side of the HTML document is
In order to properly display an image or similar contents in a TML document, there is a complexity that an image file or the like has to be arranged at the reference destination described in the HTML information. In addition, the user who is a viewer of the HTML document needs to pay attention to the positions and names of these reference files in order to correctly handle the HTML document. Then, both the installer side and the user side of the HTML document try to save and manage such a reference file itself, which is extremely complicated.

[MHTML] In order to solve these problems, the Internet standard organization RFC defines MHTM.
The L format is a format format in which multimedia contents are stored together with HTML information. According to the MHTML format, a multimedia document including images and the like can be browsed by browsing software compatible with this standard.

However, MHTML has some problems because it extends HTML.

One of them is not to hold image data and the like as normal binary data but to hold as a character code represented by hexadecimal characters (0 to 9 and A to F). This is because the HTML file described in HTML is constructed so that the description content can be viewed with a text editor.

As another problem, since the MHTML document is stored in the same file as the layout information for displaying the image and the like, it is not possible to easily extract only the image or grasp the description content. There is also a problem.

From the above, at the present time, the document locally used in the personal computer is still a word document, and the document on the Internet is HT.
ML documents are used to separate houses.

[XML] On the other hand, in recent years, XML has been used.
A document format called (Extensible Markup Language) that connects the Internet and a local document has also been proposed.

The advantage of XML is that the user can define a portion corresponding to an HTML tag.
The fact that each software maker describes the data including the document in binary in its own format is that it is described in the text format that can be read and understood by a simple text editor using tags. However, XML defines a method of describing data, and a program for interpreting and executing the program, a program execution environment, and a computer (digital information processing device) are required for actual operation. Therefore, in order to display the document described in XML, a program therefor is required, and even when the same document described in XML is displayed, the display contents will be different if the programs are different. Similarly, a computer (digital information processing device)
The behavior also differs depending on the type of the program and the type of program execution environment.

In other words, in XML, even if the formats of data to be processed can be unified, it is not possible to unify the program and the computer (digital information processing device) for executing the formats.

[Multi-Platform Program Environment] Therefore, at present, a multi-platform program environment that is independent of the type of computer (digital information processing device), in other words, the type of operating system is proposed. Typical examples are JAVA of Sun Microsystems and NET concept of Microsoft. As a result, the document is described in the XML format, and the information described in the multi-platform language such as JAVA is processed, so that the type of computer (digital information processing device) (type of operation system)
There is an environment in which documents can be viewed, created, etc. without depending on.

In Japanese Patent Laid-Open No. 2000-353120, X
A combination of the ML format and JAVA is disclosed. The Japanese Patent Laid-Open No. 2000-353120 discloses that an XML document is read and a program described in JAVA is executed based on the read information.

Japanese Patent Application Laid-Open No. 09-134349 discloses that
It describes a data description in XML format and a document defining the program operation according to the data description.

The examples described in these publications are XML.
A program is started based on the description such as, and thereby multimedia contents and documents are displayed. In other words, the concept is to describe data using a descriptor such as XML for a combination of conventional data and an application that executes the data. As a result, data such as a document can be described in a general-purpose manner, and an application program for displaying a document or the like is created by using JAVA or the like, and a document can be browsed by this application program, so that the document can be displayed on different platforms. Can be viewed.

However, there is a problem in that there is no guarantee that it will operate normally if the application program for displaying a document is installed in a computer (digital information processing apparatus) or if the version of the application program is changed. In other words, when a certain document is desired to be stored for a long period of time, it is necessary to store an application program for displaying it, which is extremely complicated.

Furthermore, the document introduced in the above publication has another problem that a plurality of files make up the document. For this, JP-A-1
Japanese Patent Laid-Open No. 1-143906 discloses storing a plurality of web page files in this format, which is displayed in a book-like format in appearance, and the one document described above is displayed. The contents are not managed as one file.

[0029]

At present, electronic documents represented by digital information have become widespread due to the development of computers and the spread of the Internet. In order to create, edit, save, browse, etc. such an electronic document, the following conditions are required. 1. Hardware (computer) that actually executes processing 1. Operation system (OS) that causes a computer to perform processing 3. Software (application software) for reading and displaying document information, editing, etc. 4. Document information (data file) in which document contents are expressed in a defined digital expression, that is, an electronic document cannot be browsed unless these four conditions are met. Of these four conditions, an operating system such as Windows is installed in the computer, and the computer and the operating system have a one-to-one relationship. Therefore, the user installs a typical application program suitable for the computer and operating system on the computer, and creates and browses documents.

Therefore, when creating, editing, saving, browsing, etc. of electronic documents, compatibility between the computer and operating system and the application programs is important. In other words, when trying to browse a certain document, if the viewer has not installed an application program that is the same as or compatible with the application program used by the creator of the document on his / her computer, he / she can browse the document. Is impossible. In this case, even if a document is created and browsed by the same application program, browsing may not be performed normally if the versions are different. Because of this, handling of electronic documents is extremely inconvenient.

Next, as the document format of the electronic document, as described above, text, rich text, PDF, HT
While there are various formats such as ML, MHTML, XML, etc.
It is no exaggeration to say that the documents are roughly divided into Microsoft office documents and web documents viewed with a web browser. However, the office document of Microsoft Corporation has a problem that an office application for browsing the document is required. Also, the web document is
Since it is a document specialized for the Internet, there is a problem that a single document is composed of multiple files and management is complicated due to the structure in which multiple files existing on the server are called by a browser and displayed. .

Furthermore, in recent years, due to the rapid spread of computers, especially personal computers, and the improvement of their processing capabilities, digital documents handle not only conventional character representations (texts) but also still images, moving images, and voices. Is becoming possible. Therefore, in a personal computer, it is possible to create and view a document form that mixes a plurality of media in which the document form cultivated in the conventional type document and the image cultivated in radio and television are fused. Has become. Documents of such a form have been distributed and distributed through a global network represented by the Internet today. Such digital documents are
Generally called a multimedia document.

Here, since the multimedia document includes a plurality of media, a plurality of application programs are required for viewing and reproducing the media. In other words, in order to browse and play multimedia documents, 1. Application program required for browsing 2. The same creation and viewing environment is required between the creator and the viewer. Multiple files needed to represent a single document 4. There are many problems such as the need to store an application program for browsing in order to browse the stored past documents. Therefore, it is difficult for general users to handle multimedia documents.

An object of the present invention is to make it possible to browse a desired digital information file without installing a specific operation program file in a computer in advance and preparing the environment.

An object of the present invention is to enable one or more digital information files to be handled as a single document regardless of the format, thereby facilitating document management. Is.

[0036]

According to a first aspect of the present invention, there is provided a document conversion service method, which comprises: Converting the received document into an encapsulated document, sending the converted encapsulated document to a user,
Wherein the encapsulated document includes one or more digital information files that are representation entities on the document, and a display information file that specifies the structure of the digital information file and the display state on the document. Reference is made to a digital information display program, which is interpreted and executed together by a computer and causes the display of the computer to display the one or more digital information files in a display state specified based on the display information file, and the digital information. And an operation program file including a function operation program for executing a specific function without doing so.

Therefore, in the encapsulated document, if the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. . Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy.

For an encapsulated document having many advantages as described above, labor is required to create it. According to the present invention, however, the service device takes charge of the creation. The burden is reduced.

The invention according to claim 2 is the document conversion service method according to claim 1, wherein in the step of transmitting the converted encapsulated document to a user, after converting the received document into an encapsulated document, the user The step of transmitting the temporary encapsulated document, the step of receiving approval from the user who transmitted the temporary encapsulated document, and the step of transmitting the formal encapsulated document after the user's approval.

Therefore, the illegal use of the encapsulated document by the user when the formal encapsulated document is suddenly given to the user is prevented.

The invention according to claim 3 is the document conversion service method according to claim 1, wherein in the step of converting the received document into an encapsulated document, the document is translated using an automatic translation function, and the translated document is translated. It includes a process of generating the encapsulated document to which a document is added.

Therefore, the translation is added to the document sent by the user.

The invention according to claim 4 is the document conversion service method according to claim 1, wherein the step of converting the received document into an encapsulated document stores a plurality of terms in association with their meanings. , A data file meaning to store the explanation in correspondence with the term in the document and an explanation corresponding to the term in the document displayed on the display of the computer when the term is specified. And a function operation program that is extracted from the meaning data file and displayed on the display, and a process of generating the encapsulated document to which the meaning data file and the function operation program are added.

An encapsulated document with an anation function can be obtained.

According to a fifth aspect of the present invention, the data structure of a document specifies one or more digital information files that are representation entities on the document, the structure of the digital information file, and the display state on the document. And a display information file that is interpreted and executed by a computer and is specified based on the display information file.
Alternatively, an operation program file including a digital information display program for displaying two or more digital information files on the display of the computer and a function operation program for executing a specific function without referring to the digital information. The digital information file includes descriptions in the same language in a plurality of languages, and the functional operation program has a function of permitting selection of a language to be displayed on the display of the computer for the digital information file.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy. Further, it is possible to selectively display the same document in a plurality of languages on the display.

The invention of the data structure of the document according to claim 6 specifies one or more digital information files which are the representation entities on the document, the structure of the digital information file and the display state on the document. And a display information file that is interpreted and executed by a computer and is specified based on the display information file.
Alternatively, an operation program file including a digital information display program for displaying two or more digital information files on the display of the computer and a function operation program for executing a specific function without referring to the digital information. The digital information file includes a data file having a meaning of storing a description in correspondence with a term in a document, and the functional operation program includes:
When a term in the document displayed on the display of the computer is designated, the explanation corresponding to the term is extracted from the data file of the meaning and displayed on the display.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy. In addition, when a specific term in the document is designated, its annotation is displayed.

The invention of a storage medium according to claim 7 is one or more digital information files which are the representation entities on a document, a display for specifying the structure of the digital information file and the display state on the document. An information file and a digital information display program which is interpreted and executed together by a computer and displays the one or more digital information files on a display of the computer in a display state specified based on the display information file; An operation program file including a function operation program for executing a specific function without referring to digital information, wherein the digital information file includes a description of the same content in multiple languages, The program displays the digital information file on the computer display. A function that allows the selection of the language that presents, for storing data structure of the document.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy. Further, it is possible to selectively display the same document in a plurality of languages on the display.

The invention of a storage medium according to claim 8 is one or more digital information files which are representation entities on a document, a display for specifying the structure of the digital information file and the display state on the document. An information file and a digital information display program which is interpreted and executed together by a computer and displays the one or more digital information files on a display of the computer in a display state specified based on the display information file; An operation program file including a function operation program for executing a specific function without referring to digital information; and the digital information file means to store a description in correspondence with a term in a document. Data file, and the functional operation program is displayed on the computer. Term in a document that is displayed the corresponding description to the term extracted from the data file of the means to be displayed on the display if it is designated to store the data structure of the document.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy. In addition, when a specific term in the document is designated, its annotation is displayed.

The invention of an information processing apparatus according to claim 9 includes a computer and a data structure of a document that can be browsed by the computer, and the data structure of the document is one or more that is an entity of expression on the document. Of the digital information file, a display information file that specifies the structure of the digital information file and a display state on the document, and a display state that is interpreted and executed together by a computer and is specified based on the display information file. An operation program file including a digital information display program for displaying one or more digital information files on the display of the computer, and a function operation program for executing a specific function without referring to the digital information; The digital information file contains the same contents in multiple languages. Wherein the said function operation program has a function that allows the selection of the language to be displayed on a display of the computer for the digital information file.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy. Further, it is possible to selectively display the same document in a plurality of languages on the display.

The invention of an information processing apparatus according to claim 10 is
A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representational entities on the document, the structure of the digital information file, and the document. The display information file for specifying the above-mentioned display state is interpreted and executed together by a computer, and the one or more digital information files are displayed on the display of the computer in the display state specified based on the display information file. Digital information display program to be displayed,
An operation program file including a function operation program for executing a specific function without referring to the digital information, and the digital information file stores the description in correspondence with the terms in the document. When a term in a document displayed on the display of the computer is designated, the functional operation program has a meaning data file and extracts a description corresponding to the term from the meaning data file, Display on the display.

Therefore, when the operation program file is interpreted and executed by the computer, one or more digital information files are displayed on the display of the computer according to the display state specified by the display information file. Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, if the operation program file is interpreted and executed by the computer, the digital information file can be viewed. Therefore, it is not necessary to separately install only the operation program file on the computer in advance. That is, in order to browse a certain digital information file, it is necessary to install an operation program file suitable for the digital information file in the computer, but in the present invention, since such an operation program file is encapsulated together with the digital information file, It is sufficient for the operating program file to be interpreted and executed by a computer when browsing the digital information file, from the time when it is unknown whether to browse such digital information file or before obtaining such digital information file. It is possible to relieve the user from the complexity of having to pre-install only the operation program file in the computer separately from the digital information file to be browsed. Moreover,
Since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, their handling and management are extremely easy. In addition, when a specific term in the document is designated, its annotation is displayed.

[0057]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described with reference to the drawings.

[Data Structure of Document (Encapsulated Document)]
FIG. 1 is a schematic diagram showing a data structure of an encapsulated document which is an encapsulated document.

As shown in FIG. 1, the encapsulated document 101 is a document arrangement information 102 as a display information file showing a display state such as the structure and arrangement of the entire document, and a digital information file showing a text content in the document. Text information 103, other media information 104 as a digital information file representing a still image or a moving image, and a program 105 as a plurality of operation program files for displaying document contents and detecting user operations. Has been done. Each of these pieces of information has a structure of an individual file unit that can be managed by a general personal computer operating system.

Such an encapsulated document 101 is a magnetic storage medium such as a floppy (registered trademark) disk, a hard disk, a magnetic tape, a CD or a CD-RO.
M, CD-R, CD-RW, DVD-ROM, DVD-
It can be stored in various storage media such as an optical storage medium such as RAM, and can be easily carried depending on the type of storage medium. Also, the encapsulated document 101
Can be transmitted via various communication lines such as RAN and the Internet.

FIG. 2 is a schematic diagram showing an example of the data structure of the archive file, and FIG. 3 is a schematic diagram showing an example of another data structure of the archive file.

Each of the files 102, 103, 104 and 105 that form the encapsulated document 101 is stored in one file called an archive file 201, as illustrated in FIGS. 2 and 3. As a result, the document arrangement information 10
2 (display information file), text information 103 (digital information file), media information 104 (digital information file), and program 105 (operation program file) are encapsulated as a single document. Has been done. Such an archive file 2
The 01 file format generally includes the ZIP format and the LHA format, and these techniques may be used.

Here, the archive file 201 has a file structure in which a plurality of files 102, 103, 104, 105 are stored as one file (archive file 201). Such an archive file 201 uses a archiver program having a storage function and a decompression function, so that a plurality of files 1 can be stored according to a user's request.
02, 103, 104, and 105 can be handled as one file (archive file 201).

In the archive file 201 illustrated in FIG. 2,
Each file 102, 10 is added to the archive file 201 that stores a plurality of files 102, 103, 104, 105.
Index information indicating which positions in the archive file 201, 3, 104 and 105 are located is added. As a result, it becomes possible to search the positions of the files 102, 103, 104 and 105. In addition, as another embodiment,
Like the archive file 201 illustrated in FIG. 3, the header information is added to each of the files 102, 103, 104, and 105, and the file 102, 10
It is also possible to adopt a method that enables position retrieval of 3, 104, and 105.

As described above, the file structure of the encapsulated document 101 has a plurality of files 102, 103, 104, 10 as shown in FIG.
5 is an index (see FIG. 2) or header (see FIG. 3)
It is an archive file format managed by. In this way, the encapsulated document 101 becomes a plurality of files 102, 103, 1
Since 04 and 105 are encapsulated as one archive file 201, the user can apparently manage and store a plurality of files 102, 103, 104 and 105 as one document.

FIG. 4 is a schematic diagram showing a data structure of a program stored in the encapsulated document 101, and FIG. 5 is a schematic diagram showing a data structure of a display information file that defines information about an extension program included in the program. Is.

The program 105, which is a plurality of operation program files stored in the encapsulated document 101.
Is composed of a basic program 111 and an extension program 112, as shown in FIG.

The basic program 111 is a program that can be called when the encapsulated document 101 is activated, and only one program exists in common to all the encapsulated documents 101. This basic program 111
Includes a startup program (not shown), which is interpreted by the personal computer 301 in response to access to the encapsulated document 101 by the personal computer 301.
It is executed and started.

The extension program 112 is a program added according to the contents included in the encapsulated document 101, and is prepared according to the type of display medium, for example, as shown in FIG. As an example, when the digital information file included in the encapsulated document 101 is only the text information 103, the basic program 111
In addition to the Text P of the extension program 112
The annel program 112a is stored in the encapsulated document 101. When the media information 104, which is a digital information file representing a still image or a moving image, is included in the encapsulated document 101, in addition to the basic program 111, I
image Panel program 112b, Movei
The Panel program 112c and the 3D Panel program 112d are stored in the encapsulated document 101. The basic program 111 includes a startup program (not shown), and the personal computer 301
When the encapsulated document 101 is accessed by the user, or when necessary, the personal computer 301 interprets, executes, and activates.

FIG. 5 shows an example of the extension program reference file 113. The extension program reference file 113 defines the extension program 112, the tag 114 and the operation 115 corresponding to the extension program 112. Such an extended program reference file 113 is stored in the encapsulated document 101 as the program 105.

Next, the document arrangement information 102 will be described. The document arrangement information 102 is a file that describes the arrangement, display size, files of each medium, etc. of each medium of the encapsulated document 101. In the present embodiment, the description of these pieces of information is described in a general-purpose XML format.

FIG. 6 is a schematic diagram showing an example of the encapsulated document 101 described in XML. XML is
As shown in FIG. 6, an example thereof is a file format in which each element is described by a tag, and a document is described by a collection of elements called tags. In this case, it is possible to have a nested structure in which tags are described in tags.
It is also possible to add attributes to each tag by what is called an attribute that represents the attributes of the tag.

FIG. 7 is a schematic diagram showing a display example of the encapsulated document 101 described in XML as shown in FIG. Encapsulated document 101 as shown in FIG.
Is displayed based on the XML description illustrated in FIG. First, a tag <Document> representing the entire document is described, and the document structure is described in this tag. Then, to describe the title first, <TEXT
The display content when the tag> is used displays the content in the tag when the attribute is omitted.
The following TEXT tag example shows the text information as "Body.TX.
This is an example of reading from a file called "T". Next IMA
The GE tag is a still image called "image.JPG" in X, Y
The layout information is such that the coordinates are displayed in the size designated by WIDTH and HIGH from the starting point.

As described above, the document arrangement information 102 is the XM
The L format is used to instruct a file and an arrangement.

Although the document layout information 102 has been described by taking the XML format as an example, other description languages such as the HTML format may be used, or a unique description format may be used.

The remaining still image, moving image, 3D
The media information 104 representing images, audio information, etc. may be a general-purpose file format, or may be a unique format in the case of special specifications.

As described above, the file structure of the encapsulated document 101 has a plurality of document arrangement information 102 representing the structure of the entire document and a plurality of text information files, image files, etc. displayed in correspondence therewith. Media files (text information 103 and media information 104)
And a plurality of programs 105 group.

[Browsing of Encapsulated Document 101] Here, the basic operation of the encapsulated document 101, from the document activation to the document browsing, will be described. Therefore,
For comparison with the encapsulated document 101, the operation of a general personal computer and the conventional document browsing operation will be described.

FIG. 8 is a hardware configuration diagram of a general personal computer 301 (computer).
The personal computer 301 is a CP that processes information.
U302, ROM303 and RAM3 for storing information
04, etc., a primary storage device 305, a secondary storage device 307 such as an HDD 306 (hard disk drive) for storing processing results, etc., and a removable medium 308 such as a CD-ROM for storing, distributing, and obtaining information outside. A network 309 for transmitting information by communication with other external computers, a display 310 for displaying the progress and results of processing to the operator, a keyboard 311 for the operator to input commands and information to the personal computer 301. And a mouse 312 and the like, and transmits / receives data transmitted / received between these units to / from the bus controller 31.
3 is arbitrating and operating.

Generally, a personal computer 301
Then, when the user turns on the power, the CPU 302 causes the ROM
Start the program called loader in 303 and
A program called an operating system, which manages computer hardware and software, is loaded into the RAM 304 from D306, and this operating system is activated. Such an operating system starts a program, reads information, and saves it according to a user's operation. A typical operating system is Windows
s (registered trademark), UNIX (registered trademark) and the like are known. Programs running on these operating systems are called applications.

FIG. 9 is a flowchart showing the flow of a conventional document browsing process using the personal computer 301. As a conventional document browsing process, as shown in FIG. 9, an application program for document browsing is activated (step S101), and a document file conforming to the format of this application program is read from the activated application program (step S101).
102), which is displayed (step S103). In addition, such processing has a mechanism in which when a user selects and starts (for example, double-clicks) a document file with the mouse 312 or the like, an application program associated with the selected document file is started. Is common. In other words, the conventional document file browsing processing method in the personal computer 301 is to read the document data from the application program. Therefore, in order to display and edit the document included in the document file, the application program corresponding to the document is indispensable.

FIG. 10 shows a personal computer 301.
7 is a flowchart showing a flow of a document browsing process of the encapsulated document 101 using the. In the present embodiment, such a personal computer 301 and the encapsulated document 1
An information processing device is configured by 01 and.

The encapsulated document 101 is the text information 1
03 and media information 104, an icon file relating to an icon (not shown) for displaying on the personal computer 301 an icon corresponding to the actual data thereof is included. Therefore, since an icon according to this icon file is displayed on the personal computer 301, when the user selects and activates (double-clicks) the icon corresponding to the substance data of the encapsulated document 101 with the mouse 312 or the like, the encapsulated document is displayed. The basic program 111 stored in the archive format as the archive file 201 in 101 is activated (step S20).
1). After starting, the basic program 111 creates a display window for displaying a document (step S
202). Then, the basic program 111 is the document layout information 10 in the archive file 201 described in XML or the like.
2 is read (step S203).

The basic program 111 is the document layout information 1
After reading 02, the tag structure is analyzed (step S2
04), the extension program 112 corresponding to the tag name as illustrated in FIG.
The attribute described in 02 is passed to each extension program 112 (step S205). Basic program 1
The processing unit 11 performs such processing until the processing is completed for all tags in the document arrangement information 102 stored in the encapsulated document 101 (step S206), whereby the plurality of extension programs 112 described in the document arrangement information 102. Is started in another thread (step S20)
5).

Each extension program 112 analyzes the attributes received from the basic program 111 (step S207), and outputs the necessary text information 103 and media information 104 according to the contents of the attributes from the archive file 201 in the encapsulated document 101. Read (step S208). Then, each extension program 112
Displays the text information 103 and the media information 104 in an area having a size corresponding to the attribute in the window created by the basic program 111 (step S209). By performing such processing, the encapsulated document 101 can display a plurality of text information 103 and media information 104 in a window secured by the basic program 111.

Further, when the expansion program 112 recognizes the occurrence of various events after such display (Y in step S210), it executes the process according to the recognized event (step S211). In this way, the encapsulated document 101 can display the document with a structure that is fundamentally different from the conventional document.

[Description Method of Program 105 Included in Encapsulated Document 101] Next, the encapsulated document 10
The description of the program 105 included in 1 will be described.

When writing the program 105, a plurality of methods can be implemented.

The first method is to create the program 105 in the C programming language, which is currently the most popular language,
This is an example of using a native code in a format that can be directly executed by the CPU 302 by a C language compiler. In this case, the basic program 111 is executed in the execution format (Windows
In the EXE format), each extension program 112 is created in the library format (DLL format in Windows), and the document arrangement information 102, digital information files (text information 103 and media information 104) stored in the archive structure, and these The program 105 may be searched by the index or the header, and the searched program 105 may be designated as the basic program 111. However, in this method, the code of the CPU 302 is
Since it is limited to 302 types, it is not a very good method.

The second method is to use an interpreter language such as JAVA language. This is to construct a program with abstract intermediate code without using the execution code, convert the intermediate code into a native code that can be understood by the CPU 302 at the time of execution, and the CPU 302 executes the native code. By using this method, the CPU3
It is possible to use the encapsulated document 101 on a multi-platform regardless of the 02 type.

As described above, in the encapsulated document 101 of this embodiment, the basic program 111 is first activated,
The startup program reads various information from the document arrangement information 102 and operates the extension program 112 that conforms to the information.

As the extension program 112, as described above, a program corresponding to the tag type of the document arrangement information 102 described in XML or the like may be prepared and the extension program 112 may be activated. The extension program 112 may be started according to the types of various digital information files (text information 103, media information 104) from which the tag attribute information is read. For example, in FIG.
As shown in (1), there are a plurality of typical formats of moving images when displaying and reproducing moving image information. Therefore, if one expansion program 112 is created to display all of the plurality of moving images, it becomes a large program. Therefore, in FIG.
As shown in FIG. 1, a plurality of extension programs 112 are prepared according to the file format, and the encapsulated document 10
It suffices to encapsulate the extension program 112 that fits a specific type of file format in the No. 1 program.

[Extension Program 112] FIG. 12 is a schematic diagram showing types of the extension program 112. The extension program 112 is a digital information display program 1 for displaying and reproducing digital information, as illustrated in FIG.
Not only 12A but also a functional operation program 112B that provides a specific function without reading digital information. Alternatively, the digital information display program 112A and the functional operation program 112B in the extension program 112 are the auxiliary programs 1 that assist them.
It may have 12C.

Here, an example of the functions executed by the functional operation program 112B and the auxiliary program 112C will be described.

As an example, it is assumed that the document is longer than the display size of the display 310 of the personal computer 301 and extends over a plurality of pages. In this case, as illustrated in FIG. 13, a page turning button 118 as a function panel described as “next page”, for example.
Should appear on the display 310. As shown in FIG. 14, the tag <PAGE> is described in the document arrangement information 102, and the PAG corresponding to this tag is written.
The function operation program 112B is provided with the function of the extension program 112 called E Button. As a result, the function operation program 112B called PAGE Button is activated, and the page turning button 118 as shown in FIG. 13 appears in the document. When the user presses the button by a method such as clicking the mouse 312, the page turning function is provided. Provided.

Here, when the user presses a button, the extension program 112 determines whether an event has been detected (step S21), as shown in the flowchart of FIG.
(Y of 0), the corresponding event operation is executed (step S211). The event operation here is a page turning function executed by the function operation program 112B and the auxiliary program 112C.

As another example, the function operation program 112B for displaying the function of displaying document information such as the number of pages, the date of creation, the total number of words, etc. can be implemented.

Next, as an example of the functions executed by the extension program 112 and the auxiliary program 112C that assists the extension program 112, an example of a moving image reproduction function will be introduced.
In the moving image playback function, since the basic display portion can be used in common with any moving image file format, the basic extension program 11
2 uses the same one, but for the part that depends on the file format of the moving picture, the auxiliary program 1
There is an example of setting to 12C. For example, as shown in FIG. 15, the encoding portion of the file may be the auxiliary program 112C.

Next, a specific example of the extension program 112 will be described.

First, the function of the extension program 112, which is based on the premise that the encapsulated document 101 includes a plurality of digital information files (text information 103, media information 104), will be described.

The extension program 112 uses the display 3
A file specifying panel (not shown) is displayed at 10. This file specification panel is the encapsulated document 1
This is a panel listing a plurality of digital information files (text information 103, media information 104) included in 01 so that they can be selected and instructed. So, for example, mouse 31
When an arbitrary digital information file (text information 103, media information 104) is selected and instructed by a method such as clicking by 2, the extension program 112 determines event detection (see the flowchart shown in FIG. 10). In step S210, Y), the corresponding event operation is executed (step S211).

As an event operation here, the extension program 112 executes an operation of displaying the digital information file (text information 103, media information 104) selected and instructed on the display 310.

Next, the function of the extension program 112, which is premised on that the encapsulated document 101 includes a still image file as the media information 104, will be described.

As shown in FIG. 16, the extension program 11
2 displays a still image 121 in the document displayed on the display 310. The display area of the still image 121 included in the document on the display 310 is the mouse 31.
When the selection instruction is given by clicking or the like by 2, the extension program 112 determines the detection of an event (Y in step S210) and executes the corresponding event operation (step S2), as shown in the flowchart of FIG.
11).

As an event operation here, the extension program 112 creates and displays a function panel 122 which is another frame for enlargement / reduction display as shown in FIG. The function panel 122 includes an enlarge button 124 and a reduce button 125 together with an enlarged or reduced image 123 of the still image 121.
I will provide a. Therefore, when one of the buttons 124 and 125 is selected and instructed, the extension program 112 executes the enlargement rate or reduction rate change processing in response to the selection instruction.

Expansion program 112 for displaying a still image
By adding such a new function to, the user's visibility can be significantly improved as compared with simply pasting the still image 121 in the document.

The enlargement / reduction function of the extension program 112 can be realized by any well-known enlargement / reduction function.

Next, the function of the extension program 112, which is based on the premise that the stereoscopic image file is included as the media information 104 in the encapsulated document 101, will be described.

As shown in FIG. 17, the extension program 11
2 displays a stereoscopic image 131 in the document displayed on the display 310. The display area of the stereoscopic image 131 included in the document on the display 310 is the mouse 31.
When the selection instruction is given by clicking or the like by 2, the extension program 112 determines the detection of an event (Y in step S210) and executes the corresponding event operation (step S2), as shown in the flowchart of FIG.
11).

As an event operation here, the extension program 112 causes the pop-up frame 13 including the image 132 for enlarging, reducing, or displaying the stereoscopic image 131 as it is.
3 is displayed, and a viewpoint changing button 134 for switching the viewpoint is arranged on the pop-up frame 133.
Then, when any of the viewpoint changing buttons 134 is selected and instructed, the extension program 112 switches the viewpoint according to the selected viewpoint changing button 134.

As a result, the visibility of the user can be improved.

Next, the function of the extension program 112, which is premised on that the encapsulated document 101 contains a moving image file as the media information 104, will be described.

As shown in FIG. 18, the extension program 11
2 displays a still image 141 defined by one frame of a moving image in the document displayed on the display 310. Then, when the display area of the still image 141 included in the document on the display 310 is selected and instructed by clicking with the mouse 312 or the like, the extension program 11
2, as shown in the flowchart of FIG. 10, the event detection is determined (Y of step S210), and the corresponding event operation is executed (step S211).

As an event operation here, the extension program 112 causes the pop-up frame 14 including the image 142 for enlarging, reducing or displaying the still image 141 as it is.
3 is displayed, and a play button 144, a stop button 145, and a pause button 146 are displayed in the pop-up frame 143.
The operation button 147 consisting of appears. Then, when any of the buttons 144, 145, 146 included in the operation buttons 147 is instructed to be selected by a method such as clicking the mouse 312, the extension program 112 detects the event as shown in the flowchart of FIG. The determination is made (Y of step S210), and the corresponding event operation is executed (step S211).

As the event operation here, the extension program 112 reproduces the image 142 displayed as a still image as the original moving image if the selection instruction is the reproduction button 144, and the selection instruction is made. If is the stop button 145, the reproduction of the moving image is stopped. If the selection button is the pause button 146, the reproduction of the moving image is displayed as a still image at that time.

The function of the extension program 112, which is premised on that the encapsulated document 101 includes a voice information file as the media information 104, will be described.

As shown in FIG. 19, the extension program 11
2 displays a voice reproduction button 151 as a function panel and a reproduction panel in the document displayed on the display 310. When the display area of the voice reproduction button 151 included in the document on the display 310 is selected and instructed by clicking with the mouse 312 or the like, the extension program 112 determines the event detection as shown in the flowchart of FIG. (Y in step S210), the corresponding event action is executed (step S2).
11).

As the event operation here, the extension program 112 causes the read-aloud information display area 15 to be described later.
A pop-up frame 153 including 2 is displayed, and an operation button 157 including a play button 154, a stop button 155, and a pause button 156 appears on the pop-up frame 153. Then, when any one of the buttons 154, 155, 156 included in the operation button 157 is instructed to be selected by a method such as clicking the mouse 312, the extension program 112 detects the event as shown in the flowchart of FIG. The determination is made (Y in step S210), and the corresponding event action is executed (step S2).
11).

As the event operation here, the extension program 112 reproduces the voice in the voice information file included in the encapsulated document 101 if the selection instruction is the reproduction button 154, and the selection instruction is given. If is the stop button 145, the audio reproduction in the audio information file being reproduced is stopped, and if the selection instruction is the pause button 146, the audio reproduction in the audio information file being reproduced is temporarily stopped. To do.

As a further function, the extension program 112, when the reproduction button 154 is selected and instructed to reproduce the sound in the sound information file, the visible information obtained by converting the reproduced sound into text information is read out as voice reading information. Area 1
The personal computer 301 is caused to execute the function displayed on 52. Such an operation is performed when the document is browsed by the document browsing apparatus (usually the personal computer 301).
If the speaker for audio playback of is turned off,
This is effective when a person with a hearing loss views a document. Further, such a reading function is provided by the personal computer 301.
The pop-up operation may be automatically performed based on the setting of the speaker or the like, the setting of the assisting function for persons with disabilities, and the like.

Here, the voice information file may have a data structure as voice data obtained by sampling voice or may be text data.
In the case of text data, when the voice information file is played back, it can be played back by a method of converting the text data into voice data defined by a voice feature amount, for example, using a voice synthesis LSI. Further, when the voice information file is made up of text data, the text data can be used as it is for the text information conversion of the voice performed when the voice in the voice information file is reproduced. On the other hand, when the audio information file is composed of audio data, it is necessary to analyze the audio data and convert it into text information.

As mentioned above, the encapsulation document 10 contains many kinds of extension programs 112 according to the characteristics of various digital information to be displayed or reproduced.
It is possible to prepare for 1. Therefore, by preparing these extension programs 112 as parts of a multimedia document, it is possible to flexibly realize the extension programs 112 corresponding to various media. In this case, since only the necessary extension program 112 needs to be stored in the encapsulated document 101, handling of the encapsulated document 101 becomes extremely light.

FIG. 20 shows the structure of the extension program 112 included in the encapsulated document 101. In the encapsulated document 101 according to the present embodiment, the document arrangement information 102 is read by the basic program 111, and the document arrangement information 102 is read.
The digital information file (text information 1
03, media information 104) is started, and the started extension program 112 displays and reproduces the digital information file (text information 103, media information 104). In addition, each extension program 112 detects a user operation and performs a corresponding operation when the user operation is performed.
In this case, the digital information file (text information 10
3. In the case of the extension program 112 that does not refer to the media information 104), it simply receives a user operation and performs an operation according to the user operation.

As the user operation, it is possible to click the mouse 312 or input the keyboard 311. Mouse 312
In the case of clicking, it is sufficient to judge whether the click position of the mouse 312 is within the display occupation range of each extension program 112, and to perform the operation corresponding to the case where the mouse 312 is clicked within its own display range. Keyboard 311
In the case of input, the cursor position (not shown) that can be moved by the keyboard 311 is the extension program 11
It is only necessary to judge whether or not it is within the display occupancy range of No. 2, and to perform the operation corresponding to the case where the selection instruction is made in the own display range. For example, as shown in FIG. 21, in the case of a document displaying three pieces of digital information (PRG1, PRG2, PRG3), as an example, when the user clicks the mouse 312 in the part marked with X, the PRG2 The extension program 112 detects the click of the mouse 312 and executes the corresponding operation.

As described above, the document format of the encapsulated document 101 in this embodiment is the extension program 1 related to the type of each medium and the type of tag of the display information file.
It is composed of 12 groups, and the minimum configuration is composed of the basic program 111 and the document arrangement information 102. Then, the encapsulated document 101 prepares a digital information file (text information 103, media information 104) according to the information that the user wants to store in the encapsulated document 101, and the extension program 112 that allows the information to be reproduced and displayed. It is established by adding. Then, the encapsulated document 101 according to the present embodiment stores such various files as a single file using the archive format.

[Encapsulated Document Creation Service] As described above, in the encapsulated document 101 of this embodiment, various types of digital information files (text information 103, media information 104) are displayed by the extension program 112. It is possible to display and add various functions to the document. However, adding a new function to the encapsulated document 101 makes it easier for the viewer to understand the content of the document, but also imposes a new burden on the creator of such encapsulated document 101.

The first burden is that in order to create the encapsulated document 101 having a new document format, it is necessary to learn how to create it.

The second burden is that it is necessary to add a new function to the encapsulated document 101, and it is necessary to collect information necessary for adding such a function.

Therefore, in order to reduce these loads,
In the present embodiment, it is proposed that the service described below is provided to the user by using a digital communication network such as the Internet, and the cost is collected from the user as a consideration.

FIG. 22 is a schematic diagram of a client-server system constructed using the Internet communication network. As shown in FIG. 22, the Internet communication network 401
A server 402 serving as a plurality of service devices for providing information and management, and a client 403 serving as a user device for obtaining information from the server 402 or newly providing information are connected to the server. There is. Usually, the client 403 is composed of the personal computer 301 as described above, and the server 402 is composed of a computer having a large capacity and high processing capacity for the server 402. That is, by using the Internet communication network 401, the personal computer 301 serving as the client 403 can dispersely request the server 402 to provide information, or transmit unique information to request information processing. it can.

1. As a device for reducing the burden of creating a new document format, which is the first burden, regarding the service using the Internet communication network 401, FIG. Will be described with reference to.

FIG. 23 shows a server 402 and a client 40 which are connected via an internet communication network 401.
24 is a flowchart showing a processing procedure with the third embodiment.
FIG. 25 is a schematic diagram showing a conversion service screen for a document conversion service provided from the server 402 to the client 403, and FIG. 25 is a schematic diagram illustrating a security protection method on the net.

The user creates a document in a document format that he or she is familiar with.

Next, as shown in FIG. 23, the website providing the document conversion service is accessed through the internet communication network 401 (step S351).

Then, the server 402, which uploads the website providing such a document conversion service to the Internet, acquires the user information (step S301). As a method of acquiring the user information in this case, a membership system in which the user information is registered in advance and login authentication is performed may be adopted, or the user information may be acquired from the user information stored on the PC.

The server 402 that has acquired the user information transmits the conversion service screen 501 for the conversion service as shown in FIG. 24 to the personal computer 301 of the user, which is the client 403, as HTML data for displaying it as an HTML document. To do.

Next, the user uses the document designation field 502 in the conversion service screen 501 shown in FIG. 24 to designate the file to be converted (step S3).
52). The designated file may be a file in the personal computer 301 of the user who is the client 403, or may be a URL of an appropriate web page.

In response to this, the server 402 side uploads the designated document to the server 402 (step S302). At this time, if the image or the like in the document is not stored in the actual document due to the document reference or the like, the link is followed and the referenced file is also uploaded to the server 402 side. Then, the server 402 calculates the conversion fee based on the number, type, capacity, etc. of the uploaded files, and transmits the conversion fee list to the user-side personal computer 301 (step S303).

As a result, the conversion charge list is displayed on the personal computer 301 on the user side (step S353).

Next, the user selects the conversion service screen 501.
Various additional options can be set by clicking an additional option button 503 inside. That is, the user can select the new function to be added by clicking the additional option button 503 (step S354).

Then, on the server 402 side, the conversion condition transmitted from the user is acquired (step S304), and the conversion information is taken into consideration to calculate the cost required for the document conversion (step S305). Then, by transmitting the calculated total fee to the user side, the total amount is displayed in the fee display column 504 in the conversion service screen 501 shown in FIG. 24 in the user side personal computer 301 (step S355). . If the user is satisfied with such conversion conditions, the conversion service screen 501 shown in FIG. 24 is displayed.
The conversion button 505 shown inside is pressed to notify the conversion request to the server 402 (step S356).

Then, the server 402 acquires the conversion instruction (step S306) and converts the document in the format created by the user into the encapsulated document 101 (step S30).
7). Then, the converted encapsulated document 101 is created as a display document to be displayed on the user's personal computer 301, and this is transmitted to the user (step S308).

User's personal computer 301
Upon receiving the display document, displays the transmitted display document in the conversion document display field 506 in the conversion service screen 501 shown in FIG. 24 (step S357). Therefore,
The user looks at the document displayed in the converted document display field 506 in the conversion service screen 501 and issues an approval instruction if the displayed document can be approved (step S358). The approval instruction is the approval button 50 on the conversion service screen 501.
Made by 7 clicks.

On the other hand, if the user is not satisfied with the document conversion, the approval instruction in step S358 includes an instruction not to approve. To this end, in the conversion service screen 501, a disapproval button (not shown) is displayed in addition to the approval button 507 to allow the click, or an object for selecting approval or disapproval by clicking the approval button 507 appears. It is possible to adopt a method such as to let it do.

In any case, if the user is not approved,
The server 402 determines that the approval has not been obtained in step S309 (N in step S309), and therefore returns to the conversion condition acquisition process in step S304 again. Therefore, the user repeats the operation of designating and shifting the conversion condition in step S354 to repeat the process until the document is converted into a favorite document, and the converted document requested by the user is displayed in the converted document display field 50 in the conversion service screen 501.
6 is displayed, the user instructs approval by clicking the approval button 507 (step S step S3).
58).

If the converted document is approved (Y in step S309), the server 402 displays a display for determining the payment method on the display screen of the user's personal computer 301 to allow the user to select the payment method ( Step S359). As a result, the server 40
The user 2 acquires the payment method selected by the user (step S310), and collects the cost if there is no problem with the payment method (step S311). Cost collection is usually done by credit card, if you do this online
Online banking or the like can be used.

Thus, if the cost can be collected, the server 402 transmits the converted formal document to the user (step S312), and the user receives it (step S360).

By using the services described above, the user can create a document in the document format that he or she is accustomed to and convert it into the document format called the encapsulated document 101. Therefore, the user can create the encapsulated document 101 by replacing the work burden with a financial burden.

In the example described based on the flowchart of FIG. 23, it has been proposed to charge the user for the conversion service to the encapsulated document 101, but in order to popularize the new document format of the encapsulated document 101. It is also possible to provide conversion services free of charge.

On the other hand, in the case of charging the user for the conversion service for converting the encapsulated document 101, the display for confirmation of conversion is transmitted to the user's personal computer 301 in step S308 in FIG. It is desirable that the document is not the converted document itself but a document that allows the user to confirm the conversion. This is because if the complete document converted into the encapsulated document 101 is transmitted to the user, the data may be illegally acquired by the user and charging may not be possible.
Therefore, the user does not send the actual converted document but virtually executes the converted encapsulated document 101 on the server 402 to send only the image data, and the user performs various operations included in the encapsulated document 101. In case of performing the above, by sending the image changed by the operation, the converted encapsulated document 1
It is possible to let the user confirm the conversion without sending 01. Further, the converted encapsulated document 101 may be sent as a converted document encrypted by a special cipher, and may not operate without the cipher information from the server 402 that is currently accessing. That is, it is sent as a document that works while accessing this service, but does not work when accessing the service.
After the approval shown by 58, the encapsulated document 101 can be used only by the personal computer 301 on the user side without accessing the server 402 by sending the formal encapsulated document 101 or sending the above encryption. It can be so.

FIG. 25 is a schematic diagram illustrating a security protection method on the net. A user may want to secure the security of a document when transmitting / receiving the document to / from a web page that operates a document conversion service. In this case, as shown in FIG.
The client 403 side encrypts the text information and image information of the pre-conversion document using an appropriate encryption key, sends the information to the server 402, and the server 402 decrypts the received document using the encryption key. After that, the encapsulated document 101 is converted. In this case, in order to convert the document, the document can be correctly converted if the arrangement information, the length of the text, the size of the image, and the like are known. Therefore, specific text information or the contents of the image are unnecessary.

As another method, it is also possible to send only the document structure such as the length of text, the layout, and the layout of images without sending the actual contents of the document without using encryption or the like.

Further, in the above-described example, an example in which a completely different document format is converted into another document format (encapsulated document 101) is described.
01 may be transmitted, and a service for adding a new function to the encapsulated document 101 may be provided. Alternatively, from the user, the encapsulated document 10
1 may be sent, and a service for converting this into a normal general document format may be provided.

2. A device for reducing the second burden. It is necessary to add a new function to the encapsulated document 101, which is the second burden, or to collect information necessary for adding such a function. A device for coping with the need arises in addition to FIG.
This will be described with reference to FIG.

1. The automatically translated encapsulated document 101 can have various functions. For example, as a function of the extension program 112,
When a plurality of various types of digital information are designated in the same area, it is assumed that the digital information has a function of switching and displaying the plurality of digital information. Then, it is assumed that the document arrangement information 102 includes a description for arranging a button for instructing each extension program 112 to switch the display.

In such an extension program 112, as shown in FIG. 26, for example, as shown in FIG. 26, when it is possible to switch the information in two languages, Japanese and English, with the display switching button 601, the display switching button 601 is clicked. By doing so, the Japanese display and the English display can be easily switched, and two documents can be managed as one document.

However, creating the document information in such a plurality of languages places a heavy burden on the creator. Therefore, when the document conversion service described above with reference to FIGS. 22 to 25 is used, the server 402 automatically translates the text information in the document using a well-known automatic translation function, and adds the text in the designated language to the document. Convert to. By using such a document conversion service, the burden on the creator can be reduced.

Further, unlike a simple translation service, such a service adds new translation information to the document itself, so that the labor of pasting the translation information on the original document can be omitted.

Since the display language of the completed document can be switched by a simple operation, the user can see that
It is easy to quickly respond to the information you want to obtain.

Further, in the document conversion service, if the layout of the text document and the image and the like are put together, the burden on the document creator in that respect is greatly reduced.

2. Anation The following features can include an example of an anatomy feature that displays the meaning of terminology in a document.

As shown in FIG. 27, when the cursor 612 is moved to the technical term 611 in the document, the function for displaying the meaning of the technical term 611 is extended program 1
The case of adding 12 will be described.

The encapsulated document 10 having such a function
1 holds a technical term 611 and a data file 621 having a meaning corresponding to the technical term 611 as illustrated in FIG. 28. The extension program 112 for displaying such text information, in the text information,
When the cursor 612 is positioned on the technical term 611, step S2 in the flowchart illustrated in FIG.
An event is detected in step 10 (Y in step S210), and the data file 6 meaning the word (technical term 611) of the text corresponding to the coordinate position pointed by the cursor 612 is detected.
21 and the extracted words (term 62 in FIG. 28).
The semantic data (explanation 623 in FIG. 28) corresponding to 2) is retrieved and displayed on the display 310. Thus, using the encapsulated document 101 makes it easy to use the technical term 611.
A function to display the meaning of can be added.

However, such technical terms 611
It would be a heavy burden for the document creator to check and add the meaning of "." Therefore, the technical term 611 is written in the document.
By using the document conversion service described above with reference to FIGS. 22 to 25 to perform the service of adding the meaning of, the burden on the user is significantly reduced.

To actually perform this, the operation as shown in FIG. 29 may be performed at the time of document conversion in step S307 of the flowchart of FIG.

First, using a technical term database as a term database (not shown), terms matching the technical term 611 are extracted from the received document information, and the extracted terms are dealt with in the technical term database. Add an anatomy to do. As a result, the technical term 61
It is possible to create a data file 621 having a meaning including a pair of a term 622 that is 1 and its description 623. Then, by adding the data file 621 having this meaning to the document before conversion, the encapsulated document 101 with the term explanation function can be created.

If necessary, the term explanation function expansion program 112 may be added to the document.

Also, since the required term changes depending on the professional level of the viewer, the difficulty level 624 of the term 622 should be added to the meaning data file 621, and the term description should be added according to the difficulty level selected by the creator. Thus, it is possible to omit unnecessary term explanations.

Also, there are many technical terms 611 having different meanings even with the same spelling. Such terminology 611
In particular, there are many abbreviations and the like. For example, there are EC representing the European Community and EC representing electronic commerce. In order to select the explanation of such a term appropriately, the meaning data file 621 is added with a classification 625 for specifying the field of the term 622. Therefore, the creator may select the specialized field when receiving the term explanation service, or the specialized fields of the extracted terms may be aggregated to estimate the specialized field of the created document, and multiple specialized fields may be included in one term. For homonyms with explanations, explanations of fields close to the estimated specialized field may be added.

2. Summary As another function, it is possible to add a document summary to the encapsulated document 101.

The abstract of the document may be actually created by the creator, but at present, if it is a simple abstract, it can be automatically created by a computer using various language processing techniques.

Therefore, a document conversion service to which the summary creation is added may be provided.

[0173]

According to the invention of the document conversion service method described in claim 1, a step of receiving a document from a user in an environment in which a user device and a service device can send and receive information via a network, and the received document. To an encapsulated document, and transmitting the converted encapsulated document to a user, wherein the encapsulated document is one or more digital information files that are representation entities on the document. And a display information file that specifies a structure of the digital information file and a display state on the document, and the display state that is interpreted and executed together by a computer and is specified based on the display information file. And a digital information display program for displaying the digital information file on the display of the computer. And an operation program file including a function operation program for executing a specific function without referring to the digital information. Therefore, the digital information file, the display information file and the operation program file are united by the encapsulation means. Since it is encapsulated as one document, if the operation program file is interpreted and executed on the computer, the digital information file can be browsed, and only the operation program file must be pre-installed on the computer separately. Can release the user from. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. Moreover, an encapsulation document having many advantages as described above requires labor for its creation. However, according to the present invention, the creation of the encapsulated document is performed by the service device, so that the user's burden on the user device side is reduced. Can be reduced.

The invention according to claim 2 is the document conversion service method according to claim 1, wherein the step of transmitting the converted encapsulated document to the user includes converting the received document into the encapsulated document, and then converting the received document to the user. Since transmitting the temporary encapsulated document to the user, a step of receiving approval from the user who has transmitted the temporary encapsulated document, and a step of transmitting the formal encapsulated document after the user has approved, It is possible to prevent the unauthorized use of the encapsulated document by the user when the formal encapsulated document is suddenly given to the user.

The invention according to claim 3 is the document conversion service method according to claim 1, wherein in the step of converting the received document into an encapsulated document, the document is translated using an automatic translation function, and the translated document is translated. Since the process of generating the encapsulated document to which the document is added is included, the translation can be added to the document sent by the user.

The invention according to claim 4 is the document conversion service method according to claim 1, wherein the step of converting the received document into an encapsulated document stores a plurality of terms in association with their meanings. , A data file meaning to store the explanation in correspondence with the term in the document and an explanation corresponding to the term in the document displayed on the display of the computer when the term is specified. Since it includes a process of generating the functional operation program extracted from the meaning data file and displayed on the display and generating the encapsulated document to which the meaning data file and the functional operation program are added, It is possible to obtain an encapsulated document with a rotation function.

The invention of the data structure of the document according to claim 5 specifies one or more digital information files which are the representation entities on the document, the structure of the digital information file and the display state on the document. And a display information file that is interpreted and executed by a computer and is specified based on the display information file.
Alternatively, an operation program file including a digital information display program for displaying two or more digital information files on the display of the computer and a function operation program for executing a specific function without referring to the digital information. Since the digital information file includes descriptions in the same language in a plurality of languages, the functional operation program has a function of allowing selection of a language to be displayed on the display of the computer for the digital information file. Digital information files,
Since the display information file and the operation program file are encapsulated as a single document by the encapsulation means, if the operation program file is interpreted and executed by the computer, the digital information file can be browsed, and the operation program file can be viewed. It frees the user from the hassle of having to pre-install alone on the computer alone. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. Furthermore, the same document can be selectively displayed on the display in a plurality of languages, and the document can be easily browsed.

The invention of the data structure of the document according to claim 6 specifies one or more digital information files which are the representation entities on the document, the structure of the digital information file and the display state on the document. And a display information file that is interpreted and executed by a computer and is specified based on the display information file.
Alternatively, an operation program file including a digital information display program for displaying two or more digital information files on the display of the computer and a function operation program for executing a specific function without referring to the digital information. The digital information file includes a data file having a meaning of storing a description in correspondence with a term in a document, and the functional operation program includes:
When a term in the document displayed on the display of the computer is designated, the explanation corresponding to the term is extracted from the data file of the meaning and displayed on the display, so that the digital information file, the display information file, and Since the operation program file is encapsulated as a single document by the encapsulation means,
When the operation program file is interpreted and executed by the computer, the digital information file can be browsed, and the user can be relieved from the complexity of having to pre-install only the operation program file in the computer. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. Further, by simply designating a specific term in the document, the analysis can be displayed and the document can be easily browsed.

The invention of a storage medium according to claim 7 is one or more digital information files which are representation entities on a document, a display for specifying a structure of the digital information file and a display state on the document. An information file and a digital information display program which is interpreted and executed together by a computer and displays the one or more digital information files on a display of the computer in a display state specified based on the display information file; An operation program file including a function operation program for executing a specific function without referring to digital information, wherein the digital information file includes a description of the same content in multiple languages, The program displays the digital information file on the computer display. Since the data structure of the document having the function of permitting the selection of the language to be displayed is stored, the digital information file, the display information file and the operation program file are encapsulated as a single document by the encapsulation means. When the operation program file is interpreted and executed by the computer, the digital information file can be browsed, and the user can be relieved from the complexity of having to pre-install only the operation program file in the computer. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. Furthermore, the same document can be selectively displayed on the display in a plurality of languages, and the document can be easily browsed.

The invention of a storage medium according to claim 8 is one or more digital information files which are representation entities on a document, a display for specifying the structure of the digital information file and the display state on the document. An information file and a digital information display program which is interpreted and executed together by a computer and displays the one or more digital information files on a display of the computer in a display state specified based on the display information file; An operation program file including a function operation program for executing a specific function without referring to digital information; and the digital information file means to store a description in correspondence with a term in a document. Data file, and the functional operation program is displayed on the computer. When a term in the document displayed in is specified, the explanation corresponding to the term is extracted from the data file of the meaning and is displayed on the display. Since the data structure of the document is stored, the operation program file is stored in the computer. If it is interpreted and executed, the digital information file can be browsed, and the user can be relieved from the complexity of having to pre-install only the operation program file in the computer. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. Further, by simply designating a specific term in the document, the analysis can be displayed and the document can be easily browsed.

The invention of an information processing apparatus according to claim 9 includes a computer and a data structure of a document that can be browsed by the computer, and the data structure of the document is one or more that is an entity of expression on the document. Of the digital information file, a display information file that specifies the structure of the digital information file and a display state on the document, and a display state that is interpreted and executed together by a computer and is specified based on the display information file. An operation program file including a digital information display program for displaying one or more digital information files on the display of the computer, and a function operation program for executing a specific function without referring to the digital information; The digital information file contains the same contents in multiple languages. Since the functional operation program has a function of permitting selection of a language to be displayed on the display of the computer for the digital information file, the digital information file, the display information file and the operation program file are stored by the encapsulation means. Encapsulated as a single document, so
When the operation program file is interpreted and executed by the computer, the digital information file can be browsed, and the user can be relieved from the complexity of having to pre-install only the operation program file in the computer. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. Furthermore, the same document can be selectively displayed on the display in a plurality of languages, and the document can be easily browsed.

The invention of the information processing apparatus according to claim 10 is
A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representational entities on the document, the structure of the digital information file, and the document. The display information file for specifying the above-mentioned display state is interpreted and executed together by a computer, and the one or more digital information files are displayed on the display of the computer in the display state specified based on the display information file. Digital information display program to be displayed,
An operation program file including a function operation program for executing a specific function without referring to the digital information, and the digital information file stores the description in correspondence with the terms in the document. When a term in a document displayed on the display of the computer is designated, the functional operation program has a meaning data file and extracts a description corresponding to the term from the meaning data file, Since it is displayed on the display, if the operation program file is interpreted and executed on the computer, the digital information file can be browsed, and the user is relieved from the complexity of having to pre-install only the operation program file on the computer. be able to. Further, since the digital information file, the display information file, and the operation program file are encapsulated as a single document by the encapsulating means, it is possible to extremely easily handle and manage them. Further, by simply designating a specific term in the document, the analysis can be displayed and the document can be easily browsed.

[Brief description of drawings]

FIG. 1 is a schematic diagram showing a data structure of an encapsulated document.

FIG. 2 is a schematic diagram showing an example of a data structure of an archive file.

FIG. 3 is a schematic diagram showing an example of another data structure of an archive file.

FIG. 4 is a schematic diagram showing a data structure of a program stored in an encapsulated document.

FIG. 5 is a schematic diagram showing a data structure of an extended program reference file included in a program.

FIG. 6 is a schematic diagram showing an example of an encapsulated document described in XML.

FIG. 7 is a schematic diagram showing a display example of an encapsulated document described in XML as shown in FIG.

FIG. 8 is a hardware configuration diagram of a personal computer (computer).

FIG. 9 is a flowchart showing the flow of a conventional document browsing process performed by a personal computer (computer).

FIG. 10 is a flowchart showing the flow of document browsing processing of an encapsulated document by a personal computer (computer).

FIG. 11 is a schematic diagram showing a file structure of a file that defines a correspondence relationship between media types and extension programs.

FIG. 12 is a schematic diagram showing types of extension programs.

FIG. 13 is a schematic diagram showing a display example in which a page turning button appears.

FIG. 14 is a schematic diagram showing a description example of a functional operation program file.

FIG. 15 is a schematic diagram showing a process of using an auxiliary program for an encoding part of a file.

FIG. 16 is a schematic diagram illustrating a display image enlargement / reduction function by an extension program.

FIG. 17 is a schematic diagram illustrating a viewpoint changing function of a display image which is a stereoscopic image by an extension program.

FIG. 18 is a schematic diagram illustrating a display function of a display image which is a moving image by the extension program as a still image and a reproduction function thereof.

FIG. 19 is a schematic diagram exemplifying a voice reproduction function and a reproduction voice text information conversion function by the extension program.

FIG. 20 is a schematic diagram showing the structure of an extension program included in an encapsulated document.

FIG. 21 shows three pieces of digital information (PRG1, PRG2,
It is a schematic diagram which shows the document display example which is displaying PRG3).

FIG. 22 is a schematic diagram of a client-server system constructed using the Internet communication network.

FIG. 23 is a flowchart showing a processing procedure between a server and a client connected via the Internet communication network.

FIG. 24 is a schematic diagram showing a conversion service screen for a document conversion service provided from the server to the client.

FIG. 25 is a schematic diagram illustrating a security protection method on the net.

FIG. 26 is a schematic diagram for explaining a language switching function.

FIG. 27 is a schematic diagram for explaining an anation function.

FIG. 28 is a schematic diagram illustrating a meaning data file.

[Fig. 29] Fig. 29 is a schematic diagram showing the flow of a process of adding anation to a technical term.

[Explanation of symbols]

102 display information file (document arrangement information) 103 digital information file (text information) 104 digital information file (media information) 105 operation program file 112A digital information display program 112B functional operation program 301 user device, computer (personal computer) 310 display 401 Network 402 Service device (server) 403 User device (client)

Claims (10)

[Claims] 1. A step of receiving a document from a user in an environment in which a user device and a service device can send and receive information via a network; a step of converting the received document into an encapsulated document; Transmitting the encapsulated document to a user, wherein the encapsulated document is one or more digital information files that are representational entities on the document, a structure of the digital information file, and the digital information file on the document. And a display information file that specifies the display state of the computer, are interpreted and executed together by a computer, and display the one or more digital information files on the display of the computer in the display state specified based on the display information file. A digital information display program and a unique function without referring to the digital information An operation program file including a functional operation program for executing the document conversion service method. 2. The step of transmitting the converted encapsulated document to a user, the step of transmitting the temporary encapsulated document to the user after converting the received document into an encapsulated document, and the temporary capsule. The document conversion service method according to claim 1, further comprising the steps of receiving approval from a user who has transmitted the formalized document, and transmitting the formalized encapsulated document after the user has been approved. 3. The step of converting the received document into an encapsulated document includes a process of translating the document using an automatic translation function and generating the encapsulated document to which the translated document is added. The document conversion service method described in 1. 4. The step of converting the received document into an encapsulated document is performed by referring to a term database that stores a plurality of terms in association with their meanings and storing the terms in the document in correspondence with their explanations. A data file having the meaning and a function in which, when a term in a document displayed on the computer display is specified, an explanation corresponding to the term is extracted from the data file having the meaning and displayed on the display. 2. The document conversion service method according to claim 1, further comprising a process of generating a program and generating the encapsulated document to which a data file having these meanings and a functional operation program are added. 5. One or more digital information files that are representational entities on a document, a display information file that specifies the structure of the digital information file and the display state on the document, and are both interpreted by a computer. A digital information display program that is executed and displays the one or more digital information files on the display of the computer in a display state specified based on the display information file, and a unique program without referring to the digital information. An operation program file including a function operation program for executing a function, wherein the digital information file includes descriptions of the same content in a plurality of languages, and the function operation program includes the description about the digital information file. Allows you to choose the language to display on your computer display Capable of data structure of the document. 6. One or more digital information files that are representation entities on a document, a display information file that specifies a structure of the digital information file and a display state on the document, and are both interpreted by a computer. A digital information display program that is executed and displays the one or more digital information files on the display of the computer in a display state specified based on the display information file, and a unique program without referring to the digital information. An operation program file including a function operation program for executing a function, wherein the digital information file has a data file meaning to store the description in correspondence with the term in the document, The operating program refers to the terms in the document displayed on the computer display. It has been a corresponding description to the term extracted from the data file of the means to be displayed on the display when the data structure of the document. 7. One or more digital information files that are representation entities on a document, a display information file that specifies a structure of the digital information file and a display state on the document, and are interpreted together by a computer. A digital information display program that is executed and displays the one or more digital information files on the display of the computer in a display state specified based on the display information file, and a unique program without referring to the digital information. An operation program file including a function operation program for executing a function, wherein the digital information file includes descriptions of the same content in a plurality of languages, and the function operation program includes the description about the digital information file. Allows you to choose the language to display on your computer display Storage medium having ability to store a data structure of the document. 8. One or more digital information files that are representation entities on a document, a display information file that specifies a structure of the digital information file and a display state on the document, and are both interpreted by a computer, A digital information display program that is executed and displays the one or more digital information files on the display of the computer in a display state specified based on the display information file, and a unique program without referring to the digital information. An operation program file including a function operation program for executing a function, wherein the digital information file has a data file meaning to store the description in correspondence with the term in the document, The operating program refers to the terms in the document displayed on the computer display. Is the corresponding description to the term extracted from the data file of the means to be displayed on the display when the storage medium for storing a data structure of the document. 9. A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representation entities on the document, and the digital information file. And a display information file that specifies a display state on the document and a display information file that is interpreted and executed together by a computer and is displayed based on the display information file. A digital information display program to be displayed on a display of a computer, and an operation program file including a function operation program for executing a specific function without referring to the digital information, and the digital information file, The functional operation program including description in the same content in multiple languages Has a function to allow selection of the language to be displayed on a display of the computer for the digital information file, the information processing apparatus. 10. A computer and a data structure of a document that can be browsed by the computer, wherein the data structure of the document is one or more digital information files that are representation entities on the document, and the digital information file. And a display information file that specifies a display state on the document and a display information file that is interpreted and executed together by a computer and is displayed based on the display information file. A digital information display program to be displayed on a display of a computer, and an operation program file including a function operation program for executing a specific function without referring to the digital information, and the digital information file, Meaning data that stores the explanation in correspondence with the terms in the document When a term in the document displayed on the display of the computer is designated, the functional operation program extracts the explanation corresponding to the term from the data file of the meaning and displays it on the display. An information processing device.