JP3308153B2 - Multimedia information display system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system for storing and retrieving multimedia information, and presents multimedia information to a user according to the capability and purpose of a device for displaying and processing the information. The present invention relates to a system for performing data conversion of multimedia information in order to change the display of the structure when performing the operation.

[0002]

2. Description of the Related Art As a conventional system for converting multimedia document data, for example, tex or tex which performs data conversion of printing document data whose structure is described as text information on a single plane display medium called paper. Similarly, a system for displaying document data having a structure described as text information in a hypertext form on a computer display, for example, World Wide W
EB server, etc., or a system that converts document data in which the structure is described as text information into several indices on a computer and provides the information as information related by indexing (Japanese Patent Laid-Open No. 2-2490)
No. 23).

[0003] In these systems, when printing a structure description in text and displaying it on a screen, it is necessary to control elements of planar information expression such as enlarging chapter and section titles on paper. It has been used to create relationships, such as the next section in the same chapter, when used or displayed on a screen.

[0004]

SUMMARY OF THE INVENTION In a multimedia system, particularly a system for representing a structured information format in the real world such as a book on a computer,
It is necessary to convert document data in which the logical structure is described as text information into a format that directly expresses the structure of information such as the thickness of a book and nail headings.

[0005] This problem is caused by the problem of displaying information, which is multidimensional in the real world such as a book, on a computer display with respect to a conventional system for printing on a page basis or for flat display. In addition to controlling the elements of the planar representation of structural information expressed in text, controlling the relationship between information, and controlling the position of the information representation for expressing information in a multidimensional manner It is necessary to do.

According to the present invention, in order to improve the totality of information for a user who uses multimedia document data, multidimensional information is represented from a planarly described structure. Make it an issue.

[0007]

[MEANS FOR SOLVING THE PROBLEMS] A system for displaying multimedia information including text and images in a three-dimensional list on a two-dimensional display as an electronic book. Structural text analysis means for separating the information describing the structure and the information describing the content from the text in which the information describing the information structure and the information of the content to be transmitted to the user are mixed, and the information of the separated structure And a content information analyzing means for determining the size and display position of an area for expanding the separated content information into a display area, and a content information analyzing means. Information structure determining means for determining the structure as one book by associating the displayed position information with the structure stored in the structure information storage means, and expressed as one book Information storage means for storing the information, the structure generation means for searching the information storage means and extracting the heading information and the page number of the chapter or section arranged in the table of contents, and the page amount of the extracted chapter or section. Based on the number of chapters and sections selected in advance in descending order, and obtained by the display structure selecting means and the display structure selecting means as nail headings .
Determine the page where the nail heading is located Determine the nail heading page
Displays hand-throw and multimedia information in an open book format
The current multimedia information
Around the information to be displayed corresponding to the page
Book thickness to indicate the position corresponding to the entire media information
Thickness calculation display means for calculating and displaying only
The nail heading at a position on the thickness of the book on an existing page
And a book information interface means connected to the information storage means for displaying the shape of the book on a computer and utilizing the information. The dimensioning system is the means for solving the problem.

According to the present invention, multimedia information to be displayed is developed and arranged over a plurality of pages in a preset area, the thickness of the book is calculated, and a multi-dimensional information such as a nail head or a sticky note is placed at the corresponding page position. Display elements on the page of the page where the multi-dimensional display information determined from the logical structure exists on the thickness of the book, and display it to the user who uses the image and document data of the multimedia information. To improve the totality of information. At that time, the description of the logical structure
Descriptions for multi-dimensional display such as nail headings
Rarely, only logical structures such as chapters and sections are described.
Document structure such as chapters and sections included in the logical structure.
Description of the structure and information on the content to be transmitted contained in each structure
Multi-dimensional display such as nail heading automatically from the amount of
The information creator, so that the information creator
Even if a logical structure is described, multidimensional
Enable display.

[0009]

[0010]

[0011]

[0012]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below.
This will be described in detail with reference to the drawings.

[First Embodiment] First, in order to facilitate understanding, an embodiment of the present invention will be described .
It shows a first embodiment as a part. FIG. 1 is an example in which a multidimensional expression of an information structure using a book in the real world in the embodiment is expressed on a flat computer display. In the following description of the embodiment, a case where the structure of the book is expressed will be described as an example, but not limited to the book, a system that provides information in a structured representation in the real world such as a binder, Similar effects can be obtained when expressed on a computer display.

As an example of a method of expressing a book in the real world on a computer display, in FIG. 1, a book frame 1 is displayed to display an area in which the contents of the book are displayed, a nail heading 2 and a sticky note 3. Is separated from the area in which the structure for searching the contents is displayed. In an area where a structure for searching the contents is displayed, for example, a large item assigned by the author or a mark for an important item is displayed vertically on the left and right sides of the main frame 1 as a nail heading 2. Conversely, a mark required by the user, such as a sticky note 3, is displayed horizontally above the main frame 1, thereby separating the structure of the mark created by the author from the structure of the mark created by the user. further,
The information of the book thickness 4 displayed on the left, right, and bottom sides of the book frame 1 allows the current position information in the information expressed as one book and the nail heading 2 to be pasted at the position of the corresponding thickness. It is possible to perform a display in which the amount of each information classified by the nail heading 2 can be listed from the outside.

Thus, the separation of the area for displaying the information
By combining with a display for expressing the structure of information, a multidimensional structure of a book in the real world can be expressed on a flat display. In the present embodiment, a method of creating such a representation of the structure of information on a computer display from a logical description of information in text will be described.

FIG. 2 shows a system configuration according to this embodiment. The multimedia information enhancement display system according to the present embodiment is structured text data for inputting into the system mixed information of structured information of information and information of contents to be transmitted to a user as text information. An input unit 11, a structure text analysis unit 12 for separating information describing the structure included in the text data from information describing the contents, a structure information storage unit 13 for sequentially storing the information of the structure, A content information analysis unit 14 for determining the size and position of an area for expanding the information of the content thus obtained in the content display area, and the position information obtained by the content information analysis unit 14 and stored in the structure information storage unit 13 Information structure determining unit 15 that determines a structure when information is expressed as one book by associating a structure with the existing structure with information that is explicitly displayed as, for example, a nail heading in the information structure. , A display structure selection unit 16 for selecting information, an information storage unit 17 for storing information expressed as one book, and a display unit which is connected to the information storage unit 17 and displays the shape of the book to the user on computer data to display information. And a layout information storage unit 19 that stores layout information to be expressed as book information in the case of the present embodiment.

The information in which the information is structured and described as text information is, for example, SG standardized in ISO.
ML or T that describes the expression structure when creating a print document
eX, LaTeX, or a description format such as HTML that defines the display structure when browsing information on a computer display in the form of a paper roll may be used. In the present embodiment, book information is particularly displayed on a computer display. The description will be made using a language called BMDL which describes an expression for browsing information. The language system and description method of BMDL necessary in the description of the embodiment of the present invention are as follows.

(1) Book management function (description group for creating book format data) a) Book control function A series of book data to be input always starts with <BOOK> and ends with </ BOOK>. I do. This does not necessarily represent one book, but may be partial data of a book.

<BOOK>[<COVER> ......... <//
COVER>] [<BODY> ...... </ BODY>]
[<BACKCOVER> ......... </ BACKCOVER
R >>] </ BOOK> b) Cover area control function This function is for designating data to be pasted on the cover page. As the contents, only the image data is pasted.

<COVER>... </ COVER> c) Back cover area control function This function is for designating data to be pasted on the back cover page. As the contents, only the image data is pasted.

<BACKCOVER>... </ BAC
KCOVER> d) Content area control function Describe the function to paste the contents of the book. In the part of ......
The following functions can be described.

<BODY>... </ BODY> (2) Page generation and control functions (functions for creating functional pages such as a table of contents) a) Table of contents page generation <TOH1 SIZE = Value FONT = nam
e color = Value STYLE = Value
> B) Tag page generation (nail heading generation) <DUGPAGE SIZE = Value FONT =
name color = Value STYLE = Va
lue LABEL = name> c) Index page generation <INDEX SIZE = Value FONT = na
me color = Value STYLE = Value
e> (3) Page object generation function (display function of transmitted information) a) Chapter title generation <Chapter SIZE = Value FONT =
name color = Value STYLE = Va
lue POSX = Value POSY = Value
WIDTH = Value Height = Value
> Text </ Chapter> b) Section title generation <Section SIZE = Value FONT =
name color = Value STYLE = Va
lue POSX = Value POSY = Value
WIDTH = Value Height = Value
> Text </ section> c) Term title generation <Subsection SIZE = Value FO
NT = name color = Value STYLE
= Value POSX = Value POSY = Va
lue WIDTH = Value Height = Va
lue> text </ Subsection> d) Generate text <Contents SIZE = Value Font
= Name color = Value STYLE = V
value POSX = Value POSY = Value
e WIDTH = Value Height = Value
e> text </ Contents> e) Image generation <Graphic POSX = Value POSY =
Value WIDTH = Value Zoom = On
/ Off border = On / Off Resize
= On / Off>｛<IMG SRC = filenam
e SOUND = filename Interval
= Seconds>. . <<< / Graphic> (4) Other Layout Auxiliary Functions <PAGEBREAK> Go to the next page The book information interface 18 displays the structure of a book on a flat computer display as shown in FIG. This system aims to simulate the operation method.
274396 book information search and display method
The system for displaying book information shown in the information search processing device and method of -78168 may be used.

Japanese Patent Application Laid-Open No. 6-274396 discloses a method for searching and displaying book information. In a system in which a plurality of devices for searching and displaying book information are connected via a network, the book information and the book information are stored. When the user inputs search data of book information from the book information search operation input unit on the device in advance, the book information corresponding to the search data is stored in the book information storage unit. The book information search discriminating control unit checks whether or not the book information is stored. If the book data is not stored, the device refers to the table and checks the device in which the book information corresponding to the search data is stored. The search data is transmitted to the device in which the book information is stored. Other devices that have received the search data at the search data receiving unit
The corresponding book information stored in the book information storage unit is transmitted to the device that transmitted the search data. In the device of the transmitting user, the transmitted book information is received by the book information receiving unit, and is sent to the book synthesizing unit. The book combining unit combines the book information with the book graphic, displays the combined information, and provides the combined information to the user.

In the information retrieval processing apparatus and method disclosed in Japanese Patent Application Laid-Open No. 7-78168, first, a plurality of keywords stored in the keyword storage means are displayed on the keyword display means, and the keyword is displayed by the user on the keyword selection means. When a desired keyword is selected from, the book information search unit searches the book information storage unit for book information corresponding to the selected keyword. Next, the book information searched by the book information searching means, the tag information and the keyword attached to the book information are synthesized by the book information synthesizing means, and the synthesized book information is displayed by the display means and provided to the user. I do. In this manner, the book information is searched by the keyword selected by the user, and the searched book information and
By generating display information by synthesizing a tag attached to the book information, a keyword, and the like, and displaying the display information in a display format included in the book information, the user does not recognize the location information of the information corresponding to the keyword. Alternatively, when a user searches for displayed information, after inputting a keyword, desired information can be obtained by browsing.

FIG. 3 is a flow chart showing the process of the present invention in this embodiment. Using this, the process of the process in this embodiment will be described in detail.

First, in step 21, data with structure information described in the BMDL language is input from the structure text data input unit 11.

As described above, in the BMDL language, the structure information has a description enclosed by <> like SGML or the like, and can be identified by performing character string analysis. Therefore, in the structural text analysis unit 12, as step 22, the structural information enclosed by <>
The identification is performed by comparing the character strings, and the identified structure information is stored in the structure information storage unit 13 together with the identifier. BMD
A description example of the L language will be described later with reference to FIG. The content information is sent to the content information analysis unit 14 together with display modification information such as character size information and structural information identifiers used when displaying the contents described in the BMDL language.

Next, in order to arrange data such as text and images in the content information in the content display area, step 2 is executed.
Third, the rules for displaying images and texts stored in the layout information storage unit 19 are extracted according to the type of data, and the size of the area required to display data such as character strings and images is determined. calculate.

As an example of the calculation of the size of the area, when displaying text information, the width of the character added to the font information given together with the content information and the layout information stored in the layout information storage unit 19 are stored. The number of characters that can be displayed in one line on the book on the screen is determined by dividing the width of the page by the width of the character according to the width of the page of the book that can be displayed, and the number of characters of the sent text is displayed on one line Calculate the number of lines required for the text by dividing by the number of possible characters. The required area on the screen can be calculated by multiplying the required number of lines by the height of the character.

Similarly, if it is image data, information on the vertical and horizontal sizes given to the image data itself and the width of the displayable book page stored in the layout information storage unit 19 are displayed. By comparing with the information of the vertical length, if either the vertical or horizontal of the image data exceeds the size of the area of the page, the value exceeding the size of the Alternatively, the values are made equal to the corresponding values in the vertical direction, and the other is shrunk so as to maintain the same ratio. If both the vertical and horizontal values exceed the area of the page, the value that greatly exceeds the value of the page is adjusted to the value of the area of the corresponding page. If neither the vertical nor horizontal value of the image data exceeds the area, the vertical and horizontal values of the image data are set to the size of the area when displayed on a book. The simplest method of shrinking an image can be achieved by thinning out image data at regular intervals.

The resulting text data with the size of the display area on the book, the image data, and the data of the identifier for the information structure are sent to the information structure determination unit 15. In the case of displaying the shape of a book as shown in FIG. 1 in the information structure determination unit 15, the area in which information can be displayed changes depending on the page opened due to the thickness of the book, as in the case of a physical book. In order to arrange text and image data as the shape of a book, as a step 24, the value of the displayable area of the content information of the first page to be displayed is obtained from the layout information storage unit 19, and the coordinates of the upper left coordinate point are obtained. Is stored as the next arrangement position.

In step 25, an area from the upper left of the displayable area is secured for the data with the area sent from the content information analysis unit 14, and the data is arranged based on the area size and the next arrangement position. A comparison is made with the lower end of the display area in the vertical direction to determine whether the data fits in the page.

If the result of the determination is that the display fits into the display area,
In step 26, the data is set as the data of the corresponding page, and the value of the next arrangement position is set to the value of the lower end of the data or a value obtained by adding a predetermined value to the lower end. For example, the coordinates of the next arrangement position when arranging data are 40 dots in the horizontal direction and 100 dots in the vertical direction, and the vertical size of the area required by the data is 200 dots.
Assuming that the value of the displayable area in the page is 680 dots in the vertical direction, the value of the next arrangement position when the data is arranged is 40 dots in the horizontal direction and 300 dots in the vertical direction. At this time, for example, if the data area of the image and the text area are extremely close to each other, it becomes difficult for the user to see the data area.
In the case of 80 dots, if a space of 6% or 7 dots of 1% is provided and the next arrangement position is 307 dots, separation of data is expressed, so that it is easy to see.

If the result of determination in step 25 is that the page does not fit in the display area, then step 27
Is determined as image data or text data.

If the image data is divided, there is a case where the meaning of the data is lost, but in the case of text data, the area can be divided and arranged on a plurality of pages. The length in the vertical direction from the next arrangement position to the lower end is obtained.

Next, in step 29, in order to determine the number of lines of text that can be displayed in the display area, step 2 is executed.
8. The number of lines that can be displayed is obtained by dividing the vertical length obtained in step 8 by the vertical size of the area required for display obtained in step 23, and multiplied by the number of characters that can be displayed in one line. Determines the range of text that can be displayed on a.

Next, at step 30, the text data is divided into the range obtained at step 29 to obtain two pieces of text data. The previous data at the time of the division becomes the data displayed as the data displayed in the area in step 26, and the subsequent data becomes the data arranged in the next area.

Next, the structure information stored in the structure information storage unit 13 is attached to the data of the area determined in step 26 and, for example, the structure information indicating a chapter is displayed in a corresponding page. In step 31, the information structure selecting unit 16 searches the structure information storage unit 13 using an identifier attached to the data of the area, and obtains the corresponding structure information.

Next, in step 32, referring to the relationship between the structural information and the expression elements such as nail heads, the display structure selection unit 16 adds information on the expression elements such as nail heads to the corresponding page. .

Next, in step 33, the information of the expression elements, the information of the contents arranged in each page, and the page number are paired and stored in the information storage unit 17 in page units.

The image determined to be out of the applicable page in step 27 and the text data of the latter half divided in step 30 are stored in the page in the information storage unit 17 in step 34 in order to advance the page one page. The counter is incremented by 1, and the data displayed is returned to step 24 to display information from the beginning of the next page.

As a result, information to be expressed on a book described in BMDL is automatically divided into information in units of pages. For example, as shown in FIG. 1, if a book thickness 4 is given when displaying a book shape on a display, the value of the page counter in the information storage unit 17 is changed to the book thickness 4. By changing the picture of the book thickness 4 according to the ratio of each page to the page counter when browsing, the dimension of expression when displaying information on a flat display is increased by one dimension. Is possible.

A user who browses data in the book format browses information stored in the information storage unit 17 as book format information as shown in FIG. FIG. 4 is a flowchart showing a process of processing for increasing the dimension of information when a user of the present system browses the information in this format.

As a basic method for browsing user information in the present embodiment, first, in step 41, the information storage unit 1 is referred to by a page number to be referred to obtained from the user.
7 to obtain the information of the corresponding page, and as a step 42, calculate the thickness of the book corresponding to the current reference page for the relevant book, the ratio of the current page to the entire book, and the total book. Calculate the thickness of the entire page from the number of pages. Step 43: book information interface 1
A picture representing the book stored in 8 on the screen is displayed, and a picture having the thickness calculated in step 42 is displayed around the picture.

Next, as step 44, the information storage unit 1
7 is searched for the page number of the nail head and the character string of the nail head. The number of pages of the retrieved nail heading and the number of pages currently being referred to are compared in step 45. For information having a number of pages smaller than the current page, the thickness of the left side of the book image On the image, as step 46, the ratio of the number of pages of the nail head information to the current page is calculated, and the arrangement position of the nail head with respect to the thickness of the left side surface is determined.

Similarly, as a result of the comparison in step 45, the information having the number of pages larger than the current page is set to 47 on the right side image of the book image.
The ratio of the number of pages of the information of the nail head to the current page is calculated, and the arrangement position of the nail head relative to the thickness is determined.

For example, assuming that the total number of pages of a book is 100 and the current reference page is 40 pages, the size of the thickness area on the left and right sides of the 100-page book stored in the book information interface unit 18 Is 2 on the left
Assuming that 5 dots and 35 dots on the right are given, and that the nail heading is given on page 3, page 7, page 20, page 50, page 80 and page 95, page 3 is 3 pages / 40 pages * 25 dots. Left 2 dots, 7
Page is left 4 dots, page 20 is left 13 dots,
50 pages are (50-40) pages / 60 pages * 35
6 dots on the right side, 23 dots on 80 pages, 95 dots
The page has 32 dots, and is arranged in the thickness direction as shown in FIG.

Next, as shown in FIG. 1, the book information interface unit 18 performs step 48 so that the nail heading 2 can be listed in the thickness region without overlapping, as shown in FIG.
The area of each nail heading is arranged sequentially from the upper end of the image of the thickness on the left side, and then on the right side also from the lower end of the nail head arranged on the left side. For example, in the above example, it is assumed that the vertical size in which the nail heading can be displayed is 600 dots, the vertical size of the three-page nail heading is 70 dots, page 7 is 150 dots, and page 20 is 70 dots. If page 50 is given as 70 dots, page 80 is given as 70 dots, and page 95 is given as 70 dots, and if the area where the nail heading can be arranged is 15 dots from the top of the book thickness image, page 3 15 dots, 7 pages are 15 + 70 dots, 85 dots, 20 pages are 235 dots, 50 pages are 305 dots, 80 pages
Pages are 375 dots and 95 pages are 445 dots, and are arranged in a vertical direction as shown in FIG. At this time, if an interval of about 1% of the image of the thickness in the vertical direction is provided between the nail headings, it becomes easier to see.

Next, in step 49, information such as a still image and text of the page retrieved from the information storage unit 17 is displayed on the book image.

Next, as step 50, if the book information interface unit 18 holds information indicating that a sticky note is added to the book data, the book note is converted to the book image. Place horizontally on top.

In the case of the page referred to at this time,
By displaying the sticky note partially over the image of the text and displaying it as shown in FIG. 5, it is also possible to make it easier to understand that the sticky note is stuck on the relevant page.

As a result, the listing of the information structure described in the book, which was achieved because the book printed on paper has a three-dimensional shape, is reproduced on a flat display. it can.

Information described in BMDL in one embodiment is shown in FIG. 6, and is displayed as shown in the lower part of FIG. 6 in this format. In one embodiment, display elements for chapter titles, text, and figures are used. For each information expression element, Section
, Information is described in gothic from the top of the page, and text and still images are placed on the page.

As an example of the data structure in the structure information storage unit 13, as shown in FIG. 7, a unique identifier assigned to each content information such as one picture or one phrase text, and a data structure The type is stored. The type of the data structure may be any type as long as it is an element of the structure necessary for expressing the information in this format in the present invention. In the BMDL described above, chapters, sections, sections, and figures are provided. As an example of an embodiment, for example, by creating all the elements of the chapter and the section, the table of contents can be created. I can do it.

As an embodiment of the storage format of the data divided in each page unit in the information storage unit 17, an example is as follows.
As shown in FIG. 8, data for each page, such as nail headings and page numbers, and multimedia data such as texts and images arranged in each page are stored together. As shown in FIG. 8, the content data is composed of a coordinate position on each page, a type of information of the content to be displayed, and the actual state of the data. For example, when storing information such as a still image or an icon displayed on each page on a book like a moving image and a plurality of data such as moving image data transmitted to a user, In addition to the coordinate position of the data when the information is arranged, the coordinate position of the area for transmitting information to the user and the data are stored. Which data is controlled by the type of information of the content attached to each data.

As shown in FIG. 9, an example of the layout information in the layout information storage unit 19 is, for example, whether at least the type of the structure of the information to be displayed is a double-page book or a single-page book. It is composed of data indicating a display structure, a layout type indicating a type of layout at the time of display, and data expressing a size of an area required for each layout type.

Second Embodiment Next, a second embodiment of the present invention will be described. FIG. 10 is a system configuration diagram in the present embodiment.

In the present embodiment, for example, in order to automatically select information for providing a nail heading, after all the information described in the structured description language is input from the structured text data input unit 11, The structure generating unit 51 that searches the information storage unit 17 and extracts elements such as chapters and sections to which the nail heads are added is added to the system of FIG.
The other components of the system are the same as those of the first embodiment shown in FIG. 2 and will not be described because they can be easily analogized.

FIG. 1 shows the process of the processing in this embodiment.
1 is shown by the flowchart of FIG. As the process of the processing in the present embodiment, the information expressed in the structured description language is constructed in the information storage unit 17 as book-type data divided into each page unit. The description is omitted because it can be easily inferred.

When all the information constituting one book is input and stored in the information storage unit 17, the structure text data input unit 11 proceeds to step 61 as the book structure generation unit 5
1 is given a request to generate a nail heading. The structure generation unit 51 searches the information storage unit 17 in order to extract nail heading candidates, and searches for data of elements arranged in the table of contents such as chapters and sections and the page numbers where the corresponding information exists. . When the information includes two or more chapters, the information about the chapter is searched. When the information includes only one chapter or less, the information about the section information is searched.

The retrieved information and the page number are stored in the page data storage unit in the structure generation unit 51. At step 62, the difference between the page number of one chapter and the page number of the next chapter is calculated. Calculate the number of pages for each chapter and section.

Since it is highly likely that the main part of one book is described in an area where the number of pages in each chapter or section is large, step 63 is performed in the order of the number of pages in each chapter or section. Rearrange.

Next, in step 64, information of chapters or sections arranged in descending order of the number of pages by the number of predetermined thresholds is selected.

In order to add a nail head to the selected information, a chapter or section number is stored as the name of the nail head in the information of each corresponding page in the information storage unit 17 in step 65.

By the above processing, a nail head can be automatically given to a chapter or a section having a high possibility that important information is described.

As another example of the embodiment for selecting a nail heading, for example, creation of a table of contents in BMDL,
If information such as creation of an index is given to the structured text data input unit 11, in step 64, the information of the nail heading is selected so that the table of contents and the position of the index in the book can always be listed. In this case, information of a predetermined threshold value−2 pieces of information is selected.
By adding a nail heading to the table of contents and index of the information storage unit 17 at the top of the page, the position where the table of contents and index information exist, which serves as a guide for the information described in the book, can be always shown to the user. It becomes possible.

As shown in FIG. 12, one embodiment of the structure of the page data storage unit in the structure generation unit 51 includes at least a chapter or section name, a page number, and a section between the next chapter or section. The difference in the number of pages is stored.

[0068]

As described above, in the present invention,
By automatically converting information in which the information structure is described by text into book structure information, it is possible to display a multidimensional structure such as the thickness of a book on a flat display. As a result, the browsability of the entire information structure is improved for the user who browses the information.

[0069] Furthermore, according to the present onset Ming, in the description of the multi-media information, in case you do not give a description to improve the list of the structure of the entire information is also, chapter author information of the logical structure, such as or clause Only by giving the information, it is possible to improve the browsability of the structure of the entire information for the information viewer.

[Brief description of the drawings]

FIG. 1 is a diagram showing an example in which information is three-dimensionally displayed on a planar display according to a first embodiment of the present invention.

FIG. 2 is a system configuration diagram of a multimedia information enhancement display system according to the first embodiment.

FIG. 3 is a flowchart showing a process of performing a data registration process in the multimedia information enhancement display system according to the first embodiment.

FIG. 4 is a flowchart showing a process of displaying information in a higher-dimensional manner when a user browses the information in the multimedia information higher-dimensional display system in the first embodiment.

FIG. 5 is a diagram showing a method of determining a coordinate position when displaying information, such as nail heads, in a high-dimensional manner in the first embodiment.

FIG. 6 is a diagram showing a relationship when information of contents to be transmitted described in the BMDL language according to the first embodiment is converted into information of this format.

FIG. 7 is a diagram showing an example of a data structure in a structure information storage unit in the first embodiment.

FIG. 8 is a diagram showing an example of a data structure in an information storage unit in the first embodiment.

FIG. 9 is a diagram illustrating an example of a data structure in a layout information storage unit in the first embodiment.

FIG. 10 is a system configuration diagram of a multimedia information enhancement display system according to a second embodiment of the present invention.

FIG. 11 is a flowchart showing a process of determining information for adding a nail heading in the multimedia information enhancement display system in the second embodiment.

FIG. 12 is a diagram illustrating an example of a data structure of a page data storage unit in the structure generation unit according to the second embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Book frame 2 ... Nail heading 3 ... Sticky note 4 ... Book thickness 11 ... Structural text data input unit 12 ... Structural text analysis unit 13 ... Structural information storage unit 14 ... Content information analysis unit 15 ... Information structure determination unit 16 ... Display structure selection unit 17 ... Information storage unit 18 ... Book information interface unit 19 ... Layout information storage unit 51 ... Main structure generation unit

──────────────────────────────────────────────────続 き Continuation of the front page (72) Inventor Hiroshi Hamada 3-19-2 Nishi-Shinjuku, Shinjuku-ku, Tokyo Within Nippon Telegraph and Telephone Corporation (56) References JP-A-7-44306 (JP, A) ( 58) Field surveyed (Int.Cl. ⁷ , DB name) G06F 3/00 601-658 G06F 3/14-3/153 G09G 5/00-5/42 G06F 17/20-17/26 G06F 17/30

Claims (1)

(57) [Claims] 1. A system for displaying multimedia information including texts and images in a three-dimensional list on a two-dimensional display as an electronic book, wherein information describing the structure of the multimedia information is transmitted to a user. Structural text analysis means for separating the information describing the structure and the information describing the content from the text in which the content information is mixed, and the structure information storage means for sequentially storing the information of the separated structure; Content information analyzing means for determining the size and display position of an area for expanding the separated content information into a display area; display position information and structure information storage means obtained by the content information analyzing means; Information structure determining means for determining the structure as one book by associating the information with the existing structure, information storage means for storing information expressed as one book, and an information storage means. This structure generation means for searching for columns and extracting the heading information of the chapters and sections arranged in the table of contents and the page number to be posted, and a predetermined number of chapters and sections based on the extracted page numbers of the chapters and sections There is a display structure selecting means for selecting only a chapter or a section and setting it as a nail head, and a nail head obtained by the display structure selecting means exists.
When displaying the nail information page decision hand throw and multimedia information in a book open format,
The page currently referenced in the entire multimedia information
Multimedia information around information to be displayed in response to
Calculate book thickness to indicate position corresponding to entire report
Thickness calculation display means to be displayed, and the position on the thickness of the book of the page where the nail heading is present
And a book information interface means connected to the information storage means for displaying the shape of the book on a computer and utilizing the information. Multi-dimensional information display system.