JP2002175176A - Information presenting device and presenting method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily recognize the contents by even a use in a mobile environment limiting a display resource and a use by a visually handicapped person, when presenting an image file and HTML contents including the image file. SOLUTION: This device is provided with an image analysis processing part 102 for analyzing an image file including image data showing images and image information on the image data and obtaining the image information and a sound output part 106 for outputting the image information obtained by the image analysis processing part 102 in voice.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information presenting method and apparatus for presenting information or the like of an image file and a recording medium storing a control program for controlling the information presenting apparatus. Wor in the Internet especially
In an ld Wide Web (hereinafter referred to as "WWW") system, an information presenting method and apparatus suitable for presenting information and the like of HTML content including image files stored in a WWW server and an information presenting apparatus are controlled. The present invention relates to a recording medium storing a control program.

[0002]

2. Description of the Related Art An image file such as a JPEG file can be displayed using an image viewer or the like. The image can also be displayed after being enlarged or reduced. Image file creator, creation date, title,
Various image information such as a comment and a link related to the image file can be added to the image file as a header of the image file. The information included as the header can be displayed as text using the function of the image viewer.

[0003] In a WWW system, a Netscape Navigator is used.
And Internet Explorer (InternetE
(xproler), it is possible to access the WWW server, obtain HTML content described in HTML from the WWW server, and present information included in the HTML content using the display function of the browser. . HTML content is created using many references to image files in addition to descriptions of documents and links.

In a mobile environment where display resources are small,
In order to efficiently use display resources, a voice browser that outputs information by voice is effective. For phones and the like, a voice browser that only outputs voice is compatible with PDA (Persona).
In a small portable terminal such as l Data Assistance, an audio browser that outputs audio as an aid to screen output is used.

For visually impaired persons, the conventional WW
The W browser is very difficult to use because it is output by a GUI, but the voice browser can use voice as an output means, so that a visually impaired person can use it.

[0006] In the audio output of the audio browser, the main focus is on how to effectively read out the document data and the link information. Development is being carried out on whether or not it can be selected.

[0007] HTML files include image files, and image files contain a great deal of information visually. However, it is very difficult to express the visual information contained in this image by voice. difficult. Therefore, when presenting information on HTML content using a voice browser, an image file is ignored without consideration or displayed as it is (JP-A-11-110186), or a reduced image is created and displayed according to resources. (Japanese Patent Laid-Open No. 10
-326244).

Also, a method of describing image information in an HTML document such as reading out a sentence described in ALT of an IMG tag representing a reference to an image file in HTML content, or analyzing an image using OCR and including the image in an image. A method of reading out a sentence (JP-A-11-288364) is also considered.

[0009]

When it is desired to confirm an image file on a device such as a mobile device having a small screen display resource, the image file has been conventionally confirmed by a reduced display of the image or a text display of the image information. Lack of convenience due to limited display resources.

[0010] Regarding the image referred to from the HTML content, if the image is ignored, the information contained in the image is lost at all, and if the reduced image is displayed, the character information contained in the image is lost. There was a drawback that it could not be read. Of course, in a device having a small display resource, displaying an image as it is lacks convenience. When the image is analyzed by the OCR and the text included in the image is read out, it is not effective when the image does not include character information.

In the method of describing image information in an HTML document, if the HTML content creator and the image data creator are different, it is considered that the image information intended by the image creator is not necessarily transmitted. Further, when a certain image file is referred to from a plurality of HTML contents, all of the HTML files referred to when the image file is changed or the like are changed.
It is not easy to change the description in the L content, and there is a high possibility of a change error or the like. That is, it is difficult for a conventional voice browser to sufficiently present information included in an image by voice.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and has been made in consideration of a case where an image file or HTML content including an image file is presented in a mobile environment where display resources are limited, or when an HTML file including an image file is presented. The purpose is to make the contents easily recognizable even in use.

[0013]

In order to solve such a problem, for example, an information presenting apparatus of the present invention has the following configuration. That is, an image file containing image data representing an image and image information related to the image data is analyzed, and image analysis means for obtaining the image information, and audio for outputting the image information obtained by the image analysis means in voice Output means.

[0014]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [Embodiment 1] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing a configuration of an information presenting apparatus according to an embodiment of the present invention.

Referring to FIG. 1, reference numeral 100 denotes an image file to be presented. The image file includes image information described as header information and image data representing the image itself.
The header information describes, as image information, information such as the creator of the image file, the date of creation, the title, a comment, and a link related to the image file.

Reference numeral 101 denotes an information presenting apparatus for presenting image data and image information of an input image file. The information presenting apparatus 101 includes an image analysis processing unit 102 for analyzing image information and image data for an image file; Presentation method selection unit 103 for selecting a presentation method for the image, a screen output unit 10 for displaying the analyzed image data and displaying the text of the image information
4. Speech synthesis unit 105 for synthesizing the analyzed image information, and speech output unit 106 for outputting the speech synthesized by speech synthesis unit 105.

As information presentation methods, (1) image data is presented by the screen output unit 104, (2) image information is presented as text data by the screen output unit 104, and (3) image information is voiced by the audio output unit 106. There are three data presentation methods, which can be presented alone or in combination, and the presentation method selection unit 103 selects which presentation method to select. It may be set in advance according to the specifications of the information presentation device 101, or may be set by the user himself in response to a request from the user.

The operation of the information presentation apparatus 101 according to the present embodiment will be described with reference to the flowchart of FIG.

First, an image file is read in step S201. At this time, the holding place of the image file to be read is not limited. Reading from an image file held in the same information presenting device, reading from an image file held in another device, and reading via a network can be performed.

Next, in step S202, the image file read by the image analysis processing unit 102 is analyzed to obtain image information and image data. In step S203, it is determined whether to present the image data to the screen output unit 104. When presenting the image data, the image data is displayed on the screen output unit 104 in step S204. On the other hand, when the image data is not presented, the process proceeds to step S205.

In step S205, it is determined whether or not the analyzed image information is to be presented on the screen output unit 104 as text. When presenting a text, step S20
In step 6, the image information is displayed as text on the screen output unit 104.
On the other hand, if no text is to be presented, the process proceeds to step S207.

In step S207, it is determined whether or not the image information obtained by the analysis is output to the audio output unit 105 as audio. When presenting a voice, the image information obtained in step S208 is converted into voice by the voice synthesis processing unit 105, and voice output is performed by the voice output unit 106. On the other hand, if no voice is presented, the process ends.

An example of presenting image data and image information according to the present embodiment will be described with reference to FIG.

Reference numeral 301 denotes a presentation example in which image data is displayed, image information is output as audio, and text is displayed. The image data display result 302 displays image data, and the image information display result 303 displays image information in text. , A voice output result 304 for performing voice output of image information. The displayed image information is an example, and presents various other information.

Reference numeral 305 denotes a presentation example in which image data is displayed and text information of image information is displayed. The user did not select audio output, or the audio output of the information presentation device was restricted and could not be used. This is an example of the case.

Reference numeral 306 denotes a presentation example in which the text display of image information and the audio output of image information are performed. If the user does not select the display of the image data, Is an example of a case where is restricted like a mobile terminal.

In addition, a presentation method can be determined according to a user's request or a resource of the information presentation device.

[Second Embodiment] In the above embodiment, the analysis method in the image analysis processing unit 102 of the information presenting apparatus 101 is limited to the analysis of the header information of the image file. Further information can be obtained in combination with the analysis of character information. The information obtained by the character recognition processing is also added to the image information, and text display on the screen output unit 104 and audio output to the audio output unit 106 are performed based on the flowchart of FIG. it can.

[Embodiment 3] FIG. 4 is a block diagram showing a configuration of an information presenting apparatus according to an embodiment of the present invention.

In the figure, reference numeral 400 denotes HTML content including an image file, and the HTML content is HT.
It is composed of an HTML document file described in ML, an image file referred to by the HTML content, and other files referred to by the HTML content.

The referenced image file is composed of image information described as header information and image data representing the image itself. The header information includes, for example, the creator, creation date, title, and comment of the image file. And information such as a link regarding the image file.

An information presentation device 401 for presenting input HTML content has the following configuration.

The HTML content analysis processing unit 402
It analyzes the HTML document file in the input HTML content, analyzes the document information and link information described therein, and checks the referenced image file.

The image analysis processing unit 403 analyzes image information and image data for an image file referenced from the HTML content.

HTML content reconstruction processing section 404
Updates the HTML document file to reflect the obtained image information in the HTML content.

The presentation method selection unit 405 selects a presentation method for reconstructing HTML content.

The screen output unit 406 outputs the reconstructed H
The screen display of the TML content is performed by the speech synthesis processing unit 407.
Performs voice synthesis of the reconstructed HTML content, and the voice output unit 408 outputs the synthesized voice.

As a method of presenting an image file in HTML content, (1) image data is output to the screen output unit 40
6, (2) the image information obtained by analysis is presented as text on the screen output unit 406, and (3) the image information obtained by analysis is presented by the audio output unit 408 as audio data. It is possible to present each of them alone or to present them in combination. It may be set in advance according to the specifications of the information presentation device 401, or may be set by the user himself in response to a user request.

The operation of the information presentation device 401 according to the present embodiment will be described with reference to the flowchart of FIG.

First, in step S501, HTML content is read. Usually W through a network
HTM accessed WWW server and placed on WWW server
Acquire L content.

Next, in step S502, the HTML content read by the HTML content analysis processing unit 402 is analyzed. That is, it analyzes document information, link information, and image files referenced from the HTML content included in the HTML content.

In step S503, the image analysis processing unit 4
The image file referred to in step 03 is analyzed to obtain image information and image data.

In step S504, step S503 is executed.
The original HTML content is reconstructed by the HTML content reconstructing unit 404 so that the image information analyzed in step 1 is reflected. Based on the presentation method selected by the presentation method selection unit 405, it is determined whether to display the image data, whether to display the text of the image information, and whether to output the audio of the image information. Then, step S50
In step 5, screen output and audio output are performed based on the reconstructed HTML content according to the presentation method.

An example of the presentation of the HTML content information according to the present embodiment will be described with reference to FIG.

Reference numeral 601 denotes a presentation example in which text display of image information and audio output of image information are not performed. 602 is a screen display of information described as an HTML document, 603 is a screen display of image data, and 604 is H
The sound output of information described as a TML document is performed by a commonly used sound browser.

Reference numeral 605 denotes a presentation example in which image data is displayed and image information is output as audio, and is an example in a case where the user does not select text display of image information.

Reference numeral 606 denotes a presentation example in which text display of image information and audio output of image information are performed. If the user does not select display of image data, or resources of the screen output unit of the information presentation apparatus are displayed. Is an example in the case where is restricted like a mobile terminal.

In addition, the presentation method can be determined according to the user's request or the resources of the information presentation device.

[Fourth Embodiment] The analysis method in the image analysis processing unit 403 of the information presentation device 401 has been described as being limited to the analysis of the header information of the image file in the above embodiment, but is included in the image data by the character recognition processing. Further information can be obtained by combining this with the analysis of character information. The information obtained by the character recognition processing is also added to the image information, and text display on the screen output unit 406 and audio output to the audio output unit 408 are performed based on the flowchart of FIG. it can.

[Fifth Embodiment] In the above embodiment, the information presenting device 4 for presenting the input HTML content
01, to reduce processing on the terminal side,
L content analysis processing unit 402, image analysis processing unit 40
3. The HTML content reconstruction processing unit 404 can be applied to a gateway-type information presenting device realized by another device separated from the information presenting device.

[Embodiment 6] In the above embodiment, the current W
The HTML content described in HTML widely used in the WW system has been described. However, it is naturally applicable to content written in a markup language such as XML as in HTML.

[Embodiment 7] In the above embodiment, H
Although the HTML content according to the image information presentation method is reconstructed in the TML content reconstruction processing unit 404, the HTML content can be reconstructed into a content described in a markup language for a voice browser.

[Eighth Embodiment] In the above embodiment, the image information included as the header information of the image file may be described in the header information in a form suitable for speech synthesis such as phonetic text notation.

[Embodiment 9] Another object of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (a computer) of the system or apparatus. Alternatively, it is needless to say that the present invention can also be achieved by a CPU or an MPU) reading and executing the program code stored in the storage medium.

In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiment are realized, but also the OS (Operating System) running on the computer based on the instruction of the program code. ) May perform some or all of the actual processing, and the processing may realize the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided on a function expansion board inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that the CPU included in the function expansion board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0060]

As described above in detail, according to the present invention, when presenting an image file or HTML content including the image file, use in a mobile environment where display resources are limited, or use by a visually impaired person However, the contents can be easily recognized.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an information presentation device according to a first embodiment of the present invention.

FIG. 2 is a flowchart illustrating a processing flow of the information presentation device according to the first embodiment of the present invention.

FIG. 3 is an output diagram of the information presentation device according to the first embodiment of the present invention.

FIG. 4 is a block diagram illustrating a configuration of an information presentation device according to a third embodiment of the present invention.

FIG. 5 is a flowchart illustrating a flow of processing of an information presentation device according to a third embodiment of the present invention.

FIG. 6 is an output diagram of an information presentation device according to a third embodiment of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 image file 101 information presentation device 102 image analysis processing unit 103 presentation method selection unit 104 screen output unit 105 voice synthesis processing unit 106 voice output unit 400 HTML content 401 information presentation device 402 HTML content analysis processing unit 403 image analysis processing unit 404 HTML Content reconstruction processing unit 405 Presentation method selection unit 406 Screen output unit 407 Voice synthesis processing unit 408 Voice output unit 410 Network

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI theme coat ゛ (reference) // G09B 21/00 G09B 21/00 DF term (reference) 5B050 AA08 BA15 CA07 CA08 FA02 FA10 FA13 FA19 5B075 ND06 NK04 PQ02 PQ04 5E501 AA01 AA04 AB03 AC15 AC22 BA03 BA12 CA08 EA34 FA13 FA14 FA32 FB34

Claims (11)

[Claims] An image analysis unit that analyzes an image file including image data representing an image and image information related to the image data to obtain the image information; and converts the image information obtained by the image analysis unit into a voice. An information presentation device, comprising: an audio output unit for outputting. 2. Extraction means for analyzing the image data and recognizing characters included in the image data by character recognition to extract image data extraction information; and image data extraction information obtained by the extraction means. 2. The image output apparatus according to claim 1, further comprising: an image information generating unit configured to generate image information in combination with the image information, wherein the image information generated by the image information generating unit is provided to the audio output unit. Information presentation device. 3. A screen output means for displaying the image data and the image information, and whether or not the image data is displayed by the screen output means.
2. A presentation method selecting means for arbitrarily selecting a presence / absence of display of said image information by said screen output means and presence / absence of sound output of said image information by said sound output means. Information presentation device as described. 4. An HT for analyzing HTML content including an image file and extracting a document file and an image file.
ML content analysis means, and the HTML information obtained by using the image analysis means or the image generation means based on the image file extracted by the HTML content analysis means,
HT that reconstructs HTML content by reflecting it in the document file extracted by the L content analysis processing means
The information presentation apparatus according to claim 1, further comprising: ML content reconstruction processing means; wherein the audio output means outputs the HTML content reconstructed by the HTML content reconstruction processing means in voice. . 5. A screen output unit for displaying the image data and the image information, and whether or not the image data is displayed by the screen output unit.
A presentation method selecting means for arbitrarily selecting a presence / absence of display of the document file by the screen output means and a sound output of the document file by the sound output means. 4. The information presentation device according to 4. 6. An image analyzing step of analyzing an image file including image data representing an image and image information related to the image data to obtain the image information, and converting the image information obtained in the image analyzing step into voice. And an audio output step of outputting. 7. An extraction step of analyzing the image data and recognizing characters included in the image data by character recognition to extract image data extraction information; and an image data extraction information obtained by the extraction step. 7. An image information generating step of generating image information in combination with the image information, wherein the image information generated by the image information generating means is provided to the audio output means. Presentation method. 8. A screen output step of displaying the image data and the image information; and displaying or not displaying the image data in the screen output step.
7. A presentation method selecting step in which a user arbitrarily selects the presence or absence of display of the image information in the screen output step and the presence or absence of audio output of the image information in the audio output step. Information presentation method described. 9. An HT for analyzing HTML content including an image file and extracting a document file and an image file
The ML content analysis step, and the image information obtained by using the image analysis step or the image generation step based on the image file extracted in the HTML content analysis step,
HT that reconstructs HTML content by reflecting it in the document file extracted in the L content analysis process
7. The information presentation method according to claim 6, further comprising an ML content reconstructing process, wherein the audio output unit outputs the HTML content reconstructed in the HTML content reconstructing process by voice. . 10. A screen output step of displaying the image data and the image information; presence or absence of display of the image data in the screen output step; presence or absence of display of the document file in the screen output step; 10. The information presentation method according to claim 9, further comprising: a presentation method selection step in which a user arbitrarily selects the presence or absence of the audio output in the audio output step. 11. A storage medium for storing a control program for causing a computer to implement the information presentation method according to claim 6.