JP3033330B2 - Speech synthesis method for screen display output data - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention enables speech synthesis of data contents created by an application that is not compatible with a speech synthesizer, particularly by monitoring display output data on a screen. The present invention relates to a speech synthesis method for screen display output data.

[0002]

2. Description of the Related Art Conventionally, an application that is not compatible with a speech synthesizer is required to once save the data content in a text format and to terminate the application in order to perform speech synthesis of the data content created by the application. It is necessary to send the file to the speech synthesizer.

[0003]

In the prior art, it is necessary to save data contents once in a text format. Moreover, it is necessary to terminate the application after saving.

[0004] If the application does not have a function of saving in text format, speech synthesis becomes impossible.

[0005]

Means for Solving the Problems] screen speech synthesis method of the display output data of the present invention monitors the text display output to the screen from an application, sequentially storing display data
And one screen of display output from the application.
And monitoring processing means for outputting the display data detected accumulated finished, the display data contents from the monitoring processing unit,
Compare and analyze the display data received last time ,
And analysis processing means for outputting a new data content of ® emission display output, the data content from the analysis processing unit and buffer
A format in which a speech synthesizer can understand a specific amount of data on a regular basis
It converted to and an output processing means to pass to the speech synthesizer.

[0006]

FIG. 1 is a block diagram of an embodiment of the present invention.

Now, suppose that an application displays a screen on a text VRAM through an OS (or directly). The screen display output data monitor processing means B constantly monitors information that the application has rewritten the text VRAM through the OS, and accumulates the display data in a buffer of the screen display output data monitor processing means B. When the screen display output data monitor processing means B determines that the display output of the application has been completed, the display data accumulated in the buffer is passed to the screen display output data analysis processing means C.

The screen display output data analysis processing means C compares the passed data with the display data passed last time, and passes the data newly displayed by the application to the analysis result output processing means D as an analysis result.

The analysis result output processing means D processes the data of the analysis result into an interface which can be understood by the speech synthesizer E, and passes the processed data to the speech synthesizer E.

[0010] The speech synthesizer E performs speech synthesis of the passed data.

[0011] By repeating the above-described processing, it becomes possible to synthesize speech of data newly displayed by the application.

Next, screen display output data monitor processing means A
Is described. Now, suppose an e-mail application having a screen configuration as shown in FIG. This application has 4 screens and 7 screens
Assuming digits, the first line is always the application name "EM
AIL "is displayed. The screen at a certain point in time is shown in FIG. 2 (b), and as the data is transmitted from the server, the screen of FIG. 2 (c) and then the screen of FIG. 2 (d) Suppose you have moved to

When the application shifts from FIG. 2 (b) to FIG. 2 (c), the application displays the data of the third line on the second line,
The data on the fourth line is displayed on the third line, and the new data received from the server is displayed on the fourth line. The screen display output data monitor processing means monitors the screen display data of the application, and writes the data in the buffer corresponding to the line and column of the screen in the screen display output data monitor processing means as shown in FIG.

If an attempt is made to shift from FIG. 2 (c) to FIG. 2 (d), the application attempts to display the third line again on the second line. However, since data has already been written in the second line of the buffer of the screen display output data monitor processing means as shown in FIG. 3 (a), it is determined that the first screen display has ended, and the screen display output The contents of the buffer of the data monitor processing means are passed to the screen display output data analysis processing means. Then, after clearing the buffer, the screen display data is written into the buffer as shown in FIG.

Next, the specific processing contents of the screen display output data analysis processing means C will be described.

The screen display output data analysis processing means has two buffers of the same size as the buffer of the screen display output data monitor processing means.
Buffer 2. The buffer 1 contains the immediately preceding display data passed from the screen display output data monitor processing means.

Now, the application is changed from FIG.
It is assumed that the processing shifts to (c), and the buffer of the screen display output data monitor processing means in FIG. 3A is passed to the screen display output data analysis processing means. At this time, the screen display output data analysis processing means copies the contents of the buffer 1 to the buffer 2 as shown in FIGS. 4 (a), 4 (b), 4 (c), and 4 (d).
Then, the display data passed from the screen display output data monitor processing means is written. Next, as shown in FIGS. 4 (e) and 4 (f), buffer 1 and buffer 2 are compared, similar data is analyzed, and it is determined that the screen has scrolled up.
Is passed to the analysis result output processing means as newly displayed data.

Next, the specific processing contents of the analysis result output processing means will be described.

The analysis result output processing means has a ring buffer large enough to store the data passed from the screen display output data analysis processing means, and a pointer indicating the head of the data = SP and indicating the end. Pointer = EP.

Now, the application is changed from FIG.
It is assumed that the processing has shifted to (c), and the bottom line of the buffer 1 in FIGS. 4 (e) and 4 (f) has been passed to the analysis result output processing means. The analysis result output processing means adds the passed data as shown in FIGS. 5A and 5B, and rewrites the EP with the last pointer storing the passed data. The analysis result output processing means periodically converts a certain amount of data from the SP to an interface understood by the speech synthesizer and passes the data as shown in FIG. 5 (c). After passing the data, the value of SP is updated.

[0021]

As described above, according to the present invention, even if an existing application is not compatible with a speech synthesizer and does not support saving of a text file, the application is not terminated. Voice synthesis becomes possible. In particular, when writing a reply immediately to important contents while listening to the contents of the e-mail, or when reading the contents of a word processor or spreadsheet by speech synthesis and correcting immediately after confirming a typo, This method, which does not require termination of the application, is very effective.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an embodiment of the present invention.

FIGS. 2 (a), (b), (c), and (d) are diagrams showing screen examples of an e-mail.

FIGS. 3A and 3B are diagrams showing the contents of a buffer of the screen display output data monitor processing means. FIGS.

FIGS. 4A, 4B, 4C, 4D, 4E, and 4F are views showing the contents of buffers 1 and 2 of the screen display output data analysis processing means. .

5 (a), 5 (b) and 5 (c) are views showing the contents of a ring buffer of the analysis result output processing means.

Claims (1)

(57) [Claims] 1. Text from an application to a screen
Monitor the preparative display output, sequentially storing the display data, the
Check the end of one screen display output from the application
Monitor processing means for outputting the display data stored and stored ;
The display data content from the monitor processor receives the previous
Compare and analyze the displayed data contents and display the application
And analysis processing means for outputting a new data content of the output, before
Buffers the data content from the serial analysis processing means on a regular basis
Speech synthesis method of a screen display output data, characterized by comprising an output processing means to pass to convert a specific amount of data to a form understood speech synthesizer <br/> speech synthesizer.