JP2003241778A - Information processing apparatus and information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a convenient and portable information terminal the manufacturing cost of which does not increase as the number of parts such as an operation button increases for various information processing. <P>SOLUTION: When a user gives an instruction for performing various operation for 'playback', 'stop', 'temporary stop', 'fast forward', 'rewind', etc., during an operation for 'playback of sound-recorded data', 'read-aloud of stored document', 'read-aloud of new information', etc., the indication is detected and processing based upon the user's instruction is carried out without increasing the number of components such as an operation button. Consequently, the manufacturing cost can be suppressed. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus, an information processing method, a control program and a computer readable storage medium, and more particularly to an information processing apparatus, an information processing method, a control program and a computer readable storage medium using speech synthesis. .

[0002]

2. Description of the Related Art At present, for example, a portable information terminal as shown in FIG. 20 has been put into practical use, and various information processing is performed using this information terminal. This portable information terminal includes, for example, one including a communication unit, a storage unit, a voice output unit, and a voice synthesis unit, and in each of these units, for example, "recorded data reproduction", "stored document reading", Functions such as "Read out new information" have been realized. 1) "Recorded data playback" function Acoustic data such as music and language teaching materials downloaded through the communication unit is stored in the storage unit and played back at an arbitrary time and place. 2) "Read aloud document" function The text data such as novels stored in the data storage unit is read aloud using voice synthesis (text-to-speech conversion) to browse information regardless of location. 3) "Reading out new information" function Using the communication unit, connect to the Internet and obtain real-time information (text data) such as mail and news. Furthermore, the obtained information is read aloud using speech synthesis (text-to-speech conversion).

Furthermore, it is also possible to use the following functions that combine the above-mentioned "playback of recorded data", "reading of stored document", and "reading out new information". 4) “Read out document with recorded data as BGM” function While playing back recorded data, read a stored document and new information (text data) using voice synthesis (text-to-speech conversion). 5) "Interrupt notification of new arrival information" function When mail or new arrival news arrives, it is read aloud using voice synthesis (text-to-speech conversion). Since it is a voice, it is difficult to disturb the work even during other work. It is also possible to overlay synthetic speech while playing music or the like.

[0004]

However, the above-mentioned conventional method has the following two problems.

The first problem is that the number of operation buttons increases.

For any of "playback of recorded data", "reading of stored document", and "reading out new information", the user can "play", "stop", "fast-forward",
The operation instruction such as "rewind" can be performed together. However, in addition to the operation buttons for “play recorded data”, “read stored document”, and “read new information”, operation buttons such as “play”, “stop”, “fast forward”, and “rewind” are provided separately. In such a case, there is a problem that the installation place becomes large, the size of the entire information terminal becomes large, the number of parts increases, and the manufacturing cost rises.

The second problem is that when the "fast-forward" and "rewind" processes similar to the reproduction of recorded data are performed while reading aloud using voice synthesis (text-to-speech conversion),
During “fast forward” and “rewind”, the user cannot hear what is being read by using voice synthesis (text-to-speech conversion), which is inconvenient.

The present invention is intended to solve the above-mentioned problems of the prior art, and the purpose thereof is, for example, "playback of recorded data", "reading stored document", and "reading out new information" during operation. A portable information processing apparatus and an information processing method capable of performing various operations such as "play", "stop", "fast forward", and "rewind", and which does not increase the manufacturing cost due to an increase in the number of parts such as operation buttons. Is to provide.

Another object of the present invention is, for example, when performing "fast forward" and "rewind" processing similar to the reproduction of recorded data during reading using voice synthesis (text-to-speech conversion). However, it is an object of the present invention to provide a convenient and portable information processing device and information processing method by which a user can hear what is read aloud by using voice synthesis.

[0010]

An information processing apparatus according to an embodiment of the present invention for achieving the above object has the following configuration. That is, a voice reproducing means for reproducing a voice from voice data, a voice synthesizing means for voice-synthesizing and outputting text data, an instruction detecting means for detecting a user's instruction, and an operation of the voice reproducing means and the voice synthesizing means. Detecting means for detecting a state, instruction providing means for giving the user's instruction to either the voice reproducing means or the voice synthesizing means in accordance with the operating state, and the voice reproduction given the user's instruction. Means or the voice synthesizing means includes a control means for controlling to execute a process based on the user's instruction.

Here, for example, it is preferable that the user's instruction is any one of fast-forward, rewind, stop and pause.

Here, it is preferable that, for example, the instruction providing means gives the instruction to the voice synthesizing means when the voice synthesizing means is in operation.

Here, it is preferable that, for example, the instruction providing means gives the instruction to the voice reproducing means when the voice synthesizing means is not operating and the voice reproducing means is operating.

Here, for example, when the user's instruction is fast-forward and the instruction providing means gives the instruction to the voice synthesizing means, the control means selects from each sentence of the text data to be read out. It is preferable to control the voice synthesizing unit so that data of a predetermined portion is extracted to create summary data, and the summary data is synthesized and output.

Here, for example, when the user's instruction is fast-forwarding and the instruction providing means gives the instruction to the voice synthesizing means, the control means selects from each sentence of the text data to be read out. It is preferable to control the voice synthesizing unit so that the first phrase is extracted and the extracted phrases are sequentially synthesized and output.

Here, for example, when the user's instruction is rewind and the instruction providing means gives the instruction to the voice synthesis means, the control means causes each sentence of the text data to be read aloud. It is preferable to control the voice synthesizing unit so that the first phrase is extracted and the extracted phrase is voice-synthesized and output in the reverse order of the sentence arrangement of the text data.

Here, for example, when the user's instruction is reproduction, the instruction providing means detects whether or not a reading pointer indicating a position to start reading in the text data is set. It is preferable that, when the reading pointer is detected, the user's instruction is given to the voice synthesizing unit so that the voice synthesis of the text data is started from the position of the reading pointer.

Here, for example, when the user's instruction is reproduction, the instruction providing means detects whether or not a reproduction pointer indicating a position to start reproduction in the recorded data is set. It is preferable that, when the reproduction pointer is detected, the user's instruction is given to the audio reproduction means so as to start reproduction of the recorded data from the position of the reproduction pointer.

Here, for example, the control means may synthesize the voice data so as to output a predetermined sound corresponding to the data omitted from the text data by the voice synthesis means. It is preferable to control the means.

An information processing apparatus according to an embodiment of the present invention for achieving the above object has the following configuration. That is, a voice synthesizing unit for synthesizing and outputting text data, a dial for inputting a user's instruction, an angle detecting unit for detecting an angle of the dial, and the text according to the detected angle of the dial. And a control means for controlling the voice synthesizing means so that the data is voice-synthesized by fast-forwarding and output, or the text data is rewound and voice-synthesized.

Here, for example, it is preferable that the control means, when the angle of the dial is positive, synthesizes the text data by fast-forwarding and outputs it.

Here, for example, it is preferable that the control means further includes a changing means for changing the number of skipped phrases to be voice-synthesized in the fast-forwarding.

Here, for example, it is preferable that the control means controls the voice synthesizing means so as to output a predetermined sound corresponding to a portion where the phrase is skipped.

Here, for example, it is preferable that the control means, when the angle of the dial is negative, synthesize the voice data by rewinding and output the text data.

Here, for example, it is preferable that the control means further includes a changing means for changing the number of skipped clauses for speech synthesis in the rewinding.

Here, for example, it is preferable that the control means controls the voice synthesizing means so as to output a predetermined sound corresponding to a portion where the phrase is skipped.

An information processing method according to an embodiment of the present invention for achieving the above object has the following configuration. That is, a voice reproduction step of reproducing voice from voice data,
A voice synthesizing step of voice synthesizing and outputting text data, an instruction detecting step of detecting a user's instruction, a detecting hand step of detecting an operation state of the voice reproducing step and the voice synthesizing step, and depending on the operation state An instruction providing step for giving the user's instruction to either the voice reproducing step or the voice synthesizing step, and the voice reproducing step or the voice synthesizing step given the user's instruction based on the user's instruction. And a control step of controlling so as to execute the above process.

An information processing method according to an embodiment of the present invention for achieving the above object has the following configuration. That is, a voice synthesizing step of synthesizing and outputting text data, a dial for inputting a user's instruction, an angle detecting step of detecting an angle of the dial, and the text according to the detected angle of the dial. And a control step of controlling the voice synthesizing step so that the data is voice-synthesized by fast-forwarding and output, or the text data is rewound and voice-synthesized.

A control program according to an embodiment of the present invention for achieving the above object has the following configuration. That is, a control program for controlling an information processing apparatus, wherein the control program includes a code of a voice reproducing step of reproducing voice from voice data, a code of a voice synthesizing step of synthesizing and outputting text data, and a user. The code of the instruction detecting step for detecting the instruction, the code of the detecting step for detecting the operating states of the voice reproducing means and the voice synthesizing means, and the instruction of the user according to the operating state. Alternatively, the code of the instruction providing step given to any of the voice synthesizing steps and the voice reproducing step or the voice synthesizing step given the instruction of the user are controlled so as to execute a process based on the instruction of the user. And a code of a control process to be performed.

A computer-readable storage medium according to an embodiment of the present invention for achieving the above object has the following configuration. That is, a computer-readable storage medium storing a control program for controlling an information processing device, wherein the control program is a voice for reproducing a voice from voice data, and a voice for synthesizing and outputting text data. The code of the synthesizing step, the code of the instruction detecting step of detecting the user's instruction, the code of the detecting step of detecting the operating states of the voice reproducing means and the voice synthesizing means, and the user according to the operating state. Based on the instruction of the user, the code of the instruction providing step for giving the instruction of 1 to the voice reproducing step or the voice synthesizing step, and the voice reproducing step or the voice synthesizing step given the instruction of the user. And a control process code for controlling the process to be executed.

A control program according to an embodiment of the present invention for achieving the above object has the following configuration. That is, a control program for controlling an information processing device having a dial for inputting a user's instruction, wherein the control program detects a code of a voice synthesizing step for synthesizing and outputting text data and an angle of the dial. Depending on the code of the angle detecting step and the detected angle of the dial, the text data is voice-synthesized by fast-forward and output, or the text data is rewound to be voice-synthesized and output. And a code of a control step for controlling the synthesizing means.

A computer-readable storage medium according to an embodiment of the present invention for achieving the above object has the following configuration. That is, a computer-readable storage medium storing a control program for controlling an information processing apparatus having a dial for inputting a user's instruction, wherein the control program includes a code of a voice synthesizing step for synthesizing and outputting text data. According to the code of the angle detecting step for detecting the angle of the dial and the detected angle of the dial, the text data is voice-synthesized by fast-forwarding and output, or the text data is re-voiced by voice-synthesis. And a code of a control step for controlling the voice synthesizing means so as to output the speech.

An information processing apparatus according to an embodiment of the present invention for achieving the above object has the following configuration. That is, voice synthesizing means for synthesizing and outputting text data, instruction detecting means for detecting a user's instruction, detecting means for detecting an operating state of the voice synthesizing means, and the user according to the operating state. An instruction providing means for giving the instruction to the voice synthesizing means, and a control means for controlling the voice synthesizing means given the instruction of the user to execute processing based on the instruction of the user. Is characterized by.

Here, for example, when the user's instruction is fast-forward and the instruction providing means gives the instruction to the voice synthesizing means, the control means selects from each sentence of the text data to be read out. It is preferable to control the voice synthesizing unit so that data of a predetermined portion is extracted to create summary data, and the summary data is synthesized and output.

Here, for example, when the user's instruction is fast-forward and the instruction providing means gives the instruction to the voice synthesizing means, the control means selects from each sentence of the text data to be read out. It is preferable to control the voice synthesizing unit so that the first phrase is extracted and the extracted phrases are sequentially synthesized and output.

Here, for example, when the instruction of the user is rewinding and the instruction providing means gives the instruction to the voice synthesis means, the control means causes each sentence of the text data to be read aloud. It is preferable to control the voice synthesizing unit so that the first phrase is extracted and the extracted phrase is voice-synthesized and output in the reverse order of the sentence arrangement of the text data.

Here, for example, the control means may synthesize the voice data so as to output a predetermined sound corresponding to the data omitted from the text data by the voice synthesis means. It is preferable to control the means.

[0038]

DETAILED DESCRIPTION OF THE INVENTION An information processing apparatus according to an embodiment of the present invention will be described below with reference to the drawings. In this embodiment, a portable information terminal is used as an example of the information processing apparatus, but the scope of the present invention is not limited to the described example.

<First Embodiment> [Hardware Configuration: FIG. 1] FIG. 1 is a diagram for explaining the hardware configuration of a portable information terminal H1000 according to the first embodiment.

H1 is a central processing unit for performing processing such as numerical calculation and control, and performs calculation according to a control program which describes the processing procedure of the present invention. H2 is an output unit that presents information to the user. The output unit H2 includes a voice output unit H201 such as a speaker / headphone and a screen display unit H202 such as a liquid crystal.

H3 is an input unit through which the user gives an operation instruction to the information terminal H1000 or inputs information. The input section H3 includes a play button H301, a stop button H302, a pause button H303, and a fast forward button H3.
04, rewind button H305 and touch panel H3
A general-purpose input unit such as 06 is included.

H4 is a data communication unit such as a LAN card or a PHS card, and is used for acquiring data such as new mail. H5 is a storage unit such as a hard disk or a non-volatile memory, and holds recorded data and accumulated information. H6 is a read-only storage unit in which fixed data such as a control program showing the procedure of the present invention and a voice synthesis dictionary is stored.

H7 is a storage unit for holding temporary information such as a RAM, and holds temporary data and various flags. H8 is an interval timer unit, which functions to interrupt the central processing unit H1 after a predetermined time has elapsed after the timer was started. The central processing unit H1 to the timer unit H8 described above
Are connected by bus.

[Appearance of hardware configuration of information terminal: FIG. 20] FIG. 20 shows the portable information terminal H described in FIG.
3 is a sketch diagram showing an example of an external image of 1000 hardware configurations. FIG.

[Outline of each event process: FIG. 2] The event process in the information terminal H1000 described above will be described with reference to the flowcharts shown in FIGS. The following processing is executed by using the storage unit H7 that holds temporary information such as RAM based on the event-driven control program stored in the read-only storage unit H6 by the central processing unit H1. It is a thing. In addition, input processing from the input unit H3 and data request from the output unit H2,
An interrupt such as a timer interrupt is processed as the start of each event in the control program.

In FIG. 2, first, in event acquisition step S1, a new event is acquired.

Next, step S2 for determining the reproduction button depression
Then, it is determined whether or not the event acquired in the event acquisition step S1 is “press play button”. If the acquired event is “press play button”, the process proceeds to step S101 shown in FIG. If it is not "pressing the play button", the process is moved to the stop button press determination step S3.

Next, in the stop button press determination step S3, it is determined whether or not the event acquired in the event acquisition step S1 is "stop button press", and the acquired event is "stop button press". If so, the process proceeds to step S201 shown in FIG. 4, and if it is not “pressing the stop button”, temporary stop button press determination step S4
Transfer processing to.

Next, step S for determining whether or not the pause button has been pressed
In 4, it is determined whether or not the event acquired in the event acquisition step S1 is “pressing the pause button”. If the event is “pressing the pause button”, the process proceeds to step S301 shown in FIG. If it is not “pressing the pause button”, the process proceeds to the fast-forward button pressing determination step S5.

Next, the fast-forward button pressing determination step S5
Then, it is determined whether or not the event acquired in the event acquisition step S1 is “pressing the fast-forward button”. If it is “pressing the fast-forward button”, step S shown in FIG.
If it is not “pressing of the fast-forward button”, the process proceeds to 401, and the process proceeds to the fast-forward button release determination step S6.

Next, the fast-forward button release determination step S6
Then, the event acquired in the event acquisition step S1 is “release of the fast-forward button (operation to release the pressed button).
If it is "release of the fast-forward button", the process proceeds to step S501 shown in FIG. 7. If it is not "release of the fast-forward button", the rewind button press determination step S7 is performed. Transfer processing.

Next, the rewind button depression determination step S
In 7, it is determined whether or not the event acquired in the event acquisition step S1 is “pressing the rewind button”,
If it is "push of rewind button", the process is moved to step S601 shown in FIG. 8. If it is not "push of rewind button", rewind button release determination step S8.
Transfer processing to.

Next, the rewind button release determination step S
In 8, it is determined whether or not the event acquired in the event acquisition step S1 is “release of rewind button”,
If it is "release of rewind button", the process proceeds to step S701 shown in FIG. 9. If not "release of rewind button", the process proceeds to new information arrival determination step S9.

Next, in the new information arrival determination step S9, it is determined whether or not the event acquired in the event acquisition step S1 indicates that "new arrival information" has arrived. If there is, the process is moved to step S801 shown in FIG. 10. If “new arrival information” has not arrived, the accumulated information reading instruction determination step S10.
Transfer processing to.

Next, in the accumulated information reading instruction determination step S10, it is determined whether or not the event acquired in the event acquisition step S1 is "user's accumulated information reading instruction", and "user's accumulated information reading instruction". 11 ", the process proceeds to step S901 shown in FIG. 11. If it is not"user's instruction to read stored information ", the process proceeds to voice synthesis data request determination step S11.

Next, the voice synthesis data request judgment step S
At 11, it is determined whether or not the event acquired at the event acquisition step S1 is a "data request from the synthetic voice output device", and if the event is a "data request from the synthetic voice output device", it is shown in FIG. Step S1001
If it is not "a data request from the synthetic voice output device", the recording / playback data request determination step S1 is performed.
Transfer the process to 2.

Next, a recording / playback data request determination step S
At 12, it is determined whether or not the event acquired at the event acquisition step S1 is a “data request from the recording data output device”. If the event is a “data request from the recording data output device”, it is shown in FIG. Step S11
When the processing is moved to 01, and it is not “data request from recording data output device”, timer event determination step S
The process is moved to 13.

Next, a timer event determination step S13
Then, it is determined whether or not the event acquired in the event acquisition step S1 is a notification from the timer unit H8 indicating that a predetermined time has elapsed after the timer is started, and the timer unit H
If it is a notification from S8, step S12 shown in FIG.
The process proceeds to 01, and if not a notification from the timer unit H8, the process returns to the event acquisition step S1.

["Pressing Playback Button" Process: FIG. 3] Next, the process of each event described above will be described in detail below. First, the "pressing the play button" process will be described with reference to FIG.

[Reading Pointer] Reading Pointer Setting Judgment (Reproduction) In step S101, it is judged whether or not the "reading pointer" is set, and if the "reading pointer" is set, the voice synthesis pause flag is released.
(Reproduction) The process proceeds to step S106. If the "speech pointer" is not set, the process proceeds to priority read-out sentence existence determination (reproduction) step S102. The "reading pointer" is, for example, an area for holding the position where the next voice synthesis is performed and the reading is started in the middle of the priority reading sentence (text data) of which an example is shown in FIG. The position of the "reading pointer" is set as a value.

Next, in the priority reading sentence existence determination (reproduction) step S102, it is determined whether or not "a priority reading sentence exists", and if "a priority reading sentence exists", a priority reading sentence initial pointer setting step S108. If the "preferred reading sentence does not exist", the process proceeds to the accumulated reading sentence existence determination step S103.

Next, step S for judging the presence of the accumulated read sentence
In 103, it is determined whether or not "the accumulated reading sentence exists", and if the "cumulative reading sentence exists", the process moves to the accumulated reading sentence initial pointer setting step S109, and if "the accumulated reading sentence does not exist". Play pointer setting judgment
(Reproduction) The process moves to step S104.

[Playback Pointer] Next, in the playback pointer setting determination (playback) step S104, it is determined whether or not the "playback pointer is set". If the "playback pointer is set", the playback pause flag is cleared. (Playback) The process proceeds to step S111, and if the "playback pointer is not set", the process proceeds to recording data existence determination step S105. The "reproduction pointer" is an area for holding the position to be reproduced next, and is not set or the position of the "reproduction pointer" in the recorded data is set as a value.

Next, step S10 for judging the existence of recorded data.
In 5, it is determined whether or not "recorded data exists",
If "recording data exists", the process moves to the recording data reproduction initial pointer setting step S113, and if "recording data does not exist", the process moves to the event acquisition step S1 in FIG.

Next, the voice synthesis pause flag is cleared (reproduced).
In step S106, the voice synthesis pause flag is cleared. The voice synthesis pause flag is a flag indicating whether or not voice synthesis is in a temporary state, and takes a value of "true" when set and "false" when released.

Next, speech synthesis restart (reproduction) step S1
In 07, the speech synthesis which has been temporarily stopped in step S304 of FIG. 5 is restarted, and then the process proceeds to the event acquisition step S1 of FIG. The processing in each of the "speech synthesis start", "speech synthesis stop", "speech synthesis pause", and "speech synthesis restart" routines will be described later with reference to FIG.

Next, in the priority reading sentence initial pointer setting step S108, the reading pointer is set to the head of the priority reading sentence, and the process proceeds to the voice synthesis starting step S110.

Next, in the step S109 for setting the initial pointer of the accumulated reading sentence, the reading pointer is set to the head of the accumulated reading sentence, and the process proceeds to the voice synthesis start step S110.

Next, after the reading pointer is set in the priority reading sentence initial pointer setting step S108 or the accumulated reading sentence initial pointer setting step S109,
After the voice synthesis is started in the voice synthesis start step S110, the process is moved to the event acquisition step S1 of FIG.

Next, in the reproduction pause flag release (reproduction) step S111, the reproduction pause flag is released. The playback pause flag is a flag indicating whether or not the playback of recorded data is in a temporary state.

Next, in step S112, the reproduction of the recorded data, which has been paused in step S308, is restarted, and the event acquisition step S is performed.
The process is transferred to 1. FIG. 16 shows the processing in each of the "recording data playback start", "recording data playback stop", "recording data playback pause", and "recording data playback restart" routines.
Will be described later.

Next, in the recording data reproduction initial pointer setting step S113, the reproduction pointer is set to the head of the recording data, and the process proceeds to the recording data reproduction starting step S114. In the recording data reproduction start step S114, the reproduction of the recording data is started and then the process proceeds to the event acquisition step S1 of FIG.

["Stop Button Press" Process: FIG. 4] Next, the "stop button press" process will be described with reference to FIG.

In reading pointer setting determination (stop) step S201, it is determined whether or not the "reading pointer" is set, and if the "reading pointer" is set, the voice synthesis pause flag is released (stop) step S2.
03, and if the "reading pointer" is not set, the playback pointer setting determination (stop) Step S
The process is moved to 202.

Next, in the reproduction pointer setting judgment (stop) step S202, it is judged whether or not the "reproduction pointer" is set, and if the "reproduction pointer" is set, the reproduction pause flag is canceled (stop) step. The process proceeds to S206, and if the "reproduction pointer" is not set, the process proceeds to the event acquisition step S1.

Clearing (Stopping) Voice Synthesis Pause Flag In step S203, the voice synthesis pause flag is cleared. Next, in step S204, the reading pointer is canceled (stopped), and the reading pointer is canceled (not set). Next, after the voice synthesis is stopped in the voice synthesis stop step S205, the processing is shifted to the event acquisition step S1 of FIG.

Next, in the reproduction pause flag release (stop) step S206, the reproduction pause flag is released. Next, in step S207, the playback pointer is released (stopped), and the playback pointer is released (unset). Next, after stopping the reproduction of the recording data in the recording data reproduction stop step S208, the processing is shifted to the event acquisition step S1 of FIG.

["Press Pause Button" Processing: FIG. 5]
Next, the process of “pressing the pause button” will be described with reference to FIG.

First, reading pointer setting judgment (temporary stop)
In step S301, it is determined whether or not the "reading pointer" is set. If the "reading pointer" is set, the process proceeds to the voice synthesis pause flag setting determination step S302, and the "reading pointer" is set. If not, the process moves to the reproduction pointer setting determination (temporary stop) step S305.

Next, in the voice synthesizing pause flag setting judgment step S302, it is judged whether or not the voice synthesizing pause flag is set, that is, whether or not the voice synthesizing is in a suspended state, and the voice synthesizing pause flag is set. If
Reading pointer setting judgment (reproduction) in FIG. 3 Step S1
01, and if the voice synthesis pause flag is not set, the voice synthesis pause flag setting step S30
Processing is transferred to 3.

Next, in the voice synthesis pause flag setting step S303, the voice synthesis pause flag is set (value is set to "true"). Next, voice synthesis pause step S3
After the voice synthesis is temporarily stopped at 04, the process proceeds to the event acquisition step S1 of FIG.

Next, reproduction pointer setting judgment (temporary stop)
In step S305, it is determined whether or not the "reproduction pointer" is set. If the "reproduction pointer" is set, the process proceeds to the reproduction pause flag setting determination step S306, and the "reproduction pointer" must be set. For example, the process proceeds to the event acquisition step S1 of FIG.

Next, in the reproduction pause flag setting judgment step S306, it is judged whether or not the "reproduction pause flag" is set, that is, whether or not the reproduction of the recorded data is in the pause state, and the "reproduction pause flag" is judged. If it is set, the process moves to the reading pointer setting determination (reproduction) step S101 in FIG. 3, and if the "reproduction pause flag" is not set, the reproduction pause flag setting step S3.
The process is transferred to 07.

Next, a reproduction pause flag setting step S3
At 07, the reproduction pause flag is set (the value is set to "true"). Then, the recording data reproduction pause step S30
At 8, the reproduction of the recorded data is temporarily stopped, and the process proceeds to the event acquisition step S1 in FIG.

["Fast Forward Button Pressing" Process: FIG. 6] Next, the "fast forward button pressing" process will be described with reference to FIG.

Reading Pointer Setting Judgment (Fast Forward) In step S401, it is judged whether or not the "reading pointer" is set. If the "reading pointer" is set, the fast forward reading timer mode setting step S4.
If the "reading pointer" is not set, the process proceeds to step S405.

Next, in the fast-forward reading timer mode setting step S402, the timer mode is set to "fast-forward reading", and the fast-forward event mask setting step S402.
The processing is moved to 403. The timer mode indicates the use of the timer.

Next, in the fast-forward event mask setting step S403, the event mask is set for fast-forward processing, and the events acquired in the event acquisition step S1 are referred to as "fast-forward button release", "voice synthesis data request", Limit to “Recording / playback data request” and “Timer event” only.

Next, timer start (fast forward) step S4
The timer is started at 04 so that a timer event occurs after a predetermined time. Then, the process proceeds to the event acquisition step S1 of FIG.

Play Pointer Setting Judgment (Fast Forward) In step S405, it is judged whether or not the play pointer is set, and if the play pointer is set, the process moves to the fast forward playback timer mode setting step S406, and the play pointer is set. If not set, the process proceeds to the event acquisition step S1 of FIG.

Fast-forward playback timer mode setting step S4
In 06, set the timer mode to "Fast forward playback",
The processing moves to the fast-forward event mask setting step S403.

["Fast Forward Button Release" Process: FIG. 7] Next, the "fast forward button release" process will be described with reference to FIG.

First, in the event mask release (fast forward) step S501, the event mask is released, and all the events are acquired in the subsequent event acquisition step S1.

Timer mode initialization / timer stop (fast forward) After the timer mode is initialized in step S502, the timer is stopped.

Next, it is judged whether or not the "reading pointer" is set in the reading pointer setting judgment (fast forward cancellation) step S503, and if the "reading pointer" is set, the reading mode judgment (fast forward) step S504. If the "reading pointer" has not been set, the process proceeds to step S511 for determining playback pointer setting (fast forward cancellation).

Reading mode determination (fast forward) Step S
At 504, it is determined whether or not the reading mode is "fast-forward". If it is "fast-forward", the reading mode is initialized (fast-forward). Step S505 is performed. ) Step S50
Processing is transferred to 8.

Next, in reading mode initialization (fast forward) step S505, the reading mode is returned to the initial state. Next, read pointer return (fast forward) Step S
In 506, the reading pointer set in the abstract sentence created in step S1207 of FIG. 14 is set to the corresponding position in the original document.

Then, the abstract sentence is discarded in step S507 for discarding the abstract sentence, and then the process proceeds to step S1 for acquiring the event in FIG.

Next, voice synthesis stop (fast forward) step S
At 508, voice synthesis is stopped. Next, in the reading pointer forward skip step S509, the reading pointer is moved to the beginning of the sentence next to the sentence currently being read.
Next, voice synthesis is started in voice synthesis start (fast forward) step S510, and the process proceeds to event acquisition step S1.

On the other hand, judgment of playback pointer setting (fast forward cancellation)
In step S511, it is determined whether or not the "playback pointer" is set, and if the "playback pointer" is set, recording / playback mode determination (fast forward) step S512.
If the "reproduction pointer" is not set, the process proceeds to event acquisition step S1 in FIG.

Recording / playback mode determination (fast forward) Step S
At 512, it is determined whether the recording / playback mode is "fast forward". If it is "fast forward", the recording / playback mode is initialized (fast forward). Stop (fast forward) Moves the processing to step S514.

Next, in the recording / playback mode initialization (fast forward) step S513, the recording / playback mode is returned to the initial state, and then the process proceeds to the event acquisition step S1 in FIG.
Then, stop playing the recorded data (fast forward) in step S514.
Now, stop playing the recorded data. Next, in the skip forward playback pointer step S515, the playback pointer is advanced by one index. For example, if the recorded data is music data, the playback pointer will move to the beginning of the next song.

Next, after the reproduction of the recording data is started in the recording data reproduction start (fast forward) step S516, the processing is shifted to the event acquisition step S1 of FIG.

["Press rewind button" processing: FIG. 8]
Next, the process of "pressing the rewind button" will be described with reference to FIG.

First, in the reading pointer setting judgment (rewinding) step S601, it is judged whether or not the "reading pointer is set", and if the "reading pointer is set", the rewind reading timer mode setting step S602. If the "reading pointer has not been set", the process proceeds to step S605 for determining playback pointer setting (rewind).

Next, in the rewind reading timer mode setting step S602, the timer mode is set to "rewind reading", and the process proceeds to the rewind event mask setting step S603.

Next, in the rewind event mask setting step S603, after the event mask is set for the rewind processing, the event acquired in the event acquisition step S1 of FIG. Only "voice synthesis data request", "recording / playback data request", and "timer event" are limited.

Next, timer start (rewind) step S
The timer is started at 604, and after a timer event is generated after a predetermined time, the process proceeds to the event acquisition step S1 of FIG.

Next, determination of playback pointer setting (rewind)
In step S605, it is determined whether or not the "reproduction pointer" is set. If the "reproduction pointer" is set, the process is moved to rewind reproduction timer mode setting step S606, and the "reproduction pointer" is set. If not, the process proceeds to the event acquisition step S1 of FIG.

Next, in rewinding reproduction timer mode setting step S606, the timer mode is set to "rewinding reproduction".
, And rewind event mask setting step S60
Processing is transferred to 3.

["Rewind Button Release" Processing: FIG. 9]
Next, the "release of the rewind button" process will be described with reference to FIG.

First, in the event mask releasing (rewinding) step S701, the event mask is released, and all the events are acquired in the subsequent event acquiring step S1.

Next, timer mode initialization / timer stop (rewind) In step S702, the timer mode is initialized and then the timer is stopped.

Next, it is judged whether or not the "reading pointer" is set in step S703, and if the "reading pointer" is set, the reading mode is judged (rewinding). The process moves to step S704, and if the "reading pointer" is not set, the process moves to reproduction pointer setting determination (rewinding cancellation) step S711.

Next, in reading mode determination (rewinding) step S704, it is determined whether or not the reading mode is "rewinding", and if it is "rewinding", reading mode initialization (rewinding) step. The process moves to S705, and if it is not "rewind", voice synthesis is stopped (rewind).
The processing moves to step S708.

Next, read mode initialization (rewind)
In step S705, the reading mode is returned to the initial state. Next, in a reading pointer return (rewind) step S706, the reading pointer set in the head phrase list created in step S1204 of FIG. 14 is set to a corresponding position in the original document. (Step S120
The information created in 5 is used. ) Next, the head phrase list is discarded in the head phrase list discarding step S707, and then the event acquisition step S1 in FIG.
Transfer processing to.

Next, voice synthesis is stopped (rewinding) In step S708, voice synthesis is stopped. Next, in a backward skip step S709 for the reading pointer, the reading pointer is moved to the beginning of the sentence before the sentence currently being read.

Next, voice synthesis start (rewind) step S
After the voice synthesis is started in 710, the process proceeds to the event acquisition step S1 of FIG.

Next, in step S711, it is determined whether or not the "reproduction pointer" is set. If the "reproduction pointer" is set, the recording / reproduction mode is determined (rewinding). Return) Step S7
If the "playback pointer" has not been set, the process proceeds to 12 and the process proceeds to the event acquisition step S1.

Next, in step S712, it is determined whether or not the recording / playback mode is "rewind", and if it is "rewind", the recording / playback mode is initialized (rewind). Return) The process proceeds to step S713, and if it is not "rewind", the recording data reproduction stop (rewind) process proceeds to step S714.

Next, initialization of recording / playback mode (rewind)
In step S713, the recording / playback mode is returned to the initial state, and the process proceeds to event acquisition step S1.

Next, in step S714 of stopping reproduction of recorded data (rewinding), reproduction of recorded data is stopped. Next, in the backward skip step S715 of the playback pointer,
Move the play pointer back by one index. For example, if the recorded data is music data and the reproduction pointer does not overlap with the index, the reproduction pointer moves to the beginning of the current song.

Next, starting the reproduction of the recorded data (rewinding), the reproduction of the recorded data is started in step S716, and then, as shown in FIG.
The process moves to the event acquisition step S1.

["Arrival of New Information" Processing: FIG. 10] Next, the "arrival of new information" processing will be described with reference to FIG.

First, in step S801, it is determined whether or not a preferential reading sentence exists, and if there is a preferential reading sentence, the process proceeds to new reading sentence adding step S807 to read the preferential reading sentence. If no sentence exists, a new arrival notification message copy step S8
The process is moved to 02.

Next, in a new arrival notification message copy step S802, the new arrival notification message is copied to the head of the priority reading sentence. An example of the new arrival notification message is shown in FIG.

Next, a new reading sentence copy step S8
In 03, the newly arrived reading sentence is copied after the new arrival notification message in the priority reading sentence.

Next, reading pointer setting judgment (new arrival)
In step S804, it is determined whether or not the reading pointer is set. If the reading pointer is set, the reading pointer backup is created (new arrival).
The process proceeds to step 805, and if the reading pointer is not set, the process proceeds to step S101.

Next, create a reading pointer backup
(New Arrival) In step S805, the current value of the reading pointer is held as supplementary information for the priority reading sentence.

Next, in the new reading sentence reading pointer setting step S806, the reading pointer is set to the head of the priority reading sentence, and the event acquisition step S1.
Transfer processing to.

Next, a new reading sentence adding step S80
In 7, the new reading sentence is copied to the end of the priority reading sentence, and then the process proceeds to the event acquisition step S1 of FIG.

[“Reading out accumulated information instruction” processing: FIG. 1
1] Next, regarding the "readout instruction of accumulated information" processing,
This will be described with reference to FIG.

Reading Pointer Setting Judgment (Reading Accumulated Information) In step S901, it is judged whether or not "reading pointer is set", and if "reading pointer is set", warning display during reading step S90.
If the "reading pointer has not been set", the process proceeds to step S902.

Next, the accumulated read-aloud sentence copy step S9.
In 02, the information instructed in the accumulated information reading instruction determination step S10 is copied from the accumulated information stored in the external storage unit H5 to the accumulated reading sentence.

Next, it is determined whether or not there is a "preferred reading sentence" in the priority reading sentence existence determination (stored information reading) step S903. If "priority reading sentence exists", a reading pointer backup setting step S90.
If the "preferred reading sentence does not exist", the process is moved to the event acquisition step S1.

Next, in the reading pointer backup setting step S904, the head of the accumulated reading sentence is set as the incidental information for the priority reading sentence, and then the process proceeds to the event acquisition step S1 of FIG.

Next, a reading warning display step S90.
In step 5, a warning indicating that reading is currently being performed is output, and then the process proceeds to the event acquisition step S1 in FIG.

["Voice Synthesis Request Instruction" Processing: FIG. 12]
Next, the “voice synthesis request instruction” process will be described with reference to FIG.

First, the synthetic voice data existence judging step S
In 1001, it is judged whether or not the “waveform data” converted from the text to the voice waveform already exists, and if the “waveform data” exists, the synthetic voice data copy step S1.
If the “waveform data” does not exist, the reading pointer setting determination (voice output) Step S
The process is transferred to 1002.

Reading Pointer Setting Judgment (Voice Output) In step S1002, it is judged whether "reading pointer is set" or not, and "reading pointer is set".
If so, the process proceeds to the document data end determination step S1003, and if "reading pointer is not set", the process proceeds to the event acquisition step S1 in FIG.

Next, the document data end determination step S10.
In 03, it is determined whether or not the "reading pointer reaches the end of the document data", and if the "reading pointer reaches the end of the document data", the processing is moved to reading pointer backup existence determination step S1008, and the "reading pointer Does not reach the “end of document data”, the process moves to document data cutout step S1004.

In step S1004 of cutting out document data, a predetermined amount (for example, one sentence) of data is cut out from the document data. Next, synthetic speech data generation step S1005
Then, voice synthesis processing is performed on the cut out data to obtain synthesized voice data.

Next, the reading pointer moving step S1.
In 006, the reading pointer is moved by the amount cut out in the document data cutting step S1004, and the process is moved to the synthesized voice data copying step S1007.

Synthesized voice data copy step S1007
Then, a predetermined amount (buffer size of the synthesized speech output device) of synthesized speech data is output to the synthesized speech output device, and the process proceeds to the event acquisition step S1.

In the reading pointer backup existence judging step S1008, it is judged whether or not the reading pointer backup exists as the supplementary information of the document data, and the reading pointer backup exists.
If yes, the process moves to the reading pointer backup restoration step S1009, and if there is no “reading pointer backup”, the process moves to the reading pointer releasing step S1010.

Next, in the reading pointer backup restoration step S1009, the backup of the reading pointer attached to the document data is set to the reading pointer, and the processing is moved to the document data end judging step S1003.

Next, the reading pointer releasing step S1.
At 010, the reading pointer is canceled (not set). Then, the process proceeds to the event acquisition step S1.

Next, determination of playback pointer setting (recording / playback)
In step S1101, it is determined whether or not "reproduction pointer is set", and if "reproduction pointer is set", recording / reproduction mode determination (rewind 2) step S1
If the "reproduction pointer is not set" is set, the process is moved to 102, and the process is moved to the event acquisition step S1.

["Recording / playback request instruction" processing: FIG. 13]
Next, the “recording / playback request instruction” process will be described with reference to FIG.

First, recording / playback mode determination (rewind 2)
In step S1102, it is determined whether or not the recording / playback mode is "rewind". If it is "rewind," the process proceeds to playback pointer start determination step S1109. If it is not "rewind," the playback pointer end. The processing moves to determination step S1103.

Next, the reproduction pointer end determination step S1
In 103, it is stable whether the "reproduction pointer is the end (last) of the recorded data", and if the "reproduction pointer is the end of the recorded data", the reproduction pointer releasing step S110.
Moved the processing to 4, "Playback pointer is the end of recorded data"
If not, the process moves to recording data copy step S1105.

Next, the reproduction pointer releasing step S110.
In 4, the process returns to the event acquisition step S1 after releasing the reproduction pointer.

Next, recording data copy step S110
In step 5, a predetermined amount (buffer size of the recording data output device) of the recording data is output to the recording data output device, and the process moves to recording / playback mode determination (fast forward 2) step S1106.

Next, in the recording / playback mode determination (fast forward 2) step S1106, it is determined whether or not the "recording / playback mode is fast forward", and if the "recording / playback mode is fast forward", the playback pointer fast forward moving step. The process moves to S1107, and if the “recording / reproducing mode is not fast-forward”, the process moves to the reproducing pointer moving step S1108.

Next, the reproduction pointer fast forward movement step S
At 1107, the reproduction pointer is advanced by more than the output at the recording data copy step S1105 (for example, 10 times the predetermined amount), and then the process is moved to the event acquisition step S1 of FIG.

Next, the reproduction pointer moving step S110.
In step 8, the reproduction pointer is moved to the recording data copy step S1.
The event acquisition step S
The process is transferred to 1.

Next, the reproduction pointer head determination step S1
At 109, it is determined whether or not the "playback pointer is pointing to the beginning of the recorded data", and if it is "playback pointer to the beginning of the recorded data", the process proceeds to the event acquisition step S1. If it is not the “head of the record”, the process proceeds to the reverse order of recording data copy step S1110.

Recording data reverse order copy step S1110
Then, as in the recording data copy step S1105, a predetermined amount (buffer size of recording data output device)
The data of is output to the recording data output device, but the data is output in the reverse order.

Next, at the reproduction pointer rewinding movement step S1111, the reproduction pointer is moved in the reverse direction of the reproduction, and then the processing is shifted to the event acquisition step S1 of FIG.

["Timer Event" Processing: FIG. 14] Next, the "timer event" processing will be described with reference to FIG.

First, in the timer stop step S1201, the timer is stopped.

Next, timer mode determination (fast-forward reading)
In step S1202, it is determined whether or not the timer mode is "fast-forward reading", and if it is "fast-forward reading", the process proceeds to summary sentence creating step S1207,
If not "fast-forward reading", the process moves to timer mode determination (rewind reading) step S1203.

Next, in the timer mode determination (rewind reading) step S1203, it is determined whether or not the timer mode is "rewind reading", and if it is "rewind reading", the first clause list creation step S120.
If it is not "rewind reading", the processing is moved to 1204, and timer mode determination (fast forward reproduction) is performed at step S12.
The process is transferred to 10.

In the first clause list creation step S1204, a list of the first clause of each sentence existing from the beginning of the document indicated by the reading pointer to the reading pointer is created. An example is shown in FIG. 18A is an original document, and FIG. 18B is an image of the created clause list. The position of the reading pointer is set so that the position of the reading pointer comes to the end of the read document, and when the document is read, the position of the reading pointer moves in synchronization with the reading.

Next, in step S1205 of creating rewind reading pointer backup, a corresponding point to which the reading pointer is moved when returning from the rewind mode is created.
In FIG. 18, the corresponding points are the relations of the arrows connecting the first phrase list and the original document.

Next, in rewind reading mode setting step S1206, the reading mode is set to rewind, and then the process proceeds to the event acquisition step S1 of FIG.

Next, in a summary sentence creating step S1207, a summary sentence from the location indicated by the reading pointer to the end of the document is created. An example is shown in FIG. 19A is an original document, and FIG. 19B is an image of the created summary sentence. The position of the reading pointer is set so that the position of the reading pointer comes to the end of the read document (that is, the beginning of the unread portion), and when the document is read, the position of the reading pointer is synchronized with the reading. Moving.

Next, in step S1208 for creating a fast-forward reading pointer backup, a corresponding point to which the reading pointer is moved when returning from the fast-forward mode is created. Figure 1
In FIG. 9, the relationship between the abstract text and the arrow connecting the original documents is the corresponding point. However, in FIG. 19, all are not shown in order to avoid complication.

Next, in step S1209 for setting the fast-forward reading mode, the reading mode is set to fast-forward, and then the process proceeds to the event acquisition step S1 in FIG.

Next, timer mode determination (fast-forward playback) In step S1210, the timer mode is "fast-forward playback".
If it is "fast-forward reproduction", the process is moved to the fast-forward recording / playback mode setting step S1211. If it is not "fast-forward reproduction", the process is moved to the rewinding recording / playback mode setting step S1212.

Next, in the fast-forward recording / playback mode setting step S1211, the recording / playback mode is set to fast-forwarding, and the process proceeds to the event acquisition step S1.

Next, in the rewind recording / playback mode setting step S1212, the recording / playback mode is set to rewind, and then the process proceeds to the event acquisition step S1 in FIG.

[Each process of "speech synthesis": FIGS.
D] Next, for each process of "speech synthesis", refer to FIG.
15D will be described.

15A to 15D show "speech synthesis start",
The processing in each of the "voice synthesis stop", "voice synthesis pause", and "voice synthesis restart" routines are shown.

First, synthetic voice output device setting step S
At 1301, initial setting of the synthetic voice output device such as setting of sampling rate is performed.

Next, in step S1302 for activating the synthetic voice output device, the synthetic voice output device is activated, and the operation of outputting the synthetic voice is started.

Next, synthetic voice data clear step S1.
In 303, the synthesized voice data generated and held in the synthesized voice data generation step S1005 is deleted.

Next, in step S1304 for stopping the synthesized voice output device, the synthesized voice output device is stopped.

Next, in step S1305 of temporarily suspending the synthetic voice output device, the synthetic voice output device is temporarily stopped.

Next, in step S1306 of restarting the synthesized voice output device, the operation of the synthesized voice output device temporarily stopped in step S1305 of the synthesized voice output device is restarted.

[Each processing of "recording data reproduction": FIG. 16A
16D] Next, each process of "recording data reproduction" will be described with reference to FIGS. 16A-1
6D shows the processing in each routine of "start recording data reproduction", "stop recording data reproduction", "pause recording data reproduction", and "restart recording data reproduction".

First, in the recording data output device setting step S1401, initial setting of the recording data output device such as setting of sampling rate is performed.

Next, in step S1402 of activating the recording data output device, the recording data output device is activated,
Start recording data output operation.

Next, in the recording data output device stop step S1403, the recording data output device is stopped.

Next, in step S1404 of temporarily stopping the recording data output device, the recording data output device is temporarily stopped.

Next, in the recording data output device restart step S1405, the operation of the recording data output device temporarily stopped in the recording data output device temporary stop step S1404 is restarted.

The above-described first embodiment is an example, and, for example, the first phrase list creating step S1204.
In the above, the head phrase list is a list consisting of only the head 1 phrase, but this does not necessarily have to be the head 1 phrase, and may be, for example, a plurality of user-specified phrases.

Further, the example of the summary sentence shown in the summary sentence creating step S1207 is an example in which the main part of each sentence is extracted, but it is not always necessary to summarize for each sentence. May all be omitted.

Further, instead of the summary sentence creating step S1207, in the case of fast-forwarding, a head phrase list is created as shown in FIG. 28, and the heads of the created head phrase list are sequentially from "below" to "H4". You may make it read from the head.

When the summary is used for rewinding, the summary shown in FIG. 29 may be used.

Further, in the above text data, a sound such as a beep sound indicating the omission may be output to a portion which is not read out by voice synthesis.

Further, the first phrase list creating step S1
Although both 204 and the summary sentence creation step S1207 are executed after the rewind / fast-forward button release event is acquired, the new reading sentence copy step S
It may be executed after each step of 803, new reading sentence adding step S807 and accumulated reading sentence copying step S902. This reduces the response time from release of the rewind / fast forward button.

<Second Embodiment> Next, the second embodiment will be described.

[Hardware Configuration: FIG. 21] FIG.
It is a figure explaining the hardware constitutions of the portable information terminal H1200 which is a 2nd embodiment.

H11 is a central processing unit for performing processing such as numerical calculation and control, and performs calculation according to a control program which describes the processing procedure of the present invention. H12 is an output unit that presents information to the user. The output unit H12 includes a voice output unit H1201 such as a speaker / headphone and a screen display unit H1202 such as a liquid crystal.

H13 is an input unit through which the user gives an operation instruction to the information terminal H1200 or inputs information. H14 is a data communication unit such as a LAN card or a PHS card, and is used to acquire data such as new mail. H15 is a storage unit such as a hard disk or a non-volatile memory, and holds recorded data and accumulated information.

H16 is a read-only storage unit which stores fixed data such as a control program showing the procedure of the present invention and a voice synthesis dictionary. H17 is a storage unit for holding temporary information such as a RAM, and holds temporary data and various flags.

An angle detector H18 outputs a value corresponding to the angle, and detects the operation amount of the dial portion H19. H
Reference numeral 19 is a dial unit that can be operated by the user, and is connected to the angle detection unit H18. The central processing unit H1 to the angle detection unit H18 are connected by a bus.

[Appearance of Hardware Configuration of Information Terminal: FIG. 27] FIG. 27 is a sketch diagram showing an example of an appearance image of the hardware configuration of the portable information terminal H1200 described with reference to FIG.

[Outline of Event Processing: FIG. 22] The event processing in the information terminal H1200 of the second embodiment described above will be described with reference to the flowcharts shown in FIGS. Note that the following processing is performed in the central processing unit H1.
1 based on the event-driven control program stored in the read-only storage unit H16 or the like.
It is executed using the storage unit H17 that holds temporary information such as. Further, an input process from the input unit H13, a data request from the output unit H12, and an interrupt such as a timer interrupt are processed as the start of each event in the control program.

First, the variable initial setting step S1 in FIG.
At 501, each variable is set to an initial value.

Next, in step S1502 for starting / temporarily suspending the voice synthesizing device, the voice synthesizing device is suspended.

Next, an event acquisition step S1503
And get a new event.

Next, the dial angle change determination step S1
In 504, it is determined whether the event acquired in the event acquisition step S1503 is due to "change dial angle". If "event change dial angle", step S1
If it is not "change dial angle", the process proceeds to step S1505.

Next, a voice synthesis request judgment step S150.
In step 5, it is determined whether or not the event acquired in the event acquisition step S1503 is a "data request from the synthetic voice output device". If the event is "data request from the synthetic voice output device", the process proceeds to step S1701. If it is not "data request from synthetic speech output device", the process is returned to the event acquisition step S1503.

["Dial Angle Change" Process: FIG. 23] Next, the process of each event described above will be described in detail below.

First, the "dial angle change" process will be described with reference to FIG.

In the new dial angle judging step S1601, it is judged whether or not the new dial angle is "0". If it is "0", the processing is moved to the synthetic voice output device temporary stop step S1605, and a new dial angle is judged. If the dial angle is not "0", the dial angle variable determination step S1
The processing is transferred to 602.

Dial angle variable determination step S1602
Then, it is determined whether or not the previous dial angle held in the dial angle variable is "0", and if the previous dial angle held in the dial angle variable is "0", the process proceeds to step S1606 for restarting the synthesized voice output device. If the previous dial angle held in the dial angle variable is not "0", the process proceeds to dial angle variable updating step S1603.

Dial angle variable updating step S1603
Then, a new dial angle is assigned to the dial angle variable.

Next, the reading skip number setting step S
At 1604, the number of reading skips is set according to the value of the dial angle variable. The reading skip number is set such that the larger the absolute value of the dial angle, the larger the absolute value of the skip number, and that the sign of the dial angle and the sign of the skip number are the same. FIG. 25 shows an example of a correspondence table between dial angles (unit angle is θ) and skip numbers. After setting the number of skips, the process proceeds to event acquisition step S1503.

Next, in a step S1605 of temporarily suspending the synthetic speech output device, the speech synthesis output device is temporarily stopped, and the process proceeds to the step S1503 of acquiring an event.

Next, in the synthesized voice output device restart step S1606, the synthesized voice output device temporarily stopped in the synthesized voice output device temporary stop step S1605 is restarted, and the process proceeds to the dial angle variable update step S1603.

[“Voice Synthesis Instruction” Processing: FIG. 24] Next,
The "voice synthesis instruction" process will be described with reference to FIG.

First, synthetic voice data end determination step S
In 1701, it is determined whether or not the phrase counter is equal to the number of phrases, and if the phrase counter is equal to the number of phrases, the processing is moved to the document data cutting step S1709,
If the phrase counter is not equal to the number of phrases, the process proceeds to dial angle absolute value determination step S1702. The number of clauses is the synthesized speech data generation step S1 executed immediately before.
The state is the number of clauses included in the sentence targeted by step 710, and the clause counter is equal to the number of clauses in step S171.
It indicates that the output of all the synthesized voice data obtained at 0 is completed.

Next, the dial angle absolute value determination step S
In 1702, it is determined whether or not the absolute value of the dial angle held in the dial angle variable is larger than "1". If the absolute value of the dial angle is larger than "1", the processing is moved to the reading target sentence updating step S1717, and the dial is performed. If the absolute value of the angle is not larger than "1", the process moves to the reading pointer determination step S1703.

Next, reading pointer determination step S1
In 703, it is determined whether or not the reading pointer is equal to the reading target sentence, and if the reading pointer is equal to the reading target sentence, the phrase counter determination step S17.
If the reading pointer is not equal to the reading target sentence, the processing is moved to 04, and the voice synthesis device stop step S
The process is transferred to 1705.

Next, the clause counter determination step S170.
In step 4, it is determined whether the phrase counter is "0". If the phrase counter is "0", the reading target sentence update step S1717.
If the phrase counter is not "0", the process proceeds to voice synthesis device stop step S1705.

Next, the voice synthesizing device stop step S1.
At 705, the voice synthesis device is stopped. Next, in the beep sound output step S1706, a beep sound is output. Next, in step S1707, start the voice synthesis device.

Next, the clause counter updating step S170.
In step 8, "1" is added to the phrase counter, and the process proceeds to the event acquisition step S1503.

Next, the document data cutting step S17
In 09, data for one sentence is cut out from the reading target document with the reading pointer at the head.

Next, synthetic voice data generation step S17
In step 10, voice synthesis is performed on the sentence cut out in the document data cutout step S1709 to obtain synthesized voice data.

Next, in the phrase number calculation step S1711,
In the document data cutting step S1709, the number of clauses included in the sentence cut out is calculated.

Next, in a synchronization point generation step S1712,
The correspondence between the synthesized speech generated in the synthesized speech data generation step S1710 and each clause included in the sentence cut out in the document data cutting step S1709 is obtained and held as a synchronization point. An example of synchronization points is shown in FIG.

Next, the phrase counter initialization step S17.
At 13, the phrase counter is set to "0".

Next, the dial angle positive / negative determination step S1.
At 714, it is determined whether or not the dial angle held in the dial angle variable is "positive", and if "positive", the process proceeds to the reading pointer increment step S1715.
If it is not "correct", the process moves to the reading pointer decrement step S1716.

Next, in the reading pointer increment step S1715, 1 is added to the reading pointer,
The processing moves to dial angle absolute value determination step S1702.

Next, in the reading pointer decrement step S1716, 1 is subtracted from the reading pointer,
The processing moves to dial angle absolute value determination step S1702.

Next, the reading target sentence update step S17.
In 17, the reading target sentence is set to the sum of the reading pointer and the skip number set in the reading skip number setting step S1604.

Next, synthetic voice data copy step S1
In 718, the synthesized speech generated in the synthesized speech data generation step S1005 is copied into the buffer of the one-phrase speech synthesis device. The range to be copied is one phrase from the sync point corresponding to the current phrase counter. After copying the data, the process proceeds to the clause counter updating step S1708.

The second embodiment described above is an example, and for example, the reading skip number setting step S16.
In 04, the number of reading skips is set to a fixed number of sentences according to the value of the dial angle variable, but it is also possible to skip to the next paragraph when the dial angle is large. This can be achieved by counting the number of sentences from the reading pointer to the sentence at the beginning of the next paragraph. It is also possible to skip one or more clauses when the dial angle is small.

Furthermore, in the second embodiment, the number of beeps during fast-forwarding / rewinding is the same as the number of skipped clauses, but it need not be the same. Further, in the second embodiment, the fast forward / rewind is represented by a single beep sound, but different beep sounds or different signals may be uttered depending on the type of fast forward / rewind or the dial angle.

Furthermore, it is also possible to apply the fast-forward by the summary used in the first embodiment to the second embodiment. In this case, the compression rate of the digest can be changed according to the number of skips set in the reading skip number setting step S1604.

[0234]

Other Embodiments Even when the present invention is applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), an apparatus including one device (for example, a copying machine). Machine, facsimile machine, etc.).

Further, an object of the present invention is to supply a storage medium (or a recording medium) recording a program code of software for realizing the functions of the above-described embodiments to a system or apparatus, and to supply a computer of the system or apparatus ( Alternatively, by the CPU or MPU) reading and executing the program code stored in the storage medium,
It goes without saying that it will be achieved. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.
Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also based on the instruction of the program code,
An operating system (OS) running on the computer does some or all of the actual processing,
It goes without saying that the processing includes the case where the functions of the above-described embodiments are realized.

Further, after the program code read from the storage medium is written in the memory provided in the function expansion card inserted into the computer or the function expansion unit connected to the computer, based on the instruction of the program code, , The CPU provided in the function expansion card or the function expansion unit performs some or all of the actual processing,
It goes without saying that the processing includes the case where the functions of the above-described embodiments are realized.

When the present invention is applied to the above-mentioned storage medium, the storage medium has been described above (see FIGS. 2-16, 22-2).
The program code corresponding to the flowchart (shown in FIG. 4) will be stored.

As described above, according to the present invention, the user can give an instruction with a small number of operation buttons, and as a result, the size of the entire terminal is reduced. Also,
The number of parts is reduced and the manufacturing cost is reduced. Also, fast forward
It becomes possible to provide the information required by the user during rewinding, which improves convenience.

[0239]

As described above, according to the present invention,
It is possible to provide a portable information terminal capable of suppressing an increase in manufacturing cost due to an increase in the number of parts such as operation buttons when performing various types of information processing. In addition, it is possible to provide a portable information terminal that can perform the above-mentioned various information processing with convenience.

[Brief description of drawings]

FIG. 1 is a block diagram showing a hardware configuration according to a first embodiment of the present invention.

FIG. 2 is a flowchart illustrating an entire event process according to the first embodiment of the present invention.

FIG. 3 is a flowchart illustrating a process when a play button is pressed.

FIG. 4 is a flowchart illustrating a process when a stop button is pressed.

FIG. 5 is a flowchart illustrating a process when a pause button is pressed.

FIG. 6 is a flowchart illustrating a process when a fast-forward button is pressed.

FIG. 7 is a flowchart illustrating a process when a fast-forward button is released.

FIG. 8 is a flowchart illustrating a process when a rewind button is pressed.

FIG. 9 is a flowchart illustrating a process when a rewind button is released.

FIG. 10 is a flowchart illustrating a process when new information arrives.

FIG. 11 is a flowchart illustrating a process when an instruction to read stored information is given.

FIG. 12 is a flowchart illustrating a process when a voice synthesis instruction is given.

FIG. 13 is a flowchart illustrating a process when a recording / playback instruction is given.

FIG. 14 is a flowchart illustrating timer event processing.

FIG. 15A is a flowchart illustrating a voice synthesis start process.

FIG. 15B is a flowchart illustrating a voice synthesis stop process.

FIG. 15C is a flowchart illustrating a voice synthesis temporary stop process.

FIG. 15D is a flowchart illustrating a voice synthesis restart process.

FIG. 16A is a flowchart illustrating a recording data reproduction start process.

FIG. 16B is a flowchart illustrating a recording data reproduction stop process.

FIG. 16C is a flowchart illustrating a recording data reproduction pause process.

FIG. 16D is a flowchart illustrating a recording data reproduction restart process.

FIG. 17 is a diagram illustrating an example of a new arrival notification message.

FIG. 18 is a diagram illustrating an example of an image of a leading phrase list.

FIG. 19 is a diagram illustrating an example of an image of a summary sentence.

FIG. 20 is a sketch diagram showing an image of a hardware configuration of the first embodiment according to the present invention.

FIG. 21 is a block diagram showing a hardware configuration according to a second embodiment of the present invention.

FIG. 22 is a flowchart illustrating the entire event processing according to the second embodiment of the present invention.

FIG. 23 is a flowchart illustrating a process when a dial angle is changed.

FIG. 24 is a flowchart illustrating a process when voice synthesis is requested.

FIG. 25 is a diagram illustrating a correspondence between a dial angle and the number of reading skips.

FIG. 26 is a diagram illustrating an example of a synchronization point.

FIG. 27 is a sketch diagram showing an image of a hardware configuration of a second embodiment according to the present invention.

FIG. 28 is a diagram illustrating an example of an image of a leading phrase list in the case of fast-forwarding.

FIG. 29 is a diagram showing an example of a summary at the time of rewinding.

[Explanation of symbols]

H1 Central processing unit that performs numerical calculation / control processing H2 Output unit that presents information to the user H201 Audio output unit (speakers, headphones, etc.) H202 Screen display unit (liquid crystal, etc.) H3 Input unit (operation instruction / information input by user) H301 Play button (input section) H302 Stop button (input section) H303 Pause button (input section) H304 Fast forward button (input section) H305 Rewind button (input section) H306 Touch panel H4 Data communication section (LAN card, PHS card, new arrival) H5 storage unit (holding hard disk, non-volatile memory, recording data) H6 read-only storage unit (holding ROM, program, dictionary for voice synthesis, etc.) H7 storage unit holding temporary information (RAM, etc.) H8 interval timer section (central processing section) Interrupt processing)

Claims (28)

[Claims] 1. A voice reproducing means for reproducing voice from voice data, a voice synthesizing means for synthesizing and outputting text data, an instruction detecting means for detecting a user's instruction, the voice reproducing means and the voice synthesizing means. Detecting means for detecting an operating state of the means; instruction providing means for giving the user's instruction to either the voice reproducing means or the voice synthesizing means according to the operating state; and the user's instruction. An information processing apparatus, comprising: a control unit that controls the voice reproduction unit or the voice synthesis unit to execute a process based on an instruction from the user. 2. The information processing apparatus according to claim 1, wherein the user's instruction is any one of fast forward, rewind, stop, and pause. 3. The information processing apparatus according to claim 1, wherein the instruction providing unit gives the instruction to the voice synthesizing unit when the voice synthesizing unit is in operation. . 4. The instruction providing means gives the instruction to the voice reproducing means when the voice synthesizing means is not operating and the voice reproducing means is in operation. The information processing apparatus according to claim 1 or claim 2. 5. When the user's instruction is fast-forward and the instruction providing means gives the instruction to the voice synthesizing means, the control means sets a predetermined portion from each sentence of the text data to be read aloud. 3. The voice synthesizing means is controlled so that data is extracted to create summary data, and the summary data is synthesized and output.
The information processing device according to 1. 6. When the user's instruction is fast-forward and the instruction providing means gives the instruction to the voice synthesizing means, the control means sets the first phrase from each sentence of the text data to be read aloud. The information processing apparatus according to claim 2, wherein the voice synthesis unit is controlled so that the extracted phrases are sequentially voice-synthesized and output. 7. The user's instruction is rewind,
When the instruction providing means gives the instruction to the voice synthesizing means, the control means extracts the first phrase from each sentence of the text data to be read out, and the extracted phrases are arranged in the text data sequence. 3. The information processing apparatus according to claim 2, wherein the voice synthesizing unit is controlled so as to output voice after synthesizing voice in the reverse order. 8. The instruction providing means detects, when the user's instruction is reproduction, whether or not a reading pointer indicating a position to start reading in the text data is set, and the reading pointer is read. 2. When the pointer is detected, the user's instruction is given to the voice synthesizing means to start the voice synthesizing of the text data from the position of the reading pointer.
The information processing apparatus according to claim 6. 9. The instruction providing means detects, when the instruction from the user is reproduction, whether or not a reproduction pointer indicating a position to start reproduction in the recorded data is set, and the reproduction is performed. 7. When the pointer is detected, the user's instruction is given to the voice reproducing means so as to start reproducing the recorded data from the position of the reproducing pointer. The information processing device according to item 1. 10. The control means controls the voice synthesizing means so as to output a predetermined sound corresponding to the data omitted from the text data by the voice synthesizing means without being synthesized by the voice synthesizing means. The information processing apparatus according to any one of claims 1 to 8, characterized in that: 11. A voice synthesizing means for synthesizing and outputting text data, a dial for inputting a user's instruction, an angle detecting means for detecting an angle of the dial, and an angle detecting means according to the detected angle of the dial. And a control means for controlling the voice synthesizing means so that the text data is voice-synthesized by fast-forwarding and output, or the text data is voice-synthesized by rewinding and output. apparatus. 12. The information processing apparatus according to claim 11, wherein the control unit outputs the text data by voice-synthesizing the text data by fast-forwarding when the angle of the dial is positive. 13. The information processing apparatus according to claim 12, wherein the control unit further includes a changing unit that changes the number of skipped clauses for speech synthesis in the fast-forwarding. 14. The information processing apparatus according to claim 13, wherein the control unit controls the voice synthesizing unit to output a predetermined sound corresponding to a portion where the phrase is skipped. 15. The information processing apparatus according to claim 11, wherein the control means performs voice synthesis of the text data by rewinding and outputs the text data when the angle of the dial is negative. 16. The information processing apparatus according to claim 14, wherein the control unit further includes a changing unit that changes the number of skipped phrases to be speech-synthesized in the rewinding. 17. The information processing apparatus according to claim 16, wherein the control unit controls the voice synthesizing unit to output a predetermined sound corresponding to a portion where the phrase is skipped. 18. A voice reproducing step of reproducing voice from voice data, a voice synthesizing step of voice synthesizing and outputting text data, an instruction detecting step of detecting a user's instruction, the voice reproducing step and the voice synthesizing step. A detecting step for detecting an operation state of the step; an instruction providing step for giving the user's instruction to either the voice reproducing step or the voice synthesizing step according to the operation state; and the user's instruction. A control step of controlling the voice reproducing step or the voice synthesizing step to execute a process based on an instruction from the user. 19. A voice synthesizing step of synthesizing and outputting text data, a dial for inputting a user's instruction, an angle detecting step of detecting an angle of the dial, and a step of detecting a dial angle according to the detected angle of the dial. A control process for controlling the voice synthesis process so that the text data is voice-synthesized by fast-forwarding and output, or the text data is voice-synthesized by rewinding and output. Method. 20. A control program for controlling an information processing device, wherein the control program is a code of a voice reproducing step of reproducing voice from voice data, and a code of a voice synthesizing step of synthesizing and outputting text data. A code of an instruction detection step of detecting an instruction of a user, a code of a detection step of detecting an operation state of the voice reproduction means and the voice synthesis means, and an instruction of the user according to the operation state. The code of the instruction providing step given to either the voice reproducing step or the voice synthesizing step, and the voice reproducing step or the voice synthesizing step given the instruction of the user executes a process based on the instruction of the user. And a code of a control process for controlling as described above. 21. A computer-readable storage medium storing a control program for controlling an information processing device, wherein the control program synthesizes voice code of a voice reproduction process for reproducing voice from voice data and text data. A code of a voice synthesizing step to be output, a code of an instruction detecting step of detecting a user's instruction, a code of a detecting step of detecting an operation state of the voice reproducing means and the voice synthesizing means, and A code of an instruction providing step for giving the user's instruction to either the voice reproducing step or the voice synthesizing step, and the voice reproducing step or the voice synthesizing step given the user's instruction, the user's instruction And a code of a control process for controlling to execute a process based on Media. 22. A control program for controlling an information processing device having a dial for inputting a user's instruction, wherein the control program includes a code of a voice synthesizing step for synthesizing and outputting text data, and a dial of the dial. Depending on the code of the angle detecting step for detecting the angle and the detected angle of the dial, the text data may be voice-synthesized by fast-forwarding and output, or the text data may be voice-synthesized by rewinding and output. And a control process code for controlling the voice synthesizing means. 23. A computer-readable storage medium storing a control program for controlling an information processing apparatus having a dial for inputting a user's instruction, wherein the control program is a voice synthesizing step of synthesizing and outputting text data. The code of the angle detection step for detecting the angle of the dial, and according to the detected angle of the dial, the text data is voice-synthesized and output by fast-forwarding, or the text data can be rewound. And a code of a control step for controlling the voice synthesizing unit so that the voice is synthesized and output. 24. A voice synthesizing unit for synthesizing and outputting text data, an instruction detecting unit for detecting a user's instruction, a detecting unit for detecting an operation state of the voice synthesizing unit, An instruction providing means for giving the user's instruction to the voice synthesizing means, and a control means for controlling the voice synthesizing means given the user's instruction to execute a process based on the user's instruction, An information processing device comprising: 25. The user's instruction is fast forward,
When the instruction providing means gives the instruction to the voice synthesizing means, the control means extracts data of a predetermined portion from each sentence of the text data to be read out to create summary data, and the summary data is obtained. 25. The information processing apparatus according to claim 24, wherein the voice synthesizing means is controlled so as to synthesize and output a voice. 26. The user's instruction is fast forward,
When the instruction providing means gives the instruction to the voice synthesizing means, the control means extracts the first phrase from each sentence of the text data to be read and sequentially synthesizes the extracted phrases and outputs them. 25. The information processing apparatus according to claim 24, wherein the voice synthesizer is controlled as described above. 27. When the user's instruction is rewinding and the instruction providing means gives the instruction to the voice synthesizing means, the control means causes the first phrase from each sentence of the text data to be read aloud. 25. The information processing apparatus according to claim 24, further comprising: controlling the voice synthesizing unit so as to perform voice synthesis of the extracted phrase and output the phrase in an order opposite to the sequence of the sentences of the text data. 28. The control means controls the voice synthesizing means so as to output a predetermined sound in response to data of the text data which is omitted by the voice synthesizing means without being voice synthesized. The information processing apparatus according to any one of claims 24 to 27, wherein: