JP4990482B2 - Mobile terminal device - Google Patents

Description

  The present invention relates to a mobile terminal device that performs wireless communication such as a mobile phone, and more particularly to a mobile terminal device having a function of reading out a displayed item by voice.

In recent years, there has been proposed a mobile phone that announces a function name or the like set by a key operation corresponding to the key operation as a mobile terminal device (see, for example, Patent Document 1).
The mobile phone includes a plurality of key operation units, a control unit configured to set a function corresponding to the key operation among a plurality of functions provided in the telephone according to one or more key operations of the key operation unit, and a key operation. And a voice synthesizer that outputs a function name set in conjunction with the voice.

  In addition, as a terminal device having a voice output function, an operator (user) may misidentify information when the voice is converted into a sound having a meaning as a word such as news or advertisement and reproduced. There is known an information output device for preventing or a document reading device that shortens a time for checking a necessary mail from a mail read by a mail reading device.

  The former information output device is a device that converts the information stored in the information storage unit into a read voice from a predetermined read position and reproduces and outputs the information, and the read control unit reads the information by an instruction by a rewind button. When the start position is determined, it moves to the first separation position ahead of the determined information reading position, and when the information reading start position is determined by an instruction by the fast-forward button, reading of the determined information is performed. The start position is moved to the first rearward break position, and the information read start position is finally determined.

In the latter document reading apparatus, when the mail is read by accessing the information processing apparatus from the telephone, first, the header of the mail is sequentially output by the speech synthesizer. For unnecessary mail, the user registers the sender and / or subject as a skip condition in the skip condition holding unit. Thereafter, when the header part is read, the condition is determined by the skip condition determination unit, and the mail conforming to the skip condition is not read. If a necessary mail is found, the text synthesizer outputs the text according to the instruction.
Japanese Patent Laid-Open No. 11-252216

  However, the mobile phone described in Patent Document 1 basically converts the search result of the abbreviated number memory into voice information and transmits it to the user in response to a key operation. There is a disadvantage in that it is output in order, there is no listability, it is difficult for the user to select and select voice information according to importance, and the so-called reading function cannot be used efficiently.

Further, the information output apparatus described above basically corresponds to text information that is a series of sentences, and does not support menu display accompanying operation of the terminal.
In addition, the automatic setting of the break position is primarily considered to avoid playback from an unnatural position after rewinding or fast-forwarding operation, but it is sufficient from the viewpoint of supporting selection according to importance. Absent.
For example, since mail header information is not recognized as header information, information that is not necessary for reading out such as “Return path” or “to”, such as “Return path” or “to”, which is less important than the reception date and time, sender, and subject Will be treated in the same way.

In addition, since the above-described document reading apparatus focuses on operability when selecting and reproducing a necessary mail, only “subject” and “sender” can be used as skip conditions.
In addition, operability when reading a mail is not improved.

  Further, each of the above-described devices has a disadvantage that it does not have a function for improving the convenience of the user in correspondence with an external connection device such as an earphone microphone.

  The present invention has been made in view of such circumstances, and an object thereof is to automatically set an appropriate item separation position according to the situation, to realize a skip operation and a back skip operation by a specific operation, and to provide a reading function. An object of the present invention is to provide a portable terminal device that can be efficiently used and can improve user convenience.

According to the present invention, a mobile terminal device having a voice reading function,
Is connected to the communication network, the wireless communication, subject, date, sender, a communication unit capable of receiving e-mail with the content data corresponding to a plurality of items such as text, each content for each item of the received e-mail performing a storage unit for storing as data the predetermined order, and an operation unit for instructing the reading operation for reading out the item names and respective content data of each of the plurality of items of the electronic mail thus received, the reading of the When reading out a predetermined item among the plurality of items, a voice synthesis unit that converts the item name and the content data into voice data, a voice output unit that outputs the voice data, and the item A control unit for controlling the content data associated with the item to be output by the audio output unit. ,
When the control unit reads out the e-mail stored in the storage unit and reads out the item name of the item of the e-mail, if the predetermined instruction is given by the operation unit, The mobile phone is characterized in that reading of the content data associated with the item is omitted, and the item name of the next item in the predetermined order of the omitted item is controlled to be output by the audio output unit. A terminal device is provided.

Preferably, the upper Symbol control unit when a said predetermined instruction is by the voice output unit audio data in the text data corresponding to the next item in the items of text data being read by the instruction input point Output.

Preferably, the plurality of items are further divided at a predetermined delimiter position, and the predetermined delimiter position is a position to which a description symbol is added.

Preferably, the storage unit stores name data corresponding to each of the plurality of items, and the control unit reads name data corresponding to the item when reading out text data corresponding to the item. Is controlled to be output by the above-described audio output unit .

Preferably, the storage unit includes a titles data, and stores the address information, the control unit, the items indicating the sender of the plurality of items are searchable sender name from the address information, the sender When reading out the text data corresponding to the indicated item, the voice output unit is controlled to output the honorific data after outputting the sender name.

  Preferably, the operation unit includes an externally connected externally connected device having an external operation unit that is externally connected and capable of instructing the control unit to perform a reading operation, and the control unit is connected to the externally connected device. Sometimes the output of the audio output unit is switched to the externally connected device.

Preferably, the upper Symbol control unit receives the incoming call information of the electronic mail by the communication unit, and to perform an incoming call notification by the voice output unit causes output to the external connection device, the external operation portion When operated, the incoming call notification is stopped and the communication unit is controlled to start communication connection processing to the communication network.

  Preferably, the external operation unit includes at least one key, and the control unit discriminates the predetermined instruction by counting the number of times a signal generated by the operation of the key within a predetermined time.

  Preferably, the external operation unit includes at least one key, and the control unit discriminates the predetermined instruction by counting a continuous time of a signal generated by the operation of the key.

Preferably, the predetermined instruction instructed by the operation unit is a fast-forward operation, and the control unit performs the operation when the voice output unit reads out at the first speed which is a normal speed. fast-forward when an instruction is issued by the Department, during reading time or al of the fast-forward instruction there was also read the rest of the text data in the first second speed that is higher than the speed, the reading was the text data of the next The text data is read back to the first speed.

According to the present invention, it is possible to automatically set an appropriate item separation position according to the situation, to realize a skip operation or a back skip operation by a specific operation, and to efficiently use a reading function.
In addition, user convenience can be improved.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

FIG. 1 is a block diagram illustrating an example of a system configuration of a mobile phone 10 as a mobile terminal device of the present invention. FIG. 2 is a diagram illustrating an example of the appearance of the mobile phone 1.
The mobile phone 10 is a so-called foldable mobile phone having a movable mechanism. FIG. 2A is a front view in an opened state (open state), and FIG. 2B is a closed state (closed state). (C) is a side view in the open state, and (d) is a side view in the closed state.

In the mobile phone 10 according to the present embodiment, in addition to the function of a normal mobile phone, an external connection that has a voice reading function and includes an external operation unit that is externally connected and can instruct a reading operation is remote-controlled. An earphone microphone as a device can be connected, and when an externally connected device is connected, a function of switching the output of the audio output unit to the earphone microphone is provided.
The mobile phone 10 (including the case where the earphone microphone is not connected and the case where it is connected) is a menu display, mailer, browser, etc., where the data format and a series of operations are prescribed, and the importance of information for the user An effective rule for automatically setting the break position according to time is defined, and the user can efficiently select information by utilizing a skip operation during speech reading.
For example, in the cellular phone 10 according to the present embodiment, when reading a mail text, the delimiter position is set by e-mail-specific information such as “reception date”, “sender”, “subject”, and “text”. At the same time, it is possible to insert these item headings as fixed texts at the beginning of each delimiter and perform a skip operation while checking the item names in this order.
In the mobile phone 10 according to the present embodiment, for example, descriptive symbols such as punctuation marks, punctuation marks, exclamation marks, and question marks defined by JIS, specifically, “,” “.”, “−”, “/”, “!” By setting the position with a descriptive symbol such as ""? "As the delimiter position, it is possible to automatically delimit the body of the mail and grasp the general purpose while shortening the confirmation (recognition) time. It is possible to do.
In addition, when the earphone microphone is used, it is possible to check a read-out voice through the earphone and to perform a remote control (hereinafter simply referred to as a remote control) operation. It is possible to check the contents of a new mail while listening to music at 10 and to check information in a situation where the user does not want to see the contents of the screen in a simple operation.

  Hereinafter, the configuration and function of each unit of the mobile phone 10 according to the present embodiment, and the voice reading control will be described in order.

As shown in FIG. 1, the mobile phone 10 includes a communication processing unit 11 including a transmission / reception antenna 111, a memory 12, a key operation unit 13, a dial input unit 14, a sub display unit 15, and a main display unit 16. , A speech processing unit 17 including a speaker 171 and a microphone 172, an open / close switch 18, a reading key operation unit 19, a speech synthesis unit 20, a ringer speaker 21, switch circuits 22, 23 and 24, and an external device connection unit. 25 and a control unit (CPU) 26. In FIG. 1, reference numeral 30 denotes an earphone microphone as an externally connected device.
As shown in FIG. 1, the earphone microphone 30 includes a key operation unit 31, a speaker 32, and a microphone 33 for remote control operation.
2A, the main body case 100 of the mobile phone 10 includes a key input side main body case 101 as a first case and a display side main case 102 as a second case. These are connected by a movable mechanism (not shown) to form an open / close state.

The communication processing unit 11 performs a wireless communication operation via the base station, for example, a telephone number calling operation or an e-mail transmission / reception operation.
The communication processing unit 11 is configured to include a transmission / reception antenna 111. In order to perform wireless communication using radio waves, the communication processing unit 11 modulates voice information, e-mail, and the like processed by the control unit 26, and a base (not shown) by the transmission / reception antenna 111 Send to the station.
In addition, the communication processing unit 11 demodulates various information such as e-mail and voice information transmitted from the base station by radio and received by the transmission / reception antenna 111 and outputs the demodulated information to the control unit 26.
The transmission / reception antenna 111 is built in the key input side main body case 101 or the display side main body case 102 and is not exposed to the outside in FIG.

The memory (storage unit) 12 includes a nonvolatile memory such as an EEPROM, and stores a control program for sending and receiving calls and mails, an Internet browser, message data, an address book in which names and telephone numbers are registered, and the like. To do.
The memory 12 stores a speech reading database including a text string necessary for a reading function to be described later. In this database, text strings for reading are systematically arranged so that the connection relationship before and after is established as a sentence.
The memory 12 stores a title text and address information. The control unit 26 can retrieve the sender name from the address information of the memory 12 for the component indicating the sender of the received e-mail, and when reading out the component indicating the sender of the e-mail, a speaker is used as a voice output unit. Control is performed so that the title is output after the sender name is output by 21 or the like.
The memory 12 stores “standard text”, “abbreviated text”, and “explanatory text” for each menu item displayed on the display unit.

  The key operation unit 13 has an end (end call) / power key, a start (call) key, a plurality of numeric keys corresponding to numbers, etc., and when these keys are operated by the user, Input information is output to the control unit 26.

As shown in FIG. 2C, the dial input unit 14 is disposed on the side surface of the display-side main body case 102 so that the user can easily operate with the thumb of the user when holding the mobile phone 10 in the open state. The dial-type input unit is configured to be operated in two directions.
By operating the dial input unit 14, the user can change the sound output volume and the character size displayed on the sub display unit 15 and the main display unit 16.
Further, as apparent from FIGS. 2C and 2D, when the dial input unit 14 in the closed state and the open state are compared, the operation directions in the upper and lower directions are physically reversed. In the form, in order not to cause a sense of incongruity for the user, the operation direction viewed from the user and the action on the operation (for example, the above-described volume change and display font size (character size to be displayed) change) always match. It is controlled by the control unit 26 described later.

The sub display unit 15 has a display device such as a liquid crystal display (LCD) and is visually recognized by the user in the closed state as shown in FIG.
The main display unit 16 includes a display device such as a liquid crystal display (LCD) and is visually recognized by the user in the open state as shown in FIG.
The sub display unit 15 and the main display unit 16 display the text of the received e-mail and various text data stored in the memory 12 in the closed state and the open state, respectively.

The sound processing unit 17 includes a sound processing circuit, and a microphone 172 that performs sound input by selectively connecting a speaker 171 that outputs sound for a call function and a speaker 32 of the earphone microphone 30 via the switch 22. And the microphone 33 of the earphone microphone 30 are selectively connected via the switch 23.
The sound processing unit 17 performs predetermined processing on the sound collected by the microphone 172 or the microphone 33 of the earphone microphone 30 and supplies the processed sound to the control unit 26. The audio processing unit 17 performs predetermined processing on the audio information supplied from the control unit 26 and outputs the audio information from the speaker 171 or the speaker 32 of the earphone microphone 30.
Further, as shown in FIGS. 2A and 2B, the speaker 171 includes two voice output units, that is, a reception speaker 171 and a ringer speaker 21, and is basically a processing result of the reading function by the ringer speaker 21. A certain sound is output.

The open / close switch 18 is a switch for detecting the open / closed state of the mobile phone 10.
Various technologies can be applied to the specific configuration of the open / close switch 18. For example, as shown in FIG. 2A, a contact portion is provided on each of the key input side main body case 101 and the display side main body case 102. In the closed state (FIG. 2 (b)), the two contacts are electrically non-conductive so that the device can be turned off.
For example, when the cellular phone 10 is in the closed state, the open / close switch 18 is turned on (ON state), and in the open state, the open / close switch 18 is turned off (OFF state), and the control unit 26 changes the state of the open / close switch. By detecting, the open / close state of the mobile phone 10 is determined.

As shown in FIG. 2B, the reading key operation unit 19 includes a push-down button 19a disposed in the center of the display-side main body case 102, and an input circuit for switch input by the button. The
The cellular phone 10 according to the present embodiment has a reading function. When the push button 19a is pressed (operated), for example, the voice is output from the ringer speaker 21 in the closed state, and the voice is output from the receiving speaker 171 in the open state. In this manner, the control unit 26 controls the operation.
The control unit 26 described later determines the open / closed state of the mobile phone 10 based on the output of the open / close switch 18, and then notifies the audio processing unit 17 of the audio output destination for reading.
For example, in the open state, the control unit 26 causes the speaker 171 to output the output voice data generated by voice synthesis by the voice synthesis unit 20 through the voice processing unit 17.

  The speech synthesizer 20 converts the text data read and extracted from the memory 12 by the control unit 26 into speech data when reading out.

In the switch circuit 22, the fixed contact a is connected to the input / output unit of the sound processing unit 17, the operation contact b is connected to the microphone 172, and the operation contact c is connected to the microphone terminal 251 of the external device connection unit 25.
When the connection terminal of the earphone microphone 30 is not connected to the external device connection unit 25 (not inserted), the switch circuit 22 connects the fixed contact a and the operation contact b under the control of the control unit 26, Information collected by the microphone 172 is input to the audio processing unit 17.
When the connection terminal of the earphone microphone 30 is connected (inserted) to the external device connection unit 25, the switch circuit 22 connects the fixed contact a and the operation contact c under the control of the control unit 26, Information collected by the microphone 33 of the external earphone microphone 30 is input to the sound processing unit 17.

In the switch circuit 23, the fixed contact a is connected to the input / output unit of the sound processing unit 17, the operation contact b is connected to the speaker 171, and the operation contact c is connected to the speaker terminal 252 of the external device connection unit 25.
When the connection terminal of the earphone microphone 30 is not connected (not inserted) to the external device connection unit 25, the switch circuit 23 connects the fixed contact a and the operation contact b under the control of the control unit 26, Audio is output from the speaker 171.
When the connection terminal of the earphone microphone 30 is connected (inserted) to the external device connection unit 25, the switch circuit 23 connects the fixed contact a and the operation contact c under the control of the control unit 26, Sound is output from the speaker 32 of the external earphone microphone 30.

The switch circuit 24 has a fixed contact a connected to the output unit of the speech synthesizer 20, an operating contact b connected to the ringer speaker 21, and an operating contact c connected to the speaker terminal 252 of the external device connection unit 25.
When the connection terminal of the earphone microphone 30 is not connected (not inserted) to the external device connection unit 25, the switch circuit 24 connects the fixed contact a and the operation contact b under the control of the control unit 26, The synthesized voice is output from the ringer speaker 21.
The switch circuit 2 4, when the connection terminals of the earphone microphone 30 is connected to the external device connecting section 25 (which is inserted), under the control of the control unit 26 connects the fixed contact a and the operation contact c The sound synthesized by the speaker 32 of the external earphone microphone 30 is output.

The external device connection unit 25 is detachably connectable to the connection terminal of the earphone microphone 30 and includes a microphone terminal 251, a speaker terminal 252, and a signal terminal 253.
The microphone terminal 251 is connected to the operation contact c of the switch circuit 22 and the microphone 33 of the earphone microphone 30. The speaker terminal 252 is connected to the operating contact c of the switch circuit 23 and the speaker 32 of the earphone microphone 30. The signal terminal is connected to the control unit 26 and the key operation unit 31 of the earphone microphone 30.
When the control unit 26 recognizes that the connection terminal of the earphone microphone 30 is connected to the external device connection unit 25 and is connected to the key operation unit 31, the control unit 26 switches the connection of the fixed contact a of the switch circuits 22, 23, and 24 to the operation contact. Control which switches from b to the operation contact c is performed.

The control unit 26 is mainly composed of a microcomputer and controls the entire mobile phone 1. For example, the control unit 26 controls the transmission / reception of various types of information in the communication processing unit 11, the processing of audio information for the audio processing unit 17, the display control of information on the main display unit 16, and the input information of the key operation unit 13. Responsive processing, access control to the memory 12, and the like are performed.

When the user operates the push button 19a, the control unit 26 executes a function for reading out the displayed text. At this time, as a reading function, a text reading method is used instead of a method of outputting voice data for reading, and a text string is extracted / generated to read the text.
For example, as shown in FIG. 1, the control unit 26 includes a text extraction unit 261. The text extraction unit 261 extracts text from, for example, a menu, mailer, or browser database stored in the memory 12 in accordance with the text extraction rule. To the speech synthesizer 20.
At that time, the control unit 26 scans the text string in order from the first character, refers to the reading database in the memory 12 in advance, and performs speech synthesis in units of sentences while considering the connection relationship before and after. The text data is supplied to the speech synthesizer 20. Further, the control unit 26 performs control so as to perform, for example, sentence-by-sentence speech synthesis, and according to this reading function, for example, it is possible to change to a male sound, change to a female sound, change a reading speed, and the like. .

When outputting the voice data from the ringer speaker 21 (speaker 171) or the speaker 32 of the earphone microphone 30 through the voice synthesizer 20, the control unit 26 recognizes a predetermined break from the text to be read out, and the key operation unit 13 or When a predetermined instruction is given by the reading key operation unit 19, control is performed so as to output as audio data from any delimiter position before or after the text to be read at the time of inputting the instruction.
In this case, the predetermined instruction instructed to the control unit 26 by the key operation unit 13 or the reading key operation unit 19 is, for example, an operation of fast forward (skip) or rewind (back skip 9).
If the predetermined instruction is a fast-forward (skip) instruction, the control unit 26 performs control so that audio data is output from the nearest separation position forward from the time when the instruction is given.
If the predetermined instruction is an instruction for rewinding (back skip), the control unit 26 performs control so as to output the audio data from the position closest to the rear from the time when the instruction is given.
As described above, this delimiter position is, for example, a descriptive symbol such as a punctuation mark, a punctuation mark, an exclamation mark, or a question mark specified by JIS, specifically, “,” “.” “−” “/” “!” “? ] Is set as the delimiter position, so that the body of the mail can be automatically delimited, and the general purpose can be grasped while shortening the confirmation (recognition) time. It is possible.

The control unit 26 further receives, for example, an e-mail through the communication processing unit 11, and recognizes the components of the e-mail and reads a plurality of components as a separation position when reading out the e-mail. Control to handle.
Further, when reading out the electronic mail, the control unit 26 performs control so that the text of the name of the component is inserted at the head portion of the text sandwiched at the delimiter position divided by the component.
The memory 12 stores a title text and address information, and the control unit 26 can retrieve the sender name from the address information in the memory 12 for the component indicating the sender of the received electronic mail. When reading out the component indicating the sender of the mail, control is performed so that the title is output after the sender name is output by the speaker 21 or the like as the voice output unit.

Further, as described above, the mobile phone 10 can be connected to the earphone microphone 30 as an externally connected device that can be remotely controlled and includes an external operation unit that can be externally connected and instructed to perform a reading operation, in addition to the voice reading function. When the earphone microphone 30 is connected, the control unit 26 controls the switch circuits 22 to 24 so as to switch the voice input / output to the earphone microphone 30 by performing a remote control-compatible operation interrupt routine management process.
When the connection terminal of the earphone microphone 30 is disconnected from the external device connection unit 25, the control unit 26 controls the switch circuits 22 to 24 so that the voice input / output is switched by the built-in microphone 172, speaker 171 and ringer speaker 21. .

When the incoming information is input through the communication processing unit 11 when the earphone microphone 30 is connected, the control unit 26 causes the speaker 32 as an audio output unit to notify the incoming call and output it to the earphone microphone 30. When the key operation unit 31 of the earphone microphone 30 is operated, the incoming call notification is stopped, and the communication processing unit 11 is further controlled to start communication connection processing to the communication network.
The key operation unit 31 of the earphone microphone 30 includes one or a plurality of keys.
As will be described in detail later, the control unit 26 discriminates a predetermined instruction by counting the number of times a signal generated by the key operation of the key operation unit 31 of the earphone microphone 30 within a predetermined time.
The predetermined instruction here is a fast forward (skip) or rewind (back skip) operation. For example, as shown in FIG. 3 (a), the control unit 26 skips when the key of the key operation unit 31 is operated once, and backs up when operated twice as shown in FIG. 3 (b). It is determined that it is skipped. Further, as shown in FIG. 3 (c), when there is a signal input by the key operation unit 31 for a predetermined time or more, the control unit 26 performs an operation not related to the read-out function, such as an incoming call response or a hold release. It is determined that

Further, when the controller 26 reads out at the first speed, which is the normal speed, and is instructed to fast-forward by the key operation unit 19, 13, or 31, it is closest to the front from the time when the fast-forward instruction is issued. Control is performed to read up to the break position at a second speed higher than the first speed, and to read back from the break position to the first speed.
When the first rewinding instruction is given by the key operation unit 19, 13, or 31, the control unit 26 reads out the separation section at the time of the first operation instruction and receives the first operation instruction. If an instruction for rewinding operation is given again within a predetermined time, control is performed so that the reading target is returned to the previous section.

In addition, when the sub-display unit 15 or the main display unit 16 displays text, when a dial input is made in the upward direction of the mobile phone 1, the character size of the displayed text is increased. When a dial input is made in the downward direction of the mobile phone 1, each display unit is controlled so that the character size of the displayed text is reduced.
Since the character information is stored in the memory 12 as a scalable font or as a plurality of fonts having different sizes, the control unit 26 takes out the character information from the memory 12 and displays it on each display unit.
Here, in the state shown in FIG. 2B, it is assumed that the mobile phone 1 displays a text font with the ringer speaker 21 side as the lower side.

As described above, the control unit 26 performs processing according to the dial input from the dial input unit 14, and at that time, performs reversal processing according to the open / closed state of the mobile phone 1.
In general, for a dial operation in the vertical direction, the user expects an increase in action for an upward operation and a decrease in action for a downward operation. Regardless of the open / closed state of the telephone 1, the process for realizing the above-described action in accordance with the user's expectation is the inversion process.

In other words, when the cellular phone 1 is in the closed state (FIG. 2B), as described above, for example, when processing is performed so that the character size is enlarged / reduced according to the input in the vertical direction of the dial, If no other processing is performed, when the cellular phone 1 is in the open state (FIG. 2A), the vertical position direction of the dial input unit 14 for the user is reversed compared to the closed state. The character size is reduced in response to the input, and this results in an unnatural feeling for the user.
Therefore, the control unit 26 determines the open / closed state of the mobile phone 1 based on the output of the open / close switch 18, and performs an inversion process of the action on the dial input unit 14 according to the open / closed state. Accordingly, when viewed from the user, regardless of the open / closed state of the mobile phone 1, an upward operation on the dial input unit 14 always increases the character size and a downward operation on the dial input unit 14 Thus, the operation is performed in the direction of reducing the character size, so that there is no sense of incongruity and operability is improved.

Heretofore, each component of the mobile phone 10 has been described.
Next, the voice reading control of the mobile phone 10 according to the present embodiment will be specifically described with reference to FIGS.

First, the basic operation of the reading operation according to the present embodiment will be described with reference to FIGS.
FIG. 4 is a flowchart for explaining the basic operation of the reading operation according to this embodiment. FIG. 5 is a diagram illustrating an example of data received at the time of a reading operation, and is a diagram illustrating an example of a case where the data is received by a mailer. FIG. 6 is a diagram illustrating an example of a table created by the text extraction unit 261 based on the data received during the reading operation.

Basically, it operates by transitioning to a state where it can be read out.
First, as a pre-reading process, the reception source of data to be read is determined (ST1). It is determined whether the recipient is a menu, mailer, or browser. In this example, it is assumed that it has been received from a mailer. Note that the receiving source is not limited to one place, and a combination of a menu and a mailer is allowed.
Then, data as shown in FIG. 5 is received (ST2), and a table as shown in FIG. 6 is created (ST3).

The received data is, for example, data as shown in FIG.
That is, the header part is DATE (date): 2004/3/20, From (sender): Taro Kyocera, Subject (subject): good weather, and so on. The example in the text of FIG. 6 is “Today is a nice weather. Will it be sunny tomorrow? Let's go play next time!”. As described above, the text includes a reading mark “.”, A question mark “?”, And an exclamation mark “!”.

When creating a table, text data is created for each item according to a rule corresponding to the data receiving source.
Specifically, “ Reception March 20, 2004” is created as the text data of “item number 1”. The text data of item number 1 is created based on data “DATE: 2004/3/20” in the header portion of the received data. Note that the character “Receive” is underlined, which indicates that this is a standard additional text for each item.
As text data of "item number 2", "From Kyocera Taro" is created. The text data of item number 2 is created based on the data “From: Taro Kyocera” in the header portion of the received data. Note that the characters “Sender” and “Mr.” are underlined, which indicates that the text is a standard additional text for each item. “San” is a title. Note that the CPU 26 omits the operation of adding the title or refers to the address book stored in the memory 12 of the mobile phone 10 when only the address information is included in the component indicating the sender of the e-mail. It is preferable to perform the operation of adding a title after extracting the matching names.
As the text data of “item number 3”, “ subject is nice weather” is created. The text data of item number 3 is created based on the data “Subject: Nice weather” in the header of the received data. In addition, although the character of "subject" is underlined, this indicates that it is a standard additional text for each item.

As the text data of “item number 4”, “the text is good weather today” is created. The text data of item number 4 is created based on the data “Today is good weather” in the body of the received data. That is, the reading point “.” Is recognized as a delimiter position, and the item is delimited by this reading point “.”. In addition, although the character of "body" is underlined, this indicates that it is a standard additional text for each item.
As text data of “Item No. 5”, “Is it fine tomorrow?” Is created. The text data of item number 5 is created based on the data “Is it fine tomorrow?” In the body of the received data. That is, the question mark “?” Is recognized as a delimiter position, and the question mark “?” Portion is used as a delimiter.
“Let's go play this time!” Is created as the text data of “item number 6”. The text data of item number 6 is created based on the data “Let's go play next time” in the body of the received data. That is, the exclamation point “!” Is recognized as a delimiter position, and the exclamation point “!” Portion is used as a delimiter.
Then, as the text data of “item number 7”, “end of mail” is created as a fixed additional text at the end of the sentence. In addition, although the character of "the end of mail" is underlined, this indicates that it is a standard additional text for each item.

  In the mobile phone 10 according to the embodiment, text corresponding to each item for voice output by the reading function (referred to as explanatory text) is held in the memory 12, and according to an operation on the push button 19a, Text corresponding to the selected item is supplied to the speech synthesizer 20, where speech synthesis processing is performed, and for example, speech is output from the linger speaker 21 item by item according to the table.

If an interrupt process is received by the key operation unit 13 or 19 during reading, a skip operation instruction (fast forward instruction) or a back skip operation instruction (rewind instruction) is received, a skip operation (ST5a) or a back skip operation (ST5b) described later is performed. Done.
The process ends when the last item of the created table (number 7 "end of mail") is read out (ST6).

Next, a skip operation and a back skip operation will be described with reference to FIGS.
FIG. 7 is a flowchart for explaining the operation during the skip operation. FIG. 8 is a flowchart for explaining the operation of the back skip operation.

First, the operation during the skip operation will be described with reference to FIG.
If an interrupt process based on a skip operation instruction (fast forward instruction) is received by the key operation unit 13 or 19 during reading (ST11), it is determined whether or not the item to be skipped is the last item in the created table (ST12).
If it is determined in step ST12 that the item is not the last item, a process of advancing the item by one, that is, skipping the current item is performed (ST13).
Next, it is determined whether or not an interrupt process by a skip operation instruction (fast-forward instruction) has been received by the key operation unit 13 or 19 within a predetermined time (ST14).
In step ST14, when there is no skip operation instruction within a predetermined time, the process is terminated. On the other hand, if it is determined that a skip operation instruction has been issued within a predetermined time, the process returns to step ST12 to determine whether or not the item to be skipped is the last item in the created table (ST12).
If it is determined in step ST12 that the item is the last item, the process is terminated. If it is determined that the item is not the last item, the item is advanced by one from the process in step ST13, that is, the current item is skipped. Transition to processing.

Next, the operation at the time of the back skip operation will be described with reference to FIG.
If an interrupt process by a back skip operation instruction (fast reverse instruction) is received by the key operation unit 13 or 19 during reading (ST21), after reading the same item again (ST22), the first of the tables created by the item to be back skipped It is determined whether or not it is an item (ST23).
If it is determined in step ST23 that it is not the first item, it is determined whether or not an interrupt process by a back skip operation instruction (fast return instruction) has been received by the key operation unit 13 or 19 within a predetermined time (ST24).
In step ST24, if there is no back skip operation instruction within a predetermined time, the process is terminated. On the other hand, if it is determined that the back skip operation instruction has been issued within the predetermined time, the process proceeds to step ST25 to determine whether or not the item to be skipped is the first item in the created table.
If it is determined in step ST25 that the item is not the first item, a process of returning one item, that is, a back-skipping of the current item is performed (ST26), and the process proceeds to step ST24.
If it is determined in step ST25 that it is not the first item, the process is terminated.

  Next, a control operation when the connection terminal of the earphone microphone 30 as an external connection device is connected to the external device connection unit 25 will be described with reference to the flowcharts of FIGS. 9 and 10.

First, as shown in FIG. 9, it is determined whether or not the connection terminal of the earphone microphone 30 as an external connection device is connected to the external device connection unit 25 (ST31).
If it is determined in step ST31 that the connection terminal of the earphone microphone 30 is connected to the external device connection unit 25, the control unit 26 performs an operation interrupt routine management process corresponding to the remote control (ST32).
If it is determined in step ST31 that the connection terminal of the earphone microphone 30 is not connected to the external device connection unit 25, the control unit performs normal operation interrupt routine management processing (ST33).

In the operation interrupt routine management process corresponding to the remote controller, as shown in FIG. 10, it is determined whether or not there is an input from the key operation unit of the main body (ST41), and if there is, an interrupt process corresponding to the operation is performed. Perform (ST42).
If it is determined in step ST41 that there is no input from the key operation unit of the main body, it is determined whether or not a remote control signal is input (ON) by the key operation unit 31 of the earphone microphone 30 (ST43).

If it is determined in step ST43 that the remote control signal has been turned on, it is determined whether or not the remote control signal has been turned off within a predetermined time after being turned on (ST44).
If it is determined in step ST44 that the remote control signal is not OFF, the key operation unit 31 has input a signal for a predetermined time or longer, and therefore, an operation not related to the read-out function, for example, an incoming call response or a hold release. A determination is made (ST45).
If it is determined in step ST44 that the remote control signal has been turned OFF, it is determined whether or not the remote control signal has been turned ON within a predetermined time by the key operation unit 31 (ST46).
If it is determined in step ST46 that the remote control signal is turned on again at a predetermined time, it is determined that a back skip operation instruction has been issued, and the above-described back skip operation interrupt process is performed (ST47).
If it is determined in step ST46 that the remote control signal is not turned ON again at a predetermined time, it is determined that a skip operation instruction has been issued, and the skip operation interrupt process described above is performed (ST48).

In addition, when the earphone microphone 30 is connected, when the incoming call information is input through the communication processing unit 11, the control unit 26 causes the speaker 32 to notify the incoming call and output it to the earphone microphone 30.
In parallel with this, the control unit 26 stops the incoming call notification when the key operation unit 31 of the earphone microphone 30 is operated, and causes the communication processing unit 11 to start communication connection processing to the communication network.
Further, when the earphone microphone 30 is connected, the control unit 26 creates a new mail table when receiving a new mail.

Here, a new mail table when the earphone microphone is connected will be described. Basically, the creation of the table has already been described with reference to FIGS. 5 and 6. However, when the earphone microphone is connected, the reading function can be made more convenient for the user by slightly changing this operation. .
Normally, when a new incoming mail is generated, “There is a new mail” is displayed on the standby screen. This “new mail” is displayed when the CPU 26 detects that a new incoming mail has occurred, and displays text extracted from the menu database stored in the memory 12 on the sub display unit 15. . Here, when the user opens the terminal, the display of “new mail” is switched on the main display unit 16 due to a change in the signal of the open / close switch 18.
In this state, when a new mail is opened by the key operation unit 13 and reading is instructed by the reading key operation unit 19, a table as described in association with FIGS. 5 and 6 is created. The
On the other hand, when the earphone microphone 30 is connected, when the table as described with reference to FIGS. 5 and 6 is created, the text is first extracted from the menu database at the beginning of the item number. Add new mail "to the text data and create a table by shifting the item numbers below one by one.
Thereby, even if the fast-forward (skip) operation is performed without operating the key operation unit 13 in a state where a new mail is generated, it is possible to confirm even the contents of the new mail immediately.

In addition, although the table creation operation including such a menu has been described only in a state where the earphone microphone 30 is connected, it is not limited to this.
For example, when the reading key operation unit 19 is configured to be exposed when the terminal is closed, when the reading operation unit 19 is operated with the terminal closed, the menu is displayed as described above. An included table creation operation may be performed.
As a result, even when the terminal is not opened, the reading “There is a new mail” is output from the ringer speaker 21 or the like, and a series of contents confirmation can be performed.

As described above, according to the present embodiment, the operation unit 19 that instructs the reading operation, the memory 12 that stores the text, and the text data stored in the memory 12 when the reading is performed are converted into voice data. The voice synthesizing unit 20, the voice output unit 21 that outputs the voice data, and the voice output unit 21 when the voice output unit 21 outputs the voice data, a predetermined break is recognized from the text to be read out, and the operation unit 19 performs a predetermined instruction. When there is, the control unit 26 that controls the speaker as an audio output unit to output the audio data from any position before or after the text to be read out at the time of inputting the instruction as follows. Can be obtained.
In the speech reading function, the user can select according to the importance of information, and the reading function can be used efficiently.
In addition, applications that manage information display, such as mailers, browsers, and menu display units, can be the source of text information, and can be delivered in meaningful units when displaying screens, such as for a single email. .
In addition, text items to be read out can be extracted according to predetermined rules, and can be automatically handled in the case of data such as e-mails whose contents cannot be predicted in advance. The effort to set up can be reduced.
Using the existing earphone / microphone interface, it is possible to use read-out voice output and remote control operation, enabling the cost reduction and size reduction of the terminal, and functional operation in consideration of privacy.
Since operations such as e-mail confirmation can be performed without almost looking at the screen, it can be used in situations where the eyesight is low, as well as in situations where you do not want to look into the screen, etc. .
In addition, when a new mail is received when the earphone microphone is used for purposes other than voice reading such as music playback, simple operations such as confirmation of new mail can be performed at hand without opening a so-called folding terminal. There is an advantage to become.
In addition, since private information such as confirmation of mail contents is included, even if there is a demerit in reading aloud, the voice does not leak to the surroundings and can be used without any problem.

  In addition, according to the mobile phone 10 according to the present embodiment, the characters of the displayed text can be enlarged / reduced by the operation on the dial input unit 14, the text visibility is improved, and the text characters are improved. When enlarging / reducing is performed, display processing corresponding to the display format of the text is performed, so that the user's visibility and operational comfort are further improved.

1 is a block diagram illustrating an example of a system configuration of a mobile phone. It is the figure which illustrated an example of the external appearance of a mobile telephone, (a) is a front external view, (b) is a back external view, (c) is a front external view, (d) is a back external view. Each figure is shown. It is a figure which shows the example of a signal in the case of identifying three types of operation in embodiment. It is a flowchart for demonstrating the basic operation | movement of the reading-out operation | movement which concerns on embodiment. It is a figure which shows the example of the data received at the time of the reading operation | movement which concerns on embodiment, Comprising: It is a figure which shows the example at the time of receiving by the mailer. It is a figure which shows an example of the table produced in a text extraction part based on the data received at the time of the reading operation | movement which concerns on embodiment. It is a flowchart for demonstrating the operation | movement at the time of the skip operation which concerns on embodiment. It is a flowchart for demonstrating operation | movement of the back skip operation which concerns on embodiment. It is a flowchart for demonstrating control operation | movement when the connection terminal of the earphone microphone which is an external connection apparatus which concerns on embodiment is connected to the external apparatus connection part. It is a flowchart for demonstrating control operation | movement when the connection terminal of the earphone microphone which is an external connection apparatus which concerns on embodiment is connected to the external apparatus connection part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Mobile phone 100 ... Main body case 101 ... Key input side main body case 102 ... Display side main body case 11 ... Communication processing part 111 ... Transmission / reception antenna 12 ... Memory 13 ... Key operation part 14 ... Dial input part 15 ... Sub display part 16 ... Main display unit 17 ... Audio processing unit 171 ... Speaker 172 ... Microphone 18 ... Open / close switch 19 ... Reading key operation unit 20 ... Speech synthesis unit 21 ... Linger speaker 22-24 ... Switch circuit 25 ... External device connection terminal 26 ... Control unit 30 ... Earphone microphone 31 ... Key operation unit 32 ... Speaker 33 ... Microphone

Claims (7)

A portable terminal device having a voice reading function,
A communication unit connected to a communication network and capable of receiving an e-mail having content data corresponding to a plurality of items such as a subject, date and time, sender, and body by wireless communication;
A storage unit for storing, as each data content for each item of the received e-mail becomes a predetermined order,
An operation unit for instructing the reading operation for reading out the item names and respective content data of each of the plurality of items of the electronic mail thus received,
A speech synthesizer for converting the item name and the content data into speech data when the reading is performed;
An audio output unit for outputting the audio data;
Control to read out the item name of the item when the predetermined item among the plurality of items is read out and then output the content data associated with the item by the audio output unit And
Have
When the control unit reads out the e-mail stored in the storage unit and reads out the item name of the item of the e-mail, if the predetermined instruction is given by the operation unit, The reading of the content data associated with the item is omitted, and the item name of the next item in the predetermined order of the omitted item is controlled to be output by the audio output unit.
The portable terminal device characterized by the above-mentioned. The plurality of items are kicked min at a predetermined separation position,
The mobile terminal apparatus according to claim 1, wherein the predetermined delimiter position is a position to which a descriptive symbol is attached. The storage unit stores honorific data and e-mail address information,
The control unit can retrieve the sender name from the address information for the item indicating the sender of the e-mail among the plurality of items, and when the text data corresponding to the item indicating the sender is read out, the voice output Control to output the title data after outputting the sender name in the department,
The mobile terminal device according to claim 1 , wherein the mobile terminal device is a mobile terminal device. The operation unit includes an externally connected externally connected device including an external operation unit that is externally connected and can instruct the control unit to perform a reading operation.
The portable terminal device according to any one of claims 1 to 3 , wherein the control unit switches the output of the audio output unit to the external connection device when the external connection device is connected. When receiving the incoming information of the e-mail by the communication unit, the control unit causes the voice output unit to notify the incoming call and output it to the externally connected device, and when the external operation unit is operated, The portable terminal device according to claim 4 , wherein the incoming call notification is stopped and the communication unit is controlled to start communication connection processing to a communication network. The external operation unit includes at least one key,
The mobile terminal device according to claim 4 or 5 , wherein the control unit discriminates the predetermined instruction by counting the number of times a signal generated by the operation of the key within a predetermined time. The external operation unit includes at least one key,
The control unit by counting the time to continue the signal generated by the operation of the key, the portable terminal device according to claim 4 or 5, characterized in that to determine the predetermined instruction.

Images