JP2001216215A - Voice reply/transmission system for portable information terminal electronic mail - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make transmittable electronic mail from a portable information terminal, to add voice information to the electronic mail, and to simplify the information input operation of the electronic mail further. SOLUTION: At the time of transmitting an electronic mail, a logical communication path is secured and a data communication state is established further. Then, an electronic mail processing part 111 transmits the electronic mail to an electronic mail service processing part 133. To the electronic mail to which the voice information is to be added, a tag for indicating that effect is attached and it is sent. The electronic mail service processing part 133 stores the received electronic mail. In the case of the electronic mail with the tag, after switching from the data communication state to a voice communication state, a user is urged to generate voice from a voice information processing part 136 through the electric mail processing part 111. The voice information from the user is stored in a voice storage device 14. When all voice input is ended, the electronic mail service processing part 133 takes out the voice from the voice storage device 14, attaches it to the electronic mail and outputs it to the internet 15.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a technical field belonging to a system for exchanging electronic mails using a portable information terminal in a mobile environment. In a mobile environment, there is a high demand for using e-mail, and systems are being prepared by mobile communication carriers. However, portable information terminals have been reduced in size, and the operation of character input is more inconvenient than an electronic mail terminal installed in an office. The present invention relates to a technical field for improving operability of inputting information of an electronic mail in a mobile environment.

[0002]

2. Description of the Related Art FIG.
FIG. 1 is a configuration diagram of a conventional electronic mail storage and exchange system disclosed in Japanese Patent Publication No. In the figure, 101 is an electronic mail storage and exchange device, 102 is a message input / output processing unit, 103 is a mail terminal access processing unit, 104 is a message storage unit,
105 is a correspondence table storage unit, 106 is a mailbox, 10
7 is a telephone for inputting and outputting voice messages, 108 is a figure
A facsimile machine (FAX) 109 for inputting and outputting image messages such as tables and characters, and a mail terminal device 109 such as a personal computer. The telephones 107a and 107b and the facsimile apparatuses 108a and 108b are connected to the mail storage and exchange apparatus 101 via an ISDN line, 107c is connected to the mail storage and exchange apparatus 101 via an analog telephone network, and the mail terminal apparatus 109 is connected to the communication path. It is connected to the mail storage and exchange apparatus 101 via the Internet.

Next, the operation of the conventional electronic mail storage and exchange system will be described. In the mail storage and exchange device 101,
A correspondence table including the identification information of the mail terminal device, the telephone number of the telephone 107, and the FAX number of the FAX 108 is stored. In response to a message creation request of a voice message or an image message from the mail terminal device 109,
The mail storage and exchange apparatus 101 refers to the correspondence table, retrieves the telephone number or FAX number corresponding to the mail terminal apparatus 109, and informs the calling number notification service of the ISDN that a call has been set from the telephone or FAX corresponding to the number. After the confirmation, the voice message or the image message input from the mail terminal device 109 is assigned with a message identifier in the mail storage and exchange device 101, and the message identifier is returned to the mail terminal device 109. Thereby, the mail terminal device 109 can know the identifier of the message created and sent by itself.

[0004] Next, by transmitting a voice message output request or an image message output request designating a message identifier from the mail terminal device 109 to the mail storage and exchange device 101, the mail storage and exchange device 101 refers to the correspondence table. The telephone number or FAX number corresponding to the mail terminal device 109 is taken out, the telephone 107 or FAX 108 corresponding to the number is called, and the voice message or the image message specified in the message output request is output to the telephone 107 or FAX 108.

[0005] In addition, the mail storing and exchanging a mail in which a message identifier is added to the mail storing and exchanging device 101 and at least one of a text message generated by the mail terminal device 109 and a text message generated by the mail terminal device 109 are combined. A plurality of text messages and message identifiers are set in a mail message for exchange between mail terminal devices via the device 101, and the mail message is issued and distributed as one mail unit.

[0006]

The conventional electronic mail storage system is configured as described above, but the size of the mobile terminal has been reduced in order to allow the mobile information terminal to operate the electronic mail in a mobile environment. Because of the pursuit, the use of a small keyboard, phone buttons on mobile phones,
It is necessary to incorporate a means of inputting with a pen, and in this case, there is a problem that the information input means is difficult to use and takes time as compared with an operation environment using a PC keyboard in an office.

[0007] Further, in another conventional technique of adding information by voice to an electronic mail (Japanese Patent Laid-Open No. 3-99543), it is not assumed that the electronic mail is created by a portable terminal. The procedure for adding voice information is complicated, the user's convenience is impaired, and resource management is complicated in order to achieve the same for many users in a mobile phone communication network. There was a problem.

The present invention has been made to solve such a problem, and a user who sends an electronic mail from a portable information terminal adds voice information to the electronic mail in the flow of the sending procedure. As possible as possible
An object of the present invention is to construct a system that can enhance information of an e-mail by adding a voice and simplify an operation of inputting information of an e-mail.

Another object is to simplify the configuration of a portable terminal.

[0010]

According to a first aspect of the present invention, there is provided an electronic mail voice reply / transmission system including a portable information terminal capable of transmitting and receiving an electronic mail. As a function of the network, it is possible to add voice information.

[0011] Also, an electronic mail voice reply / transmission system according to a second invention is an electronic mail service device connected to a first network such as the Internet and a second network such as a cellular phone communication network. The electronic mail service device includes at least one personal digital assistant connected via the second network, and the personal digital assistant performs processing such as creation, reply, and transfer of electronic mail, and performs voice input / output means. An e-mail processing unit comprising: a communication processing unit; a data communication unit that transmits and receives e-mail processed by the e-mail processing unit; and a voice communication unit that transmits and receives voice information. A service communication control unit configured to secure a communication path on the second network in cooperation with the communication processing unit; and the data communication unit. A data processing unit for carrying out transmission and reception of e-mail, and a voice processing unit for communicating voice information in cooperation with the voice communication unit, wherein the e-mail processing unit A tag is attached, and the electronic mail service processing section adds audio information to the electronic mail when the electronic mail received from the electronic mail processing section has a tag.

[0012] In addition, an electronic mail voice reply / transmission system according to a third aspect of the present invention includes an electronic mail service device connected to a first network such as the Internet and a second network such as a cellular phone communication network. The electronic mail service device includes at least one personal digital assistant connected via the second network, and the personal digital assistant performs processing such as creation, reply, and transfer of electronic mail, and performs voice input / output means. An e-mail processing unit comprising: a communication processing unit; a data communication unit that transmits and receives e-mail processed by the e-mail processing unit; and a voice communication unit that transmits and receives voice information. A service communication control unit configured to secure a communication path on the second network in cooperation with the communication processing unit;
A data processing unit that transmits and receives e-mails in cooperation with the data communication unit, a voice processing unit that performs communication of voice information in cooperation with the voice communication unit, and information such as an identifier of an electronic mail with voice information. Email voice related table to save,
A voice information processing unit; and voice storage means for storing voice information, wherein the email processing unit tags an email with voice information, and the email service processing unit includes the email processing unit. At least one received from
One e-mail is temporarily stored, and information such as an identifier of an e-mail with a tag is stored in the e-mail audio-related table. Read out, voice-convert the information, and transmit the voice-converted information and voice guidance for prompting voice input to the portable information terminal,
The e-mail processing unit of the portable information terminal receives the information such as the identifier and the voice guidance and outputs the information to the voice input / output unit. The voice information is input from the voice input / output unit and transmitted to the electronic mail service device. The voice information processing unit of the electronic mail service device stores the voice information received from the voice communication unit in the voice storage unit, and the electronic mail service processing unit, in the case of a tagged electronic mail, The voice information corresponding to the e-mail identifier in the association table is read from the voice storage means, and the voice information is added to the e-mail and transmitted to the first network.

A voice reply / transmission system for an electronic mail according to a fourth aspect of the present invention includes a portable information terminal capable of transmitting and receiving an electronic mail. In an electronic mail voice reply / transmission system to which voice information is added, voice is transmitted to a communication network using a data communication function for transmission of voice information.

An electronic mail voice reply / transmission system according to a fifth aspect of the present invention includes an electronic mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network. The electronic mail service device includes at least one personal digital assistant connected via the second network, and the personal digital assistant performs processing such as creation, reply, and transfer of electronic mail, and performs voice input / output means. An e-mail processing unit, comprising: a communication processing unit; a data communication unit for transmitting and receiving the e-mail created by the e-mail processing unit; and a voice communication unit for transmitting and receiving voice information. A service communication control unit that secures a communication path on the second network in cooperation with the communication processing unit; Setting a data communication path on the communication path, setting a voice communication path on the communication path in cooperation with the voice communication unit, and a data processing unit for transmitting and receiving an e-mail using the data communication path. And a voice processing unit that performs voice information communication using the voice communication path.

[0015] In addition, an electronic mail voice reply / transmission system according to a sixth aspect of the present invention includes an electronic mail service device connected to a first network such as the Internet and a second network such as a cellular phone communication network. The electronic mail service device includes at least one personal digital assistant connected via the second network, and the personal digital assistant performs processing such as creation, reply, and transfer of electronic mail, and performs voice input / output means. An e-mail processing unit, comprising: a communication processing unit; a data communication unit for transmitting and receiving the e-mail created by the e-mail processing unit; and a voice communication unit for transmitting and receiving voice information. A service communication control unit that secures a communication path on the second network in cooperation with the communication processing unit; A data processing unit for setting a logical data communication path to the communication path and is intended to include a voice processing unit for communication of voice information using the data communication path in conjunction with the voice communication unit.

A voice reply / transmission system for e-mail according to a seventh aspect of the present invention includes a portable information terminal capable of transmitting / receiving an e-mail. In a voice reply / transmission system of an electronic mail to which voice information is added, an operation of adding voice information for each email is enabled.

Also, an electronic mail voice reply / transmission system according to an eighth aspect of the present invention provides an electronic mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network. The electronic mail service device includes at least one personal digital assistant connected via the second network, and the personal digital assistant performs processing such as creation, reply, and transfer of electronic mail, and performs voice input / output means. An e-mail processing unit comprising: a communication processing unit; a data communication unit that transmits and receives e-mail processed by the e-mail processing unit; and a voice communication unit that transmits and receives voice information. A service communication control unit configured to secure a communication path on the second network in cooperation with the communication processing unit; and the data communication unit. A data processing unit for carrying out transmission and reception of e-mail, and a voice processing unit for communicating voice information in cooperation with the voice communication unit, wherein the e-mail processing unit Tag, the email service processing unit sends the email to the first network as it is if the email received from the email processing unit is not tagged, and the email is tagged. If this is the case, voice information is added to this e-mail and transmitted to the first network.

Further, the voice reply / transmission system for e-mail according to the ninth invention comprises: an e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network; The electronic mail service device includes at least one personal digital assistant connected via the second network, and the personal digital assistant performs processing such as creation, reply, and transfer of electronic mail, and performs voice input / output means. An e-mail processing unit comprising: a communication processing unit; a data communication unit that transmits and receives e-mail processed by the e-mail processing unit; and a voice communication unit that transmits and receives voice information. A service communication control unit configured to secure a communication path on the second network in cooperation with the communication processing unit; and the data communication unit. A data processing unit for carrying out transmission and reception of e-mail, a voice processing unit for communicating voice information in cooperation with the voice communication unit, and a mail voice storage for storing information such as an email identifier with voice information. A table, a voice storage unit for storing voice information, and a voice information processing unit for storing voice information in the voice storage unit, wherein the email processing unit attaches a tag to an email with voice information, The e-mail service processing unit transmits the e-mail directly to the first network if the e-mail received from the e-mail processing unit is not tagged, and if the e-mail is tagged, The information such as the mail identifier is stored in the mail voice-related table, and the voice information processing unit reads the email identifier The information is read out, the information is voice-converted, the voice-converted information and voice guidance prompting voice input are transmitted to the portable information terminal, and the electronic mail processing unit of the portable information terminal transmits the information such as the identifier. The information and the voice guidance are received and output to the voice input / output unit, voice information is input from the voice input / output unit and transmitted to the electronic mail service device, and the voice information processing unit of the electronic mail service device includes: The voice information received from the voice communication unit is stored in the voice storage unit, and in the case of a tagged email, the email information processing unit stores the voice information corresponding to the email identifier in the email voice related table. The voice information is read out from the voice storage means, and the voice information is added to the electronic mail and the first
To the network.

Also, an electronic mail voice reply / transmission system according to a tenth aspect of the present invention is an electronic mail service device connected to a first network such as the Internet and a second network such as a cellular phone communication network. At least one portable information terminal connected to the electronic mail service device via the second network;
The portable information terminal performs processing such as creation, reply, and transfer of an e-mail, an e-mail processing unit including a voice input / output unit, a communication processing unit, and transmission and reception of the e-mail processed by the e-mail processing unit. A service communication control unit including a data communication unit for performing communication and a voice communication unit for transmitting and receiving voice information, wherein the e-mail service device secures a communication path on the second network in cooperation with the communication processing unit When,
A data processing unit that transmits and receives e-mail in cooperation with the data communication unit, a voice processing unit that performs communication of voice information in cooperation with the voice communication unit, and stores an identifier of an email with voice information and the like. A mail voice-related table, a voice information processing unit, and voice storage means for storing voice information, wherein the email processing unit attaches a tag to an email with voice information, and the email service processing unit If the received e-mail is not tagged, the e-mail is sent to the first network as it is, and if the e-mail is tagged, information such as the e-mail identifier is output, The unit inputs the identifier of the e-mail output from the e-mail service processing unit, converts the information into a voice, and inputs the voice-converted information and the voice input. To the portable information terminal, and the e-mail processing unit of the portable information terminal receives the information such as the identifier and the speech guidance and outputs them to the speech input / output means. The information is input and transmitted to the e-mail service device, and the voice information processing unit of the e-mail service device stores the voice information received from the voice communication unit in the voice storage unit, and the e-mail service processing unit Reads out, from the voice storage unit, voice information corresponding to the email identifier in the mail voice-related table in the case of a tagged email, adds the voice information to the email, and sends the voice information to the first network. To send.

An electronic mail voice reply / transmission system according to the eleventh invention is an electronic mail voice reply / transmission system for adding voice information as a function of a mobile telephone communication network to an electronic mail transmitted from a portable information terminal. , An electronic mail can be transmitted to the Internet for each operation of adding voice information.

An electronic mail voice reply / transmission system according to a twelfth invention is an electronic mail voice reply / transmission system for adding voice information as a function of a mobile telephone communication network to an electronic mail transmitted from a portable information terminal. , The speech recognition can be used for the operation of adding the speech information.

An electronic mail voice reply / transmission system according to a thirteenth invention is an electronic mail voice reply / transmission system for adding voice information as a function of a mobile telephone communication network to an electronic mail transmitted from a portable information terminal. , An operation of adding voice information prior to a reply e-mail operation is enabled.

The voice reply / transmission system for electronic mail according to the fourteenth invention adds image information such as video to the electronic mail transmitted from the mobile information terminal as a function of a mobile telephone communication network.

Also, an electronic mail voice reply / transmission system according to a fifteenth aspect of the present invention includes an electronic mail service device connected to a first network such as the Internet and a second network such as a cellular phone communication network. At least one portable information terminal connected to the electronic mail service device via the second network;
The portable information terminal performs processing such as creation, reply, and transfer of an e-mail, an e-mail processing unit including a voice input / output unit, a communication processing unit, and transmission and reception of the e-mail processed by the e-mail processing unit. A data communication unit for transmitting and receiving video information, and a video communication unit for transmitting and receiving video information, wherein the e-mail service device cooperates with the communication processing unit to secure a communication path on the second network. A data processing unit that transmits and receives e-mail in cooperation with the data communication unit; and a video processing unit that performs communication of video information in cooperation with the video communication unit, wherein the e-mail processing unit includes video information. A tag is attached to the e-mail with the tag, and the e-mail service processing unit, when the e-mail received from the e-mail processing unit is tagged, It is intended to add a video information received from the portable information terminal.

[0025] Further, an electronic mail voice reply / transmission system according to a sixteenth aspect of the present invention is an electronic mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network. At least one portable information terminal connected to the electronic mail service device via the second network;
The portable information terminal performs processing such as creation, replying, and forwarding of an e-mail, and performs transmission and reception of an e-mail processed by the e-mail processing unit including a video input unit, a communication processing unit, and the e-mail processing unit. A data communication unit, including a video communication unit for transmitting and receiving video information, the e-mail service device, a service communication control unit for securing a communication path on the second network in cooperation with the communication processing unit; A data processing unit that transmits and receives e-mail in cooperation with the data communication unit, a video processing unit that performs communication of video information in cooperation with the video communication unit, and stores an e-mail identifier with video information and the like. An e-mail processing unit, a video information processing unit, and a video storage unit for storing video information. Tagging mail, the e-mail service processing unit stores the e-mail received from the e-mail processing unit, saves information such as the identifier of the tagged e-mail in the e-mail video related table, The e-mail processing unit inputs video information from a video input unit and transmits the video information to the video information processing unit. The video information processing unit stores the video information received from the e-mail processing unit in the video storage unit. The e-mail service processing unit reads video information corresponding to information such as an e-mail identifier in the video association table from the video storage unit when transmitting an e-mail to the first network; Information is added to the electronic mail corresponding to the identifier.

[0026] In a seventeenth aspect of the present invention, in the electronic mail voice reply / transmission system, the electronic mail service device on the portable information communication network accumulates the voice information and transmits the electronic mail to the portable information terminal every time. The e-mail with the audio information is attached with the audio information and transmitted.

An e-mail voice reply / transmission system according to an eighteenth aspect of the present invention includes an e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network. At least one portable information terminal connected to the electronic mail service device via the second network;
The portable information terminal performs processing such as creation, reply, and transfer of an e-mail, an e-mail processing unit including a voice input / output unit, a communication processing unit, and transmission and reception of the e-mail processed by the e-mail processing unit. A service communication control unit including a data communication unit for performing communication and a voice communication unit for transmitting and receiving voice information, wherein the e-mail service device secures a communication path on the second network in cooperation with the communication processing unit When,
A data processing unit that transmits and receives e-mail in cooperation with the data communication unit; and a voice processing unit that performs communication of voice information in cooperation with the voice communication unit, wherein the e-mail service processing unit includes the Internet or the like. Accumulating e-mails received from the network, tagging the e-mails with voice information, and processing the e-mails including the tagged e-mails via the data processing unit on the portable information terminal side. When the e-mail service processing unit receives a request for audio information from the e-mail processing unit of the portable information terminal, the e-mail service processing unit adds the audio information to the tagged e-mail and sends the To send.

[0028] Also, the voice reply / transmission system for e-mail according to the nineteenth invention comprises an e-mail service device connected to a first network such as the Internet and a second network such as a cellular phone communication network. At least one portable information terminal connected to the electronic mail service device via the second network;
The portable information terminal performs processing such as creation, reply, and transfer of an e-mail, an e-mail processing unit including a voice input / output unit, a communication processing unit, and transmission and reception of the e-mail processed by the e-mail processing unit. A service communication control unit including a data communication unit for performing communication and a voice communication unit for transmitting and receiving voice information, wherein the e-mail service device secures a communication path on the second network in cooperation with the communication processing unit When,
A data processing unit for transmitting and receiving an e-mail in cooperation with the data communication unit, a voice processing unit for performing communication of voice information in cooperation with the voice communication unit, and storing an identifier of an email with voice information and the like. A mail voice-related table, a voice information processing unit, and voice storage means for storing voice information, wherein the electronic mail service processing unit is configured such that the electronic mail received from a network such as the Internet is an electronic mail with voice information; A tag is attached to the e-mail and transmitted to the e-mail processing unit, and voice information is further stored in the voice information storage means, and information such as an identifier of the e-mail with the voice information is stored in the mail voice-related table. Storing, and when the e-mail service processing unit receives a request for voice information from the e-mail processing unit, The unit reads out information such as an identifier of the e-mail stored in the mail voice-related table, converts the information into voice, and extracts voice information corresponding to the voice-converted information from the voice information storage unit. The electronic mail processing unit transmits the audio information to the outside by voice using a voice input / output unit.

[0029] Also, an electronic mail voice reply / transmission system according to the twentieth invention comprises an electronic mail service device connected to a first network such as the Internet and a second network such as a cellular phone communication network. At least one portable information terminal connected to the electronic mail service device via the second network;
The portable information terminal performs processing such as creation, reply, and transfer of e-mail, an e-mail processing unit including a voice input / output unit and a display unit, a communication processing unit, and an e-mail processed by the e-mail processing unit. And a voice communication unit for transmitting and receiving voice information. The e-mail service device secures a communication path on the second network in cooperation with the communication processing unit. A service communication control unit, a data processing unit that transmits and receives e-mail in cooperation with the data communication unit, a voice processing unit that performs communication of voice information in cooperation with the voice communication unit, and an e-mail with voice information A mail voice-related table for storing information such as an identifier of the mail, a voice information processing unit, and voice storage means for storing voice information; The e-mail service processing unit temporarily stores at least one e-mail received from the e-mail processing unit and stores information such as an identifier of the e-mail with the tag in the e-mail voice-related table. The voice information processing unit reads information such as an electronic mail identifier from the mail voice-related table, transmits this information and voice guidance prompting voice input to the mobile information terminal, The e-mail processing unit receives the information such as the identifier and the voice guidance, displays the information such as the identifier on the display unit, outputs the voice guidance to the voice input / output unit, and outputs the voice information from the voice input / output unit. And sends it to the e-mail service device, and the voice information processing unit of the e-mail service device The e-mail service processing unit stores, in the case of an e-mail with a tag, the audio information corresponding to the e-mail identifier in the e-mail audio-related table, And adds the voice information to the electronic mail and transmits the electronic mail to the first network.

An electronic mail voice reply / transmission system according to a twenty-first aspect of the present invention includes an electronic mail service device connected to a first network such as the Internet and a second network such as a cellular phone communication network. At least one portable information terminal connected to the electronic mail service device via the second network;
The portable information terminal performs processing such as creation, reply, and transfer of an e-mail, an e-mail processing unit including a voice input / output unit, a communication processing unit, and transmission and reception of the e-mail processed by the e-mail processing unit. A service communication control for securing a communication path on the second network in cooperation with the communication processing unit, the service communication control including a data communication unit for performing communication and a voice communication unit for transmitting and receiving voice information. Unit, a data processing unit that transmits and receives e-mail in cooperation with the data communication unit, a voice processing unit that performs communication of voice information in cooperation with the voice communication unit, an identifier of an email with voice information, and the like. A mail voice-related table that stores the information of the voice, a voice information processing unit, and voice storage means that stores voice information. Attach, the e-mail service processing unit temporarily stores at least one e-mail received from the e-mail processing unit, and stores information such as an identifier of a tagged e-mail in the e-mail voice related table, The voice information processing unit reads information such as an electronic mail identifier from the mail voice related table,
This information is voice-converted, the voice-converted information and voice guidance for prompting voice input are transmitted to the portable information terminal, and the electronic mail processing unit of the portable information terminal receives the information such as the identifier and the voice guidance. Output to the voice input / output means, input voice information from the voice input / output means and transmit it to the electronic mail service device, and the voice information processing unit of the electronic mail service device receives the voice information from the voice communication unit. The voice information is stored in the voice storage unit, and the electronic mail service processing unit reads, from the voice storage unit, voice information corresponding to an electronic mail identifier in the mail voice-related table in the case of a tagged email.
Adding the voice information to the e-mail and transmitting the e-mail to the first network, and sequentially transmitting the untagged e-mail received before receiving the first tagged e-mail to the first network It is.

Also, in the electronic mail voice reply / transmission system according to the twenty-second invention, the voice information processing section includes voice synthesis means, and the voice information processing section transmits the voice guidance when sending voice guidance. The information such as the identifier of the e-mail read from the table is converted into voice.

Further, in the electronic mail voice reply / transmission system according to the twenty-third aspect, the voice storage means comprises at least one voice storage means.
The voice information corresponding to the identifiers and titles of the two emails is stored, and the voice information processing unit searches the voice storage means using the email identifier read from the email voice-related table as a search key when transmitting voice guidance, and responds. The voice conversion is performed by extracting voice information of information such as an identifier of an electronic mail to be performed.

[0033]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 FIG. 1 is a configuration diagram showing Embodiment 1 of a voice reply / transmission system for electronic mail of a portable information terminal according to the present invention. In the figure, 1
Reference numeral 1 denotes a portable information terminal that sends and receives e-mails to and from a mobile phone communication network. Next, the configuration of the portable information terminal 11 will be described. Reference numeral 111 denotes an e-mail processing unit having functions similar to e-mail software used on a personal computer in an office or the like, which performs creation and transmission / reception of e-mails; 112, a data communication unit for performing e-mail data communication; A voice communication unit that performs voice processing when the information terminal 11 performs a voice call as a mobile phone;
Is a communication processing unit for securing a communication path for sending and receiving e-mail and making a voice call as a mobile phone.

Reference numeral 12 denotes a mobile phone communication network (hereinafter, referred to as a communication network), and reference numeral 13 denotes an e-mail service device for performing an e-mail service in the communication network 12, which not only communicates with the portable information terminal 11, Internet 15
Is also connected to the Internet 15
It transmits and receives to and from another system (not shown) via

Next, the configuration of the electronic mail service device 13 will be described. 131 is a service communication control unit that secures a communication path in cooperation with the communication processing unit 114 of the portable information terminal 11, and 132 is an e-mail between the e-mail service processing unit 133 and the data communication unit 112 of the portable information terminal 11. A data processing unit 134 for controlling a data communication state at the time of performing communication of the e-mail; a mail voice-related table 134 holding a link between the e-mail stored by the e-mail service processing unit 133 and the voice information stored in the voice storage device 14 , 13
Reference numeral 5 denotes a voice processing unit which controls a voice communication state when performing voice communication in cooperation with the voice communication unit 113 of the portable information terminal 11,
A voice information processing unit 136 includes a voice synthesizing unit (not shown) and stores and reads voice information in and from the voice storage device 14.

FIG. 2 is a flowchart showing the operation of the first embodiment. The operation of the first embodiment will be described with reference to FIGS. The e-mail processing unit 111 of the portable information terminal 11 creates an e-mail based on a user's instruction, or displays a received reply mail or transfer e-mail on the screen of the portable information terminal 11 to create a response mail. (Step S201). Next, the user performs an operation of inputting a source address, a destination address, a title, a text, and the like in text with a small keyboard, a pen, and a push button with respect to the e-mail currently being operated. By this input operation, the e-mail processing unit 11
1 inputs the information into an e-mail and temporarily stores it in the e-mail processing unit 111 (step S202). In addition, the user performs an operation indicating that to a mail to which voice information is to be added, among the emails transmitted using the function of the email processing unit 111. Thereby, the e-mail processing unit 111 attaches a tag (mark) to the e-mail indicating that the e-mail currently being operated is a mail to which voice information should be added (step S203).

When the user instructs the portable information terminal 11 to transmit an e-mail, the communication processing unit 114 of the portable information terminal 11 sends the e-mail service device 13 of the communication network 12
The communication path is secured on the communication network 12 in cooperation with the service communication control unit 131 provided in (step S204). Next, the data communication unit 112 and the data processing unit 132 cooperate to establish a data communication state (steps S205 and S2).
10). Here, "establishing a data communication state" means "securing a data communication path" for performing data communication on the communication path. Thereafter, data communication can be performed between the portable information terminal 11 and the electronic mail service device 13 using this data communication path.

When the data communication state is established, the e-mail created by the e-mail processing unit 111 is sent from the e-mail processing unit 111 to the data communication unit 112, the communication processing unit 114, the communication network 12, the service communication control unit 131, the data communication unit It is sent to the e-mail service processing unit 133 via the processing unit 132 in this order (step S206). Upon receiving the e-mail sent from the e-mail processing unit 111 of the portable information terminal 11 (step S211), the e-mail service processing unit 133 stores the received e-mail in a storage unit (not shown), and Check if is tagged. If no tag is attached to the received e-mail, a reception completion signal is simply sent to the e-mail processing unit 111 by a reverse route. If the received e-mail has a tag, information such as the identifier and title of the e-mail is registered in the e-mail voice-related table 134 (step S212), and a reception completion signal is sent to the e-mail processing by a reverse route. Notify section 111.

When the e-mail processing unit 111 receives the e-mail reception completion signal from the e-mail service processing unit 133, the e-mail processing unit 111 again transmits the next e-mail created by the e-mail processing unit 111 to the e-mail processing unit 111 for data communication. The e-mail is transmitted to the e-mail service processing unit 133 via the unit 112, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the data processing unit 132 in this order (step S206).

Upon receiving the e-mail sent from the e-mail processing unit 111 of the portable information terminal 11 (step S211), the e-mail service processing unit 133 accumulates the received e-mail in a storage unit (not shown) and receives it. Check if the e-mail you have tagged is tagged. If no tag is attached to the received e-mail, a reception completion signal is simply sent to the e-mail processing unit 111 by a reverse route. If the received e-mail has a tag, information such as the e-mail identifier and title is registered in the e-mail voice-related table 134 (step S21).
2) Further, the reception completion signal is notified to the e-mail processing unit 111 by the reverse route.

The operations of steps S206, S211 and S212 are repeated until all electronic mails are transmitted from the portable information terminal 11 to the electronic mail service device 13.

When the e-mail processing unit 111 transmits the last e-mail and receives an e-mail reception completion signal from the e-mail service processing unit 133, the portable information terminal 11 confirms that all the e-mails have been transmitted. Is detected, and the data communication unit 112 and the data processing unit 132 cooperate to cancel the data communication state. In this case, the data communication path is cut off, but the communication path is not cut off and is maintained. Next, the portable information terminal 11 is
Start The voice communication unit 113 establishes a voice call state in cooperation with the voice processing unit 135 of the e-mail service device 13, and shifts from the data communication state to the voice call state (steps S207 and S213). Here, "establishing a voice communication state" means "securing a voice communication path" for performing voice communication on the communication path. Since then
Voice communication can be performed between the portable information terminal 11 and the electronic mail service device 13 using this voice communication path.

When the voice communication state is established, the voice information processing unit 136 reads information such as the title and identifier of the electronic mail to be voice-inputted from the mail voice-related table 134, and uses a voice synthesizer (not shown) to read the information. Voice guidance that prompts the user to utter a message, and a voice guidance that prompts the user to press a push button after the completion of one message. The voice processing unit 135, the service communication control unit 13
1, communication network 12, communication processing unit 114, voice communication unit 113
Are transmitted to the e-mail processing unit 111 via this order. Therefore, the voice guidance is stored in the voice storage device 1 in advance.
4 must be saved.

The electronic mail processing section 111 outputs these pieces of information by using an audio output device (not shown) such as an attached speaker. According to the voice guidance, the user utters a message to be added to the e-mail corresponding to the information such as the e-mail identifier and the title (step S).
208). The message uttered by the user is input to the e-mail processing unit 111 through a voice input device (not shown) such as an attached microphone, and the e-mail processing unit 111 outputs a voice communication unit 113, a communication processing unit 114, a communication network 12, a service communication control unit. 131, is transmitted to the audio information processing unit 136 via the audio processing unit 135 in this order, and is stored in the audio storage device 14 by the audio information processing unit 136 (step S214).

When the utterance of one message is completed, the user operates the push button according to the voice guidance. With this operation, the push tone signal is input to the e-mail processing unit 111, and the e-mail processing unit 111 sends the voice communication unit 113, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the voice processing unit 135 in this order. The e-mail service device 13 transmits the e-mail to the voice information processing unit 136, and detects that the input of the voice information of the e-mail is completed. Thereby, the state shifts to the input state of the voice information of the next electronic mail.

The voice information processing unit 136 reads information such as the identifier and title of the next electronic mail to be voice-inputted from the mail voice-related table 134 again, and converts the information into voice using a voice synthesizer (not shown). Converted,
Further, the voice guidance urging the user to utter a message and the voice guidance urging the user to press a push button after the completion of one message are read out from the voice storage device 14 and the electronic mail converted into voice is read. The information is transmitted to the electronic mail processing unit 111 via the voice processing unit 135, the service communication control unit 131, the communication network 12, the communication processing unit 114, and the voice communication unit 113 in this order together with the information such as the identifier and the title.

The e-mail processing unit 111 outputs these pieces of information by using an audio output device (not shown) such as an attached speaker. According to the voice guidance, the user utters a message to be added to the e-mail corresponding to the information such as the e-mail identifier and the title (step S).
208). The message uttered by the user is input to the e-mail processing unit 111 through a voice input device (not shown) such as an attached microphone, and the e-mail processing unit 111 outputs a voice communication unit 113, a communication processing unit 114, a communication network 12, a service communication control unit. 131, is transmitted to the audio information processing unit 136 via the audio processing unit 135 in this order, and is stored in the audio storage device 14 by the audio information processing unit 136 (step S214).

When the utterance of one message is completed, the user operates the push button according to the guidance. By this operation, the push tone signal is input to the e-mail processing unit 111, and the e-mail processing unit 111 passes through the voice communication unit 113, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the voice processing unit 135. Transmitted to the voice information processing unit 136,
3 detects that the input of the voice information of the electronic mail is completed. As a result, the state shifts to the input state of voice information corresponding to the next electronic mail.

When the above operations of steps S208 and S214 are repeated, and the input of all the voice information is completed, the voice information processing unit 136 indicates that all the record information of the mail voice-related table 134 has been read, for example, EOF (E
nd Of File) detection, and notifies the electronic mail service device 13 of this. This allows
The electronic mail service processing unit 133 starts transmitting the stored electronic mail to the Internet 15. When transmitting the e-mail to the Internet 15, the e-mail service processing unit 133 refers to the information in the e-mail voice-related table 134 based on the information such as the identifier and the title of the e-mail with the tag. Then, the corresponding voice information is extracted from the voice storage device 14, and the voice information is attached to the electronic mail and transmitted to the Internet 15. Internet 1 without any audio information attached to untagged e-mail
5 (step S215). On the other hand, the portable information terminal 11 that has completed the transmission of the e-mail disconnects the secured communication path (step S209).

As described above, by adding voice information to an e-mail, data previously input by key operation can be sent by voice, and the data input from the portable information terminal can be minimized. Creation and transmission become possible, and the trouble of key input can be greatly reduced.

In addition, since the function of voice information processing is provided in the electronic mail service device on the communication network side, the mobile information terminal does not need any storage resources for voice information.

Further, since the operation terminal for e-mail and the telephone for voice input can be operated integrally, there is no need for the user to re-input the voice as in the prior art, and the convenience is improved. .

Embodiment 2 In the first embodiment, all the e-mails are stored in the e-mail service device 13 and transmitted to the Internet 15 after all the voice input is completed, but the first e-mail with voice information is received. A plurality of e-mails without audio information received prior to the first e-mail may be output to the Internet 15 without waiting until all the e-mails are accumulated. This will be described in a second embodiment. FIG. 1 is also used in the second embodiment. FIG. 3 is a flowchart showing the second embodiment.

Next, the operation of the second embodiment will be described with reference to FIGS.
This will be described with reference to FIG. The operations up to steps S205 and S210 are the same as in the first embodiment.

When the data communication state is established, the e-mail created by the e-mail processing unit 111 is sent from the e-mail processing unit 111 to the data communication unit 112, the communication processing unit 114, the communication network 12, the service communication control unit 131, the data communication unit The information is transmitted to the e-mail service processing unit 133 via the processing unit 132 in this order (step S206). Upon receiving the e-mail sent from the e-mail processing unit 111 of the portable information terminal 11 (step S211), the e-mail service processing unit 133 stores the received e-mail in a storage unit (not shown), and Check if is tagged. If the received e-mail does not have a tag, a reception completion signal is notified to the e-mail processing unit 111 by a reverse route. If no tagged e-mail has been received yet, the received e-mail is taken out of the storage unit and transmitted to the Internet 15.

Upon receiving the e-mail reception completion signal from the e-mail service processing unit 133, the e-mail processing unit 111 transmits the next e-mail created by the e-mail processing unit 111 again to the data communication from the e-mail processing unit 111. The e-mail is transmitted to the e-mail service processing unit 133 via the unit 112, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the data processing unit 132 in this order (step S206).

Upon receiving the e-mail sent from the e-mail processing unit 111 of the portable information terminal 11, the e-mail service processing unit 133 stores the received e-mail again in a storage unit (not shown) (step S211), and receives the e-mail. Check if the e-mail you have tagged is tagged. If the received e-mail is not tagged, the reception completion signal is sent to the e-mail
Notify to If no tagged e-mail has been received yet, the received e-mail is taken out of the storage unit and transmitted to the Internet 15.

The above operation is repeated until the first tagged e-mail is transmitted from the portable information terminal 11 to the e-mail service device 13. If a tag is attached to the received e-mail, information such as the e-mail identifier and title is registered in the e-mail voice-related table 134, and a reception completion signal is sent to the e-mail processing unit 1 by a reverse route.
11 is notified (step S312).

When the e-mail processing unit 111 receives the e-mail reception completion signal from the e-mail service processing unit 133, the e-mail processing unit 111 again transmits the next e-mail created by the e-mail processing unit 111 to the e-mail processing unit 111 for data communication. The e-mail is transmitted to the e-mail service processing unit 133 via the unit 112, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the data processing unit 132 in this order (step S206). Subsequent operations are the same as in the first embodiment.

As described above, every time all the e-mails including the tagged e-mails are received, in the process of storing the e-mails in the storage unit, all the untagged e-mails received before receiving the first e-mail with the tag are received. Since the electronic mail is transmitted to the Internet 15, the speed can be increased accordingly.

Embodiment 3 In the first embodiment, the information such as the title and the identifier of the e-mail is converted into voice and shown to the user.

FIG. 1 is also used in the third embodiment.
However, the speech information processing unit 136 does not include a speech synthesis device. FIG. 4 is a flowchart showing the operation of the third embodiment. The operation of the first embodiment will be described with reference to FIGS. The operation up to step S212 is the same as in the first embodiment. The subsequent operation will be described.
The e-mail processing unit 111 sends the last e-mail,
By receiving the e-mail reception completion signal from the e-mail service processing unit 133, the e-mail processing unit 111 detects that all the e-mails have been transmitted, and notifies the data communication unit 112 of this fact. Processing unit 114,
The electronic mail service processing unit 132 is notified via the communication network 12, the service communication control unit 131, and the data processing unit 132.

Next, when the voice communication state is established,
The voice communication unit 113 cancels this voice communication state in cooperation with the voice processing unit 132. In this case, the voice communication path is disconnected, but the communication path is maintained. Next, the data communication unit 112 establishes a data communication state in cooperation with the data processing unit 132. Therefore, the state shifts from the voice communication state to the data communication state (step S401). Thereafter, data communication can be performed between the portable information terminal 11 and the electronic mail service device 13 using this data communication path.

The e-mail service processing unit 133 extracts information such as the identifier and title of the first e-mail to which the sound is to be added from the e-mail sound-related table 134, and outputs the data processing unit 132, the service communication control unit 131, and the communication network 1
2. Transmission is made to the e-mail processing unit 111 via the communication processing unit 114 and the data communication unit 112 (step S402).
When the e-mail processing unit 111 receives information such as an e-mail identifier and title from the e-mail service processing unit 133, the e-mail processing unit 111 displays this information on a screen of a display unit (not shown) (step S403).

Next, the data communication section 112 cancels the data communication state in cooperation with the data processing section 132 of the e-mail service device 13 (in this case, the data communication path is disconnected, but the communication path is maintained. is there). next,
The voice communication unit 113 establishes a voice call state in cooperation with the voice processing unit 135 of the e-mail service device 13, and shifts from the data communication state to the voice call state (step S2).
07, S213). Thereafter, voice communication can be performed between the portable information terminal 11 and the electronic mail service device 13 using this voice communication path.

When the voice communication state is established, the voice information processing unit 136 generates a voice guidance urging the user to utter a message and a voice guidance urging the user to press the push button after uttering one message. Read from the audio storage device 14 and the audio processing unit 13
5. Transmission to the e-mail processing unit 111 via the service communication control unit 131, the communication network 12, the communication processing unit 114, and the voice communication unit 113. Therefore, the voice guidance needs to be stored in the voice storage device 14 in advance.

The electronic mail processing unit 111 outputs voice guidance by voice using a voice output device (not shown) such as an attached speaker. According to the voice guidance, the user utters a message corresponding to the information such as the title and the identifier of the e-mail indicated on the display unit (step S20).
8). The message uttered by the user is sent to the e-mail processing unit 1 through a voice input device (not shown) such as an attached microphone.
And transmitted from the electronic mail processing unit 111 to the voice information processing unit 136 via the voice communication unit 113, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the voice processing unit 135 in this order, Voice information processing unit 13
6 is stored in the voice storage device 14 (step S6).
214).

When the utterance of one message ends, the user operates the push button according to the voice guidance. By this operation, the push tone signal is input to the e-mail processing unit 111, and the e-mail processing unit 111 passes through the voice communication unit 113, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the voice processing unit 135. Then, the electronic mail service device 13 detects that the input of the audio information of the electronic mail has been completed. Thereby, the state shifts to the input state of the voice information of the next electronic mail.

Next, the voice communication unit 113
Cancel the voice call state in cooperation with 2. In this case, the voice communication path is disconnected, but the communication path is maintained. Next, the data communication unit 112
2 to establish a data communication state. Therefore, the state shifts from the voice call state to the data communication state (step S4).
01). Thereafter, data communication can be performed between the portable information terminal 11 and the electronic mail service device 13 using this data communication path. Next, the e-mail service processing unit 133 extracts information such as an identifier and a title of the next e-mail to which the sound is to be added from the e-mail sound-related table 134, and the data processing unit 132, the service communication control unit 131, the communication network 12, The data is transmitted to the e-mail processing unit 111 via the processing unit 114 and the data communication unit 112 in this order (step S402). Email processing unit 11
When receiving information such as an e-mail identifier and title from the e-mail service processing unit 133, the information 1 is displayed on a screen of a display unit (not shown) (step S40).
3).

Next, the data communication section 112 cancels the data communication state in cooperation with the data processing section 132 of the e-mail service device 13 (in this case, the data communication path is cut off, but the communication path is maintained. is there). next,
The voice communication unit 113 establishes a voice call state in cooperation with the voice processing unit 135 of the e-mail service device 13, and shifts from the data communication state to the voice call state (step S2).
07, S213). Thereafter, voice communication can be performed between the portable information terminal 11 and the electronic mail service device 13 using this voice communication path.

When the voice communication state is established, the voice information processing unit 136 generates a voice guidance urging the user to utter a message again and a voice guidance urging the user to press the push button after uttering one message. Is read from the audio storage device 14 and the audio processing unit 1
35, to the e-mail processing unit 111 via the service communication processing unit 131, the communication network 12, the communication processing unit 114, and the voice communication unit 113. Therefore, the voice guidance needs to be stored in the voice storage device 14 in advance.

The electronic mail processing section 111 outputs voice guidance by voice using a voice output device (not shown) such as an attached speaker. According to the voice guidance, the user utters a message corresponding to the information such as the title and the identifier of the e-mail indicated on the display unit (step S20).
8). The message uttered by the user is sent to the e-mail processing unit 1 through a voice input device (not shown) such as an attached microphone.
And transmitted from the electronic mail processing unit 111 to the voice information processing unit 136 via the voice communication unit 113, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the voice processing unit 135 in this order, Voice information processing unit 13
6 is stored in the voice storage device 14 (step S6).
214).

When the utterance of one message is completed, the user operates the push button according to the voice guidance. With this operation, the push tone signal is input to the e-mail processing unit 111, and the e-mail processing unit 111 sends the voice communication unit 113, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the voice processing unit 135 in this order. The e-mail service device 13 transmits the e-mail to the voice information processing unit 136, and detects that the input of the voice information of the e-mail is completed. Thereby, the state shifts to the input state of the voice information of the next electronic mail.

When the above operation is repeated and input of all voice information is completed, the voice information processing unit 136 refers to the mail voice-related table 134 and indicates that all record information of this table has been read, for example, by EOF (End).
Of file), and notifies the electronic mail service processing unit 133 of the fact. Thereby, the e-mail service processing unit 133 starts transmitting the stored e-mail to the Internet 15. When sending an electronic mail to the Internet 15, the mail service processing unit 133 refers to the information in the mail audio related table 134, attaches audio information to the corresponding electronic mail, and transmits the electronic mail to the Internet 15. In addition, an electronic mail to which voice addition is not specified is transmitted to the Internet 15 without attaching voice information (step S).
215). On the other hand, the portable information terminal 11 which has completed the transmission of the e-mail disconnects the secured communication path (step S20).
9).

As described above, since information such as an e-mail title and an identifier is displayed on the screen without being converted into voice, a voice converter is not required, and a more inexpensive system can be constructed.

Embodiment 4 In the first to third embodiments, a system in which data communication and voice communication are switched and used has been described. In this embodiment, a VoIP (Voice Over Internet) that transmits voice using data communication is used.
t Protocol).

FIG. 5 is a block diagram showing a fourth embodiment of a voice reply / transmission system for electronic mail of a portable information terminal according to the present invention. In the figure, the same reference numerals as those in FIG. 1 denote the same or corresponding parts. A data communication processing unit 137 performs data communication such as e-mail, and exchanges e-mail data in cooperation with the data communication unit 112 of the portable information terminal 11. Further, the voice communication unit 113 of the portable information terminal 11 is located above the data communication unit 112, and the voice processing unit 13 of the electronic mail service device 13.
Reference numeral 5 is located above the data communication processing unit 137, and the voice communication unit 113 and the voice processing unit 135 cooperate to perform voice data communication on data communication.

Next, the operation will be described. FIG. 6 is a flowchart showing the operation of the fourth embodiment. The operation of the fourth embodiment will be described with reference to FIGS. Step S20
The operations up to 4 are the same as in the first embodiment. The subsequent operation will be described. When the communication path is secured, the data communication unit 112 and the data communication processing unit 137 cooperate to establish a data communication state (steps S605 and S61).
0). Thereafter, the portable information terminal 1 is used by using this data communication path.
1 and the e-mail service device 13 can perform data communication.

When the data communication state is established, the e-mail created by the e-mail processing unit 111 is sent from the e-mail processing unit 111 to the data communication unit 112, the communication processing unit 114, the communication network 12, the service communication control unit 131, The data is transmitted to the electronic mail service processing unit 133 via the communication processing unit 137 in this order (step S606).

When the e-mail service processing unit 133 receives the e-mail sent from the e-mail processing unit 111 of the portable information terminal 11 (step S611), the e-mail service processing unit 133 stores the received e-mail in a storage unit (not shown) and receives the e-mail. Check if the e-mail you have tagged is tagged. If no tag is attached to the received e-mail, a reception completion signal is simply sent to the e-mail processing unit 111 by a reverse route. If the received e-mail has a tag, information such as the e-mail identifier and title is registered in the e-mail voice-related table 134 (step S6).
12) Then, the reception completion signal is notified to the electronic mail processing unit 111 by the reverse route.

When the e-mail processing section 111 receives the e-mail reception completion signal from the e-mail service processing section 133, the e-mail processing section 111 transmits the next e-mail generated by the e-mail processing section 111 again to the data communication from the e-mail processing section 111. The e-mail is transmitted to the e-mail service processing unit 133 via the unit 112, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the data communication processing unit 137 in this order (step S606).

When the e-mail service processing unit 133 receives the e-mail sent from the e-mail processing unit 111 of the portable information terminal 11 (step S611), the e-mail service processing unit 133 accumulates the received e-mail in a storage unit (not shown) and receives it. Check if the e-mail you have tagged is tagged. If no tag is attached to the received e-mail, a reception completion signal is simply sent to the e-mail processing unit 111 by a reverse route. If the received e-mail has a tag, information such as the e-mail identifier and title is registered in the e-mail voice-related table 134 (step 61).
2) Further, the reception completion signal is notified to the e-mail processing unit 111 by the reverse route.

The operations of steps S606, S611 and S612 are repeated until all electronic mails are transmitted from portable information terminal 11 to electronic mail service device 13.

When the e-mail processing unit 111 transmits the last e-mail and receives an e-mail reception completion signal from the e-mail service processing unit 133, the portable information terminal 11 confirms that all e-mails have been transmitted. Is detected, and the data communication unit 112 and the data communication processing unit 137 cooperate to cancel the data communication state. In this case, the communication path and the data communication path are maintained without being disconnected. Next, the portable information terminal 11 activates the voice communication unit 113. The voice communication unit 113 is the electronic mail service device 13
(Steps S607 and S613) in cooperation with the voice processing unit 135 of this embodiment (steps S607 and S613).

The subsequent operation is the same as in the first embodiment.
In this case, the voice information processing unit 136 reads information such as the identifier and title of the next electronic mail to be voice-input from the mail voice-related table 134, converts the information into voice using a voice synthesizer, Further, the voice guidance urging the user to utter a message and the voice guidance urging the user to press the push button after uttering one message are read out from the voice storage device 14, and the electronic mail converted into voice is read. Along with information such as an identifier and a title, the electronic processing is performed via the voice processing unit 135, the data communication processing unit 137, the service communication control unit 131, the communication network 12, the communication processing unit 114, the data communication unit 112, and the voice communication unit 113 in this order. Mail processing unit 111
Send to

The e-mail processing section 111 outputs these pieces of information by using an audio output device (not shown) such as an attached speaker. According to the voice guidance, the user utters a message to be added to the e-mail corresponding to the information such as the e-mail identifier and the title (step S).
608). The message uttered by the user is input to the e-mail processing unit 111 through a voice input device (not shown) such as an attached microphone.
4, the communication network 12, the service communication control unit 131, the data communication processing unit 137, and the voice processing unit 135 are transmitted to the voice information processing unit 136 in this order, and the voice information processing unit 13
6 is stored in the voice storage device 14 (step S6).
614).

When the utterance of one message is completed, the user operates the push button according to the voice guidance. By this operation, the push tone signal is input to the e-mail processing unit 111, and the voice communication unit 113, the data communication unit 112, and the communication processing unit 1
14, the communication network 12, the service communication control unit 131, the data communication processing unit 137, and the voice processing unit 135 are transmitted to the voice information processing unit 136 in this order. Is detected. As a result, the state shifts to the input state of voice information corresponding to the next electronic mail.

The voice information processing section 136 reads information such as the identifier and title of the next electronic mail to be voice-inputted from the mail voice-related table 134 again, and converts the information into voice using a voice synthesizer (not shown). Converted,
Further, the voice guidance urging the user to utter a message and the voice guidance urging the user to press the push button after uttering one message are read out from the voice storage device 14, and the electronic mail converted into voice is read. Along with information such as an identifier and a title, the electronic processing is performed via the voice processing unit 135, the data communication processing unit 137, the service communication control unit 131, the communication network 12, the communication processing unit 114, the data communication unit 112, and the voice communication unit 113 in this order. Send to the mail processing unit 111.

The e-mail processing section 111 outputs these pieces of information by using an audio output device (not shown) such as an attached speaker. According to the voice guidance, the user utters a message to be added to the e-mail corresponding to the information such as the e-mail identifier and the title (step S).
608). The message uttered by the user is input to the e-mail processing unit 111 through a voice input device (not shown) such as an attached microphone.
4, the communication network 12, the service communication control unit 131, the data communication processing unit 137, and the voice processing unit 135 are transmitted to the voice information processing unit 136 in this order, and the voice information processing unit 13
6 is stored in the voice storage device 14 (step S6).
614).

When the utterance of one message is completed, the user operates the push button according to the voice guidance. By this operation, the push tone signal is input to the e-mail processing unit 111, and the voice communication unit 113, the data communication unit 112, and the communication processing unit 1
14, the communication network 12, the service communication control unit 131, the data communication processing unit 137, and the voice processing unit 135 are transmitted to the voice information processing unit 136 in this order. Is detected. As a result, the state shifts to the input state of voice information corresponding to the next electronic mail.

When the above operations of steps S608 and S614 are repeated and the input of all the voice information is completed, the voice information processing unit 136 confirms that all the record information of the mail voice-related table 134 has been read, for example, by EOF (En).
d Of File) detection and the like, and notifies the electronic mail service device 13 of this. Thereby, the e-mail service processing unit 133 starts transmitting the stored e-mail to the Internet 15. The e-mail service processing unit 133 converts the e-mail into the Internet 1
5, when the e-mail is tagged, the e-mail refers to information in the e-mail audio-related table 134 based on information such as the e-mail identifier and title, and the corresponding audio information is stored in the audio storage device 14. , And attaches this voice information to the electronic mail and transmits it to the Internet 15. Internet 1 without any audio information attached to untagged e-mail
5 (step S615). On the other hand, the portable information terminal 11 that has completed the transmission of the e-mail disconnects the secured communication path and data communication path (step S609).

As described above, at the time of transition from data communication to voice communication, voice communication is performed using the data communication path used for data communication as it is.
Unlike this, the process of setting the voice communication path after disconnecting the data communication path becomes unnecessary, and the configurations of the portable information terminal and the e-mail service device can be simplified accordingly.

Embodiment 5 In the first to fourth embodiments, a case has been described in which voice information is input after all e-mails are transmitted from the portable information terminal to the e-mail service device at once, but in the fifth embodiment, one e-mail is transmitted. A description will be given of a form in which voice information is added to an electronic mail that requires voice information every time transmission is performed from the portable information terminal 11 to the electronic mail service device 13 on the communication network side.

FIG. 5 is also used in the fifth embodiment.
FIG. 7 is a flowchart showing the operation of the fifth embodiment. Next, the operation of the fifth embodiment will be described with reference to FIGS. The operation up to step S204 is the same as in the fourth embodiment. The subsequent operation will be described. When the communication path is secured, the data communication unit 112 and the data communication processing unit 137 cooperate to establish a data communication state (steps S705 and S710). Thereafter, data communication can be performed between the portable information terminal 11 and the electronic mail service device 13 using this data communication path.

When the data communication state is established, the e-mail created by the e-mail processing unit 111 is sent from the e-mail processing unit 111 to the data communication unit 112, the communication processing unit 114, the communication network 12, the service communication control unit 131, The information is transmitted to the e-mail service processing unit 133 via the communication processing unit 137 in this order (step S706).
Upon receiving the e-mail sent from the e-mail processing unit 111 of the portable information terminal 11 (step S711), the e-mail service processing unit 133 stores the received e-mail in a storage unit (not shown), and stores the received e-mail. Check if is tagged. If no tag is attached to the received e-mail, a reception completion signal is simply sent to the e-mail processing unit 111 by a reverse route. If the received e-mail has a tag, information such as the identifier and title of the e-mail is registered in the e-mail voice-related table 134 (step S712), and the reception completion signal is sent to the e-mail processing by the reverse route. Notify section 111.

When the e-mail processing unit 111 transmits an untagged e-mail and receives an e-mail reception completion signal from the e-mail service processing unit 133, the e-mail processing unit 111 again transmits the next e-mail to the e-mail processing unit. 111 to data communication unit 112, communication processing unit 114, communication network 1
2, service communication control unit 131, data communication processing unit 13
7 in this order via the e-mail service processor 133
(Step S706). When the e-mail processing unit 111 transmits an e-mail with a tag and receives an e-mail reception completion signal from the e-mail service processing unit 133, the data communication unit 112 and the data communication processing unit 137 cooperate. To cancel the data communication state. In this case, the communication path and the data communication path are maintained without being disconnected. Next, the portable information terminal 11 activates the voice communication unit 113. The voice communication unit 113 cooperates with the voice processing unit 135 of the e-mail service device 13 in a voice communication state (in this case, not a voice communication state using a voice communication path, but a voice communication state using a data communication path). The process proceeds to (Steps S707 and S713).

When the voice communication state is established, the voice information processing unit 136 reads information such as the identifier and title of the electronic mail to be voice-inputted from the mail voice-related table 134 and uses the voice synthesizing device (not shown). The voice guidance that prompts the user to utter a message and the voice guidance that prompts the user to press a push button after the completion of the utterance of one message are read out from the voice storage device 14 and converted to voice. The voice processing unit 135, the data communication processing unit 137,
Service communication control unit 131, communication network 12, communication processing unit 1
14. The data is transmitted to the e-mail processing unit 111 via the data communication unit 112 and the voice communication unit 113 in this order. Therefore, the voice guidance needs to be stored in the voice storage device 14 in advance. The audio communication unit 113 outputs these pieces of information using an audio output device (not shown) such as an attached speaker.

The user utters a message to be added to the electronic mail corresponding to the information such as the identifier and the title according to the voice guidance (step S708). The message uttered by the user is input to the e-mail processing unit 111 through a voice input device (not shown) such as an attached microphone. , The service communication control unit 131, the data communication processing unit 137, and the voice processing unit 135 via the voice information processing unit 13 in this order.
6 and stored in the voice storage device 14 by the voice information processing unit 136 (step S714).

When the utterance of one message ends, the user operates the push button according to the voice guidance. By this operation, the push tone signal is input to the e-mail processing unit 111, and the voice communication unit 113, the data communication unit 112, and the communication processing unit 1
14, the communication network 12, the service communication control unit 131, the data communication processing unit 137, and the voice processing unit 135 are transmitted to the voice information processing unit 136 in this order. Is detected. As a result, the state shifts to the next e-mail reception state. The processing flow includes steps S705 and S710
Then, the voice communication unit 113 and the voice processing unit 135 cooperate to cancel the voice communication state. In this case, the data communication path remains connected without being disconnected. Next, the data communication unit 112 and the data communication processing unit 137 cooperate to switch from the voice communication state to the data communication state and shift to a state where the next e-mail can be transmitted.

The above operation is repeated for all e-mails including the tagged e-mail. From the mobile information terminal 11 for all e-mails to the e-mail service device 13
When the transmission to the e-mail service processing unit 13 is completed,
3 starts transmission of the e-mail stored in the storage unit (not shown) to the Internet 15. At this time, the e-mail service processing unit 133 refers to the information in the e-mail audio-related table 134 for the e-mail with the tag, extracts the corresponding audio information from the audio storage device 14, and extracts the audio information from the e-mail. Then, the electronic mail without the tag is transmitted to the Internet 15 without attaching the voice information (step S715). On the other hand, the portable information terminal 11 that has completed the transmission of the e-mail disconnects the secured communication path and data communication path (step S709).

As described above, by transmitting electronic mails one by one and inputting voice information each time, the structure of the management table is simplified and the management function is simplified.

Further, since the user performs voice input for each mail transmission, there is an effect that input arrangement of information is easy.

Embodiment 6 FIG. In the first to fifth embodiments, the method has been described in which all voice information is input, stored in the voice storage device, and then attached to an electronic mail and transmitted to the Internet 15. In the sixth embodiment, a description will be given of a form in which each time voice information is input, the voice information is attached to a corresponding electronic mail and transmitted to the Internet.

FIG. 5 is also used in the sixth embodiment.
FIG. 8 is a flowchart showing the operation of the sixth embodiment. Next, the operation of the sixth embodiment will be described with reference to FIGS.

The operations up to steps S605 and S610 are the same as in the fourth embodiment. The subsequent operation will be described. Each time one e-mail is created by the e-mail processing unit 111, this e-mail is sent from the e-mail processing unit 111 to the data communication unit 112 and the communication processing unit 11
4. E-mail service processing unit 1 via communication network 12, service communication control unit 131, data communication processing unit 137
33 (step S806).

Upon receiving one e-mail from portable information terminal 11 (step S811), e-mail service processing section 133 temporarily stores the e-mail in a storage section (not shown) and attaches a tag to the received e-mail. Check if it is. If the received e-mail does not have a tag, the e-mail is transmitted to the Internet 15 and the reception completion signal is simply notified to the e-mail processing unit 111 by the reverse route. If the received e-mail has a tag, the e-mail service processing unit 133
Registers information such as the e-mail identifier and title in the e-mail voice-related table 134 (step S81).
2) Activate the audio processing unit 135 and notify the e-mail processing unit 111 of a reception completion signal along the reverse route.

When the e-mail processing unit 111 transmits an untagged e-mail and receives an e-mail reception completion signal from the e-mail service processing unit 133, the e-mail processing unit 111 transmits the next e-mail to the e-mail processing unit 111. The data communication unit 112, the communication processing unit 114, the communication network 12, the service communication control unit 131, and the data communication processing unit 137 are transmitted to the e-mail service processing unit 133 in this order (step S206). The e-mail processing unit 11
1 transmits an e-mail with a tag and sends a reception completion signal of the e-mail to the e-mail service processing unit 133.
, The data processing unit 112 and the data communication processing unit 137 cooperate to cancel the data communication. In this case, the secured communication path and data communication path are connected without cutting. Next, the portable information terminal 11 activates the voice communication unit 113. The voice communication unit 113 cooperates with the voice processing unit 135 of the e-mail service device 13 to enter a voice communication state (in this case, not a voice communication state using a voice communication path but a voice communication state using a data communication path). The process proceeds (steps S807 and S813).

When the voice communication state is established, the voice information processing unit 136 reads information such as the identifier and title of the electronic mail to be voice-inputted from the mail voice-related table 134, and uses a voice synthesizer (not shown) for the information. The voice guidance that prompts the user to utter a message and the voice guidance that prompts the user to press a push button after the completion of the utterance of one message are read out from the voice storage device 14 and converted to voice. Along with information such as the email title converted to
The voice processing unit 135, the data communication processing unit 137, the service communication control unit 131, the communication network 12, the communication processing unit 114, the data communication unit 112, and the voice communication unit 113 are transmitted to the electronic mail processing unit 111 in this order. Therefore, the voice guidance needs to be stored in the voice storage device 14 in advance.

The e-mail processing unit 111 outputs these pieces of information by using an audio output device (not shown) such as an attached speaker. According to the voice guidance, the user utters a message to be added to the e-mail corresponding to the information such as the e-mail identifier and the title (step S).
808). The message uttered by the user is input to the e-mail processing unit 111 through a voice input device (not shown) such as an attached microphone.
4, the communication network 12, the service communication control unit 131, the data communication control unit 137, and the voice processing unit 135 are transmitted to the voice information processing unit 136 in this order, and the voice information processing unit 13
6 is stored in the voice storage device 14 (step S6).
814).

When the utterance of one message is completed, the user operates the push button according to the voice guidance. By this operation, the push tone signal is input to the e-mail processing unit 111, and the voice communication unit 113, the data communication unit 112, and the communication processing unit 1
14, the communication network 12, the service communication control unit 131, the data communication processing unit 137, and the voice processing unit 135 are transmitted to the voice information processing unit 136 in this order, and the electronic mail service device 13 inputs the voice information of the electronic mail. Is detected. As a result, the electronic mail service processing unit 133 extracts the audio information from the audio information storage device 14, attaches the audio information to the electronic mail with the tag, and transmits the electronic mail to the Internet 15. Further, the state shifts to the next e-mail reception state. The processing flow is step S6
05, returning to S610, the voice communication unit 113 and the voice processing unit 135 cooperate to cancel the voice communication state. Next, the data communication unit 112 and the data communication processing unit 137 cooperate to switch from the voice communication state to the data communication state and shift to a state in which the next e-mail can be transmitted and received.

The above operation is repeated until transmission of all e-mails including the e-mail with the tag is completed. When the transmission of all e-mails is completed, the portable information terminal 11
Disconnects the secured communication path and data communication path (step S809).

As described above, every time voice information is input, the voice information is attached to the corresponding e-mail and transmitted to the Internet, thereby simplifying the configuration of the management table and the management function.

Further, in the first to fifth embodiments, in consideration of security, it is necessary to secure a capacity for a voice information message corresponding to all electronic mails. In this embodiment, however, the voice storage device includes: Since only a voice message corresponding to one e-mail needs to be prepared, the capacity of the voice storage device can be reduced.

It is also possible to output information such as an e-mail identifier from the e-mail service processing section directly to the voice information processing section without interposing the mail voice related table. In this case, the mail voice related table is not required, so that the configuration becomes simpler. Further, the processing speed is further increased by the absence of the mail voice related table.

Embodiment 7 FIG. In the first to sixth embodiments, the instruction for voice input is a push button operation for guidance. In the seventh embodiment, a mode in which voice information is input using a voice recognition function will be described.

FIG. 9 is a block diagram showing Embodiment 7 of the voice reply / transmission system for electronic mail of the portable information terminal according to the present invention. In the figure, the same reference numerals as those in FIG. 1 denote the same or corresponding parts. 901 is an electronic mail service device 13
And a voice recognition unit that recognizes voice information.

FIG. 10 is a flowchart showing the operation of the seventh embodiment. The operation of the seventh embodiment will be described with reference to FIGS. Step S207, S213
The operation up to this point is the same as in the first embodiment. Step S2
Operation after 08 will be described. The user utters a message in accordance with the voice guidance, and the message is input as voice information to the electronic mail processing unit 111 through a voice input device (not shown) such as an attached microphone. Part 1
14, the communication network 12, the service communication control unit 131, and the voice processing unit 135 are transmitted to the voice information processing unit 136 in this order. Upon receiving the voice information, the voice information processing unit 136 sends the voice information to the voice recognition unit 901. The speech recognition unit 901 stores an end message in a speech format in advance, and the speech recognition unit 901 sequentially inputs a message uttered by the user, and compares the voice message with a previously registered end message. If the result of the comparison does not match the end message, the voice storage device 1 does nothing.
No. 4 (step S1012).

Next, the user utters an end message according to the voice guidance. The end message is input as voice information to the electronic mail processing unit 111 through a voice input device (not shown) such as an attached microphone.
4, transmitted to the voice information processing unit 136 via the communication network 12, the service communication control unit 131, and the voice processing unit 135. Upon receiving the voice information, the voice information processing unit 136 sends the voice information to the voice recognition unit 901. Voice recognition unit 90
1 sequentially inputs a message uttered by the user, and compares the voice message with a pre-registered end message. If the result of the comparison is that the message matches the end message, an end signal is generated, and the e-mail service device 13 detects the end of the voice input. As a result, the state shifts to the next e-mail reception state.

The subsequent operation is the same as in the first embodiment.

In the first to sixth embodiments, when the user notifies the end of the voice input by operating the push button of the portable information terminal, it is necessary to change the attitude from the voice input attitude for the push button operation. This allows the user to notify the portable terminal of the completion of the voice input in the posture as it was when the voice was input, so that it is not necessary to change the portable information terminal from the voice input posture for the push button operation. Convenience is improved.

Embodiment 8 FIG. In the first to seventh embodiments, the voice information is input after the e-mail is transmitted to the e-mail service device. However, in the eighth embodiment, after the voice information is input, the e-mail is A mode for transmitting to the service device will be described.

FIG. 1 is also used in the eighth embodiment.
FIG. 11 is a flowchart showing the operation of the eighth embodiment. The operation of the eighth embodiment will be described with reference to FIGS. The e-mail processing unit 111 enables an operation of adding voice information prior to an e-mail operation.

The operation up to step S204 is the same as in the first embodiment. The subsequent operation will be described. If voice information is not attached to the e-mail, step S2
After 04, the process jumps to step S1107 and operates in the same manner as in the first embodiment. When the voice information is attached to the e-mail, if the communication path is secured in step S204, the voice communication unit 113 establishes a voice communication state on the secured communication path in cooperation with the voice processing unit 135 (step S1105,
S1110). Next, the voice information processing unit 136 extracts from the voice storage device 14 voice guidance that prompts the user to utter a message and voice guidance that prompts the user to press a push button after uttering one message. Control unit 131, communication network 12,
The data is transmitted to the e-mail processing unit 111 via the communication processing unit 114 and the voice communication unit 113. Therefore, the voice guidance needs to be stored in the voice storage device 14 in advance. The e-mail processing unit 111 outputs voice guidance using a voice generator (not shown) such as an attached speaker.

The user utters a message according to the voice guidance (step S1106). The message uttered by the user is input to the e-mail processing unit 111 through a voice input device (not shown) such as an attached microphone, and the e-mail processing unit 111 outputs a voice communication unit 113, a communication processing unit 114, and a communication network 12 (voice communication path). ), Is transmitted to the audio information processing unit 136 via the service communication control unit 131 and the audio processing unit 135 in this order.
The data is stored in the voice storage device 14 by the server 36 (step S1111).

When the utterance of the message is completed, the user presses the push button according to the voice guidance. As a result, the push tone signal is input to the e-mail processing unit 111, and the e-mail processing unit 111
13, communication processing unit 114, communication network 12 (voice communication path),
It is transmitted to the voice information processing unit 136 via the service communication control unit 131 and the voice processing unit 135, and the e-mail service device 13 detects the end of voice input. This allows
The electronic mail service device 13 shifts to an electronic mail input state. Voice information processing unit 13 that has received a voice message
No. 6 notifies the e-mail processing unit 111 of the reception completion signal through the reverse route.

When the e-mail processing unit 111 receives the voice message reception completion signal from the e-mail service device 13, the voice communication unit 113 and the voice processing unit 135 cooperate to cancel the voice communication state. Next, the data communication unit 112 and the data processing unit 132 cooperate to establish a data communication state. As a result, the state shifts from the voice communication state to the data communication state (steps S1107 and S1112).
The e-mail processing unit 111 switches the display on the display unit to an e-mail creation screen. Thus, the user performs an operation of inputting the next e-mail. Email processing unit 1
Numeral 11 creates the next e-mail based on this operation.

Next, the user performs an operation of transmitting the e-mail. By this operation, the e-mail processing unit 111
The e-mail created by the e-mail processing unit 1
11 to a data communication unit 112, a communication processing unit 114, a communication network 12 (data communication path), a service communication control unit 131,
The data is transmitted to the e-mail service processing unit 133 via the data processing unit 132 (step S1108). The e-mail processing unit 133 receives the e-mail (step S
1113), the voice information (indicating the voice message) stored in the voice storage device 14 is taken out, attached to the received e-mail and transmitted to the Internet 15 (step S1114), and the reception completion signal is inverted. The e-mail processing unit 111 is notified by a route.

When the e-mail processing unit 111 receives the e-mail reception completion signal, if the next e-mail is an e-mail to which voice information is to be added, steps S1105 and S1105 are performed.
Returning to step 1110, the processing shifts to switching to the voice call state and inputting voice information. In the case of an e-mail not to be added with voice information, the processing returns to steps S1107S and 1108 to shift to input and transmission of the next e-mail.

The above operation is repeated until all e-mails have been transmitted. When transmission of all e-mails is completed, the communication processing unit 11 and the service communication control unit 131 cooperate to disconnect the communication path.

As described above, the procedure for inputting necessary information is started. Unnecessary e-mails are sent to the e-mail service device assuming voice input. There is no need to delete it.

Embodiment 9 FIG. In the first to eighth embodiments, the information to be added is limited to audio. However, since portable information terminals with camera devices will increase in the future, input of video information integrated with not only audio but also moving images is performed. It is also possible to apply to. In this embodiment, input of video information integrated with the moving image will be described.

FIG. 12 is a block diagram showing a ninth embodiment of a voice reply / transmission system for electronic mail of a portable information terminal according to the present invention. In the figure, the same reference numerals as those in FIG. 1 denote the same or corresponding parts. Reference numeral 1213 denotes a video communication unit provided in the portable information terminal 11, and 1235 denotes the e-mail service device 1.
3 is a video processing unit that controls communication of video information in cooperation with the video communication unit 1213, and 124 is a video storage device. Note that the voice storage device 14 and the voice communication unit 1
13, the audio processing unit 135 and the audio information processing unit 136 are not shown in the figure due to space limitations, but are assumed to be present.

FIG. 13 is a flowchart showing the ninth embodiment. Next, the operation of the ninth embodiment will be described with reference to FIG.
This will be described with reference to FIG. The user of the portable information terminal 11 creates an e-mail using the function of the e-mail processing unit 111 or displays a received reply mail or transfer e-mail on the screen of the portable information terminal 11 to create a response e-mail. (Step S201). Next, the user performs an operation of inputting a source address, a destination address, a title, a text, and the like in text with a small keyboard, a pen, and a push button with respect to the e-mail currently being operated. By this input operation, the e-mail processing unit 1
11 inputs these pieces of information into an e-mail and temporarily stores the information in the e-mail processing unit 111 (step S202).

Next, the user enters the e-mail processing unit 111
, The sender's address, destination address, title, text, etc. are input as text to the target mail using a small keyboard, pen, or push button. The information is temporarily stored in the electronic mail processing unit 111 by this input operation (step S202).
In addition, the user performs an operation indicating the fact to the mail to which the video information is added among the e-mails transmitted using the function of the e-mail processing unit 111. Thereby, the e-mail processing unit 111 attaches a tag (mark) to the e-mail indicating that the e-mail currently being operated is an e-mail to which video information should be added (step S130).
3).

When the user instructs the portable information terminal 11 to transmit an e-mail, the communication processing unit 114 of the portable information terminal 11 transmits the e-mail to the electronic mail service device 13 on the communication network 12 side.
A communication path is secured in cooperation with the service communication control unit 131 provided in (step S204). Next, the data communication unit 112 and the data processing unit 132 cooperate to establish a data communication state (steps S205 and S210). Since then
Data communication can be performed between the portable information terminal 11 and the electronic mail service device 13 using this data communication path.

When the data communication state is established, the e-mail created by the e-mail processing unit 111 is sent from the e-mail processing unit 111 to the data communication unit 112 and the communication processing unit 1
14, the communication network 12, the service communication control unit 131, and the data processing unit 132 are transmitted to the electronic mail service processing unit 133 in this order (step S206). Upon receiving the e-mail sent from the e-mail processing unit 111 of the portable information terminal 11 (step S211), the e-mail service processing unit 133 stores the received e-mail in a storage unit (not shown), and Check if is tagged. If no tag is attached to the received e-mail, a reception completion signal is simply sent to the e-mail processing unit 111 by a reverse route. If the received e-mail has a tag, information such as the identifier and title of the e-mail is registered in the e-mail video related table 934 (step S1312), and the reception completion signal is sent to the e-mail processing by the reverse route. Notify section 111.

When the e-mail processing unit 111 receives the e-mail reception completion signal from the e-mail service processing unit 133, the e-mail processing unit 111 transmits the next e-mail created by the e-mail processing unit 111 to the data communication unit 112. , The communication processing unit 114, the communication network 12, the service communication control unit 131, and the data processing unit 132 are transmitted in this order to the e-mail service processing unit 133 (step S1306).

When receiving the e-mail sent from the e-mail processing unit 111 of the portable information terminal 11 (step S211), the e-mail service processing unit 133 accumulates the received e-mail in a storage unit (not shown) and receives the e-mail. Check if the e-mail you have tagged is tagged. If no tag is attached to the received e-mail, a reception completion signal is simply sent to the e-mail processing unit 111 through the reverse route. If the email you receive is tagged,
Information such as the e-mail identifier and title is registered in the e-mail video related table 1234 (step S13).
12) Further, the electronic mail processing unit 111 is notified of a reception completion signal by the reverse route.

The above operation is repeated until all electronic mails are transmitted from the portable information terminal 11 to the electronic mail service device 13.

When the e-mail processing unit 111 transmits the last e-mail and receives an e-mail reception completion signal from the e-mail service processing unit 133, the portable information terminal 11 confirms that all e-mails have been transmitted. Is detected. Next, the data communication unit 112 cancels the data communication state in cooperation with the data processing unit 132 of the electronic mail service device 13. In this case, the data communication path is cut off, but the communication path is not cut off and is maintained. next,
The voice communication unit 113 (not shown) cooperates with the voice processing unit 135 (not shown) of the e-mail service device 13 to establish a voice call state. Therefore, the state shifts from the data communication state to the voice communication state (steps S1307 and S131).
3). Thereafter, the portable information terminal 1 is connected to the voice communication path.
1 and the e-mail service device 13 can perform voice communication.

When the voice communication state is established, the voice information processing section 136 (not shown) sends the mail video related table 1
234 reads information such as the title and identifier of an electronic mail to be input video information, converts the information into voice using a voice synthesizer (not shown), and further prompts the user to input video information. The voice guidance and the voice guidance urging the user to press the push button after the input of one piece of video information are read out from the voice storage device 14 (not shown), and the voice and the information such as the e-mail identifier and the title are converted into voice. Processing unit 13
5 (not shown), service communication processing unit 131, communication network 1
2. Communication processing unit 114, voice communication unit 113 (not shown)
To the e-mail processing unit 111 via. Therefore, this voice guidance needs to be stored in advance in the voice storage device 14 (not shown).

The e-mail processing section 111 outputs these pieces of information by using an audio output device (not shown) such as an attached speaker. In accordance with the voice guidance, the user shoots using a video camera or the like to input video information to be added to the e-mail corresponding to the information such as the e-mail identifier and the title (step S130).
8). The video information from the video camera is input to the e-mail processing unit 111, and after being compressed by the e-mail processing unit 111, the video communication unit 1213, the communication processing unit 114, the communication network 12, the service communication control The information is transmitted to the video information processing unit 1236 via the unit 131 and the video processing unit 1235 in this order, and is stored in the video storage device 124 by the video information processing unit 1236 (step S1314).

When one video information input is completed, the user operates the push button according to the voice guidance.
By this operation, the push tone signal is input to the e-mail processing unit 111, and from the e-mail processing unit 111, the voice communication unit 113 (not shown), the communication processing unit 114, the communication network 12, the service communication control unit 131, the voice processing Part 135
(Not shown) in this order through the audio information processing unit 136.
(Not shown) and sent to the e-mail service device 13.
Detects that the input of the video information of the e-mail has been completed. Thereby, the state shifts to the input state of the video information of the next e-mail.

The voice information processing unit 136 (not shown) reads information such as the identifier and title of the next electronic mail to be voice-input from the mail / video-related table 1234, and uses the voice synthesizing device to read the information. The voice guidance that converts the voice into voice and prompts the user to input video information and the voice guidance that prompts the user to press a push button after one video input is read out from the voice storage device 14 (not shown). Together with information such as an electronic mail identifier and a title converted into voice, a voice processing unit 135 (not shown), and a service communication control unit 13.
1, communication network 12, communication processing unit 114, voice communication unit 113
(Not shown) via the electronic mail processing unit 11 in this order.
Send to 1.

The e-mail processing unit 111 outputs these pieces of information by using an audio output device (not shown) such as an attached speaker. In accordance with the voice guidance, the user shoots using a video camera or the like to input video information to be added to the e-mail corresponding to the information such as the e-mail identifier and the title (step S130).
8). The video information from the video camera is input to the e-mail processing unit 111, and after being compressed by the e-mail processing unit 111, the video communication unit 1213, the communication processing unit 114, the communication network 12, the service communication control The information is transmitted to the video information processing unit 1236 via the unit 131 and the video processing unit 1235 in this order, and is stored in the video storage device 124 by the video information processing unit 1236 (step S1314).

When one video information input is completed, the user operates the push button according to the voice guidance.
By this operation, the push tone signal is input to the e-mail processing unit 111, and from the e-mail processing unit 111, the voice communication unit 113 (not shown), the communication processing unit 114, the communication network 12, the service communication control unit 131, the voice processing Part 135
(Not shown) in this order through the audio information processing unit 136.
The e-mail service device 13 detects that video information input of the e-mail has been completed. Thereby, the state shifts to the input state of the video information of the next e-mail.

When the above operations are repeated and input of all video information is completed, the audio information processing unit 136 notifies the electronic mail service processing unit 133 that all record information of the mail audio related table 134 has been read. Thereby, the e-mail service processing unit 133 starts transmitting the stored e-mail to the Internet 15.
When transmitting the e-mail to the Internet, the e-mail service processing unit 133 refers to the information in the e-mail video related table 1234 based on information such as the e-mail identifier and the title for the e-mail with the tag, The corresponding video information is extracted from the video storage device 124, and the video information is attached to an electronic mail and transmitted to the Internet 15. The electronic mail without the tag is transmitted to the Internet 15 without attaching the video information (step S1315). On the other hand, the portable information terminal 11 that has completed the transmission of the e-mail disconnects the secured communication path (step S1309).

In the above example, video information is transmitted and received while the voice communication state is established, but it is also possible to transmit and receive video information while the data communication state is established.

As a result, the video information requiring a larger storage capacity than the voice information is stored in the electronic mail service device on the network side, so that the portable information terminal has no storage function and attaches the voice information and the image information to the electronic mail. Can be sent.

Embodiment 10 FIG. In Embodiments 1 to 9,
The system is assumed to be transmitted from a mobile information terminal,
By reversing the procedure, it can function even if the receiving side is a portable information terminal. In the tenth embodiment, a mode in which this procedure is reversed will be described.

FIG. 1 is also used in this embodiment. FIG. 14 is a flow chart showing a tenth embodiment of a voice reply / transmission system for electronic mail of a portable information terminal according to the present invention.

When the e-mail service processing unit 133 of the e-mail service device 13 receives the e-mail from the Internet 15, the e-mail is temporarily stored in a storage unit (not shown), and the e-mail has voice information. Check if not. If no voice information is attached, the data processing unit 13 informs that the e-mail has been received.
2. Notify the e-mail processing unit 111 via the service communication control unit 131, the communication network 12, the communication processing unit 114, and the data communication unit 112. When voice information is attached to the e-mail, information such as an identifier of the e-mail is set in the mail voice-related table 134, the attached voice information is stored in the voice storage device 14, and furthermore, Tag with audio information,
The reception of the e-mail with the voice information is notified to the e-mail processing unit 111 via the data processing unit 132, the service communication control unit 131, the communication network 12, the communication processing unit 114, and the data communication unit 112 (step S1401). ).

Next, the service communication control section 131 secures a communication path in cooperation with the communication processing section 114 (step S1).
402, S1408). Further, the data processing unit 132 establishes a data communication state on a communication path in cooperation with the data communication unit 112 of the portable information terminal 11 (step S1403,
S1409). Next, the e-mail service processing unit 133
Transmits the e-mail received from the Internet 15 to the portable information terminal side. This e-mail is sent to the data processing unit 1
32, the service communication control unit 131, the communication network 12, the communication processing unit 114, and the data communication unit 112 are transmitted to the electronic mail processing unit 111 in this order, and stored in a storage unit (not shown) (steps S1404 and S1410). . When displaying the e-mail received by the user's access on the screen, the e-mail processing unit 111 also displays information indicating that voice information is attached to the e-mail if the e-mail has tag information. Display on the screen.

Next, when the user reads the contents of the e-mail on the screen and confirms that the e-mail has voice information attached thereto, the user performs an operation of accessing the attached file. By this operation, the e-mail processing unit 111 activates the voice communication unit 113. Next, the e-mail processing unit 111 transmits information such as an e-mail identifier and title to the data communication unit 112, the communication processing unit 114,
The data is transmitted to the e-mail service processing unit 133 via the communication network 12 and the service communication control unit 131. The e-mail service processing unit 133 transmits information such as the identifier and title of the received e-mail to the audio information processing unit 136. Next, the data communication unit 112 cancels the data communication state in cooperation with the data processing unit 132. in this case,
The communication path is secured without disconnection. Next, the voice communication unit 113 establishes a voice communication state in cooperation with the voice processing unit 135 (steps S1405 and S1411). When the voice communication state is established, the voice information processing unit 136 refers to the mail voice related table 134 based on the information such as the identifier and the title of the email received from the email service processing unit 133, and determines the voice corresponding to this information. The information is taken out from the audio storage device 14, and the audio processing unit 135,
Service communication control unit 131, communication network 12, communication processing unit 1
14. The data is transmitted to the electronic mail processing unit 111 via the voice communication unit 113 in this order (step S1406). The e-mail processing unit 111 outputs the received audio information as audio through an audio output device (not shown) such as an attached speaker.
This is shown to the user (step S1412). This allows the user to listen to audio information for each e-mail. On the other hand, the e-mail service device 13 disconnects the communication path (step S1407).

The operation performed when the electronic mail service apparatus receives an electronic mail with voice information attached from the Internet has been described above. The electronic mail service apparatus transmits an electronic mail with voice information attached in advance from a portable information terminal. , The voice information is stored in the voice storage device, and the operation is substantially the same when the user requests the voice information through the portable information terminal.

As described above, the voice information is stored in the electronic mail service device on the communication network side, so that the mobile information terminal does not need the storage resource of the voice information, and the voice information attached to the electronic mail can be heard. Becomes

In Embodiments 1, 2, 4 to 10,
The voice information processing unit includes a voice synthesis device, and the voice information processing unit 136 generates voice information corresponding to the e-mail identifier and the title acquired from the mail voice-related table 134 when the voice guidance is transmitted. ,
If the identifiers and titles of a plurality of e-mails used in the system can be predicted in advance, the audio information corresponding to the identifiers and titles of the e-mails is stored in advance in the
When the voice guidance is transmitted, the voice information processing unit 136 searches the voice storage device 14 using the identifier of the e-mail acquired from the mail voice-related table 134 as a search key, and outputs voice information of the corresponding identifier or title. May be taken out. This eliminates the need for a speech synthesizer, and enables the construction of a cheaper system.

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing Embodiment 1 of a voice reply / transmission system for a portable information terminal e-mail according to the present invention.

FIG. 2 is a flowchart showing an operation of the first embodiment of the portable information terminal e-mail voice reply / transmission system according to the present invention.

FIG. 3 is a flowchart showing Embodiment 2 of a voice reply / transmission system for electronic mail of a portable information terminal according to the present invention.

FIG. 4 is a flowchart showing an operation of a voice reply / transmission system for electronic mail of a portable information terminal according to a third embodiment of the present invention.

FIG. 5 is a configuration diagram showing a fourth embodiment of a voice reply / transmission system for electronic mail of a portable information terminal according to the present invention.

FIG. 6 is a flowchart showing an operation of a voice reply / transmission system for an electronic mail of a portable information terminal according to a fourth embodiment of the present invention.

FIG. 7 is a flowchart showing the operation of the fifth embodiment of the portable information terminal e-mail voice reply / transmission system according to the present invention.

FIG. 8 is a flowchart showing the operation of the sixth embodiment of the portable information terminal e-mail voice reply / transmission system according to the present invention.

FIG. 9 is a flowchart showing the operation of the seventh embodiment of the portable information terminal e-mail voice reply / transmission system according to the present invention.

FIG. 10 is a flowchart showing an operation of a portable information terminal electronic mail voice reply / transmission system according to a seventh embodiment of the present invention.

FIG. 11 is a configuration diagram showing Embodiment 8 of a voice reply / transmission system for electronic mail of a portable information terminal according to the present invention.

FIG. 12 is a flowchart showing an operation of the ninth embodiment of the voice reply / transmission system of the electronic mail of the portable information terminal according to the present invention.

FIG. 13 is a flowchart showing the operation of the ninth embodiment of the voice reply / transmission system of the electronic mail of the portable information terminal according to the present invention.

FIG. 14 is a flowchart showing Embodiment 10 of a voice reply / transmission system for electronic mail of a portable information terminal according to the present invention.

FIG. 15 is a configuration diagram of a conventional electronic mail storage and exchange system.

[Explanation of symbols]

REFERENCE SIGNS LIST 11 portable information terminal, 12 communication network, 13 e-mail service device, 14 voice storage device, 15 Internet, 101 e-mail storage and switching device, 1
02 message input / output processing unit, 103 mail terminal access processing unit, 104 message storage unit, 10
5 Correspondence table storage unit, 106 mailbox, 10
7 telephone, 108 facsimile machine (FAX),
109 mail terminal device, 111 e-mail processing unit, 112 data communication unit, 113 voice communication unit,
114 communication processing unit, 124 video storage device 13
1 service communication control unit, 132 data processing unit, 13
3 e-mail service processing unit, 134 mail voice-related table, 135 voice processing unit, 136 voice information processing unit, 901 voice recognition unit, 1213 video communication unit, 1234 mail video-related table, 1
235 video processing unit, 1236 video information processing unit.

Claims (23)

[Claims] 1. A portable information terminal, comprising: a portable information terminal capable of transmitting and receiving e-mail; and a portable information terminal capable of adding voice information as a function of a portable telephone communication network to an e-mail transmitted from the portable information terminal. Voice reply and transmission system. 2. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and an e-mail service device connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives e-mail processed by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device cooperates with the communication processing unit to transmit the second network. A service communication control unit for securing a communication path above, a data processing unit for transmitting and receiving e-mail in cooperation with the data communication unit, A voice processing unit that communicates voice information in cooperation with the unit, wherein the email processing unit attaches a tag to an email with voice information, and the email service processing unit sends a tag from the email processing unit. A voice reply / transmission system for a mobile information terminal e-mail, wherein when a received e-mail has a tag, voice information is added to the e-mail. 3. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives e-mail processed by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device cooperates with the communication processing unit to transmit the second network. A service communication control unit for securing a communication path, a data processing unit for transmitting and receiving an e-mail in cooperation with the data communication unit, A voice processing unit for communicating voice information in cooperation with a communication unit, a mail voice-related table for storing information such as an identifier of an email with voice information, a voice information processing unit, and a voice storage for storing voice information Means, the e-mail processing unit tags the e-mail with voice information, the e-mail service processing unit temporarily stores at least one e-mail received from the e-mail processing unit, The information such as the identifier of the tagged e-mail is stored in the e-mail voice-related table. The voice information processing unit reads the information such as the e-mail identifier from the e-mail voice-related table, and converts the information into voice Then, the voice-converted information and voice guidance for prompting voice input are transmitted to the portable information terminal. Receiving information such as an identifier and voice guidance and outputting the voice guidance to voice input / output means; inputting voice information from the voice input / output means and transmitting the voice information to the electronic mail service apparatus; and a voice information processing section of the electronic mail service apparatus. Stores the voice information received from the voice communication unit in the voice storage unit, and, in the case of a tagged email, the voice corresponding to the identifier of the email in the email voice-related table. A voice reply / transmission system for e-mail of a portable information terminal, wherein information is read from the voice storage means, and the voice information is added to the e-mail and transmitted to the first network. 4. An e-mail voice reply / transmission system for providing a mobile information terminal capable of transmitting and receiving e-mail and adding voice information as a function of a mobile telephone communication network to the e-mail transmitted from the mobile information terminal. A voice reply / transmission system for e-mail of portable information terminals that transmits voice to a communication network using a data communication function for information transmission. 5. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives the e-mail created by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device is configured to cooperate with the communication processing unit on the second network. A service communication control unit that secures a communication path, and a data communication path set on the communication path in cooperation with the data communication unit; A data processing unit for transmitting and receiving e-mail using the voice communication unit, and a voice processing unit for setting a voice communication path on the communication path in cooperation with the voice communication unit and communicating voice information using the voice communication path And a voice reply / transmission system for e-mail of a portable information terminal. 6. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and an e-mail service device connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives the e-mail created by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device is configured to cooperate with the communication processing unit on the second network. A service communication control unit that secures a communication path, and a data processing unit that sets a logical data communication path on the communication path in cooperation with the data communication unit. Portable information terminals email voice reply and transmission system, which comprises parts and, a voice processing unit which in conjunction with the voice communication unit performs communication of voice information using the data communication path. 7. A voice reply / transmission system for an electronic mail, comprising a mobile information terminal capable of transmitting and receiving an electronic mail, and adding voice information as a function of a mobile telephone communication network to the electronic mail transmitted from the mobile information terminal. A voice reply / transmission system for mobile information terminal e-mail that enables the operation of adding voice information for each e-mail. 8. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives e-mail processed by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device cooperates with the communication processing unit to transmit the second network. A service communication control unit for securing a communication path above, a data processing unit for transmitting and receiving e-mail in cooperation with the data communication unit, A voice processing unit that communicates voice information in cooperation with the unit, wherein the email processing unit attaches a tag to an email with voice information, and the email service processing unit sends a tag from the email processing unit. If the received e-mail is not tagged, the e-mail is sent to the first network as it is, and if the e-mail is tagged, voice information is added to the e-mail and the first network is added. A voice reply / transmission system for e-mail of a portable information terminal, which is transmitted to an e-mail. 9. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives e-mail processed by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device cooperates with the communication processing unit to transmit the second network. A service communication control unit for securing a communication path above, a data processing unit for transmitting and receiving e-mail in cooperation with the data communication unit, A voice processing unit that communicates voice information in cooperation with a unit, a mail voice-related table that stores information such as an identifier of an email with voice information, a voice storage unit that stores voice information, A voice information processing unit for storing voice data in a voice storage unit, wherein the email processing unit attaches a tag to an email with voice information, and the email service processing unit includes an email received from the email processing unit. If the e-mail is not tagged, the e-mail is sent to the first network as it is, and if the e-mail is tagged, information such as the e-mail identifier is stored in the e-mail audio-related table, The voice information processing unit reads information such as an e-mail identifier from the mail voice-related table, performs voice conversion on the information, and performs voice conversion on the information. The information and voice guidance prompting voice input are transmitted to the portable information terminal.The electronic mail processing unit of the portable information terminal receives the information such as the identifier and the voice guidance and outputs the information to the voice input / output unit. The voice information is input from the voice input / output unit and transmitted to the electronic mail service device. The voice information processing unit of the electronic mail service device stores the voice information received from the voice communication unit in the voice storage unit. The electronic mail service processing unit reads, from the audio storage unit, audio information corresponding to the electronic mail identifier in the electronic mail audio-related table in the case of an electronic mail with a tag, and adds the audio information to the electronic mail. And transmitting the electronic mail to the first network. 10. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and an e-mail service device connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives e-mail processed by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device cooperates with the communication processing unit to transmit the second network. A service communication control unit for securing a communication path above, a data processing unit for transmitting and receiving an e-mail in cooperation with the data communication unit, and the voice A voice processing unit that communicates voice information in cooperation with a communication unit, a mail voice related table that stores an identifier of an email with voice information, a voice information processing unit, and a voice storage unit that stores voice information. The email processing unit attaches a tag to the email with voice information, and the email service processing unit sends the email as it is to the first network if the received email is not tagged. Transmitting, if the e-mail has a tag, outputs information such as the e-mail identifier, and the voice information processing unit inputs the e-mail identifier and the like output from the e-mail service processing unit This information is voice-converted, and the voice-converted information and voice guidance for prompting voice input are transmitted to the portable information terminal. The mail processing unit receives the information such as the identifier and the voice guidance and outputs the voice guidance to the voice input / output unit, inputs voice information from the voice input / output unit and transmits the voice information to the electronic mail service device, The voice information processing unit stores the voice information received from the voice communication unit in the voice storage unit, and the electronic mail service processing unit, in the case of a tagged electronic mail, an identifier of the electronic mail in the mail audio related table A voice reply / transmission system for a portable information terminal e-mail, wherein voice information corresponding to the e-mail is read from the voice storage means, and the voice information is added to the e-mail and transmitted to the first network. 11. An electronic mail voice reply / transmission system for adding voice information as a function of a mobile phone communication network to an electronic mail transmitted from a mobile information terminal. A voice reply / transmission system for e-mail of a portable information terminal, which enables transmission. 12. An electronic mail voice reply / transmission system for adding voice information as a function of a mobile phone communication network to an electronic mail transmitted from a mobile information terminal, wherein voice recognition can be used for an operation of adding voice information. A voice reply / transmission system for e-mails of portable information terminals. 13. An e-mail voice reply / transmission system for adding voice information as a function of a mobile phone communication network to an e-mail transmitted from a portable information terminal, wherein an operation of adding voice information prior to a reply e-mail operation is performed. A voice reply / transmission system for e-mail of a portable information terminal, characterized in that it is made possible. 14. A voice reply / transmission system for an electronic mail of a portable information terminal, wherein image information such as video is added as a function of a mobile phone communication network to an electronic mail transmitted from the portable information terminal. 15. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives e-mail processed by the mail processing unit; and a video communication unit that sends and receives video information, wherein the e-mail service device cooperates with the communication processing unit to transmit the second network. A service communication control unit that secures a communication path above, a data processing unit that transmits and receives e-mail in cooperation with the data communication unit, A video processing unit for communicating video information in cooperation with a video communication unit, wherein the e-mail processing unit tags an e-mail with video information, and the e-mail service processing unit performs the e-mail processing. A voice reply / transmission system for a portable information terminal e-mail, characterized in that when an e-mail received from a section is tagged, video information received from the portable information terminal is added to the e-mail. 16. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. An electronic mail processing unit having a video input unit for performing processing such as creation, replying, and forwarding of an electronic mail, a communication processing unit, and the electronic mail. A data communication unit for transmitting and receiving the e-mail processed by the processing unit; and a video communication unit for transmitting and receiving the video information, wherein the e-mail service device is provided on the second network in cooperation with the communication processing unit. A service communication control unit for securing a communication path, a data processing unit for transmitting and receiving e-mail in cooperation with the data communication unit, A video processing unit for communicating video information in cooperation with a video communication unit; a mail video-related table for storing e-mail identifiers with video information; a video information processing unit; and a video storage unit for storing video information The e-mail processing unit tags the e-mail with the video information, the e-mail service processing unit accumulates the e-mail received from the e-mail processing unit, the tagged e-mail The e-mail processing unit inputs video information from a video input unit and transmits the video information to the video information processing unit, and stores the information such as an e-mail identifier in the e-mail video related table. The video information received from the mail processing unit is stored in the video storage unit, and the electronic mail service processing unit stores the electronic mail When transmitting to the first network, video information corresponding to information such as an e-mail identifier in the video-related table is read from the video storage means, and the video information is added to the e-mail corresponding to the identifier. Characterized by a voice reply / transmission system for e-mails of portable information terminals. 17. An electronic mail service device on the portable information communication network side stores voice information, and attaches voice information to an electronic mail with voice information every time an electronic mail is transmitted to a portable information terminal. A voice reply / transmission system for e-mails of portable information terminals. 18. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives e-mail processed by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device cooperates with the communication processing unit to transmit the second network. A service communication control unit for securing a communication path above, a data processing unit for transmitting and receiving an e-mail in cooperation with the data communication unit, and the voice A voice processing unit for communicating voice information in cooperation with a communication unit, wherein the email service processing unit stores email received from a network such as the Internet, and tags the email with voice information with a tag. Attached, the e-mail including the e-mail with a tag is transmitted to the e-mail processing unit on the portable information terminal side via the data processing unit,
When the electronic mail service processing unit receives a request for voice information from the electronic mail processing unit on the portable information terminal side,
A voice reply / transmission system for electronic mail of a portable information terminal, wherein voice information is added to an electronic mail with a tag and transmitted to the electronic mail processing unit. 19. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives e-mail processed by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device cooperates with the communication processing unit to transmit the second network. A service communication control unit for securing a communication path above, a data processing unit for transmitting and receiving an e-mail in cooperation with the data communication unit, and the voice A voice processing unit that communicates voice information in cooperation with a communication unit, a mail voice related table that stores an identifier of an email with voice information, a voice information processing unit, and a voice storage unit that stores voice information. The electronic mail service processing unit, if the electronic mail received from the network such as the Internet is an electronic mail with audio information, tag the electronic mail and send it to the electronic mail processing unit; Is stored in the voice information storage means, and information such as the identifier of the electronic mail with the voice information is stored in the mail voice related table, and the electronic mail service processing unit sends a request for the voice information from the electronic mail processing unit. If received, the voice information processing unit stores information such as an identifier of the electronic mail stored in the mail voice related table. The voice information is read, voice-converted, and voice information corresponding to the voice-converted information is extracted from the voice information storage unit and transmitted to the email processing unit. The email processing unit converts the voice information into voice. A voice reply / transmission system for an electronic mail of a portable information terminal, wherein the voice is output to the outside by using an input / output means. 20. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. And at least one portable information terminal, wherein the portable information terminal performs processing such as creation, reply, and transfer of an e-mail, and an e-mail processing unit including a voice input / output unit and a display unit; and a communication processing unit. A data communication unit that transmits and receives the e-mail processed by the e-mail processing unit, and a voice communication unit that transmits and receives voice information, the e-mail service device cooperates with the communication processing unit, A service communication control unit that secures a communication path on the second network, and a data processing unit that transmits and receives e-mail in cooperation with the data communication unit. A voice processing unit for communicating voice information in cooperation with the voice communication unit; a mail voice-related table for storing information such as an identifier of an email with voice information; a voice information processing unit; and storing voice information. A voice storage unit, wherein the email processing unit attaches a tag to the email with voice information, and the email service processing unit temporarily stores at least one email received from the email processing unit Then, information such as an identifier of an electronic mail with a tag is stored in the mail audio-related table, and the audio information processing unit reads information such as an identifier of the electronic mail from the mail audio-related table, and A voice guidance prompting voice input is transmitted to the portable information terminal, and the electronic mail processing unit of the portable information terminal transmits the information such as the identifier and the voice guidance. Receiving the dance, displaying the information such as the identifier on the display unit, outputting the voice guidance to voice input / output means, inputting voice information from the voice input / output means, and transmitting the voice information to the e-mail service device. The voice information processing unit of the electronic mail service device stores the voice information received from the voice communication unit in the voice storage unit, and the electronic mail service processing unit, in the case of an electronic mail with a tag, The voice information corresponding to the identifier of the email in the related table is read from the voice storage means, and the voice information is added to the email and transmitted to the first network. Voice reply and transmission system. 21. An e-mail service device connected to a first network such as the Internet and a second network such as a mobile phone communication network, and connected to the e-mail service device via the second network. An electronic mail processing unit that performs processing such as creation, replying, and forwarding of electronic mail and includes a voice input / output unit; a communication processing unit; A data communication unit that sends and receives e-mail processed by the mail processing unit; and a voice communication unit that sends and receives voice information, wherein the e-mail service device cooperates with the communication processing unit to transmit the second network. A service communication control unit for securing a communication path, a data processing unit for transmitting and receiving an e-mail in cooperation with the data communication unit, A voice processing unit for communicating voice information in cooperation with a communication unit; a mail voice related table for storing information such as an identifier of an electronic mail with voice information; a voice information processing unit; and a voice storage for storing voice information Means, the e-mail processing unit tags the e-mail with voice information, the e-mail service processing unit temporarily stores at least one e-mail received from the e-mail processing unit, The information such as the identifier of the tagged e-mail is stored in the e-mail voice-related table. The voice information processing unit reads the information such as the e-mail identifier from the e-mail voice-related table, and converts the information into voice Then, the voice-converted information and voice guidance for prompting voice input are transmitted to the portable information terminal, and the electronic mail processing unit of the portable information terminal Receiving the information such as the identifier and the voice guidance, outputting the voice guidance to the voice input / output means, inputting the voice information from the voice input / output means and transmitting the voice information to the electronic mail service device, The unit stores the voice information received from the voice communication unit in the voice storage unit, and the electronic mail service processing unit corresponds to an electronic mail identifier in the mail voice related table in the case of a tagged electronic mail. The voice information is read out from the voice storage means, the voice information is added to the electronic mail and transmitted to the first network, and the untagged e-mail received before receiving the first tagged e-mail is received. A voice reply / transmission system for a mobile information terminal e-mail, which is sequentially transmitted to the first network. 22. A voice information processing section comprising voice synthesis means, which converts information such as an electronic mail identifier read from a mail voice-related table by the voice information processing section into voice when voice guidance is transmitted. 22. The voice reply / transmission system for electronic mail of a portable information terminal according to claim 3, wherein: 23. The voice storage means stores voice information corresponding to at least one electronic mail identifier or title, and searches the electronic mail identifier read from the mail voice-related table by the voice information processing unit at the time of transmitting voice guidance. The voice conversion is performed by retrieving the voice storage means and extracting voice information of information such as a corresponding electronic mail identifier.
22. A voice reply / transmission system for a portable information terminal e-mail according to any one of items 9 and 21.