JPH0548750A - Multi-media communication system - Google Patents

Abstract

PURPOSE:To display and record a transmitting signal and a receiving signal by individual speech recognition and conversion into character code data, to record and output the received signal by translation into another language, and improve the recognition rate and usability when a voice signal is made into a document by a function for editing the character code data as to the multi-media communication system. CONSTITUTION:The transmitting signal which is inputted to the telephone part of a communication control part 7 is inputted to a speech recognition unit 6 as well and the speech recognition unit 6 recognizes and converts the transmitting signal into character codes. Further, the receiving signal which is transmitted through a line is inputted to the speech recognition part 6 as well and the speech recognition unit 6 recognizes and converts the receiving signal into character codes. The character code data obtained by the speech recognition unit 6 are stored in a voice conversion character data memory 6, and displayed on a display unit 11 and printed out on a printer 13 by operator's operation when necessary.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia communication system, and more particularly to a multimedia communication system for converting a voice signal to be transmitted / received into character code data to display or record / edit.

[0002]

2. Description of the Related Art As a conventional communication terminal having a multimedia function, there is, for example, a telephone set described in Japanese Utility Model Laid-Open No. 2-35562. This telephone is based on a voice recognition device that converts a call signal into a character code and outputs the signal, a memory that stores the character code signal that the voice recognition device outputs, and a character code signal that is read from the memory. It is configured by a printing device that prints a speech signal, converts the speech signal into a character code by voice recognition, and prints out the character code so that the speech signal can be accurately recorded as a document.

[0003]

However, in such a conventional telephone having the multimedia function, when the voice is recognized as the call signal, the voice-transmitting signal and the voice-receiving signal are not separately recognized. Therefore, there is a problem in that voice recognition cannot be performed when the transmitted signal and the received signal overlap.

After converting the voice signal into a character code,
Since it was simply printed out, it was not considered to effectively use the converted character code for other purposes. Therefore, the present invention separately recognizes a transmission signal and a reception signal by voice and converts them into character code data to display or record and output, and also translates and converts the reception signal into another language and records and outputs it. An object of the present invention is to provide a multimedia communication system which has a function of editing code data and improves the recognition rate and the usability when a voice signal is documented.

[0005]

The invention according to claim 1 is
A voice recognizing means for recognizing a voice signal transmitted and received via a communication line into a voice signal and a voice signal separately, and converting each voice signal into character code data. In the invention described in 2, a voice recognition means for recognizing a voice signal transmitted / received via a communication line into a voice signal and a voice signal separately and converting each voice signal into character code data, and voice recognition. A memory for accumulating the character code data converted by the means, a display means for displaying the character code data accumulated in the memory, and a recording means for recording and outputting the character code data accumulated in the memory are provided to convert the voice signal. The character code data of the transmitted voice signal and the received voice signal is temporarily stored in a memory and then displayed or recorded and output. The invention according to claim 3 is the same as the invention according to claim 1, A translation means for translating the language of the received signal recognized by the voice recognition means into another language and converting it into character code data, a display means for displaying the character code data converted by the translation means, and a conversion means for the translation means. Recording means for recording and outputting the character code data, and displaying or recording and outputting the character code data translated and converted from the received signal, the invention according to claim 4 is the invention according to claim 1. In the above, a memory for storing the character code data converted by the voice recognition means and an editing means for editing the character code data stored in the memory are provided.

[0006]

According to the first aspect of the present invention, the voice signal transmitted / received through the communication line is separately recognized as the voice signal and the voice signal, and each voice signal is converted into character code data. Therefore, it is possible to improve the voice recognition rate when the transmission signal and the reception signal are mixed.

According to the second aspect of the present invention, the character code data of the transmission signal and the reception signal converted from the voice signal is temporarily stored in the memory and then displayed or recorded and output. Therefore, it is possible to improve convenience such as confirmation and storage of call contents. According to the third aspect of the present invention, the received signal is translated and converted into character code data of another language and displayed or recorded and output. Therefore, when communicating with a foreign country, it is possible to realize a conversation with the partner communication terminal without learning the language of the country.

According to the fourth aspect of the invention, the function of editing the character code data stored in the memory is added. Therefore, it is possible to improve the convenience when storing and reusing the call contents.

[0009]

EXAMPLES The present invention will be specifically described below based on examples. 1 and 2 are diagrams showing an embodiment of a videophone to which the multimedia communication system according to claims 1 to 4 is applied. FIG. 1 is a block diagram of the video phone 1, which includes a system control unit 2, a RAM 3,
The translation unit 4, the voice conversion character data memory 5, the voice recognition unit 6, the communication control unit 7, the operation unit 8, the ROM 9, the display page memory 10, the display 11, the video camera 12, the printer 13, and the like.

The system control unit (editing means) 2 is a ROM
9, each unit is controlled in accordance with a program stored in 9 to perform voice recognition processing of the transmission / reception signal of the present invention, display of a character string converted by voice recognition, recording output, and voice conversion character data. The editing process of the character code data stored in the memory 5 is executed according to the instruction from the operation unit 8.

A RAM (Random Access Memory) 3 forms a memory area for temporarily storing various data when the system control unit 2 controls a communication protocol. The translation unit (translation means) 4 has a function of translating Japanese and English into each other, and converts the character string stored in the voice conversion character data memory 5 into a character string of another language.

Voice conversion character data memory (memory) 5
Stores the character string recognized by the speech recognition unit 6 as well as the character string converted by the translation unit 6 into another language. The voice recognition unit (voice recognition means) 6 separately performs voice recognition on the transmission signal and the reception signal transmitted and received by the communication control unit 7 and converts them into a character string.

A line, for example, a telephone line is connected to the communication control unit 7, and the communication control unit 7 sets / cancels a call and automatically performs an outgoing call operation and an incoming call operation, and a transmitted moving image signal. It modulates and demodulates the received video signal, controls the multiplexing of video data and audio data, and has a built-in telephone function. As shown in FIG. 2, the call section having the telephone function amplifies a voice signal input from the microphone 15 of the handset 14 by the amplifier 17 and outputs it as a transmission signal to the line by the hybrid transformer 18, and at the same time, the hybrid transformer. The received signal received from the line by 18 is amplified by the amplifier 19 and output to the speaker 16 of the receiver 14. Further, the communication control unit 7 and the voice recognition unit 6 are connected so that the transmission signal and the reception signal are also input to the voice recognition unit 6. Note that the communication control unit 7 of this embodiment needs a function of converting analog voice into digital voice when the connected line is ISDN or the like.
To simplify the explanation, the configuration is omitted.

The operation unit 8 is provided with a ten-key pad, various function keys, and the like, and performs various key input operations for executing the telephone number of the other party and the voice recognition processing of the present invention. RO
An M (Read Only Memory) 9 stores a control program executed by the system control unit 2. The display page memory 10 is a memory for displaying character data and the like on the display 11, and the display (display means) 11 displays moving images and character data.

The video camera 12 inputs the image of the speaker and the like, and the printer (recording means) 13 prints the character string and the like recognized by the voice recognition unit 6. Next, the operation will be described. The present embodiment is characterized in that the transmitted signal and the received signal are separately recognized and converted into a character string, and the converted character string is displayed, printed out, or edited.

First, a voice signal is input from the microphone 15 of the handset 14 to the communication unit of the communication control unit 7, amplified by the amplifier 17 and input to the hybrid transformer 18 as a transmission signal, and at the same time, to the voice recognition unit 6. Is also input, is recognized as a transmission signal by the voice recognition unit 6, and is converted into a character code. Further, the reception signal transmitted through the hybrid transformer 18 is amplified by the amplifier 19 and output from the speaker 16, and at the same time, is also input to the voice recognition unit 6 and recognized by the voice recognition unit 6 as a reception signal. Are converted to character codes.

The character code data thus converted by the voice recognition unit 6 is accumulated in the voice conversion character data memory 5, and is displayed on the display 11 or the printer as required by the operation of the operator from the operation unit 11. Print out from 13. When it is necessary to translate the character code string stored in the voice conversion character data memory 5 into another language, the character code string is sent to the translation unit 4 to be translated and converted into that language and converted into another language. The generated character code string is again stored in the voice conversion character data memory 5, and is displayed on the display 11 or printed out from the printer 13 as required by the operation of the operator from the operation unit 11. With this translation function, the contents of the call with the other party in different languages are displayed on the display 11 in the same language as the sender, so that the operator can understand the contents of the call by reading the displayed contents. Therefore, when calling overseas, it is possible to make a call without knowing the language of the other party.

When an editing instruction is input from the operation unit 8 after the call ends, the system control unit 2 deletes unnecessary portions of the character code data stored in the voice conversion character data memory 5 and changes the layout. Is performed, and convenience is improved in recording call contents and the like. In this example,
Although the videophone 1 has been described, it is also possible to use the voice recognition function of the present invention in a multimedia terminal or the like to which a function such as a data communication function is added. It is also possible to use a method such as converting a character code into a character code by voice recognition, transmitting a data file composed of this character code string, and transmitting only the character data file instead of the voice to the other party.

[0019]

According to the invention described in claim 1, the voice signal transmitted / received through the communication line is recognized separately as the transmission signal and the reception signal, and each voice signal is converted into character code data. Therefore, it is possible to improve the voice recognition rate when the transmission signal and the reception signal are mixed.

According to the second aspect of the invention, the character code data of the transmission signal and the reception signal converted from the voice signal are temporarily stored in the memory and then displayed or recorded and output. The convenience of confirmation and storage can be improved. According to the invention of claim 3, since the received signal is translated and converted into the character code data of another language and displayed or recorded and output, the other party does not have to learn the language of that country when communicating with a foreign country. A conversation with a communication terminal can be realized.

According to the fourth aspect of the present invention, since the function of editing the character code data stored in the memory is added, it is possible to improve the convenience in saving and reusing the call contents. ..

[Brief description of drawings]

FIG. 1 is a block diagram of a videophone to which a multimedia communication system according to the first to fourth aspects of the invention is applied.

FIG. 2 is a block diagram of a call unit built in the communication control unit of FIG.

[Explanation of symbols]

 1 Videophone 2 System control unit 3 RAM 4 Translation unit 5 Voice conversion character data memory 6 Voice recognition unit 7 Communication control unit 8 Operation unit 9 ROM 10 Display page memory 11 Display 12 Video camera 13 Printer 14 Handset

Claims (4)

[Claims] 1. A voice recognition means for recognizing a voice signal transmitted / received via a communication line into a voice signal and a voice signal separately, and converting each voice signal into character code data. Characteristic multimedia communication system. 2. A voice recognition means for separately recognizing a voice signal transmitted and received via a communication line into a voice signal and a voice signal and converting each voice signal into character code data, and a voice recognition means. A memory for accumulating the character code data converted by the above, a display means for displaying the character code data accumulated in the memory, and a recording means for recording and outputting the character code data accumulated in the memory are provided, which are converted from the voice signal. A multimedia communication system characterized in that character code data of a transmission signal and a reception signal are temporarily stored in a memory and then displayed or recorded and output. 3. The invention according to claim 1, wherein the language of the received signal recognized by the voice recognition means is translated into another language and converted into character code data, and a character converted by the translation means. A display means for displaying code data and a recording means for recording and outputting the character code data converted by the translating means are provided to display or record and output the character code data translated and converted from the received signal. Multimedia communication system. 4. The invention according to claim 1, further comprising a memory for storing the character code data converted by the voice recognition means, and an editing means for editing the character code data stored in the memory. Characteristic multimedia communication system.