JP2003008691A - Interactive transmission/reception method and system, and interactive transmission/reception terminal device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an interactive transmission/reception method and system, and interactive transmission/reception terminal device, which any users, not limiting to ones aurally challenged, can use anywhere. SOLUTION: In an interactive transmission/reception system, which receives character groups transmitted from a transmitting source with a communication means and recognizes them as texts with a character recognizing means and converts these texts into voice signals by voice synthesizer to transmit the signals to a transmission destination, the interactive transmission/reception system and the interactive transmission/reception terminal are equipped with a call device such as telephones used at the transmitting source, a voice/ character group mutual converter for converting voice transmitted from the transmitting source into character groups, a reception terminal for receiving signals converted into voice or character groups by the voice/character group converter.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an interactive transmission / reception method for converting a voice into a character group (including an image) or a character group into a voice, and using this method, particularly for visually or hearing impaired persons. The present invention relates to an interactive transmission / reception system capable of interactive communication, and an interactive transmission / reception terminal device which can be directly communicated by the visually and hearing impaired person himself / herself.

[0002]

2. Description of the Related Art As a conventional interactive communication method of this kind, a multimedia public telephone system for hearing impaired persons displays a voice signal with subtitles and a caller inputs a character group string. In some cases, the voice signal is converted into a voice signal and transmitted to the other party.

For example, in Japanese Unexamined Patent Publication No. 10-224520, a voice recognition device is used when voice of a caller is received by a voice signal receiving means through a communication system and subtitle reception is selected by a voice / character group conversion switch. The received voice signal is recognized, the recognized voice is converted into character group data by the voice recognition generation device, and the character group data is displayed on the display as a caption.

On the contrary, the character group string input by the caller is recognized and generated as a style by character group recognition, this style is converted into a voice signal by voice synthesis, and this voice signal is transmitted to the other party of the call via the communication system. And a multimedia public telephone system using a voice pattern dictionary or a character group pattern dictionary as a method for converting voice to character groups and vice versa. .

According to this multimedia public telephone system, a voice understanding system is added to the conventional multimedia public telephone function, the voice of the other party is converted into subtitles and displayed on the display, and the voice understanding function is added to the memo function. By adding the so that the characters written in the memo can be converted and transmitted to the caller, it is convenient for the hearing impaired to be able to have a telephone conversation by using the subtitles and voice conversion function.

[0006]

However, in the above-mentioned multimedia public telephone system, when a hearing impaired person or the like conducts a conversation using a telephone, it is limited for the deaf person to use a public telephone. It will be a place.

[0007] Not only limited public telephones for the hearing impaired, but also development of other communication means without location restrictions, and the user is not limited to the hearing impaired and can be used by anyone anywhere. It is required to provide an interactive transmission / reception method and system and an interactive transmission / reception terminal device.

The present invention has been made in consideration of the above-mentioned circumstances, and an interactive transmission / reception method and system by which even a handicapped person such as a hearing-impaired person can easily carry out conversations in an interactive manner anywhere. The main purpose is to provide an interactive transmission / reception terminal device.

Further, another object of the present invention is to provide an interactive transmission / reception method and system in which even a person with a disability such as a hearing-impaired person can participate in an interactive meeting or conversation at the time of a meeting or conversation in a meeting or a lesson. An object is to provide an interactive transmission / reception terminal device.

Further, another object of the present invention is to provide an interactive type suitable for interactive conversation even when the visitor is a hearing impaired person or the like in the conversation with the visitor in the reception work. It is to provide a transmission / reception method and system, and an interactive transmission / reception terminal device.

Still another object of the present invention is to provide an interactive transmission / reception method and system as well as an interactive transmission / reception terminal device capable of conducting a conversation from anywhere in a neighborhood without specifying a conversation place. Especially.

[0012]

To achieve the above object, according to the invention of claim 1, a voice signal transmitted from a telephone device such as a telephone is received by a communication means and converted into a character group. In the interactive transmission / reception method of recognizing the style as a style by the character recognition means for transmitting the style to an interactive transmission / reception terminal such as a PC, the voice is converted into a character group,
A step of displaying the converted character group on the display screen of the interactive transmission / reception terminal, and a step of transmitting / receiving the displayed character group by bidirectional communication to a slave terminal linked to the interactive transmission / reception terminal. A step of transmitting a response signal in the character group from the interactive transmission / reception terminal to the slave terminal, and a step of transmitting a response signal in the character group from the interactive transmission / reception terminal to the communication device. A voice signal transmitted from a telephone device, which is capable of responding by a voice signal from at least one of the interactive transmission / reception terminal and the slave terminal linked to the interactive transmission / reception terminal. An interactive transmission / reception method is provided.

Therefore, it is possible to provide an interactive transmission / reception method by which persons with disabilities such as hearing impaired persons and healthy persons can easily carry out interactive conversations anytime, anywhere.

To achieve the above object, according to the invention of claim 3, a character recognition means for receiving a voice signal transmitted from a telephone device such as a telephone by a communication means and converting it into a character group. According to the interactive transmission / reception method of recognizing as a style and transmitting this style to an interactive transmission / reception terminal such as a PC, the voice signal transmitted from the communication device is transmitted to the interactive transmission / reception terminal such as a PC, and the interactive transmission / reception terminal is transmitted. A step of transmitting a voice with an attached speaker; a step of converting the voice signal into a character group and displaying the converted character group on a display screen such as a CRT screen of the interactive transmission / reception terminal; There is provided an interactive transmission / reception method characterized in that communication contents can be recognized by at least one of a speaker and a display screen of the interactive transmission / reception terminal.

Therefore, it is possible to provide an interactive transmission / reception method by which persons with disabilities such as hearing impaired persons and healthy persons can easily carry out interactive conversations anytime, anywhere.

To achieve the above object, according to the invention of claim 4, a character recognition means for receiving a voice signal transmitted from a telephone device such as a telephone by a communication means and converting it into a character group. In the interactive transmission / reception method of recognizing as a style and transmitting this style to an interactive transmission / reception terminal such as a PC, a voice signal transmitted from a telephone device is converted into a character group, and the converted character group is converted into a plurality of character groups. A step of displaying on the display screen of the interactive transmission / reception terminal; a step of specifying one of the plurality of interactive transmission / reception terminals so that two-way communication with the communication device is possible; While the terminal is connected to the calling device and the two-way communication by the character group is performed, the step of simultaneously displaying the character group on the display screen of another interactive transmission / reception terminal is included. One It provides an interactive method of transmitting and receiving character group in the two-way communication in interactive transmission and reception terminals, characterized in that can be displayed in other interactive transmission and reception terminals of the display screen.

In order to achieve the above object, according to the invention of claim 5, a character for receiving a voice signal transmitted from a telephone device such as a plurality of telephones by a communication means and converting it into a character group. In the interactive transmission / reception method of recognizing a style by the recognition means and transmitting the style to a plurality of interactive transmission / reception terminals such as PCs, a voice signal transmitted from a specific telephone device is converted into a character group, and the character group is converted. Displaying a character group on a display screen such as a CRT screen of an interactive transmission / reception terminal, and when the character group is simultaneously transmitted from the specific calling device and another calling device, it is divided into the display screen such as the CRT screen. Or displaying them separately on the display screens of a plurality of interactive transmission / reception terminals; and when the character groups are transmitted from a plurality of telephone devices, the respective character groups are Deciphering the contents, determining a priority order for responding, and performing two-way communication from the interactive transmission / reception terminal in which the character group is displayed to the calling device according to the determined priority order, At least one interactive transmission / reception terminal capable of simultaneously receiving the respective character groups transmitted from the communication device is prepared, the priority of the dialogue is determined, and then the dialogue is performed according to the order. Provide a sending and receiving method.

Therefore, in the conversation with the visitor or the like in the reception work, it is possible to provide the interactive transmission / reception method suitable for the conversation in the interactive form even when the visitor or the like is a handicapped person or the like.

In order to achieve the above object, according to the invention of claim 8, a character recognition means for receiving a voice signal transmitted from a telephone device such as a telephone by a communication means and converting it into a character group. In the interactive transmission / reception system that recognizes as a style and transmits this style to an interactive transmission / reception terminal such as a PC, a voice / character group mutual conversion device for mutually converting a voice signal transmitted from the communication device into a character group. When,
An interactive transmission / reception terminal for receiving a signal converted into a character group or a voice by the voice / character group mutual conversion device, and integrating the voice / character group mutual conversion device and the interactive transmission / reception terminal An interactive transmission / reception system characterized by comprising a transmission / reception terminal with a character mutual conversion function.

Therefore, it is possible to provide an interactive transmission / reception system in which a disabled person such as a hearing-impaired person or a normal person can easily carry out interactive conversations anytime, anywhere.

To achieve the above object, according to the invention of claim 9, a character recognition means for receiving a voice signal transmitted from a telephone device such as a telephone by a communication means and converting it into a character group. In the interactive transmission / reception system that recognizes as a style and transmits the style to an interactive transmission / reception terminal such as a PC, a voice / character group mutual conversion device for converting a voice signal transmitted from the communication device into a character group, A conversion character group signal is transmitted from the voice / character group mutual conversion device, and an interactive transmission / reception terminal that receives the conversion character group signal and displays the character group on the display screen is provided. The conversion device includes a voice / character group conversion device that mutually converts voice into a character group and a character group / voice conversion device that converts characters into voice, and the voice / character group conversion device includes:
A transceiver that receives a voice signal and transmits the voice signal, a voice recognizer that receives the voice signal transmitted from the transceiver and transmits a voice recognition signal, and a voice recognition signal that receives the voice recognition signal. A voice / character including a character conversion unit for transmitting a converted character group signal, wherein the interactive transmission / reception terminal includes a display screen such as a CRT screen, a microphone attached to the interactive transmission / reception terminal, a character group input keyboard, and a speaker attached to the interactive transmission / reception terminal. An interactive transmission / reception system characterized by being a transmission / reception terminal with a group mutual conversion function.

Therefore, it is possible to provide an interactive transmission / reception system in which a disabled person such as a hearing-impaired person or a normal person can easily carry out interactive conversations anytime, anywhere.

To achieve the above object, according to the invention of claim 10, a character recognition means for receiving a voice signal transmitted from a telephone device such as a telephone by a communication means and converting it into a character group. In the interactive transmission / reception system that recognizes the style as a style and transmits the style to an interactive transmission / reception terminal such as a PC, a voice character group conversion device for converting a voice signal transmitted from the communication device into a character group, and An interactive transmission / reception terminal provided with a display screen such as a CRT screen provided to display a group of characters, a slave terminal such as a plurality of mobile phones, etc., for bidirectional communication linked with the interactive transmission / reception terminal. An interactive transmission / reception terminal such as the PC and the PC for the voice signal transmitted from the communication device
It is possible to provide an interactive transmission / reception system characterized in that at least one of the interactive transmission / reception terminals of the slave terminals linked to the interactive transmission / reception terminal such as can respond by a voice signal.

In order to achieve the above object, according to the invention of claim 11, as a style, by a character recognition means for receiving a voice signal transmitted from a telephone device by a communication means and converting it into a character group. In an interactive transmission / reception system that recognizes and transmits this style to an interactive transmission / reception terminal, an interactive transmission / reception terminal equipped with a speaker attached to the interactive transmission / reception terminal, which receives a voice signal transmitted from the communication device and transmits the voice signal, A voice / character group conversion device for converting a voice signal into a character group, and an interactive transmission / reception terminal having a display screen such as a CRT screen for displaying the character group, and output from the speaker attached to the interactive transmission / reception terminal. An interactive transmission / reception system characterized in that the content of the dialogue can be recognized by at least one of a voice and a character group displayed on the display screen. To provide.

Therefore, it is possible to provide an interactive transmission / reception system in which persons with disabilities such as hearing impaired persons and healthy persons can easily carry out interactive conversations anytime, anywhere.

In order to achieve the above object, according to the invention of claim 12, the character recognition means for receiving the voice signal transmitted from the telephone equipment by the communication means and converting it into the character group is converted into a style. In an interactive transmission / reception system that recognizes and transmits this style to an interactive transmission / reception terminal, converts a voice signal transmitted from the communication device into a character group,
A plurality of interactive transmission / reception terminals for displaying the converted character group on a display screen such as a CRT screen, and an interactive transmission / reception in which one of the plurality of interactive transmission / reception terminals capable of bidirectional communication with the communication device is specified While the interactive transmission / reception terminal is connected to a telephone device and is performing bidirectional communication by a character group, the character group is simultaneously displayed on a display screen such as a CRT screen of another interactive transmission / reception terminal. An interactive transmission / reception system characterized by being displayed can be provided.

Therefore, it is possible to provide an interactive transmission / reception system suitable for a conference or a conversation in an interactive manner by persons with disabilities such as hearing impaired persons when conducting a conference or a conversation in a conference or a classroom.

In order to achieve the above object, according to the invention of claim 13, the character recognition means for receiving the voice signals transmitted from the plurality of telephone devices by the communication means and converting them into the character group, In an interactive transmission / reception system that recognizes as a style and transmits this style to a plurality of interactive transmission / reception terminals, a voice signal transmitted from a specific telephone device can be converted into a character group, and the converted character group can be displayed. CR
When a character group is simultaneously transmitted from a specific PC having a display screen such as a T screen and the specific calling device and another calling device, does it have a display screen that can be displayed separately in one display screen? , Or a plurality of interactive transmission / reception terminals provided so that a plurality of display screens are provided, and one or a plurality of interactive transmission / reception terminals capable of simultaneously receiving a character group transmitted from a plurality of communication devices are prepared, (EN) Provided is an interactive transmission / reception system characterized in that after a priority of a dialogue is decided, the dialogue can be made in accordance with the above-mentioned order.

Therefore, in the conversation with the visitor or the like in the reception work, it is possible to provide the interactive transmission / reception system suitable for the conversation in the interactive form even when the visitor or the like is a handicapped person or the like.

In order to achieve the above-mentioned object, according to the invention of claim 14, a character recognition means for receiving a voice signal transmitted from a telephone device by a communication means and converting it into a character group is used as a style. In an interactive transmission / reception system which recognizes and transmits this style to an interactive transmission / reception terminal, a voice / character group mutual conversion device for mutually converting a voice signal transmitted from the communication device into a character group, and this voice / character group A conversion character group signal is transmitted from the mutual conversion device, the conversion character group signal is received, and an interactive transmission / reception terminal that displays a character group on a display screen such as a CRT screen is provided. A PC equipped with a display screen, a microphone attached to the interactive transmission / reception terminal, a character group input keyboard and a speaker attached to the interactive transmission / reception terminal. Equipped with a connectable voice / character mutual converter and a receiver provided to physically overlap the voice / character mutual converter so that the sound emitted by direct sound waves can be transmitted and received. An interactive transmission / reception terminal device is provided.

Therefore, the dialogue place is not specified,
It is possible to provide an interactive transmission / reception terminal device that enables conversation from anywhere in the neighborhood.

[0032]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of an interactive transmission / reception method and system and an interactive transmission / reception terminal device according to the present invention will be described with reference to the drawings.

FIG. 1 shows an embodiment of an interactive transmission / reception system according to the present invention. This interactive transmission / reception system is mainly composed of three devices: a telephone device 1, a voice / character group mutual conversion device 2 and an interactive transmission / reception terminal 3.

The calling device 1 includes a telephone set 4 used by the calling party M, a headphone type transceiver 5 used by the instructor T for a plurality of students, and a speaker combination type microphone 6 used by the visitor H. It is a transceiver.

The telephone 4 and the speaker combination type microphone 6 are connected to the voice / character group mutual conversion device 2 by a telephone line 7 and a communication cable 8.

The headphone type transceiver 5 is connected to the voice / character group mutual conversion device 2 via a Bluetooth communication radio wave F based on the Bluetooth wireless communication system.

Bluetooth is a radio communication system having a transmission rate of 1 Mbps, which uses a frequency called the ISM band in the 2.4 GHz band and employs a spread spectrum system which performs frequency hopping at 1600 times per second.

Such a Bluetooth wireless communication system is within a range of about 10 meters from the communication port by using the Bluetooth communication radio wave F and is suitable for communication between a plurality of communication objects. It is suitable as an interactive tool for.

The voice / character group mutual conversion device 2 mutually converts a voice and a character group, and is composed of a voice / character group conversion device 10 and a character group / voice conversion device 11.

By receiving the voice signal a output from the caller M of the caller M through the telephone line 7 and the character group signal g output from the interactive transmission / reception terminal 3, The voice / character group mutual conversion device 2 functions.

As the communication device 1 side, the caller M
In addition to the above case, when the lecturer conversation voice T1 of the instructor T outputs the voice signal a via the Bluetooth communication radio wave F, and the visitor conversation voice H1 of the visitor H also receives the voice signal a via the communication communication cable 8. The same applies when is output.

The interactive transmission / reception terminal 3 uses a CRT (Cath
display screen 12 such as ode ray tube) screen, PC
, A microphone 13 attached to an interactive transmission / reception terminal
A PC (personal computer) 16 as an interactive transmission / reception terminal equipped with a character group input keyboard 14 and an interactive transmission / reception terminal attached speaker 15 attached to a PC or the like.

The personal computer terminal 17 (mobile phone / PHS) of the interactive transmission / reception terminal 3 is wirelessly connected to the PC 16 by the Bluetooth communication radio wave F of the Bluetooth wireless communication system.

This slave terminal 17 is provided with a slave terminal display screen 18 and a simple keyboard 19 and has the same functions as the PC 16.

That is, this child device terminal display screen 18 is P
A character group is displayed similarly to the display screen 12 such as the CRT screen of C16. The simple keyboard 19 includes operation keys (not shown) equivalent to the character group input keyboard 14 of the PC 16.

A handset terminal (call-only communication terminal) 22 including a simple keyboard 20 for call and a handset terminal display screen 21 is connected to the PC 16 by a cable 9.

That is, the slave terminal 22 is detachably attached to the PC 16 via the cable 9 if necessary.

The simple keyboard 20 of the child device terminal 22 has operation keys (not shown) equivalent to the character group input keyboard 14 of the PC 16.

On this child terminal display screen 21, the PC 16
A character group (style) 29 is displayed similarly to the display screen 12 such as the CRT screen.

As shown in FIG. 2, the PC 16 receives a fixed character signal f output from a character group conversion unit 25, which will be described later, and based on the signal f, a character group ( Stylistic) is displayed.

At the same time, the voice recognition signal d output from the voice recognition section 24 is directly received, and the incoming signal is transmitted by the speaker 15 attached to the interactive transmission / reception terminal attached to the PC or the like.

On at least one of the above, the other party of the dialogue understands the content of the conversation. By understanding the contents and performing an input operation with the character input keyboard 14, the character group signal g is transmitted to the communication device 1 side.

The voice of the voice / character group mutual conversion device 2
As shown in FIG. 1, the character group converter 10 has a main function of converting a voice signal into a character group signal in order to convey a talk to a conversation partner. And a voice recognition unit 24 that recognizes this voice by receiving the voice signal, and a character group conversion unit 25 that converts the recognized voice into a character group (style).
It has and.

Telephone device 1 such as telephone 4 and a PC to be described later
A transmission / reception unit 23 that communicates with an interactive transmission / reception terminal 3 such as a (personal computer), a voice recognition unit 24 that receives a voice signal b transmitted from the transmission / reception unit 23 and recognizes voice, and this voice recognition unit. A character group conversion unit 25 is provided for converting the character group based on the voice recognition signal d output from 24.

The converted character group signal f output from the character group conversion unit 25 is transmitted to the interactive transmission / reception terminal 3.

The voice recognition signal d is directly transmitted to the PC 16 without passing through the character group conversion unit 25, the voice recognition signal d is processed by this PC 16, and the speaker 15 attached to the interactive transmission / reception terminal attached to the PC or the like. You can make a voice call.

The voice recognition signal d has a style corresponding to the character group converted by the character signal generator 37 (see FIG. 2) of the character group converter 25.

By the way, as shown in FIG. 2, the voice recognizing unit 24 receives the processed voice signal b whose voice waveform has been generated by the transmitting / receiving unit 23 and performs noise processing for removing noise of the processed voice signal b. A section 30 is provided.

A feature extraction unit 31 is provided for extracting a voice feature from the processed voice signal b from which noise has been removed by the noise processing unit 30 and transmitting the optimum target voice signal c. The optimum target voice signal c is a voice signal in which a feature is extracted as a result of comparison and collation with a voice feature file contained in the voice feature dictionary 32.

Further, as shown in FIG. 2, the character group converter 25 recognizes a voice recognition dictionary 34 in which a main voice signal is registered in advance, and voice recognition in which a feature is extracted from the optimum target voice signal c. Voice comparison and collation unit 35 for comparing and collating with signal d
Further, as a result of the comparison and collation, the character group conversion signal e is received, and the character group signal generator 37 for transmitting the fixed character group signal f to the PC 16 is provided.

Further, the character group / speech converter 11 is shown in FIG.
As shown in FIG. 5, the character group input keyboard 14 of the PC 16 has a function of converting a character group into a voice signal and transmitting the voice signal to the communication device 1 side as a voice signal.

This character group / speech converter 11 is a PC 1
6, a voice synthesis unit 41 for performing voice synthesis, and a voice waveform signal 1 output from the voice synthesis unit 41 are received based on the character group signal g transmitted from the PC 16 by operating the character group input keyboard 14. A voice waveform generation unit 42 that generates a waveform and a transmission / reception unit 23 that receives the voice signal q generated by the voice waveform generation unit 42 and transmits the voice signal to the communication device 1 are provided.

As shown in FIG. 2, the speech synthesizer 41 is composed of a language analyzer 45 and a prosody controller 46.

The language analysis unit 45 has a function of receiving the character group signal g of the character group input by the character input keyboard 14 of the PC 16, extracting only the correct language, and outputting the character group conversation signal h.

The prosody control unit 46 uses the character group conversation signal h.
Is received, language identification and prosody control are performed, and the speech signal l
It has a function of generating.

The prosody control section 46 receives a voice data storage section 48, a voice data signal i output from the voice data storage section 48, and a representative prosody pattern generation section 50 for producing a representative prosody pattern. Based on the prosody control rule conforming section 52, which confirms that the pattern conforms to a specific prosody judgment reference by the representative prosody pattern signal j, and outputs the prosody pattern signal k when the confirmation is completed, and the intonation based on the prosody pattern signal k. A tonnation pattern creating unit 54 that creates a pattern is provided.

The voice waveform generator 42 has a function of generating a voice waveform signal q in order to transmit the confirmed voice signal r to the telephone device 1 via the transmitter / receiver 23.

As shown in FIG. 2, the prosody control unit 46 uses the voice data of the voice data storage unit 48, receives the data voice signal i, and outputs the representative voice unit signal m. The speech unit creating unit 56 compares and compares the representative speech unit signal m to find a matching speech unit, and outputs the searched speech unit as a speech unit signal n and the speech unit signal n. To generate a voice waveform and output a voice waveform signal q to the transmitting / receiving unit 23.

The transmission / reception unit 23 is shared with the transmission / reception unit of the voice / character group conversion device 10 described above, but may be provided separately.

The code 60a is a reception lamp for the voice / character group converter provided in the voice / character group converter 10. The reception lamp 60a is lit when the transceiver 23 receives from any one of the telephone set 4, the headphone type transceiver 5 and the speaker combination type microphone 6, and notifies the reception.

Further, the interactive transmission / reception terminal 3 such as the PC 1
Assuming that the operator of No. 6 is away from the reception lamp 60, the PC 16 on the interactive transmission / reception terminal 3 side is turned on in synchronization with the reception of the voice recognition signal d or the fixed character group signal f. Two receiving lamps 60a are provided.

Furthermore, the slave terminal 17 and the slave terminal 22.
In the same manner as the PC 16, third and fourth communication lamps 60c and 60d are provided.

If the power of the PC 16 is on,
Both the slave terminals 17 and 22 can function as slaves.

Next, another embodiment of the interactive transmission / reception system and the interactive transmission / reception terminal device of the present invention will be described with reference to FIGS.

In the embodiment of FIGS. 1 and 2 described above, the voice / character group mutual conversion device 2 is configured separately from the PC 16, but according to FIG. 3 to FIG. It is an embodiment configured as a body type.

Each embodiment shown in FIGS. 3 to 5 will be described below.

Here, since the respective configurations of the voice / character group mutual conversion device 2 and the PC 16 in the examples of FIGS. 3 to 5 are similar to those of the above-described embodiment of FIGS. 1 and 2, the configurations and The description of the operation is omitted.

The embodiment shown in FIG. 3 is an example in which conversation is performed between the caller M and the called party W.

The caller M uses the telephone 4 to caller voice M1.
Is transmitted, the voice signal a is transmitted to the PC 16 which is the interactive transmission / reception terminal 3 via the telephone line.

When the audio signal a is transmitted to the PC 16, the speaker 1 attached to the interactive transmission / reception terminal attached to the PC or the like.
At the same time when an incoming signal is transmitted from 5, the voice signal a is displayed as a character group (style) 29 on a display screen such as a CRT screen
It is supposed to be displayed on 2.

The called party W reads the character group (style) 29 displayed on the display screen 12 such as the CRT screen, and inputs the conversation content such as a reply using the character group input keyboard 14 to input the character group (style). . By this input operation, the confirmed voice signal r is input to the telephone 4 through the communication path opposite to that of the voice signal a, and is transmitted as the called voice W1 at the telephone 4.

In this way, several conversations are repeated,
A conversation will be established.

The flow of call exchange between the caller M and the called party W and the state of the dialogue between the caller and the called party will be described by the following <step 1> to <step 4>. An example is shown.

<Step 1> When the caller M makes a caller voice M1 using the telephone 4, the voice signal a is transmitted to the PC 16 which is the interactive transmission / reception terminal 3 through the telephone line 7.

When the PC 16 receives the audio signal a, the speaker 15 attached to the interactive transmission / reception terminal attached to the PC or the like simultaneously outputs an incoming signal, and at the same time, a character group (style) is displayed on the display screen 12 such as the CRT screen. It

[0086] group of characters from the caller M (style), for example, as shown in FIG. 6 (a) "Hello, how are you." Is displayed.

Then, the called party W confirms the character group display of this character group.

<Step 2> The called party W confirms the character group display and inputs a reply by operating the character group input keyboard 14 to input a character group (style).

Then, the character group (style) from the called party W is displayed as "genki-genki. How are you?" As shown in FIG. 6 (a), for example.

By this input, the confirmed voice signal r is output, and the called party voice W1 of the called party W is transmitted from the telephone 4.

<Step 3> The caller M listens to the callee voice W1, and the caller voice M1 as a reply is transmitted to the PC 16 which is the interactive transmission / reception terminal 3 as the voice signal a.

When the PC 16 receives the voice signal a, the character group (style) of the voice signal a is displayed on the display screen 12 such as the CRT screen of the PC 16. Then, the called party W confirms the character group display of this character group.

<Step 4> The called party W confirms the display of the character group and inputs a question or message again using the character group input keyboard 14 of the PC 16 and releases (OFF) the communication line.

The party M hears the question or message again and ends the dialogue.

The embodiment shown in FIG. 4 will be described.

In this embodiment, the instructor T and the plurality of students S,
This is an example of dialogue with S.

When the instructor T transmits the instructor conversation voice T1 by the headphone type transceiver 5, the voice signal a is transmitted to the PC which is the interactive communication terminal 3 via the Bluetooth communication radio wave F.
16 is transmitted.

When the audio signal a is transmitted to the PC 16, the speaker 1 attached to the interactive transmission / reception terminal attached to the PC or the like.
At the same time that an incoming signal is transmitted from 5, the voice signal a is displayed as a character group (style) 29 on the display screen 12 such as a display screen such as a CRT screen.

The student S displays the display screen 1 such as the CRT screen.
The character group (style) 29 displayed on 2 is read, and the content of conversation such as a question is input by the character group input keyboard 14.

By this input operation, the confirmed voice signal r is transmitted as the student voice S1 by the headphone type transceiver 5 through the communication path opposite to the voice signal a.

In this way, several conversations are repeated,
A conversation will be established.

Note that the instructor T can talk with a plurality of students S, S at the same time because the communication line uses the Bluetooth communication radio wave F, so that a simultaneous conversation is possible. Participants S with the first contact with the teacher T
It is also possible to provide an interference prevention device (not shown) so as to identify and prevent interference.

The flow of conversation between the caller M and the callee W and the state of the dialogue between the caller and the callee are described in the following <Step 1> to <Step 4>. An example is shown.

In the example of FIG. 4, the flow of dialogue exchange between the instructor T and the student S and the instructor T and the student S.
3 shows an example of a situation of dialogue in.

<Step 1> When the instructor T transmits the instructor conversation voice T1 using the headphone type transceiver 5, the voice signal a is transmitted via the Bluetooth communication radio wave F to the plurality of PCs 16 and 16 which are the interactive transmission / reception terminals 3. Sent.

The PCs 16 and 16 receive the voice signal a, respectively, so that the interactive transmission / reception terminal-attached speakers 15 and 15 attached to the PCs 16 and 16 simultaneously send out an incoming signal, and at the same time, a character group on the display screen 12 such as a CRT screen. (Style) 29 is displayed.

The character group (style) from the instructor T is, for example, as shown in FIG. 6 (b), "○ is Δ, ○○
Becomes Why is this? Is displayed.

The student S confirms the character group display of this character group.

<Step 2> The instructor T inputs a character group (stylus) by operating the character group input keyboard 14 as a response after confirming the character group display.

Then, the character group (style) from the student S is displayed as shown in FIG. 6 (b), for example, "That is because of ΔΔ."

With this input, the confirmed voice signal r is output and the student voice S1 of the student S is transmitted from the headphone type transceiver 5 to the instructor T.

<Step 3> The instructor T uses the student voice S1.
By listening to, the lecturer conversation voice T1 as a response is transmitted to the PC 16 which is the interactive transmission / reception terminal 3 by the voice signal a.

When the PC 16 receives the voice signal a, the character group (style) 29 of the voice signal a is displayed on the display screen 12 such as the CRT screen of the PC 16. Then, the student S confirms the character group display of this character group.

<Step 4> The student S confirms the display of the character group and inputs a message to the effect that he / she understands it with the character group input keyboard 14 of the PC 16 and releases the communication line (OFF).

Further, the embodiment shown in FIG. 5 will be described.

The embodiment of FIG. 5 is an example in which a visitor H and a receptionist U have a dialogue.

When the visitor H transmits the visitor voice H1 through the speaker combination type microphone 6, the voice signal a is transmitted via the Bluetooth communication radio wave F as the interactive transmission / reception terminal 3
Is transmitted to the PC 16.

When the audio signal a is transmitted to the PC 16, the speaker 1 attached to the interactive transmission / reception terminal attached to the PC or the like.
At the same time when an incoming signal is transmitted from 5, the voice signal a is displayed as a character group (style) 29 on a display screen such as a CRT screen
It is supposed to be displayed on 2.

The receptionist U uses the display screen 1 such as the CRT screen.
The character group (style) 29 displayed in 2 is read, and the content of conversation such as guidance is input by the character group input keyboard 14.

By this input operation, the confirmed voice signal r is input to the speaker combination type microphone 6 through the communication path opposite to the voice signal a, and the speaker combination type microphone 6 becomes the receptionist voice U1. Sent.

In this way, several conversations are repeated,
A conversation will be established.

The flow of conversation between the visitor H and the receptionist U and the visitor H and the receptionist U.
The situation of the conversation with the following <Step 1> ~ <
An example is shown by Step 3>.

<Step 1> When the visitor H transmits the visitor conversation voice H1 using the speaker combination type microphone 6, the voice signal a is transmitted to the PC 16 which is the interactive transmission / reception terminal 3 via the Bluetooth communication radio wave F. It

When the PC 16 receives the voice signal a, the speaker 15 attached to the interactive transmission / reception terminal attached to the PC 16 transmits an incoming signal, and at the same time, a character group (style) 29 is displayed on the display screen 12 such as the CRT screen. It

The character group (style) from the visitor H is "Sorry, as shown in FIG. 6C, for example.
Where is Is displayed.

Then, the student S confirms the character group display of this character group.

<Step 2> The visitor H confirms the character group display and inputs a response by operating the character group input keyboard 14 to input a character group (style).

Then, the character group (style) from the receptionist U is displayed as shown in FIG. 6B, for example, "XX is on the 3rd floor."

With this input, the confirmed voice signal r is output, and the receptionist voice U1 of the receptionist U is transmitted from 6 to the visitor H.

<Step 3> Visitor H receives receptionist voice U
By listening to No. 1, visitor conversation voice H1 as a reward
Is transmitted to the PC 16 which is the interactive transmission / reception terminal 3 by the voice signal a, and the communication line is released (OFF).

Since each of the embodiments shown in FIGS. 4 and 5 is a face-to-face system, it is possible to incorporate a technique of supporting both conversations by having both gestures if necessary, rather than relying on conversation in front. .

According to the voice / character group mutual conversion function of the voice / character group mutual conversion device 2 of the present invention, noise suppression processing, feature extraction work, and voice recognition work are involved in the voice / character group conversion function. Moreover, in the character group / speech conversion function, a slight delay in the signal system occurs during the dialogue due to the language analysis work and the speech waveform generation work.

Regarding this point, the delay can be minimized by improving the operation processing speed of the voice / character group mutual conversion device 2 and the PC 16 and by performing coding and encryption having a specific meaning. .

Furthermore, the interactive transmission / reception system and the interactive transmission / reception terminal device according to the present invention are not limited to the above-described embodiment, and the voice signal a transmitted from the telephone equipment 1 uses the telephone line 7. In this system, the voice receiver / receiver 62 is directly taken in by the interactive transmission / reception terminal 3 side, and the voice / character mutual converter 61, which is a separate component that can be detachably attached, is used.

That is, as shown in FIG. 7, an ordinary handset which is of a handset type, in which a connectable voice / character mutual conversion device 61 is attached to the PC 16 while being connected to the telephone line 7. It is also possible to physically superpose 62 so that the voices can communicate with each other.

In this case, since a voice signal from the other party's telephone is once received by the handset 62 and converted into a character group (stylistic style), a person who is able to act as a person may call the person. Suitable for cases.

Furthermore, the PC 16 and the voice / character mutual converter 53 are provided with a memory (not shown) having a fixed storage capacity, and this memory can substitute a part of conversation.

That is, in the memory, for example, the name of the company, the affiliation, the name of the person in charge, the voice of the prescribed greeting, etc. are stored in advance, and in the case of the embodiment of FIG. In the case where the caller M has made a call for the first time or is from a customer, this is judged by a separate judgment means (not shown), and at the same time, the contents of the memory suitable for the other party. Can be sent in advance.

This call may be made automatically or, after confirming that it is the first call, it can be switched to manual.

[0140] Then, after this call is made, it is possible to proceed with the conversation of only the message.

[0141]

According to the present invention, a voice call from a telephone or the like is converted into a character group, and the content can be recognized by reading the character group. On the contrary, PC
An interactive transmission / reception method and system in which a character group is converted into a call voice by writing a character group from the interactive transmission / reception terminal, and the contents can be recognized by the call voice, and an interactive transmission / reception terminal device Therefore, the hearing impaired person can use the PC to smoothly communicate with a person with a healthy person or the like through daily conversation.

Not only the hearing impaired person but also the visually impaired person can be used within the range where the keyboard of the PC can be operated. It is possible to improve.

[Brief description of drawings]

FIG. 1 is a diagram showing an outline of an interactive transmission / reception method and system and an interactive transmission / reception terminal device of the present invention.

FIG. 2 is a schematic diagram showing steps of mutual conversion between a voice and a character group in the interactive transmission / reception method and system of the present invention.

FIG. 3 is a diagram showing an outline of another embodiment of an interactive transmission / reception method and system and an interactive transmission / reception terminal device of the present invention, in which (a) is an implementation of a conversation state between a calling party and a called party. The figure which shows an example. FIG. 6B is a diagram showing a flow of call exchange between the caller and the called party.

FIG. 4 is a diagram showing an outline of another embodiment of an interactive transmission / reception method and system and an interactive transmission / reception terminal device of the present invention, in which (a) is an example of a conversation state between a teacher and a student. FIG. FIG. 6B is a diagram showing a flow of conversation exchange between the instructor and the student.

FIG. 5 is a diagram showing an outline of another embodiment of an interactive transmission / reception method and system and an interactive transmission / reception terminal device of the present invention, in which (a) shows an example of a conversation between a visitor and a receptionist. FIG. FIG. 6B is a diagram showing a flow of conversation exchange between a visitor and a receptionist.

6A to 6C are examples of display screens displayed on the CRT screen in FIG. 1, and FIGS. 6A to 6C are views showing an example in which conversation contents are displayed on a display device.

FIG. 7 is a diagram showing another embodiment of the interactive transmission / reception terminal.

[Explanation of symbols]

1 Calling Device 2 Voice / Character Group Mutual Converter 3 Interactive Transmitter / Receiver Terminal 4 Telephone 5 Headphone Transmitter / Receiver 6 Speaker Combination Microphone 7 Telephone Line 8, 26 Communication Cable 10 Voice / Character Group Convertor 11 Character Group / Voice Converter Device 12 Display screen such as CRT (Cathode Ray Tube) screen 13 Microphone attached to interactive transmission / reception terminal 14 Character group input keyboard 15 Speaker attached to interactive transmission / reception terminal 16 PC (personal computer) 17 Handset terminal (mobile phone / PHS) 18, 21 Child Machine terminal display screen 19 Simple keyboard 20 Call-only simple keyboard 22 Handset terminal (call-only communication terminal) 23 Transmitter / receiver 24 Voice recognition unit 25 Character group conversion unit 29 Character group (stylistic style) 30 Noise processing unit 31 Feature extraction unit 32 Voice Characteristic dictionary 34 Voice recognition dictionary 35 Voice comparison / collation unit 37 Character group communication Generation unit 41 Speech synthesis unit 42 Speech waveform generation unit 45 Language analysis unit 46 Prosody control unit 48 Speech data storage unit 50 Representative prosody pattern creation unit 52 Prosody control rule adaptation unit 54 Intonation pattern creation unit 55 Speech waveform generation unit 56 Representative speech element Piece creation unit 57 Speech element dictionary 60a to 60d Reception lamp 61 Speech / character mutual converter 62 Handset a Speech signal b Modified speech signal c Optimal purpose speech signal d Speech recognition signal e Character group conversion signal f Definite character group signal g Character Group signal h Character group conversation signal i Voice data signal j Representative prosody pattern signal k Prosody pattern signal l Voice signal m Representative speech segment signal n Speech segment signal q Speech waveform signal r Confirmed speech signal A Interactive transceiver F Bluetooth communication Radio wave M Caller M1 Caller voice W Callee W1 Callee voice T Lecturer T1 Lecturer conversation voice S H1 visitors conversational speech U receptionist U1 receptionist voice lecture's S1 student voice H visitors

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04M 17/00 G10L 3/00 RQ

Claims (14)

[Claims] 1. A character recognition unit for receiving a voice signal transmitted from a telephone device such as a telephone set by a communication unit and recognizing it as a style by a character recognition unit for converting it into a character group.
In an interactive transmission / reception method of transmitting to an interactive transmission / reception terminal such as C, a step of converting voice into a character group and displaying the converted character group on a display screen of the interactive transmission / reception terminal; A step of transmitting and receiving a character group by bidirectional communication to a slave terminal linked to the interactive transmitter / receiver terminal; a step of transmitting a response signal by the character group from the interactive transmitter / receiver terminal to the slave terminal; A step of transmitting a response signal based on a character group from the interactive transmission / reception terminal to the communication device, the interactive transmission / reception terminal and the interactive transmission / reception terminal for a voice signal transmitted from the communication device. An interactive transmission / reception method, characterized in that at least one of the slave terminals to be linked can respond by a voice signal. 2. The interactive transmission / reception method according to claim 1, wherein the slave terminal is a mobile phone / PHS or a communication terminal dedicated to communication. 3. A character recognition means for receiving a voice signal transmitted from a telephone device such as a telephone by a communication means and recognizing it as a style by a character recognition means for converting it into a character group.
In an interactive transmission / reception method of transmitting to an interactive transmission / reception terminal such as C, a step of transmitting an audio signal transmitted from a communication device to an interactive transmission / reception terminal such as a PC, and transmitting a voice using a speaker attached to the interactive transmission / reception terminal, Converting the voice signal into a character group and displaying the converted character group on a display screen such as a CRT screen of the interactive transmission / reception terminal. An interactive transmission / reception method, characterized in that at least one of the communication contents can be recognized. 4. A character recognition means for receiving a voice signal transmitted from a telephone device such as a telephone by a communication means and recognizing it as a style by a character recognition means for converting it into a character group.
In the interactive transmission / reception method of transmitting to an interactive transmission / reception terminal such as C, the voice signal transmitted from the communication device is converted into a character group, and the converted character group is displayed on the display screens of a plurality of interactive transmission / reception terminals. The step of specifying one of the plurality of interactive transmission / reception terminals and performing bidirectional communication with the communication device, the one specified interactive transmission / reception terminal connected to the communication device, and the character During the two-way communication by the group, the step of simultaneously displaying the character group on the display screen of another interactive transmission / reception terminal, the two-way communication in the specified one interactive transmission / reception terminal. The interactive transmission / reception method, wherein the character group of can be displayed on the display screen of another interactive transmission / reception terminal. 5. A character recognition means for receiving a voice signal transmitted from a telephone device such as a plurality of telephones by a communication means, and recognizing it as a style by a character recognition means for converting it into a character group. In the interactive transmission / reception method of transmitting to an interactive transmission / reception terminal, a voice signal transmitted from a specific telephone device is converted into a character group, and the converted character group is a CRT of the interactive transmission / reception terminal.
A step of displaying on a display screen such as a screen, and when a character group is simultaneously transmitted from the specific calling device and another calling device, the characters are displayed separately on the display screen such as the CRT screen, or a plurality of dialogues are displayed. A step of displaying separately on the display screen of the type transmitting / receiving terminal, and when the character group is transmitted from a plurality of calling devices,
Determining the priority of responding by reading the contents of each of the character groups, and bidirectionally communicating from the interactive transmission / reception terminal in which the character groups are displayed to the calling device according to the determined priority. And preparing at least one interactive transmission / reception terminal capable of simultaneously receiving respective character groups transmitted from a plurality of communication devices, and after determining the priority of the dialogue, according to the order,
An interactive transmission / reception method characterized by conducting a dialog. 6. The interactive transmission / reception method according to claim 1, wherein the bidirectional communication is Bluetooth bidirectional communication. 7. When the character group is displayed on a display screen such as a CRT, a receiving lamp for PC is turned on, and the character group is the C character.
The interactive transmission / reception method according to any one of claims 1 to 3, characterized in that what has been displayed on a display screen such as an RT is displayed in advance. 8. A character recognition unit for receiving a voice signal transmitted from a telephone device such as a telephone set by a communication unit and recognizing it as a style by a character recognition unit for converting it into a character group.
In an interactive transmission / reception system for transmitting to an interactive transmission / reception terminal such as C, a voice / character group mutual conversion device for mutually converting a voice signal transmitted from the communication device into a character group, and the voice / character group mutual conversion device. An interactive transmission / reception terminal for receiving a signal converted into a character group or voice by the above-mentioned speech / character group mutual conversion device and an interactive transmission / reception terminal are integrated into a transmission / reception terminal with a speech / character mutual conversion function. An interactive transmission / reception system characterized by being configured. 9. A character recognition means for receiving a voice signal transmitted from a telephone device such as a telephone by a communication means and recognizing it as a style by a character recognition means for converting it into a character group.
In an interactive transmission / reception system for transmitting to an interactive transmission / reception terminal such as C, a voice / character group mutual conversion device for converting a voice signal transmitted from the communication device into a character group, and a conversion by this voice / character group mutual conversion device. A character group signal is transmitted, the converted character group signal is received, and an interactive transmission / reception terminal that displays a character group on a display screen is provided, wherein the voice / character group mutual conversion device is configured to convert voice to a character group. A voice / character group converter for converting into a voice and a character group / voice converter for converting characters into voice, wherein the voice / character group converter receives a voice signal, and a transmitting / receiving unit for transmitting the voice signal, The dialogue includes: a voice recognition unit that receives the voice signal transmitted from the transmission / reception unit and transmits a voice recognition signal; and a character conversion unit that receives the voice recognition signal and transmits a converted character group signal. The interactive transmission / reception terminal is a transmission / reception terminal with a voice / character group mutual conversion function, which includes a display screen such as a CRT screen, a microphone attached to the interactive transmission / reception terminal, a character group input keyboard, and a speaker attached to the interactive transmission / reception terminal. Type transmitting and receiving system. 10. A character recognition unit for receiving a voice signal transmitted from a telephone device such as a telephone set by a communication unit and recognizing it as a style by a character recognition unit for converting it into a character group, and the style is communicated interactively by a PC or the like. In an interactive transmission / reception system for transmitting to a terminal, a voice character group conversion device for converting a voice signal transmitted from the communication device into a character group, and a display screen such as a CRT screen provided to display the converted character group. An interactive transmission / reception terminal provided, a plurality of child device terminals such as mobile phones provided for two-way communication linked to the interactive transmission / reception terminal, and a P signal for the voice signal transmitted from the communication device.
A dialogue characterized in that the interactive transmission / reception terminal such as C and the interactive transmission / reception terminal of at least one of the slave terminals linked to the interactive transmission / reception terminal such as the PC can respond by a voice signal. Type transmitting and receiving system. 11. An interactive transmission / reception in which a voice signal transmitted from a telephone device is received by a communication means, recognized as a style by a character recognition means for converting into a character group, and this style is transmitted to an interactive transmission / reception terminal. In the system, an interactive transmission / reception terminal equipped with a speaker attached to the interactive transmission / reception terminal, which receives a voice signal transmitted from the communication device and transmits the voice, and a voice / character group conversion device for converting the voice signal into a character group. An interactive transmission / reception terminal having a display screen such as a CRT screen for displaying the character group, and at least one of a voice output from the speaker attached to the interactive transmission / reception terminal or a character group displayed on the display screen. An interactive transmission / reception system characterized in that the contents of the conversation can be recognized in. 12. An interactive transmission / reception in which a voice signal transmitted from a telephone device is received by a communication means, recognized as a style by a character recognition means for converting into a character group, and the style is transmitted to an interactive transmission / reception terminal. In the system, a plurality of interactive transmission / reception terminals that convert a voice signal transmitted from the communication device into a character group and display the converted character group on a display screen such as a CRT screen; Among them, an interactive transmission / reception terminal in which one capable of bidirectional communication with the communication device is specified, and while the one interactive transmission / reception terminal is connected to the communication device and performs bidirectional communication by a character group. The interactive transmission / reception system, wherein the character group is simultaneously displayed on a display screen such as a CRT screen of another interactive transmission / reception terminal. 13. A voice recognition device, which receives voice signals transmitted from a plurality of telephone devices, is recognized as a style by a character recognition means for converting into a character group, and the style is transmitted to a plurality of interactive transmission / reception terminals. In the interactive transmission / reception system, a specific PC having a display screen such as a CRT screen capable of converting a voice signal transmitted from a specific calling device into a character group and displaying the converted character group, and the specific call. When a character group is simultaneously transmitted from the device and another calling device, a plurality of interactive transmission / reception with a display screen that can be displayed separately on one display screen or provided so as to have a plurality of display screens A terminal is provided, and one or more interactive transmitting / receiving terminals that can simultaneously receive a character group transmitted from a plurality of communication devices are prepared, and after determining the priority of the dialogue, Therefore, an interactive transmission / reception system characterized by being able to interact. 14. An interactive transmission / reception in which a voice signal transmitted from a communication device is received by a communication means, recognized as a style by a character recognition means for converting into a character group, and the style is transmitted to an interactive transmission / reception terminal. In the system, a voice / character group mutual conversion device for mutually converting a voice signal transmitted from the communication device, and a conversion character group signal transmitted from the voice / character group mutual conversion device. An interactive transmission / reception terminal that receives a signal and displays a character group on a display screen such as a CRT screen, wherein the interactive transmission / reception terminal is a display screen such as a CRT screen, a microphone attached to the interactive transmission / reception terminal, and a character group input keyboard. And a PC equipped with a speaker attached to the interactive transmission / reception terminal, and a voice / character mutual converter which is attached to this PC so as to be connectable to this PC. To voice-character cross converter, interactive reception terminal apparatus characterized by comprising a receiver provided so as to physically polymerization so as to receive the sound to be emitted by direct waves.