KR100639998B1 - Dual-mode supporting device and method for voice call system with text-to-speech generation - Google Patents

Abstract

A dual-mode terminal and a voice synthesizing call method in the dual-mode terminal are provided to convert inputted characters into voice in real time to perform voice call communication through a wireless voice network. A TTS(Text To Speech) client unit(330) transmits input character data to a TTS server(340) through WiBro(Wireless Broadband Internet), and receives converted voice data corresponding to the input character data from the server(340). A CDMA interworking unit(310) is connected with a CDMA. A voice reproducing unit(320) transmits the converted voice data through the CDMA.

Description

Dual-mode supporting device and method for voice call system with text-to-speech generation}

1 is an overall schematic diagram of a wireless call process through speech synthesis in a dual mode terminal.

2 is a circuit wiring diagram of a dual mode terminal.

3 is an internal structure diagram of a dual mode terminal for receiving a text and converting it into a voice to make a call with the other party.

4 illustrates an embodiment of an internal structure diagram of a dual mode terminal for receiving a text of FIG.

5 is a flowchart of a voice call based on a character input by a caller in the dual mode terminal of the present invention.

* Explanation of symbols on the main parts of the drawing

100 Dual Mode Terminal 110 Wireless Voice (CDMA) Network

120 CDMA terminal 130 Mobile Internet (WiBro) network

The present invention relates to a speech synthesis method and a dual mode terminal in a dual mode supporting terminal capable of simultaneously using a mobile Internet network (WiBro) and a wireless voice network (CDMA). The present invention relates to a method and a dual mode terminal for synthesizing a text inputted using a voice conversion (TTS) server into a voice and using the same.

In general, a wireless voice network call may not be able to make a normal voice call due to various reasons. For example, if the speaker is too noisy and the speaker cannot hear you or cannot speak loudly, such as during a meeting, or because the speaker has a speech impairment, making it difficult to speak. In the conventional case, there is a problem that only a voice call can be made through the wireless voice network.

The present invention has been proposed to solve the above problems, using a wireless internet network and a portable Internet network at the same time, the receiver can hear the voice as in a normal call while the sender is difficult to talk by voice by communicating through a text Enables wireless calls through speech synthesis.

In order to achieve the above object, in a preferred embodiment of the present invention, the dual-mode terminal transmits input text data to a text-to-speech (TTS) server through a portable Internet network, and corresponds to the input text data from the server. A text-to-speech (TTS) client unit for receiving the converted speech data; And a wireless voice interworking unit for accessing a wireless voice network; and a voice reproducing unit for transmitting the received converted voice data through the wireless voice network.

In another preferred embodiment of the present invention for achieving the above object, the dual-mode terminal has an output unit for playing the input voice file and converts the input text data to a text-to-speech (TTS) server via a portable Internet network A portable internet network modem for transmitting and receiving converted voice data corresponding to the input text data from the server; A wireless voice network modem for communicating in a wireless voice network; And an output unit for reproducing the converted voice data received by the portable internet network modem, wherein the voice input unit is connected to a line-in terminal of the wireless voice network modem and a voice is input to a line-out terminal of the wireless voice network modem. A listening unit is connected, and the output unit is connected to a line-in terminal of the wireless voice network modem, and the output unit is connected to the voice listening unit.

In still another preferred embodiment of the present invention, a voice synthesis call method using both a portable Internet network for data communication and a wireless voice network for voice communication comprises the steps of: accessing the wireless voice network; Transmitting input text data to a text-to-speech (TTS) server via the portable Internet network; Receiving converted voice data corresponding to the input text data from the server through the portable Internet network; And transmitting the received converted voice data through the wireless voice network.

In another preferred embodiment of the present invention, a voice synthesis call method using both a portable Internet network for data communication and a wireless voice network for voice communication is a line-in of a wireless voice network modem for communication in a wireless voice network. Connecting a voice input unit to a terminal; Connecting a voice listening unit to a line-out terminal of the wireless voice network modem; Transmitting input text data to a text-to-speech (TTS) server via a mobile Internet network, and reproducing the voice data received from a portable Internet network modem for receiving converted voice data corresponding to the input text data from the server. Connecting an output unit to a line-in terminal of the wireless voice network modem; And connecting the output unit to the voice listening unit.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that the same elements among the drawings are denoted by the same reference numerals and symbols as much as possible even though they are shown in different drawings. In the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

WiBro network technology is a next generation wireless communication technology that is being developed in Korea. It is a technology to provide Internet service similar to the current DSL level at a low price even when stationary and mobile.

WiBro technology is in a position to overcome the narrow coverage in WLAN and the slow data rate in CDMA, and is recognized as an intermediate step in the future to 802.20 wireless broadband service.

Looking at some of the key technical features used in WiBro, OFDMA is used for multiple access and the channel bandwidth is 10Mbps. The frequency band used is 2.3GHz, and the uplink transmission rate is at least 128Kbps, the maximum is 1Mbps, and the downstream transmission rate is at least 512Kbps, and the maximum is 3Mbps.

In terms of mobility support, the WiBro standard stipulates that service will be provided smoothly even at a maximum travel speed of 60 km. If WiBro service is successfully commercialized, it is expected to have more ripple effect than CDMA had in the past.

The present invention relates to a speech synthesis method and a dual mode terminal in a dual mode supporting terminal capable of simultaneously using a portable internet network (WiBro) and a wireless voice network (CDMA), and a portable internet network (WiBro) and a wireless voice network (CDMA). It is necessary to use a heterogeneous network interworking technology to maintain the service transparently by performing network switching when necessary at the same time while using the dual mode terminal.

The interworking between the WiBro and the wireless voice network (CDMA) is possible because both the wireless voice network (CDMA) network can provide both voice and data services. 1) Data service of the wireless Internet network (WiBro) and wireless voice network (CDMA) 2) can be divided into interworking with the voice network of the mobile Internet network (WiBro) and wireless voice network (CDMA).

1. Mobile Internet Network WiBro ) And wireless Voice network (CDMA)  Data Service Integration

Data service interworking between WiBro data network and CDMA network aims to provide seamless data service. A user who owns a dual mode terminal is provided with services while moving, so he may leave the service area of the current service network and reenter the service.

For users, it is more important to provide stable services than information on the status and type of the wireless network currently in use. In order to provide a stable service, a terminal needs to be able to access a different network when the current network is disconnected or the network is out of service.

In order to automatically switch between networks without user intervention, it is necessary to provide a single network interface to the application layer operating in the terminal.

This requires a layer that integrates network devices just below the TCP / IP layer. The specific role of this layer is to manage the CDMA device driver and WiBro device driver, select the currently available network, transfer the data frame to the upper layer (IP layer), and the network access and management module existing in the application layer. In case of failure, switch the network in response.

In the TCP / IP layer and above, only one device is recognized as being present, but in the network integration layer, it is actually connected to one specific network in consideration of the current network state. Such interworking technology has been mainly studied in the network interworking between wireless LAN, ATM, WCDMA, but there is no relevant research at home and abroad for network interworking between CDMA and WiBro.

2. Mobile Internet Network WiBro ) And wireless Voice network (CDMA) Voice network  peristalsis

The interworking between the WiBro data network and the CDMA voice network means that a user uses a data service through an IP network while making a general CDMA call. If WiBro data network and CDMA voice network are used, two networks can be used at the same time unlike data service interworking.

In the case of data service interworking, either WiBro or CDMA should be selected at a time. However, since CDMA voice network is not an IP network and is processed by the CDMA module, not the OS of the terminal, it can operate simultaneously with WiBro.

The simultaneous use of the CDMA voice network and WiBro network can be used to increase the availability of existing CDMA voice calls.

1 is an overall schematic diagram of a wireless call process through speech synthesis in a dual mode terminal 100.

The dual mode terminal 100 supports the CDMA voice / data network 110 and the WiBro network 130, which is a next generation high-speed wireless network. WiBro is a technology developed to provide ADSL-class wireless Internet service at a low price, and other heterogeneous networks supporting the TCP / IP protocol stack can be applied. In the following description, a heterogeneous network of the CDMA network 200 and the WiBro network 300 will be described as an example.

The dual mode terminal 100 may have a form of a notebook, a PDA, a smartphone, or the like. However, it should be noted that, as one embodiment, it includes all that can be easily substituted, changed by those skilled in the art to which the present invention pertains without departing from the technical spirit of the present invention.

When using a notebook can be equipped with a CDMA module and WiBro modem in the form of a PCMCIA card can function as a dual mode terminal (100). The dual mode terminal 100 for WiBro / CDMA, which will be released later, will have such network access functions embedded in one terminal, and the S / W platform is not a download platform used in current CDMA phones but a complete OS. Will differ only in size and performance with current notebooks, and its internal structure and functionality are expected to be very similar.

In the figure, each of the terminals 100 and 120 in the caller side and the receiver side is in a state of making a voice call through the CDMA network. The calling party's terminal is a dual terminal 100 for WiBro / CDMA and the calling party's terminal is a terminal 120 which can use only a CDMA network.

In order to make a CDMA call connection, the caller inputs a phone number of the other party and attempts to make a call through the CDMA network 110. Attempting to make a call over a CDMA network means calling a telephony API (TAPI) function for dialing. If the TAPI function is successfully executed, communication through the CDMA network becomes possible.

After the call is connected, the caller can hear the receiver's story through the earphone or speaker connected to the terminal, and wants to communicate, but in a situation where communication through voice is difficult, the keyboard is used.

The text input through the keyboard is transmitted to the text-to-speech text to speech (TTS) server 150 through the mobile Internet network 130 and 140 and after user authentication, the text-to-speech (TTS) server 150 keyboard It converts the text entered through wav or mp3 type voice data and sends it back to the sender.

This voice data is played on the caller's dual mode terminal 100 and transmitted to the receiver as voice through the CDMA network 110.

If the voice call is difficult, the caller makes a call with the receiver by inputting text instead of voice in the dual mode terminal 100 after the CDMA call connection is made. To this end, a graphic interface for character input is required in the dual mode terminal 100.

The graphic interface for inputting text is input to the text-to-speech (TTS) server 150 through the portable Internet network 130, 140 receives the text in a small input window that the user can enter the text.

The user inputs text through appropriate input means provided by the dual mode terminal 100. For example, the dual mode terminal 100 in a notebook form may input characters through a keyboard, and in a form such as a PDA or a smartphone, the characters may be input through a character input unit or a character recognizer. However, it should be noted that the above-described one is an embodiment, and includes the same technical idea or easily replaceable means.

2 is a circuit wiring diagram of a dual mode terminal.

When a call is connected between the caller and the receiver through the CDMA network 110, the caller using the dual mode terminal 100 speaks by inputting a letter, and the receiver calls by voice. However, since the characters input to the dual mode terminal 100 cannot be read by the receiver, the characters are converted into voice data through the WiBro network and then transferred back to the receiver through the CDMA network.

In order to perform the above process, a special type of wiring structure is required in the dual mode terminal 200. The dual mode terminal 200 includes an output unit for reproducing the converted voice data received from the wireless voice network modem 210, the portable internet network modem 220, and the portable internet network modem 220.

The wireless voice network modem 210 is required for communication in the wireless voice network and the portable internet network modem 220 transmits input text data to a text-to-speech (TTS) server via the mobile internet network, and from the server Receive converted speech data corresponding to the input text data.

Line in / out (210) of the CDMA modem is a terminal in which a CDMA modem is generally present to support a voice call through CDMA. Although represented by one terminal, all input / output wires are connected.

The voice input unit 230, such as a microphone, is connected to a line in 210 terminal of the CDMA modem in order to deliver the words spoken by the sender (S200).

The voice listening unit 240 such as a speaker, earphone, etc. is connected to a line out 210 terminal of the CDMA modem to output the words spoken by the receiver (S200).

Characters input by the caller to the dual mode terminal 200 are converted into converted speech data corresponding to the input text data through a text-to-speech (TTS) server and then reproduced in the dual mode terminal 200.

At this time, in order for the reproduced sound to be heard by the receiver, the output unit 250 of the dual mode terminal is connected to a terminal which is a line of the wireless voice network modem 210. In addition, since the caller should be able to hear the reproduced sound, the output unit is connected to the voice listening unit 240.

In the above, it is assumed that the dual mode terminal is a type of terminal using a CDMA modem and a WiBro modem. However, in a dual mode terminal such as a smartphone, a speaker and a microphone exist as part of a terminal, such as a mobile phone, and a modem is also built in. Form is also possible. In this case, the wiring connection as described above may be made at the circuit level.

3 is an internal structure diagram of a dual mode terminal for receiving a text and converting it into a voice to make a call with the other party.

The phone number management module, which manages CDMA call connections, has a phone book and records the call list previously. In addition, the telephone number management module has a function of connecting a telephone call between the caller and the receiver.

The text input module is a graphical user interface (GUI) and receives text from a caller. Thereafter, the received string is divided into lines and semantic units, and transmitted to the voice reproducing unit 320.

The audio reproducing unit 320 includes a determining unit 321, a storage unit 322, and a reproducing unit PLAY. The determination unit 321 determines whether the character string corresponding to the previously transmitted voice file is the same, and if the character string corresponding to the previously transmitted voice file is the same, reproduces the voice file corresponding to the stored previous character string.

If not the same, the received string is transmitted to the TTS server 340 through the TTS client 330. The TTS server 340 returns voice data corresponding to the received character string, and reproduces the voice data received from the TTS server 340 in the voice reproducing unit 320.

4 illustrates an embodiment of an internal structure diagram of a dual mode terminal for receiving a text of FIG.

The phone number management module 411 is a module for managing CDMA call connection and has a phone book and also records a list of previously called phone numbers. Further, the phone number management module 411 calls the CDMA TAPI 420 and the CDMA TAPI 420 directly calls the CDMA when the caller wants to talk to the receiver after the caller enters the phone number so that the caller can make a CDMA phone call with the recipient. The device 160 is controlled to connect to the CDMA voice network.

The text input module 412 is a graphical user interface (GUI) that receives text from a user or a sender. The character input module 412 divides the string received from the user into lines and transmits the string to the TTS module 415.

The TTS module 415 receives the converted voice data from the TTS cache 416 as a module that performs a procedure for converting an input character string into voice data.

The TTS cache 416 caches the results of the operation of converting previously performed text data into voice data, and then voices corresponding to the text input when the conversion request of the TTS module occurs and the character string input in its cache. If data exists, voice data is delivered.

If it is not in the TTS cache 416, the TTS client 417 is requested and the string is transmitted to an external TTS server. The TTS server returns the synthesized voice and the TTS client 417 receives it and delivers it to the TTS cache. The TTS cache 416 stores it in its cache and plays it back through the WAV player 418.

The login module 413 is a module for first connecting to an external TTS server when converting text data into voice data for the first time in a dual mode terminal. Enter the ID and password through the login module 413 and authenticate with the TTS server through the TTS client 417.

The networking module 402 means a protocol stack for TCP / IP networking and the network structure is simply indicated because it is not covered in the present invention. In the dual mode terminal, TCP / IP based networking is performed through the WiBro device 423.

Although it may be provided through the CDMA device 421, in the present invention, the CDMA device only considers the case of using a voice network.

The TTS server in FIG. 4 exists on the general Internet 500 as shown in FIG. The role of the TTS server is to combine and synthesize the given text into voice and convert the result into a voice file such as WAV and mp3 files, and is not limited to wav and mp3 files. Represents a server that converts a string to speech regardless of whether it has a structure, but does not require a special form.

5 is a flowchart of a voice call based on a character input by a caller in the dual mode terminal of the present invention.

The caller inputs a text through the text input module after accessing the wireless voice network (CDMA) (510, 520). The dual mode terminal determines whether the caller matches the input text and the previously transmitted text with the converted voice data (531). If there is a voice data file corresponding to the input text, the voice is played and stored (532,533). Communicate with the receiver (550).

In the dual mode terminal, if the caller does not match the input data with the voice data converted from the previously transmitted character, the dual mode terminal transmits the character to the TTS server (540) and then corresponds to the character from the TTS server. After receiving the converted voice data (540, 541) and playing back and storing the voice data (532, 533) and communicating with the receiver (550).

The invention can also be embodied as computer readable code on a computer readable recording medium. Computer-readable recording media include all kinds of recording devices that store data that can be read by a computer system.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, which are also implemented in the form of carrier waves (for example, transmission over the Internet). It also includes. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

The best embodiments have been disclosed in the drawings and specification above. Although specific terms have been used herein, they are used only for the purpose of describing the present invention and are not used to limit the scope of the present invention as defined in the meaning or claims.

Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

The present invention by using a wireless voice network and a portable Internet network at the same time, the external noise in a dual-mode terminal or a situation requiring a quiet or a user with a language disorder can make a call using only the text without using a voice Causes effect.

In addition, the present invention has the advantage that the voice call through the wireless voice network by converting the text input to the voice in real time.

The present invention can increase the convenience and availability to the user during a call, and has the effect of increasing the utilization of the dual-mode terminal through a service using a wireless Internet network (WiBro) to be commercialized in the future.

Claims (15)

A text-to-speech (TTS) client unit for transmitting input text data to a text-to-speech (TTS) server via a portable Internet network, and receiving converted speech data corresponding to the input text data from the server; Wireless voice interworking unit for connecting to a wireless voice network; And And a voice reproducing unit configured to transmit the received converted voice data through the wireless voice network. The method of claim 1, And the voice reproducing unit reproduces the converted voice data. The apparatus of claim 1, wherein the voice reproducing unit A storage unit which stores previous converted speech data corresponding to the predetermined text data; A determination unit determining whether or not the converted voice data corresponding to the input text data exists in the storage unit; And If the converted voice data corresponding to the received text data exists in the storage unit, the converted voice data is transmitted to the voice reproducing unit. And a transmission unit for transmitting the received text data to the text-to-speech (TTS) client unit when the converted speech data corresponding to the input text data does not exist in the storage unit. Mode terminal. The method of claim 1, The text-to-speech (TTS) client unit includes a portable Internet network modem for transmitting and receiving data to and from the text-to-speech (TTS) server and a portable Internet network. The wireless voice linkage unit is a dual mode terminal, characterized in that it comprises a wireless voice network modem for communicating over a wireless voice network. The method of claim 1, The text-to-speech (TTS) client unit is a dual-mode terminal, characterized in that for transmitting the input text data to the text-to-speech (TTS) server, the ID and password required for user authentication. In the dual mode terminal having an output unit for playing the input voice file, A portable internet network modem for transmitting input text data to a text-to-speech (TTS) server via a portable internet network, and receiving converted voice data corresponding to the input text data from the server; A wireless voice network modem for communicating in a wireless voice network; And an output unit for reproducing the converted voice data received by the portable internet network modem. Connect a voice input to the line-in terminal of the wireless voice network modem Connect a voice listening unit to the line-out terminal of the wireless voice network modem The output unit is connected to the Line-in terminal of the wireless voice network modem. And connecting the output unit to the voice listening unit. The method according to any one of claims 1, 4 and 6, The portable Internet network is a dual mode terminal, characterized in that the Wibro network. The method according to any one of claims 1, 4 and 6, The wireless voice network is a dual mode terminal, characterized in that the CDMA network. A voice synthesis call method using both a mobile Internet network for data communication and a wireless voice network for voice communication, Accessing the wireless voice network; Transmitting input text data to a text-to-speech (TTS) server via the portable Internet network; Receiving converted voice data corresponding to the input text data from the server through the portable Internet network; And And transmitting the received converted voice data through the wireless voice network. The method of claim 9, wherein the transmitting through the wireless voice network Storing previous converted speech data corresponding to the predetermined text data in a storage unit; Determining whether the converted voice data corresponding to the input text data exists in the storage unit; Transmitting the converted voice data through the wireless voice network when the converted voice data corresponding to the received text data exists in the storage unit; and And transmitting the received text data to a text-to-speech (TTS) client through the portable Internet network when the converted voice data corresponding to the received text data does not exist in the storage unit. Characterized by voice synthesis call method. The method of claim 9, The transmitting step and the receiving step transmit and receive text data and voice data in the portable Internet network through the portable Internet network modem. And the transmitting step transmits the voice data in the wireless voice network through a wireless voice network modem. The method of claim 9, When the input text data to the text-to-speech (TTS) server, the step of first confirming the ID and password required for user authentication; voice synthesis call method further comprising. Connecting a voice input unit to a line-in terminal of a wireless voice network modem for communication in a wireless voice network; Connecting a voice listening unit to a line-out terminal of the wireless voice network modem; Transmitting input text data to a text-to-speech (TTS) server via a mobile Internet network, and reproducing the voice data received from a portable Internet network modem for receiving converted voice data corresponding to the input text data from the server. Connecting an output unit to a line-in terminal of the wireless voice network modem; And Connecting the output unit to the voice listening unit. The method according to any one of claims 9 to 13, The portable Internet network is a voice synthesis call method, characterized in that the Wibro network. The method according to any one of claims 9 to 13, And said wireless voice network is a CDMA network.

Images