KR100888340B1 - Voice Message Transmission System for Using MultiModal Plug-in in End Terminal Browser Based And Method thereof - Google Patents

Abstract

The present invention discloses a voice message transmission system and method using a multi-modal plug-in based on a terminal browser. That is, when the voice message is input, the input voice message is transmitted to the multimodal platform, the voice message transmitted to the multimodal platform is transmitted to the content server, and when the voice message is transmitted to the multimodal platform, the voice message is transmitted. By implementing a voice message transmission system and a method using a terminal browser-based multi-modal plug-in that transmits a message requesting to a receiving terminal to a content server, the user can use a visual and audio multi-mode user interface. You can send and receive voice messages.

Multimodal Plug-ins, Content Servers, Voice Messages

Description

Voice message transmission system using multi-modal plug-in based on terminal browser and method thereof {Voice Message Transmission System for Using MultiModal Plug-in in End Terminal Browser Based And Method about}

1 is a schematic diagram showing a voice message transmission system using a terminal browser-based multi-modal plug-in according to an embodiment of the present invention.

2 is a flowchart illustrating a method of transmitting a voice message using a terminal browser-based multimodal plug-in according to an exemplary embodiment of the present invention.

3 is a block diagram illustrating an apparatus for transmitting a voice message of a communication terminal applied to a voice message transmission system using a terminal browser-based multimodal plug-in according to an exemplary embodiment of the present invention.

4 is an exemplary diagram for inputting a telephone number of a receiving terminal according to an embodiment of the present invention.

5 is an exemplary diagram for inputting a voice message, a title of a voice message, and a modulation method according to an embodiment of the present invention.

6 is a flowchart illustrating a voice message transmission method of a communication terminal applied to a voice message transmission system using a terminal browser-based multimodal plug-in according to an embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

10: input unit 20: control unit

30: transceiver 40: memory

50: display unit 60: communication module unit

100: transmitting terminal 110: multi-modal platform

120: content server 130: receiving terminal

The present invention relates to a voice message transmission technology, and to a voice message using a terminal browser-based multimodal plug-in that provides a voice mail service and a voice message service by using a plug-in that provides a multi-modal function to a wireless Internet browser of a communication terminal. A transmission system and a method thereof.

In general, the wireless Internet service being serviced by the communication terminal is very useful despite the small screen and inconvenient key input of the terminal. This is because the communication terminal is a small device, which is excellent in mobility and can acquire desired information anytime and anywhere. However, small screens and inconvenient keystrokes have been perceived as barriers to those who want to use wireless Internet services.

However, when a voice message is to be transmitted using a conventional terminal, the existing voice mailbox service and voice message service are a method in which a sender calls a ARS to leave a message, and a receiver also calls a ARS to listen to the message. Listening to the voice menu provided by the has been inconvenient to leave a message and listen accordingly.

Multimodal means providing a variety of interfaces between a user and a terminal. The existing wireless Internet service provides one input / output, a screen output and a key input. It is intended to be synchronized and provided in one integrated interface.

Multimodal services can be largely divided into application-based services and browser-based services. An application-based service is a method of adding a multi-modal function to a terminal application (eg, WIPI), and it is possible to have a server flat processing voice input and output and a terminal application that can interoperate with it. However, since there is a problem of developing a terminal application, its spreading speed is very slow.

Browser-based services, on the other hand, add multimodal functionality to the WAP browser, a wireless Internet browser, which adds tags for voice input and output to existing WML or HTML documents. In order to implement this, a multimodal platform that processes a terminal browser and voice input / output is required.

An object of the present invention is to provide a voice message transmission system and method using a terminal browser-based multimodal plug-in that provides a voice mail service and a voice message service using a plug-in that provides a multi-modal function on a wireless Internet browser of a communication terminal. By implementing the above, it is for transmitting and receiving a voice message capable of visual and audio multi-mode through the user interface.

The present invention for achieving the above object, a transmission terminal for generating a predetermined voice message through a browser-based multi-modal plug-in; A multi-modal platform for storing a voice message generated from the transmitting terminal and modulating the stored voice message through a preset modulation method; A content server for transmitting a voice message stored in the multi-modal platform in response to receiving a predetermined transmission request signal generated from the transmitting terminal; And a receiving terminal for receiving and reproducing a voice message transmitted from the content server. The system provides a voice message transmission system using a multi-modal plug-in based on a terminal browser.

The present invention for achieving the above object, the transmitting terminal generates a predetermined voice message through a browser-based multi-modal plug-in; Storing a voice message generated from the transmitting terminal by a multimodal platform and modulating the stored voice message through a preset modulation method; Transmitting a voice message stored in the multi-modal platform as a content server receives a predetermined transmission request signal generated from the transmitting terminal; And a receiving terminal receiving and playing the voice message transmitted from the content server.

The present invention for achieving the above object, the communication module unit for receiving a multi-modal plug-in for supporting the input of voice messages and additional information by starting a predetermined browser; A display unit configured to display an input menu formed on the multi-modal plug-in; An input unit configured to receive a voice message and additional information through the input menu; And a controller configured to control input and output of the voice message and additional information.

 According to an aspect of the present invention, there is provided a communication module including: receiving, by a communication module, a multimodal plug-in supporting a voice message and input of additional information by starting a predetermined browser; Displaying, by a display unit, an input menu formed on the multi-modal plug-in; Receiving, by an input unit, a voice message and additional information through the input menu; And a control unit controlling input and output of the voice message and additional information.

Hereinafter, described in detail with reference to the accompanying drawings of the present invention.

First of all, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals have the same reference numerals as much as possible even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

Multimodal applied to the present invention means to provide a variety of interfaces between the user and the terminal, the existing wireless Internet service provided one input and output, such as screen output and key input, but adds voice input and output It synchronizes with screen input and output and provides it as one integrated interface.

The multi-modal service applied to the present invention is a browser-based service, and the browser-based service adds a multi-modal function to a WAP browser, which is a wireless Internet browser, which is a tag for voice input / output to an existing WML or HTML document. This is how you add it. In order to implement this, a multimodal platform that processes a terminal browser and voice input / output is required.

1 is a schematic diagram showing a voice message transmission system using a terminal browser-based multi-modal plug-in according to an embodiment of the present invention.

Referring to FIG. 1, a voice message transmission system using a terminal browser-based multimodal plug-in according to an embodiment of the present invention includes a transmitting terminal 100, a multimodal platform 110, a content server 120, and a receiving terminal 130. ).

The transmitting terminal 100 inputs the telephone number of the receiving terminal 130 to which the voice message is to be transmitted. When the transmitting terminal 100 records the voice, the telephone number of the receiving terminal 130, the Audio Type, MaxLength of the recorded voice, the recorded voice is converted to EVRC (Enhanced Variable Rate Codec) streaming to the multi-modal platform 110 Is sent to.

The multi-modal platform 110 generates the name and phone number of the phonebook as a dynamic grammar for each user terminal.

In addition, the multi-modal platform 110 converts the voice type into a method (eg, a WAV method) designated by the audio type, and temporarily stores the voice type by mapping it with the telephone number of the receiving terminal.

When the transmitting terminal 100 transmits the recorded voice, the content server transmits the telephone number of the receiving terminal 130 to the multi-modal platform and requests the recorded voice to obtain the recorded voice from the multi-modal platform. .

Then, after storing the voice received from the multi-modal platform, if the download request of the recorded voice is received from the receiving terminal, the stored voice is transmitted to the receiving terminal. The receiving terminal 130 reproduces the voice received from the content server 120.

The sending terminal is a method of inputting the receiving terminal telephone number, and inputting the recipient number by voice recording by number, by voice recording the recipient name registered in the address book of the phone book of the terminal, or by directly inputting the number by the user. You can input using.

When the receiver name is input by voice, the multimodal plug-in of the transmitting terminal transmits the recorded voice to the multimodal platform, and the multimodal platform generates the phonebook name and phone number by dynamic grammar for each user.

When speech recognition processing is performed in an ARS (Automatic Response System), the multimodal platform transmits the telephone number Alias according to the speech recognition result to the transmitting terminal.

In addition, the telephone number of the receiving terminal is updated every time the user inputs and stores the transmitting terminal periodically or when the telephone number is updated, the phone book information previously stored in the transmitting terminal is transmitted to the multi-modal platform and stored in the multi-modal platform. Update your phonebook information.

Thereafter, the multimodal platform parses the received phone numbers to generate a dynamic bnf file.

2 is a flowchart illustrating a method of transmitting a voice message using a terminal browser-based multimodal plug-in according to an exemplary embodiment of the present invention.

Referring to Figure 2, it will be described in detail a voice message transmission method using a terminal browser-based multi-modal plug-in according to an embodiment of the present invention.

Among various methods of inputting the telephone number of the receiving terminal 130 to which the transmitting terminal 100 is to transmit voice, a user name or nickname of the receiving terminal, etc., for inputting the telephone number of the receiving terminal by a method according to voice recognition, Voice input the corresponding name stored in the phone book of the transmitting terminal.

Accordingly, the input telephone number voice is transmitted to the multimodal platform (S100).

The multimodal platform receiving the telephone number voice performs ARS on the received telephone number voice and transmits the telephone number of the receiving terminal to the transmitting terminal (S102 and S104).

The transmitting terminal sets the received telephone number as the receiving terminal telephone number of the menu, and when the voice to be transmitted from the transmitting terminal is recorded, the recorded voice is transmitted to the multi-modal platform 110.

The multi-modal platform 110 stores the received voice (S106-S110). When the transmitting terminal user requests to transmit the recorded voice to the content server 120, the content server 120 requests the voice stored in the multi-modal platform 110 (S112-S114).

When the stored voice is received from the multi-modal platform 110, the content server 120 stores the received voice (S116-S118). The content server 120 transmits a short message service (SMS) message indicating that the voice message has been received to the receiver terminal 130.

When the receiving terminal accesses the content server and requests a message download, the content server transmits the stored voice (S120). Then, the receiving terminal reproduces the received voice (S122).

That is, the voice message input from the user is changed from the EVRC format to the WAV format and transmitted to the multimodal platform, and the multimodal platform transmits the voice message received in the WAV format to the content server.

3 is a block diagram illustrating an apparatus for transmitting a voice message of a communication terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 3, an apparatus for transmitting a voice message of a communication terminal according to an embodiment of the present invention includes a keypad for receiving a telephone number of a receiving terminal, a touch pad, a microphone for receiving a voice message to be transmitted to the receiving terminal, and the like. When the voice message is input, the display unit 50 for displaying the input unit 10, a menu for receiving a telephone number of the receiving terminal, a voice message, a title of the voice message, a menu for modulating the input voice message, etc. from the user, The controller 20 stores the input voice message in the memory 40, transmits and controls the voice message to the receiving terminal through the transceiver 30, and various communication modules for transmitting the stored voice message to the multimodal platform. The communication module unit 60 is included.

In addition, the memory has a built-in multi-modal plug-in function, and a menu function including a receiving terminal telephone number, a title of a voice message, and various functions for receiving the voice message from a user.

To use the multimodal plug-in, the <OBJERCT> tag is used. [Table 1] is an example of such an <OBJECT> tag.

 <OBJECT classid = "clsname: mm_plg-asr" codebase = "http://mmsvr.nate.com//mm_plg.pgn#Version=1.0.0" data = "" type = "application / plugin" width = 105height = 110 <PARAMname = "product" value = "mm plugin"> </ PARAM> </ OBJECT>

When the sentence shown in [Table 1] is included in the WML document, check whether the plug-in is installed while calling the document from the WAP browser, and if it is not installed or is installed at a lower version, install it immediately after checking the user. Done. After the plug-in is installed, the plug-in takes up part of the screen of the WAP browser.

4 is an exemplary diagram for inputting a telephone number of a receiving terminal according to an exemplary embodiment of the present invention, and FIG. 5 is an exemplary diagram for inputting a voice message, a title of a voice message, and a modulation method according to an exemplary embodiment of the present invention. .

Hereinafter, an operation of a voice message transmitting apparatus of a communication terminal applied to a voice message transmitting system according to an embodiment of the present invention will be described with reference to FIGS. 3, 4, and 5.

When the terminal user wants to transmit a voice message, the user selects a voice message or a message by accessing the wireless Internet using a multimodal function on the wireless internet browser provided in the terminal.

After selecting Send voice message, enter the received telephone number as shown in FIG. At this time, in the method for inputting the received telephone number, the receiver number is input by voice recording by number, the receiver name registered in the address book of the phone book of the terminal is input by voice recording, or the user uses the keypad to enter the occupation number. You can enter

If the name of the receiving terminal user is input as a voice and a predetermined key (for example, the 'OK' button of FIG. 4) is input, the controller 20 controls the communication module 60 to multiply the recorded voice. If the receiving terminal telephone number is received from the multi-modal server, the received telephone number is displayed on the receiver telephone number of the menu for transmitting the voice message, that is, the item of the receiver number, as shown in FIG.

In addition, the calling party number (telephone number of the transmitting terminal) is input. After receiving a title of a voice message or a voice message to be transmitted, the modulation method modulates the voice message, that is, the voices of various voice actors, entertainers, etc. stored in the memory, and then the modulation is set as shown in FIG. 5. After pressing a predetermined key (for example, recording), a voice to be transmitted is input, and the input voice is stored in the memory 40.

In addition, the time of the input voice is also displayed, and if the 'listen' button is selected, the input voice message can be listened to. After the voice message to be transmitted is completed through this method, if a message is sent, that is, the recorded voice message is transmitted, the multi-modal plug-in function records the voice message, the recipient's phone number, the caller's phone number, the subject, the modulation method, and the like. Send to the multimodal platform.

In addition, the controller 20 accesses the content server and requests transmission of the recorded message, that is, the voice message transmitted to the multi-modal platform to the corresponding receiving terminal. As such, functions for receiving and transmitting a voice message are accompanied under the control of the controller 20.

6 is a flowchart illustrating a voice message transmission method of a communication terminal applied to a voice message transmission system using a terminal browser-based multimodal plug-in according to an embodiment of the present invention.

Hereinafter, a voice message transmission method of a communication terminal applied to a voice message transmission system using a terminal browser-based multimodal plug-in according to an embodiment of the present invention will be described in detail with reference to FIG. 6.

If a user wants to transmit a voice message from the user and accesses the wireless Internet and a voice message transmission command is input, that is, a menu for transmitting a voice message is selected, the selected menu is displayed, and the user displays the recipient's telephone number in the displayed menu. The voice message title and the modulation method are input (S200-S204).

In this manner, when the voice message is input, that is, recording starts while the receiver's telephone number, the voice message title, and the modulation method are input, the recorded voice message is stored (S206). When the recording of the voice message is completed and a command for transmitting the recorded voice message is input, the terminal transmits the recorded message, the receiver's telephone number, the sender's telephone number, the voice message subject, the modulation method, and the like to the multimodal platform. In addition, it transmits a message requesting the transmission of the recorded message to the receiving terminal to the content server (S208-S212).

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art will be able to variously modify and change the present invention without departing from the spirit and scope of the invention as set forth in the claims below. It will be appreciated.

According to the present invention described above, a voice message transmission system and method using a terminal browser-based multimodal plug-in for providing a voice mail service and a voice message service using a plug-in providing a multi-modal function on a wireless Internet browser of a communication terminal. By implementing the, the effect of transmitting and receiving voice messages capable of visual and audio multi-mode through the user interface.

Claims (11)

A transmitting terminal for generating a predetermined voice message through a browser-based multimodal plug-in; A multi-modal platform for storing a voice message generated from the transmitting terminal and modulating the stored voice message through a preset modulation method; A content server for transmitting a voice message stored in the multi-modal platform in response to receiving a predetermined transmission request signal generated from the transmitting terminal; And And a receiving terminal for receiving and reproducing a voice message transmitted from the content server. The multi-modal platform, Recognizing and extracting the recipient name belonging to the voice message generated from the transmitting terminal through the ARS, and the terminal browser-based multi-modal, characterized in that for transmitting the telephone number of the receiving communication terminal matching the recipient name to the transmitting terminal Voice message transmission system using plug-in. delete The method of claim 1, wherein the multi-modal platform, And a digital modulation of the received voice message through a predetermined preconfigured modulation module. Generating, by the sending terminal, a predetermined voice message through a browser-based multimodal plug-in; The multi-modal platform stores the voice message generated from the transmitting terminal, modulates the stored voice message through a preset modulation method, and recognizes and extracts a recipient name belonging to the voice message generated from the transmitting terminal through ARS. Transmitting the telephone number of the receiving terminal matching the recipient name to the transmitting terminal; Transmitting a voice message stored in the multi-modal platform as a content server receives a predetermined transmission request signal generated from the transmitting terminal; And Receiving terminal receiving and playing the voice message transmitted from the content server; Voice message transmission method using a terminal browser-based multi-modal plug-in comprising a. delete The method of claim 4, wherein the multi-modal platform, And digitally modulating the received voice message through a predetermined preconfigured modulation module. A communication module unit for starting a predetermined browser to receive a multimodal plug-in for inputting additional information including a voice message and a telephone number of the communication terminal, a title of the voice message, or a modulation mode of the voice message; A display unit configured to display an input menu formed on the multi-modal plug-in; An input unit configured to receive a voice message and additional information through the input menu; And And a controller configured to control input and output of the voice message and additional information. And the control unit digitally converts the voice message to generate a WAV format. delete delete Starting a predetermined browser by the communication module to receive a multimodal plug-in supporting input of a voice message and additional information; Displaying, by a display unit, an input menu formed on the multi-modal plug-in; Receiving, by an input unit, a voice message and additional information through the input menu; A control unit controlling input and output of the voice message and additional information; And Generating, by the controller, a WAV format by digitally converting the voice message; Voice message transmission method of a communication terminal comprising a. delete

Images