KR20140107736A - Method for providing of voice message, apparatus and system for the same - Google Patents

Abstract

The present invention relates to a method for providing a voice message and, more particularly, to a method for providing a voice message, which can extract a keyword satisfying a predetermined condition from a voice message and generate and display a text message including the extracted keyword while recognizing the voice message and converting the voice message into the text message according to the recognition result, when the voice message is received from any one terminal through a messenger program, and to a device and a system for the same. To this end, a terminal according to an embodiment of the present invention comprises an output unit which outputs one or more pieces of information generated during execution of a messenger program; and a control unit which is functionally connected to the output unit, generates a text message including a predetermined keyword through an applied voice message when the voice message is applied during the execution of the messenger program, and controls the generated text message to be output through the output unit.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice message providing method,

The present invention relates to a method of providing a voice message, and more particularly, to a method and apparatus for receiving a voice message from a terminal through a messenger program, and recognizing the voice message and converting the voice message into a text message The present invention relates to a voice message providing method and apparatus, and a system therefor, which can generate and display a text message including the extracted keyword after extracting a keyword satisfying predetermined conditions in the voice message.

2. Description of the Related Art [0002] With the rapid development of information communication technologies, various types of terminals such as mobile communication terminals, personal computers, and the like have been implemented to perform various functions.

For example, the mobile communication terminal may be provided with various functions such as data communication, photographing or movie shooting using a camera, music or moving picture file playback, game, and broadcasting viewing. .

Technological developments for increasing the functions that can be performed on such terminals have been continuously carried out, and they have been continuously carried out mainly in hardware improvement technology and software improvement technology.

In recent years, the frequency of use of a messenger program capable of conducting a conversation has been continuously increasing by connecting and communicating with a large number of users after connecting to a communication network using such a terminal.

Through such a messenger program, a user generally generates a text message and transmits the generated text message to the counterpart terminal, thereby performing communication with the counterpart terminal. However, recently, the frequency of using a voice message is increasing.

However, even if the user receives the voice message through the messenger program, it is difficult to grasp the contents of the voice message when the environment of the current user is in a noisy environment, and the voice message itself is lost or deformed during transmission / reception There is a problem that it is difficult to reproduce the voice message itself.

Korean Patent Publication No. 10-2013-0011352, Jan. 30, 2013 (name: voice-based message service system, terminal device for the same, voice-based message service method therefor)

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above-described problems, and it is an object of the present invention to solve the problem that it is difficult to grasp the contents of a voice message transmitted and received through a messenger program, Recognizes the voice message and converts the voice message into a text message according to a recognized result, extracts a predetermined keyword from the voice message, and generates a voice message including a generated text message including the extracted keyword Method, apparatus and system therefor.

According to another aspect of the present invention, there is provided a terminal comprising: an output unit outputting one or more pieces of information generated during execution of a messenger program; And a control unit operable to generate a text message including a predetermined keyword through an authorized voice message when the voice message is applied during execution of the messenger program and to control the generated text message to be output through the output unit, ; ≪ / RTI >

In this case, the voice recognition unit may proceed with voice recording at the request of the user to generate a voice message. And a communication unit that transmits and receives one or more information generated through a messenger program to at least one of the counterpart terminals, wherein when the voice message is applied through the voice recognition unit or a voice message is received through the communication unit, A text message including a predetermined keyword can be generated.

At this time, when the voice message is received through the voice recognition unit in the messenger program dialog window, the control unit generates a text message including a predetermined keyword through the authorized voice message, and transmits the generated text message to the one So that the other party terminal can be controlled to be transmitted through the communication unit.

At this time, if a user input corresponding to a predetermined condition is detected during the execution of the messenger program, the control unit may request the speech recognition unit to generate a voice message and control the voice message to be generated.

The user input corresponding to the predetermined condition may be any one of a touch, a swipe, a drag and drop, a gesture, a line of sight, and a shake in a specific direction.

In addition, the control unit recognizes the voice message to convert it into text, extracts a keyword satisfying a predetermined condition from the converted text, and controls the text message to include a extracted keyword.

At this time, the predetermined condition may be set to extract a keyword corresponding to a noun, a number, or a URL (Uniform Resource Locator), or to analyze a size of a voice to extract a keyword having a voice size of a certain level or more.

In addition, the control unit can generate a text message including only the extracted keywords.

In addition, the control unit recognizes the voice message and converts it into text, generates a text message including the converted text, extracts a keyword satisfying predetermined condition from the text, Message can be generated.

If the extracted keyword includes information on a specific time, the control unit may control to display a notification message through the output unit at the corresponding time.

In addition, the control unit may control the icon corresponding to the voice message to be output through the output unit.

According to an aspect of the present invention, there is provided a service device including a service communication unit for transmitting and receiving various information through one or more terminals and a messenger program; And a service communication unit, wherein when a voice message transmitted from any one of the terminals, in which the messenger program is running, to at least one other party terminal is received through the service communication unit, a text message including a predetermined keyword And a service controller for controlling the generated text message and voice message to be transmitted to the counterpart terminal through the service communication unit.

At this time, the service control unit recognizes the voice message and converts it into text, extracts a keyword satisfying a predetermined condition from the converted text, and controls to generate a text message including the extracted keyword.

In addition, the service control unit can generate a text message including only the extracted keywords.

In addition, the service control unit recognizes the voice message and converts it into text, generates a text message including the converted text, extracts a keyword satisfying a predetermined condition from the text, To be transmitted to the counterpart terminal.

According to another aspect of the present invention, there is provided a messenger system including: a terminal for transmitting a generated voice message to at least one counterpart terminal when a voice message is generated during execution of a messenger program; And a service device for generating a text message including a predetermined keyword through a voice message when the voice message transmitted from the terminal to the opposite terminal is received and for transmitting the generated text message and voice message to the opposite terminal, .

According to another aspect of the present invention, there is provided a method for providing a voice message, the method comprising: receiving a voice message transmitted from a terminal in which a messenger program is executed to at least one other terminal; The service device recognizing a voice message and converting the voice message into text; Extracting a keyword satisfying a preset condition from the text converted by the service device, and generating a text message including the extracted keyword; And transmitting the voice message and the text message to the correspondent terminal by the service apparatus.

In this case, before the step of receiving the voice message, the terminal detects a user input corresponding to a predetermined condition during execution of the messenger program; The terminal proceeds to voice recording to generate a voice message; And transmitting the voice message to the service device to transmit the voice message to the counterpart terminal.

At this time, the step of generating a text message may generate a text message including only the keyword extracted by the service apparatus.

At this time, in the step of generating a text message, the service device generates a text message including the converted text, extracts a keyword satisfying a predetermined condition from the text, and then transmits a text message having a preset effect to the extracted keyword Can be generated.

Further, the present invention can provide a computer-readable recording medium on which a program for executing the above-described voice message providing method is recorded.

According to the method and apparatus for providing a voice message of the present invention, a voice message transmitted and received through a messenger program is recognized and converted into a text message, a keyword satisfying predetermined conditions is extracted from the voice message, The contents of the voice message can be easily grasped.

Thus, a new additional service can be provided to a user using the messenger program.

1 is a schematic configuration diagram of a messenger system according to an embodiment of the present invention.
2 is a block diagram showing a main configuration of a terminal according to an embodiment of the present invention.
3 is a block diagram illustrating a main configuration of a service apparatus according to an embodiment of the present invention.
4 is a data flow chart for explaining a method of providing a voice message according to an embodiment of the present invention.
5 to 8 are diagrams for explaining a method of providing a voice message according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the detailed description of known functions and configurations incorporated herein will be omitted when it may unnecessarily obscure the subject matter of the present invention. This is to omit the unnecessary description so as to convey the key of the present invention more clearly without fading. Also, the terms first, second, etc. are used for describing various components and are used only for the purpose of distinguishing one component from another component, and are not used to define the components.

The same reference numerals are used for portions having similar functions and functions throughout the drawings.

In addition, the terminal of the present invention can be implemented in various forms. For example, the terminal described in the present specification may be a mobile terminal such as a smart phone, a tablet PC, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), an MP3 player, (Smart TV), a desktop computer, or the like can be used. Any device capable of transmitting / receiving a message to / from another user through a communication network can be applied to the terminal of the present invention.

Hereinafter, a messenger system according to an embodiment of the present invention will be described.

1 is a schematic configuration diagram of a messenger system according to an embodiment of the present invention.

Referring to FIG. 1, a messenger system 100 of the present invention may include a plurality of terminals 10, a service apparatus 20, and a communication network 30.

First, a plurality of terminals 10 are devices that can transmit and receive messages with one or more counterpart terminals through a messenger program, transmit and receive contents and share them, and can be used by a user.

Here, the messenger program may be provided by the service device 20 and may be a program capable of providing an instant messaging service. Such a messenger program may be downloaded from the service device 20 and installed in the terminal 10. Even if the terminal 10 does not install the messenger program, the messenger program may be connected to the service device 20 to transmit the messenger program in a cloud service manner It can also be used.

Such a terminal 10 can execute a messenger program and display a messenger program execution screen (e.g., an initial screen, a dialog window screen, etc.). Here, the messenger program may be executed according to a request of the user or may be executed upon occurrence of a specific event. The instant messenger program of the terminal 10 can be executed when a specific event occurs, such as when a message is received from the other party or when specific information is received from the service device 20. [

In particular, the terminal 10 according to the embodiment of the present invention can generate a voice message during the execution of the messenger program and transmit the generated voice message to one or more specified opposite terminals. Here, for convenience of explanation, the first terminal 10a is a terminal used by a user, and the second terminal 10b can transmit / receive a text message or voice message to / from a user of the first terminal 10a through a messenger program It is assumed that the other terminal is a terminal, but the present invention is not limited thereto.

The terminal 10 of the present invention can generate a voice message during the execution of the messenger program and transmit the voice message to the counterpart terminal. For example, the first terminal 10a can transmit the generated voice message to the second terminal 10b connected through the dialog window of the messenger program.

Also, the first terminal 10a can receive a voice message from the second terminal 10b through a messenger program.

At this time, the first terminal 10a does not merely display the voice message, but recognizes the voice message and converts it into text, extracts a keyword satisfying a predetermined condition from the converted text, , And display the generated text message.

The main configuration and a more specific operation method of the terminal 10 according to the embodiment of the present invention will be described later.

The service device 20 plays a role of supporting transmission and reception of messages or contents among a plurality of terminals 10 through a messenger program. For example, when a message is input by the user of the first terminal 10a, the service device 20 transmits the message to one or more second terminals 10b connected through the dialog window of the messenger program, It is possible to control the entire process of transmitting the message to the first terminal 10a.

In addition, the service device 20 can store and provide a message or content being transmitted and received through a dialog window at the request of the user. In other words, in a state where the first terminal 10a and the one or more second terminals 10b are connected through a chat window of the instant messenger program, a user input corresponding to a predetermined condition on the dialog window of the first terminal 10a, For example, when a swipe operation in one direction is detected, the message or content transmitted and received through the dialog window can be stored, and the stored message or contents can be provided at any time according to the request of the user.

At this time, the message or contents transmitted / received through the messenger program of the terminal 10 may be stored and managed in the service device 20 rather than being stored in the terminal 10.

The user of the terminal 10 can also confirm the connection by checking the message or the contents exchanged with the counterpart by the user of the terminal 10 The user terminal 10 may include a process of performing a separate login process or the like to the service device 20. The process may also include a process of automatically connecting to the service device 20 even if the process such as login is not performed. The user can immediately confirm related information from the service device 20 through the one execution screen of the messenger program, and when a selection input for a specific object or a specific command displayed on the one execution screen is detected by the user It is possible to directly access the service name 20.

In addition, messages or contents transmitted and received through the messenger program can be simultaneously stored in the terminal 10 and the service device 20, and only a specific message or specific contents can be stored in the service device 20 according to the user's selection.

In addition, the service device 20 divides the subscribed users into user identifiers to provide a messenger program service to a plurality of terminals 10, and for each subscribed user, a status, a reception mode, a list of message recipients, Manage subscriber environment information, and manage IM chat sessions, i.e., chat channels, for delivering IM chat messages between on-line users connected to the Internet. The service device 20 can also perform SIP (Session Initiation Protocol) call processing and MSRP (Message Session Relay Protocol) relay functions. The service device 20 can communicate with a plurality of terminals such as a first terminal 10a and a second terminal (10b).

In particular, when receiving a voice message transmitted from the first terminal 10a to the second terminal 10b, the service apparatus 20 according to the embodiment of the present invention recognizes the voice message and converts the voice message into text. Then, the service device 20 extracts a keyword satisfying predetermined conditions from the converted text, generates a text message including the extracted keyword, and transmits the generated text message to the second terminal 10b together with the voice message .

Such a service device 20 may be implemented as a collection of various devices to support the operation as described above. For example, a database server capable of storing and managing various related information, a file server for file processing, a push server capable of automatically pushing relevant information to the terminal 10, and the like.

In addition, various servers can be implemented according to the system design method. In addition, the function corresponding to the server may be implemented in one service apparatus 20 as one module.

The main configuration and the more specific operation method of the terminal 10 and the service apparatus 20 as described above will be described later and the terminal 10 and the service apparatus 20 mounted on the service apparatus 20 according to the embodiment of the present invention The processor may process a program command for providing a voice message. In one implementation, the processor may be a single-threaded processor, and in other embodiments, the processor may be a multithreaded processor. Further, the processor is capable of processing instructions stored on a memory or storage device.

In addition, the connected state through the dialog window in the above-described present invention means a state in which a moving route, i.e., a session, is connected to a plurality of terminals 10 to transmit and receive a message.

For example, the first terminal 10a may select one or more second terminals 10b to which the first terminal 10a wishes to conduct a conversation to create a conversation window, 2 to the terminal 10b, and the like.

A plurality of terminals 10 and service apparatuses 20 according to an embodiment of the present invention transmit and receive various information related to each other through the communication network 30. The communication network 30 at this time uses various types of communication networks .

For example, a wireless communication method such as WLAN (Wireless LAN), Wi-Fi, WiBro, WiMAX, HSDPA or Ethernet, xDSL (ADSL, VDSL) , Hybrid Fiber Coaxial Cable (HFC), Fiber to the Curb (FTTC), and Fiber To The Home (FTTH).

In addition to the above-described communication methods, other widely known or later-developed communication methods may be included.

Hereinafter, the main configuration and operation method of the terminal 10 according to the embodiment of the present invention will be described.

2 is a block diagram showing a main configuration of a terminal according to an embodiment of the present invention.

1 and 2, a terminal 10 according to an embodiment of the present invention includes a communication unit 11, an input unit 12, a control unit 13, a storage unit 14, an output unit 15, (16). ≪ / RTI >

More specifically, the communication unit 11 plays a role of supporting transmission and reception of related information with the service apparatus 20 and one or more counterpart terminals.

For example, the communication unit 11 can transmit a message input by a user through a chat window screen of a messenger program to a partner terminal connected through a chat channel of the chat window screen, and receive a message from the partner terminal. In particular, the communication unit 11 according to the embodiment of the present invention can receive a voice message or a text message from the other party's terminal through a messenger program, and can transmit a voice message or a text message to one or more counterpart terminals.

In addition, the communication unit 11 can transmit various request information input from the user to the service device 20. [ The communication unit 11 can receive the messenger program related information from the service device 20. [

The input unit 12 transmits various signals such as numbers and character information input from the user, various functions, and signals inputted in relation to the function control of the terminal 10 to the control unit 13. In particular, the input unit 12 of the present invention executes a messenger program and supports input of a message from a user via a messenger program. In addition, the input unit 12 supports the input of the user's predetermined operation (touch, drag, swipe, etc.) on the messenger program execution screen for generating a voice message.

Here, the predetermined operation of the user may be inputted by at least one of a keypad and a touchpad that generates an input signal according to a user's touch or operation. That is, when the input unit 12 is configured in the form of one touch panel (or touch screen) together with the output unit 15, the touch of the user and the input of the drag or swipe operation in a specific direction Can be detected.

Also, the input unit 12 may sense an input of an arrow or the like of a keypad input from a user. Or the input unit 12 may support voice input of the user's voice, e.g., "left drag "," right drag ". In addition, when the input unit 12 includes gesture input means, the input unit 12 may sense a predetermined gesture of the user.

As described above, the input unit 12 may include a key input unit such as a keyboard or a keypad, a touch input unit such as a touch sensor or a touch pad, a voice input unit, a gyro sensor, a geomagnetism sensor, an acceleration sensor and a proximity sensor, And gesture input means including at least one or more gesture input means.

In addition, it can include all forms of input that are currently under development or can be developed in the future.

The control unit 13 performs overall control of the terminal 10 and may be an operating system (OS) and a process apparatus for driving each configuration, for example, a central processing unit (CPU) .

The controller 13 of the present invention is functionally connected to each component. That is, the control unit 13 is functionally connected to the communication unit 11, the input unit 12, the storage unit 14, the output unit 15, and the voice recognition unit 16, And controls the flow of signals for execution

In particular, the controller 13 according to the embodiment of the present invention can execute a messenger program and control various functions executed through the messenger program. The control unit 13 basically controls the execution of the messenger program when the user's request or occurrence of the preset event is detected, and controls the messenger program execution screen to be displayed on the output unit 15. [

In addition, the control unit 13 can select a specific party according to a request of the user through the messenger program, and support an overall process for transmitting or receiving a message or content with the other party. In addition, the control unit 13 may support various operations for performing various functions provided by the messenger program.

In particular, when the voice message is applied during execution of the messenger program, the control unit 13 generates a text message including a predetermined keyword through an authorized voice message, (15) to be output.

Here, the control unit 13 may generate a text message based on the voice message generated through the voice recognition unit 16, and may generate a text message based on the voice message received from the at least one counterpart terminal through the communication unit 11. [ Lt; / RTI >

In this case, when a voice message is generated through the voice recognition unit 16, if the user inputs corresponding to predetermined conditions are detected on one execution screen of the messenger program, for example, a conversation window screen, 16 to request the generation of a voice message. Here, the user input corresponding to the preset condition is displayed on the execution screen of the messenger program in a certain direction such as touch, swipe, drag & drop, gesture, movement of the eyes, shake It can be either. In addition to this, touch, drag, voice input, etc. can also be. In addition, specific directions can be diagonal as well as up, down, left, and right on the execution screen of the messenger program.

In addition, when a predetermined menu selection input is detected, the control unit 13 may request the voice recognition unit 16 to generate a voice message to generate a voice message.

Thereafter, the voice recognition unit 16 proceeds to voice recording until a voice recording progress completion command is given from the user, generates a voice message, and transmits the generated voice message to the control unit 13.

Thereafter, the control unit 13 recognizes the voice message and converts it into text, extracts a keyword satisfying predetermined conditions from the text, generates a text message including the extracted keyword, and outputs the generated text message (15).

For example, when the voice message is '7 o'clock today, and the appointment place is the chicken house of Gangnam Station', the control unit 13 recognizes the voice message and converts it into text first. Here, various known techniques can be applied to the process of recognizing a voice message and converting it into text. For example, the control unit 13 may first remove noise from the voice message and extract features for voice recognition. Further, the control unit 13 compares the extracted feature with the pre-stored speech model database, and when they match, outputs it as a recognition result, thereby converting the feature into text.

Thereafter, the control unit 13 extracts keywords that satisfy predetermined conditions in the converted text. Here, the predetermined condition may be set by the service device 20 serving the user or the messenger program, for example, a name, a number, or a specific condition.

For example, if the predetermined condition is to extract only the area name, the control unit 13 can extract only the 'Gangnam Station' from the voice message, 'Today is 7 o'clock, appointment place is chicken house in Gangnam Station'. If the predetermined condition is to extract only numbers, the control unit 13 can extract only '7' from the voice message. In addition, when the predetermined condition extracts only nouns, the control unit 13 can extract only the 'Chicken House at Gangnam Station at 7 o'clock appointment place today' in the above voice message.

In addition, the above-described exception can set conditions for keyword extraction from various viewpoints. For example, it is possible to extract only a specific URL (Uniform Resource Locator), a telephone number, and address information, and analyze the user's voice level so as to extract only words corresponding to a high voice volume.

In this way, the control unit 13 extracts the keywords satisfying the predetermined condition from the converted text, and then generates the text message including the extracted keyword. At this time, the control unit 13 can generate a text message including only the extracted keywords, and generate a text message including all the converted text. In addition, A text message may be generated by giving a predetermined effect such as an underline.

Then, the control unit 13 can transmit the generated text message and voice message to the counterpart terminal.

In addition, when receiving a voice message from any one of the other terminals through the communication unit 11, the control unit 13 generates a text message through the process described above, and transmits the received voice message and text message to the messenger program It may be controlled to be displayed through the dialog window screen.

At this time, the voice message may be outputted through the output unit 15 in the form of a predetermined icon corresponding to the voice message. Thereafter, the control unit 13 may output the voice message when a touch input or other preset input is detected from the user.

Thus, the user can easily grasp the contents of the voice message.

In addition, in the embodiment of the present invention, the voice message generated during the execution of the messenger program is converted into the text message form and displayed on the conversation window screen of the messenger program. However, the present invention is not limited to this, And can generate and display text messages in short message service (SMS) format.

In addition, when the control unit 13 recognizes the voice message and converts it into text, extracts a keyword satisfying predetermined conditions from the converted text, and if the extracted keyword includes information on a specific time , And can store it in the storage unit 14. For example, when the voice message is 'Feb. 16 at 7 pm, Kangnam station chicken house', the control unit 13 recognizes the voice message and generates a keyword (for example, date information and time information) February 16, 7 pm "can be extracted.

Then, the control unit 13 can store the extracted keyword information as schedule information in a schedule application, a diary application stored in the storage unit 14, and the like.

Thereafter, the control unit 13 may output the schedule information at the corresponding time, thereby providing a notification message to the user.

In order to control the above operation, the controller 13 may include a messenger control module 13a and a voice recognition module 13b.

Here, the messenger control module 13a controls the entire execution of the messenger program such as messenger execution, dialog window creation, etc. The voice recognition module 13b recognizes the voice message and generates a text message based on the result It can play a role of controlling the entire process.

In addition, the storage unit 14 may temporarily store various data generated during execution of the application program, including an application program required for the functional operation according to the embodiment of the present invention. In addition, the storage unit 14 may store the messenger program, and the message or the content information transmitted and received to at least one counterpart terminal through the messenger program may be stored. In particular, the storage unit 14 according to the embodiment of the present invention may store a voice message and a text message generated based on the voice message. In addition, the storage unit 14 may store information necessary to recognize a voice message, and may store condition information for extracting a specific keyword from the voice message.

The storage unit 14 may include a program area and a data area. The program area stores relevant information for driving the terminal 10, such as an operating system (OS) that boots the terminal 10. The data area is an area in which data generated according to the use of the terminal 10 is stored. Various information generated during the execution of the messenger program, for example, a voice message and a generated text message are stored based on the voice message . The storage unit 14 may be a flash memory, a hard disk, a multimedia card micro-type memory (e.g., SD or XD memory), a RAM, a ROM ROM), and the like.

In addition, in an embodiment of the present invention, a message or content information including a voice message or a text message transmitted through a messenger program or a messenger program is stored in the storage unit 14, And may be stored in the service device 20 in cooperation with the service device 20 in accordance with the cloud service method.

The output unit 15 outputs information on a series of operation states, operation results, and the like that occur while the terminal 10 is performing its functions. In particular, the output unit 15 of the present invention may include a display module (not shown) and a sound output module (not shown).

The display module (not shown) plays a role of displaying various information generated during the execution of the messenger program. For example, under the control of the controller 13, the icon corresponding to the voice message and the voice message A text message can be displayed.

The display module (not shown) may be implemented in the form of one touch panel (or touch screen) together with the input unit 12 as described above. When the display module is implemented together with the input unit 12, Various information generated according to the set operation, the drag and drop operation, and the like can be displayed.

The display module (not shown) may be a liquid crystal display (LCD), a thin film transistor (TFT) LCD, an organic light emitting diode (OLED), a light emitting diode (LED), an active matrix organic LED A flexible display and a three-dimensional display (three-dimensional display)

On the other hand, the sound source output module (not shown) converts the sound source, which is an electrical signal, into an analog signal and outputs the analog signal, and can output a voice message under the control of the controller 13.

Thus, the main configuration of the terminal 10 has been described with reference to FIG. However, all the components shown in FIG. 2 are not essential components of the terminal 10.

For example, the terminal 10 may further include a broadcast output unit capable of outputting a broadcast signal received from a broadcast transmission apparatus (not shown), a haptic module capable of outputting various information generated during the execution of the messenger program by vibration And the terminal 10 may be implemented by fewer components.

Hereinafter, the main configuration and operation method of the service apparatus 20 according to the embodiment of the present invention will be described.

3 is a block diagram illustrating a main configuration of a service apparatus according to an embodiment of the present invention.

1 and 3, the service apparatus 20 of the present invention may include a service communication unit 21, a service control unit 22, and a service storage unit 23.

Here, the service communication unit 21 may perform transmission and reception of various information related to one or more terminals 10 and a messenger program.

In particular, the service communication unit 21 can receive messages or contents transmitted and received between other terminals connected to any one of the terminals. Also, the service communication unit 21 may receive request information on various information from any one of the terminals 10 and provide the information to the terminal 10.

The service control unit 22 performs overall control of the service device 20 of the present invention. In particular, the service control unit 22 according to the embodiment of the present invention can perform various controls related to the messenger program.

For example, in order to provide a messenger program service to a plurality of terminals 10, the service control unit 22 divides the subscribed users into user identifiers, and for each subscribed user, a status, a reception mode, Manage environment information, and manage an IM chat session, i.e., a chat channel, for delivering IM chat messages between on-line users connected to the Internet. The service control unit 22 can perform SIP (Session Initiation Protocol) call processing, MSRP (Message Session Relay Protocol) relay, and the like. The service control unit 22 can provide a message or message between a plurality of terminals, Content transmission / reception becomes possible.

In particular, the service control unit 22 according to the embodiment of the present invention may be configured so that the messenger program is transmitted from any one of the terminals, for example, the first terminal 10a to one of the counterpart terminals such as the second terminal 10b When a voice message is received, a text message can be generated based on the voice message. At this time, the service control unit 22 recognizes the voice message and converts it into text, extracts a keyword satisfying a predetermined condition from the converted text, and generates a text message including the extracted keyword.

In the embodiment of the present invention, a process of generating a text message in a voice message centered on the terminal 10 has been described. However, the present invention is not limited thereto. As described above, the service device 20 may directly recognize a voice message and generate a text message.

To this end, the service control unit 22 may include a messenger management module 22a and a voice recognition module 22b. The messenger management module 22a may perform various functions for providing and controlling the messenger program between the plurality of terminals 10. The voice recognition module 22b may receive voice messages from any one of the terminals 10 , It is possible to control the entire process of recognizing the received voice message and converting it into a text message.

Various information generated during the use of the messenger program as described above may be stored in the service storage unit 23. [ In addition, the service storage unit 23 may store messages and content information exchanged between the terminal 10 and one or more other terminals, and the service control unit 22 may store the messages, content information, It is also possible to control so that the information is stored.

The service storage unit 23 may be a repository within the messenger system 100 or may be a separate data storage device located outside the messenger system 100 and capable of transmitting and receiving data with the service device 20. [

The service apparatus 20 according to the embodiment of the present invention has been described above.

As described above, the service apparatus 20 of the present invention can be implemented as one or more servers operating in a server-based computing mode or a cloud mode. In particular, the information transmitted and received through the messenger system 100 may be provided through a cloud computing function that can be permanently stored in a cloud computing device on the Internet. Here, cloud computing utilizes Internet technology in digital terminals such as desktops, tablet computers, laptops, netbooks and smart phones to provide virtualized IT (Information Technology) resources such as hardware (server, storage, (Database, security, web server, etc.), service, data, etc. on demand. In the present invention, all information transmitted and received between the plurality of terminals 10 and the service device 20 is stored in the cloud computing device on the Internet, and can be transmitted anywhere, anytime.

On the other hand, the memory mounted on the terminal 10 or the service apparatus 20 stores information in the apparatus. In one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in other embodiments, the memory may be a non-volatile memory unit. In one implementation, the storage device is a computer-readable medium. In various different implementations, the storage device may include, for example, a hard disk device, an optical disk device, or any other mass storage device.

Although the present specification and drawings describe exemplary device configurations, the functional operations and subject matter implementations described herein may be embodied in other types of digital electronic circuitry, or alternatively, of the structures disclosed herein and their structural equivalents May be embodied in computer software, firmware, or hardware, including, or in combination with, one or more of the foregoing. Implementations of the subject matter described herein may be embodied in one or more computer program products, i. E. One for computer program instructions encoded on a program storage medium of the type for < RTI ID = 0.0 & And can be implemented as a module as described above. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that affects the machine readable propagation type signal, or a combination of one or more of the foregoing.

Hereinafter, a method of providing a voice message according to an embodiment of the present invention will be described.

4 is a data flow chart for explaining a method of providing a voice message according to an embodiment of the present invention.

1 and 4, in an embodiment of the present invention, the first terminal 10a generates a voice message during the execution of the messenger program, and transmits the generated voice message to the specified one or more opposite terminals, And the second terminal 10b is a terminal of the user who receives the message transmitted from the first terminal 10a. However, the present invention is not limited thereto, The first terminal 10a and the second terminal 10b may perform the same function.

Hereinafter, a method of providing a voice message according to an embodiment of the present invention will be described with reference to FIG.

When the first terminal 10a executes the messenger program (S101), the first terminal 10a can generate a voice message according to the request of the user (S103). At this time, the first terminal 10a can activate a voice recording function to generate a voice message when a user input corresponding to predetermined conditions is detected on a messenger program execution screen, in particular, a conversation window screen of a messenger program.

Then, the generated voice message is transmitted to the other terminal (e.g., the second terminal 10b) through the dialog window of the messenger program (S105).

The service device 20 that manages the transmission and reception of messages between the first terminal 10a and the second terminal 10b through the messenger program receives the voice message transmitted from the first terminal 10b to the second terminal 10b The voice message is recognized (S107) and converted into text (S109). Thereafter, the service device 20 extracts a keyword satisfying a predetermined condition from the changed text (S111), and generates a text message including the extracted keyword.

Thereafter, the service device 20 transmits the voice message received from the first terminal 10a and the text message generated based on the voice message to the second terminal 10b, and the second terminal 10b transmits the voice message, Messages and text messages will be displayed on the chat window of Messenger program.

At this time, the voice message and the text message transmitted to the second terminal 10b can also be displayed on the conversation window screen of the messenger program of the first terminal 10a.

This will be described in more detail with reference to FIGS. 5 to 8. FIG.

5 to 8 are diagrams for explaining a method of providing a voice message according to an embodiment of the present invention.

FIG. 5 shows a messenger program conversation window on the terminal of the user, for example, the first terminal 10a. The messenger program conversation window screen 505 may display information on the other terminal, for example, the user of the second terminal 10b connected through the messenger program conversation window screen, 10b. ≪ / RTI >

In the lower part of the dialog window, a content sharing screen display menu 501 for sharing various contents such as photos and music with the other terminal, a menu 502 for transmitting emoticons, stickers, etc. to the other terminal, An input field 503 for input, and the like.

In addition, it may further comprise a menu 504 for generating a voice message, and by selecting a menu 504 for the user of the first terminal 10a to generate the voice message, .

When a user input corresponding to a predetermined condition, such as a long touch, a drag, or a swipe, is detected on the conversation window screen, the voice recording function can be activated to proceed with voice recording. As shown in FIG. 6, when voice recording is performed, a message indicating that voice recording is proceeding is displayed, and the user touches the message window, clicks the message window, moves the message window, , The voice recording process can be terminated and a voice message can be generated.

Thereafter, as shown in FIG. 6, a message 507 for confirming whether or not to transmit to the counterpart terminal, that is, the second terminal 10b is displayed, and the user selects a transmit button to transmit a voice message Or cancel the transmission of the voice message by selecting the cancel button.

Here, when the user selects the transmission button, the service device 20 managing the chat session between the first terminal 10a and the second terminal 10b receives the request from the first terminal 10a to the second terminal 10a 10b. ≪ / RTI >

Then, the service device 20 recognizes the voice message and converts it into text, extracts a keyword satisfying predetermined conditions from the text, generates a text message including the extracted keyword, And a voice message to the second terminal 10b.

7 shows a dialog window screen of the messenger program in the second terminal 10b. The second terminal 10b transmits a voice message received from the first terminal 10b, as indicated by 508, Can be displayed together with the text message generated by the user.

Here, the text message may be configured to include only the keyword, if the text message is converted into text and a keyword satisfying predetermined conditions is extracted from the converted text. That is, as indicated by 508, a text message can be generated by including only a keyword corresponding to a predetermined condition (extracted only nouns) in a voice message, for example, 'Today's appointment is a chicken house in Gangnam Station'.

Also, as indicated by 509 in FIG. 8, a voice message is converted into text, and a text message including all of the converted text is generated, and a predetermined effect (for example, For example, an underline), and display the generated text message.

Accordingly, it is possible to convert a voice message generated during the use of the messenger program into a text message, extract a keyword satisfying predetermined conditions in the voice message, generate a text message including the extracted keyword, By generating the text message to which the predetermined effect is given, time and resources required for converting the voice message into the text message are reduced, and the user can more easily grasp the contents of the voice message.

Accordingly, the present invention can provide UX (User experience) of a new messenger program.

In the method of providing a voice message according to an exemplary embodiment of the present invention, the service device 20 recognizes a voice message and generates a text message including a keyword satisfying a predetermined condition. However, The terminal of the user who has generated the voice message may generate the text message based on the voice message and the terminal of the user who has received the voice message may generate the text message based on the voice message.

The method of providing the voice message according to the embodiment of the present invention has been described above.

The voice message providing method of the present invention as described above may be provided in the form of a computer readable medium suitable for storing computer program instructions and data. At this time, a computer-readable medium suitable for storing computer program instructions and data includes, for example, a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, a compact disk read only memory (CD-ROM) Optical media such as a DVD (Digital Video Disk), a magneto-optical medium such as a floppy disk, and a ROM (Read Only Memory), a RAM , Random Access Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM). The processor and memory may be supplemented by, or incorporated in, special purpose logic circuits. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

While the specification contains a number of specific implementation details, it should be understood that they are not to be construed as limitations on the scope of any invention or claim, but rather on the description of features that may be specific to a particular embodiment of a particular invention Should be understood. Certain features described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments, either individually or in any suitable subcombination. Further, although the features may operate in a particular combination and may be initially described as so claimed, one or more features from the claimed combination may in some cases be excluded from the combination, Or a variant of a subcombination.

Likewise, although the operations are depicted in the drawings in a particular order, it should be understood that such operations must be performed in that particular order or sequential order shown to achieve the desired result, or that all illustrated operations should be performed. In certain cases, multitasking and parallel processing may be advantageous. Also, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products It should be understood.

It should be noted that the embodiments of the present invention disclosed in the present specification and drawings are only illustrative of specific examples for the purpose of understanding and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

The present invention relates to a method of providing a voice message, and more particularly, to a method and apparatus for receiving a voice message from a terminal through a messenger program, and recognizing the voice message and converting the voice message into a text message The present invention relates to a voice message providing method and apparatus, and a system therefor, which can generate and display a text message including the extracted keyword after extracting a keyword satisfying predetermined conditions in the voice message.

According to the present invention, when a voice message is received while using the messenger program, the contents of the voice message can be easily grasped by generating a text message including a keyword that satisfies predetermined conditions by recognizing the received voice message , Thereby contributing to the development of the messenger service industry.

In addition, the present invention is industrially applicable because it is not only commercially available or operable but is practically and practically practicable.

10: terminal 11: communication unit 12: input unit
13: control unit 13a: messenger control module 13b: voice recognition module
14: storage part 15: output part 20: service device
21: service communication unit 22: service control unit 22a: messenger management module
22b: voice recognition module 23: service storage unit 30: communication network
100: Messenger system

Claims (21)

An output unit for outputting at least one information generated during execution of the messenger program; And
Wherein when the voice message is applied during execution of the messenger program, a text message including a predetermined keyword is generated through the authorized voice message, and the generated text message is output through the output unit A control unit for controlling the control unit;
And a terminal device. The method according to claim 1,
A voice recognition unit for performing a voice recording according to a request of a user to generate a voice message; And
A communication unit for transmitting and receiving at least one information generated through the messenger program to one or more counterpart terminals;
Further comprising:
The control unit
And generates a text message including a predetermined keyword through the authorized voice message when a voice message is received through the voice recognition unit or a voice message is received through the communication unit. 3. The method of claim 2,
The control unit
And generating a text message including a predetermined keyword through the authorized voice message when the voice message is received through the voice recognition unit in the messenger program conversation window screen and transmitting the generated text message through the conversation window screen And controls the at least one counterpart terminal to be transmitted through the communication unit. 3. The method of claim 2,
The control unit
Wherein the control unit requests the voice recognition unit to generate a voice message to generate a voice message when a user input corresponding to a preset condition is detected during execution of the messenger program. 5. The method of claim 4,
The user input corresponding to the preset condition
Wherein the terminal is one of a touch in a specific direction, a swipe, a drag & drop, a gesture, a gaze movement, and a shake. The method according to claim 1,
The control unit
Recognizes the authorized voice message and converts it into text, extracts a keyword satisfying predetermined conditions from the converted text, and generates a text message including the extracted keyword. The method according to claim 6,
The predetermined condition is
Wherein the keyword is set to extract a keyword corresponding to a noun, a number, and a URL (Uniform Resource Locator), or to analyze a size of a voice to extract a keyword having a voice size of a certain level or higher. The method according to claim 6,
The control unit
And generates a text message including only the extracted keyword. The method according to claim 6,
The control unit
Recognizing the voice message and converting the text message into text, generating a text message including the converted text, extracting a keyword satisfying a preset condition from the text, And generates a message. The method according to claim 6,
Wherein if the extracted keyword includes information on a specific time, the control unit controls to display a notification message through the output unit at the corresponding time. The method according to claim 1,
The control unit
And controls the icon corresponding to the voice message to be output through the output unit. A service communication unit for transmitting and receiving various information through one or more terminals and a messenger program; And
Wherein when a voice message transmitted from any one of the MSs to the at least one other MS is received through the service communication unit, A service controller for generating a text message and controlling the generated text message and the voice message to be transmitted to the counterpart terminal through the service communication unit;
Wherein the service device comprises: 13. The method of claim 12,
The service control unit
Recognizes the voice message and converts the text message into text, extracts a keyword satisfying predetermined conditions from the converted text, and generates a text message including the extracted keyword. 14. The method of claim 13,
The service control unit
And generates a text message including only the extracted keyword. 14. The method of claim 13,
The service control unit
Recognizing the voice message and converting the text message into text, generating a text message including the converted text, extracting a keyword satisfying a predetermined condition from the text, assigning a predetermined effect to the extracted keyword, To be transmitted to the counterpart terminal. A terminal for transmitting the generated voice message to at least one counterpart terminal when a voice message is generated during execution of the messenger program; And
A service providing unit for generating a text message including a predetermined keyword through the voice message when the voice message transmitted from the terminal to the counterpart terminal is received and transmitting the generated text message and the voice message to the counterpart terminal, ;
The messenger system comprising: The method comprising the steps of: receiving a voice message transmitted from a terminal to which at least one counterpart terminal is currently executing a messenger program;
The service device recognizing the voice message and converting the voice message into text;
Extracting a keyword satisfying a predetermined condition from the converted text, and generating a text message including the extracted keyword; And
Transmitting the voice message and the text message to the counterpart terminal;
And transmitting the voice message to the user. 18. The method of claim 17,
Prior to the step of receiving the voice message,
Detecting a user input corresponding to a predetermined condition during execution of the messenger program by the terminal;
The terminal proceeds to voice recording to generate a voice message; And
Transmitting the voice message to the service device to transmit the voice message to the counterpart terminal;
The method of claim 1, further comprising: 18. The method of claim 17,
The step of generating the text message
Wherein the service device generates a text message including only the extracted keyword. 18. The method of claim 17,
The step of generating the text message
The service device generates a text message including the converted text, extracts a keyword satisfying a predetermined condition from the text, and generates a text message to which the predetermined effect is given to the extracted keyword. / RTI > A computer-readable recording medium having recorded thereon a program for executing the method of providing a voice message according to any one of claims 17 to 20.

Images