KR101363866B1 - Method for generating of voice message, apparatus and system for the same - Google Patents

Abstract

The present invention relates to a method for generating a voice message in a messenger program and more specifically, to a method for generating a voice message, an apparatus and a system for the same capable of generating a voice message more simply and transmitting the generated voice message to at least one opposing terminal connected through a conversation window screen, by generating the voice message by proceeding voice recording, if a voice message processing area is displayed and maintained for a fixed time, under the state that the conversion window screen of the messenger program is displayed. A terminal according to an embodiment of the present invention for the above objective includes: an output part for outputting various information generated during the execution of the messenger program constituted to transmit and receive an instant message with at least one opposing terminal; a voice recognition part for generating a voice message by proceeding voice recording; and a control part connected to the output part and the voice recognition part functionally. The control part controls a voice message processing area to be displayed through the output part under the state that the conversation window screen of the messenger program is displayed, and then can control the voice recognition part to proceed the voice recording, if the voice message processing area is maintained for a fixed time. [Reference numerals] (AA) Start; (BB) End; (S101) Execute a messenger program; (S103) Display a conversation window screen; (S105) Is user input corresponding to a pre-set condition sensed?; (S107) Display a voice message processing area; (S109) Does user input continue for more than fixed time?; (S111) Proceed to record voice; (S113) User input end?; (S115) Generate a voice message; (S117) Transmit the voice message to an opposing terminal

Description

Method for generating a voice message, apparatus and system for the same

The present invention relates to a method of generating a voice message in a messenger program. More particularly, when a voice message processing area is displayed and maintained for a predetermined time while a chat window screen of a messenger program is displayed, the voice recording is performed. The present invention relates to a voice message generating method and apparatus and system for generating a voice message, and to easily generate a voice message and to transmit the generated voice message to one or more counterpart terminals connected through the chat window screen.

2. Description of the Related Art [0002] With the rapid development of information communication technologies, various types of terminals such as mobile communication terminals, personal computers, and the like have been implemented to perform various functions.

For example, the mobile communication terminal may be provided with various functions such as data communication, photographing or movie shooting using a camera, music or moving picture file playback, game, and broadcasting viewing. .

Technological developments for increasing the functions that can be performed on such terminals have been continuously carried out, and they have been continuously carried out mainly in hardware improvement technology and software improvement technology.

In recent years, the frequency of use of a messenger program capable of conducting a conversation has been continuously increasing by connecting and communicating with a large number of users after connecting to a communication network using such a terminal.

Through such a messenger program, a user may create a text message and transmit the generated text message to the counterpart terminal, thereby communicating with the counterpart terminal, and furthermore, may communicate with the counterpart terminal using a voice message. .

However, in order for a user to generate a voice message through a messenger program, after confirming a menu providing a voice message generating function, the user may move to a corresponding menu and select and input the menu to generate a voice message. This process is a process that requires a plurality of user operations, there is a problem that a lot of inconvenience follows from the user's point of view.

In addition, even if a user receives a voice message through a messenger program, when the current environment of the user is noisy, it is difficult to grasp the contents of the voice message, and the voice message itself may be lost or modified in the process of being transmitted or received. In this case, there is a problem that it is difficult to reproduce the voice message itself.

Korean Patent Publication No. 10-2013-0011352, Jan. 30, 2013 (name: voice-based message service system, terminal device for the same, voice-based message service method therefor)

The present invention has been proposed to solve the above-mentioned problems. When the voice message processing area is displayed and maintained for a predetermined time while the chat window screen of the messenger program is being displayed, voice recording is performed by performing voice recording. It is an object of the present invention to provide a voice message generating method, an apparatus and a system therefor, which can generate and transmit a generated voice message to one or more counterpart terminals connected through the chat window screen.

In addition, the present invention, after recognizing a voice message and extracting a predetermined keyword from the voice message, generates a text message including the extracted keyword, the voice message generating method that can be transmitted to the counterpart terminal with the voice message, It is an object to provide an apparatus and system for this purpose.

According to an aspect of the present invention, there is provided a terminal including: an output unit configured to output various information generated during execution of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal; A voice recognition unit for generating a voice message by performing voice recording; And a control unit that is functionally connected to the output unit and the voice recognition unit, wherein the control unit displays a voice message processing area through the output unit while a chat window screen of the messenger program is displayed through the output unit. After the control is performed, if the displayed voice message processing area is maintained for a predetermined time, the voice recognition unit may be controlled to proceed with voice recording.

In this case, the terminal further includes an input unit for supporting a user input, wherein the control unit is a state in which the dialog window screen is displayed, if the user input corresponding to a preset condition is detected through the input unit, the voice message The processing region may be controlled to be displayed through the output unit, and if the user input is continued, the voice recording may be controlled to proceed.

The user input corresponding to the preset condition may be any one of a touch, a swipe in one direction, a touch and drag, a gesture, a gaze movement, and a shake on the conversation window screen. Can be.

The controller may control the voice recognition unit to terminate the voice recording so that a voice message is generated when the user input is terminated.

In addition, the terminal further comprises a communication unit for transmitting and receiving a variety of information generated through the messenger program with one or more counterpart terminal, the control unit is a voice message generated through the voice recognition unit via the communication window screen It may be controlled to be transmitted to the other terminal connected through.

The controller may be configured to display the voice message processing area on a certain area within the chat window screen, move the chat window screen in one direction and simultaneously display the moved chat window screen, or switch from the chat window screen. Only the voice message processing area may be controlled to be displayed through the output unit.

The controller may control to display at least one of an icon indicating that voice recording is in progress and a voice recording progress bar through the voice message processing area while the voice recording is in progress.

In this case, the voice recording progress bar may include at least one of recording progress status information, recording progress time information, and maximum recordable time information.

The controller may generate a text message including a predetermined keyword in the voice message generated by the voice recognition unit when the voice recording is terminated.

In this case, the controller may control to display an icon indicating that the voice message is being analyzed through the voice message processing area while the text message is generated.

The controller may control the voice message processing area not to be displayed when the text message generation is completed.

The controller may control a voice message generation failure message to be output through the output unit when the user input is terminated while the user input is not maintained for a predetermined time or more.

According to an aspect of the present invention, there is provided a service device including a service communication unit for transmitting and receiving various information through one or more terminals and a messenger program; And a voice message processing area display information received from any one terminal which is functionally connected to the service communication unit and the chat window screen of the messenger program is displayed through the service communication unit, and receives a voice to the terminal through the service communication unit. And a service control unit for transmitting recording request information and controlling the service communication unit to transmit voice recording end request information to the terminal when the voice message processing region inactive information is received from the terminal through the service communication unit. Can be.

In this case, after the voice control unit transmits the voice recording end request information to the terminal and receives a voice message generated through the service communication unit from the terminal, the service control unit communicates the received voice message through the service communication unit. It may be controlled to be transmitted to the connected counterpart terminal through the window screen.

The service control unit recognizes the voice message received from the terminal, converts the voice message into text, extracts a keyword satisfying a predetermined condition from the converted text, and then generates a text message including the extracted keyword. The received voice message and the generated text message may be controlled to be transmitted to the counterpart terminal through the service communication unit.

Here, the preset condition may be a condition set to extract a keyword corresponding to a noun, a number, and a Uniform Resource Locator (URL), or to analyze a voice size to extract a keyword having a predetermined size or more. .

The service controller may generate a text message including only the extracted keywords.

The service controller may recognize the voice message, convert the voice message into text, generate a text message including the converted text, extract a keyword satisfying a predetermined condition from the text, and extract the keyword from the text. It is possible to generate a text message given a set effect.

In the messenger system according to an embodiment of the present invention for achieving the above object, in a state where a chat window screen of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal is displayed, When the message processing area is displayed and maintained for a predetermined time, the terminal proceeds with voice recording to generate a voice message and transmits the generated voice message to at least one counterpart terminal; And receiving a voice message transmitted from the terminal to the counterpart terminal, generating a text message including a predetermined keyword through the voice message, and transmitting the generated text message and the voice message to the counterpart terminal. Apparatus; can be configured to include.

According to an aspect of the present invention, there is provided a method of generating a voice message, the method comprising: displaying, by a terminal, a chat window screen of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal; ; Displaying, by the terminal, a voice message processing area; Determining, by the terminal, whether the voice message processing area is maintained for a predetermined time or more while the voice message processing area is displayed; And if the voice message processing area is maintained for a predetermined time or more, performing a voice recording by the terminal.

In this case, the displaying of the voice message processing area may include: determining, by the terminal, a user input corresponding to a preset condition on the chat window screen; And when the user input corresponding to the preset condition is detected, displaying, by the terminal, the voice message processing area.

Here, in the determining whether the terminal is maintained for a predetermined time or more, the terminal may determine whether the user input lasts for a predetermined time or longer.

In addition, after the voice recording step, if the user input is terminated by the terminal, ending the voice recording to generate a voice message; Recognizing the voice message and converting the voice message into text; Generating, by the terminal, a keyword that satisfies a predetermined condition in the converted text, and then generating a text message including the extracted keyword; And transmitting, by the terminal, the voice message and the text message to at least one counterpart terminal connected through the chat window screen.

In addition, the present invention can provide a computer readable recording medium having recorded thereon a program for executing the voice message generating method as described above.

According to the method for generating a voice message of the present invention, an apparatus and a system therefor, when the voice message processing area is displayed and maintained for a predetermined time while the chat window screen of the messenger program is being displayed, the voice message is processed to record the voice message. It may be generated and transmitted to one or more counterpart terminals connected through the chat window screen.

Through this, a user using a messenger program can have an excellent effect of generating a voice message through a simpler and more intuitive user interface.

In addition, according to the voice message generating method, apparatus and system therefor, extracting a keyword satisfying a predetermined condition from the generated voice message, and then generating a text message including the extracted keyword and transmitting it to the counterpart terminal. In addition, the user as well as the counterpart receiving the voice message and the text message can more easily grasp the contents of the voice message.

1 is a schematic configuration diagram of a messenger system according to an embodiment of the present invention.
2 is a block diagram illustrating a main configuration of a terminal according to an exemplary embodiment of the present invention shown in FIG. 1.
3 is a block diagram illustrating a main configuration of a service apparatus according to an exemplary embodiment of the present invention illustrated in FIG. 1.
4 is a data flowchart illustrating a voice message generation method in a terminal according to an embodiment of the present invention.
5 is a flowchart illustrating a method of generating a voice message in a service apparatus according to another embodiment of the present invention.
6 to 14 are screen views illustrating a voice message generating method according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the detailed description of known functions and configurations incorporated herein will be omitted when it may unnecessarily obscure the subject matter of the present invention. This is to omit the unnecessary description so as to convey the key of the present invention more clearly without fading. While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. However, it should be understood that the invention is not limited to the specific embodiments thereof, It is to be understood that the invention is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Also, terms including ordinal numbers such as first, second, etc. are used to describe various elements, and are used only for the purpose of distinguishing one element from another, Not used. For example, without departing from the scope of the present invention, the second component may be referred to as a first component, and similarly, the first component may also be referred to as a second component.

In addition, when a component is referred to as being "connected" or "connected" to another component, it means that it may be connected or connected logically or physically. In other words, although a component may be directly connected or connected to other components, it should be understood that other components may exist in the middle, and may be connected or connected indirectly.

In addition, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In addition, the terms "comprises" or "having" described herein are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or the same. It is to be understood that the present invention does not exclude in advance the possibility of the presence or addition of other features, numbers, steps, operations, components, parts, or combinations thereof.

Now, a method of generating a voice message according to an embodiment of the present invention will be described in detail with reference to the drawings, and the same or corresponding components are denoted by the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. .

First, a messenger system according to an embodiment of the present invention will be described.

1 is a schematic configuration diagram of a messenger system according to an embodiment of the present invention.

Referring to FIG. 1, a messenger system 100 of the present invention may include a plurality of terminals 10, a service apparatus 20, and a communication network 30.

First, the plurality of terminals 10 are devices that can transmit and receive messages or share contents by transmitting and receiving messages with one or more counterpart terminals through a messenger program.

Here, the messenger program may be provided by the service device 20 and may be a program capable of providing an instant messaging service. Such a messenger program may be downloaded from the service device 20 and installed in the terminal 10. Even if the terminal 10 does not install the messenger program, the messenger program may be connected to the service device 20 to transmit the messenger program in a cloud service manner It can also be used.

Such a terminal 10 can execute a messenger program and display a messenger program execution screen (e.g., an initial screen, a dialog window screen, etc.). Here, the messenger program may be executed according to a request of the user or may be executed upon occurrence of a specific event. The instant messenger program of the terminal 10 can be executed when a specific event occurs, such as when a message is received from the other party or when specific information is received from the service device 20. [

In particular, the terminal 10 according to an exemplary embodiment of the present invention can more easily generate a voice message only by an intuitive operation of the user while executing a messenger program. In other words, when the chat window screen of the messenger program is being displayed, the voice message processing area is displayed according to a user's operation, and if the voice message processing area is maintained for a predetermined time, voice recording can be controlled to proceed. have. Thereafter, when the voice recording is terminated according to a user's manipulation, a voice message may be generated, and the voice message may be controlled to be transmitted to the counterpart terminal connected through the chat window screen.

For example, in a state where the first terminal 10a and the second terminal 10b are connected through a chat window screen of a messenger program, a voice message generated by the first terminal 10a is transmitted through a chat window screen. 10b), and may receive a voice message from the second terminal 10b.

In addition, the terminal 10 according to an embodiment of the present invention may generate or transmit a text message to the counterpart terminal based on the generated voice message or the voice message received from one counterpart terminal. In this case, the terminal 10 of the present invention recognizes the voice message, converts it into text, extracts a keyword satisfying a predetermined condition from the converted text, and then generates a text message including the extracted keyword. have.

The main configuration and more specific operation method of the terminal 10 according to an embodiment of the present invention will be described later.

The service device 20 plays a role of supporting transmission and reception of messages or contents among a plurality of terminals 10 through a messenger program. For example, when a message is input by the user of the first terminal 10a, the service device 20 transmits the message to one or more second terminals 10b connected through the dialog window of the messenger program, It is possible to control the entire process of transmitting the message to the first terminal 10a.

In addition, the service device 20 may store and manage a message or content currently being transmitted and received through a chat window according to a user's request. At this time, the message or contents transmitted / received through the messenger program of the terminal 10 may be stored and managed in the service device 20 rather than being stored in the terminal 10. In addition, messages or contents transmitted and received through the messenger program can be simultaneously stored in the terminal 10 and the service device 20, and only a specific message or specific contents can be stored in the service device 20 according to the user's selection.

In addition, the service device 20 divides the subscribed users into user identifiers to provide a messenger program service to a plurality of terminals 10, and for each subscribed user, a status, a reception mode, a list of message recipients, Manage subscriber environment information, and manage IM chat sessions, i.e., chat channels, for delivering IM chat messages between on-line users connected to the Internet. The service device 20 can also perform SIP (Session Initiation Protocol) call processing and MSRP (Message Session Relay Protocol) relay functions. The service device 20 can communicate with a plurality of terminals such as a first terminal 10a and a second terminal (10b).

In particular, when receiving a voice message transmitted from the first terminal 10a to the second terminal 10b, the service apparatus 20 according to the embodiment of the present invention recognizes the voice message and converts the voice message into text. Then, the service device 20 extracts a keyword satisfying predetermined conditions from the converted text, generates a text message including the extracted keyword, and transmits the generated text message to the second terminal 10b together with the voice message .

Such a service device 20 may be implemented as a collection of various devices to support the operation as described above. For example, a database server capable of storing and managing various related information, a file server for file processing, a push server capable of automatically pushing relevant information to the terminal 10, and the like.

In addition, various servers can be implemented according to the system design method. In addition, the function corresponding to the server may be implemented in one service apparatus 20 as one module.

The main configuration and more specific operation method of the terminal 10 and the service device 20 as described above will be described later, and are mounted in the terminal 10 and the service device 20 according to an embodiment of the present invention. The processor may process a program command for generating a voice message. In one implementation, the processor may be a single-threaded processor, and in other embodiments, the processor may be a multithreaded processor. Further, the processor is capable of processing instructions stored on a memory or storage device.

In addition, the state connected through the chat window according to the present invention described above means a state in which a mobile path, ie, a session, that can transmit and receive messages between a plurality of terminals 10 is connected.

For example, the first terminal 10a selects one or more second terminals 10b to conduct a conversation and generates a chat window, and the first terminal 10a receives one or more messages input from the user. 2 may be a concept including both the transmission to the terminal (10b).

A plurality of terminals 10 and service apparatuses 20 according to an embodiment of the present invention transmit and receive various information related to each other through the communication network 30. The communication network 30 at this time uses various types of communication networks .

For example, a wireless communication method such as WLAN (Wireless LAN), Wi-Fi, WiBro, WiMAX, HSDPA or Ethernet, xDSL (ADSL, VDSL) , Hybrid Fiber Coaxial Cable (HFC), Fiber to the Curb (FTTC), and Fiber To The Home (FTTH).

In addition to the above-described communication methods, other widely known or later-developed communication methods may be included.

Hereinafter, the main configuration and operation method of the terminal 10 according to the embodiment of the present invention will be described.

2 is a block diagram illustrating a main configuration of a terminal according to an exemplary embodiment of the present invention shown in FIG. 1.

1 and 2, a terminal 10 according to an embodiment of the present invention includes a communication unit 11, an input unit 12, a control unit 13, a storage unit 14, an output unit 15, (16). ≪ / RTI >

More specifically, the communication unit 11 plays a role of supporting transmission and reception of related information with the service apparatus 20 and one or more counterpart terminals.

For example, the communication unit 11 can transmit a message input by a user through a chat window screen of a messenger program to a partner terminal connected through a chat channel of the chat window screen, and receive a message from the partner terminal. In particular, the communication unit 11 according to the embodiment of the present invention can receive a voice message or a text message from the other party's terminal through a messenger program, and can transmit a voice message or a text message to one or more counterpart terminals.

In addition, the communication unit 11 can transmit various request information input from the user to the service device 20. [ Information corresponding thereto may be received from the service device 20.

The input unit 12 transmits various signals such as numbers and character information input from the user, various functions, and signals inputted in relation to the function control of the terminal 10 to the control unit 13. In particular, the input unit 12 of the present invention executes a messenger program and supports input of a message from a user via a messenger program. In addition, the input unit 12 supports a user input corresponding to a preset condition on a chat window screen of a messenger program for generating a voice message.

Here, the user input corresponding to a preset condition may be a touch input on the chat window screen. For example, various touch inputs such as a long touch, a short touch, and a double touch may be used. In addition, the user input corresponding to a preset condition may be any one of a swipe, a touch and drag, a gesture, a gaze movement, and a shake in one direction. For example, it may be a swipe in an upward direction, a gesture input in a left direction, or the like.

The input unit 12 supporting the user input may be configured with at least one of a keypad and a touch pad generating an input signal according to a user's touch or manipulation. In addition, when the input unit 12 is configured in the form of a single touch panel (or touch screen) together with the output unit 15, a user input on the touch panel may be sensed.

In addition, the input unit 12 may support input of a voice of a user, for example, a "left drag", a "right drag", or the like. In addition, when the input unit 12 includes gesture input means, the input unit 12 may sense a predetermined gesture of the user.

As described above, the input unit 12 may include a key input unit such as a keyboard or a keypad, a touch input unit such as a touch sensor or a touch pad, a voice input unit, a gyro sensor, a geomagnetism sensor, an acceleration sensor and a proximity sensor, And gesture input means including at least one or more gesture input means.

In addition, it can include all forms of input that are currently under development or can be developed in the future.

The controller 13 performs overall control of the terminal 10, and may be a process device that drives an operating system (OS) and each component, for example, a central processing unit (CPU). .

Such a control unit 13 of the present invention is functionally connected to each component. That is, the control unit 13 is functionally connected to the communication unit 11, the input unit 12, the storage unit 14, the output unit 15, and the voice recognition unit 16, And controls the flow of signals for execution

In particular, the controller 13 according to the embodiment of the present invention can execute a messenger program and control various functions executed through the messenger program. The control unit 13 basically controls the execution of the messenger program when the user's request or occurrence of the preset event is detected, and controls the messenger program execution screen to be displayed on the output unit 15. [

In addition, the control unit 13 can select a specific party according to a request of the user through the messenger program, and support an overall process for transmitting or receiving a message or content with the other party. In addition, the control unit 13 may support various operations for performing various functions provided by the messenger program.

In particular, the control unit 13 according to an embodiment of the present invention can control the voice message processing area to be displayed through the output unit 15 while the chat window screen of the messenger program is displayed through the output unit 15. Can be. Here, the voice message processing area may be displayed when a user input corresponding to a preset condition is detected through the input unit 12.

In this case, the user input corresponding to a preset condition is touched or swiped in one direction, touch and drag, gesture, eye movement, and shake on the conversation window screen as described above. It may be any one of. In addition, the voice input may be performed, and one direction may be a diagonal direction as well as up, down, left, and right on the chat window screen of the messenger program. In addition, the controller 13 may control the voice message processing area to be displayed when a selection input of a predetermined menu is detected by a user.

In addition, when the voice message processing area is displayed according to a user's operation, the controller 13 controls the display to be inserted into the chat window screen or moves the chat window screen in one direction and simultaneously with the moved chat window screen. It may be controlled to be displayed, or may be controlled to display only the voice message processing area by being called from the chat window screen.

In more detail, when the user input corresponding to a preset condition is detected in the chat window screen, for example, a touch and drag input starting from the bottom of the chat window screen and proceeding upward, the controller 13 displays the chat window screen. The voice message processing region may be controlled to be displayed in one region of the region, for example, a region where a message is displayed.

In addition, when a user input corresponding to a preset condition is detected in the chat window screen, for example, a touch and drag input starting from the right side of the chat window screen and proceeding in the left direction, the controller 13 moves the chat window screen in one direction, that is, to the left. Direction, and the voice message processing area is displayed at the same time as the moved chat window screen. Through this, the user can confirm that the chat window screen is moved according to the user input direction and the voice message processing area is pulled to the left and displayed. In this case, the chat window screen may be moved by only a predetermined distance, and the voice message processing area may be displayed by the distance that the chat window screen is moved.

After the above process, when the voice message processing region is displayed, the controller 13 determines whether the voice message processing region is maintained for a predetermined time. Maintaining for a certain time means that the user input as described above is maintained. In the above-described example, when the user input is a touch and drag input starting from the right side of the chat window screen and proceeding in the left direction, it means that the user's finger at the last point is continuously touching. In addition, when the user input is a line of sight movement in a diagonal direction, the line of sight at the last point is fixed.

When the user input is maintained for a predetermined time, for example, 3 seconds while the voice message processing area is displayed as described above, the controller 13 controls the voice recognition unit 16 to proceed with the voice recording.

In other words, the controller 13 requests the voice recognition unit 16 to generate a voice message. The voice recognition unit 16 activates the voice recording function according to a control command of the control unit 13 to record the information input through the microphone MIC.

Thereafter, the controller 13 continuously determines whether the user input is maintained. At this time, if the user input is terminated (for example, the user's finger is not touched) and no longer detected, the controller 13 transmits an end command to the voice recognition unit 16, and the voice recognition unit 16 The voice recorded until the end command is applied may be generated as a voice message and transmitted to the controller 13.

Thereafter, when the voice message is transmitted through the voice recognition unit 16, the controller 13 controls the voice message to be transmitted to one or more counterpart terminals connected through the chat window screen through the communication unit 11.

In addition, while the voice recording is in progress, the controller 13 may control at least one of an icon indicating that voice recording is in progress and a voice recording progress bar through the voice message processing area. In this case, the voice recording progress bar may control to display at least one of recording progress status information, recording progress time information, and maximum recordable time information.

In addition, after the voice message processing area is displayed, the controller 13 outputs a voice message generation failure message if the user input corresponding to a preset condition does not last for a predetermined time and the user input is terminated. Can be controlled to output through. For example, after displaying the voice message processing area, the controller 13 may control to generate a voice message by performing voice recording when a user input corresponding to a preset condition, for example, a touch input, lasts for 3 seconds or more. When the touch input lasts only 1 second, the voice message generation failure message of 'recording time is short' may be output through the output unit 15.

In addition, the controller 13 may recognize the generated voice message, generate a text message corresponding to the voice message, and control the generated text message to be transmitted to the counterpart terminal together.

In more detail, the controller 13 recognizes the voice message, converts the voice message into text, extracts a keyword satisfying a predetermined condition from the text, and generates and generates a text message including the extracted keyword. The text message may be controlled to be displayed through the output unit 15.

For example, when the generated voice message is '7 o'clock today, the appointment place is Gangnam Station Chicken House', the controller 13 recognizes the voice message and converts it into text. Here, various known techniques can be applied to the process of recognizing a voice message and converting it into text. For example, the control unit 13 may first remove noise from the voice message and extract features for voice recognition. Further, the control unit 13 compares the extracted feature with the pre-stored speech model database, and when they match, outputs it as a recognition result, thereby converting the feature into text.

Thereafter, the control unit 13 extracts keywords that satisfy predetermined conditions in the converted text. Here, the predetermined condition may be set by the service device 20 serving the user or the messenger program, for example, a name, a number, or a specific condition.

For example, if the predetermined condition is to extract only the area name, the control unit 13 can extract only the 'Gangnam Station' from the voice message, 'Today is 7 o'clock, appointment place is chicken house in Gangnam Station'. If the predetermined condition is to extract only numbers, the control unit 13 can extract only '7' from the voice message. In addition, when the predetermined condition extracts only nouns, the control unit 13 can extract only the 'Chicken House at Gangnam Station at 7 o'clock appointment place today' in the above voice message.

In addition, the above-described exception can set conditions for keyword extraction from various viewpoints. For example, it is possible to extract only a specific URL (Uniform Resource Locator), a telephone number, and address information, and analyze the user's voice level so as to extract only words corresponding to a high voice volume.

In this way, the control unit 13 extracts the keywords satisfying the predetermined condition from the converted text, and then generates the text message including the extracted keyword. At this time, the control unit 13 can generate a text message including only the extracted keywords, and generate a text message including all the converted text. In addition, A text message may be generated by giving a predetermined effect such as an underline.

Thereafter, the controller 13 may transmit the generated text message and the voice message to the counterpart terminal.

In addition, the controller 13 may control to display an icon indicating that the voice message is being analyzed through a voice message processing area while the text message is generated. When the text message is generated, the voice message may be displayed. The processing area can be controlled so that it is no longer displayed via the output unit 15.

In addition, when the voice message is received from one of the counterpart terminals through the communication unit 11, the controller 13 may generate a text message through the above-described process. In other words, if the user terminal supports the generation of a voice message and a corresponding text message, but the counterpart terminal supports only the voice message generation, if only the voice message is received from the counterpart terminal, the controller 13 directly controls the voice. A text message corresponding to the message may be generated and controlled to be output through the output unit 15.

When output through the output unit 15, the voice message may be output in the form of a predetermined icon corresponding to the voice message. Thereafter, the control unit 13 may output the voice message when a touch input or other preset input is detected from the user.

In addition, an embodiment of the present invention has been described with an example of converting a voice message generated during execution of a messenger program into a text message form and displaying the same through a chat window screen of the messenger program, but is not limited thereto. A text message may be generated in the form of a short message service (SMS). In this case, the voice message may be output through the chat window screen of the messenger program, and the text message in the form of a short message may be transmitted to the counterpart terminal through an SMS server or may be output through a menu supporting an SMS function.

In addition, when the control unit 13 recognizes the voice message and converts it into text, extracts a keyword satisfying predetermined conditions from the converted text, and if the extracted keyword includes information on a specific time , And can store it in the storage unit 14. For example, when the voice message is 'Feb. 16 at 7 pm, Kangnam station chicken house', the control unit 13 recognizes the voice message and generates a keyword (for example, date information and time information) February 16, 7 pm "can be extracted.

Then, the control unit 13 can store the extracted keyword information as schedule information in a schedule application, a diary application stored in the storage unit 14, and the like. Thereafter, the control unit 13 may output the schedule information at the corresponding time, thereby providing a notification message to the user.

In order to control the above operation, the controller 13 may include a messenger control module 13a and a voice processing module 13b.

Here, the messenger control module 13a controls the overall execution of the messenger program, such as messenger execution and conversation window generation, and the voice processing module 13b controls the process of displaying a voice message processing area or controls a voice message. Recognize and play a role in controlling the overall process of generating a text message based on the result.

In addition, the storage unit 14 may temporarily store various data generated during execution of the application program, including an application program required for the functional operation according to the embodiment of the present invention. In addition, the storage unit 14 may store a messenger program, and a message or content transmitted and received with one or more counterpart terminals through the messenger program may be stored. In particular, the storage unit 14 according to the embodiment of the present invention may store a voice message and a text message generated based on the voice message. In addition, the storage unit 14 may store information necessary to recognize a voice message, and may store condition information for extracting a specific keyword from the voice message.

The storage unit 14 may include a program area and a data area. The program area stores related information for driving the terminal 10 such as an operating system (OS) for booting the terminal 10. The data area is an area in which data generated according to the use of the terminal 10 is stored. Various information generated during the execution of the messenger program, for example, a voice message and a generated text message are stored based on the voice message . The storage unit 14 may be a flash memory, a hard disk, a multimedia card micro-type memory (e.g., SD or XD memory), a RAM, a ROM ROM), and the like.

In addition, an embodiment of the present invention will be described with reference to a configuration in which a messenger program or a message or content including a voice message or a text message transmitted and received through the messenger program is stored in the storage unit 14, but is not limited thereto. In other words, it may be stored in the service device 20 in association with the service device 20 according to the cloud service method.

The output unit 15 outputs information on a series of operation states, operation results, and the like that occur while the terminal 10 is performing its functions. In particular, the output unit 15 of the present invention may include a display module 15a and a sound source output module 15b.

The display module 15a serves to display various information generated during the execution of the messenger program. For example, the display module 15a displays a voice message processing area under the control of the controller 13, and displays various information through the voice message processing area. An icon, a status bar, etc. can be displayed. In addition, an icon corresponding to the voice message and a text message generated based on the voice message may be displayed.

As described above, the display module 15a may be implemented in the form of a single touch panel (or touch screen) together with the input unit 12, and when implemented together with the input unit 12, the user's preset Various information generated according to an operation may be displayed.

In addition, the display module 15a may be a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), organic light emitting diodes (OLED), a light emitting diode (LED), an active matrix organic LED (AMOLED), flexible The display may be configured as a flexible display and a three-dimensional display. Some of these displays may also be configured to be transparent or light transmissive so that they can be seen through. This can be configured as a transparent display including TOLED (Transparent OLED).

On the other hand, the sound source output module 15b converts a sound source, which is an electrical signal, into an analog signal and outputs the analog signal. The sound source output module 15b may output a voice message under the control of the controller 13.

The voice recognition unit 16 generates a voice message by performing voice recording under the control of the controller 13, and processes the analog information from the microphone MIC and the information input through the microphone MIC to process the voice message. It may be configured to include a processing module capable of generating a. In addition, in an embodiment of the present invention, the sound source of the voice recognition unit 16 capable of generating a voice message by processing information input through a microphone (MIC) and the output unit 15 capable of outputting the voice message. Although the output module 15b is illustrated separately, the present invention is not limited thereto. In some cases, the voice inset unit 16 and the sound source output module 15b may exist in the form of one sound source processor.

As described above, the main configuration of the terminal 10 has been described with reference to FIG. 2. However, not all components illustrated in FIG. 2 are essential components of the terminal 10.

For example, the terminal 10 may further include a broadcast output unit capable of outputting a broadcast signal received from a broadcast transmission apparatus (not shown), a haptic module capable of outputting various information generated during the execution of the messenger program by vibration And the terminal 10 may be implemented by fewer components.

It is needless to say that the positions of the major components of the terminal 10 shown in FIG. 2 can be changed for convenience or for other reasons. In addition, the module constituting the control unit 13 is illustrated as a messenger control module 13a and a voice processing module 13b, but is not limited thereto, and the control unit 13 may be configured with various modules that perform various functions. have.

The main configuration and operation method of the terminal 10 according to the embodiment of the present invention have been described above. The terminal 10 of the present invention can be implemented in various forms. For example, the terminal 10 described herein may be a mobile terminal such as a smart phone, a tablet PC, a PDA (personal digital assistant), a portable multimedia player (PMP) , A smart TV, a desktop computer, etc. may be used.

The terminal 10 of the present invention can not be enumerated because all the variations of the portable device according to the convergence (convergence) trend of the digital device, but the unit of the same level as the above-mentioned unit is a terminal according to the present invention It may also be used as (10), if the terminal that can send and receive messages with the terminal of one or more other users via the messenger service device 20 through the communication network 30, any device to the terminal 10 of the present invention Applicable

Hereinafter, the main configuration and operation method of the messenger service device 20 according to an embodiment of the present invention will be described.

3 is a block diagram illustrating a main configuration of a service apparatus according to an exemplary embodiment of the present invention illustrated in FIG. 1.

1 and 3, the service apparatus 20 of the present invention may include a service communication unit 21, a service control unit 22, and a service storage unit 23.

Here, the service communication unit 21 may perform transmission and reception of various information related to one or more terminals 10 and a messenger program.

In particular, the service communication unit 21 can receive messages or contents transmitted and received between other terminals connected to any one of the terminals. Also, the service communication unit 21 may receive request information on various information from any one of the terminals 10 and provide the information to the terminal 10.

The service control unit 22 performs overall control of the service device 20 of the present invention. In particular, the service control unit 22 according to the embodiment of the present invention can perform various controls related to the messenger program.

For example, in order to provide a messenger program service to a plurality of terminals 10, the service control unit 22 divides the subscribed users into user identifiers, and for each subscribed user, a status, a reception mode, Manage environment information, and manage an IM chat session, i.e., a chat channel, for delivering IM chat messages between on-line users connected to the Internet. In addition, the service controller 22 may perform a Session Initiation Protocol (SIP) call processing and a Message Session Relay Protocol (MSRP) relay function, and the like, and thus, a plurality of terminals, for example, the first terminal 10a and the second terminal. Messages or contents can be transmitted and received between the 10b.

In particular, the service control unit 22 according to an embodiment of the present invention transmits a voice message processing area from one terminal, for example, the first terminal 10a, through the service communication unit 21, on which a chat window screen of a messenger program is displayed. When the display information is received, the voice recording request information is transmitted to the first terminal 10a through the service communication unit 21, and a voice message processing area from the first terminal 10a through the service communication unit 21. When the deactivation information is received, the voice recording end request information may be transmitted to the first terminal 10a through the service communication unit 21.

Here, the voice message processing region display information may be information indicating that the voice message processing region is displayed through the first terminal 10a. As described above with reference to FIG. 2, the voice message processing area may be displayed according to a preset user input of the first terminal 10a. In addition, the first terminal 10a may transmit the voice message processing region display information to the service device 20 at a predetermined interval while the user input is maintained.

On the other hand, the voice message processing area deactivation information refers to a state in which the voice message processing area is displayed but the user input is terminated. In other words, the voice message processing area is displayed on the first terminal 10a according to a user input, and the user input is maintained after the user input is maintained for a predetermined time. In this case, the voice message processing area may be continuously displayed. When the user input is terminated, the service controller 22 transmits the voice recording end request information for generating a voice message with the voice recorded so far to the first terminal 10a.

Then, when the voice control unit 22 receives a voice message from the first terminal 10a through the service communication unit 21, the service control unit 22 connects the received voice message to the first terminal 10a through a chat window screen. For example, it may be controlled to be transmitted to the second terminal 10b.

In addition, the service controller 22 according to an embodiment of the present disclosure may generate a text message based on the received voice message when the voice message is received from the first terminal 10a. At this time, the service control unit 22 recognizes the voice message and converts it into text, extracts a keyword satisfying a predetermined condition from the converted text, and generates a text message including the extracted keyword.

In addition, in one embodiment of the present invention, when the service control unit 22 receives the voice message processing region display information from any one terminal 10, the service control unit 22 transmits the voice recording request information to the terminal 10, and the terminal ( When the voice message processing area deactivation information is received from 10), and after the voice recording end request information is transmitted to the terminal 10, if a voice message is received from the terminal 10, the text is based on the received voice message. Although a message is generated as an example, the present invention is not limited thereto. When a voice message is received from any one terminal 10 regardless of whether voice message processing region indication information and voice message processing region deactivation information are received, Only a process of generating a text message may be controlled based on the voice message.

In other words, in an embodiment of the present invention, a process of generating a voice message based on the terminal 10 and a process of generating a text message based on the voice message have been described, but are not limited thereto. When a voice message is generated through the process as described above at 10, the terminal 10 transmits the generated voice message to the service device 20, and the service device 20 transmits the text message based on the voice message. After generating a, it is possible to control the overall process of transmitting the generated text message to the terminal 10 and the other terminal.

To this end, the service control unit 22 may include a messenger management module 22a and a voice processing module 22b. The messenger management module 22a may perform various functions for providing and controlling a messenger program between the plurality of terminals 10, and the voice processing module 22b generates a text message based on a voice message. Can be controlled.

Various information generated while using the messenger program as described above may be stored in the service storage unit 23. In addition, the service storage unit 23 may store messages, contents, and the like, which are exchanged with the terminal 10 and one or more counterpart terminals, and the service control unit 22 corresponds to the user identification information of the terminal 10. Can be controlled to be stored.

The service storage unit 23 may be a repository within the messenger system 100 or may be a separate data storage device located outside the messenger system 100 and capable of transmitting and receiving data with the service device 20. [

The service apparatus 20 according to the embodiment of the present invention has been described above.

As described above, the service apparatus 20 of the present invention can be implemented as one or more servers operating in a server-based computing mode or a cloud mode. In particular, the information transmitted and received through the messenger system 100 may be provided through a cloud computing function that can be permanently stored in a cloud computing device on the Internet. Here, cloud computing utilizes Internet technology in digital terminals such as desktops, tablet computers, laptops, netbooks and smart phones to provide virtualized IT (Information Technology) resources such as hardware (server, storage, (Database, security, web server, etc.), service, data, etc. on demand. In the present invention, all information transmitted and received between the plurality of terminals 10 and the service device 20 is stored in the cloud computing device on the Internet, and can be transmitted anywhere, anytime.

On the other hand, the memory mounted in the terminal 10 or the service device 20 stores information in the device. In one embodiment, the memory is a computer readable medium. In one implementation, the memory may be a volatile memory unit, and in other embodiments, the memory may be a non-volatile memory unit. In one embodiment, the storage device is a computer readable medium. In various different implementations, the storage device may include, for example, a hard disk device, an optical disk device, or any other mass storage device.

Although the present specification and drawings describe exemplary device configurations, the functional operations and subject matter implementations described herein may be embodied in other types of digital electronic circuitry, or alternatively, of the structures disclosed herein and their structural equivalents May be embodied in computer software, firmware, or hardware, including, or in combination with, one or more of the foregoing. Implementations of the subject matter described herein may be embodied in one or more computer program products, i. E. One for computer program instructions encoded on a program storage medium of the type for < RTI ID = 0.0 & And can be implemented as a module as described above. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that affects the machine readable propagation type signal, or a combination of one or more of the foregoing.

Hereinafter, a voice message generating method according to an embodiment of the present invention will be described.

4 is a data flowchart illustrating a voice message generation method in a terminal according to an embodiment of the present invention.

1 and 4, first, in order to generate a voice message according to an embodiment of the present invention, a messenger program must be executed in the terminal 10 (S101).

Thereafter, the terminal 10 may display a chat window screen of the messenger program according to a user's manipulation (S103). The terminal 10 determines whether a user input corresponding to a preset condition is detected while the chat window screen of the messenger program is being displayed (S105).

In this case, the user input corresponding to a preset condition may be any one of a touch, a swipe in one direction, a touch and drag, a gesture, a gaze movement, and a shake in the conversation window screen. Can be.

Thereafter, when a user input corresponding to a preset condition is detected, the terminal 10 displays a voice message processing area (S107). Here, the voice message processing area is displayed in a certain area within the chat window screen, or is displayed simultaneously with the chat window screen in which the chat window screen is moved in one direction and moved, or is switched in the chat window screen to process the voice message. Only areas can be displayed.

Then, the terminal 10 determines whether the user input detected in the step S105 is maintained for a predetermined time (S109), and if maintained for a predetermined time, proceeds with the voice recording (S111).

Thereafter, the terminal 10 determines whether the user input is terminated (S113), and when the user input is terminated, the terminal 10 generates a portion in which the recording is performed as a voice message (S115).

In other words, the terminal 10 according to an embodiment of the present invention displays a voice message processing area when a user input corresponding to a preset condition, for example, a touch and drag input upward direction, is detected on a chat window screen of a messenger program. If the user's touch input continues while the voice message processing area is displayed, voice recording is performed. If the touch input is no longer detected, voice recording is terminated to generate a voice message.

In addition, the user input corresponding to the preset condition in the step S105 and the user input corresponding to the preset condition in the step S109 may be different. For example, the user input corresponding to the preset condition in step S105 may be a touch and drag input in an upward direction, and the user input corresponding to the preset condition in step S109 may be a touch input at the end of the drag. Can be. In other words, when the user input is maintained for a predetermined time, when the touch and drag input in the upward direction is generated in step S105, the touch input at the end point of the drag is continued in step S109.

Thereafter, the terminal 10 may transmit the generated voice message to the counterpart terminal connected through the chat window screen (S117). Before the transmission, the terminal 10 recognizes the generated voice message and selects a predetermined keyword from the voice message. After generating a text message including a, the text message may be transmitted to the counterpart terminal together with the voice message.

In addition, the terminal 10 according to another embodiment of the present invention may support only a process until a voice message is generated, and a process of generating a text message based on the voice message may be performed under the control of the service device 20. have.

Hereinafter, a method of generating a voice message in the service device 20 according to another embodiment of the present invention will be described.

5 is a flowchart illustrating a method of generating a voice message in a service apparatus according to another embodiment of the present invention.

1 and 5, first, the service device 20 determines whether voice message processing region display information is received from any one terminal 10 in a standby state S201 (S203). Here, the standby state means that the service device 20 transmits and receives a message between the terminal and the terminal, for example, the first terminal 10a and the second terminal 10b connected through the chat window screen of the first terminal 10a and the messenger program. This refers to a state in which session control, message transmission control, and the like are performed.

Subsequently, when the voice message processing region display information is received from the terminal 10, the service apparatus 20 transmits voice recording request information to the terminal 10 (S205) and the voice message processing region from the terminal 10. When the deactivation information is received (S207), the voice recording end request information may be transmitted to the terminal 10 (S209).

The voice message processing region display information may be information indicating that the voice message processing region is displayed through the terminal, for example, the first terminal 10a. On the other hand, the voice message processing area deactivation information refers to a state in which the voice message processing area is displayed but the user input is terminated. In other words, the voice message processing area is displayed on the first terminal 10a according to a user input, and the user input is maintained after the user input is maintained for a predetermined time. In this case, the voice message processing area may be continuously displayed. When the user input is terminated, the service device 20 transmits the voice recording end request information to generate a voice message with the voice recorded so far to the first terminal 10a.

After that, when the voice message is received from the terminal 10 (S211), the service device 20 recognizes the voice message and converts the voice message into text (S213). Thereafter, the service device 20 extracts a keyword satisfying a predetermined condition from the changed text (S215), and generates a text message including the extracted keyword (S217).

Thereafter, the service device 20 may transmit the voice message and the text message to the corresponding counterpart terminal. In addition, the generated text message may be transmitted to the terminal 10 that has transmitted the voice message.

In addition, when the voice message processing region activation information is received from any one terminal 10, the service apparatus 20 according to an embodiment of the present invention transmits voice recording request information to the terminal 10 and transmits the voice recording request information. When the voice message processing area deactivation information is received from 10), the voice recording end request information is transmitted to the terminal 10 as an example. However, the present invention is not limited thereto, and steps S201 to S209 may be omitted. Only the process after step S211 may be controlled.

A voice message generating method according to an embodiment of the present invention as described above will be described in more detail with reference to the screen example.

6 to 14 are screen views illustrating a voice message generating method according to an embodiment of the present invention.

6A illustrates a messenger program dialog window screen of a user's terminal, for example, the first terminal 10a. The messenger program conversation window screen may consist of an upper part, a message display part, and a lower part. In the upper part of the messenger program conversation window screen, an area 500 for displaying information (e.g., profile picture, nickname, etc.) of the other party connected through the messenger program conversation window screen, a menu button 501 for further adding another user, A call button 502 for proceeding with a voice call or a video call between the users can be displayed. In addition, in the case of the group conversation, the number of users participating in the group conversation and the group conversation name may be displayed in the area 500 where the information on the other party is displayed.

Also, a message 520 received from the other party and a message 521 input by the user may be sequentially displayed on the message display part. In this case, to distinguish between the counterpart and the user, the message 520 received from the counterpart may be displayed on the left side of the screen, and the message 521 input from the user may be displayed on the right side of the screen, but is not limited thereto.

In the lower part of the messenger program conversation window screen, a content sharing screen display menu 503 for sharing contents such as pictures and music with the other terminal connected through the conversation window screen, an emoticon, a sticker, A menu 504 for transmission, an input field 505 for inputting a message, and the like. In addition, a transmission button 506 for transmitting a message input from the user through the input box 505 to the counterpart terminal connected through the chat window screen may be displayed.

In the state where such a chat window screen is being displayed, the terminal 10 determines whether a user input corresponding to a preset condition, for example, a touch and drag input in an upward direction, is detected from the user.

At this time, the touch and drag input in the upward direction is preferably detected starting from the point where the input field 505 is displayed to distinguish from the vertical scroll input, but the present invention is not limited thereto. Various preset conditions, such as touch-and-drag input in the downward direction starting from, touch-and-drag input in the upward direction starting at the bottom of the messenger program dialog window, or swipe input in one direction detected in the message display area. There may be an input corresponding to.

In this case, when a user input corresponding to a preset condition is detected, the terminal 10 may control the voice message processing area 507 to be displayed as illustrated in FIG. 6B. The voice message processing area 507 may be displayed in the form of a translucent bar near one area of the chat window screen, preferably near the bottom portion of the chat window screen. In addition, the voice message processing area 507 may display an icon 510 indicating that the user input needs to be maintained for a predetermined time or more. This icon may not be able to generate a voice message yet, and may be an icon indicating that user input should be maintained for a predetermined time to generate a voice message. For example, when the user input is a touch and drag input in an upward direction, it may mean that the user is dragged further in an upward direction.

In this case, when the user further drags upward, as illustrated in FIG. 6C, the voice message processing region 507 may be wider and displayed. In this case, the voice message processing region 507 may be set not to exceed a predetermined range. For example, it may be set not to exceed 1/10 or more of the message display portion, and when the maximum range is reached, the terminal 10 may control the voice message processing region 507 to no longer be widened.

When the user input is continued while the voice message processing area 507 reaches the maximum range, the voice message processing area 507 may display an icon indicating that voice recording is in progress, and voice recording progress indicating a voice recording progress state. A status bar may be displayed. This will be described with reference to FIG. 9.

In addition, in an embodiment of the present invention, the voice message processing area 507 is described as an example that does not exceed a preset maximum range, but the present invention is not limited thereto, and the area may be flexibly adjusted according to a user input. In other words, in a user input, for example, a touch and drag input in an upward direction, the voice message processing area 507 may be widened or narrowed according to a drag input. Thereafter, when the dragged last point is maintained for a predetermined time or more, the voice message processing area 507 may display an icon indicating that voice recording is in progress and a voice recording progress bar.

In addition, the voice message processing area 507 may be displayed according to a user's operation even when the keypad is activated. That is, as shown in FIG. 7A, when the keypad is activated on the chat window screen of the messenger program, the voice message processing area (as shown in FIG. 7B) according to a user input in a upward direction starting from a predetermined area (see FIG. 7B). 507 may be displayed.

In addition, as shown in FIG. 8A, after controlling to display an instruction bar 508 for generating a voice message in a region of a messenger program conversation window screen, the user starts from the vicinity of the instruction bar 508 from a user. When a user input in a direction, for example, a swipe input to the left, is detected, the terminal 10 moves the chat window screen to one direction, that is, to the left, as shown in FIG. 8B, and the voice message processing area ( 507 is moved to the left and displayed as if pulled and displayed according to a user input. In this case, the chat window screen may be moved only up to a certain area, and the voice message processing area 507 may be displayed as much as the portion where the chat window screen is moved.

In this case, the voice message processing area 507 may display an icon 510 indicating that the user input needs to be maintained for a predetermined time or more. This icon may not be able to generate a voice message yet, and may be an icon indicating that user input should be maintained for a predetermined time to generate a voice message. In other words, it can be an icon indicating that it should be further dragged to the left.

Then, when the user input is maintained for a predetermined time or more, the terminal 10 may display an icon 530 indicating that voice recording has started, as shown in FIG. 8C, and a speaker image is visually displayed around the terminal 10. May be Subsequently, while the user input is maintained, the terminal 10 proceeds with voice recording, and as shown in FIG. 8D, the icon 531 displayed is counted down and displayed starting from the maximum recordable time information. Can be.

In addition, the voice message processing region 507 can be displayed in various ways.

As described above, when the user input is maintained for a predetermined time or more while the voice message processing area 507 is displayed, the terminal 10 performs voice recording to generate a voice message. While voice recording is in progress, the user input is preferably maintained.

In addition, the voice message processing area 507 is shown in Figure 9a, the voice message processing area 507 is an icon 512 indicating that voice recording is in progress, the voice recording progress status indicating the voice recording progress status A bar may be displayed.

The voice recording progress bar for notifying the voice recording progress state includes an area 516 for visually displaying the recording progress state information, and recording progress state information 509, which is information on time recorded so far, in total. The maximum recordable time information 511 which is information on the recordable time may be displayed.

In this case, while the user maintains a preset user input, while the voice recording is in progress, the terminal 10 dynamically changes the wavelength 524 corresponding to the size of the user's voice through the icon 512. It can be controlled to be displayed as.

These wavelengths can be represented in various forms, as indicated by 525 in FIG. 9B.

In addition, after the voice message processing area 507 is displayed, the terminal 10 according to an exemplary embodiment of the present invention terminates the user input in a state in which a user input corresponding to a preset condition has not lasted for a predetermined time or more. 10, the voice message generation failure message 513 may be displayed.

On the other hand, after the voice message processing area 507 is displayed, the terminal 10 generates a voice message when the user input is terminated while the user input corresponding to the preset condition is maintained for a predetermined time or more, and FIG. 11. As illustrated in FIG. 3, the voice message processing area 507 may be controlled to display an icon 514 indicating that analysis of a voice message generated is in progress.

In this case, preferably, as indicated by 515, the total recorded time information may be displayed, and as indicated by 517, an area 517 indicating an analysis progress state may be displayed, as indicated by 518. Likewise, a menu button for canceling generation of a voice message may be displayed.

Here, the analysis of the voice message may be a process of generating a text message including a predetermined keyword in the generated voice message.

For example, when the generated voice message is 'Today's appointment place is Gangnam Station Chicken House', the terminal 10 includes only a keyword corresponding to a preset condition (only a noun is extracted) in the voice message, that is, 'today' Appointment place Gangnam Station Chicken House 'can be created, and the generated text message and voice message can be transmitted to the counterpart terminal connected through the chat window screen.

That is, as illustrated in FIG. 12, the counterpart terminal may display a text message generated based on the voice message together with an icon corresponding to the voice message.

In addition, as indicated by 523 of FIG. 13, the voice message is converted into text, and a text message including all the converted texts is generated, and a predetermined effect is applied to a keyword (eg, a noun) corresponding to a preset condition. For example, an underlined text message may be displayed.

In this case, the user of the counterpart terminal selects and inputs an icon corresponding to the voice message, thereby outputting and confirming the voice message. For example, when a user selects and inputs an icon corresponding to a voice message in the message indicated by 523 illustrated in FIG. 13, a window 532 for playing the voice message may be popped up and displayed as shown in FIG. 14A. have.

The window 532 for reproducing the voice message may include a progress bar 533 for visually confirming the reproducing information, a menu button 534 for canceling reproducing the voice message, and reproducing the voice message. And a menu button 535 for transmitting a menu button 536 for transmitting a voice message to one or more other users. In this case, when the voice message is a voice message received from one of the terminals, the transmission menu button 536 may not be displayed or displayed in an inactive state, and is activated or displayed only when the voice message is generated by the user. Can be.

In addition, when a user selects and inputs a menu button 535 for playing a voice message, as shown in FIG. 14B, the icon may be changed to a menu button 535 for stopping a voice message. While the playback is in progress, the playback information may be visually confirmed through the progress bar 533.

In addition, the user can easily check the voice message based on the text message displayed together with the voice message even without outputting the voice message as described above.

The voice message and the text message may be simultaneously displayed on the counterpart terminal as well as the user terminal 10.

As described above, according to the method for generating a voice message, an apparatus and a system therefor according to the present invention, when the voice message processing area is displayed and maintained for a predetermined time while the chat window screen of the messenger program is being displayed, By recording, a voice message may be generated and transmitted to one or more counterpart terminals connected through the chat window screen.

Through this, a user using a messenger program can provide a superior effect of generating a voice message through a simpler and more intuitive interface as well as provide UX (User eXperience) of a new messenger program.

In addition, according to the voice message generating method, apparatus and system therefor, extracting a keyword satisfying a predetermined condition from the generated voice message, and then generating a text message including the extracted keyword and transmitting it to the counterpart terminal. In addition, the user as well as the counterpart receiving the voice message and the text message can more easily grasp the contents of the voice message.

In addition, the voice message generating method according to an embodiment of the present invention described with reference to FIGS. 6 to 14 is an example in which the terminal 10 not only generates a voice message but also generates a text message based on the voice message. Although described, the terminal 10 generates only a voice message, and transmits the generated voice message to the service device 20, the service device 20 may generate a text message based on the voice message.

The voice message generating method according to the embodiment of the present invention has been described above.

The voice message generating method of the present invention as described above may be provided in the form of a computer readable medium suitable for storing computer program instructions and data. At this time, a computer-readable medium suitable for storing computer program instructions and data includes, for example, a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, a compact disk read only memory (CD-ROM) Optical media such as a DVD (Digital Video Disk), a magneto-optical medium such as a floppy disk, and a ROM (Read Only Memory), a RAM , Random Access Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM). The processor and memory may be supplemented by, or incorporated in, special purpose logic circuits. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

While the specification contains a number of specific implementation details, it should be understood that they are not to be construed as limitations on the scope of any invention or claim, but rather on the description of features that may be specific to a particular embodiment of a particular invention Should be understood. Certain features described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments, either individually or in any suitable subcombination. Further, although the features may operate in a particular combination and may be initially described as so claimed, one or more features from the claimed combination may in some cases be excluded from the combination, Or a variant of a subcombination.

Likewise, although the operations are depicted in the drawings in a particular order, it should be understood that such operations must be performed in that particular order or sequential order shown to achieve the desired result, or that all illustrated operations should be performed. In certain cases, multitasking and parallel processing may be advantageous. Also, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products It should be understood.

It should be noted that the embodiments of the present invention disclosed in the present specification and drawings are only illustrative of specific examples for the purpose of understanding and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

The present invention relates to a method of generating a voice message in a messenger program. More particularly, when a voice message processing area is displayed and maintained for a predetermined time while a chat window screen of a messenger program is displayed, the voice recording is performed. The present invention relates to a voice message generating method and apparatus and system for generating a voice message, and to easily generate a voice message and to transmit the generated voice message to one or more counterpart terminals connected through the chat window screen.

According to the present invention, if the voice message processing area is displayed and maintained for a predetermined time while the chat window screen of the messenger program is being displayed, voice recording is performed by generating a voice message and connected through the chat window screen. By transmitting to the counterpart terminal, the user using the messenger program can generate a voice message through a simpler and more intuitive interface, and transmit the voice message to the counterpart terminal, thereby contributing to the development of the messenger service industry. do.

In addition, since the present invention is not only possible to be marketed or operated, but also can be practically and practically carried out, it is industrially applicable.

10: terminal 11: communication unit 12: input unit
13: control unit 13a: messenger control module 13b: voice processing module
14: storage unit 15: output unit 16: voice recognition unit
20: service apparatus 21: service communication unit 22:
22a: messenger management module 22b: voice processing module 23: service storage unit
30: communication network 100: messenger system

Claims (24)

An output unit configured to output various information generated during execution of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal;
An input unit for supporting user input;
A voice recognition unit for generating a voice message by performing voice recording; And
It includes a control unit that is functionally connected to the output unit, the input unit and the speech recognition unit,
The controller controls the voice message processing area to be displayed through the output unit when a preset user input is detected through the input unit while the chat window screen of the messenger program is displayed through the output unit. And controlling the output unit to maintain the displayed voice message processing area for the predetermined time for a predetermined time through which the user input is maintained, and to control the voice recognition unit to perform voice recording for the predetermined time. delete The method of claim 1,
The user input corresponding to the preset condition
Terminals, characterized in that any one of the touch or swipe in one direction, touch and drag, gestures, eye movements, shake in the chat window screen. The method of claim 1,
The control unit
And when the user input ends, controlling the voice recognition unit to end the voice recording to generate a voice message. 5. The method of claim 4,
Communication unit for transmitting and receiving a variety of information generated through the messenger program with one or more counterpart terminal;
Further comprising:
The control unit
And controlling the voice message generated by the voice recognition unit to be transmitted to the counterpart terminal connected through the chat window screen through the communication unit. The method of claim 1,
The control unit
The voice message processing area is displayed on a certain area within the chat window screen, or the chat window screen is moved in one direction and displayed simultaneously with the moved chat window screen, or is switched on the chat window screen to change the voice message processing area. Terminal only characterized in that the control to be displayed through the output unit. The method of claim 1,
The control unit
And at least one of an icon indicating that voice recording is in progress and a voice recording progress bar are displayed through the voice message processing area while the voice recording is in progress. The method of claim 7, wherein
The voice recording progress bar includes at least one of recording progress status information, recording progress time information, and maximum recordable time information. 5. The method of claim 4,
The control unit
When the voice recording is finished, the terminal characterized in that for generating a text message containing a predetermined keyword from the voice message generated by the voice recognition unit. 10. The method of claim 9,
The control unit
While the text message is being generated, the terminal is controlled to display an icon indicating that the analysis of the voice message is in progress through the voice message processing area. 10. The method of claim 9,
The control unit
When the text message generation is complete, the terminal characterized in that the control to not display the voice message processing area. 5. The method of claim 4,
The control unit
And a terminal in which the voice message generation failure message is output through the output unit when the user input is terminated while the user input is not maintained for a predetermined time or more. A service communication unit for transmitting and receiving various information through one or more terminals and a messenger program; And
When the voice message processing area display information is received from any one terminal functionally connected to the service communication unit and the chat window screen of the messenger program is displayed through the service communication unit, voice recording is performed to the terminal through the service communication unit. A service control unit which transmits request information and controls to transmit voice recording end request information to the terminal when the voice message processing region inactive information is received from the terminal through the service communication unit;
Lt; / RTI >
The voice message processing region display information is transmitted by a preset user input input to the terminal, and the voice message processing region inactive information is transmitted when the input of the user is terminated. 14. The method of claim 13,
The service control unit
After the voice recording end request information is transmitted to the terminal, when a voice message generated through the service communication unit is received from the terminal, the other party connected the received voice message through the conversation window screen through the service communication unit. The service device characterized in that the control to be transmitted to the terminal. 15. The method of claim 14,
The service control unit
The voice message received from the terminal is recognized and converted into text, a keyword satisfying a predetermined condition is extracted from the converted text, a text message including the extracted keyword is generated, and the received voice message and And controlling the generated text message to be transmitted to the counterpart terminal through the service communication unit. 16. The method of claim 15,
The preset condition is
And a condition set to extract a keyword corresponding to a noun, a number, and a uniform resource locator (URL), or to analyze a volume of a voice to extract a keyword having a predetermined size or more. 16. The method of claim 15,
The service control unit
And generates a text message including only the extracted keyword. 16. The method of claim 15,
The service control unit
Recognize the voice message, convert it into text, generate a text message including the converted text, extract a keyword that satisfies a predetermined condition from the text, and give a predetermined effect to the extracted keyword. Generating a message. When a chat window screen of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal is being displayed, if a preset user input is detected, a voice message processing area is displayed and then the user input is displayed. A terminal that maintains the displayed voice message processing area for the predetermined time for a predetermined time, performs voice recording for the predetermined time to generate a voice message, and transmits the generated voice message to at least one counterpart terminal; And
A service providing unit for generating a text message including a predetermined keyword through the voice message when the voice message transmitted from the terminal to the counterpart terminal is received and transmitting the generated text message and the voice message to the counterpart terminal, ;
The messenger system comprising: Displaying a chat window screen of a messenger program configured to enable a terminal to transmit and receive an instant message with at least one counterpart terminal;
Displaying, by the terminal, a voice message processing area when a preset user input is detected; And
The terminal maintaining the displayed voice message processing region for a predetermined time while the user input is maintained while the voice message processing region is displayed, and performing voice recording;
Voice message generation method comprising a. delete delete 21. The method of claim 20,
After the step of proceeding with the voice recording,
Generating a voice message by terminating the voice recording when the user input is terminated;
Recognizing the voice message and converting the voice message into text;
Generating, by the terminal, a keyword that satisfies a predetermined condition in the converted text, and then generating a text message including the extracted keyword; And
Transmitting, by the terminal, the voice message and the text message to at least one counterpart terminal connected through the chat window screen;
Voice message generation method comprising a. A computer-readable recording medium having recorded thereon a program for executing the voice message generating method according to any one of claims 20 and 23.

Images