WO2014142391A1

WO2014142391A1 - Method for generating voice message, and apparatus and system therefor

Info

Publication number: WO2014142391A1
Application number: PCT/KR2013/005076
Authority: WO
Inventors: 오길훈; 권기택; 김희용
Original assignee: 에스케이플래닛 주식회사
Priority date: 2013-03-13
Filing date: 2013-06-10
Publication date: 2014-09-18
Also published as: KR101363866B1

Abstract

The present invention relates to a method for generating a voice message in a messenger program, and more particularly to a method for generating a voice message which is obtained readily by recording voiced words if a voice message process region is displayed in a dialogue window screen of a messenger program for a given time, and transmitted to at least one of the dialoguing terminals connected through the dialogue window screen, and an apparatus and a system therefor. To this end, a terminal according to an embodiment of the present invention includes: an output part for outputting various information pieces generated while executing a messenger program structured so as to exchange an instant message with at least one other terminal; a voice recognition part for generating a voice message by recording voiced words; and a control unit functionally connected to the output part and the voice recognition part, wherein the control unit controls the output part to display the voice message process region in the dialogue window screen of the messenger program displayed through the output part, and also controls the voice recognition part to record voice words if the voice message process region is maintained for a given time.

Description

Voice message generation method, apparatus and system therefor

The present invention relates to a method of generating a voice message in a messenger program. More particularly, when a voice message processing area is displayed and maintained for a predetermined time while a chat window screen of a messenger program is displayed, the voice recording is performed. The present invention relates to a voice message generating method and apparatus and system for generating a voice message, and to easily generate a voice message and to transmit the generated voice message to one or more counterpart terminals connected through the chat window screen.

Due to the rapid development of information and communication technology, various types of terminals such as mobile communication terminals and personal computers have been implemented to perform various functions.

Taking the mobile communication terminal as an example, the mobile communication terminal can be used in addition to basic voice communication functions such as data communication, taking a picture or video using a camera, playing a music or video file, playing a game, watching a broadcast, and the like. Is being implemented.

The development of technology for increasing the functions that can be executed in such a terminal is continuously made, and the hardware improvement technology as well as the software improvement technology is continuously made.

On the other hand, in recent years by using a terminal to connect to the communication network by sending and receiving a message with a large number of users, the frequency of use of the messenger program that can proceed with the conversation is continuously increasing.

Through such a messenger program, a user may create a text message and transmit the generated text message to the counterpart terminal, thereby communicating with the counterpart terminal, and furthermore, may communicate with the counterpart terminal using a voice message. .

However, in order for a user to generate a voice message through a messenger program, after confirming a menu providing a voice message generating function, the user may move to a corresponding menu and select and input the menu to generate a voice message. This process is a process that requires a plurality of user operations, there is a problem that a lot of inconvenience follows from the user's point of view.

In addition, even if a user receives a voice message through a messenger program, when the current environment of the user is noisy, it is difficult to grasp the contents of the voice message, and the voice message itself may be lost or modified in the process of being transmitted or received. In this case, there is a problem that it is difficult to reproduce the voice message itself.

The present invention has been proposed to solve the above-mentioned problems. When the voice message processing area is displayed and maintained for a predetermined time while the chat window screen of the messenger program is being displayed, voice recording is performed by performing voice recording. It is an object of the present invention to provide a voice message generating method, an apparatus and a system therefor, which can generate and transmit a generated voice message to one or more counterpart terminals connected through the chat window screen.

In addition, the present invention, after recognizing a voice message and extracting a predetermined keyword from the voice message, generates a text message including the extracted keyword, the voice message generating method that can be transmitted to the counterpart terminal with the voice message, It is an object to provide an apparatus and system for this purpose.

According to an aspect of the present invention, there is provided a terminal including an output unit configured to output information generated during execution of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal; A voice recognition unit for generating a voice message by performing voice recording; And a controller operatively connected to the output unit and the voice recognition unit, wherein the controller is configured to process a voice message for supporting voice message generation while a chat window screen of the messenger program is displayed through the output unit. After the area is controlled to be displayed through the output unit, if the displayed voice message processing area is maintained for a predetermined time, a control command may be transmitted to the voice recognition unit to generate a voice message by performing voice recording.

The voice message processing area may further include an input unit supporting a user input, and the controller may detect a user input corresponding to a preset condition through the input unit while the conversation window screen is being displayed. The control unit may be displayed through the output unit, and if the user input is continued, a control command may be transmitted to the voice recognition unit so that the voice recording proceeds.

The user input corresponding to the preset condition may be any one of a touch, a swipe in one direction, a touch and drag, a gesture, a gaze movement, and a shake on the conversation window screen. Can be.

In this case, when the user input is terminated, the controller may transmit a control command to the voice recognition unit so that a voice message is generated by ending the voice recording.

In addition, the terminal further comprises a communication unit for transmitting and receiving a variety of information generated through the messenger program with one or more counterpart terminal, the control unit is a voice message generated through the voice recognition unit via the communication window screen It may be controlled to be transmitted to the other terminal connected through.

The controller may be configured to display the voice message processing area on a certain area within the chat window screen, move the chat window screen in one direction and simultaneously display the moved chat window screen, or switch from the chat window screen. Only the voice message processing area may be controlled to be displayed through the output unit.

In this case, the controller may control to display at least one of an icon indicating that voice recording is in progress and a voice recording progress bar through the voice message processing area while the voice recording is in progress.

In this case, the voice recording progress bar may include at least one of recording progress status information, recording progress time information, and maximum recordable time information.

In this case, when the voice recording is terminated, the controller may generate a text message including a predetermined keyword in the voice message generated by the voice recognition unit.

In this case, the controller may control to display an icon indicating that the voice message is being analyzed through the voice message processing area while the text message is generated.

The controller may control the voice message processing area not to be displayed when the text message generation is completed.

In this case, the controller may control to output a voice message generation failure message through the output unit when the user input is terminated while the user input does not last for a predetermined time or more.

A service apparatus according to an embodiment of the present invention for achieving the above object is a service communication unit for transmitting and receiving a variety of information through one or more terminals and a messenger program; And a voice message operatively connected to the service communication unit and indicating that a voice message processing area for supporting voice message generation is displayed from any one terminal on which a chat window screen of the messenger program is displayed through the service communication unit. When the processing area display information is received, the voice recording request information is transmitted to the terminal through the service communication unit. When the voice message processing area deactivation information is received from the terminal through the service communication unit, the service communication unit is voiced to the terminal. And a service controller for controlling the recording end request information to be transmitted.

In this case, after the voice control unit transmits the voice recording end request information to the terminal and receives a voice message generated through the service communication unit from the terminal, the service control unit communicates the received voice message through the service communication unit. It may be controlled to be transmitted to the connected counterpart terminal through the window screen.

The service controller may recognize the voice message received from the terminal, convert the voice message into text, extract a keyword satisfying a preset condition from the converted text, and generate a text message including the extracted keyword. The received voice message and the generated text message may be controlled to be transmitted to the counterpart terminal through the service communication unit.

In this case, the preset condition may be a condition set to extract a keyword corresponding to a noun, a number, and a uniform resource locator (URL), or to analyze a voice size to extract a keyword having a predetermined size or more. .

The service controller may generate a text message including only the extracted keywords.

In addition, the service controller may generate a text message to which a predetermined effect is assigned to the extracted keyword.

In the messenger system according to an embodiment of the present invention for achieving the above object, in a state where a chat window screen of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal is displayed, When the voice message processing area for supporting message generation is displayed and maintained for a predetermined time, the terminal for generating a voice message by performing voice recording, and transmitting the generated voice message to at least one counterpart terminal; And receiving a voice message transmitted from the terminal to the counterpart terminal, generating a text message including a predetermined keyword through the voice message, and transmitting the generated text message and the voice message to the counterpart terminal. Apparatus; can be configured to include.

According to an aspect of the present invention, there is provided a method of generating a voice message, the method comprising: displaying, by a terminal, a chat window screen of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal; ; Displaying, by the terminal, a voice message processing area for supporting voice message generation; Determining, by the terminal, whether the voice message processing area is maintained for a predetermined time or more while the voice message processing area is displayed; And if the voice message processing area is maintained for a predetermined time or more, performing a voice recording by the terminal.

In this case, the displaying of the voice message processing area may include: determining, by the terminal, a user input corresponding to a preset condition on the chat window screen; And when the user input corresponding to the preset condition is detected, displaying, by the terminal, the voice message processing area.

In this case, in the determining whether the terminal is maintained for a predetermined time or more, the terminal may determine whether the user input lasts for a predetermined time or longer.

In this case, after the voice recording is performed, when the user input is terminated, the terminal ends the voice recording to generate a voice message; Recognizing the voice message and converting the voice message into text; Generating, by the terminal, a keyword that satisfies a predetermined condition in the converted text, and then generating a text message including the extracted keyword; And transmitting, by the terminal, the voice message and the text message to at least one counterpart terminal connected through the chat window screen.

In addition, the present invention can provide a computer readable recording medium having recorded thereon a program for executing the voice message generating method as described above.

According to the method for generating a voice message of the present invention, an apparatus and a system therefor, when the voice message processing area is displayed and maintained for a predetermined time while the chat window screen of the messenger program is being displayed, the voice message is processed to record the voice message. It may be generated and transmitted to one or more counterpart terminals connected through the chat window screen.

Through this, a user using a messenger program can have an excellent effect of generating a voice message through a simpler and more intuitive user interface.

In addition, according to the voice message generating method, apparatus and system therefor, extracting a keyword satisfying a predetermined condition from the generated voice message, and then generating a text message including the extracted keyword and transmitting it to the counterpart terminal. In addition, the user as well as the counterpart receiving the voice message and the text message can more easily grasp the contents of the voice message.

1 is a schematic structural diagram of a messenger system according to an embodiment of the present invention.

2 is a block diagram illustrating a main configuration of a terminal according to an exemplary embodiment of the present invention shown in FIG. 1.

3 is a block diagram illustrating a main configuration of a service apparatus according to an exemplary embodiment of the present invention illustrated in FIG. 1.

4 is a data flowchart illustrating a voice message generation method in a terminal according to an embodiment of the present invention.

5 is a flowchart illustrating a method of generating a voice message in a service apparatus according to another embodiment of the present invention.

6 to 14 are screen views illustrating a voice message generating method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, in describing in detail the operating principle of the preferred embodiment of the present invention, if it is determined that the detailed description of the related known functions or configurations may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. This is to more clearly communicate without obscure the core of the present invention by omitting unnecessary description. In addition, the present invention may be modified in various ways and may have various embodiments, but specific embodiments are illustrated in the drawings and described in detail in the detailed description, which is not intended to limit the present invention to specific embodiments. It is to be understood that all changes, equivalents, and substitutes included in the spirit and technical scope of the present invention are included.

In addition, terms including ordinal numbers, such as first and second, are used to describe various components, and are used only to distinguish one component from another component, and to limit the components. Not used. For example, without departing from the scope of the present invention, the second component may be referred to as the first component, and similarly, the first component may also be referred to as the second component.

In addition, when a component is referred to as being "connected" or "connected" to another component, it means that it may be connected or connected logically or physically. In other words, although a component may be directly connected or connected to other components, it should be understood that other components may exist in the middle, and may be connected or connected indirectly.

In addition, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In addition, the terms "comprises" or "having" described herein are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or the same. It is to be understood that the present invention does not exclude in advance the possibility of the presence or the addition of other features, numbers, steps, operations, components, parts, or a combination thereof.

Now, a method of generating a voice message according to an embodiment of the present invention will be described in detail with reference to the drawings, and the same or corresponding components are denoted by the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. .

First, a messenger system according to an embodiment of the present invention will be described.

Referring to FIG. 1, the messenger system 100 of the present invention may include a plurality of terminals 10, a service device 20, and a communication network 30.

First, the plurality of terminals 10 are devices that can transmit and receive messages or share contents by transmitting and receiving messages with one or more counterpart terminals through a messenger program.

Here, the messenger program may be provided by the service device 20, and may be a program capable of providing an instant messaging service. The messenger program may be downloaded from the service device 20 and installed in the terminal 10. Even if the terminal 10 does not have a messenger program installed, the messenger program may be connected to the service device 20 to provide a messenger program in a cloud service manner. It can also be used.

The terminal 10 may execute a messenger program and display a messenger program execution screen (eg, an initial screen, a chat window screen, and the like). The messenger program may be executed according to a user's request or may be executed when a specific event occurs. The messenger program of the terminal 10 may be executed when a specific event occurs, for example, when a message is received from the counterpart or when specific information is received from the service device 20.

In particular, the terminal 10 according to an exemplary embodiment of the present invention can more easily generate a voice message only by an intuitive operation of the user while executing a messenger program. In other words, when a chat window screen of a messenger program is being displayed, a voice message processing area for supporting voice message generation is displayed according to a user's operation, and when the voice message processing area is maintained for a predetermined time, You can control the recording to proceed. Thereafter, when the voice recording is terminated according to a user's manipulation, a voice message may be generated, and the voice message may be controlled to be transmitted to the counterpart terminal connected through the chat window screen.

For example, in a state where the first terminal 10a and the second terminal 10b are connected through a chat window screen of a messenger program, a voice message generated by the first terminal 10a is transmitted through a chat window screen. 10b), and may receive a voice message from the second terminal 10b.

In addition, the terminal 10 according to an embodiment of the present invention may generate or transmit a text message to the counterpart terminal based on the generated voice message or the voice message received from one counterpart terminal. In this case, the terminal 10 of the present invention recognizes the voice message, converts it into text, extracts a keyword satisfying a predetermined condition from the converted text, and then generates a text message including the extracted keyword. have.

The main configuration and more specific operation method of the terminal 10 according to an embodiment of the present invention will be described later.

The service device 20 serves to support transmission and reception of messages or content between the plurality of terminals 10 through a messenger program. For example, when a message is input by the user of the first terminal 10a, the service device 20 transmits the message to one or more second terminals 10b connected through the chat window screen of the messenger program, and the second terminal 10b. When a message is received from the N-T, the first half of the process of transmitting the message to the first terminal 10a may be controlled.

In addition, the service device 20 may store and manage a message or content currently being transmitted and received through a chat window according to a user's request. In this case, preferably, the message or content transmitted and received through the messenger program of the terminal 10 may be stored and managed in the service device 20 instead of being stored in the terminal 10. In addition, the message or content transmitted and received through the messenger program may be simultaneously stored in the terminal 10 and the service device 20, and only a specific message or specific content may be stored in the service device 20 according to a user's selection.

In addition, in order to provide a messenger program service to the plurality of terminals 10, the service device 20 divides the subscribed users into user identifiers, and provides status, reception mode, message recipient list, and the like for each subscribed user. It is possible to manage subscriber environment information and to manage an IM conversation session, that is, a conversation channel, for transferring an IM conversation message between on-line users. In addition, the service device 20 may perform a Session Initiation Protocol (SIP) call processing and a Message Session Relay Protocol (MSRP) relay function, and the like, and thus, a plurality of terminals, for example, the first terminal 10a and the second terminal. It is possible to provide a chat service between 10b.

In particular, when a voice message transmitted from the first terminal 10a to the second terminal 10b is received, the service device 20 according to an exemplary embodiment of the present invention recognizes the voice message and converts the voice message into text. Thereafter, the service device 20 may extract a keyword that satisfies a predetermined condition from the converted text, generate a text message including the extracted keyword, and transmit the generated text message to the second terminal 10b together with the voice message. .

Such a service device 20 may be implemented as a collection of various devices to support the operation as described above. For example, a database server capable of storing and managing various related information, a file server for file processing, and a push server capable of automatically pushing related information to the terminal 10 may be implemented.

In addition, it can be implemented including various servers according to the system design method. In addition, a function corresponding to the server may be implemented in one service apparatus 20 as one module.

The main configuration and more specific operation method of the terminal 10 and the service device 20 as described above will be described later, and are mounted in the terminal 10 and the service device 20 according to an embodiment of the present invention. The processor may process a program command for generating a voice message. In one implementation, this processor may be a single-threaded processor, and in other implementations, the processor may be a multithreaded processor. Furthermore, the processor is capable of processing instructions stored on memory or storage devices.

In addition, the state connected through the chat window according to the present invention described above means a state in which a mobile path, ie, a session, that can transmit and receive messages between a plurality of terminals 10 is connected.

For example, the first terminal 10a selects one or more second terminals 10b to conduct a conversation and generates a chat window, and the first terminal 10a receives one or more messages input from the user. 2 may be a concept including both the transmission to the terminal (10b).

In addition, the plurality of terminals 10 and the service device 20 according to an exemplary embodiment of the present invention transmit and receive various related information through the communication network 30, and the communication network 30 may use various types of communication networks. Can be.

For example, wireless communication methods such as wireless LAN (WLAN), Wi-Fi, Wibro, Wimax, Wimax, and High Speed Downlink Packet Access (HSDPA), or Ethernet, xDSL (ADSL, VDSL) , Wired communication methods such as Hybrid Fiber Coaxial Cable (HFC), Fiber to The Curb (FTTC), and Fiber To The Home (FTTH).

Further, in addition to the above-described communication method, it may include all other types of communication methods that are well known or developed in the future.

Hereinafter, the main configuration and operation method of the terminal 10 according to an embodiment of the present invention.

1 and 2, the terminal 10 according to an exemplary embodiment of the present invention includes a communication unit 11, an input unit 12, a control unit 13, a storage unit 14, an output unit 15, and voice recognition. It may be configured to include a portion (16).

In more detail with respect to each component, the communication unit 11 serves to support the transmission and reception of related information with the service device 20 and one or more counterpart terminals.

For example, the communication unit 11 may transmit a message input from a user through a chat window screen of a messenger program to a counterpart terminal connected through a chat channel of the chat window screen, and receive a message from the counterpart terminal. In particular, the communication unit 11 according to an embodiment of the present invention may receive a voice message or a text message from a counterpart terminal through a messenger program and transmit a voice message or a text message to one or more counterpart terminals.

In addition, the communication unit 11 may transmit various request information input from the user to the service device 20. Information corresponding thereto may be received from the service device 20.

The input unit 12 transmits a variety of information such as numeric and text information input from a user, a signal input in connection with various function settings and function control of the terminal 10 to the controller 13. In particular, the input unit 12 of the present invention executes a messenger program and supports message input from a user through the messenger program. In addition, the input unit 12 supports a user input corresponding to a preset condition on a chat window screen of a messenger program for generating a voice message.

Here, the user input corresponding to a preset condition may be a touch input on the chat window screen. For example, various touch inputs such as a long touch, a short touch, and a double touch may be used. In addition, the user input corresponding to a preset condition may be any one of a swipe, a touch and drag, a gesture, a gaze movement, and a shake in one direction. For example, it may be a swipe in an upward direction, a gesture input in a left direction, or the like.

The input unit 12 supporting the user input may be configured with at least one of a keypad and a touch pad generating an input signal according to a user's touch or manipulation. In addition, when the input unit 12 is configured in the form of a single touch panel (or touch screen) together with the output unit 15, a user input on the touch panel may be sensed.

In addition, the input unit 12 may support input of a voice of a user, for example, a "left drag", a "right drag", or the like. In addition, when the input unit 12 includes a gesture input unit, the input unit 12 may detect a user's preset gesture.

As described above, the input unit 12 includes a key input means such as a keyboard or a keypad, a touch input means such as a touch sensor or a touch pad, a voice input means, a gyro sensor, a geomagnetic sensor, an acceleration sensor and a proximity sensor, and a camera. It may also include a gesture input means comprising at least one or more.

In addition, it may include all types of input means that are currently under development or may be developed in the future.

The controller 13 performs overall control of the terminal 10, and may be a process device that drives an operating system (OS) and each component, for example, a central processing unit (CPU). .

Such a control unit 13 of the present invention is functionally connected to each component. That is, the controller 13 is functionally connected to the communication unit 11, the input unit 12, the storage unit 14, the output unit 15, and the voice recognition unit 16, and supplies power and functions to each of the above components. To control the flow of signals for execution

In particular, the control unit 13 according to an embodiment of the present invention may execute a messenger program and control execution of various functions generated through the messenger program. Basically, when a user's request or a preset event is detected, the controller 13 may control the messenger program to be executed, and may control the messenger program execution screen to be displayed on the output unit 15.

In addition, the controller 13 may select a specific counterpart according to a user's request through the messenger program, and support an overall process for transmitting and receiving a message or content with the counterpart. In addition, the controller 13 may support various operations for performing various functions provided by the messenger program.

In particular, the control unit 13 according to the embodiment of the present invention has a voice message processing area for supporting voice message generation while the chat window screen of the messenger program is displayed through the output unit 15. Can be displayed through). In this case, the voice message processing area is for more intuitively informing the user that a voice message can be generated. The voice message processing area may be displayed when a user input corresponding to a preset condition is detected through the input unit 12. have.

In this case, the user input corresponding to a preset condition is touched or swiped in one direction, touch and drag, gesture, eye movement, and shake on the conversation window screen as described above. It may be any one of. In addition, the voice input may be performed, and one direction may be a diagonal direction as well as up, down, left, and right on the chat window of the messenger program. In addition, the controller 13 may control the voice message processing area to be displayed when a selection input of a predetermined menu is detected by a user.

In addition, when the voice message processing area is displayed according to a user's operation, the controller 13 controls the display to be inserted into the chat window screen or moves the chat window screen in one direction and simultaneously with the moved chat window screen. It may be controlled to be displayed, or may be controlled to display only the voice message processing area by being called from the chat window screen.

In more detail, when the user input corresponding to a preset condition is detected in the chat window screen, for example, a touch and drag input starting from the bottom of the chat window screen and proceeding upward, the controller 13 displays the chat window screen. The voice message processing region may be controlled to be displayed in one region of the region, for example, a region where a message is displayed.

In addition, when a user input corresponding to a preset condition is detected in the chat window screen, for example, a touch and drag input starting from the right side of the chat window screen and proceeding in the left direction, the controller 13 moves the chat window screen in one direction, that is, to the left. Direction, and the voice message processing area is displayed at the same time as the moved chat window screen. Through this, the user can confirm that the chat window screen is moved according to the user input direction and the voice message processing area is pulled to the left and displayed. In this case, the chat window screen may be moved by only a predetermined distance, and the voice message processing area may be displayed by the distance that the chat window screen is moved.

After the above process, when the voice message processing region is displayed, the controller 13 determines whether the voice message processing region is maintained for a predetermined time. Maintaining for a certain time means that the user input as described above is maintained. In the above-described example, when the user input is a touch and drag input starting from the right side of the chat window screen and proceeding in the left direction, it means that the user's finger at the last point is continuously touching. In addition, when the user input is a line of sight movement in a diagonal direction, the line of sight at the last point is fixed.

When the user input is maintained for a predetermined time, for example, 3 seconds while the voice message processing area is displayed as described above, the controller 13 controls the voice recognition unit 16 to proceed with the voice recording.

In other words, the controller 13 requests the voice recognition unit 16 to generate a voice message. The voice recognition unit 16 activates the voice recording function according to a control command of the control unit 13 to record the information input through the microphone MIC.

Thereafter, the controller 13 continuously determines whether the user input is maintained. At this time, if the user input is terminated (for example, the user's finger is not touched) and no longer detected, the controller 13 transmits an end command to the voice recognition unit 16, and the voice recognition unit 16 The voice recorded until the end command is applied may be generated as a voice message and transmitted to the controller 13.

Thereafter, when the voice message is transmitted through the voice recognition unit 16, the controller 13 controls the voice message to be transmitted to one or more counterpart terminals connected through the chat window screen through the communication unit 11.

In addition, while the voice recording is in progress, the controller 13 may control at least one of an icon indicating that voice recording is in progress and a voice recording progress bar through the voice message processing area. In this case, the voice recording progress bar may control to display at least one of recording progress status information, recording progress time information, and maximum recordable time information.

In addition, after the voice message processing area is displayed, the controller 13 outputs a voice message generation failure message if the user input corresponding to a preset condition does not last for a predetermined time and the user input is terminated. Can be controlled to output through. For example, after displaying the voice message processing area, the controller 13 may control to generate a voice message by performing voice recording when a user input corresponding to a preset condition, for example, a touch input, lasts for 3 seconds or more. When the touch input lasts only 1 second, the voice message generation failure message of 'recording time is short' may be output through the output unit 15.

In addition, the controller 13 may recognize the generated voice message, generate a text message corresponding to the voice message, and control the generated text message to be transmitted to the counterpart terminal together.

In more detail, the controller 13 recognizes the voice message, converts the voice message into text, extracts a keyword satisfying a predetermined condition from the text, and generates and generates a text message including the extracted keyword. The text message may be controlled to be displayed through the output unit 15.

For example, when the generated voice message is '7 o'clock today, the appointment place is Gangnam station chicken house', the controller 13 recognizes the voice message and converts it into text. Here, the process of recognizing a voice message and converting the voice message into text may apply various known techniques. For example, the controller 13 may first remove noise from the voice message and extract a feature for voice recognition. In addition, the controller 13 may convert the extracted feature into a text by comparing the extracted feature with a pre-stored voice model database and outputting the matching feature as a recognition result.

Thereafter, the controller 13 extracts a keyword that satisfies a preset condition from the converted text. Here, the preset condition may be set by the service device 20 serving the user or the messenger program. For example, the preset condition may be a place name, a number, or a specific condition.

For example, if the preset condition is to extract only the region name, the controller 13 may extract only the 'Gangnam station' from the voice message, that is, '7 o'clock today, the appointment place is Gangnam station chicken house'. In addition, when the preset condition is to extract only numbers, the controller 13 may extract only '7' from the voice message. In addition, when the preset condition extracts only nouns, the controller 13 may extract only '7 o'clock appointment place Gangnam station chicken house today' from the voice message.

In addition, the above-described exception may set conditions for keyword extraction from various viewpoints. For example, only a specific Uniform Resource Locator (URL), a phone number, and address information may be extracted, and the height of the user's voice may be analyzed to set only a word corresponding to a high voice section.

As described above, the controller 13 extracts a keyword that satisfies a predetermined condition from the converted text, and then generates a text message including the extracted keyword. In this case, the control unit 13 may generate a text message including only the extracted keywords, and generate a text message including all of the converted texts. You can also create a text message by assigning an underlined effect.

Thereafter, the controller 13 may transmit the generated text message and the voice message to the counterpart terminal.

In addition, the controller 13 may control to display an icon indicating that the voice message is being analyzed through a voice message processing area while the text message is generated. When the text message is generated, the voice message may be displayed. The processing area can be controlled so that it is no longer displayed via the output unit 15.

In addition, when the voice message is received from one of the counterpart terminals through the communication unit 11, the controller 13 may generate a text message through the above-described process. In other words, if the user terminal supports the generation of a voice message and a corresponding text message, but the counterpart terminal supports only the voice message generation, if only the voice message is received from the counterpart terminal, the controller 13 directly controls the voice. A text message corresponding to the message may be generated and controlled to be output through the output unit 15.

When output through the output unit 15, the voice message may be output in the form of a predetermined icon corresponding to the voice message. Thereafter, the controller 13 may output the voice message when a touch input or other preset input for the icon is detected by the user.

In addition, an embodiment of the present invention has been described with an example of converting a voice message generated during execution of a messenger program into a text message form and displaying the same through a chat window screen of the messenger program, but is not limited thereto. A text message may be generated in the form of a short message service (SMS). In this case, the voice message may be output through the chat window screen of the messenger program, and the text message in the form of a short message may be transmitted to the counterpart terminal through an SMS server or may be output through a menu supporting an SMS function.

In addition, the controller 13 recognizes the voice message, converts it into text, and extracts a keyword that satisfies a predetermined condition from the converted text, and when the extracted keyword includes information on a specific time. This may be stored in the storage unit 14. For example, when the voice message is' 7 pm on February 16, Gangnam Station Chicken House ', the controller 13 recognizes the voice message and satisfies a preset condition (eg, date information and time information), that is,' February 16th at 7pm '.

Thereafter, the controller 13 may store the extracted keyword information as schedule information in a schedule application, a diary application, or the like stored in the storage 14. Thereafter, the controller 13 may provide the notification message to the user by outputting the schedule information at a corresponding time.

In order to control the above operation, the controller 13 may include a messenger control module 13a and a voice processing module 13b.

Here, the messenger control module 13a controls the overall execution of the messenger program, such as messenger execution and conversation window generation, and the voice processing module 13b controls the process of displaying a voice message processing area or controls a voice message. Recognize and play a role in controlling the overall process of generating a text message based on the result.

In addition, the storage unit 14 may temporarily store various data generated during execution of the application program, including an application program required for operating a function according to an embodiment of the present invention. In addition, the storage unit 14 may store a messenger program, and a message or content transmitted and received with one or more counterpart terminals through the messenger program may be stored. In particular, the storage unit 14 according to an embodiment of the present invention may store a voice message and a text message generated based on the voice message. In addition, the storage unit 14 may store information necessary for voice message recognition, and in particular, may store condition information for extracting a specific keyword from the voice message.

The storage unit 14 may largely include a program area and a data area. The program area stores related information for driving the terminal 10 such as an operating system (OS) for booting the terminal 10. The data area is an area in which data generated according to the use of the terminal 10 is stored, and as described above, various information generated during execution of the messenger program, for example, a voice message and a text message generated based on the voice message, may be stored. Can be. The storage unit 14 may be a flash memory, a hard disk, a memory of a multimedia card micro type (for example, SD or XD memory, etc.), a RAM, a ROM, or the like. ROM) and a storage medium.

In addition, an embodiment of the present invention will be described with reference to a configuration in which a messenger program or a message or content including a voice message or a text message transmitted and received through the messenger program is stored in the storage unit 14, but is not limited thereto. In other words, it may be stored in the service device 20 in association with the service device 20 according to the cloud service method.

The output unit 15 outputs information on a series of operation states and operation results generated during the functioning of the terminal 10. In particular, the output unit 15 of the present invention may include a display module 15a and a sound source output module 15b.

The display module 15a serves to display various information generated during the execution of the messenger program. For example, the display module 15a displays a voice message processing area under the control of the controller 13, and displays various information through the voice message processing area. An icon, a status bar, and the like can be displayed. In addition, an icon corresponding to the voice message and a text message generated based on the voice message may be displayed.

As described above, the display module 15a may be implemented in the form of a single touch panel (or touch screen) together with the input unit 12, and when implemented together with the input unit 12, the user's preset Various information generated according to an operation may be displayed.

In addition, the display module 15a may be a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), organic light emitting diodes (OLED), a light emitting diode (LED), an active matrix organic LED (AMOLED), flexible The display may be configured as a flexible display and a three-dimensional display. Some of these displays may also be configured to be transparent or light transmissive so that they can be seen from the outside. It may be configured in the form of a transparent display including a transparent OLED (TOLED).

On the other hand, the sound source output module 15b converts a sound source, which is an electrical signal, into an analog signal and outputs the analog signal. The sound source output module 15b may output a voice message under the control of the controller 13.

The voice recognition unit 16 generates a voice message by performing voice recording under the control of the controller 13, and processes the analog information from the microphone MIC and the information input through the microphone MIC to process the voice message. It may be configured to include a processing module capable of generating a. In addition, in an embodiment of the present invention, the sound source of the voice recognition unit 16 capable of generating a voice message by processing information input through a microphone (MIC) and the output unit 15 capable of outputting the voice message. Although the output module 15b is illustrated separately, the present invention is not limited thereto. In some cases, the voice inset unit 16 and the sound source output module 15b may exist in the form of one sound source processor.

As described above, the main configuration of the terminal 10 has been described with reference to FIG. 2. However, not all components illustrated in FIG. 2 are essential components of the terminal 10.

For example, the terminal 10 further includes a broadcast output unit capable of outputting a broadcast signal received from a broadcast transmitter (not shown), a haptic module capable of vibratingly output various information generated during execution of a messenger program, and the like. The terminal 10 may be implemented by fewer components.

In addition, the location of the main components of the terminal 10 shown in FIG. 2 may be changed for convenience or other reasons. In addition, the module constituting the control unit 13 is illustrated as a messenger control module 13a and a voice processing module 13b, but is not limited thereto, and the control unit 13 may be configured with various modules that perform various functions. have.

It has been described above the main configuration and operation method of the terminal 10 according to an embodiment of the present invention. The terminal 10 of the present invention may be implemented in various forms. For example, the terminal 10 described herein may be a mobile terminal such as a smart phone, a tablet PC, a personal digital assistant (PDA), a portable multimedia player (PMP), or an MP3 player. A fixed terminal such as a smart TV, a desktop computer, or the like may be used.

The terminal 10 of the present invention can not be enumerated because all the variations of the portable device according to the convergence (convergence) trend of the digital device, but the unit of the same level as the above-mentioned unit is a terminal according to the present invention It may also be used as (10), if the terminal that can send and receive messages with the terminal of one or more other users via the messenger service device 20 through the communication network 30, any device to the terminal 10 of the present invention Applicable

Hereinafter, the main configuration and operation method of the messenger service device 20 according to an embodiment of the present invention will be described.

1 and 3, the service device 20 of the present invention may include a service communication unit 21, a service control unit 22, and a service storage unit 23.

Here, the service communication unit 21 may play a role of transmitting and receiving various information related to the messenger program with one or more terminals 10.

In particular, the service communication unit 21 may receive a message or content transmitted and received between any one terminal and another terminal connected thereto. In addition, the service communication unit 21 may receive request information for various information from any one terminal 10 and provide the information to the terminal 10.

The service controller 22 performs overall control of the service device 20 of the present invention. In particular, the service controller 22 according to an embodiment of the present invention may perform various controls related to the messenger program.

For example, in order to provide a messenger program service to the plurality of terminals 10, the service controller 22 divides the subscribed users by user identifiers, and displays the status, reception mode, message recipient list, and subscriber for each subscribed user. It manages environmental information and manages IM chat sessions, or chat channels, for transferring IM chat messages between users who are on-line. In addition, the service controller 22 may perform a Session Initiation Protocol (SIP) call processing and a Message Session Relay Protocol (MSRP) relay function, and the like, and thus, a plurality of terminals, for example, the first terminal 10a and the second terminal. Messages or contents can be transmitted and received between the 10b.

In particular, the service control unit 22 according to an embodiment of the present invention transmits a voice message processing area from one terminal, for example, the first terminal 10a, through the service communication unit 21, on which a chat window screen of a messenger program is displayed. When the display information is received, the voice recording request information is transmitted to the first terminal 10a through the service communication unit 21, and a voice message processing area from the first terminal 10a through the service communication unit 21. When the deactivation information is received, the voice recording end request information may be transmitted to the first terminal 10a through the service communication unit 21.

Here, the voice message processing region display information may be information indicating that the voice message processing region is displayed through the first terminal 10a. As described above with reference to FIG. 2, the voice message processing area may be displayed according to a preset user input of the first terminal 10a. In addition, the first terminal 10a may transmit the voice message processing region display information to the service device 20 at a predetermined interval while the user input is maintained.

On the other hand, the voice message processing area deactivation information refers to a state in which the voice message processing area is displayed but the user input is terminated. In other words, the voice message processing area is displayed on the first terminal 10a according to a user input, and the user input is maintained after the user input is maintained for a predetermined time. In this case, the voice message processing area may be continuously displayed. When the user input is terminated, the service controller 22 transmits the voice recording end request information for generating a voice message with the voice recorded so far to the first terminal 10a.

Then, when the voice control unit 22 receives a voice message from the first terminal 10a through the service communication unit 21, the service control unit 22 connects the received voice message to the first terminal 10a through a chat window screen. For example, it may be controlled to be transmitted to the second terminal 10b.

In addition, the service controller 22 according to an embodiment of the present disclosure may generate a text message based on the received voice message when the voice message is received from the first terminal 10a. In this case, the service controller 22 recognizes the voice message, converts the voice message into text, extracts a keyword satisfying a predetermined condition from the converted text, and generates a text message including the extracted keyword.

In addition, in one embodiment of the present invention, when the service control unit 22 receives the voice message processing region display information from any one terminal 10, the service control unit 22 transmits the voice recording request information to the terminal 10, and the terminal ( When the voice message processing area deactivation information is received from 10), and after the voice recording end request information is transmitted to the terminal 10, if a voice message is received from the terminal 10, the text is based on the received voice message. Although a message is generated as an example, the present invention is not limited thereto. When a voice message is received from any one terminal 10 regardless of whether voice message processing region indication information and voice message processing region deactivation information are received, Only a process of generating a text message may be controlled based on the voice message.

In other words, in an embodiment of the present invention, a process of generating a voice message based on the terminal 10 and a process of generating a text message based on the voice message have been described, but are not limited thereto. When a voice message is generated through the process as described above at 10, the terminal 10 transmits the generated voice message to the service device 20, and the service device 20 transmits the text message based on the voice message. After generating a, it is possible to control the overall process of transmitting the generated text message to the terminal 10 and the other terminal.

To this end, the service control unit 22 may include a messenger management module 22a and a voice processing module 22b. The messenger management module 22a may perform various functions for providing and controlling a messenger program between the plurality of terminals 10, and the voice processing module 22b generates a text message based on a voice message. Can be controlled.

Various information generated while using the messenger program as described above may be stored in the service storage unit 23. In addition, the service storage unit 23 may store messages, contents, and the like, which are exchanged with the terminal 10 and one or more counterpart terminals, and the service control unit 22 corresponds to the user identification information of the terminal 10. Can be controlled to be stored.

The service storage unit 23 may be a storage in the messenger system 100, or may be a separate data storage device that is located outside the messenger system 100 and that can transmit and receive data with the service device 20.

The service device 20 according to the embodiment of the present invention has been described above.

As described above, the service device 20 of the present invention may be implemented as one or more servers operating in a server-based computing method or a cloud method. In particular, information transmitted and received through the messenger system 100 may be provided through a cloud computing function that may be permanently stored in a cloud computing device on the Internet. Here, cloud computing utilizes Internet technologies in digital terminals such as desktops, tablet computers, laptops, netbooks, and smartphones to virtualize information technology (IT) resources such as hardware (servers, storage, networks, etc.) and software. It refers to a technology that provides services on demand (database, security, web server, etc.), services, and data. In the present invention, all information transmitted and received between the plurality of terminals 10 and the service device 20 is stored in the cloud computing device on the Internet, and can be transmitted anytime, anywhere.

On the other hand, the memory mounted in the terminal 10 or the service device 20 stores information in the device. In one embodiment, the memory is a computer readable medium. In one implementation, the memory may be a volatile memory unit, and for other implementations, the memory may be a nonvolatile memory unit. In one embodiment, the storage device is a computer readable medium. In various different implementations, the storage device may include, for example, a hard disk device, an optical disk device, or some other mass storage device.

Although the specification and drawings describe exemplary device configurations, the functional operations and subject matter implementations described herein may be embodied in other types of digital electronic circuitry, or modified from the structures and structural equivalents disclosed herein. It may be implemented in computer software, firmware or hardware, including, or a combination of one or more of them. Implementations of the subject matter described herein relate to one or more computer program products, ie computer program instructions encoded on a program storage medium of tangible type for controlling or by the operation of an apparatus according to the invention. It may be implemented as the above module. The computer readable medium may be a machine readable storage device, a machine readable storage substrate, a memory device, a composition of materials affecting a machine readable propagated signal, or a combination of one or more thereof.

Hereinafter, a voice message generating method according to an embodiment of the present invention will be described.

1 and 4, first, in order to generate a voice message according to an embodiment of the present invention, a messenger program must be executed in the terminal 10 (S101).

Thereafter, the terminal 10 may display a chat window screen of the messenger program according to a user's manipulation (S103). The terminal 10 determines whether a user input corresponding to a preset condition is detected while the chat window screen of the messenger program is being displayed (S105).

In this case, the user input corresponding to a preset condition may be any one of a touch, a swipe in one direction, a touch and drag, a gesture, a gaze movement, and a shake in the conversation window screen. Can be.

Thereafter, when a user input corresponding to a preset condition is detected, the terminal 10 displays a voice message processing area (S107). Here, the voice message processing area is displayed in a certain area within the chat window screen, or is displayed simultaneously with the chat window screen in which the chat window screen is moved in one direction and moved, or is switched in the chat window screen to process the voice message. Only areas can be displayed.

Then, the terminal 10 determines whether the user input detected in the step S105 is maintained for a predetermined time (S109), and if maintained for a predetermined time, proceeds with the voice recording (S111).

Thereafter, the terminal 10 determines whether the user input is terminated (S113), and when the user input is terminated, the terminal 10 generates a portion in which recording is performed as a voice message (S115).

In other words, the terminal 10 according to an embodiment of the present invention displays a voice message processing area when a user input corresponding to a preset condition, for example, a touch and drag input upward direction, is detected on a chat window screen of a messenger program. If the user's touch input continues while the voice message processing area is displayed, voice recording is performed. If the touch input is no longer detected, voice recording is terminated to generate a voice message.

In addition, the user input corresponding to the preset condition in the step S105 and the user input corresponding to the preset condition in the step S109 may be different. For example, the user input corresponding to the preset condition in step S105 may be a touch and drag input in an upward direction, and the user input corresponding to the preset condition in step S109 may be a touch input at the end of the drag. Can be. In other words, when the user input is maintained for a predetermined time, when the touch and drag input in the upward direction is generated in step S105, the touch input at the end point of the drag is continued in step S109.

Thereafter, the terminal 10 may transmit the generated voice message to the counterpart terminal connected through the chat window screen (S117). Before the transmission, the terminal 10 recognizes the generated voice message and selects a predetermined keyword from the voice message. After generating a text message including a, the text message may be transmitted to the counterpart terminal together with the voice message.

In addition, the terminal 10 according to another embodiment of the present invention may support only a process until a voice message is generated, and a process of generating a text message based on the voice message may be performed under the control of the service device 20. have.

Hereinafter, a method of generating a voice message in the service device 20 according to another embodiment of the present invention will be described.

1 and 5, first, the service device 20 determines whether voice message processing region display information is received from any one terminal 10 in a standby state S201 (S203). Here, the standby state means that the service device 20 transmits and receives a message between the terminal and the terminal, for example, the first terminal 10a and the second terminal 10b connected through the chat window screen of the first terminal 10a and the messenger program. This refers to a state in which session control, message transmission control, and the like are performed.

Subsequently, when the voice message processing region display information is received from the terminal 10, the service apparatus 20 transmits voice recording request information to the terminal 10 (S205) and the voice message processing region from the terminal 10. When the deactivation information is received (S207), the voice recording end request information may be transmitted to the terminal 10 (S209).

The voice message processing region display information may be information indicating that the voice message processing region is displayed through the terminal, for example, the first terminal 10a. On the other hand, the voice message processing area deactivation information refers to a state in which the voice message processing area is displayed but the user input is terminated. In other words, the voice message processing area is displayed on the first terminal 10a according to a user input, and the user input is maintained after the user input is maintained for a predetermined time. In this case, the voice message processing area may be continuously displayed. When the user input is terminated, the service device 20 transmits the voice recording end request information to generate a voice message with the voice recorded so far to the first terminal 10a.

After that, when the voice message is received from the terminal 10 (S211), the service device 20 recognizes the voice message and converts the voice message into text (S213). Thereafter, the service device 20 extracts a keyword satisfying a predetermined condition from the changed text (S215), and generates a text message including the extracted keyword (S217).

Thereafter, the service device 20 may transmit the voice message and the text message to the corresponding counterpart terminal. In addition, the generated text message may be transmitted to the terminal 10 that has transmitted the voice message.

In addition, when the voice message processing region activation information is received from any one terminal 10, the service apparatus 20 according to an embodiment of the present invention transmits voice recording request information to the terminal 10 and transmits the voice recording request information. When the voice message processing area deactivation information is received from 10), the voice recording end request information is transmitted to the terminal 10 as an example. However, the present invention is not limited thereto, and steps S201 to S209 may be omitted. Only the process after step S211 may be controlled.

A voice message generating method according to an embodiment of the present invention as described above will be described in more detail with reference to the screen example.

6A illustrates a messenger program dialog window screen of a user's terminal, for example, the first terminal 10a. The messenger program dialog window screen may include an upper portion, a message display portion, and a lower portion. At the top of the screen of the messenger program chat window, an area 500 where information (eg, profile picture, nickname, etc.) about the other party connected through the messenger program chat window screen is displayed, a menu button 501 for adding another user, A call button 502 for conducting a voice call or a video call between users may be displayed. In addition, when the area 500 in which the information on the counterpart is displayed is a group conversation, the number of users participating in the group conversation and the name of the group conversation may be displayed.

Also, a message 520 received from the other party and a message 521 input by the user may be sequentially displayed on the message display part. In this case, to distinguish between the counterpart and the user, the message 520 received from the counterpart may be displayed on the left side of the screen, and the message 521 input from the user may be displayed on the right side of the screen, but is not limited thereto.

In addition, the lower part of the screen of the messenger program chat window displays a content sharing screen display menu 503 for sharing various information, such as a picture or music, with the other terminal connected through the chat window screen, and an emoticon and a sticker to the other terminal. And a menu 504 for transmitting, an input field 505 for inputting a message, and the like. In addition, a transmission button 506 for transmitting a message input from the user through the input box 505 to the counterpart terminal connected through the chat window screen may be displayed.

In the state where such a chat window screen is being displayed, the terminal 10 determines whether a user input corresponding to a preset condition, for example, a touch and drag input in an upward direction, is detected from the user.

At this time, the touch and drag input in the upward direction is preferably detected starting from the point where the input field 505 is displayed to distinguish from the vertical scroll input, but the present invention is not limited thereto. Various preset conditions, such as touch-and-drag input in the downward direction starting from, touch-and-drag input in the upward direction starting at the bottom of the messenger program dialog window, or swipe input in one direction detected in the message display area. There may be an input corresponding to.

In this case, when a user input corresponding to a preset condition is detected, the terminal 10 may control the voice message processing area 507 to be displayed as illustrated in FIG. 6B. The voice message processing area 507 may be displayed in the form of a translucent bar near one area of the chat window screen, preferably near the bottom portion of the chat window screen. In addition, the voice message processing area 507 may display an icon 510 indicating that the user input needs to be maintained for a predetermined time or more. This icon may not be able to generate a voice message yet, and may be an icon indicating that user input should be maintained for a predetermined time to generate a voice message. For example, when the user input is a touch and drag input in an upward direction, it may mean that the user is dragged further in an upward direction.

In this case, when the user further drags upward, as illustrated in FIG. 6C, the voice message processing region 507 may be wider and displayed. In this case, the voice message processing region 507 may be set not to exceed a predetermined range. For example, it may be set not to exceed 1/10 or more of the message display portion, and when the maximum range is reached, the terminal 10 may control the voice message processing region 507 to no longer be widened.

When the user input is continued while the voice message processing area 507 reaches the maximum range, the voice message processing area 507 may display an icon indicating that voice recording is in progress, and voice recording progress indicating a voice recording progress state. A status bar may be displayed. This will be described with reference to FIG. 9.

In addition, in an embodiment of the present invention, the voice message processing area 507 is described as an example that does not exceed a preset maximum range, but the present invention is not limited thereto, and the area may be flexibly adjusted according to a user input. In other words, in a user input, for example, a touch and drag input in an upward direction, the voice message processing area 507 may be widened or narrowed according to a drag input. Thereafter, when the dragged last point is maintained for a predetermined time or more, the voice message processing area 507 may display an icon indicating that voice recording is in progress and a voice recording progress bar.

In addition, the voice message processing area 507 may be displayed according to a user's operation even when the keypad is activated. That is, as shown in FIG. 7A, when the keypad is activated on the chat window screen of the messenger program, the voice message processing area (as shown in FIG. 7B) according to a user input in a upward direction starting from a predetermined area (see FIG. 7B). 507 may be displayed.

In addition, as shown in FIG. 8A, after controlling to display an instruction bar 508 for generating a voice message in a region of a messenger program conversation window screen, the user starts from the vicinity of the instruction bar 508 from a user. When a user input in a direction, for example, a swipe input to the left, is detected, the terminal 10 moves the chat window screen to one direction, that is, to the left, as shown in FIG. 8B, and the voice message processing area ( 507 is moved to the left and displayed as if pulled and displayed according to a user input. In this case, the chat window screen may be moved only up to a certain area, and the voice message processing area 507 may be displayed as much as the portion where the chat window screen is moved.

In this case, the voice message processing area 507 may display an icon 510 indicating that the user input needs to be maintained for a predetermined time or more. This icon may not be able to generate a voice message yet, and may be an icon indicating that user input should be maintained for a predetermined time to generate a voice message. In other words, it can be an icon indicating that it should be further dragged to the left.

Then, when the user input is maintained for a predetermined time or more, the terminal 10 may display an icon 530 indicating that voice recording has started, as shown in FIG. 8C, and a speaker image is visually displayed around the terminal 10. May be Subsequently, while the user input is maintained, the terminal 10 proceeds with voice recording, and as shown in FIG. 8D, the icon 531 displayed is counted down and displayed starting from the maximum recordable time information. Can be.

In addition, the voice message processing region 507 can be displayed in various ways.

As described above, when the user input is maintained for a predetermined time or more while the voice message processing area 507 is displayed, the terminal 10 performs voice recording to generate a voice message. While voice recording is in progress, the user input is preferably maintained.

In addition, the voice message processing area 507 is shown in Figure 9a, the voice message processing area 507 is an icon 512 indicating that voice recording is in progress, the voice recording progress status indicating the voice recording progress status A bar may be displayed.

The voice recording progress bar for notifying the voice recording progress state includes an area 516 for visually displaying the recording progress state information, and recording progress state information 509, which is information on time recorded so far, in total. The maximum recordable time information 511 which is information on the recordable time may be displayed.

In this case, while the user maintains a preset user input, while the voice recording is in progress, the terminal 10 dynamically changes the wavelength 524 corresponding to the size of the user's voice through the icon 512. It can be controlled to be displayed as.

These wavelengths can be represented in various forms, as indicated by 525 in FIG. 9B.

In addition, after the voice message processing area 507 is displayed, the terminal 10 according to an exemplary embodiment of the present invention terminates the user input in a state in which a user input corresponding to a preset condition has not lasted for a predetermined time or more. 10, the voice message generation failure message 513 may be displayed.

On the other hand, after the voice message processing area 507 is displayed, the terminal 10 generates a voice message when the user input is terminated while the user input corresponding to the preset condition is maintained for a predetermined time or more, and FIG. 11. As illustrated in FIG. 3, the voice message processing area 507 may be controlled to display an icon 514 indicating that analysis of a voice message generated is in progress.

In this case, preferably, as indicated by 515, the total recorded time information may be displayed, and as indicated by 517, an area 517 indicating an analysis progress state may be displayed, as indicated by 518. Likewise, a menu button for canceling generation of a voice message may be displayed.

Here, the analysis of the voice message may be a process of generating a text message including a predetermined keyword in the generated voice message.

For example, when the generated voice message is 'Today's appointment place is Gangnam Station Chicken House', the terminal 10 includes only a keyword corresponding to a preset condition (only a noun is extracted) from the voice message, that is, 'today' Appointment place Gangnam Station Chicken House 'can be created, and the generated text message and voice message can be transmitted to the counterpart terminal connected through the chat window screen.

That is, as illustrated in FIG. 12, the counterpart terminal may display a text message generated based on the voice message together with an icon corresponding to the voice message.

In addition, as indicated by 523 of FIG. 13, the voice message is converted into text, and a text message including all the converted texts is generated, and a predetermined effect is applied to a keyword (eg, a noun) corresponding to a preset condition. For example, an underlined text message may be displayed.

In this case, the user of the counterpart terminal selects and inputs an icon corresponding to the voice message, thereby outputting and confirming the voice message. For example, when a user selects and inputs an icon corresponding to a voice message in the message indicated by 523 illustrated in FIG. 13, a window 532 for playing the voice message may be popped up and displayed as shown in FIG. 14A. have.

The window 532 for reproducing the voice message may include a progress bar 533 for visually confirming the reproducing information, a menu button 534 for canceling reproducing the voice message, and reproducing the voice message. And a menu button 535 for transmitting a menu button 536 for transmitting a voice message to one or more other users. In this case, when the voice message is a voice message received from one of the terminals, the transmission menu button 536 may not be displayed or displayed in an inactive state, and is activated or displayed only when the voice message is generated by the user. Can be.

In addition, when a user selects and inputs a menu button 535 for playing a voice message, as shown in FIG. 14B, the icon may be changed to a menu button 535 for stopping a voice message. While the playback is in progress, the playback information may be visually confirmed through the progress bar 533.

In addition, the user can easily check the voice message based on the text message displayed together with the voice message even without outputting the voice message as described above.

The voice message and the text message may be simultaneously displayed on the counterpart terminal as well as the user terminal 10.

As described above, according to the method for generating a voice message, an apparatus and a system therefor according to the present invention, when the voice message processing area is displayed and maintained for a predetermined time while the chat window screen of the messenger program is being displayed, By recording, a voice message may be generated and transmitted to one or more counterpart terminals connected through the chat window screen.

Through this, a user using a messenger program can provide a superior effect of generating a voice message through a simpler and more intuitive interface as well as provide UX (User eXperience) of a new messenger program.

In addition, the voice message generating method according to an embodiment of the present invention described with reference to FIGS. 6 to 13 is an example in which the terminal 10 not only generates a voice message but also generates a text message based on the voice message. Although described, the terminal 10 generates only a voice message, and transmits the generated voice message to the service device 20, the service device 20 may generate a text message based on the voice message.

The voice message generating method according to the embodiment of the present invention has been described above.

The voice message generating method of the present invention as described above may be provided in the form of a computer readable medium suitable for storing computer program instructions and data. In this case, a computer-readable medium suitable for storing computer program instructions and data may include, for example, a magnetic medium such as a hard disk, a floppy disk, and a magnetic tape, and a compact disk read only memory (CD-ROM). , Optical media such as Digital Video Disk (DVD), magneto-optical media such as Floppy Disk, and ROM (Read Only Memory), RAM And a semiconductor memory such as a random access memory, a flash memory, an erasable programmable ROM (EPROM), and an electrically erasable programmable ROM (EEPROM). The processor and memory can be supplemented by or integrated with special purpose logic circuitry. Examples of program instructions may include high-level language code that can be executed by a computer using an interpreter as well as machine code such as produced by a compiler. Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

Although the specification includes numerous specific implementation details, these should not be construed as limiting to any invention or the scope of the claims, but rather as a description of features that may be specific to a particular embodiment of a particular invention. It must be understood. Certain features that are described in this specification in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable subcombination. Furthermore, while the features may operate in a particular combination and may be initially depicted as so claimed, one or more features from the claimed combination may in some cases be excluded from the combination, the claimed combination being a subcombination Or a combination of subcombinations.

Likewise, although the operations are depicted in the drawings in a specific order, it should not be understood that such operations must be performed in the specific order or sequential order shown in order to obtain desirable results or that all illustrated operations must be performed. In certain cases, multitasking and parallel processing may be advantageous. Moreover, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products. It should be understood that it can.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples for clarity and are not intended to limit the scope of the present invention. It is apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be carried out in addition to the embodiments disclosed herein.

According to the present invention, if the voice message processing area is displayed and maintained for a predetermined time while the chat window screen of the messenger program is being displayed, voice recording is performed by generating a voice message and connected through the chat window screen. By transmitting to the counterpart terminal, the user using the messenger program can generate a voice message through a simpler and more intuitive interface, and transmit the voice message to the counterpart terminal, thereby contributing to the development of the messenger service industry. do.

In addition, the present invention has industrial applicability because the present invention is not only sufficiently commercially available or commercially viable, but also practically clearly implemented.

Claims

An output unit for outputting information generated during execution of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal;

A voice recognition unit for generating a voice message by performing voice recording; And

A control unit that is functionally connected to the output unit and the voice recognition unit,

The controller controls the voice message processing region for supporting voice message generation to be displayed through the output unit while the chat window screen of the messenger program is displayed through the output unit, and then displays the displayed voice message processing region. If maintained for a predetermined time, the terminal characterized in that for transmitting a control command to the voice recognition unit to proceed with voice recording to generate a voice message.
The method of claim 1,

An input unit supporting user input;

More,

The control unit

When the dialog window screen is displayed, if a user input corresponding to a preset condition is detected through the input unit, the voice message processing area is controlled to be displayed through the output unit, and if the user input continues, And a control command is transmitted to the voice recognition unit so that voice recording is performed.
The method of claim 2,

The user input corresponding to the preset condition is

Terminals, characterized in that any one of the touch or swipe in one direction, touch and drag, gestures, eye movements, shake in the chat window screen.
The method of claim 2,

The control unit

And when the user input ends, transmitting a control command to the voice recognition unit so that the voice message is generated by ending the voice recording.
The method of claim 4, wherein

Communication unit for transmitting and receiving a variety of information generated through the messenger program with one or more counterpart terminal;

More,

The control unit

And controlling the voice message generated by the voice recognition unit to be transmitted to the counterpart terminal connected through the chat window screen through the communication unit.
The method of claim 1,

The control unit

The voice message processing area is displayed on a certain area within the chat window screen, or the chat window screen is moved in one direction and displayed simultaneously with the moved chat window screen, or is switched on the chat window screen to change the voice message processing area. Terminal only characterized in that the control to be displayed through the output unit.
The method of claim 1,

The control unit

And at least one of an icon indicating that voice recording is in progress and a voice recording progress bar are displayed through the voice message processing area while the voice recording is in progress.
The method of claim 7, wherein

The voice recording progress bar includes at least one of recording progress status information, recording progress time information, and maximum recordable time information.
The method of claim 4, wherein

The control unit

When the voice recording is finished, the terminal characterized in that for generating a text message containing a predetermined keyword from the voice message generated by the voice recognition unit.
The method of claim 9,

The control unit

While the text message is being generated, the terminal is controlled to display an icon indicating that the analysis of the voice message is in progress through the voice message processing area.
The method of claim 9,

The control unit

When the text message generation is complete, the terminal characterized in that the control to not display the voice message processing area.
The method of claim 4, wherein

The control unit

And a terminal in which the voice message generation failure message is output through the output unit when the user input is terminated while the user input is not maintained for a predetermined time or more.
A service communication unit for transmitting and receiving various information through at least one terminal and a messenger program; And

Voice message processing, which is functionally connected to the service communication unit and informs that a voice message processing area for supporting voice message generation is displayed from any one terminal in which a chat window screen of the messenger program is displayed through the service communication unit. When the area indication information is received, the voice recording request information is transmitted to the terminal through the service communication unit. When voice message processing area deactivation information is received from the terminal through the service communication unit, the service communication unit is voice recorded. A service controller which controls the termination request information to be transmitted;

Service device comprising a.
The method of claim 13,

The service control unit

After the voice recording end request information is transmitted to the terminal, when a voice message generated through the service communication unit is received from the terminal, the other party connected the received voice message through the conversation window screen through the service communication unit. The service device characterized in that the control to be transmitted to the terminal.
The method of claim 14,

The service control unit

The voice message received from the terminal is recognized and converted into text, a keyword satisfying a predetermined condition is extracted from the converted text, and a text message including the extracted keyword is generated to generate the received voice message and the And controlling the generated text message to be transmitted to the counterpart terminal through the service communication unit.
The method of claim 15,

The preset condition is

And a condition set to extract a keyword corresponding to a noun, a number, and a uniform resource locator (URL), or to analyze a volume of a voice to extract a keyword having a predetermined size or more.
The method of claim 15,

The service control unit

And a text message including only the extracted keywords.
The method of claim 15,

The service control unit

And a text message to which a predetermined effect is assigned to the extracted keyword.
When a chat window screen of a messenger program configured to transmit and receive instant messages with at least one counterpart terminal is being displayed, if a voice message processing area for supporting voice message generation is displayed and maintained for a predetermined time, A terminal for generating a voice message by performing voice recording and transmitting the generated voice message to at least one counterpart terminal; And

When the voice message transmitted from the terminal to the counterpart terminal is received, a service device for generating a text message including a predetermined keyword through the voice message, and transmits the generated text message and the voice message to the counterpart terminal ;

Messenger system comprising a.
Displaying, by a terminal, a chat window screen of a messenger program configured to transmit and receive an instant message with at least one counterpart terminal;

Displaying, by the terminal, a voice message processing area for supporting voice message generation;

Determining, by the terminal, whether the voice message processing area is maintained for a predetermined time or more while the voice message processing area is displayed; And

When the voice message processing area is maintained for a predetermined time or more, the terminal performing voice recording;

Voice message generation method comprising a.
The method of claim 20,

Displaying the voice message processing area is

Determining, by the terminal, whether a user input corresponding to a preset condition is detected on the chat window screen; And

Displaying, by the terminal, the voice message processing area when a user input corresponding to the preset condition is detected;

Voice message generation method comprising a.
The method of claim 21,

Determining whether the predetermined time or more is maintained

The terminal determines whether the user input lasts for a predetermined time or more.
The method of claim 21,

After the step of proceeding with the voice recording,

Generating a voice message by terminating the voice recording when the user input is terminated;

Recognizing the voice message and converting the voice message into text;

Generating, by the terminal, a keyword that satisfies a predetermined condition in the converted text, and then generating a text message including the extracted keyword; And

Transmitting, by the terminal, the voice message and the text message to at least one counterpart terminal connected through the chat window screen;

Voice message generation method further comprising.
A computer-readable recording medium having recorded thereon a program for executing the voice message generating method according to any one of claims 20 to 23.