KR20150088532A - Apparatus for providing service during call and method for using the apparatus - Google Patents

Abstract

Disclosed are an apparatus and method for providing a service during a call. The apparatus for providing a service during a call comprises: a conversation content recording unit for recording conversation content between a caller and a callee by using a user terminal and converting the recorded content into text; a command extraction unit for extracting a command for running an application to be activated during a call, based on an event generated in accordance with selection of at least one application which can be activated during a call by a caller, or output of an activation command; and a command execution unit for simultaneously activating the application during a call by processing the command for running the application based on the conversation content which is converted into text. Thus, the present invention can provide a user with the convenience of using the user terminal.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a service providing apparatus,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user terminal control technology, and more particularly, to a service provision apparatus for providing a communication service with a user terminal by processing an event generated by a busy user.

BACKGROUND ART [0002] With the recent development of information communication technologies, popularization of various user terminals having communication functions such as a smart phone, a tablet PC, and a smart home appliance has become popular, so that a user can operate at least one user terminal.

Thus, the user can use the user terminal to talk to another person without any place and time, send / receive a message, search desired information through the Internet, and share the location with the other person using the position sensor mounted on the user terminal And the like can be provided.

However, as the hardware performance of the user terminal has been improved and the information processing speed has been improved and the capacity of the memory has been increased, a large number of users installed in the user terminal Multi-tasking capable of simultaneously executing applications of the present invention.

Accordingly, a technique for controlling user terminals based on multitasking has been actively researched, and in particular, a technology for providing various services simultaneously with a call to a busy user has been developed and commercialized.

For example, according to Korean Patent Laid-Open Publication No. 10-2008-0101561 (published on November 21, 2008), it is possible to confirm whether or not a service is subscribed to a service providing server that has acquired a call control right, To provide contents according to the caller's demands in real time during the call.

However, in the above-described conventional technology, in order to provide contents in real time during a call, a call processing procedure for checking whether a service is added is indispensable, and the system may become complicated, .

In addition, since contents are transmitted through a mobile communication network, service delays may occur depending on network conditions, which may cause inconveniences for a user, and there is a limitation in that services that can be provided are limited to contents.

It is an object of the present invention to solve the above problems and to provide a method and apparatus for handling an event generated by an operation or an utterance of a user during a call and providing an application installed in the user terminal without interruption, And to provide a service providing apparatus in the middle of a call capable of providing convenience.

It is another object of the present invention to provide a method for providing a busy service in a multi-tasking application for an application installed in a user terminal.

According to an aspect of the present invention, there is provided an apparatus for providing a service during a call, the apparatus being implemented by a user terminal operated by a user and recording voice call contents between a user and a call recipient using a user terminal, An application to be executed during a call based on an event that is generated as a result of selection of at least one application executable during a call by a user in a call or execution command for at least one application executable during a call, And a command execution unit for processing an execution command of the extracted application on the basis of the voice conversation contents converted into the text and simultaneously executing the application during the call.

Here, the call content recording unit temporarily stores the voice call conversation contents converted into text into a database in the user terminal or an external server that monitors the use of at least one user terminal in real time for a preset period of time, Lt; / RTI >

Here, the on-the-call service providing apparatus may further include a display unit for displaying a list of at least one application executable during a call so as to be selected by a busy user, or displaying a processing result of an execution command of the application.

Here, the list of at least one application includes at least one of a location transfer of a user in a call, a location reception of a call destination, a distance difference between a calling user and a calling party, execution of an application used before a call, information retrieval, And a possible application type view.

Here, the event may be generated including a start event and an end event for an application selected by a busy user among a list of at least one application executable among calls displayed on the display unit.

Here, the event may be generated as the execution command including the start instruction and the end instruction registered in advance for each of at least one application executable by the busy user is communicated.

Here, the command extraction unit may extract an execution command of an application to be executed during a call, including a start event and an end event for an application selected by a user in a call, or may include a start command and an end command, It is possible to extract an execution command of the application to be executed.

Here, the command execution unit may process the execution command of the application to be executed during the call using the voice conversation contents converted into the text corresponding to the time between the start event and the end event, or may be a text corresponding to the time between the uttered start command and the end command It is possible to process an execution command of an application to be executed during a call using the converted voice call content.

According to another aspect of the present invention, there is provided a method for providing a service during a call, the method comprising the steps of: recording a voice call between a user and a calling party using a user terminal, Converting at least one application executable during a call by a user in a call to a text based on an event generated as an execution instruction for at least one application executable during a call is selected, Extracting a performance command, and processing an execution command of the extracted application based on the voice conversation converted into text, thereby executing the application concurrently with the call.

According to the apparatus for providing a service during a call and the method for using the same according to an embodiment of the present invention, an event generated by an operation or an utterance of a user during a call is processed, So that it is possible to provide convenience to the user in using the user terminal.

In addition, since multi-tasking can be performed for an application installed in the user terminal, the user terminal can be efficiently used.

1 is a block diagram illustrating an apparatus for providing a service during a call according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an example of displaying a list of at least one application executable during a call according to an exemplary embodiment of the present invention and a processing result of an application execution command on a display unit. FIG.
3 is an exemplary diagram illustrating an execution command registered in advance for at least one application executable during a call according to an embodiment of the present invention.
4 is a flowchart illustrating a method for providing a service during a call according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, A, B, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram illustrating an apparatus for providing a service during a call according to an embodiment of the present invention. FIG. 2 illustrates a list of at least one application executable during a call according to an exemplary embodiment of the present invention, And displaying the result on the display unit.

3 is an exemplary diagram illustrating an execution command registered in advance for at least one application executable during a call according to an embodiment of the present invention.

1 to 3, the on-the-call service providing apparatus 100 may be implemented in a user terminal operated by a user to simultaneously provide at least one application of a call to a user.

Here, the user terminal may mean an information processing device such as a computer, a notebook, a smart phone, or a tablet PC, but the present invention is not limited thereto. Various sensors, A communication device capable of transmitting / receiving information through a wired / wireless network, a display device for displaying information, and various devices having an information processing function for processing an operation or voice of a recognized user.

At this time, the user terminal can be connected to other user terminals through various communication interfaces such as WiFi (Wireless Fidelity), 3G (3G), and LTE (Long Term Evolution) to provide a call service. In addition, it is possible to provide various services to the user by executing at least one application installed in the user terminal.

In recent years, since the hardware performance of a user terminal has been improved and multi-tasking is possible, a plurality of applications can be simultaneously executed and a plurality of services can be simultaneously provided to a user.

In particular, the present invention proposes an on-the-call service providing apparatus 100 capable of providing a service requested by a user simultaneously with a call to a user using a user terminal.

Thus, the on-the-call service providing apparatus 100 according to the present invention may include a call content recording unit 110, an instruction extraction unit 120, and an instruction execution unit 130, and may further include a display unit 140 can do.

The call content recording unit 110 may record the voice call content between the user and the call party using the user terminal and convert the voice call content into text. Here, the voice conversation contents converted into the text may be temporarily stored in a database in the user terminal or in an external server that monitors the use of the at least one user terminal in real time for a predetermined period.

For example, in the case where the predetermined period is 24 hours, the contents of the voice conversation converted into the text for 24 hours from the end of the communication with the calling party can be temporarily stored. Thus, it can be used when a voice conversation content converted to text is required to process an execution command of an application. At this time, after the preset 24 hours, the temporarily stored voice call contents may be updated or automatically deleted as the user proceeds another call and the new voice call contents are converted into text.

In this way, by using the temporarily stored voice call contents converted into text, it is possible to easily search contents necessary for keyword search without listening to recorded voice call contents. In addition, if the main keyword registered in advance by the user is included in the temporarily stored voice call conversation, the usage content of the main keyword or the usage frequency of the main keyword may be generated and provided as a message after termination of the call. It is not.

Accordingly, the call content recording unit 110 may include identification information of the user terminal, identification information of the terminal operated by the user's call partner, call date, call start time, A header or a tag including identification information of at least one of a time and a recording time may be added to the voice conversation converted into the text, but the present invention is not limited thereto.

When an application is requested by a busy user, the user terminal can generate an event corresponding to the requested application. Here, the application may mean not only a message transmission / reception function, an information search function, a content reproduction function, a memo writing function, and a camera function, which are basically provided in a user terminal, but also various programs additionally installed by a user, But may include all software that can be performed simultaneously with a call at a user terminal without limitation.

The event at the user terminal may be generated as a busy user selects an application from among a list of executable applications among calls displayed on the display unit 140. [

More specifically, as shown in FIG. 2 (a), when a user in a call selects an application required during a call from a list of applications displayed on the display unit 140 of the user terminal 10, .

Here, the list of applications includes a user's current location transmission, reception of the current location of the calling party, difference in distance between the calling user and the calling party, application execution before the call, information retrieval, And / or a view.

At this time, the event may include a start event and a termination event for the application selected by the busy user. For example, when a user in a call touches the display unit 140 displayed with the application once briefly or touches the display unit 140 for a predetermined time, a start event may be generated to execute the application, and the display unit 140 may be continuously operated twice An event may be generated to terminate an application that has been executed during a call, but the present invention is not limited thereto.

The command extracting unit 120 may extract an execution command of an application to be executed during a call, including a start event and an end event for an application selected by a user in a call.

In addition, the command execution unit 130 may process an application execution command extracted based on the voice call conversions converted to text, thereby simultaneously executing an application during a call.

For example, when the appointment place location transmission application A is selected by the user in the call from the list of the applications displayed on the display unit 140 as shown in FIG. 2A, the instruction extraction unit 120 extracts, The application execution command including the start event and the end event of the appointment place location transmission application A generated in accordance with the operation of the user in charge.

Thus, the command execution unit 130 analyzes the contents of the voice conversation converted into the text corresponding to the time from the time when the start event of the application execution command extracted by the command extraction unit 120 is generated until the time when the end event is generated And displays the position of the appointed appointment place as shown in FIG. 2 (b) on the map (B), and displays the position of the appointed appointment place on the display unit 140 of the user terminal and the terminal of the communication partner By doing so, it is possible to carry out the busy place transfer application simultaneously.

The event may also be generated as the execution command for at least one application executable by the user in the call using the user terminal during a call is uttered. At this time, the execution command for the application may include a start command and an end command pre-registered for at least one application executable during a call as shown in Fig.

For example, when a user in a call is in a "call" mode, the "current location transfer", the "incoming call destination", "the distance difference", "appointment place", "appointment place transfer" The application corresponding to the start command is initiated during the call and the execution is terminated when a previously registered end command such as "end", "end", "completion", "end" The application being terminated.

The instruction extracting unit 120 may extract an execution command of an application to be executed during a call, including a start instruction and an end instruction for an application uttered by a user in a call.

In addition, the command execution unit 130 may process an application execution command extracted based on the voice call conversions converted to text, thereby simultaneously executing an application during a call.

Specifically, for example, a " memo " as a start command registered in advance by a busy user can be uttered. Accordingly, the command extracting unit 120 can extract an execution command of an application to be executed during a call, including a start command " memo " uttered by a user in a call and an end command " end ".

Thus, the command execution unit 130 receives the voice conversation content converted from text from the time when the start command extracted by the command extraction unit 120 is uttered until the time when the end command is uttered, from the call content recording unit 110 The user can simultaneously perform the on-the-call memo application by displaying it on the display unit 140 of the user terminal.

As described above, the display unit 140 may display a list of at least one application executable during a call so as to be selected by a user in a call, or may display a processing result of an execution command of the application.

4 is a flowchart illustrating a method for providing a service during a call according to an embodiment of the present invention.

Referring to FIG. 4, a method of providing a service during a call includes steps of recording a voice call content between a calling user and a calling party and converting the voice call into text (S100) Extracting an execution command (S200), and processing an execution command of an application (S300) based on the voice conversation converted into text.

At this time, the service provision method during communication is performed in the service provision apparatus during the communication of the user terminal operated by the user, so that at least one application of the calls can be simultaneously provided to the user.

Here, the application may mean not only a message transmission / reception function, an information search function, a content reproduction function, a memo writing function, and a camera function, which are basically provided in a user terminal, but also various programs additionally installed by a user, But may include all software that can be performed simultaneously with a call at a user terminal without limitation.

The user terminal may refer to an information processing device such as a computer, a notebook, a smart phone, or a tablet PC, but may include various sensors capable of recognizing user's actions or voices, A display device for displaying information, and various devices having an information processing function for processing an operation or a voice of a recognized user.

Also, the user terminal can be connected to other user terminals through various communication interfaces such as WiFi (Wireless Fidelity), 3G (3G), and LTE (Long Term Evolution) to provide a call service. In addition, it is possible to provide various services to the user by executing at least one application installed in the user terminal.

In order to simultaneously provide at least one application of the call to the user, the voice call content between the calling user and the calling party can be recorded and converted into text (S100).

Here, the voice conversation contents converted into the text may be temporarily stored in a database in the user terminal or in an external server monitoring in real time the use of the at least one user terminal for a predetermined period, A header or a tag including identification information of a user terminal and identification information of a terminal operated by the user of the call destination, at least one of a call date, a call start time, an end time, and a recording time, (tag) may be added to the voice conversation converted into text, but the present invention is not limited thereto.

In this way, by using the temporarily stored voice call contents converted into text, it is possible to easily search contents necessary for keyword search without listening to recorded voice call contents. In addition, if the main keyword previously registered by the user is included in the temporarily stored voice call conversation, the content of the main keyword or the usage frequency of the main keyword may be generated and provided as a message after the call is terminated.

When an application is requested by a busy user, the user terminal can generate an event corresponding to the requested application. That is, the event may be generated as a user in a call selects an application from a list of executable applications among calls displayed on the display unit. More specifically, the event may include a start event and an end event for the application depending on the behavior of the user in the call.

Here, the list of applications includes a user's current location transmission, reception of the current location of the calling party, difference in distance between the calling user and the calling party, application execution before the call, information retrieval, Examples include, but are not limited to, at least one of the following examples.

The event may also be generated as the execution command for at least one application executable by the user in the call using the user terminal during a call is uttered. At this time, the execution command for the application may include a start command and an end command pre-registered for at least one application executable during a call.

In this manner, at least one application executable during the call is selected by the user in the call or an execution command of the application to be executed during the call is extracted based on the event generated as the execution command for at least one application executable during the call is uttered (S200).

First, when an application to be executed during a call is selected through a display unit, an execution command of an application to be executed during a call can be extracted including a start event and an end event for an application selected by a user in a call.

On the other hand, when an application to be executed during a call is uttered by a busy user, an execution command of an application to be executed during a call can be extracted including a start command and an end command for the application.

Thus, it is possible to process an execution command of the extracted application based on the voice conversation contents converted into the text (S300). That is, the voice call contents converted into the text corresponding to the generation period between the start event and the end event of the application execution command are analyzed, and the execution command of the extracted application is processed to simultaneously perform the application during the call.

In addition, by receiving the voice communication contents converted into text from the time when the extracted start command is uttered until the time when the end command is uttered, and processing the execution command of the extracted application to display on the display unit of the user terminal, Can be performed simultaneously.

According to the apparatus for providing a service during a call and the method for using the same according to an embodiment of the present invention, an event generated by an operation or an utterance of a user during a call is processed, So that it is possible to provide convenience to the user in using the user terminal.

In addition, since multi-tasking can be performed for an application installed in the user terminal, the user terminal can be efficiently used.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the present invention as defined by the following claims It can be understood that

10: user terminal 100:
110: call content recording unit 120: command extracting unit
130: command execution unit 140: display unit

Claims (15)

In a user terminal operated by a user,
A call content recording unit for recording the voice call content between the user and the call destination using the user terminal and converting the voice call content into text;
Extracting an execution command of an application to be executed during a call based on an event that is generated as a result of selection of at least one executable executable executable instruction for at least one application executable by the user in the call An instruction extractor; And
And an instruction execution unit for processing the execution command of the extracted application based on the voice conversation contents converted into the text to simultaneously execute the application during a call. The method according to claim 1,
The call content recording unit,
The voice communication contents converted into the text are temporarily stored in a database in the user terminal or in an external server monitoring in real time the use of the at least one user terminal for a preset period of time and used for processing the execution command of the application Wherein the service providing apparatus comprises: The method according to claim 1,
Further comprising a display unit for displaying a list of at least one application executable during the call so as to be selected by the user in the call or displaying a processing result of an execution command of the application, . The method of claim 3,
Wherein the list for the at least one application comprises:
A position difference between the calling user and the calling party, execution of the application used before the call, information search, memo creation, and viewing of the application types executable during the communication Wherein the service providing apparatus comprises: The method of claim 4,
In the event,
And a start event and an end event for the application selected by the busy user among the list of at least one application executable among the calls displayed on the display unit. The method of claim 5,
In the event,
Wherein an execution command including a start command and an end command registered in advance for each of at least one application executable during the call is generated by the calling user. The method of claim 6,
Wherein the instruction extracting unit comprises:
Extracting an execution command of an application to be executed during the call, including a start event and an end event for an application selected by the busy user,
And extracts an execution command of an application to be executed during the call including the start command and the end command issued by the user in the call. The method of claim 7,
Wherein the command execution unit comprises:
Processing the execution command of the application to be executed during the call using the voice call conversation converted into the text corresponding to the time between the start event and the end event,
Wherein the processing unit is configured to process an execution command of an application to be executed during the call using the voice conversation contents converted into the text corresponding to the time between the ignited start command and the end command. A method performed in a service providing apparatus during communication of a user terminal,
Recording a voice call content between a calling party and a calling party using the user terminal and converting the voice call content into text;
Extracting an execution command of an application to be executed during a call based on an event that is generated as a result of selection of at least one executable executable executable instruction for at least one application executable by the user in the call step; And
And processing an execution command of the extracted application based on the voice call conversions converted to the text to perform an application at the same time as a call. The method of claim 9,
The method of claim 1,
The voice communication contents converted into the text are temporarily stored in a database in the user terminal or in an external server monitoring in real time the use of the at least one user terminal for a preset period of time and used for processing the execution command of the application Wherein said method comprises the steps of: The method of claim 9,
In the event,
And a start event and an end event for the application selected by the busy user among the list of at least one application executable during the call. The method of claim 11,
Wherein the list for the at least one application comprises:
A position difference between the calling user and the calling party, execution of the application used before the call, information search, memo creation, and viewing of the application types executable during the communication Wherein the method comprises the steps of: The method of claim 11,
In the event,
Wherein an execution command including a start command and an end command registered in advance for each of at least one application executable during the call is generated by the user in the call. 14. The method of claim 13,
Wherein the extracting of the execution command of the application to be executed during the call comprises:
Extracting an execution command of an application to be executed during the call, including a start event and an end event for an application selected by the busy user,
And extracting an execution command of an application to be executed during the call including the start command and the end command uttered by the user in the call. 15. The method of claim 14,
The step of performing the application comprises:
Processing the execution command of the application to be executed during the call using the voice call conversation converted into the text corresponding to the time between the start event and the end event,
Wherein the execution command of the application to be executed during the call is processed using the voice conversation content converted into the text corresponding to the time between the ignited start command and the end command.

Images