KR101798765B1 - Apparatus and Method for responding to inquiry while talking over the telephone - Google Patents

Abstract

The present invention analyzes an intention of a user through intelligent judgment / analysis and allows a user in a call to recognize and process a user's request without directly searching for or acting on the call, A real-time response method for a call inquiry according to an aspect of the present invention includes the steps of: (a) receiving a real-time call content of a subscriber terminal as a basis Recognizing whether or not to make a call to the concierge server; (b) controlling the concierge server to participate in a real-time call session of the subscriber terminal when the call is recognized in step (a); And (c) when the concierge server is in the participating call session. Recognizing a query / request item from the subscriber terminal or the counterpart terminal based on the real-time communication content between the concierge server and the subscriber terminal or the communication counterpart terminal of the subscriber terminal, and outputs the result of the inquiry / To the subscriber terminal and the counterpart terminal through the participating call session.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and apparatus for real-

The present invention relates to an apparatus and method for performing a response or a corresponding function to a query and a request of a user during a call using voice recognition.

Speech Recognition refers to a technology in which a computer analyzes voice and converts it into character data. It is one of the technologies that is attracting attention because it can input information quickly and easily by voice without using a separate input device such as a keyboard.

Speech recognition has been used in various ways in smart phones. The iPhone provides a voice command function that allows users to execute simple commands such as running apps by voice, and Google provides a service for searching the web by voice.

In addition, a translation application that uses a user's voice to speak in another language or an application that checks the user's pitch is also an example of using speech recognition technology.

In the meantime, the appearance of 'Shirai' presented a new leap forward in speech recognition technology. Siri (Speech Interpretation and Recognition Interface) was first introduced in iPhone 4S in 2011 as a speech recognition service provided by Apple. Originally developed as a part of the commercial CALO project developed for military use, it was first developed as an application on the iPhone 3GS and became popular. In April 2010, Apple acquired Shirley exclusively and the current Apple Shiri was born. The characteristics of the series are not simply recognizing the voice, but it can solve all the tasks with one voice command in conjunction with various applications. It also provides the learning recognition function and the function to increase the recognition rate by learning the user's voice, In particular, it has an algorithm that can answer various queries based on database center using dialog processing. Also, the reason that Shiri got popular was that he could express freely as he could talk with people. It is a remarkable development compared to the fact that existing speech recognition services have been successfully recognized only in the form of a sentence.

Since then, voice recognition services such as Samsung's S-Voice, LG Electronics' Q-Voice, and PENTEC's Smart Voice have appeared, making it easier to use smartphones.

However, the conventional speech recognition services described above can be applied to terminal control (e.g., call connection according to a voice command, alarm, schedule management, mail / text sending) according to a voice command, (For example, connection to a web browser). Therefore, there is a limitation that it is based on passive operation by a user's command, and a feedback form is given to only one user who requests a command There is a problem in that it is impossible to search / confirm other facts other than the conversation or to use other service functions during a call because it is impossible to use them in parallel while using other service functions such as calls.

Korean Registered Patent No. 10-0930248 (Registered on November 30, 2009)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned conventional problems, and its object is to analyze user's intention through intelligent judgment / analysis, so that a user in a call can recognize and process a user's requirement The present invention also provides a real-time response device and method for in-the-call inquiry, in which the result of the processing can be fed back to the other party on the call with the call request requester as well as the call request without disturbing the call.

According to an aspect of the present invention, there is provided a real-time response device for a call-in-progress query, comprising: a concierge control server for recognizing whether a call is made to a concierge server based on real- A call control server for controlling the concierge server to participate in a real-time call session of the subscriber terminal when the call is recognized; And recognizing a query / request item from the subscriber terminal or the counterpart terminal based on real-time communication contents between the concierge server and the subscriber terminal or the counterpart terminal of the subscriber terminal through the participating call session, And a concierge server for transmitting the result of the inquiry / request to the at least one of the subscriber terminal and the counterpart terminal through the participating call session.

The concierge control server can recognize that there is a call to the concierge server when a predetermined specific word among the real-time communication contents of the subscriber terminal occurs.

The call control server invites the concierge server to participate in the real-time call session of the subscriber terminal when the call is recognized in the concierge control server, and the concierge server accepts the invitation and transmits the invitation to the real- You can participate.

According to another aspect of the present invention, there is provided a method for real-time response to a call query, the method comprising the steps of: (a) recognizing whether or not to call a concierge server based on a real- (b) controlling the concierge server to participate in a real-time call session of the subscriber terminal when the call is recognized in step (a); And (c) when the concierge server is in the participating call session. Recognizing a query / request item from the subscriber terminal or the counterpart terminal based on the real-time communication content between the concierge server and the subscriber terminal or the communication counterpart terminal of the subscriber terminal, and outputs the result of the inquiry / To at least one of the subscriber terminal and the counterpart terminal through the participating call session.

The step (a) may recognize that there is a call to the concierge server when a predetermined specific word among the real-time communication contents of the subscriber terminal occurs.

If the call is recognized, the step (b) invites the concierge server to a real-time call session of the subscriber terminal through the call control server of the communication network, and the concierge server accepts the invitation, You can participate.

According to another aspect of the present invention, there is provided a computer-readable recording medium storing a program for causing a computer to execute a real-time response method for a call-in-progress query.

According to another aspect of the present invention, there is provided an application (program) stored in a computer-readable recording medium for executing a real-time response method for a call-in-queue query in combination with hardware.

According to another aspect of the present invention, there is provided a computer program stored in a computer-readable recording medium for causing a computer to execute a real-time response method for a call-in-progress query.

As described above, according to various aspects of the present invention, when a call is recognized by recognizing a specific word from conversation contents during a call, the caller can directly participate in a call session between the callers, such as an additional caller, (I.e., feedback according to the content of the call as a person of the caller) by analyzing the content of the conversation by analyzing the content of the conversation, When a query / request is made during a conversation, all the callers can receive feedback directly on the call, and even if they are not in a call using the same system, feedback on inquiries and responses can be received. In addition, / Checked or failed to perform other tasks, Reumyeon can support the call of the parallel and dialogue so that the user can receive the desired result for such search / check or other services requested.

FIG. 1 is a block diagram of a system for real-time response to a query in a call according to an embodiment of the present invention.
FIG. 2 is a block diagram of an apparatus for real-time response to a query in a call according to an embodiment of the present invention;
3 is a flow diagram of a method for real-time response to a call-in-a-call according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, like reference numerals are used to denote like elements in the drawings, even if they are shown in different drawings. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

FIG. 1 is a block diagram of a system for real-time response to a query in a call according to an embodiment of the present invention. As shown in the figure, a communication network 1, a terminal A 11, a terminal B 12, A response device 20, and an intelligence server 30.

The communication network 1 is a single or a plurality of communication networks capable of communicating between the terminal A 11, the terminal B 12, the real-time response device 20 and the intelligence server 30 by wire, wireless and / It can be any mesh of compound.

The terminal A 11 and the terminal B 12 may include a mobile communication terminal, a PDA, a smart phone, or a tablet PC capable of performing voice communication, video communication, data communication, and Internet communication with each other.

The real-time response device 20 has a voice recognition function, an intelligent judgment / analysis function, and a call session participation function, for example, If the call is recognized, the caller joins the call session directly with the additional caller, hears the voice of the existing caller in the participating same call session, analyzes the conversation contents, and processes the user's request As a person, feedback according to the content of the call).

The intelligence server 30 may include one or more servers capable of providing various kinds of information such as personal information, living information, and additional information.

FIG. 2 is a detailed configuration diagram of the real-time response device 20 of FIG. 1 as a device configuration for a real-time response to a query in a call according to an embodiment of the present invention. As shown in FIG. 2, A control server 21, a call control server 23, and a concierge server 25. [

The concierge control server 21 is for recognizing whether or not to call the concierge server based on the real time communication contents of the subscriber terminal 11 or 12. The concierge control server 21 manages the real time communication contents between the subscriber terminal A 11 and the counterpart terminal B 12 And checks whether or not a specific word (Wake-up Word) occurs in the contents of the call. If a predetermined word is generated as a result of the check, the concierge server 25 recognizes that there is a call, The control server 23 can be instructed to call the concierge server 25. [

For example, when the calling name of the concierge server 25 is called 'Jarvis', the calling name 'Jarvis' can be set to a specific word for calling.

Therefore, the concierge control server 21 determines whether or not the call between any one of the terminals A, B (11, 12) The call of the concierge server 25 including the telephone number information of the terminal A, B (11, 12) in the current call is identified by calling the name of the concierge server 25, To the control server 23 to command the concierge server 25 to make a call.

The call control server 23 is for controlling the concierge server 25 to participate in a specific call session formed between one or more terminals (or between a terminal and a specific server) as one of the callers. For example, When a call command message of the concierge server 25 including the telephone number information of the terminals A and B 11 and 12 currently in communication is received from the server 21, the corresponding specific real-time call session, that is, B calls 11 and 12 and the concierge server 25 can participate in the real-time call session between the terminals A and B 11 and 12 so that a three-party call session between the terminals A and B 11 and 12 and the concierge server 25 can be formed.

For example, when the call control server 21 recognizes the call of the concierge server 25 via the concierge control server 21, the concierge server 25 participates in a live call session between the terminals A and B 11 and 12 And the concierge server 25 can accept the invitation and participate in the corresponding real-time call session.

The concierge server 25 transmits the " Based on the contents of real-time communication between the concierge server 25 and the subscriber terminal A 11 or between the subscriber terminal A 12 and the terminal B 12 as a communication partner of the subscriber terminal A 11, And can provide the result of the pertinent inquiry / request to at least one of subscriber terminal A 11 and counterpart terminal B 12 via a participating call session or other communication path. have.

For example, after a three-way call session is established between the terminals A, B 11 and 12 and the concierge server 25, the user of the subscriber terminal A 11 or the counterpart terminal B 12 may select ' The concierge server 25 responds promptly to the owner of the terminal A 11 or the user of the terminal B 12 such as 'What can I do for you?' And the result of the inquired query / request can be found through the intelligence server 3 and converted to voice and provided to the subscriber terminal A 11 and the counterpart terminal B 12 have.

When the request from the subscriber terminal A 11 or the counterpart terminal B 12 requires confirmation of personal information such as a calendar / address book stored in the user's own phone (terminal), the concierge server 25, for example, (Feedback) the result to the terminal A 11 or the terminal B 12 as the corresponding terminal, by searching the personal information DB of the terminal (terminal) concerned.

Concierge server 25 may provide a function of notifying caller or receiver of a call alert for a spam phone such as voice phishing by analyzing call content as another example.

The concierge server 25 may also be configured to send a request to the subscriber terminal A 11 or the counterpart terminal B 12 for delivery of food / flowers, purchase / delivery of goods, Etc., it is possible to provide a function of transferring the request information to the affiliated on / off line agent so as to enable the proxy service.

The concierge server 25 may provide a function to make the terminal A 11 or the terminal B 12 accessible by a special number (ex. ** 019) or the like so that the terminal A 11 or the terminal B 12 can use the service .

In the present invention, the real-time response device 20 can be configured as a physically independent device or as a single integrated device, such as the concierge control server 21, the call control server 23 and the concierge server 25 will be.

3 is a flowchart of a method for real-time response to a query in the call according to an embodiment of the present invention, and is a flowchart of a method performed in the real-time response device 20 of FIG. The operation of the devices 11, 12, and 30 interlocked with the device 20 will be described.

First, during a voice call between the terminal A 11 and the terminal B 12 (S 301), the user of the terminal A 11 or the terminal B 12 receives a "High! The concierge server 21 calls the concierge server 25 in the same way as the concierge server 25 including the telephone number information of the terminals A and B 11 and 12 during the call 25 to the call control server 23 (S305).

The call control server 23 receives the call command message of the concierge server 25 including the telephone number information of the terminals A and B 11 and 12 currently on the call from the concierge control server 21 in step S305, The concierge server 25 invites the participant to participate in the real-time call session between the terminals A and B 11 and 12, and the concierge server 25 accepts the invitation and participates in the corresponding real-time call session at step S307.

In step S307, the concierge server 25 participating in the real-time call session between the terminals A and B 11 and 12 transmits a call request message to the user terminal 11 or the correspondent terminal B 12 from the high- The terminal A 11 or the user of the terminal B 12 as a voice in response to a call such as 'Jarvis' (step S309) S311).

The concierge server 25 then converts the query / request matter recognized as speech in steps S309 to S311 into text and transmits the command to the intelligence server 3 to generate a query / request result (S313) (S317), the result is converted to speech, and the result is transmitted to the intelligent server 3 via the real-time communication session or other communication path in step S307. And responds to the inquiry / request from the user at step S311 by providing it to at least one of the terminal B12 (S319).

As another example of the method for real-time response to the inquiry in the call according to the present invention, the concierge server 25 determines whether the request from the subscriber terminal A 11 or the counterpart terminal B 12 is a schedule / Address book or the like, it searches the personal information DB of the corresponding phone (terminal) and transmits (feedback) the result to the terminal A 11 or B 12 as the corresponding phone .

As another example of the method for real-time response to the inquiry during the call according to the present invention, the concierge server 25 analyzes the contents of the call and notifies the sender or the receiver of a call alert for the spam phone such as voice phishing .

As another example of the method for real-time response to the inquiry in the call according to the present invention, the concierge server 25 may determine whether the request from the subscriber terminal A 11 or the counterpart terminal B 12, In the case of a request for a proxy service requesting a proxy service to connect offline stores such as delivery of food / flower, purchase / delivery of a product, reservation of a ticket, etc., the request is forwarded to an affiliated on / offline agent, .

As another example of the method for real-time response to the inquiry during the call according to the present invention, the concierge server 25 may use a special (ex. ** 019), and so on.

Meanwhile, according to the method for real-time response to the inquiry during a call, the computer-readable recording medium on which the program for causing the computer to execute the method can be implemented.

Meanwhile, according to the above-described method for real-time response to the inquiry during the call, an application (program) stored in a computer-readable recording medium can be implemented in order to execute the method in combination with hardware.

Meanwhile, according to the above-described method for real-time response to the inquiry during a call, a computer program stored in a computer-readable recording medium for implementing the method in a computer can be implemented.

For example, as described above, a method for a multi-call content-based keyword analysis service according to an embodiment of the present invention includes a computer-readable recording medium including program instructions for performing various computer-implemented operations, Lt; RTI ID = 0.0 > and / or < / RTI > The computer-readable recording medium may include a program command, a local data file, a local data structure, or the like, alone or in combination. The recording medium may be those specially designed and constructed for the embodiments of the present invention or may be those known to those skilled in the computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floppy disks, and ROMs, And hardware devices specifically configured to store and execute the same program instructions. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

1: Network
11, 12:
20: Real-time response device
21: Concierge control server
23: Call control server
25: Concierge server
30: Intelligence Server

Claims (15)

A concierge control server for recognizing whether or not to call the concierge server based on the contents of real time communication of the subscriber terminal;
A call control server for controlling the concierge server to participate in a real-time call session of the subscriber terminal when the call is recognized; And
Recognizing a query / request item from the subscriber terminal or the counterpart terminal based on real-time communication contents between the concierge server and the subscriber terminal or the counterpart terminal of the subscriber terminal through the participating call session, And a concierge server for transmitting the result of the inquiry / request to the at least one of the subscriber terminal and the counterpart terminal through the participating call session,
The call control server invites the concierge server to participate in the real-time call session of the subscriber terminal when the call is recognized in the concierge control server, and the concierge server accepts the invitation and transmits the invitation to the real- Wherein the real time response device is a real time response device for a call in progress. The method according to claim 1,
Wherein the concierge control server recognizes that there is a call to the concierge server when a predetermined specific word among the real-time communication contents of the subscriber terminal occurs. delete The method according to claim 1,
Wherein the concierge server retrieves the personal information stored in the terminal of the requester and feeds back the information to the terminal of the principal when the recognized inquiry / request requests the personal information stored in the terminal of the requester. The method according to claim 1,
Wherein the concierge server provides an offline connection so that the pertinent inquiry / request item is an agent service request connected to an offline store, so that the offline service can be performed. The method according to claim 1,
Wherein the concierge server analyzes the conversation contents of the conversation and notifies the recipient terminal of a spam phone alert including voice phishing. (a) recognizing whether or not to call the concierge server based on the real-time communication contents of the subscriber terminal;
(b) controlling the concierge server to participate in a real-time call session of the subscriber terminal when the call is recognized in step (a); And
(c) the concierge server transmits, via the participating call session, a query / request from the subscriber terminal or the counterpart terminal, based on the real-time communication content between the concierge server and the subscriber terminal or the counterpart terminal of the subscriber terminal And communicating the result of the perceived inquiry / request to at least one of the subscriber terminal and the counterpart terminal through the participating call session,
If the call is recognized, the step (b) invites the concierge server to a real-time call session of the subscriber terminal through the call control server of the communication network, and the concierge server accepts the invitation, Wherein the real-time response to the call-in-progress query is performed in response to a query. 8. The method of claim 7,
Wherein the step (a) recognizes that there is a call to the concierge server when a predetermined specific word among the real-time communication contents of the subscriber terminal occurs. delete 8. The method of claim 7,
Wherein in the step (c), when the recognized inquiry / request requests personal information stored in the terminal of the requester, the concierge server searches the information and feeds back the information to the terminal of the principal. Real - time response method for. 8. The method of claim 7,
Wherein the concierge server performs an offline connection so as to proxy the business if the recognized inquiry / request item is an agency business request connected with an offline store. How to respond. 8. The method of claim 7,
Wherein the concierge server analyzes the conversation contents of the call and notifies the receiver terminal of a spam phone alert including voice phishing in step (c). A computer-readable recording medium having recorded thereon a program for causing a computer to execute a real-time response method for the call-in-progress query as set forth in any one of claims 7, 8, 10, An application stored on a computer readable recording medium for executing a real time response method for the on-the-call query of any one of claims 7, 8, and 12 in combination with hardware. A computer program stored on a computer readable recording medium for causing a computer to execute a real-time response method for the on-call query of any one of claims 7, 8, and 10 to 12.

Images