KR101470753B1 - Terminal, Server, Method, and Recording Medium for Auto-Scheduling based on Communication Context - Google Patents

Abstract

The present invention relates to an auto-scheduling terminal based on communication contents, a server, a method, and a recording medium capable of analyzing the communication contents, actively extracting words/sentences related to a schedule, and reflecting the same on the schedule of a caller. The auto-scheduling method based on the communication contents according to an embodiment of the present invention, which is performed in a terminal, further comprises (a) a step for matching schedule related information extracted from the communication contents of a member with communication information of the opposite member and displaying the same; (b) a step for reflecting the displayed schedule related information on the schedule and storing the same; (c) a step for editing or modifying the schedule related information displayed in the (a) step according to the selection of a user; and (d) a step for offering an alarm for an overlapped schedule when the schedule related information stored in the (b) step is overlapped with stored schedule related information.

Description

Technical Field [0001] The present invention relates to a terminal, a server, a method, and a recording medium for automatic content-based automatic scheduling.

The present invention relates to a terminal, a server, a method, and a recording medium for communication content-based automatic scheduling, which can actively extract a schedule related word / sentence by analyzing a communication content and reflect it on a schedule of a speaker.

Speech Recognition refers to a technology in which a computer analyzes voice and converts it into character data. It is one of the technologies that is attracting attention because it can input information quickly and easily by voice without using a separate input device such as a keyboard.

Speech recognition has been used in various ways in smart phones. The iPhone provides a voice command function that allows users to execute simple commands such as running apps by voice, and Google provides a service for searching the web by voice.

In addition, a translation application that uses a user's voice to speak in another language or an application that checks the user's pitch is also an example of using speech recognition technology.

In the meantime, the appearance of 'Shirai' presented a new leap forward in speech recognition technology. Siri (Speech Interpretation and Recognition Interface) was first introduced in iPhone 4S in 2011 as a speech recognition service provided by Apple. Originally developed as a part of the commercial CALO project developed for military use, it was first developed as an application on the iPhone 3GS and became popular. In April 2010, Apple acquired Shirley exclusively and the current Apple Shiri was born. The characteristics of the series are not simply recognizing the voice, but it can solve all the tasks with one voice command in conjunction with various applications. It also provides the learning recognition function and the function to increase the recognition rate by learning the user's voice, In particular, it has an algorithm that can answer various queries based on database center using dialog processing. Also, the reason that Shiri got popular was that he could express freely as he could talk with people. It is a remarkable development compared to the fact that existing speech recognition services have been successfully recognized only in the form of a sentence.

Since then, voice recognition services such as Samsung's S-Voice, LG Electronics' Q-Voice, and PENTEC's Smart Voice have appeared, making it easier to use smartphones.

However, the conventional speech recognition services described above can be applied to terminal control (e.g., call connection according to a voice command, alarm, schedule management, mail / text sending) according to a voice command, (For example, connection to a web browser, etc.), it has a limitation that it is based on passive operation by the user's command.

Published Patent Publication No. 10-2008-0068793 (published on July 24, 2008)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned conventional limitations and it is an object of the present invention to provide a communication content based automatic scheduling terminal for analyzing communication contents and actively extracting a certain related word / , A server, a method, and a recording medium.

According to an aspect of the present invention, there is provided a terminal for automatic content-based automatic scheduling, the terminal comprising: a schedule display unit for displaying schedule-related information extracted from communication contents of at least one of a subscriber itself and a communication counterpart; And a schedule reflector for reflecting the displayed schedule related information on a schedule and storing the schedule related information in a schedule, the scheduler may include a scheduler for editing or modifying the schedule schedule related information according to a user's selection, An alarm unit for providing an alarm for the redundant schedule when the schedule information is overlapped with the schedule information, and an information receiving unit for receiving the schedule related information from the server, And may further include one.

The schedule display unit may display the schedule related information immediately after the information receiving unit receives the schedule related information from the server, and the schedule display unit may display schedule related information extracted from the communication contents of at least one of the subscriber itself and the communication counterpart, Information of the subscriber can be displayed by matching with the communication counterpart information of the subscriber. The schedule related information may include at least one of Time, Place, Occasion, and Event.

According to another aspect of the present invention, there is provided a server for automatic content-based scheduling, comprising: an information extraction unit for extracting schedule-related information from a communication content of a subscriber; And an information providing unit for providing the extracted schedule related information to the terminal of the subscriber, and may further include an information storage unit for (log) storing the extracted schedule related information, A time, a place, and a schedule name.

The information extracting unit may extract schedule related information from the communication content during communication of the subscriber, and the information providing unit may transmit the extracted schedule related information to the subscriber in accordance with a selection of the user or automatically And the information providing unit may provide the extracted schedule related information to the terminal of the subscriber by matching with the communication counterpart information of the subscriber.

According to another aspect of the present invention, there is provided a method for automatic content-based scheduling, the method comprising the steps of: (a) displaying schedule-related information extracted from a communication content of a subscriber; ; And (b) reflecting the schedule related information displayed on the schedule, and (c) editing or modifying the schedule related information displayed in the step (a) according to a user's selection, And (d) if the schedule-related information stored in the step (b) overlaps with the previously stored schedule-related information, providing an alarm about the overlap schedule.

Wherein the step (a) can display the schedule-related information extracted from the communication contents of at least one of the subscriber itself and the communication counterpart with matching information of the communication counterpart of the subscriber, and in the step (a) The schedule related information can be displayed immediately after the completion of the reception of the schedule related information, and the schedule related information can be displayed at a time, a place, And may include one or more of a specified name.

According to another aspect of the present invention, there is provided a method for automatic content-based scheduling, the method comprising the steps of: (a) extracting schedule-related information from a communication content of a subscriber; And (b) providing the extracted schedule-related information to the terminal of the subscriber; and (c) storing (log) the schedule-related information extracted in the step (a) And the schedule related information may include at least one of a time, a place, and a schedule name.

Wherein the step (a) extracts the schedule-related information from the communication content during the communication of the subscriber, and the step (b) Alternatively, the step (b) may provide the extracted schedule-related information to the terminal of the subscriber by matching with the communication counterpart information of the subscriber.

According to another aspect of the present invention, there is provided a computer-readable recording medium recording a program for causing a computer to execute a method for automatic content-based scheduling.

As described above, according to various aspects of the present invention, based on an active operation of automatically catching schedule-related information based on conversation contents of participants during communication such as voice call, video call, chat, and messaging service It is different from existing voice recognition service, which operates only when a user wants to express a desired function. In other words, based on the speech recognition solution and context aware solution, related words or phrases such as time, place, and schedule name that can be reflected in the schedule among the contents revealed by customers can be automatically extracted and reflected on the schedule during or after the call There is an effect that can be supported. Therefore, when the call is made, the schedule is arranged so that the customer can feel the convenience of managing the schedule without separately performing the memo / cleanup operation during the call.

1 is a configuration diagram of a system for automatic content-based scheduling according to an embodiment of the present invention;
2 is a configuration diagram of a terminal for automatic content-based scheduling according to an embodiment of the present invention;
3 is a configuration diagram of a server for automatic content-based scheduling according to an exemplary embodiment of the present invention.
4 is a flowchart of a method for automatic content-based scheduling performed in a terminal according to an embodiment of the present invention;
5 is a flowchart of a method for automatic content-based scheduling performed in a server according to an embodiment of the present invention;
6 is a view illustrating an example of schedule related information displayed on a screen of a terminal according to an embodiment of the present invention;
7 is a view illustrating an example of a screen for editing / editing schedule-related information displayed on a terminal according to an embodiment of the present invention;
8 is a diagram illustrating an example of a schedule list displayed on a screen of a terminal according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, like reference numerals are used to denote like elements in the drawings, even if they are shown in different drawings. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

1 is a block diagram of a system for automatic content-based automatic scheduling according to an embodiment of the present invention. As shown in the figure, a communication network 10, a terminal A 20A, a terminal B 20B, and a server 30).

The communication network 10 is connected to the terminal A 20A, the terminal B 20B and the server 30 by wire, wireless and / or Internet to perform voice communication, video call, chat-messaging service (SMS, MMS, SNS, and the like).

One of the terminal A 20A and the terminal B 20B indicates a terminal of a calling user and the other terminal indicates a terminal of a counterpart receiving user. For example, voice communication, video communication, data communication, A mobile communication terminal, a PDA, a smart phone, a tablet PC, and the like. In this embodiment, at least one of the users of the sending / receiving terminals 20A and 20B may be a subscriber of the corresponding service.

The server 30 extracts various information including schedule related information based on the communication contents between the terminal A 20A and the terminal B 20B, logs the extracted information and stores the information (hereinafter referred to as log storage) And provides one information selected from the terminal A 20A or the terminal B 20B to the corresponding terminal from among the extracted information or log stored information. For example, a voice recognition solution, a context aware solution, A keyword server, a keyword extracting logic, and a call / chat result gathering function, and a cloud server for log-storing various information extracted from the service server and transmitted.

In the present embodiment, log storage refers to storing information related to a communication party, various types of information extracted from real-time communication contents, and communication date and time.

FIG. 2 is a detailed configuration diagram of the terminal A 20A or the terminal B 20B shown in FIG. 1 as a configuration of a terminal for communication content-based automatic scheduling according to an embodiment of the present invention. An information receiving unit 21, a schedule display unit 23, a schedule reflecting unit 25, a constant correction unit 27, and an alarm unit 29. [

The information receiving unit 21 is for receiving the schedule related information extracted from the communication content of at least one of the user (subscriber) or the counterpart, from the corresponding server 30 during the communication or after completion of communication, May be selected by the user or automatically received.

In this embodiment, the schedule-related information may include at least one of Time, Place, and Occasion (Event) names.

The schedule display unit 23 is for sorting the schedule-related information received through the information receiving unit 21 in order of speaking time and displaying on the screen by matching with the communication counterpart information of the subscriber. For example, As shown in the figure, the communication counterpart information is displayed at the top of the screen as 'MindTalk with Suzie', and an app icon for using various related applications (schedule, alarm, memo, message, etc.) (Date information, time information), a place name (Gangnam Station, etc.), and a schedule name (blind date, etc.) as schedule related information can be displayed.

(5/20) +1 day = May 21, 6:00 pm at 6 pm "as the time information from the communication contents such as" Let's meet at Gangnam Station tomorrow at 6 o'clock tomorrow " Related information such as " = Gangnam station ", and "Meet-to-Meet" as a schedule name. The extraction of the schedule-related information may be performed not only in the server 30 but also in the terminal.

The schedule reflecting unit 25 is for reflecting the schedule related information displayed on the screen on the schedule through the schedule display unit 23 and storing the schedule related information. For example, when a specific button is selected by the user or automatically The schedule related information displayed in the sorted order can be reflected by a schedule (schedule) application or a memo application in the terminal and stored.

The schedule corrector 27 is for editing or modifying the schedule-related information displayed on the screen on the schedule display unit 23 according to the user's selection. For example, as shown in FIG. 7 (a) The extracted keywords (Gangnam Station, Shinchon, etc.) related to the place when the 'Place' column is selected are arranged and displayed in the latest order of the utterance order, and when 'Gangnam Station' is selected as shown in FIG. 7 (b) The Gangnam station can be automatically entered into the cell. The information and the name of the date and time may also be edited or modified in the manner described above, but the present invention is not limited to this, and the information can be edited / modified by a method of directly inputting the text in the corresponding field.

The alarm unit 29 provides an alarm for the overlapping schedule if the stored schedule information overlaps with the stored schedule information through the schedule reflecting unit 25, The duplicate schedule information can be edited or modified through the scheduler 27 and stored again through the scheduler 25.

FIG. 3 is a block diagram of a server for automatic content-based scheduling according to an embodiment of the present invention. As shown in FIG. 1, the server 30 includes an information extracting unit 31, An information storage unit 33, and an information providing unit 35. [

The information extracting unit 31 is for extracting various information including schedule related information based on the communication content. For example, during the communication of the subscriber, a time, a place, A word or a sentence associated with an Occasion (Event) name or the like can be extracted as schedule related information.

(5/20) +1 day = May 21, 6:00 pm at 6 pm "as the time information from the communication contents such as" Let's meet at Gangnam Station tomorrow at 6 o'clock tomorrow " = Gangnam Station ", and schedule name-related information such as "Meet-to-Meet ".

For example, when the user of the terminal B (20B), which is the communication partner, is not a service subscriber according to the present embodiment with respect to one of the subscriber terminals A (20A) outgoing / The user of the terminal B 20B, which is the communication partner with respect to the subscriber terminal A 20A, can extract the schedule related information by analyzing the contents of the voice call only by the user of the terminal A 20A, The subscriber terminal A 20A can simultaneously analyze the voice call contents of the user and the voice call contents of the user of the opposite party subscriber terminal B 20B to extract calendar related information of the caller.

The information storage unit 33 is for storing the schedule-related information extracted by the information extraction unit 31, and may be configured as a separate cloud server or the like.

The information providing unit 35 is for providing schedule related information extracted in real time in the information extracting unit 31 or stored in the information storing unit 33 to the corresponding terminal according to a user's selection or automatically. For example, Related information extracted from the real-time communication contents may be provided to the corresponding terminal in a predetermined time interval during the communication with the communication counterpart information, or may be provided to the corresponding terminal, for example, It can be provided by matching with the counter party information.

FIG. 4 is a flowchart of a method for automatic content-based scheduling performed in a terminal according to an embodiment of the present invention, and is applied to the terminal A 20A or the terminal B 20B in FIG. .

First, the information receiving unit 21 requests schedule related information to the server 30 during communication with the counterpart terminal or after communication with the counterpart terminal 30 (S401), receives the schedule related information from the server 30 , The schedule display unit 23 displays the received schedule-related information on the screen as shown in Fig. 6 (S403).

On the other hand, if the schedule related information displayed on the screen through the schedule display unit 23 in step S403 is modified or updated as described above with reference to FIG. 7 (a) and (b) If it is edited / edited by the user, the editing / editing process is performed (S405).

The schedule reflector 25 reflects the schedule related information displayed on the screen in step S403 according to the user's selection or automatically in the app related to the schedule such as the schedule / schedule application or the memo application and stores the information in step S405 Related information is corrected or edited through the schedule changer 25, the modified or edited schedule-related information is reflected and stored in the related application of the terminal. If the schedule related information is not modified or edited in step S405, In step S403, the schedule-related information displayed on the screen is reflected and stored in the related app of the terminal (S407).

In step S407, the alarm unit 29 determines whether or not the schedule (related) information stored in the related app is stored in the schedule information unit 25 in at least one of the predetermined (related) information and the time, place, If the information is duplicated, the user is informed of the duplication information. Then, the process returns to the process of step S405 to modify or edit the schedule-related information so that the schedule-related information can be stored again.

On the other hand, when the user searches for a schedule of a specific date through the schedule / schedule application, the schedule display unit 23 arranges and displays the entire schedule list of the date with the information of the communication counterpart in chronological order as shown in FIG. 8 .

FIG. 5 is a flowchart of a method for automatic content-based scheduling performed in a server according to an embodiment of the present invention, and is applied to the server 30 shown in FIGS. 1 and 3. Accordingly, do.

First, when communication (voice communication, message communication, or the like) between the terminal A 20A and the terminal B 20B starts (S501), schedule related information is extracted in real time from one or both communication contents (S503).

Then, the schedule related information extracted from the terminal A (20A) or the terminal B (20B) in step S503 is transmitted to the terminal in response to the schedule related information request, (S505 to S507).

Meanwhile, the schedule related information extracted in real time in step S503 is log-stored (S511). After the completion of the call, log-in is performed from the terminal A 20A or the terminal B 20B, (S513), the stored schedule related information is matched with the communication counterpart information and provided to the corresponding terminal (S515).

According to another embodiment of the present invention, all the configurations 31,33, 35 of the server 30 implemented as described above with reference to Figure 3 can be implemented equally within the user terminal 20A or 20B of Figure 2 In this case, only the configuration of the user terminal 20A or 20B including the function of the server 30 without the server 30 can be applied to the communication content based automatic scheduling according to the embodiment of the present invention described above with reference to FIGS. You can run both methods for.

As described above, the method for automatic content-based scheduling according to an embodiment of the present invention can be implemented as a computer-readable recording medium including program instructions for performing various computer-implemented operations. The computer-readable recording medium may include a program command, a local data file, a local data structure, or the like, alone or in combination. The recording medium may be those specially designed and constructed for the embodiments of the present invention or may be those known to those skilled in the computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floppy disks, and ROMs, And hardware devices specifically configured to store and execute the same program instructions. The recording medium may be a transmission medium such as an optical or metal line, a wave guide, or the like, including a carrier wave for transmitting a signal designating a program command, a local data structure, or the like. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

10: Network
20A, 20B: a user terminal
21: Information receiving section
23: information display section
25: schedule reflector
27: Constitutional Government
29: Alarm section
30: Server
31: information extracting unit
33: Information storage unit
35: Information provision

Claims (25)

A schedule display unit for displaying schedule related information extracted from communication contents of at least one of a subscriber itself and a communication counterpart;
A schedule reflector for reflecting the schedule related information displayed on the schedule and storing the schedule related information; And
And an information receiver for receiving the schedule-related information from the server automatically or automatically according to a user's selection during the communication,
Wherein the predetermined display unit displays the schedule related information extracted from the communication content of at least one of the subscriber itself and the communication counterpart with the communication counterpart information of the subscriber and displays the matched information. delete The method according to claim 1,
Further comprising a schedule modifying unit for editing or modifying the displayed schedule related information according to a user's selection. The method according to claim 1,
Further comprising an alarm unit for providing an alarm for the overlap schedule when the stored schedule related information overlaps with the stored schedule information. The method according to claim 1,
Wherein the schedule related information includes at least one of a time, a place, and an occasion and an event name. The method according to claim 1,
Wherein the information receiver receives the schedule-related information from the server either during or after completion of the communication according to a user's selection or automatically,
Wherein the schedule display unit displays the schedule related information immediately after the information receiving unit receives the schedule related information from the server. An information extraction unit for extracting schedule related information from the communication contents of the subscriber; And
And an information providing unit for providing the extracted schedule related information to the terminal of the subscriber,
The information providing unit matches the extracted schedule-related information with the communication counterpart information of the subscriber and provides the same to the subscriber's terminal,
Wherein the information providing unit provides the extracted schedule-related information to the terminal of the subscriber according to a user's selection or automatically during the communication. delete 8. The method of claim 7,
Wherein the information extraction unit extracts schedule related information from the communication contents during communication of the subscriber. 10. The method of claim 9,
Wherein the information providing unit provides the extracted schedule-related information to the terminal of the subscriber in accordance with a user's selection or automatically after the completion of the communication or during the communication. 8. The method of claim 7,
Wherein the schedule related information includes at least one of a time, a place, and a schedule name. 8. The method of claim 7,
And an information storage unit for storing (log) the extracted schedule-related information. A method for performing in a terminal,
(a) displaying schedule related information extracted from communication contents of a subscriber; And
(b) reflecting the schedule related information displayed on the schedule,
Wherein the step (a) matches the schedule-related information extracted from the communication content of at least one of the subscriber itself and the communication counterpart with the communication counterpart information of the subscriber,
Wherein the step (a) receives and displays schedule-related information from the server according to a user's selection or automatically during the communication. delete 14. The method of claim 13,
(c) editing or modifying schedule-related information displayed in step (a) according to a user's selection. 16. The method of claim 15,
(d) if the stored schedule-related information is overlapped with the previously stored schedule-related information, providing an alarm for the corresponding duplicate schedule; and . 16. The method of claim 15,
Wherein the schedule related information includes at least one of a time, a place, and a schedule name. 16. The method of claim 15,
Wherein, in the step (a), the schedule-related information is received from the server either automatically or immediately after the communication is completed or immediately after completion of the communication, and the schedule-related information is displayed immediately after receiving the schedule- A method for automatic scheduling. A method performed by a server,
(a) extracting schedule related information from communication contents of a subscriber; And
(b) providing the extracted schedule-related information to the terminal of the subscriber,
Wherein the step (b) matches the extracted schedule-related information with the communication counterpart information of the subscriber and provides the same to the subscriber terminal,
And the step (b) provides the extracted schedule-related information to the terminal of the subscriber according to a user's selection or automatically during the communication. delete 20. The method of claim 19,
Wherein the step (a) extracts schedule-related information from the communication content during communication of the subscriber. 22. The method of claim 21,
Wherein the step (b) provides the extracted schedule-related information to the terminal of the subscriber according to a selection of the user or directly after the completion of the corresponding communication. 20. The method of claim 19,
Wherein the schedule related information includes at least one of a time, a place, and a schedule name. 20. The method of claim 19,
(c) storing (log) the schedule related information extracted in the step (a). A computer-readable recording medium having recorded thereon a program for causing a computer to execute a method for automatic content-based automatic scheduling according to any one of claims 13, 15 to 19, and 21 to 24.

Images